Nov 06 15:33:45 user nova-compute[75337]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=75337) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=75337) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=75337) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 06 15:33:45 user nova-compute[75337]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.018s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:33:45 user nova-compute[75337]: INFO nova.virt.driver [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] Loading compute driver 'libvirt.LibvirtDriver'
Nov 06 15:33:45 user nova-compute[75337]: INFO nova.compute.provider_config [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] Acquiring lock "singleton_lock" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] Acquired lock "singleton_lock" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] Releasing lock "singleton_lock" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] Full set of CONF: {{(pid=75337) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] ******************************************************************************** {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] Configuration options gathered from: {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] ================================================================================ {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] allow_resize_to_same_host      = True {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] arq_binding_timeout            = 300 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] backdoor_port                  = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] backdoor_socket                = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] block_device_allocate_retries  = 300 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] block_device_allocate_retries_interval = 5 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] cert                           = self.pem {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] compute_monitors               = [] {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] config_dir                     = [] {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] config_drive_format            = iso9660 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] config_source                  = [] {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] console_host                   = user {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] control_exchange               = nova {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] cpu_allocation_ratio           = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] daemon                         = False {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] debug                          = True {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] default_access_ip_network_name = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] default_availability_zone      = nova {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] default_ephemeral_format       = ext4 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] default_green_pool_size        = 1000 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] default_schedule_zone          = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] disk_allocation_ratio          = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] enable_new_services            = True {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] enabled_apis                   = ['osapi_compute'] {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] enabled_ssl_apis               = [] {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] flat_injected                  = False {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] force_config_drive             = False {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] force_raw_images               = True {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] graceful_shutdown_timeout      = 5 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] heal_instance_info_cache_interval = 60 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] host                           = user {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] initial_disk_allocation_ratio  = 1.0 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] initial_ram_allocation_ratio   = 1.0 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] instance_build_timeout         = 0 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] instance_delete_interval       = 300 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] instance_format                = [instance: %(uuid)s]  {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] instance_name_template         = instance-%08x {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] instance_usage_audit           = False {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] instance_usage_audit_period    = month {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] internal_service_availability_zone = internal {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] key                            = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] live_migration_retry_count     = 30 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] log_config_append              = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] log_dir                        = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] log_file                       = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] log_options                    = True {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] log_rotate_interval            = 1 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] log_rotate_interval_type       = days {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] log_rotation_type              = none {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] long_rpc_timeout               = 1800 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] max_concurrent_builds          = 10 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] max_concurrent_live_migrations = 1 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] max_concurrent_snapshots       = 5 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] max_local_block_devices        = 3 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] max_logfile_count              = 30 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] max_logfile_size_mb            = 200 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] maximum_instance_delete_attempts = 5 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] metadata_listen                = 0.0.0.0 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] metadata_listen_port           = 8775 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] metadata_workers               = 3 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] migrate_max_retries            = -1 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] mkisofs_cmd                    = genisoimage {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] my_block_storage_ip            = 10.0.0.210 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] my_ip                          = 10.0.0.210 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] network_allocate_retries       = 0 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] osapi_compute_listen           = 0.0.0.0 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] osapi_compute_listen_port      = 8774 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] osapi_compute_unique_server_name_scope =  {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] osapi_compute_workers          = 3 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] password_length                = 12 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] periodic_enable                = True {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] periodic_fuzzy_delay           = 60 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] pointer_model                  = ps2mouse {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] preallocate_images             = none {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] publish_errors                 = False {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] pybasedir                      = /opt/stack/nova {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] ram_allocation_ratio           = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] rate_limit_burst               = 0 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] rate_limit_except_level        = CRITICAL {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] rate_limit_interval            = 0 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] reboot_timeout                 = 0 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] reclaim_instance_interval      = 0 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] record                         = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] reimage_timeout_per_gb         = 60 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] report_interval                = 120 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] rescue_timeout                 = 0 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] reserved_host_cpus             = 0 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] reserved_host_disk_mb          = 0 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] reserved_host_memory_mb        = 512 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] reserved_huge_pages            = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] resize_confirm_window          = 0 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] resize_fs_using_block_device   = False {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] resume_guests_state_on_host_boot = False {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] rpc_response_timeout           = 60 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] run_external_periodic_tasks    = True {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] running_deleted_instance_action = reap {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] running_deleted_instance_poll_interval = 1800 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] running_deleted_instance_timeout = 0 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] scheduler_instance_sync_interval = 120 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] service_down_time              = 720 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] servicegroup_driver            = db {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] shelved_offload_time           = 0 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] shelved_poll_interval          = 3600 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] shutdown_timeout               = 0 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] source_is_ipv6                 = False {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] ssl_only                       = False {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] state_path                     = /opt/stack/data/nova {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] sync_power_state_interval      = 600 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] sync_power_state_pool_size     = 1000 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] syslog_log_facility            = LOG_USER {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] tempdir                        = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] timeout_nbd                    = 10 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] transport_url                  = **** {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] update_resources_interval      = 0 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] use_cow_images                 = True {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] use_eventlog                   = False {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] use_journal                    = False {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] use_json                       = False {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] use_rootwrap_daemon            = False {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] use_stderr                     = False {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] use_syslog                     = False {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] vcpu_pin_set                   = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] vif_plugging_is_fatal          = False {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] vif_plugging_timeout           = 0 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] virt_mkfs                      = [] {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] volume_usage_poll_interval     = 0 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] watch_log_file                 = False {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] web                            = /usr/share/spice-html5 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] oslo_concurrency.disable_process_locking = False {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] api.auth_strategy              = keystone {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] api.compute_link_prefix        = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] api.dhcp_domain                = novalocal {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] api.enable_instance_password   = True {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] api.glance_link_prefix         = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] api.instance_list_cells_batch_strategy = distributed {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] api.instance_list_per_project_cells = False {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] api.list_records_by_skipping_down_cells = True {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] api.local_metadata_per_cell    = False {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] api.max_limit                  = 1000 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] api.metadata_cache_expiration  = 15 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] api.neutron_default_tenant_id  = default {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] api.use_forwarded_for          = False {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] api.use_neutron_default_nets   = False {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] api.vendordata_dynamic_failure_fatal = False {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] api.vendordata_dynamic_targets = [] {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] api.vendordata_jsonfile_path   = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] cache.backend                  = dogpile.cache.memcached {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] cache.backend_argument         = **** {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] cache.config_prefix            = cache.oslo {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] cache.dead_timeout             = 60.0 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] cache.debug_cache_backend      = False {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] cache.enable_retry_client      = False {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] cache.enable_socket_keepalive  = False {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] cache.enabled                  = True {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] cache.expiration_time          = 600 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] cache.hashclient_retry_attempts = 2 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] cache.hashclient_retry_delay   = 1.0 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] cache.memcache_dead_retry      = 300 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] cache.memcache_password        =  {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] cache.memcache_pool_maxsize    = 10 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] cache.memcache_sasl_enabled    = False {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] cache.memcache_socket_timeout  = 1.0 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] cache.memcache_username        =  {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] cache.proxies                  = [] {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] cache.retry_attempts           = 2 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] cache.retry_delay              = 0.0 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] cache.socket_keepalive_count   = 1 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] cache.socket_keepalive_idle    = 1 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] cache.socket_keepalive_interval = 1 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] cache.tls_allowed_ciphers      = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] cache.tls_cafile               = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] cache.tls_certfile             = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] cache.tls_enabled              = False {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] cache.tls_keyfile              = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] cinder.auth_section            = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] cinder.auth_type               = password {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] cinder.cafile                  = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] cinder.catalog_info            = volumev3::publicURL {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] cinder.certfile                = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] cinder.collect_timing          = False {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] cinder.cross_az_attach         = True {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] cinder.debug                   = False {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] cinder.endpoint_template       = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] cinder.http_retries            = 3 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] cinder.insecure                = False {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] cinder.keyfile                 = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] cinder.os_region_name          = RegionOne {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] cinder.split_loggers           = False {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] cinder.timeout                 = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] compute.cpu_dedicated_set      = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] compute.cpu_shared_set         = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] compute.image_type_exclude_list = [] {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] compute.live_migration_wait_for_vif_plug = True {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] compute.max_concurrent_disk_ops = 0 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] compute.max_disk_devices_to_attach = -1 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] compute.resource_provider_association_refresh = 300 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] compute.shutdown_retry_interval = 10 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] conductor.workers              = 3 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] console.allowed_origins        = [] {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] console.ssl_ciphers            = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] console.ssl_minimum_version    = default {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] consoleauth.token_ttl          = 600 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] cyborg.cafile                  = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] cyborg.certfile                = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] cyborg.collect_timing          = False {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] cyborg.connect_retries         = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] cyborg.connect_retry_delay     = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] cyborg.endpoint_override       = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] cyborg.insecure                = False {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] cyborg.keyfile                 = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] cyborg.max_version             = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] cyborg.min_version             = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] cyborg.region_name             = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] cyborg.service_name            = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] cyborg.service_type            = accelerator {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] cyborg.split_loggers           = False {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] cyborg.status_code_retries     = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] cyborg.status_code_retry_delay = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] cyborg.timeout                 = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] cyborg.version                 = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] database.backend               = sqlalchemy {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] database.connection            = **** {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] database.connection_debug      = 0 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] database.connection_parameters =  {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] database.connection_recycle_time = 3600 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:45 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] database.connection_trace      = False {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] database.db_inc_retry_interval = True {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] database.db_max_retries        = 20 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] database.db_max_retry_interval = 10 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] database.db_retry_interval     = 1 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] database.max_overflow          = 50 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] database.max_pool_size         = 5 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] database.max_retries           = 10 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] database.mysql_wsrep_sync_wait = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] database.pool_timeout          = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] database.retry_interval        = 10 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] database.slave_connection      = **** {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] database.sqlite_synchronous    = True {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] api_database.backend           = sqlalchemy {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] api_database.connection        = **** {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] api_database.connection_debug  = 0 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] api_database.connection_parameters =  {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] api_database.connection_recycle_time = 3600 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] api_database.connection_trace  = False {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] api_database.db_inc_retry_interval = True {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] api_database.db_max_retries    = 20 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] api_database.db_max_retry_interval = 10 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] api_database.db_retry_interval = 1 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] api_database.max_overflow      = 50 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] api_database.max_pool_size     = 5 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] api_database.max_retries       = 10 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] api_database.mysql_wsrep_sync_wait = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] api_database.pool_timeout      = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] api_database.retry_interval    = 10 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] api_database.slave_connection  = **** {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] api_database.sqlite_synchronous = True {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] devices.enabled_mdev_types     = [] {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] ephemeral_storage_encryption.enabled = False {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] ephemeral_storage_encryption.key_size = 512 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] glance.api_servers             = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] glance.cafile                  = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] glance.certfile                = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] glance.collect_timing          = False {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] glance.connect_retries         = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] glance.connect_retry_delay     = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] glance.debug                   = False {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] glance.default_trusted_certificate_ids = [] {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] glance.enable_certificate_validation = False {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] glance.enable_rbd_download     = False {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] glance.endpoint_override       = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] glance.insecure                = False {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] glance.keyfile                 = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] glance.max_version             = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] glance.min_version             = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] glance.num_retries             = 3 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] glance.rbd_ceph_conf           =  {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] glance.rbd_connect_timeout     = 5 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] glance.rbd_pool                =  {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] glance.rbd_user                =  {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] glance.region_name             = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] glance.service_name            = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] glance.service_type            = image {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] glance.split_loggers           = False {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] glance.status_code_retries     = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] glance.status_code_retry_delay = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] glance.timeout                 = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] glance.verify_glance_signatures = False {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] glance.version                 = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] guestfs.debug                  = False {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] hyperv.config_drive_cdrom      = False {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] hyperv.config_drive_inject_password = False {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] hyperv.enable_instance_metrics_collection = False {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] hyperv.enable_remotefx         = False {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] hyperv.instances_path_share    =  {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] hyperv.iscsi_initiator_list    = [] {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] hyperv.limit_cpu_features      = False {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] hyperv.power_state_check_timeframe = 60 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] hyperv.power_state_event_polling_interval = 2 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] hyperv.use_multipath_io        = False {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] hyperv.volume_attach_retry_count = 10 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] hyperv.volume_attach_retry_interval = 5 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] hyperv.vswitch_name            = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] mks.enabled                    = False {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] image_cache.manager_interval   = 2400 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] image_cache.precache_concurrency = 1 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] image_cache.remove_unused_base_images = True {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] image_cache.subdirectory_name  = _base {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] ironic.api_max_retries         = 60 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] ironic.api_retry_interval      = 2 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] ironic.auth_section            = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] ironic.auth_type               = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] ironic.cafile                  = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] ironic.certfile                = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] ironic.collect_timing          = False {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] ironic.conductor_group         = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] ironic.connect_retries         = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] ironic.connect_retry_delay     = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] ironic.endpoint_override       = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] ironic.insecure                = False {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] ironic.keyfile                 = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] ironic.max_version             = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] ironic.min_version             = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] ironic.peer_list               = [] {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] ironic.region_name             = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] ironic.serial_console_state_timeout = 10 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] ironic.service_name            = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] ironic.service_type            = baremetal {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] ironic.split_loggers           = False {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] ironic.status_code_retries     = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] ironic.status_code_retry_delay = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] ironic.timeout                 = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] ironic.version                 = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] key_manager.fixed_key          = **** {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] barbican.barbican_api_version  = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] barbican.barbican_endpoint     = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] barbican.barbican_endpoint_type = public {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] barbican.barbican_region_name  = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] barbican.cafile                = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] barbican.certfile              = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] barbican.collect_timing        = False {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] barbican.insecure              = False {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] barbican.keyfile               = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] barbican.number_of_retries     = 60 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] barbican.retry_delay           = 1 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] barbican.send_service_user_token = False {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] barbican.split_loggers         = False {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] barbican.timeout               = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] barbican.verify_ssl            = True {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] barbican.verify_ssl_path       = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] barbican_service_user.auth_section = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] barbican_service_user.auth_type = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] barbican_service_user.cafile   = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] barbican_service_user.certfile = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] barbican_service_user.collect_timing = False {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] barbican_service_user.insecure = False {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] barbican_service_user.keyfile  = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] barbican_service_user.split_loggers = False {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] barbican_service_user.timeout  = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] vault.approle_role_id          = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] vault.approle_secret_id        = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] vault.cafile                   = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] vault.certfile                 = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] vault.collect_timing           = False {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] vault.insecure                 = False {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] vault.keyfile                  = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] vault.kv_mountpoint            = secret {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] vault.kv_path                  = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] vault.kv_version               = 2 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] vault.namespace                = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] vault.root_token_id            = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] vault.split_loggers            = False {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] vault.ssl_ca_crt_file          = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] vault.timeout                  = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] vault.use_ssl                  = False {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] keystone.auth_section          = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] keystone.auth_type             = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] keystone.cafile                = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] keystone.certfile              = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] keystone.collect_timing        = False {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] keystone.connect_retries       = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] keystone.connect_retry_delay   = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] keystone.endpoint_override     = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] keystone.insecure              = False {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] keystone.keyfile               = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] keystone.max_version           = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] keystone.min_version           = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] keystone.region_name           = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] keystone.service_name          = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] keystone.service_type          = identity {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] keystone.split_loggers         = False {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] keystone.status_code_retries   = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] keystone.status_code_retry_delay = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] keystone.timeout               = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] keystone.version               = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] libvirt.connection_uri         =  {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] libvirt.cpu_mode               = custom {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] libvirt.cpu_model_extra_flags  = [] {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: WARNING oslo_config.cfg [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] libvirt.cpu_power_governor_high = performance {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] libvirt.cpu_power_governor_low = powersave {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] libvirt.cpu_power_management   = False {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] libvirt.device_detach_attempts = 8 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] libvirt.device_detach_timeout  = 20 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] libvirt.disk_cachemodes        = [] {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] libvirt.disk_prefix            = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] libvirt.enabled_perf_events    = [] {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] libvirt.file_backed_memory     = 0 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] libvirt.gid_maps               = [] {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] libvirt.hw_disk_discard        = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] libvirt.hw_machine_type        = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] libvirt.images_rbd_ceph_conf   =  {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] libvirt.images_rbd_glance_store_name =  {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] libvirt.images_rbd_pool        = rbd {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] libvirt.images_type            = default {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] libvirt.images_volume_group    = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] libvirt.inject_key             = False {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] libvirt.inject_partition       = -2 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] libvirt.inject_password        = False {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] libvirt.iscsi_iface            = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] libvirt.iser_use_multipath     = False {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] libvirt.live_migration_bandwidth = 0 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] libvirt.live_migration_completion_timeout = 800 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] libvirt.live_migration_downtime = 500 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] libvirt.live_migration_downtime_delay = 75 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] libvirt.live_migration_downtime_steps = 10 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] libvirt.live_migration_inbound_addr = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] libvirt.live_migration_permit_auto_converge = False {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] libvirt.live_migration_permit_post_copy = False {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] libvirt.live_migration_scheme  = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] libvirt.live_migration_timeout_action = abort {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] libvirt.live_migration_tunnelled = False {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: WARNING oslo_config.cfg [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Nov 06 15:33:46 user nova-compute[75337]: live_migration_uri is deprecated for removal in favor of two other options that
Nov 06 15:33:46 user nova-compute[75337]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Nov 06 15:33:46 user nova-compute[75337]: and ``live_migration_inbound_addr`` respectively.
Nov 06 15:33:46 user nova-compute[75337]: ).  Its value may be silently ignored in the future.
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] libvirt.live_migration_with_native_tls = False {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] libvirt.max_queues             = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] libvirt.mem_stats_period_seconds = 10 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] libvirt.nfs_mount_options      = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] libvirt.num_aoe_discover_tries = 3 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] libvirt.num_iser_scan_tries    = 5 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] libvirt.num_memory_encrypted_guests = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] libvirt.num_nvme_discover_tries = 5 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] libvirt.num_pcie_ports         = 0 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] libvirt.num_volume_scan_tries  = 5 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] libvirt.pmem_namespaces        = [] {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] libvirt.quobyte_client_cfg     = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] libvirt.rbd_connect_timeout    = 5 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] libvirt.rbd_secret_uuid        = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] libvirt.rbd_user               = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] libvirt.realtime_scheduler_priority = 1 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] libvirt.remote_filesystem_transport = ssh {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] libvirt.rescue_image_id        = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] libvirt.rescue_kernel_id       = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] libvirt.rescue_ramdisk_id      = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] libvirt.rx_queue_size          = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] libvirt.smbfs_mount_options    =  {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] libvirt.snapshot_compression   = False {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] libvirt.snapshot_image_format  = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] libvirt.sparse_logical_volumes = False {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] libvirt.swtpm_enabled          = False {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] libvirt.swtpm_group            = tss {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] libvirt.swtpm_user             = tss {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] libvirt.sysinfo_serial         = unique {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] libvirt.tb_cache_size          = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] libvirt.tx_queue_size          = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] libvirt.uid_maps               = [] {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] libvirt.use_virtio_for_bridges = True {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] libvirt.virt_type              = kvm {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] libvirt.volume_clear           = zero {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] libvirt.volume_clear_size      = 0 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] libvirt.volume_use_multipath   = False {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] libvirt.vzstorage_cache_path   = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] libvirt.vzstorage_mount_group  = qemu {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] libvirt.vzstorage_mount_opts   = [] {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] libvirt.vzstorage_mount_user   = stack {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] neutron.auth_section           = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] neutron.auth_type              = password {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] neutron.cafile                 = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] neutron.certfile               = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] neutron.collect_timing         = False {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] neutron.connect_retries        = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] neutron.connect_retry_delay    = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] neutron.default_floating_pool  = public {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] neutron.endpoint_override      = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] neutron.extension_sync_interval = 600 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] neutron.http_retries           = 3 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] neutron.insecure               = False {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] neutron.keyfile                = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] neutron.max_version            = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] neutron.metadata_proxy_shared_secret = **** {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] neutron.min_version            = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] neutron.ovs_bridge             = br-int {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] neutron.physnets               = [] {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] neutron.region_name            = RegionOne {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] neutron.service_metadata_proxy = True {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] neutron.service_name           = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] neutron.service_type           = network {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] neutron.split_loggers          = False {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] neutron.status_code_retries    = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] neutron.status_code_retry_delay = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] neutron.timeout                = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] neutron.version                = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] notifications.bdms_in_notifications = False {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] notifications.default_level    = INFO {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] notifications.notification_format = unversioned {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] notifications.notify_on_state_change = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] pci.alias                      = [] {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] pci.device_spec                = [] {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] pci.report_in_placement        = False {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] placement.auth_section         = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] placement.auth_type            = password {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] placement.cafile               = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] placement.certfile             = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] placement.collect_timing       = False {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] placement.connect_retries      = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] placement.connect_retry_delay  = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] placement.default_domain_id    = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] placement.default_domain_name  = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] placement.domain_id            = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] placement.domain_name          = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] placement.endpoint_override    = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] placement.insecure             = False {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] placement.keyfile              = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] placement.max_version          = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] placement.min_version          = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] placement.password             = **** {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] placement.project_domain_id    = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] placement.project_domain_name  = Default {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] placement.project_id           = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] placement.project_name         = service {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] placement.region_name          = RegionOne {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] placement.service_name         = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] placement.service_type         = placement {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] placement.split_loggers        = False {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] placement.status_code_retries  = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] placement.status_code_retry_delay = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] placement.system_scope         = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] placement.timeout              = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] placement.trust_id             = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] placement.user_domain_id       = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] placement.user_domain_name     = Default {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] placement.user_id              = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] placement.username             = placement {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] placement.version              = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] quota.cores                    = 20 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] quota.count_usage_from_placement = False {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] quota.injected_file_content_bytes = 10240 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] quota.injected_file_path_length = 255 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] quota.injected_files           = 5 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] quota.instances                = 10 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] quota.key_pairs                = 100 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] quota.metadata_items           = 128 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] quota.ram                      = 51200 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] quota.recheck_quota            = True {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] quota.server_group_members     = 10 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] quota.server_groups            = 10 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] rdp.enabled                    = False {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] scheduler.image_metadata_prefilter = False {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] scheduler.max_attempts         = 3 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] scheduler.max_placement_results = 1000 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] scheduler.query_placement_for_image_type_support = False {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] scheduler.workers              = 3 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] filter_scheduler.host_subset_size = 1 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] filter_scheduler.image_properties_default_architecture = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] filter_scheduler.isolated_hosts = [] {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] filter_scheduler.isolated_images = [] {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] filter_scheduler.max_instances_per_host = 50 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] filter_scheduler.pci_in_placement = False {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] filter_scheduler.track_instance_changes = False {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] metrics.required               = True {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] metrics.weight_multiplier      = 1.0 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] metrics.weight_setting         = [] {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] serial_console.enabled         = False {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] serial_console.port_range      = 10000:20000 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] serial_console.serialproxy_port = 6083 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] service_user.auth_section      = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] service_user.auth_type         = password {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] service_user.cafile            = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] service_user.certfile          = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] service_user.collect_timing    = False {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] service_user.insecure          = False {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] service_user.keyfile           = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] service_user.send_service_user_token = True {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] service_user.split_loggers     = False {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] service_user.timeout           = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] spice.agent_enabled            = True {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] spice.enabled                  = False {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] spice.html5proxy_port          = 6082 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] spice.image_compression        = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] spice.jpeg_compression         = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] spice.playback_compression     = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] spice.server_listen            = 127.0.0.1 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] spice.streaming_mode           = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] spice.zlib_compression         = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] upgrade_levels.baseapi         = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] upgrade_levels.cert            = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] upgrade_levels.compute         = auto {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] upgrade_levels.conductor       = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] upgrade_levels.scheduler       = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] vendordata_dynamic_auth.auth_section = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] vendordata_dynamic_auth.auth_type = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] vendordata_dynamic_auth.cafile = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] vendordata_dynamic_auth.certfile = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] vendordata_dynamic_auth.collect_timing = False {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] vendordata_dynamic_auth.insecure = False {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] vendordata_dynamic_auth.keyfile = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] vendordata_dynamic_auth.split_loggers = False {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] vendordata_dynamic_auth.timeout = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] vmware.api_retry_count         = 10 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] vmware.ca_file                 = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] vmware.cache_prefix            = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] vmware.cluster_name            = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] vmware.connection_pool_size    = 10 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] vmware.console_delay_seconds   = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] vmware.datastore_regex         = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] vmware.host_ip                 = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] vmware.host_password           = **** {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] vmware.host_port               = 443 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] vmware.host_username           = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] vmware.insecure                = False {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] vmware.integration_bridge      = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] vmware.maximum_objects         = 100 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] vmware.pbm_default_policy      = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] vmware.pbm_enabled             = False {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] vmware.pbm_wsdl_location       = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] vmware.serial_port_proxy_uri   = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] vmware.serial_port_service_uri = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] vmware.task_poll_interval      = 0.5 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] vmware.use_linked_clone        = True {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] vmware.vnc_keymap              = en-us {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] vmware.vnc_port                = 5900 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] vmware.vnc_port_total          = 10000 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] vnc.auth_schemes               = ['none'] {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] vnc.enabled                    = True {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] vnc.novncproxy_port            = 6080 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] vnc.server_listen              = 0.0.0.0 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] vnc.vencrypt_ca_certs          = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] vnc.vencrypt_client_cert       = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] vnc.vencrypt_client_key        = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] workarounds.disable_fallback_pcpu_query = False {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] workarounds.disable_group_policy_check_upcall = True {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] workarounds.disable_rootwrap   = False {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] workarounds.enable_numa_live_migration = False {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] workarounds.handle_virt_lifecycle_events = True {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] workarounds.libvirt_disable_apic = False {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] workarounds.never_download_image_if_on_rbd = False {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] wsgi.client_socket_timeout     = 900 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] wsgi.default_pool_size         = 1000 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] wsgi.keep_alive                = True {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] wsgi.max_header_line           = 16384 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] wsgi.secure_proxy_ssl_header   = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] wsgi.ssl_ca_file               = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] wsgi.ssl_cert_file             = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] wsgi.ssl_key_file              = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] wsgi.tcp_keepidle              = 600 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] zvm.ca_file                    = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] zvm.cloud_connector_url        = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] zvm.reachable_timeout          = 300 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] oslo_policy.enforce_new_defaults = True {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] oslo_policy.enforce_scope      = True {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] oslo_policy.policy_default_rule = default {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] oslo_policy.policy_file        = policy.yaml {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] profiler.connection_string     = messaging:// {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] profiler.enabled               = False {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] profiler.es_doc_type           = notification {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] profiler.es_scroll_size        = 10000 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] profiler.es_scroll_time        = 2m {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] profiler.filter_error_trace    = False {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] profiler.hmac_keys             = **** {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] profiler.sentinel_service_name = mymaster {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] profiler.socket_timeout        = 0.1 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] profiler.trace_requests        = False {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] profiler.trace_sqlalchemy      = False {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] profiler_jaeger.process_tags   = {} {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] profiler_jaeger.service_name_prefix = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] profiler_otlp.service_name_prefix = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] remote_debug.host              = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] remote_debug.port              = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] oslo_messaging_rabbit.ssl      = False {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] oslo_messaging_rabbit.ssl_version =  {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] oslo_messaging_notifications.retry = -1 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] oslo_messaging_notifications.transport_url = **** {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] oslo_limit.auth_section        = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] oslo_limit.auth_type           = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] oslo_limit.cafile              = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] oslo_limit.certfile            = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] oslo_limit.collect_timing      = False {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] oslo_limit.connect_retries     = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] oslo_limit.connect_retry_delay = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] oslo_limit.endpoint_id         = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] oslo_limit.endpoint_override   = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] oslo_limit.insecure            = False {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] oslo_limit.keyfile             = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] oslo_limit.max_version         = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] oslo_limit.min_version         = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] oslo_limit.region_name         = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] oslo_limit.service_name        = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] oslo_limit.service_type        = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] oslo_limit.split_loggers       = False {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] oslo_limit.status_code_retries = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] oslo_limit.status_code_retry_delay = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] oslo_limit.timeout             = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] oslo_limit.valid_interfaces    = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] oslo_limit.version             = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] oslo_reports.file_event_handler = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] oslo_reports.log_dir           = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] vif_plug_linux_bridge_privileged.group = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] vif_plug_linux_bridge_privileged.user = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] vif_plug_ovs_privileged.group  = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] vif_plug_ovs_privileged.helper_command = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] vif_plug_ovs_privileged.user   = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] os_vif_linux_bridge.flat_interface = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] os_vif_linux_bridge.vlan_interface = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] os_vif_ovs.default_qos_type    = linux-noop {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] os_vif_ovs.isolate_vif         = False {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] os_vif_ovs.ovsdb_interface     = native {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] os_vif_ovs.per_port_bridge     = False {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] os_brick.lock_path             = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] privsep_osbrick.capabilities   = [21] {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] privsep_osbrick.group          = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] privsep_osbrick.helper_command = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] privsep_osbrick.thread_pool_size = 12 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] privsep_osbrick.user           = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] nova_sys_admin.group           = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] nova_sys_admin.helper_command  = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] nova_sys_admin.thread_pool_size = 12 {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] nova_sys_admin.user            = None {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG oslo_service.service [None req-aba23bec-7ec3-45c9-9c8e-b3b405cb401c None None] ******************************************************************************** {{(pid=75337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Nov 06 15:33:46 user nova-compute[75337]: INFO nova.service [-] Starting compute node (version 0.0.0)
Nov 06 15:33:46 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-1e6ae7ea-ba7d-43af-87d6-9a560ad5df4b None None] Connecting to libvirt: qemu:///system {{(pid=75337) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:506}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-1e6ae7ea-ba7d-43af-87d6-9a560ad5df4b None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7f2ac4abb040> {{(pid=75337) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:512}}
Nov 06 15:33:46 user nova-compute[75337]: libvirt:  error : internal error: could not initialize domain event timer
Nov 06 15:33:46 user nova-compute[75337]: WARNING nova.virt.libvirt.host [None req-1e6ae7ea-ba7d-43af-87d6-9a560ad5df4b None None] URI qemu:///system does not support events: internal error: could not initialize domain event timer: libvirt.libvirtError: internal error: could not initialize domain event timer
Nov 06 15:33:46 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-1e6ae7ea-ba7d-43af-87d6-9a560ad5df4b None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7f2ac4abb040> {{(pid=75337) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:533}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-1e6ae7ea-ba7d-43af-87d6-9a560ad5df4b None None] Starting native event thread {{(pid=75337) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-1e6ae7ea-ba7d-43af-87d6-9a560ad5df4b None None] Starting green dispatch thread {{(pid=75337) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Nov 06 15:33:46 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-1e6ae7ea-ba7d-43af-87d6-9a560ad5df4b None None] Starting connection event dispatch thread {{(pid=75337) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:501}}
Nov 06 15:33:46 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-1e6ae7ea-ba7d-43af-87d6-9a560ad5df4b None None] Connection event '1' reason 'None'
Nov 06 15:33:46 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-1e6ae7ea-ba7d-43af-87d6-9a560ad5df4b None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 06 15:33:46 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.mount [None req-1e6ae7ea-ba7d-43af-87d6-9a560ad5df4b None None] Initialising _HostMountState generation 0 {{(pid=75337) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Nov 06 15:33:53 user nova-compute[75337]: INFO nova.virt.libvirt.host [None req-1e6ae7ea-ba7d-43af-87d6-9a560ad5df4b None None] Libvirt host capabilities <capabilities>
Nov 06 15:33:53 user nova-compute[75337]:   <host>
Nov 06 15:33:53 user nova-compute[75337]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Nov 06 15:33:53 user nova-compute[75337]:     <cpu>
Nov 06 15:33:53 user nova-compute[75337]:       <arch>x86_64</arch>
Nov 06 15:33:53 user nova-compute[75337]:       <model>IvyBridge-IBRS</model>
Nov 06 15:33:53 user nova-compute[75337]:       <vendor>Intel</vendor>
Nov 06 15:33:53 user nova-compute[75337]:       <microcode version='1070'/>
Nov 06 15:33:53 user nova-compute[75337]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Nov 06 15:33:53 user nova-compute[75337]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Nov 06 15:33:53 user nova-compute[75337]:       <feature name='ss'/>
Nov 06 15:33:53 user nova-compute[75337]:       <feature name='vmx'/>
Nov 06 15:33:53 user nova-compute[75337]:       <feature name='pcid'/>
Nov 06 15:33:53 user nova-compute[75337]:       <feature name='osxsave'/>
Nov 06 15:33:53 user nova-compute[75337]:       <feature name='hypervisor'/>
Nov 06 15:33:53 user nova-compute[75337]:       <feature name='arat'/>
Nov 06 15:33:53 user nova-compute[75337]:       <feature name='tsc_adjust'/>
Nov 06 15:33:53 user nova-compute[75337]:       <feature name='md-clear'/>
Nov 06 15:33:53 user nova-compute[75337]:       <feature name='stibp'/>
Nov 06 15:33:53 user nova-compute[75337]:       <feature name='arch-capabilities'/>
Nov 06 15:33:53 user nova-compute[75337]:       <feature name='ssbd'/>
Nov 06 15:33:53 user nova-compute[75337]:       <feature name='invtsc'/>
Nov 06 15:33:53 user nova-compute[75337]:       <feature name='rsba'/>
Nov 06 15:33:53 user nova-compute[75337]:       <feature name='skip-l1dfl-vmentry'/>
Nov 06 15:33:53 user nova-compute[75337]:       <pages unit='KiB' size='4'/>
Nov 06 15:33:53 user nova-compute[75337]:       <pages unit='KiB' size='2048'/>
Nov 06 15:33:53 user nova-compute[75337]:     </cpu>
Nov 06 15:33:53 user nova-compute[75337]:     <power_management>
Nov 06 15:33:53 user nova-compute[75337]:       <suspend_mem/>
Nov 06 15:33:53 user nova-compute[75337]:       <suspend_disk/>
Nov 06 15:33:53 user nova-compute[75337]:       <suspend_hybrid/>
Nov 06 15:33:53 user nova-compute[75337]:     </power_management>
Nov 06 15:33:53 user nova-compute[75337]:     <iommu support='no'/>
Nov 06 15:33:53 user nova-compute[75337]:     <migration_features>
Nov 06 15:33:53 user nova-compute[75337]:       <live/>
Nov 06 15:33:53 user nova-compute[75337]:       <uri_transports>
Nov 06 15:33:53 user nova-compute[75337]:         <uri_transport>tcp</uri_transport>
Nov 06 15:33:53 user nova-compute[75337]:         <uri_transport>rdma</uri_transport>
Nov 06 15:33:53 user nova-compute[75337]:       </uri_transports>
Nov 06 15:33:53 user nova-compute[75337]:     </migration_features>
Nov 06 15:33:53 user nova-compute[75337]:     <topology>
Nov 06 15:33:53 user nova-compute[75337]:       <cells num='2'>
Nov 06 15:33:53 user nova-compute[75337]:         <cell id='0'>
Nov 06 15:33:53 user nova-compute[75337]:           <memory unit='KiB'>8140616</memory>
Nov 06 15:33:53 user nova-compute[75337]:           <pages unit='KiB' size='4'>2035154</pages>
Nov 06 15:33:53 user nova-compute[75337]:           <pages unit='KiB' size='2048'>0</pages>
Nov 06 15:33:53 user nova-compute[75337]:           <distances>
Nov 06 15:33:53 user nova-compute[75337]:             <sibling id='0' value='10'/>
Nov 06 15:33:53 user nova-compute[75337]:             <sibling id='1' value='20'/>
Nov 06 15:33:53 user nova-compute[75337]:           </distances>
Nov 06 15:33:53 user nova-compute[75337]:           <cpus num='6'>
Nov 06 15:33:53 user nova-compute[75337]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Nov 06 15:33:53 user nova-compute[75337]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Nov 06 15:33:53 user nova-compute[75337]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Nov 06 15:33:53 user nova-compute[75337]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Nov 06 15:33:53 user nova-compute[75337]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Nov 06 15:33:53 user nova-compute[75337]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Nov 06 15:33:53 user nova-compute[75337]:           </cpus>
Nov 06 15:33:53 user nova-compute[75337]:         </cell>
Nov 06 15:33:53 user nova-compute[75337]:         <cell id='1'>
Nov 06 15:33:53 user nova-compute[75337]:           <memory unit='KiB'>8255068</memory>
Nov 06 15:33:53 user nova-compute[75337]:           <pages unit='KiB' size='4'>2063767</pages>
Nov 06 15:33:53 user nova-compute[75337]:           <pages unit='KiB' size='2048'>0</pages>
Nov 06 15:33:53 user nova-compute[75337]:           <distances>
Nov 06 15:33:53 user nova-compute[75337]:             <sibling id='0' value='20'/>
Nov 06 15:33:53 user nova-compute[75337]:             <sibling id='1' value='10'/>
Nov 06 15:33:53 user nova-compute[75337]:           </distances>
Nov 06 15:33:53 user nova-compute[75337]:           <cpus num='6'>
Nov 06 15:33:53 user nova-compute[75337]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Nov 06 15:33:53 user nova-compute[75337]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Nov 06 15:33:53 user nova-compute[75337]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Nov 06 15:33:53 user nova-compute[75337]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Nov 06 15:33:53 user nova-compute[75337]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Nov 06 15:33:53 user nova-compute[75337]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Nov 06 15:33:53 user nova-compute[75337]:           </cpus>
Nov 06 15:33:53 user nova-compute[75337]:         </cell>
Nov 06 15:33:53 user nova-compute[75337]:       </cells>
Nov 06 15:33:53 user nova-compute[75337]:     </topology>
Nov 06 15:33:53 user nova-compute[75337]:     <cache>
Nov 06 15:33:53 user nova-compute[75337]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Nov 06 15:33:53 user nova-compute[75337]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Nov 06 15:33:53 user nova-compute[75337]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Nov 06 15:33:53 user nova-compute[75337]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Nov 06 15:33:53 user nova-compute[75337]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Nov 06 15:33:53 user nova-compute[75337]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Nov 06 15:33:53 user nova-compute[75337]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Nov 06 15:33:53 user nova-compute[75337]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Nov 06 15:33:53 user nova-compute[75337]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Nov 06 15:33:53 user nova-compute[75337]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Nov 06 15:33:53 user nova-compute[75337]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Nov 06 15:33:53 user nova-compute[75337]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Nov 06 15:33:53 user nova-compute[75337]:     </cache>
Nov 06 15:33:53 user nova-compute[75337]:     <secmodel>
Nov 06 15:33:53 user nova-compute[75337]:       <model>apparmor</model>
Nov 06 15:33:53 user nova-compute[75337]:       <doi>0</doi>
Nov 06 15:33:53 user nova-compute[75337]:     </secmodel>
Nov 06 15:33:53 user nova-compute[75337]:     <secmodel>
Nov 06 15:33:53 user nova-compute[75337]:       <model>dac</model>
Nov 06 15:33:53 user nova-compute[75337]:       <doi>0</doi>
Nov 06 15:33:53 user nova-compute[75337]:       <baselabel type='kvm'>+64055:+108</baselabel>
Nov 06 15:33:53 user nova-compute[75337]:       <baselabel type='qemu'>+64055:+108</baselabel>
Nov 06 15:33:53 user nova-compute[75337]:     </secmodel>
Nov 06 15:33:53 user nova-compute[75337]:   </host>
Nov 06 15:33:53 user nova-compute[75337]:   <guest>
Nov 06 15:33:53 user nova-compute[75337]:     <os_type>hvm</os_type>
Nov 06 15:33:53 user nova-compute[75337]:     <arch name='alpha'>
Nov 06 15:33:53 user nova-compute[75337]:       <wordsize>64</wordsize>
Nov 06 15:33:53 user nova-compute[75337]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='4'>clipper</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <domain type='qemu'/>
Nov 06 15:33:53 user nova-compute[75337]:     </arch>
Nov 06 15:33:53 user nova-compute[75337]:     <features>
Nov 06 15:33:53 user nova-compute[75337]:       <cpuselection/>
Nov 06 15:33:53 user nova-compute[75337]:       <deviceboot/>
Nov 06 15:33:53 user nova-compute[75337]:       <disksnapshot default='on' toggle='no'/>
Nov 06 15:33:53 user nova-compute[75337]:     </features>
Nov 06 15:33:53 user nova-compute[75337]:   </guest>
Nov 06 15:33:53 user nova-compute[75337]:   <guest>
Nov 06 15:33:53 user nova-compute[75337]:     <os_type>hvm</os_type>
Nov 06 15:33:53 user nova-compute[75337]:     <arch name='armv6l'>
Nov 06 15:33:53 user nova-compute[75337]:       <wordsize>32</wordsize>
Nov 06 15:33:53 user nova-compute[75337]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>integratorcp</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>borzoi</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>spitz</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='2'>nuri</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='2'>musca-b1</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>versatileab</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>kzm</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='2'>musca-a</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='2'>smdkc210</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>sx1</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>z2</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>tosa</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='4'>sabrelite</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>realview-eb</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>n810</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>n800</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>versatilepb</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>terrier</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>mainstone</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='4'>midway</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>musicpal</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>microbit</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>cubieboard</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>verdex</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>netduino2</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='4'>raspi2b</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>cheetah</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='4'>highbank</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>akita</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>connex</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>collie</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>raspi0</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <domain type='qemu'/>
Nov 06 15:33:53 user nova-compute[75337]:     </arch>
Nov 06 15:33:53 user nova-compute[75337]:     <features>
Nov 06 15:33:53 user nova-compute[75337]:       <cpuselection/>
Nov 06 15:33:53 user nova-compute[75337]:       <deviceboot/>
Nov 06 15:33:53 user nova-compute[75337]:       <disksnapshot default='on' toggle='no'/>
Nov 06 15:33:53 user nova-compute[75337]:     </features>
Nov 06 15:33:53 user nova-compute[75337]:   </guest>
Nov 06 15:33:53 user nova-compute[75337]:   <guest>
Nov 06 15:33:53 user nova-compute[75337]:     <os_type>hvm</os_type>
Nov 06 15:33:53 user nova-compute[75337]:     <arch name='armv7l'>
Nov 06 15:33:53 user nova-compute[75337]:       <wordsize>32</wordsize>
Nov 06 15:33:53 user nova-compute[75337]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>integratorcp</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>borzoi</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>spitz</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='2'>nuri</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='2'>musca-b1</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>versatileab</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>kzm</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='2'>musca-a</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='2'>smdkc210</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>sx1</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>z2</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>tosa</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='4'>sabrelite</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>realview-eb</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>n810</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>n800</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>versatilepb</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>terrier</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>mainstone</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='4'>midway</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>musicpal</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>microbit</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>cubieboard</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>verdex</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>netduino2</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='4'>raspi2b</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>cheetah</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='4'>highbank</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>akita</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>connex</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>collie</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>raspi0</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <domain type='qemu'/>
Nov 06 15:33:53 user nova-compute[75337]:     </arch>
Nov 06 15:33:53 user nova-compute[75337]:     <features>
Nov 06 15:33:53 user nova-compute[75337]:       <cpuselection/>
Nov 06 15:33:53 user nova-compute[75337]:       <deviceboot/>
Nov 06 15:33:53 user nova-compute[75337]:       <disksnapshot default='on' toggle='no'/>
Nov 06 15:33:53 user nova-compute[75337]:     </features>
Nov 06 15:33:53 user nova-compute[75337]:   </guest>
Nov 06 15:33:53 user nova-compute[75337]:   <guest>
Nov 06 15:33:53 user nova-compute[75337]:     <os_type>hvm</os_type>
Nov 06 15:33:53 user nova-compute[75337]:     <arch name='aarch64'>
Nov 06 15:33:53 user nova-compute[75337]:       <wordsize>64</wordsize>
Nov 06 15:33:53 user nova-compute[75337]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>integratorcp</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>borzoi</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>spitz</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='2'>nuri</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='2'>musca-b1</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>versatileab</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>kzm</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='2'>musca-a</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='2'>smdkc210</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>sx1</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>z2</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>tosa</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='4'>sabrelite</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>realview-eb</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='512'>sbsa-ref</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>n810</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>n800</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>versatilepb</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>terrier</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>mainstone</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='4'>midway</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>musicpal</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>microbit</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='4'>raspi3ap</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>cubieboard</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>verdex</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>netduino2</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='4'>raspi3b</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='4'>raspi2b</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>cheetah</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='4'>highbank</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>akita</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>connex</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>collie</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>raspi0</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <domain type='qemu'/>
Nov 06 15:33:53 user nova-compute[75337]:     </arch>
Nov 06 15:33:53 user nova-compute[75337]:     <features>
Nov 06 15:33:53 user nova-compute[75337]:       <acpi default='on' toggle='yes'/>
Nov 06 15:33:53 user nova-compute[75337]:       <cpuselection/>
Nov 06 15:33:53 user nova-compute[75337]:       <deviceboot/>
Nov 06 15:33:53 user nova-compute[75337]:       <disksnapshot default='on' toggle='no'/>
Nov 06 15:33:53 user nova-compute[75337]:     </features>
Nov 06 15:33:53 user nova-compute[75337]:   </guest>
Nov 06 15:33:53 user nova-compute[75337]:   <guest>
Nov 06 15:33:53 user nova-compute[75337]:     <os_type>hvm</os_type>
Nov 06 15:33:53 user nova-compute[75337]:     <arch name='cris'>
Nov 06 15:33:53 user nova-compute[75337]:       <wordsize>32</wordsize>
Nov 06 15:33:53 user nova-compute[75337]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>axis-dev88</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <domain type='qemu'/>
Nov 06 15:33:53 user nova-compute[75337]:     </arch>
Nov 06 15:33:53 user nova-compute[75337]:     <features>
Nov 06 15:33:53 user nova-compute[75337]:       <cpuselection/>
Nov 06 15:33:53 user nova-compute[75337]:       <deviceboot/>
Nov 06 15:33:53 user nova-compute[75337]:       <disksnapshot default='on' toggle='no'/>
Nov 06 15:33:53 user nova-compute[75337]:     </features>
Nov 06 15:33:53 user nova-compute[75337]:   </guest>
Nov 06 15:33:53 user nova-compute[75337]:   <guest>
Nov 06 15:33:53 user nova-compute[75337]:     <os_type>hvm</os_type>
Nov 06 15:33:53 user nova-compute[75337]:     <arch name='i686'>
Nov 06 15:33:53 user nova-compute[75337]:       <wordsize>32</wordsize>
Nov 06 15:33:53 user nova-compute[75337]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>x-remote</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>isapc</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='288'>microvm</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <domain type='qemu'/>
Nov 06 15:33:53 user nova-compute[75337]:       <domain type='kvm'/>
Nov 06 15:33:53 user nova-compute[75337]:     </arch>
Nov 06 15:33:53 user nova-compute[75337]:     <features>
Nov 06 15:33:53 user nova-compute[75337]:       <pae/>
Nov 06 15:33:53 user nova-compute[75337]:       <nonpae/>
Nov 06 15:33:53 user nova-compute[75337]:       <acpi default='on' toggle='yes'/>
Nov 06 15:33:53 user nova-compute[75337]:       <apic default='on' toggle='no'/>
Nov 06 15:33:53 user nova-compute[75337]:       <cpuselection/>
Nov 06 15:33:53 user nova-compute[75337]:       <deviceboot/>
Nov 06 15:33:53 user nova-compute[75337]:       <disksnapshot default='on' toggle='no'/>
Nov 06 15:33:53 user nova-compute[75337]:     </features>
Nov 06 15:33:53 user nova-compute[75337]:   </guest>
Nov 06 15:33:53 user nova-compute[75337]:   <guest>
Nov 06 15:33:53 user nova-compute[75337]:     <os_type>hvm</os_type>
Nov 06 15:33:53 user nova-compute[75337]:     <arch name='m68k'>
Nov 06 15:33:53 user nova-compute[75337]:       <wordsize>32</wordsize>
Nov 06 15:33:53 user nova-compute[75337]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>mcf5208evb</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>an5206</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>virt-6.0</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>q800</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>virt-6.2</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>next-cube</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>virt-6.1</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <domain type='qemu'/>
Nov 06 15:33:53 user nova-compute[75337]:     </arch>
Nov 06 15:33:53 user nova-compute[75337]:     <features>
Nov 06 15:33:53 user nova-compute[75337]:       <cpuselection/>
Nov 06 15:33:53 user nova-compute[75337]:       <deviceboot/>
Nov 06 15:33:53 user nova-compute[75337]:       <disksnapshot default='on' toggle='no'/>
Nov 06 15:33:53 user nova-compute[75337]:     </features>
Nov 06 15:33:53 user nova-compute[75337]:   </guest>
Nov 06 15:33:53 user nova-compute[75337]:   <guest>
Nov 06 15:33:53 user nova-compute[75337]:     <os_type>hvm</os_type>
Nov 06 15:33:53 user nova-compute[75337]:     <arch name='microblaze'>
Nov 06 15:33:53 user nova-compute[75337]:       <wordsize>32</wordsize>
Nov 06 15:33:53 user nova-compute[75337]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <domain type='qemu'/>
Nov 06 15:33:53 user nova-compute[75337]:     </arch>
Nov 06 15:33:53 user nova-compute[75337]:     <features>
Nov 06 15:33:53 user nova-compute[75337]:       <cpuselection/>
Nov 06 15:33:53 user nova-compute[75337]:       <deviceboot/>
Nov 06 15:33:53 user nova-compute[75337]:       <disksnapshot default='on' toggle='no'/>
Nov 06 15:33:53 user nova-compute[75337]:     </features>
Nov 06 15:33:53 user nova-compute[75337]:   </guest>
Nov 06 15:33:53 user nova-compute[75337]:   <guest>
Nov 06 15:33:53 user nova-compute[75337]:     <os_type>hvm</os_type>
Nov 06 15:33:53 user nova-compute[75337]:     <arch name='microblazeel'>
Nov 06 15:33:53 user nova-compute[75337]:       <wordsize>32</wordsize>
Nov 06 15:33:53 user nova-compute[75337]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <domain type='qemu'/>
Nov 06 15:33:53 user nova-compute[75337]:     </arch>
Nov 06 15:33:53 user nova-compute[75337]:     <features>
Nov 06 15:33:53 user nova-compute[75337]:       <cpuselection/>
Nov 06 15:33:53 user nova-compute[75337]:       <deviceboot/>
Nov 06 15:33:53 user nova-compute[75337]:       <disksnapshot default='on' toggle='no'/>
Nov 06 15:33:53 user nova-compute[75337]:     </features>
Nov 06 15:33:53 user nova-compute[75337]:   </guest>
Nov 06 15:33:53 user nova-compute[75337]:   <guest>
Nov 06 15:33:53 user nova-compute[75337]:     <os_type>hvm</os_type>
Nov 06 15:33:53 user nova-compute[75337]:     <arch name='mips'>
Nov 06 15:33:53 user nova-compute[75337]:       <wordsize>32</wordsize>
Nov 06 15:33:53 user nova-compute[75337]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='16'>malta</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>mipssim</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <domain type='qemu'/>
Nov 06 15:33:53 user nova-compute[75337]:     </arch>
Nov 06 15:33:53 user nova-compute[75337]:     <features>
Nov 06 15:33:53 user nova-compute[75337]:       <cpuselection/>
Nov 06 15:33:53 user nova-compute[75337]:       <deviceboot/>
Nov 06 15:33:53 user nova-compute[75337]:       <disksnapshot default='on' toggle='no'/>
Nov 06 15:33:53 user nova-compute[75337]:     </features>
Nov 06 15:33:53 user nova-compute[75337]:   </guest>
Nov 06 15:33:53 user nova-compute[75337]:   <guest>
Nov 06 15:33:53 user nova-compute[75337]:     <os_type>hvm</os_type>
Nov 06 15:33:53 user nova-compute[75337]:     <arch name='mipsel'>
Nov 06 15:33:53 user nova-compute[75337]:       <wordsize>32</wordsize>
Nov 06 15:33:53 user nova-compute[75337]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='16'>malta</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>mipssim</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <domain type='qemu'/>
Nov 06 15:33:53 user nova-compute[75337]:     </arch>
Nov 06 15:33:53 user nova-compute[75337]:     <features>
Nov 06 15:33:53 user nova-compute[75337]:       <cpuselection/>
Nov 06 15:33:53 user nova-compute[75337]:       <deviceboot/>
Nov 06 15:33:53 user nova-compute[75337]:       <disksnapshot default='on' toggle='no'/>
Nov 06 15:33:53 user nova-compute[75337]:     </features>
Nov 06 15:33:53 user nova-compute[75337]:   </guest>
Nov 06 15:33:53 user nova-compute[75337]:   <guest>
Nov 06 15:33:53 user nova-compute[75337]:     <os_type>hvm</os_type>
Nov 06 15:33:53 user nova-compute[75337]:     <arch name='mips64'>
Nov 06 15:33:53 user nova-compute[75337]:       <wordsize>64</wordsize>
Nov 06 15:33:53 user nova-compute[75337]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='16'>malta</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>mipssim</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>pica61</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>magnum</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <domain type='qemu'/>
Nov 06 15:33:53 user nova-compute[75337]:     </arch>
Nov 06 15:33:53 user nova-compute[75337]:     <features>
Nov 06 15:33:53 user nova-compute[75337]:       <cpuselection/>
Nov 06 15:33:53 user nova-compute[75337]:       <deviceboot/>
Nov 06 15:33:53 user nova-compute[75337]:       <disksnapshot default='on' toggle='no'/>
Nov 06 15:33:53 user nova-compute[75337]:     </features>
Nov 06 15:33:53 user nova-compute[75337]:   </guest>
Nov 06 15:33:53 user nova-compute[75337]:   <guest>
Nov 06 15:33:53 user nova-compute[75337]:     <os_type>hvm</os_type>
Nov 06 15:33:53 user nova-compute[75337]:     <arch name='mips64el'>
Nov 06 15:33:53 user nova-compute[75337]:       <wordsize>64</wordsize>
Nov 06 15:33:53 user nova-compute[75337]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='16'>malta</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='16'>loongson3-virt</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>mipssim</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>pica61</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>magnum</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='16'>boston</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>fuloong2e</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <domain type='qemu'/>
Nov 06 15:33:53 user nova-compute[75337]:     </arch>
Nov 06 15:33:53 user nova-compute[75337]:     <features>
Nov 06 15:33:53 user nova-compute[75337]:       <cpuselection/>
Nov 06 15:33:53 user nova-compute[75337]:       <deviceboot/>
Nov 06 15:33:53 user nova-compute[75337]:       <disksnapshot default='on' toggle='no'/>
Nov 06 15:33:53 user nova-compute[75337]:     </features>
Nov 06 15:33:53 user nova-compute[75337]:   </guest>
Nov 06 15:33:53 user nova-compute[75337]:   <guest>
Nov 06 15:33:53 user nova-compute[75337]:     <os_type>hvm</os_type>
Nov 06 15:33:53 user nova-compute[75337]:     <arch name='ppc'>
Nov 06 15:33:53 user nova-compute[75337]:       <wordsize>32</wordsize>
Nov 06 15:33:53 user nova-compute[75337]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>g3beige</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>mac99</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='32'>ppce500</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>pegasos2</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>sam460ex</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>bamboo</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>40p</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>ref405ep</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>taihu</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <domain type='qemu'/>
Nov 06 15:33:53 user nova-compute[75337]:     </arch>
Nov 06 15:33:53 user nova-compute[75337]:     <features>
Nov 06 15:33:53 user nova-compute[75337]:       <cpuselection/>
Nov 06 15:33:53 user nova-compute[75337]:       <deviceboot/>
Nov 06 15:33:53 user nova-compute[75337]:       <disksnapshot default='on' toggle='no'/>
Nov 06 15:33:53 user nova-compute[75337]:     </features>
Nov 06 15:33:53 user nova-compute[75337]:   </guest>
Nov 06 15:33:53 user nova-compute[75337]:   <guest>
Nov 06 15:33:53 user nova-compute[75337]:     <os_type>hvm</os_type>
Nov 06 15:33:53 user nova-compute[75337]:     <arch name='ppc64'>
Nov 06 15:33:53 user nova-compute[75337]:       <wordsize>64</wordsize>
Nov 06 15:33:53 user nova-compute[75337]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='2048'>powernv9</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>taihu</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='2048'>powernv10</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='32'>ppce500</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>40p</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>pegasos2</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>bamboo</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>g3beige</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>mac99</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>sam460ex</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>ref405ep</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='2048'>powernv8</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <domain type='qemu'/>
Nov 06 15:33:53 user nova-compute[75337]:     </arch>
Nov 06 15:33:53 user nova-compute[75337]:     <features>
Nov 06 15:33:53 user nova-compute[75337]:       <cpuselection/>
Nov 06 15:33:53 user nova-compute[75337]:       <deviceboot/>
Nov 06 15:33:53 user nova-compute[75337]:       <disksnapshot default='on' toggle='no'/>
Nov 06 15:33:53 user nova-compute[75337]:     </features>
Nov 06 15:33:53 user nova-compute[75337]:   </guest>
Nov 06 15:33:53 user nova-compute[75337]:   <guest>
Nov 06 15:33:53 user nova-compute[75337]:     <os_type>hvm</os_type>
Nov 06 15:33:53 user nova-compute[75337]:     <arch name='ppc64le'>
Nov 06 15:33:53 user nova-compute[75337]:       <wordsize>64</wordsize>
Nov 06 15:33:53 user nova-compute[75337]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='2048'>powernv9</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>taihu</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='2048'>powernv10</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='32'>ppce500</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>40p</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>pegasos2</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>bamboo</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>g3beige</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>mac99</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>sam460ex</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>ref405ep</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='2048'>powernv8</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <domain type='qemu'/>
Nov 06 15:33:53 user nova-compute[75337]:     </arch>
Nov 06 15:33:53 user nova-compute[75337]:     <features>
Nov 06 15:33:53 user nova-compute[75337]:       <cpuselection/>
Nov 06 15:33:53 user nova-compute[75337]:       <deviceboot/>
Nov 06 15:33:53 user nova-compute[75337]:       <disksnapshot default='on' toggle='no'/>
Nov 06 15:33:53 user nova-compute[75337]:     </features>
Nov 06 15:33:53 user nova-compute[75337]:   </guest>
Nov 06 15:33:53 user nova-compute[75337]:   <guest>
Nov 06 15:33:53 user nova-compute[75337]:     <os_type>hvm</os_type>
Nov 06 15:33:53 user nova-compute[75337]:     <arch name='riscv32'>
Nov 06 15:33:53 user nova-compute[75337]:       <wordsize>32</wordsize>
Nov 06 15:33:53 user nova-compute[75337]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='8'>spike</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>opentitan</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='5'>sifive_u</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>sifive_e</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='8'>virt</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <domain type='qemu'/>
Nov 06 15:33:53 user nova-compute[75337]:     </arch>
Nov 06 15:33:53 user nova-compute[75337]:     <features>
Nov 06 15:33:53 user nova-compute[75337]:       <cpuselection/>
Nov 06 15:33:53 user nova-compute[75337]:       <deviceboot/>
Nov 06 15:33:53 user nova-compute[75337]:       <disksnapshot default='on' toggle='no'/>
Nov 06 15:33:53 user nova-compute[75337]:     </features>
Nov 06 15:33:53 user nova-compute[75337]:   </guest>
Nov 06 15:33:53 user nova-compute[75337]:   <guest>
Nov 06 15:33:53 user nova-compute[75337]:     <os_type>hvm</os_type>
Nov 06 15:33:53 user nova-compute[75337]:     <arch name='riscv64'>
Nov 06 15:33:53 user nova-compute[75337]:       <wordsize>64</wordsize>
Nov 06 15:33:53 user nova-compute[75337]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='8'>spike</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='5'>sifive_u</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>shakti_c</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>sifive_e</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='8'>virt</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <domain type='qemu'/>
Nov 06 15:33:53 user nova-compute[75337]:     </arch>
Nov 06 15:33:53 user nova-compute[75337]:     <features>
Nov 06 15:33:53 user nova-compute[75337]:       <cpuselection/>
Nov 06 15:33:53 user nova-compute[75337]:       <deviceboot/>
Nov 06 15:33:53 user nova-compute[75337]:       <disksnapshot default='on' toggle='no'/>
Nov 06 15:33:53 user nova-compute[75337]:     </features>
Nov 06 15:33:53 user nova-compute[75337]:   </guest>
Nov 06 15:33:53 user nova-compute[75337]:   <guest>
Nov 06 15:33:53 user nova-compute[75337]:     <os_type>hvm</os_type>
Nov 06 15:33:53 user nova-compute[75337]:     <arch name='s390x'>
Nov 06 15:33:53 user nova-compute[75337]:       <wordsize>64</wordsize>
Nov 06 15:33:53 user nova-compute[75337]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <domain type='qemu'/>
Nov 06 15:33:53 user nova-compute[75337]:     </arch>
Nov 06 15:33:53 user nova-compute[75337]:     <features>
Nov 06 15:33:53 user nova-compute[75337]:       <cpuselection/>
Nov 06 15:33:53 user nova-compute[75337]:       <deviceboot/>
Nov 06 15:33:53 user nova-compute[75337]:       <disksnapshot default='on' toggle='no'/>
Nov 06 15:33:53 user nova-compute[75337]:     </features>
Nov 06 15:33:53 user nova-compute[75337]:   </guest>
Nov 06 15:33:53 user nova-compute[75337]:   <guest>
Nov 06 15:33:53 user nova-compute[75337]:     <os_type>hvm</os_type>
Nov 06 15:33:53 user nova-compute[75337]:     <arch name='sh4'>
Nov 06 15:33:53 user nova-compute[75337]:       <wordsize>32</wordsize>
Nov 06 15:33:53 user nova-compute[75337]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>shix</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>r2d</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <domain type='qemu'/>
Nov 06 15:33:53 user nova-compute[75337]:     </arch>
Nov 06 15:33:53 user nova-compute[75337]:     <features>
Nov 06 15:33:53 user nova-compute[75337]:       <cpuselection/>
Nov 06 15:33:53 user nova-compute[75337]:       <deviceboot/>
Nov 06 15:33:53 user nova-compute[75337]:       <disksnapshot default='on' toggle='no'/>
Nov 06 15:33:53 user nova-compute[75337]:     </features>
Nov 06 15:33:53 user nova-compute[75337]:   </guest>
Nov 06 15:33:53 user nova-compute[75337]:   <guest>
Nov 06 15:33:53 user nova-compute[75337]:     <os_type>hvm</os_type>
Nov 06 15:33:53 user nova-compute[75337]:     <arch name='sh4eb'>
Nov 06 15:33:53 user nova-compute[75337]:       <wordsize>64</wordsize>
Nov 06 15:33:53 user nova-compute[75337]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>shix</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>r2d</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <domain type='qemu'/>
Nov 06 15:33:53 user nova-compute[75337]:     </arch>
Nov 06 15:33:53 user nova-compute[75337]:     <features>
Nov 06 15:33:53 user nova-compute[75337]:       <cpuselection/>
Nov 06 15:33:53 user nova-compute[75337]:       <deviceboot/>
Nov 06 15:33:53 user nova-compute[75337]:       <disksnapshot default='on' toggle='no'/>
Nov 06 15:33:53 user nova-compute[75337]:     </features>
Nov 06 15:33:53 user nova-compute[75337]:   </guest>
Nov 06 15:33:53 user nova-compute[75337]:   <guest>
Nov 06 15:33:53 user nova-compute[75337]:     <os_type>hvm</os_type>
Nov 06 15:33:53 user nova-compute[75337]:     <arch name='sparc'>
Nov 06 15:33:53 user nova-compute[75337]:       <wordsize>32</wordsize>
Nov 06 15:33:53 user nova-compute[75337]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>SS-5</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='4'>SS-20</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>LX</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>SPARCClassic</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>leon3_generic</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>SPARCbook</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>SS-4</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='4'>SS-600MP</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='4'>SS-10</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>Voyager</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <domain type='qemu'/>
Nov 06 15:33:53 user nova-compute[75337]:     </arch>
Nov 06 15:33:53 user nova-compute[75337]:     <features>
Nov 06 15:33:53 user nova-compute[75337]:       <cpuselection/>
Nov 06 15:33:53 user nova-compute[75337]:       <deviceboot/>
Nov 06 15:33:53 user nova-compute[75337]:       <disksnapshot default='on' toggle='no'/>
Nov 06 15:33:53 user nova-compute[75337]:     </features>
Nov 06 15:33:53 user nova-compute[75337]:   </guest>
Nov 06 15:33:53 user nova-compute[75337]:   <guest>
Nov 06 15:33:53 user nova-compute[75337]:     <os_type>hvm</os_type>
Nov 06 15:33:53 user nova-compute[75337]:     <arch name='sparc64'>
Nov 06 15:33:53 user nova-compute[75337]:       <wordsize>64</wordsize>
Nov 06 15:33:53 user nova-compute[75337]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>sun4u</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>niagara</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>sun4v</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <domain type='qemu'/>
Nov 06 15:33:53 user nova-compute[75337]:     </arch>
Nov 06 15:33:53 user nova-compute[75337]:     <features>
Nov 06 15:33:53 user nova-compute[75337]:       <cpuselection/>
Nov 06 15:33:53 user nova-compute[75337]:       <deviceboot/>
Nov 06 15:33:53 user nova-compute[75337]:       <disksnapshot default='on' toggle='no'/>
Nov 06 15:33:53 user nova-compute[75337]:     </features>
Nov 06 15:33:53 user nova-compute[75337]:   </guest>
Nov 06 15:33:53 user nova-compute[75337]:   <guest>
Nov 06 15:33:53 user nova-compute[75337]:     <os_type>hvm</os_type>
Nov 06 15:33:53 user nova-compute[75337]:     <arch name='x86_64'>
Nov 06 15:33:53 user nova-compute[75337]:       <wordsize>64</wordsize>
Nov 06 15:33:53 user nova-compute[75337]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>x-remote</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='1'>isapc</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='288'>microvm</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <domain type='qemu'/>
Nov 06 15:33:53 user nova-compute[75337]:       <domain type='kvm'/>
Nov 06 15:33:53 user nova-compute[75337]:     </arch>
Nov 06 15:33:53 user nova-compute[75337]:     <features>
Nov 06 15:33:53 user nova-compute[75337]:       <acpi default='on' toggle='yes'/>
Nov 06 15:33:53 user nova-compute[75337]:       <apic default='on' toggle='no'/>
Nov 06 15:33:53 user nova-compute[75337]:       <cpuselection/>
Nov 06 15:33:53 user nova-compute[75337]:       <deviceboot/>
Nov 06 15:33:53 user nova-compute[75337]:       <disksnapshot default='on' toggle='no'/>
Nov 06 15:33:53 user nova-compute[75337]:     </features>
Nov 06 15:33:53 user nova-compute[75337]:   </guest>
Nov 06 15:33:53 user nova-compute[75337]:   <guest>
Nov 06 15:33:53 user nova-compute[75337]:     <os_type>hvm</os_type>
Nov 06 15:33:53 user nova-compute[75337]:     <arch name='xtensa'>
Nov 06 15:33:53 user nova-compute[75337]:       <wordsize>32</wordsize>
Nov 06 15:33:53 user nova-compute[75337]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='4'>sim</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='32'>kc705</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='32'>ml605</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='32'>virt</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='32'>lx200</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='32'>lx60</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <domain type='qemu'/>
Nov 06 15:33:53 user nova-compute[75337]:     </arch>
Nov 06 15:33:53 user nova-compute[75337]:     <features>
Nov 06 15:33:53 user nova-compute[75337]:       <cpuselection/>
Nov 06 15:33:53 user nova-compute[75337]:       <deviceboot/>
Nov 06 15:33:53 user nova-compute[75337]:       <disksnapshot default='on' toggle='no'/>
Nov 06 15:33:53 user nova-compute[75337]:     </features>
Nov 06 15:33:53 user nova-compute[75337]:   </guest>
Nov 06 15:33:53 user nova-compute[75337]:   <guest>
Nov 06 15:33:53 user nova-compute[75337]:     <os_type>hvm</os_type>
Nov 06 15:33:53 user nova-compute[75337]:     <arch name='xtensaeb'>
Nov 06 15:33:53 user nova-compute[75337]:       <wordsize>32</wordsize>
Nov 06 15:33:53 user nova-compute[75337]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='4'>sim</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='32'>kc705</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='32'>ml605</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='32'>virt</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='32'>lx200</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='32'>lx60</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 06 15:33:53 user nova-compute[75337]:       <domain type='qemu'/>
Nov 06 15:33:53 user nova-compute[75337]:     </arch>
Nov 06 15:33:53 user nova-compute[75337]:     <features>
Nov 06 15:33:53 user nova-compute[75337]:       <cpuselection/>
Nov 06 15:33:53 user nova-compute[75337]:       <deviceboot/>
Nov 06 15:33:53 user nova-compute[75337]:       <disksnapshot default='on' toggle='no'/>
Nov 06 15:33:53 user nova-compute[75337]:     </features>
Nov 06 15:33:53 user nova-compute[75337]:   </guest>
Nov 06 15:33:53 user nova-compute[75337]: </capabilities>
Nov 06 15:33:53 user nova-compute[75337]: 
Nov 06 15:33:53 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-1e6ae7ea-ba7d-43af-87d6-9a560ad5df4b None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=75337) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 06 15:33:53 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-1e6ae7ea-ba7d-43af-87d6-9a560ad5df4b None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=75337) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 06 15:33:53 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-1e6ae7ea-ba7d-43af-87d6-9a560ad5df4b None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=75337) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 06 15:33:53 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-1e6ae7ea-ba7d-43af-87d6-9a560ad5df4b None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75337) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 06 15:33:53 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-1e6ae7ea-ba7d-43af-87d6-9a560ad5df4b None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75337) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 06 15:33:53 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-1e6ae7ea-ba7d-43af-87d6-9a560ad5df4b None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=75337) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 06 15:33:53 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-1e6ae7ea-ba7d-43af-87d6-9a560ad5df4b None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75337) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 06 15:33:53 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-1e6ae7ea-ba7d-43af-87d6-9a560ad5df4b None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=75337) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 06 15:33:53 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-1e6ae7ea-ba7d-43af-87d6-9a560ad5df4b None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=75337) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 06 15:33:53 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-1e6ae7ea-ba7d-43af-87d6-9a560ad5df4b None None] Getting domain capabilities for cris via machine types: {None} {{(pid=75337) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 06 15:33:53 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-1e6ae7ea-ba7d-43af-87d6-9a560ad5df4b None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=75337) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 06 15:33:53 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-1e6ae7ea-ba7d-43af-87d6-9a560ad5df4b None None] Getting domain capabilities for i686 via machine types: {'pc', 'ubuntu-q35', 'q35', 'ubuntu'} {{(pid=75337) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 06 15:33:53 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-1e6ae7ea-ba7d-43af-87d6-9a560ad5df4b None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Nov 06 15:33:53 user nova-compute[75337]: <domainCapabilities>
Nov 06 15:33:53 user nova-compute[75337]:   <path>/usr/bin/qemu-system-i386</path>
Nov 06 15:33:53 user nova-compute[75337]:   <domain>kvm</domain>
Nov 06 15:33:53 user nova-compute[75337]:   <machine>pc-i440fx-6.2</machine>
Nov 06 15:33:53 user nova-compute[75337]:   <arch>i686</arch>
Nov 06 15:33:53 user nova-compute[75337]:   <vcpu max='255'/>
Nov 06 15:33:53 user nova-compute[75337]:   <iothreads supported='yes'/>
Nov 06 15:33:53 user nova-compute[75337]:   <os supported='yes'>
Nov 06 15:33:53 user nova-compute[75337]:     <enum name='firmware'/>
Nov 06 15:33:53 user nova-compute[75337]:     <loader supported='yes'>
Nov 06 15:33:53 user nova-compute[75337]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 06 15:33:53 user nova-compute[75337]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 06 15:33:53 user nova-compute[75337]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 06 15:33:53 user nova-compute[75337]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 06 15:33:53 user nova-compute[75337]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 06 15:33:53 user nova-compute[75337]:       <enum name='type'>
Nov 06 15:33:53 user nova-compute[75337]:         <value>rom</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>pflash</value>
Nov 06 15:33:53 user nova-compute[75337]:       </enum>
Nov 06 15:33:53 user nova-compute[75337]:       <enum name='readonly'>
Nov 06 15:33:53 user nova-compute[75337]:         <value>yes</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>no</value>
Nov 06 15:33:53 user nova-compute[75337]:       </enum>
Nov 06 15:33:53 user nova-compute[75337]:       <enum name='secure'>
Nov 06 15:33:53 user nova-compute[75337]:         <value>no</value>
Nov 06 15:33:53 user nova-compute[75337]:       </enum>
Nov 06 15:33:53 user nova-compute[75337]:     </loader>
Nov 06 15:33:53 user nova-compute[75337]:   </os>
Nov 06 15:33:53 user nova-compute[75337]:   <cpu>
Nov 06 15:33:53 user nova-compute[75337]:     <mode name='host-passthrough' supported='yes'>
Nov 06 15:33:53 user nova-compute[75337]:       <enum name='hostPassthroughMigratable'>
Nov 06 15:33:53 user nova-compute[75337]:         <value>off</value>
Nov 06 15:33:53 user nova-compute[75337]:       </enum>
Nov 06 15:33:53 user nova-compute[75337]:     </mode>
Nov 06 15:33:53 user nova-compute[75337]:     <mode name='maximum' supported='yes'>
Nov 06 15:33:53 user nova-compute[75337]:       <enum name='maximumMigratable'>
Nov 06 15:33:53 user nova-compute[75337]:         <value>on</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>off</value>
Nov 06 15:33:53 user nova-compute[75337]:       </enum>
Nov 06 15:33:53 user nova-compute[75337]:     </mode>
Nov 06 15:33:53 user nova-compute[75337]:     <mode name='host-model' supported='yes'>
Nov 06 15:33:53 user nova-compute[75337]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 06 15:33:53 user nova-compute[75337]:       <vendor>Intel</vendor>
Nov 06 15:33:53 user nova-compute[75337]:       <feature policy='require' name='ss'/>
Nov 06 15:33:53 user nova-compute[75337]:       <feature policy='require' name='vmx'/>
Nov 06 15:33:53 user nova-compute[75337]:       <feature policy='require' name='pcid'/>
Nov 06 15:33:53 user nova-compute[75337]:       <feature policy='require' name='hypervisor'/>
Nov 06 15:33:53 user nova-compute[75337]:       <feature policy='require' name='arat'/>
Nov 06 15:33:53 user nova-compute[75337]:       <feature policy='require' name='tsc_adjust'/>
Nov 06 15:33:53 user nova-compute[75337]:       <feature policy='require' name='umip'/>
Nov 06 15:33:53 user nova-compute[75337]:       <feature policy='require' name='md-clear'/>
Nov 06 15:33:53 user nova-compute[75337]:       <feature policy='require' name='stibp'/>
Nov 06 15:33:53 user nova-compute[75337]:       <feature policy='require' name='arch-capabilities'/>
Nov 06 15:33:53 user nova-compute[75337]:       <feature policy='require' name='ssbd'/>
Nov 06 15:33:53 user nova-compute[75337]:       <feature policy='require' name='ibpb'/>
Nov 06 15:33:53 user nova-compute[75337]:       <feature policy='require' name='ibrs'/>
Nov 06 15:33:53 user nova-compute[75337]:       <feature policy='require' name='amd-stibp'/>
Nov 06 15:33:53 user nova-compute[75337]:       <feature policy='require' name='amd-ssbd'/>
Nov 06 15:33:53 user nova-compute[75337]:       <feature policy='disable' name='erms'/>
Nov 06 15:33:53 user nova-compute[75337]:       <feature policy='disable' name='xsaveopt'/>
Nov 06 15:33:53 user nova-compute[75337]:       <feature policy='disable' name='lm'/>
Nov 06 15:33:53 user nova-compute[75337]:     </mode>
Nov 06 15:33:53 user nova-compute[75337]:     <mode name='custom' supported='yes'>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>qemu64</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='yes'>qemu32</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>phenom</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='yes'>pentium3</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='yes'>pentium2</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='yes'>pentium</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>n270</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>kvm64</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='yes'>kvm32</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='yes'>coreduo</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>core2duo</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>athlon</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Westmere-IBRS</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Westmere</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Snowridge</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Skylake-Server</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Skylake-Client</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>SandyBridge</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Penryn</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Opteron_G5</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Opteron_G4</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Opteron_G3</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Opteron_G2</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Opteron_G1</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Nehalem-IBRS</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Nehalem</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>IvyBridge</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Icelake-Server</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Haswell-noTSX</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Haswell-IBRS</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Haswell</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>EPYC-Rome</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>EPYC-Milan</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>EPYC-IBPB</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>EPYC</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Dhyana</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Cooperlake</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Conroe</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Cascadelake-Server</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Broadwell-noTSX</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Broadwell-IBRS</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Broadwell</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='yes'>486</model>
Nov 06 15:33:53 user nova-compute[75337]:     </mode>
Nov 06 15:33:53 user nova-compute[75337]:   </cpu>
Nov 06 15:33:53 user nova-compute[75337]:   <memoryBacking supported='yes'>
Nov 06 15:33:53 user nova-compute[75337]:     <enum name='sourceType'>
Nov 06 15:33:53 user nova-compute[75337]:       <value>file</value>
Nov 06 15:33:53 user nova-compute[75337]:       <value>anonymous</value>
Nov 06 15:33:53 user nova-compute[75337]:       <value>memfd</value>
Nov 06 15:33:53 user nova-compute[75337]:     </enum>
Nov 06 15:33:53 user nova-compute[75337]:   </memoryBacking>
Nov 06 15:33:53 user nova-compute[75337]:   <devices>
Nov 06 15:33:53 user nova-compute[75337]:     <disk supported='yes'>
Nov 06 15:33:53 user nova-compute[75337]:       <enum name='diskDevice'>
Nov 06 15:33:53 user nova-compute[75337]:         <value>disk</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>cdrom</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>floppy</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>lun</value>
Nov 06 15:33:53 user nova-compute[75337]:       </enum>
Nov 06 15:33:53 user nova-compute[75337]:       <enum name='bus'>
Nov 06 15:33:53 user nova-compute[75337]:         <value>ide</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>fdc</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>scsi</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>virtio</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>usb</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>sata</value>
Nov 06 15:33:53 user nova-compute[75337]:       </enum>
Nov 06 15:33:53 user nova-compute[75337]:       <enum name='model'>
Nov 06 15:33:53 user nova-compute[75337]:         <value>virtio</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>virtio-transitional</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>virtio-non-transitional</value>
Nov 06 15:33:53 user nova-compute[75337]:       </enum>
Nov 06 15:33:53 user nova-compute[75337]:     </disk>
Nov 06 15:33:53 user nova-compute[75337]:     <graphics supported='yes'>
Nov 06 15:33:53 user nova-compute[75337]:       <enum name='type'>
Nov 06 15:33:53 user nova-compute[75337]:         <value>sdl</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>vnc</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>spice</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>egl-headless</value>
Nov 06 15:33:53 user nova-compute[75337]:       </enum>
Nov 06 15:33:53 user nova-compute[75337]:     </graphics>
Nov 06 15:33:53 user nova-compute[75337]:     <video supported='yes'>
Nov 06 15:33:53 user nova-compute[75337]:       <enum name='modelType'>
Nov 06 15:33:53 user nova-compute[75337]:         <value>vga</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>cirrus</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>vmvga</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>qxl</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>virtio</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>none</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>bochs</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>ramfb</value>
Nov 06 15:33:53 user nova-compute[75337]:       </enum>
Nov 06 15:33:53 user nova-compute[75337]:     </video>
Nov 06 15:33:53 user nova-compute[75337]:     <hostdev supported='yes'>
Nov 06 15:33:53 user nova-compute[75337]:       <enum name='mode'>
Nov 06 15:33:53 user nova-compute[75337]:         <value>subsystem</value>
Nov 06 15:33:53 user nova-compute[75337]:       </enum>
Nov 06 15:33:53 user nova-compute[75337]:       <enum name='startupPolicy'>
Nov 06 15:33:53 user nova-compute[75337]:         <value>default</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>mandatory</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>requisite</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>optional</value>
Nov 06 15:33:53 user nova-compute[75337]:       </enum>
Nov 06 15:33:53 user nova-compute[75337]:       <enum name='subsysType'>
Nov 06 15:33:53 user nova-compute[75337]:         <value>usb</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>pci</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>scsi</value>
Nov 06 15:33:53 user nova-compute[75337]:       </enum>
Nov 06 15:33:53 user nova-compute[75337]:       <enum name='capsType'/>
Nov 06 15:33:53 user nova-compute[75337]:       <enum name='pciBackend'/>
Nov 06 15:33:53 user nova-compute[75337]:     </hostdev>
Nov 06 15:33:53 user nova-compute[75337]:     <rng supported='yes'>
Nov 06 15:33:53 user nova-compute[75337]:       <enum name='model'>
Nov 06 15:33:53 user nova-compute[75337]:         <value>virtio</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>virtio-transitional</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>virtio-non-transitional</value>
Nov 06 15:33:53 user nova-compute[75337]:       </enum>
Nov 06 15:33:53 user nova-compute[75337]:       <enum name='backendModel'>
Nov 06 15:33:53 user nova-compute[75337]:         <value>random</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>egd</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>builtin</value>
Nov 06 15:33:53 user nova-compute[75337]:       </enum>
Nov 06 15:33:53 user nova-compute[75337]:     </rng>
Nov 06 15:33:53 user nova-compute[75337]:     <filesystem supported='yes'>
Nov 06 15:33:53 user nova-compute[75337]:       <enum name='driverType'>
Nov 06 15:33:53 user nova-compute[75337]:         <value>path</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>handle</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>virtiofs</value>
Nov 06 15:33:53 user nova-compute[75337]:       </enum>
Nov 06 15:33:53 user nova-compute[75337]:     </filesystem>
Nov 06 15:33:53 user nova-compute[75337]:     <tpm supported='yes'>
Nov 06 15:33:53 user nova-compute[75337]:       <enum name='model'>
Nov 06 15:33:53 user nova-compute[75337]:         <value>tpm-tis</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>tpm-crb</value>
Nov 06 15:33:53 user nova-compute[75337]:       </enum>
Nov 06 15:33:53 user nova-compute[75337]:       <enum name='backendModel'>
Nov 06 15:33:53 user nova-compute[75337]:         <value>passthrough</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>emulator</value>
Nov 06 15:33:53 user nova-compute[75337]:       </enum>
Nov 06 15:33:53 user nova-compute[75337]:     </tpm>
Nov 06 15:33:53 user nova-compute[75337]:   </devices>
Nov 06 15:33:53 user nova-compute[75337]:   <features>
Nov 06 15:33:53 user nova-compute[75337]:     <gic supported='no'/>
Nov 06 15:33:53 user nova-compute[75337]:     <vmcoreinfo supported='yes'/>
Nov 06 15:33:53 user nova-compute[75337]:     <genid supported='yes'/>
Nov 06 15:33:53 user nova-compute[75337]:     <backingStoreInput supported='yes'/>
Nov 06 15:33:53 user nova-compute[75337]:     <backup supported='yes'/>
Nov 06 15:33:53 user nova-compute[75337]:     <sev supported='no'/>
Nov 06 15:33:53 user nova-compute[75337]:   </features>
Nov 06 15:33:53 user nova-compute[75337]: </domainCapabilities>
Nov 06 15:33:53 user nova-compute[75337]:  {{(pid=75337) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 06 15:33:53 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-1e6ae7ea-ba7d-43af-87d6-9a560ad5df4b None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Nov 06 15:33:53 user nova-compute[75337]: <domainCapabilities>
Nov 06 15:33:53 user nova-compute[75337]:   <path>/usr/bin/qemu-system-i386</path>
Nov 06 15:33:53 user nova-compute[75337]:   <domain>kvm</domain>
Nov 06 15:33:53 user nova-compute[75337]:   <machine>pc-q35-jammy</machine>
Nov 06 15:33:53 user nova-compute[75337]:   <arch>i686</arch>
Nov 06 15:33:53 user nova-compute[75337]:   <vcpu max='288'/>
Nov 06 15:33:53 user nova-compute[75337]:   <iothreads supported='yes'/>
Nov 06 15:33:53 user nova-compute[75337]:   <os supported='yes'>
Nov 06 15:33:53 user nova-compute[75337]:     <enum name='firmware'/>
Nov 06 15:33:53 user nova-compute[75337]:     <loader supported='yes'>
Nov 06 15:33:53 user nova-compute[75337]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 06 15:33:53 user nova-compute[75337]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 06 15:33:53 user nova-compute[75337]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 06 15:33:53 user nova-compute[75337]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 06 15:33:53 user nova-compute[75337]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 06 15:33:53 user nova-compute[75337]:       <enum name='type'>
Nov 06 15:33:53 user nova-compute[75337]:         <value>rom</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>pflash</value>
Nov 06 15:33:53 user nova-compute[75337]:       </enum>
Nov 06 15:33:53 user nova-compute[75337]:       <enum name='readonly'>
Nov 06 15:33:53 user nova-compute[75337]:         <value>yes</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>no</value>
Nov 06 15:33:53 user nova-compute[75337]:       </enum>
Nov 06 15:33:53 user nova-compute[75337]:       <enum name='secure'>
Nov 06 15:33:53 user nova-compute[75337]:         <value>no</value>
Nov 06 15:33:53 user nova-compute[75337]:       </enum>
Nov 06 15:33:53 user nova-compute[75337]:     </loader>
Nov 06 15:33:53 user nova-compute[75337]:   </os>
Nov 06 15:33:53 user nova-compute[75337]:   <cpu>
Nov 06 15:33:53 user nova-compute[75337]:     <mode name='host-passthrough' supported='yes'>
Nov 06 15:33:53 user nova-compute[75337]:       <enum name='hostPassthroughMigratable'>
Nov 06 15:33:53 user nova-compute[75337]:         <value>off</value>
Nov 06 15:33:53 user nova-compute[75337]:       </enum>
Nov 06 15:33:53 user nova-compute[75337]:     </mode>
Nov 06 15:33:53 user nova-compute[75337]:     <mode name='maximum' supported='yes'>
Nov 06 15:33:53 user nova-compute[75337]:       <enum name='maximumMigratable'>
Nov 06 15:33:53 user nova-compute[75337]:         <value>on</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>off</value>
Nov 06 15:33:53 user nova-compute[75337]:       </enum>
Nov 06 15:33:53 user nova-compute[75337]:     </mode>
Nov 06 15:33:53 user nova-compute[75337]:     <mode name='host-model' supported='yes'>
Nov 06 15:33:53 user nova-compute[75337]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 06 15:33:53 user nova-compute[75337]:       <vendor>Intel</vendor>
Nov 06 15:33:53 user nova-compute[75337]:       <feature policy='require' name='ss'/>
Nov 06 15:33:53 user nova-compute[75337]:       <feature policy='require' name='vmx'/>
Nov 06 15:33:53 user nova-compute[75337]:       <feature policy='require' name='pcid'/>
Nov 06 15:33:53 user nova-compute[75337]:       <feature policy='require' name='hypervisor'/>
Nov 06 15:33:53 user nova-compute[75337]:       <feature policy='require' name='arat'/>
Nov 06 15:33:53 user nova-compute[75337]:       <feature policy='require' name='tsc_adjust'/>
Nov 06 15:33:53 user nova-compute[75337]:       <feature policy='require' name='umip'/>
Nov 06 15:33:53 user nova-compute[75337]:       <feature policy='require' name='md-clear'/>
Nov 06 15:33:53 user nova-compute[75337]:       <feature policy='require' name='stibp'/>
Nov 06 15:33:53 user nova-compute[75337]:       <feature policy='require' name='arch-capabilities'/>
Nov 06 15:33:53 user nova-compute[75337]:       <feature policy='require' name='ssbd'/>
Nov 06 15:33:53 user nova-compute[75337]:       <feature policy='require' name='ibpb'/>
Nov 06 15:33:53 user nova-compute[75337]:       <feature policy='require' name='ibrs'/>
Nov 06 15:33:53 user nova-compute[75337]:       <feature policy='require' name='amd-stibp'/>
Nov 06 15:33:53 user nova-compute[75337]:       <feature policy='require' name='amd-ssbd'/>
Nov 06 15:33:53 user nova-compute[75337]:       <feature policy='disable' name='erms'/>
Nov 06 15:33:53 user nova-compute[75337]:       <feature policy='disable' name='xsaveopt'/>
Nov 06 15:33:53 user nova-compute[75337]:       <feature policy='disable' name='lm'/>
Nov 06 15:33:53 user nova-compute[75337]:     </mode>
Nov 06 15:33:53 user nova-compute[75337]:     <mode name='custom' supported='yes'>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>qemu64</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='yes'>qemu32</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>phenom</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='yes'>pentium3</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='yes'>pentium2</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='yes'>pentium</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>n270</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>kvm64</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='yes'>kvm32</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='yes'>coreduo</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>core2duo</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>athlon</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Westmere-IBRS</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Westmere</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Snowridge</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Skylake-Server</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Skylake-Client</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>SandyBridge</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Penryn</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Opteron_G5</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Opteron_G4</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Opteron_G3</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Opteron_G2</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Opteron_G1</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Nehalem-IBRS</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Nehalem</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>IvyBridge</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Icelake-Server</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Haswell-noTSX</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Haswell-IBRS</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Haswell</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>EPYC-Rome</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>EPYC-Milan</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>EPYC-IBPB</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>EPYC</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Dhyana</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Cooperlake</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Conroe</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Cascadelake-Server</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Broadwell-noTSX</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Broadwell-IBRS</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Broadwell</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='yes'>486</model>
Nov 06 15:33:53 user nova-compute[75337]:     </mode>
Nov 06 15:33:53 user nova-compute[75337]:   </cpu>
Nov 06 15:33:53 user nova-compute[75337]:   <memoryBacking supported='yes'>
Nov 06 15:33:53 user nova-compute[75337]:     <enum name='sourceType'>
Nov 06 15:33:53 user nova-compute[75337]:       <value>file</value>
Nov 06 15:33:53 user nova-compute[75337]:       <value>anonymous</value>
Nov 06 15:33:53 user nova-compute[75337]:       <value>memfd</value>
Nov 06 15:33:53 user nova-compute[75337]:     </enum>
Nov 06 15:33:53 user nova-compute[75337]:   </memoryBacking>
Nov 06 15:33:53 user nova-compute[75337]:   <devices>
Nov 06 15:33:53 user nova-compute[75337]:     <disk supported='yes'>
Nov 06 15:33:53 user nova-compute[75337]:       <enum name='diskDevice'>
Nov 06 15:33:53 user nova-compute[75337]:         <value>disk</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>cdrom</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>floppy</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>lun</value>
Nov 06 15:33:53 user nova-compute[75337]:       </enum>
Nov 06 15:33:53 user nova-compute[75337]:       <enum name='bus'>
Nov 06 15:33:53 user nova-compute[75337]:         <value>fdc</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>scsi</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>virtio</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>usb</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>sata</value>
Nov 06 15:33:53 user nova-compute[75337]:       </enum>
Nov 06 15:33:53 user nova-compute[75337]:       <enum name='model'>
Nov 06 15:33:53 user nova-compute[75337]:         <value>virtio</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>virtio-transitional</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>virtio-non-transitional</value>
Nov 06 15:33:53 user nova-compute[75337]:       </enum>
Nov 06 15:33:53 user nova-compute[75337]:     </disk>
Nov 06 15:33:53 user nova-compute[75337]:     <graphics supported='yes'>
Nov 06 15:33:53 user nova-compute[75337]:       <enum name='type'>
Nov 06 15:33:53 user nova-compute[75337]:         <value>sdl</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>vnc</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>spice</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>egl-headless</value>
Nov 06 15:33:53 user nova-compute[75337]:       </enum>
Nov 06 15:33:53 user nova-compute[75337]:     </graphics>
Nov 06 15:33:53 user nova-compute[75337]:     <video supported='yes'>
Nov 06 15:33:53 user nova-compute[75337]:       <enum name='modelType'>
Nov 06 15:33:53 user nova-compute[75337]:         <value>vga</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>cirrus</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>vmvga</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>qxl</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>virtio</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>none</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>bochs</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>ramfb</value>
Nov 06 15:33:53 user nova-compute[75337]:       </enum>
Nov 06 15:33:53 user nova-compute[75337]:     </video>
Nov 06 15:33:53 user nova-compute[75337]:     <hostdev supported='yes'>
Nov 06 15:33:53 user nova-compute[75337]:       <enum name='mode'>
Nov 06 15:33:53 user nova-compute[75337]:         <value>subsystem</value>
Nov 06 15:33:53 user nova-compute[75337]:       </enum>
Nov 06 15:33:53 user nova-compute[75337]:       <enum name='startupPolicy'>
Nov 06 15:33:53 user nova-compute[75337]:         <value>default</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>mandatory</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>requisite</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>optional</value>
Nov 06 15:33:53 user nova-compute[75337]:       </enum>
Nov 06 15:33:53 user nova-compute[75337]:       <enum name='subsysType'>
Nov 06 15:33:53 user nova-compute[75337]:         <value>usb</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>pci</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>scsi</value>
Nov 06 15:33:53 user nova-compute[75337]:       </enum>
Nov 06 15:33:53 user nova-compute[75337]:       <enum name='capsType'/>
Nov 06 15:33:53 user nova-compute[75337]:       <enum name='pciBackend'/>
Nov 06 15:33:53 user nova-compute[75337]:     </hostdev>
Nov 06 15:33:53 user nova-compute[75337]:     <rng supported='yes'>
Nov 06 15:33:53 user nova-compute[75337]:       <enum name='model'>
Nov 06 15:33:53 user nova-compute[75337]:         <value>virtio</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>virtio-transitional</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>virtio-non-transitional</value>
Nov 06 15:33:53 user nova-compute[75337]:       </enum>
Nov 06 15:33:53 user nova-compute[75337]:       <enum name='backendModel'>
Nov 06 15:33:53 user nova-compute[75337]:         <value>random</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>egd</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>builtin</value>
Nov 06 15:33:53 user nova-compute[75337]:       </enum>
Nov 06 15:33:53 user nova-compute[75337]:     </rng>
Nov 06 15:33:53 user nova-compute[75337]:     <filesystem supported='yes'>
Nov 06 15:33:53 user nova-compute[75337]:       <enum name='driverType'>
Nov 06 15:33:53 user nova-compute[75337]:         <value>path</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>handle</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>virtiofs</value>
Nov 06 15:33:53 user nova-compute[75337]:       </enum>
Nov 06 15:33:53 user nova-compute[75337]:     </filesystem>
Nov 06 15:33:53 user nova-compute[75337]:     <tpm supported='yes'>
Nov 06 15:33:53 user nova-compute[75337]:       <enum name='model'>
Nov 06 15:33:53 user nova-compute[75337]:         <value>tpm-tis</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>tpm-crb</value>
Nov 06 15:33:53 user nova-compute[75337]:       </enum>
Nov 06 15:33:53 user nova-compute[75337]:       <enum name='backendModel'>
Nov 06 15:33:53 user nova-compute[75337]:         <value>passthrough</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>emulator</value>
Nov 06 15:33:53 user nova-compute[75337]:       </enum>
Nov 06 15:33:53 user nova-compute[75337]:     </tpm>
Nov 06 15:33:53 user nova-compute[75337]:   </devices>
Nov 06 15:33:53 user nova-compute[75337]:   <features>
Nov 06 15:33:53 user nova-compute[75337]:     <gic supported='no'/>
Nov 06 15:33:53 user nova-compute[75337]:     <vmcoreinfo supported='yes'/>
Nov 06 15:33:53 user nova-compute[75337]:     <genid supported='yes'/>
Nov 06 15:33:53 user nova-compute[75337]:     <backingStoreInput supported='yes'/>
Nov 06 15:33:53 user nova-compute[75337]:     <backup supported='yes'/>
Nov 06 15:33:53 user nova-compute[75337]:     <sev supported='no'/>
Nov 06 15:33:53 user nova-compute[75337]:   </features>
Nov 06 15:33:53 user nova-compute[75337]: </domainCapabilities>
Nov 06 15:33:53 user nova-compute[75337]:  {{(pid=75337) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 06 15:33:53 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-1e6ae7ea-ba7d-43af-87d6-9a560ad5df4b None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Nov 06 15:33:53 user nova-compute[75337]: <domainCapabilities>
Nov 06 15:33:53 user nova-compute[75337]:   <path>/usr/bin/qemu-system-i386</path>
Nov 06 15:33:53 user nova-compute[75337]:   <domain>kvm</domain>
Nov 06 15:33:53 user nova-compute[75337]:   <machine>pc-q35-6.2</machine>
Nov 06 15:33:53 user nova-compute[75337]:   <arch>i686</arch>
Nov 06 15:33:53 user nova-compute[75337]:   <vcpu max='288'/>
Nov 06 15:33:53 user nova-compute[75337]:   <iothreads supported='yes'/>
Nov 06 15:33:53 user nova-compute[75337]:   <os supported='yes'>
Nov 06 15:33:53 user nova-compute[75337]:     <enum name='firmware'/>
Nov 06 15:33:53 user nova-compute[75337]:     <loader supported='yes'>
Nov 06 15:33:53 user nova-compute[75337]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 06 15:33:53 user nova-compute[75337]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 06 15:33:53 user nova-compute[75337]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 06 15:33:53 user nova-compute[75337]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 06 15:33:53 user nova-compute[75337]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 06 15:33:53 user nova-compute[75337]:       <enum name='type'>
Nov 06 15:33:53 user nova-compute[75337]:         <value>rom</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>pflash</value>
Nov 06 15:33:53 user nova-compute[75337]:       </enum>
Nov 06 15:33:53 user nova-compute[75337]:       <enum name='readonly'>
Nov 06 15:33:53 user nova-compute[75337]:         <value>yes</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>no</value>
Nov 06 15:33:53 user nova-compute[75337]:       </enum>
Nov 06 15:33:53 user nova-compute[75337]:       <enum name='secure'>
Nov 06 15:33:53 user nova-compute[75337]:         <value>no</value>
Nov 06 15:33:53 user nova-compute[75337]:       </enum>
Nov 06 15:33:53 user nova-compute[75337]:     </loader>
Nov 06 15:33:53 user nova-compute[75337]:   </os>
Nov 06 15:33:53 user nova-compute[75337]:   <cpu>
Nov 06 15:33:53 user nova-compute[75337]:     <mode name='host-passthrough' supported='yes'>
Nov 06 15:33:53 user nova-compute[75337]:       <enum name='hostPassthroughMigratable'>
Nov 06 15:33:53 user nova-compute[75337]:         <value>off</value>
Nov 06 15:33:53 user nova-compute[75337]:       </enum>
Nov 06 15:33:53 user nova-compute[75337]:     </mode>
Nov 06 15:33:53 user nova-compute[75337]:     <mode name='maximum' supported='yes'>
Nov 06 15:33:53 user nova-compute[75337]:       <enum name='maximumMigratable'>
Nov 06 15:33:53 user nova-compute[75337]:         <value>on</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>off</value>
Nov 06 15:33:53 user nova-compute[75337]:       </enum>
Nov 06 15:33:53 user nova-compute[75337]:     </mode>
Nov 06 15:33:53 user nova-compute[75337]:     <mode name='host-model' supported='yes'>
Nov 06 15:33:53 user nova-compute[75337]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 06 15:33:53 user nova-compute[75337]:       <vendor>Intel</vendor>
Nov 06 15:33:53 user nova-compute[75337]:       <feature policy='require' name='ss'/>
Nov 06 15:33:53 user nova-compute[75337]:       <feature policy='require' name='vmx'/>
Nov 06 15:33:53 user nova-compute[75337]:       <feature policy='require' name='pcid'/>
Nov 06 15:33:53 user nova-compute[75337]:       <feature policy='require' name='hypervisor'/>
Nov 06 15:33:53 user nova-compute[75337]:       <feature policy='require' name='arat'/>
Nov 06 15:33:53 user nova-compute[75337]:       <feature policy='require' name='tsc_adjust'/>
Nov 06 15:33:53 user nova-compute[75337]:       <feature policy='require' name='umip'/>
Nov 06 15:33:53 user nova-compute[75337]:       <feature policy='require' name='md-clear'/>
Nov 06 15:33:53 user nova-compute[75337]:       <feature policy='require' name='stibp'/>
Nov 06 15:33:53 user nova-compute[75337]:       <feature policy='require' name='arch-capabilities'/>
Nov 06 15:33:53 user nova-compute[75337]:       <feature policy='require' name='ssbd'/>
Nov 06 15:33:53 user nova-compute[75337]:       <feature policy='require' name='ibpb'/>
Nov 06 15:33:53 user nova-compute[75337]:       <feature policy='require' name='ibrs'/>
Nov 06 15:33:53 user nova-compute[75337]:       <feature policy='require' name='amd-stibp'/>
Nov 06 15:33:53 user nova-compute[75337]:       <feature policy='require' name='amd-ssbd'/>
Nov 06 15:33:53 user nova-compute[75337]:       <feature policy='disable' name='erms'/>
Nov 06 15:33:53 user nova-compute[75337]:       <feature policy='disable' name='xsaveopt'/>
Nov 06 15:33:53 user nova-compute[75337]:       <feature policy='disable' name='lm'/>
Nov 06 15:33:53 user nova-compute[75337]:     </mode>
Nov 06 15:33:53 user nova-compute[75337]:     <mode name='custom' supported='yes'>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>qemu64</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='yes'>qemu32</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>phenom</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='yes'>pentium3</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='yes'>pentium2</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='yes'>pentium</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>n270</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>kvm64</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='yes'>kvm32</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='yes'>coreduo</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>core2duo</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>athlon</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Westmere-IBRS</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Westmere</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Snowridge</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Skylake-Server</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Skylake-Client</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>SandyBridge</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Penryn</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Opteron_G5</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Opteron_G4</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Opteron_G3</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Opteron_G2</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Opteron_G1</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Nehalem-IBRS</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Nehalem</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>IvyBridge</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Icelake-Server</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Haswell-noTSX</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Haswell-IBRS</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Haswell</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>EPYC-Rome</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>EPYC-Milan</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>EPYC-IBPB</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>EPYC</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Dhyana</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Cooperlake</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Conroe</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Cascadelake-Server</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Broadwell-noTSX</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Broadwell-IBRS</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Broadwell</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='yes'>486</model>
Nov 06 15:33:53 user nova-compute[75337]:     </mode>
Nov 06 15:33:53 user nova-compute[75337]:   </cpu>
Nov 06 15:33:53 user nova-compute[75337]:   <memoryBacking supported='yes'>
Nov 06 15:33:53 user nova-compute[75337]:     <enum name='sourceType'>
Nov 06 15:33:53 user nova-compute[75337]:       <value>file</value>
Nov 06 15:33:53 user nova-compute[75337]:       <value>anonymous</value>
Nov 06 15:33:53 user nova-compute[75337]:       <value>memfd</value>
Nov 06 15:33:53 user nova-compute[75337]:     </enum>
Nov 06 15:33:53 user nova-compute[75337]:   </memoryBacking>
Nov 06 15:33:53 user nova-compute[75337]:   <devices>
Nov 06 15:33:53 user nova-compute[75337]:     <disk supported='yes'>
Nov 06 15:33:53 user nova-compute[75337]:       <enum name='diskDevice'>
Nov 06 15:33:53 user nova-compute[75337]:         <value>disk</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>cdrom</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>floppy</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>lun</value>
Nov 06 15:33:53 user nova-compute[75337]:       </enum>
Nov 06 15:33:53 user nova-compute[75337]:       <enum name='bus'>
Nov 06 15:33:53 user nova-compute[75337]:         <value>fdc</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>scsi</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>virtio</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>usb</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>sata</value>
Nov 06 15:33:53 user nova-compute[75337]:       </enum>
Nov 06 15:33:53 user nova-compute[75337]:       <enum name='model'>
Nov 06 15:33:53 user nova-compute[75337]:         <value>virtio</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>virtio-transitional</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>virtio-non-transitional</value>
Nov 06 15:33:53 user nova-compute[75337]:       </enum>
Nov 06 15:33:53 user nova-compute[75337]:     </disk>
Nov 06 15:33:53 user nova-compute[75337]:     <graphics supported='yes'>
Nov 06 15:33:53 user nova-compute[75337]:       <enum name='type'>
Nov 06 15:33:53 user nova-compute[75337]:         <value>sdl</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>vnc</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>spice</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>egl-headless</value>
Nov 06 15:33:53 user nova-compute[75337]:       </enum>
Nov 06 15:33:53 user nova-compute[75337]:     </graphics>
Nov 06 15:33:53 user nova-compute[75337]:     <video supported='yes'>
Nov 06 15:33:53 user nova-compute[75337]:       <enum name='modelType'>
Nov 06 15:33:53 user nova-compute[75337]:         <value>vga</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>cirrus</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>vmvga</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>qxl</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>virtio</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>none</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>bochs</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>ramfb</value>
Nov 06 15:33:53 user nova-compute[75337]:       </enum>
Nov 06 15:33:53 user nova-compute[75337]:     </video>
Nov 06 15:33:53 user nova-compute[75337]:     <hostdev supported='yes'>
Nov 06 15:33:53 user nova-compute[75337]:       <enum name='mode'>
Nov 06 15:33:53 user nova-compute[75337]:         <value>subsystem</value>
Nov 06 15:33:53 user nova-compute[75337]:       </enum>
Nov 06 15:33:53 user nova-compute[75337]:       <enum name='startupPolicy'>
Nov 06 15:33:53 user nova-compute[75337]:         <value>default</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>mandatory</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>requisite</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>optional</value>
Nov 06 15:33:53 user nova-compute[75337]:       </enum>
Nov 06 15:33:53 user nova-compute[75337]:       <enum name='subsysType'>
Nov 06 15:33:53 user nova-compute[75337]:         <value>usb</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>pci</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>scsi</value>
Nov 06 15:33:53 user nova-compute[75337]:       </enum>
Nov 06 15:33:53 user nova-compute[75337]:       <enum name='capsType'/>
Nov 06 15:33:53 user nova-compute[75337]:       <enum name='pciBackend'/>
Nov 06 15:33:53 user nova-compute[75337]:     </hostdev>
Nov 06 15:33:53 user nova-compute[75337]:     <rng supported='yes'>
Nov 06 15:33:53 user nova-compute[75337]:       <enum name='model'>
Nov 06 15:33:53 user nova-compute[75337]:         <value>virtio</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>virtio-transitional</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>virtio-non-transitional</value>
Nov 06 15:33:53 user nova-compute[75337]:       </enum>
Nov 06 15:33:53 user nova-compute[75337]:       <enum name='backendModel'>
Nov 06 15:33:53 user nova-compute[75337]:         <value>random</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>egd</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>builtin</value>
Nov 06 15:33:53 user nova-compute[75337]:       </enum>
Nov 06 15:33:53 user nova-compute[75337]:     </rng>
Nov 06 15:33:53 user nova-compute[75337]:     <filesystem supported='yes'>
Nov 06 15:33:53 user nova-compute[75337]:       <enum name='driverType'>
Nov 06 15:33:53 user nova-compute[75337]:         <value>path</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>handle</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>virtiofs</value>
Nov 06 15:33:53 user nova-compute[75337]:       </enum>
Nov 06 15:33:53 user nova-compute[75337]:     </filesystem>
Nov 06 15:33:53 user nova-compute[75337]:     <tpm supported='yes'>
Nov 06 15:33:53 user nova-compute[75337]:       <enum name='model'>
Nov 06 15:33:53 user nova-compute[75337]:         <value>tpm-tis</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>tpm-crb</value>
Nov 06 15:33:53 user nova-compute[75337]:       </enum>
Nov 06 15:33:53 user nova-compute[75337]:       <enum name='backendModel'>
Nov 06 15:33:53 user nova-compute[75337]:         <value>passthrough</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>emulator</value>
Nov 06 15:33:53 user nova-compute[75337]:       </enum>
Nov 06 15:33:53 user nova-compute[75337]:     </tpm>
Nov 06 15:33:53 user nova-compute[75337]:   </devices>
Nov 06 15:33:53 user nova-compute[75337]:   <features>
Nov 06 15:33:53 user nova-compute[75337]:     <gic supported='no'/>
Nov 06 15:33:53 user nova-compute[75337]:     <vmcoreinfo supported='yes'/>
Nov 06 15:33:53 user nova-compute[75337]:     <genid supported='yes'/>
Nov 06 15:33:53 user nova-compute[75337]:     <backingStoreInput supported='yes'/>
Nov 06 15:33:53 user nova-compute[75337]:     <backup supported='yes'/>
Nov 06 15:33:53 user nova-compute[75337]:     <sev supported='no'/>
Nov 06 15:33:53 user nova-compute[75337]:   </features>
Nov 06 15:33:53 user nova-compute[75337]: </domainCapabilities>
Nov 06 15:33:53 user nova-compute[75337]:  {{(pid=75337) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 06 15:33:53 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-1e6ae7ea-ba7d-43af-87d6-9a560ad5df4b None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Nov 06 15:33:53 user nova-compute[75337]: <domainCapabilities>
Nov 06 15:33:53 user nova-compute[75337]:   <path>/usr/bin/qemu-system-i386</path>
Nov 06 15:33:53 user nova-compute[75337]:   <domain>kvm</domain>
Nov 06 15:33:53 user nova-compute[75337]:   <machine>pc-i440fx-jammy</machine>
Nov 06 15:33:53 user nova-compute[75337]:   <arch>i686</arch>
Nov 06 15:33:53 user nova-compute[75337]:   <vcpu max='255'/>
Nov 06 15:33:53 user nova-compute[75337]:   <iothreads supported='yes'/>
Nov 06 15:33:53 user nova-compute[75337]:   <os supported='yes'>
Nov 06 15:33:53 user nova-compute[75337]:     <enum name='firmware'/>
Nov 06 15:33:53 user nova-compute[75337]:     <loader supported='yes'>
Nov 06 15:33:53 user nova-compute[75337]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 06 15:33:53 user nova-compute[75337]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 06 15:33:53 user nova-compute[75337]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 06 15:33:53 user nova-compute[75337]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 06 15:33:53 user nova-compute[75337]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 06 15:33:53 user nova-compute[75337]:       <enum name='type'>
Nov 06 15:33:53 user nova-compute[75337]:         <value>rom</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>pflash</value>
Nov 06 15:33:53 user nova-compute[75337]:       </enum>
Nov 06 15:33:53 user nova-compute[75337]:       <enum name='readonly'>
Nov 06 15:33:53 user nova-compute[75337]:         <value>yes</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>no</value>
Nov 06 15:33:53 user nova-compute[75337]:       </enum>
Nov 06 15:33:53 user nova-compute[75337]:       <enum name='secure'>
Nov 06 15:33:53 user nova-compute[75337]:         <value>no</value>
Nov 06 15:33:53 user nova-compute[75337]:       </enum>
Nov 06 15:33:53 user nova-compute[75337]:     </loader>
Nov 06 15:33:53 user nova-compute[75337]:   </os>
Nov 06 15:33:53 user nova-compute[75337]:   <cpu>
Nov 06 15:33:53 user nova-compute[75337]:     <mode name='host-passthrough' supported='yes'>
Nov 06 15:33:53 user nova-compute[75337]:       <enum name='hostPassthroughMigratable'>
Nov 06 15:33:53 user nova-compute[75337]:         <value>off</value>
Nov 06 15:33:53 user nova-compute[75337]:       </enum>
Nov 06 15:33:53 user nova-compute[75337]:     </mode>
Nov 06 15:33:53 user nova-compute[75337]:     <mode name='maximum' supported='yes'>
Nov 06 15:33:53 user nova-compute[75337]:       <enum name='maximumMigratable'>
Nov 06 15:33:53 user nova-compute[75337]:         <value>on</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>off</value>
Nov 06 15:33:53 user nova-compute[75337]:       </enum>
Nov 06 15:33:53 user nova-compute[75337]:     </mode>
Nov 06 15:33:53 user nova-compute[75337]:     <mode name='host-model' supported='yes'>
Nov 06 15:33:53 user nova-compute[75337]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 06 15:33:53 user nova-compute[75337]:       <vendor>Intel</vendor>
Nov 06 15:33:53 user nova-compute[75337]:       <feature policy='require' name='ss'/>
Nov 06 15:33:53 user nova-compute[75337]:       <feature policy='require' name='vmx'/>
Nov 06 15:33:53 user nova-compute[75337]:       <feature policy='require' name='pcid'/>
Nov 06 15:33:53 user nova-compute[75337]:       <feature policy='require' name='hypervisor'/>
Nov 06 15:33:53 user nova-compute[75337]:       <feature policy='require' name='arat'/>
Nov 06 15:33:53 user nova-compute[75337]:       <feature policy='require' name='tsc_adjust'/>
Nov 06 15:33:53 user nova-compute[75337]:       <feature policy='require' name='umip'/>
Nov 06 15:33:53 user nova-compute[75337]:       <feature policy='require' name='md-clear'/>
Nov 06 15:33:53 user nova-compute[75337]:       <feature policy='require' name='stibp'/>
Nov 06 15:33:53 user nova-compute[75337]:       <feature policy='require' name='arch-capabilities'/>
Nov 06 15:33:53 user nova-compute[75337]:       <feature policy='require' name='ssbd'/>
Nov 06 15:33:53 user nova-compute[75337]:       <feature policy='require' name='ibpb'/>
Nov 06 15:33:53 user nova-compute[75337]:       <feature policy='require' name='ibrs'/>
Nov 06 15:33:53 user nova-compute[75337]:       <feature policy='require' name='amd-stibp'/>
Nov 06 15:33:53 user nova-compute[75337]:       <feature policy='require' name='amd-ssbd'/>
Nov 06 15:33:53 user nova-compute[75337]:       <feature policy='disable' name='erms'/>
Nov 06 15:33:53 user nova-compute[75337]:       <feature policy='disable' name='xsaveopt'/>
Nov 06 15:33:53 user nova-compute[75337]:       <feature policy='disable' name='lm'/>
Nov 06 15:33:53 user nova-compute[75337]:     </mode>
Nov 06 15:33:53 user nova-compute[75337]:     <mode name='custom' supported='yes'>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>qemu64</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='yes'>qemu32</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>phenom</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='yes'>pentium3</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='yes'>pentium2</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='yes'>pentium</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>n270</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>kvm64</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='yes'>kvm32</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='yes'>coreduo</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>core2duo</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>athlon</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Westmere-IBRS</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Westmere</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Snowridge</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Skylake-Server</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Skylake-Client</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>SandyBridge</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Penryn</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Opteron_G5</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Opteron_G4</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Opteron_G3</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Opteron_G2</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Opteron_G1</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Nehalem-IBRS</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Nehalem</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>IvyBridge</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Icelake-Server</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Haswell-noTSX</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Haswell-IBRS</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Haswell</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>EPYC-Rome</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>EPYC-Milan</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>EPYC-IBPB</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>EPYC</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Dhyana</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Cooperlake</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Conroe</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Cascadelake-Server</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Broadwell-noTSX</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Broadwell-IBRS</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Broadwell</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='yes'>486</model>
Nov 06 15:33:53 user nova-compute[75337]:     </mode>
Nov 06 15:33:53 user nova-compute[75337]:   </cpu>
Nov 06 15:33:53 user nova-compute[75337]:   <memoryBacking supported='yes'>
Nov 06 15:33:53 user nova-compute[75337]:     <enum name='sourceType'>
Nov 06 15:33:53 user nova-compute[75337]:       <value>file</value>
Nov 06 15:33:53 user nova-compute[75337]:       <value>anonymous</value>
Nov 06 15:33:53 user nova-compute[75337]:       <value>memfd</value>
Nov 06 15:33:53 user nova-compute[75337]:     </enum>
Nov 06 15:33:53 user nova-compute[75337]:   </memoryBacking>
Nov 06 15:33:53 user nova-compute[75337]:   <devices>
Nov 06 15:33:53 user nova-compute[75337]:     <disk supported='yes'>
Nov 06 15:33:53 user nova-compute[75337]:       <enum name='diskDevice'>
Nov 06 15:33:53 user nova-compute[75337]:         <value>disk</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>cdrom</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>floppy</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>lun</value>
Nov 06 15:33:53 user nova-compute[75337]:       </enum>
Nov 06 15:33:53 user nova-compute[75337]:       <enum name='bus'>
Nov 06 15:33:53 user nova-compute[75337]:         <value>ide</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>fdc</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>scsi</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>virtio</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>usb</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>sata</value>
Nov 06 15:33:53 user nova-compute[75337]:       </enum>
Nov 06 15:33:53 user nova-compute[75337]:       <enum name='model'>
Nov 06 15:33:53 user nova-compute[75337]:         <value>virtio</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>virtio-transitional</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>virtio-non-transitional</value>
Nov 06 15:33:53 user nova-compute[75337]:       </enum>
Nov 06 15:33:53 user nova-compute[75337]:     </disk>
Nov 06 15:33:53 user nova-compute[75337]:     <graphics supported='yes'>
Nov 06 15:33:53 user nova-compute[75337]:       <enum name='type'>
Nov 06 15:33:53 user nova-compute[75337]:         <value>sdl</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>vnc</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>spice</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>egl-headless</value>
Nov 06 15:33:53 user nova-compute[75337]:       </enum>
Nov 06 15:33:53 user nova-compute[75337]:     </graphics>
Nov 06 15:33:53 user nova-compute[75337]:     <video supported='yes'>
Nov 06 15:33:53 user nova-compute[75337]:       <enum name='modelType'>
Nov 06 15:33:53 user nova-compute[75337]:         <value>vga</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>cirrus</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>vmvga</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>qxl</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>virtio</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>none</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>bochs</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>ramfb</value>
Nov 06 15:33:53 user nova-compute[75337]:       </enum>
Nov 06 15:33:53 user nova-compute[75337]:     </video>
Nov 06 15:33:53 user nova-compute[75337]:     <hostdev supported='yes'>
Nov 06 15:33:53 user nova-compute[75337]:       <enum name='mode'>
Nov 06 15:33:53 user nova-compute[75337]:         <value>subsystem</value>
Nov 06 15:33:53 user nova-compute[75337]:       </enum>
Nov 06 15:33:53 user nova-compute[75337]:       <enum name='startupPolicy'>
Nov 06 15:33:53 user nova-compute[75337]:         <value>default</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>mandatory</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>requisite</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>optional</value>
Nov 06 15:33:53 user nova-compute[75337]:       </enum>
Nov 06 15:33:53 user nova-compute[75337]:       <enum name='subsysType'>
Nov 06 15:33:53 user nova-compute[75337]:         <value>usb</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>pci</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>scsi</value>
Nov 06 15:33:53 user nova-compute[75337]:       </enum>
Nov 06 15:33:53 user nova-compute[75337]:       <enum name='capsType'/>
Nov 06 15:33:53 user nova-compute[75337]:       <enum name='pciBackend'/>
Nov 06 15:33:53 user nova-compute[75337]:     </hostdev>
Nov 06 15:33:53 user nova-compute[75337]:     <rng supported='yes'>
Nov 06 15:33:53 user nova-compute[75337]:       <enum name='model'>
Nov 06 15:33:53 user nova-compute[75337]:         <value>virtio</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>virtio-transitional</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>virtio-non-transitional</value>
Nov 06 15:33:53 user nova-compute[75337]:       </enum>
Nov 06 15:33:53 user nova-compute[75337]:       <enum name='backendModel'>
Nov 06 15:33:53 user nova-compute[75337]:         <value>random</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>egd</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>builtin</value>
Nov 06 15:33:53 user nova-compute[75337]:       </enum>
Nov 06 15:33:53 user nova-compute[75337]:     </rng>
Nov 06 15:33:53 user nova-compute[75337]:     <filesystem supported='yes'>
Nov 06 15:33:53 user nova-compute[75337]:       <enum name='driverType'>
Nov 06 15:33:53 user nova-compute[75337]:         <value>path</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>handle</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>virtiofs</value>
Nov 06 15:33:53 user nova-compute[75337]:       </enum>
Nov 06 15:33:53 user nova-compute[75337]:     </filesystem>
Nov 06 15:33:53 user nova-compute[75337]:     <tpm supported='yes'>
Nov 06 15:33:53 user nova-compute[75337]:       <enum name='model'>
Nov 06 15:33:53 user nova-compute[75337]:         <value>tpm-tis</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>tpm-crb</value>
Nov 06 15:33:53 user nova-compute[75337]:       </enum>
Nov 06 15:33:53 user nova-compute[75337]:       <enum name='backendModel'>
Nov 06 15:33:53 user nova-compute[75337]:         <value>passthrough</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>emulator</value>
Nov 06 15:33:53 user nova-compute[75337]:       </enum>
Nov 06 15:33:53 user nova-compute[75337]:     </tpm>
Nov 06 15:33:53 user nova-compute[75337]:   </devices>
Nov 06 15:33:53 user nova-compute[75337]:   <features>
Nov 06 15:33:53 user nova-compute[75337]:     <gic supported='no'/>
Nov 06 15:33:53 user nova-compute[75337]:     <vmcoreinfo supported='yes'/>
Nov 06 15:33:53 user nova-compute[75337]:     <genid supported='yes'/>
Nov 06 15:33:53 user nova-compute[75337]:     <backingStoreInput supported='yes'/>
Nov 06 15:33:53 user nova-compute[75337]:     <backup supported='yes'/>
Nov 06 15:33:53 user nova-compute[75337]:     <sev supported='no'/>
Nov 06 15:33:53 user nova-compute[75337]:   </features>
Nov 06 15:33:53 user nova-compute[75337]: </domainCapabilities>
Nov 06 15:33:53 user nova-compute[75337]:  {{(pid=75337) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 06 15:33:53 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-1e6ae7ea-ba7d-43af-87d6-9a560ad5df4b None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=75337) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 06 15:33:53 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-1e6ae7ea-ba7d-43af-87d6-9a560ad5df4b None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=75337) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 06 15:33:53 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-1e6ae7ea-ba7d-43af-87d6-9a560ad5df4b None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=75337) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 06 15:33:53 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-1e6ae7ea-ba7d-43af-87d6-9a560ad5df4b None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=75337) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 06 15:33:53 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-1e6ae7ea-ba7d-43af-87d6-9a560ad5df4b None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=75337) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 06 15:33:53 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-1e6ae7ea-ba7d-43af-87d6-9a560ad5df4b None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=75337) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 06 15:33:53 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-1e6ae7ea-ba7d-43af-87d6-9a560ad5df4b None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=75337) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 06 15:33:53 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-1e6ae7ea-ba7d-43af-87d6-9a560ad5df4b None None] Getting domain capabilities for mips via machine types: {None} {{(pid=75337) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 06 15:33:53 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-1e6ae7ea-ba7d-43af-87d6-9a560ad5df4b None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=75337) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 06 15:33:53 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-1e6ae7ea-ba7d-43af-87d6-9a560ad5df4b None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=75337) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 06 15:33:53 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-1e6ae7ea-ba7d-43af-87d6-9a560ad5df4b None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=75337) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 06 15:33:53 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-1e6ae7ea-ba7d-43af-87d6-9a560ad5df4b None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=75337) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 06 15:33:53 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-1e6ae7ea-ba7d-43af-87d6-9a560ad5df4b None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=75337) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 06 15:33:53 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-1e6ae7ea-ba7d-43af-87d6-9a560ad5df4b None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=75337) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 06 15:33:53 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-1e6ae7ea-ba7d-43af-87d6-9a560ad5df4b None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=75337) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 06 15:33:53 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-1e6ae7ea-ba7d-43af-87d6-9a560ad5df4b None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=75337) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 06 15:33:53 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-1e6ae7ea-ba7d-43af-87d6-9a560ad5df4b None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=75337) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 06 15:33:53 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-1e6ae7ea-ba7d-43af-87d6-9a560ad5df4b None None] Getting domain capabilities for ppc64 via machine types: {'powernv', 'pseries', None} {{(pid=75337) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 06 15:33:53 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-1e6ae7ea-ba7d-43af-87d6-9a560ad5df4b None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75337) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 06 15:33:53 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-1e6ae7ea-ba7d-43af-87d6-9a560ad5df4b None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75337) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 06 15:33:53 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-1e6ae7ea-ba7d-43af-87d6-9a560ad5df4b None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75337) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 06 15:33:53 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-1e6ae7ea-ba7d-43af-87d6-9a560ad5df4b None None] Getting domain capabilities for ppc64le via machine types: {'powernv', 'pseries'} {{(pid=75337) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 06 15:33:53 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-1e6ae7ea-ba7d-43af-87d6-9a560ad5df4b None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=75337) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 06 15:33:53 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-1e6ae7ea-ba7d-43af-87d6-9a560ad5df4b None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=75337) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 06 15:33:53 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-1e6ae7ea-ba7d-43af-87d6-9a560ad5df4b None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=75337) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 06 15:33:53 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-1e6ae7ea-ba7d-43af-87d6-9a560ad5df4b None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=75337) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 06 15:33:53 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-1e6ae7ea-ba7d-43af-87d6-9a560ad5df4b None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=75337) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 06 15:33:53 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-1e6ae7ea-ba7d-43af-87d6-9a560ad5df4b None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=75337) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 06 15:33:53 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-1e6ae7ea-ba7d-43af-87d6-9a560ad5df4b None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=75337) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 06 15:33:53 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-1e6ae7ea-ba7d-43af-87d6-9a560ad5df4b None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=75337) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 06 15:33:53 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-1e6ae7ea-ba7d-43af-87d6-9a560ad5df4b None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=75337) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 06 15:33:53 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-1e6ae7ea-ba7d-43af-87d6-9a560ad5df4b None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=75337) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 06 15:33:53 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-1e6ae7ea-ba7d-43af-87d6-9a560ad5df4b None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=75337) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 06 15:33:53 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-1e6ae7ea-ba7d-43af-87d6-9a560ad5df4b None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=75337) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 06 15:33:53 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-1e6ae7ea-ba7d-43af-87d6-9a560ad5df4b None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=75337) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 06 15:33:53 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-1e6ae7ea-ba7d-43af-87d6-9a560ad5df4b None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=75337) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 06 15:33:53 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-1e6ae7ea-ba7d-43af-87d6-9a560ad5df4b None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=75337) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 06 15:33:53 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-1e6ae7ea-ba7d-43af-87d6-9a560ad5df4b None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=75337) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 06 15:33:53 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-1e6ae7ea-ba7d-43af-87d6-9a560ad5df4b None None] Getting domain capabilities for x86_64 via machine types: {'pc', 'ubuntu-q35', 'q35', 'ubuntu'} {{(pid=75337) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 06 15:33:53 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-1e6ae7ea-ba7d-43af-87d6-9a560ad5df4b None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Nov 06 15:33:53 user nova-compute[75337]: <domainCapabilities>
Nov 06 15:33:53 user nova-compute[75337]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 06 15:33:53 user nova-compute[75337]:   <domain>kvm</domain>
Nov 06 15:33:53 user nova-compute[75337]:   <machine>pc-i440fx-6.2</machine>
Nov 06 15:33:53 user nova-compute[75337]:   <arch>x86_64</arch>
Nov 06 15:33:53 user nova-compute[75337]:   <vcpu max='255'/>
Nov 06 15:33:53 user nova-compute[75337]:   <iothreads supported='yes'/>
Nov 06 15:33:53 user nova-compute[75337]:   <os supported='yes'>
Nov 06 15:33:53 user nova-compute[75337]:     <enum name='firmware'>
Nov 06 15:33:53 user nova-compute[75337]:       <value>efi</value>
Nov 06 15:33:53 user nova-compute[75337]:     </enum>
Nov 06 15:33:53 user nova-compute[75337]:     <loader supported='yes'>
Nov 06 15:33:53 user nova-compute[75337]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 06 15:33:53 user nova-compute[75337]:       <enum name='type'>
Nov 06 15:33:53 user nova-compute[75337]:         <value>rom</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>pflash</value>
Nov 06 15:33:53 user nova-compute[75337]:       </enum>
Nov 06 15:33:53 user nova-compute[75337]:       <enum name='readonly'>
Nov 06 15:33:53 user nova-compute[75337]:         <value>yes</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>no</value>
Nov 06 15:33:53 user nova-compute[75337]:       </enum>
Nov 06 15:33:53 user nova-compute[75337]:       <enum name='secure'>
Nov 06 15:33:53 user nova-compute[75337]:         <value>no</value>
Nov 06 15:33:53 user nova-compute[75337]:       </enum>
Nov 06 15:33:53 user nova-compute[75337]:     </loader>
Nov 06 15:33:53 user nova-compute[75337]:   </os>
Nov 06 15:33:53 user nova-compute[75337]:   <cpu>
Nov 06 15:33:53 user nova-compute[75337]:     <mode name='host-passthrough' supported='yes'>
Nov 06 15:33:53 user nova-compute[75337]:       <enum name='hostPassthroughMigratable'>
Nov 06 15:33:53 user nova-compute[75337]:         <value>on</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>off</value>
Nov 06 15:33:53 user nova-compute[75337]:       </enum>
Nov 06 15:33:53 user nova-compute[75337]:     </mode>
Nov 06 15:33:53 user nova-compute[75337]:     <mode name='maximum' supported='yes'>
Nov 06 15:33:53 user nova-compute[75337]:       <enum name='maximumMigratable'>
Nov 06 15:33:53 user nova-compute[75337]:         <value>on</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>off</value>
Nov 06 15:33:53 user nova-compute[75337]:       </enum>
Nov 06 15:33:53 user nova-compute[75337]:     </mode>
Nov 06 15:33:53 user nova-compute[75337]:     <mode name='host-model' supported='yes'>
Nov 06 15:33:53 user nova-compute[75337]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 06 15:33:53 user nova-compute[75337]:       <vendor>Intel</vendor>
Nov 06 15:33:53 user nova-compute[75337]:       <feature policy='require' name='ss'/>
Nov 06 15:33:53 user nova-compute[75337]:       <feature policy='require' name='vmx'/>
Nov 06 15:33:53 user nova-compute[75337]:       <feature policy='require' name='pcid'/>
Nov 06 15:33:53 user nova-compute[75337]:       <feature policy='require' name='hypervisor'/>
Nov 06 15:33:53 user nova-compute[75337]:       <feature policy='require' name='arat'/>
Nov 06 15:33:53 user nova-compute[75337]:       <feature policy='require' name='tsc_adjust'/>
Nov 06 15:33:53 user nova-compute[75337]:       <feature policy='require' name='umip'/>
Nov 06 15:33:53 user nova-compute[75337]:       <feature policy='require' name='md-clear'/>
Nov 06 15:33:53 user nova-compute[75337]:       <feature policy='require' name='stibp'/>
Nov 06 15:33:53 user nova-compute[75337]:       <feature policy='require' name='arch-capabilities'/>
Nov 06 15:33:53 user nova-compute[75337]:       <feature policy='require' name='ssbd'/>
Nov 06 15:33:53 user nova-compute[75337]:       <feature policy='require' name='invtsc'/>
Nov 06 15:33:53 user nova-compute[75337]:       <feature policy='require' name='ibpb'/>
Nov 06 15:33:53 user nova-compute[75337]:       <feature policy='require' name='ibrs'/>
Nov 06 15:33:53 user nova-compute[75337]:       <feature policy='require' name='amd-stibp'/>
Nov 06 15:33:53 user nova-compute[75337]:       <feature policy='require' name='amd-ssbd'/>
Nov 06 15:33:53 user nova-compute[75337]:       <feature policy='require' name='rsba'/>
Nov 06 15:33:53 user nova-compute[75337]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 06 15:33:53 user nova-compute[75337]:       <feature policy='require' name='pschange-mc-no'/>
Nov 06 15:33:53 user nova-compute[75337]:       <feature policy='disable' name='erms'/>
Nov 06 15:33:53 user nova-compute[75337]:       <feature policy='disable' name='xsaveopt'/>
Nov 06 15:33:53 user nova-compute[75337]:     </mode>
Nov 06 15:33:53 user nova-compute[75337]:     <mode name='custom' supported='yes'>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>qemu64</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='yes'>qemu32</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>phenom</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='yes'>pentium3</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='yes'>pentium2</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='yes'>pentium</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>n270</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='yes'>kvm64</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='yes'>kvm32</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='yes'>coreduo</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='yes'>core2duo</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>athlon</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='yes'>Westmere-IBRS</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='yes'>Westmere</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Snowridge</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Skylake-Server</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Skylake-Client</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>SandyBridge</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='yes'>Penryn</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Opteron_G5</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Opteron_G4</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Opteron_G3</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Opteron_G2</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='yes'>Opteron_G1</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='yes'>Nehalem</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>IvyBridge</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Icelake-Server</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Haswell-noTSX</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Haswell-IBRS</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Haswell</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>EPYC-Rome</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>EPYC-Milan</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>EPYC-IBPB</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>EPYC</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Dhyana</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Cooperlake</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='yes'>Conroe</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Cascadelake-Server</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Broadwell-noTSX</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Broadwell-IBRS</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Broadwell</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='yes'>486</model>
Nov 06 15:33:53 user nova-compute[75337]:     </mode>
Nov 06 15:33:53 user nova-compute[75337]:   </cpu>
Nov 06 15:33:53 user nova-compute[75337]:   <memoryBacking supported='yes'>
Nov 06 15:33:53 user nova-compute[75337]:     <enum name='sourceType'>
Nov 06 15:33:53 user nova-compute[75337]:       <value>file</value>
Nov 06 15:33:53 user nova-compute[75337]:       <value>anonymous</value>
Nov 06 15:33:53 user nova-compute[75337]:       <value>memfd</value>
Nov 06 15:33:53 user nova-compute[75337]:     </enum>
Nov 06 15:33:53 user nova-compute[75337]:   </memoryBacking>
Nov 06 15:33:53 user nova-compute[75337]:   <devices>
Nov 06 15:33:53 user nova-compute[75337]:     <disk supported='yes'>
Nov 06 15:33:53 user nova-compute[75337]:       <enum name='diskDevice'>
Nov 06 15:33:53 user nova-compute[75337]:         <value>disk</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>cdrom</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>floppy</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>lun</value>
Nov 06 15:33:53 user nova-compute[75337]:       </enum>
Nov 06 15:33:53 user nova-compute[75337]:       <enum name='bus'>
Nov 06 15:33:53 user nova-compute[75337]:         <value>ide</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>fdc</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>scsi</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>virtio</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>usb</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>sata</value>
Nov 06 15:33:53 user nova-compute[75337]:       </enum>
Nov 06 15:33:53 user nova-compute[75337]:       <enum name='model'>
Nov 06 15:33:53 user nova-compute[75337]:         <value>virtio</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>virtio-transitional</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>virtio-non-transitional</value>
Nov 06 15:33:53 user nova-compute[75337]:       </enum>
Nov 06 15:33:53 user nova-compute[75337]:     </disk>
Nov 06 15:33:53 user nova-compute[75337]:     <graphics supported='yes'>
Nov 06 15:33:53 user nova-compute[75337]:       <enum name='type'>
Nov 06 15:33:53 user nova-compute[75337]:         <value>sdl</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>vnc</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>spice</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>egl-headless</value>
Nov 06 15:33:53 user nova-compute[75337]:       </enum>
Nov 06 15:33:53 user nova-compute[75337]:     </graphics>
Nov 06 15:33:53 user nova-compute[75337]:     <video supported='yes'>
Nov 06 15:33:53 user nova-compute[75337]:       <enum name='modelType'>
Nov 06 15:33:53 user nova-compute[75337]:         <value>vga</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>cirrus</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>vmvga</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>qxl</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>virtio</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>none</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>bochs</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>ramfb</value>
Nov 06 15:33:53 user nova-compute[75337]:       </enum>
Nov 06 15:33:53 user nova-compute[75337]:     </video>
Nov 06 15:33:53 user nova-compute[75337]:     <hostdev supported='yes'>
Nov 06 15:33:53 user nova-compute[75337]:       <enum name='mode'>
Nov 06 15:33:53 user nova-compute[75337]:         <value>subsystem</value>
Nov 06 15:33:53 user nova-compute[75337]:       </enum>
Nov 06 15:33:53 user nova-compute[75337]:       <enum name='startupPolicy'>
Nov 06 15:33:53 user nova-compute[75337]:         <value>default</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>mandatory</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>requisite</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>optional</value>
Nov 06 15:33:53 user nova-compute[75337]:       </enum>
Nov 06 15:33:53 user nova-compute[75337]:       <enum name='subsysType'>
Nov 06 15:33:53 user nova-compute[75337]:         <value>usb</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>pci</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>scsi</value>
Nov 06 15:33:53 user nova-compute[75337]:       </enum>
Nov 06 15:33:53 user nova-compute[75337]:       <enum name='capsType'/>
Nov 06 15:33:53 user nova-compute[75337]:       <enum name='pciBackend'/>
Nov 06 15:33:53 user nova-compute[75337]:     </hostdev>
Nov 06 15:33:53 user nova-compute[75337]:     <rng supported='yes'>
Nov 06 15:33:53 user nova-compute[75337]:       <enum name='model'>
Nov 06 15:33:53 user nova-compute[75337]:         <value>virtio</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>virtio-transitional</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>virtio-non-transitional</value>
Nov 06 15:33:53 user nova-compute[75337]:       </enum>
Nov 06 15:33:53 user nova-compute[75337]:       <enum name='backendModel'>
Nov 06 15:33:53 user nova-compute[75337]:         <value>random</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>egd</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>builtin</value>
Nov 06 15:33:53 user nova-compute[75337]:       </enum>
Nov 06 15:33:53 user nova-compute[75337]:     </rng>
Nov 06 15:33:53 user nova-compute[75337]:     <filesystem supported='yes'>
Nov 06 15:33:53 user nova-compute[75337]:       <enum name='driverType'>
Nov 06 15:33:53 user nova-compute[75337]:         <value>path</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>handle</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>virtiofs</value>
Nov 06 15:33:53 user nova-compute[75337]:       </enum>
Nov 06 15:33:53 user nova-compute[75337]:     </filesystem>
Nov 06 15:33:53 user nova-compute[75337]:     <tpm supported='yes'>
Nov 06 15:33:53 user nova-compute[75337]:       <enum name='model'>
Nov 06 15:33:53 user nova-compute[75337]:         <value>tpm-tis</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>tpm-crb</value>
Nov 06 15:33:53 user nova-compute[75337]:       </enum>
Nov 06 15:33:53 user nova-compute[75337]:       <enum name='backendModel'>
Nov 06 15:33:53 user nova-compute[75337]:         <value>passthrough</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>emulator</value>
Nov 06 15:33:53 user nova-compute[75337]:       </enum>
Nov 06 15:33:53 user nova-compute[75337]:     </tpm>
Nov 06 15:33:53 user nova-compute[75337]:   </devices>
Nov 06 15:33:53 user nova-compute[75337]:   <features>
Nov 06 15:33:53 user nova-compute[75337]:     <gic supported='no'/>
Nov 06 15:33:53 user nova-compute[75337]:     <vmcoreinfo supported='yes'/>
Nov 06 15:33:53 user nova-compute[75337]:     <genid supported='yes'/>
Nov 06 15:33:53 user nova-compute[75337]:     <backingStoreInput supported='yes'/>
Nov 06 15:33:53 user nova-compute[75337]:     <backup supported='yes'/>
Nov 06 15:33:53 user nova-compute[75337]:     <sev supported='no'/>
Nov 06 15:33:53 user nova-compute[75337]:   </features>
Nov 06 15:33:53 user nova-compute[75337]: </domainCapabilities>
Nov 06 15:33:53 user nova-compute[75337]:  {{(pid=75337) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 06 15:33:53 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-1e6ae7ea-ba7d-43af-87d6-9a560ad5df4b None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Nov 06 15:33:53 user nova-compute[75337]: <domainCapabilities>
Nov 06 15:33:53 user nova-compute[75337]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 06 15:33:53 user nova-compute[75337]:   <domain>kvm</domain>
Nov 06 15:33:53 user nova-compute[75337]:   <machine>pc-q35-jammy</machine>
Nov 06 15:33:53 user nova-compute[75337]:   <arch>x86_64</arch>
Nov 06 15:33:53 user nova-compute[75337]:   <vcpu max='288'/>
Nov 06 15:33:53 user nova-compute[75337]:   <iothreads supported='yes'/>
Nov 06 15:33:53 user nova-compute[75337]:   <os supported='yes'>
Nov 06 15:33:53 user nova-compute[75337]:     <enum name='firmware'>
Nov 06 15:33:53 user nova-compute[75337]:       <value>efi</value>
Nov 06 15:33:53 user nova-compute[75337]:     </enum>
Nov 06 15:33:53 user nova-compute[75337]:     <loader supported='yes'>
Nov 06 15:33:53 user nova-compute[75337]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 06 15:33:53 user nova-compute[75337]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 06 15:33:53 user nova-compute[75337]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 06 15:33:53 user nova-compute[75337]:       <enum name='type'>
Nov 06 15:33:53 user nova-compute[75337]:         <value>rom</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>pflash</value>
Nov 06 15:33:53 user nova-compute[75337]:       </enum>
Nov 06 15:33:53 user nova-compute[75337]:       <enum name='readonly'>
Nov 06 15:33:53 user nova-compute[75337]:         <value>yes</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>no</value>
Nov 06 15:33:53 user nova-compute[75337]:       </enum>
Nov 06 15:33:53 user nova-compute[75337]:       <enum name='secure'>
Nov 06 15:33:53 user nova-compute[75337]:         <value>yes</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>no</value>
Nov 06 15:33:53 user nova-compute[75337]:       </enum>
Nov 06 15:33:53 user nova-compute[75337]:     </loader>
Nov 06 15:33:53 user nova-compute[75337]:   </os>
Nov 06 15:33:53 user nova-compute[75337]:   <cpu>
Nov 06 15:33:53 user nova-compute[75337]:     <mode name='host-passthrough' supported='yes'>
Nov 06 15:33:53 user nova-compute[75337]:       <enum name='hostPassthroughMigratable'>
Nov 06 15:33:53 user nova-compute[75337]:         <value>on</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>off</value>
Nov 06 15:33:53 user nova-compute[75337]:       </enum>
Nov 06 15:33:53 user nova-compute[75337]:     </mode>
Nov 06 15:33:53 user nova-compute[75337]:     <mode name='maximum' supported='yes'>
Nov 06 15:33:53 user nova-compute[75337]:       <enum name='maximumMigratable'>
Nov 06 15:33:53 user nova-compute[75337]:         <value>on</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>off</value>
Nov 06 15:33:53 user nova-compute[75337]:       </enum>
Nov 06 15:33:53 user nova-compute[75337]:     </mode>
Nov 06 15:33:53 user nova-compute[75337]:     <mode name='host-model' supported='yes'>
Nov 06 15:33:53 user nova-compute[75337]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 06 15:33:53 user nova-compute[75337]:       <vendor>Intel</vendor>
Nov 06 15:33:53 user nova-compute[75337]:       <feature policy='require' name='ss'/>
Nov 06 15:33:53 user nova-compute[75337]:       <feature policy='require' name='vmx'/>
Nov 06 15:33:53 user nova-compute[75337]:       <feature policy='require' name='pcid'/>
Nov 06 15:33:53 user nova-compute[75337]:       <feature policy='require' name='hypervisor'/>
Nov 06 15:33:53 user nova-compute[75337]:       <feature policy='require' name='arat'/>
Nov 06 15:33:53 user nova-compute[75337]:       <feature policy='require' name='tsc_adjust'/>
Nov 06 15:33:53 user nova-compute[75337]:       <feature policy='require' name='umip'/>
Nov 06 15:33:53 user nova-compute[75337]:       <feature policy='require' name='md-clear'/>
Nov 06 15:33:53 user nova-compute[75337]:       <feature policy='require' name='stibp'/>
Nov 06 15:33:53 user nova-compute[75337]:       <feature policy='require' name='arch-capabilities'/>
Nov 06 15:33:53 user nova-compute[75337]:       <feature policy='require' name='ssbd'/>
Nov 06 15:33:53 user nova-compute[75337]:       <feature policy='require' name='invtsc'/>
Nov 06 15:33:53 user nova-compute[75337]:       <feature policy='require' name='ibpb'/>
Nov 06 15:33:53 user nova-compute[75337]:       <feature policy='require' name='ibrs'/>
Nov 06 15:33:53 user nova-compute[75337]:       <feature policy='require' name='amd-stibp'/>
Nov 06 15:33:53 user nova-compute[75337]:       <feature policy='require' name='amd-ssbd'/>
Nov 06 15:33:53 user nova-compute[75337]:       <feature policy='require' name='rsba'/>
Nov 06 15:33:53 user nova-compute[75337]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 06 15:33:53 user nova-compute[75337]:       <feature policy='require' name='pschange-mc-no'/>
Nov 06 15:33:53 user nova-compute[75337]:       <feature policy='disable' name='erms'/>
Nov 06 15:33:53 user nova-compute[75337]:       <feature policy='disable' name='xsaveopt'/>
Nov 06 15:33:53 user nova-compute[75337]:     </mode>
Nov 06 15:33:53 user nova-compute[75337]:     <mode name='custom' supported='yes'>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>qemu64</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='yes'>qemu32</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>phenom</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='yes'>pentium3</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='yes'>pentium2</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='yes'>pentium</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>n270</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='yes'>kvm64</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='yes'>kvm32</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='yes'>coreduo</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='yes'>core2duo</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>athlon</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='yes'>Westmere-IBRS</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='yes'>Westmere</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Snowridge</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Skylake-Server</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Skylake-Client</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>SandyBridge</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='yes'>Penryn</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Opteron_G5</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Opteron_G4</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Opteron_G3</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Opteron_G2</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='yes'>Opteron_G1</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='yes'>Nehalem</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>IvyBridge</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Icelake-Server</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Haswell-noTSX</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Haswell-IBRS</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Haswell</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>EPYC-Rome</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>EPYC-Milan</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>EPYC-IBPB</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>EPYC</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Dhyana</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Cooperlake</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='yes'>Conroe</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Cascadelake-Server</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Broadwell-noTSX</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Broadwell-IBRS</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Broadwell</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='yes'>486</model>
Nov 06 15:33:53 user nova-compute[75337]:     </mode>
Nov 06 15:33:53 user nova-compute[75337]:   </cpu>
Nov 06 15:33:53 user nova-compute[75337]:   <memoryBacking supported='yes'>
Nov 06 15:33:53 user nova-compute[75337]:     <enum name='sourceType'>
Nov 06 15:33:53 user nova-compute[75337]:       <value>file</value>
Nov 06 15:33:53 user nova-compute[75337]:       <value>anonymous</value>
Nov 06 15:33:53 user nova-compute[75337]:       <value>memfd</value>
Nov 06 15:33:53 user nova-compute[75337]:     </enum>
Nov 06 15:33:53 user nova-compute[75337]:   </memoryBacking>
Nov 06 15:33:53 user nova-compute[75337]:   <devices>
Nov 06 15:33:53 user nova-compute[75337]:     <disk supported='yes'>
Nov 06 15:33:53 user nova-compute[75337]:       <enum name='diskDevice'>
Nov 06 15:33:53 user nova-compute[75337]:         <value>disk</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>cdrom</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>floppy</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>lun</value>
Nov 06 15:33:53 user nova-compute[75337]:       </enum>
Nov 06 15:33:53 user nova-compute[75337]:       <enum name='bus'>
Nov 06 15:33:53 user nova-compute[75337]:         <value>fdc</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>scsi</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>virtio</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>usb</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>sata</value>
Nov 06 15:33:53 user nova-compute[75337]:       </enum>
Nov 06 15:33:53 user nova-compute[75337]:       <enum name='model'>
Nov 06 15:33:53 user nova-compute[75337]:         <value>virtio</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>virtio-transitional</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>virtio-non-transitional</value>
Nov 06 15:33:53 user nova-compute[75337]:       </enum>
Nov 06 15:33:53 user nova-compute[75337]:     </disk>
Nov 06 15:33:53 user nova-compute[75337]:     <graphics supported='yes'>
Nov 06 15:33:53 user nova-compute[75337]:       <enum name='type'>
Nov 06 15:33:53 user nova-compute[75337]:         <value>sdl</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>vnc</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>spice</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>egl-headless</value>
Nov 06 15:33:53 user nova-compute[75337]:       </enum>
Nov 06 15:33:53 user nova-compute[75337]:     </graphics>
Nov 06 15:33:53 user nova-compute[75337]:     <video supported='yes'>
Nov 06 15:33:53 user nova-compute[75337]:       <enum name='modelType'>
Nov 06 15:33:53 user nova-compute[75337]:         <value>vga</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>cirrus</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>vmvga</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>qxl</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>virtio</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>none</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>bochs</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>ramfb</value>
Nov 06 15:33:53 user nova-compute[75337]:       </enum>
Nov 06 15:33:53 user nova-compute[75337]:     </video>
Nov 06 15:33:53 user nova-compute[75337]:     <hostdev supported='yes'>
Nov 06 15:33:53 user nova-compute[75337]:       <enum name='mode'>
Nov 06 15:33:53 user nova-compute[75337]:         <value>subsystem</value>
Nov 06 15:33:53 user nova-compute[75337]:       </enum>
Nov 06 15:33:53 user nova-compute[75337]:       <enum name='startupPolicy'>
Nov 06 15:33:53 user nova-compute[75337]:         <value>default</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>mandatory</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>requisite</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>optional</value>
Nov 06 15:33:53 user nova-compute[75337]:       </enum>
Nov 06 15:33:53 user nova-compute[75337]:       <enum name='subsysType'>
Nov 06 15:33:53 user nova-compute[75337]:         <value>usb</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>pci</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>scsi</value>
Nov 06 15:33:53 user nova-compute[75337]:       </enum>
Nov 06 15:33:53 user nova-compute[75337]:       <enum name='capsType'/>
Nov 06 15:33:53 user nova-compute[75337]:       <enum name='pciBackend'/>
Nov 06 15:33:53 user nova-compute[75337]:     </hostdev>
Nov 06 15:33:53 user nova-compute[75337]:     <rng supported='yes'>
Nov 06 15:33:53 user nova-compute[75337]:       <enum name='model'>
Nov 06 15:33:53 user nova-compute[75337]:         <value>virtio</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>virtio-transitional</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>virtio-non-transitional</value>
Nov 06 15:33:53 user nova-compute[75337]:       </enum>
Nov 06 15:33:53 user nova-compute[75337]:       <enum name='backendModel'>
Nov 06 15:33:53 user nova-compute[75337]:         <value>random</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>egd</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>builtin</value>
Nov 06 15:33:53 user nova-compute[75337]:       </enum>
Nov 06 15:33:53 user nova-compute[75337]:     </rng>
Nov 06 15:33:53 user nova-compute[75337]:     <filesystem supported='yes'>
Nov 06 15:33:53 user nova-compute[75337]:       <enum name='driverType'>
Nov 06 15:33:53 user nova-compute[75337]:         <value>path</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>handle</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>virtiofs</value>
Nov 06 15:33:53 user nova-compute[75337]:       </enum>
Nov 06 15:33:53 user nova-compute[75337]:     </filesystem>
Nov 06 15:33:53 user nova-compute[75337]:     <tpm supported='yes'>
Nov 06 15:33:53 user nova-compute[75337]:       <enum name='model'>
Nov 06 15:33:53 user nova-compute[75337]:         <value>tpm-tis</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>tpm-crb</value>
Nov 06 15:33:53 user nova-compute[75337]:       </enum>
Nov 06 15:33:53 user nova-compute[75337]:       <enum name='backendModel'>
Nov 06 15:33:53 user nova-compute[75337]:         <value>passthrough</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>emulator</value>
Nov 06 15:33:53 user nova-compute[75337]:       </enum>
Nov 06 15:33:53 user nova-compute[75337]:     </tpm>
Nov 06 15:33:53 user nova-compute[75337]:   </devices>
Nov 06 15:33:53 user nova-compute[75337]:   <features>
Nov 06 15:33:53 user nova-compute[75337]:     <gic supported='no'/>
Nov 06 15:33:53 user nova-compute[75337]:     <vmcoreinfo supported='yes'/>
Nov 06 15:33:53 user nova-compute[75337]:     <genid supported='yes'/>
Nov 06 15:33:53 user nova-compute[75337]:     <backingStoreInput supported='yes'/>
Nov 06 15:33:53 user nova-compute[75337]:     <backup supported='yes'/>
Nov 06 15:33:53 user nova-compute[75337]:     <sev supported='no'/>
Nov 06 15:33:53 user nova-compute[75337]:   </features>
Nov 06 15:33:53 user nova-compute[75337]: </domainCapabilities>
Nov 06 15:33:53 user nova-compute[75337]:  {{(pid=75337) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 06 15:33:53 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-1e6ae7ea-ba7d-43af-87d6-9a560ad5df4b None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Nov 06 15:33:53 user nova-compute[75337]: <domainCapabilities>
Nov 06 15:33:53 user nova-compute[75337]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 06 15:33:53 user nova-compute[75337]:   <domain>kvm</domain>
Nov 06 15:33:53 user nova-compute[75337]:   <machine>pc-q35-6.2</machine>
Nov 06 15:33:53 user nova-compute[75337]:   <arch>x86_64</arch>
Nov 06 15:33:53 user nova-compute[75337]:   <vcpu max='288'/>
Nov 06 15:33:53 user nova-compute[75337]:   <iothreads supported='yes'/>
Nov 06 15:33:53 user nova-compute[75337]:   <os supported='yes'>
Nov 06 15:33:53 user nova-compute[75337]:     <enum name='firmware'>
Nov 06 15:33:53 user nova-compute[75337]:       <value>efi</value>
Nov 06 15:33:53 user nova-compute[75337]:     </enum>
Nov 06 15:33:53 user nova-compute[75337]:     <loader supported='yes'>
Nov 06 15:33:53 user nova-compute[75337]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 06 15:33:53 user nova-compute[75337]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 06 15:33:53 user nova-compute[75337]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 06 15:33:53 user nova-compute[75337]:       <enum name='type'>
Nov 06 15:33:53 user nova-compute[75337]:         <value>rom</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>pflash</value>
Nov 06 15:33:53 user nova-compute[75337]:       </enum>
Nov 06 15:33:53 user nova-compute[75337]:       <enum name='readonly'>
Nov 06 15:33:53 user nova-compute[75337]:         <value>yes</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>no</value>
Nov 06 15:33:53 user nova-compute[75337]:       </enum>
Nov 06 15:33:53 user nova-compute[75337]:       <enum name='secure'>
Nov 06 15:33:53 user nova-compute[75337]:         <value>yes</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>no</value>
Nov 06 15:33:53 user nova-compute[75337]:       </enum>
Nov 06 15:33:53 user nova-compute[75337]:     </loader>
Nov 06 15:33:53 user nova-compute[75337]:   </os>
Nov 06 15:33:53 user nova-compute[75337]:   <cpu>
Nov 06 15:33:53 user nova-compute[75337]:     <mode name='host-passthrough' supported='yes'>
Nov 06 15:33:53 user nova-compute[75337]:       <enum name='hostPassthroughMigratable'>
Nov 06 15:33:53 user nova-compute[75337]:         <value>on</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>off</value>
Nov 06 15:33:53 user nova-compute[75337]:       </enum>
Nov 06 15:33:53 user nova-compute[75337]:     </mode>
Nov 06 15:33:53 user nova-compute[75337]:     <mode name='maximum' supported='yes'>
Nov 06 15:33:53 user nova-compute[75337]:       <enum name='maximumMigratable'>
Nov 06 15:33:53 user nova-compute[75337]:         <value>on</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>off</value>
Nov 06 15:33:53 user nova-compute[75337]:       </enum>
Nov 06 15:33:53 user nova-compute[75337]:     </mode>
Nov 06 15:33:53 user nova-compute[75337]:     <mode name='host-model' supported='yes'>
Nov 06 15:33:53 user nova-compute[75337]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 06 15:33:53 user nova-compute[75337]:       <vendor>Intel</vendor>
Nov 06 15:33:53 user nova-compute[75337]:       <feature policy='require' name='ss'/>
Nov 06 15:33:53 user nova-compute[75337]:       <feature policy='require' name='vmx'/>
Nov 06 15:33:53 user nova-compute[75337]:       <feature policy='require' name='pcid'/>
Nov 06 15:33:53 user nova-compute[75337]:       <feature policy='require' name='hypervisor'/>
Nov 06 15:33:53 user nova-compute[75337]:       <feature policy='require' name='arat'/>
Nov 06 15:33:53 user nova-compute[75337]:       <feature policy='require' name='tsc_adjust'/>
Nov 06 15:33:53 user nova-compute[75337]:       <feature policy='require' name='umip'/>
Nov 06 15:33:53 user nova-compute[75337]:       <feature policy='require' name='md-clear'/>
Nov 06 15:33:53 user nova-compute[75337]:       <feature policy='require' name='stibp'/>
Nov 06 15:33:53 user nova-compute[75337]:       <feature policy='require' name='arch-capabilities'/>
Nov 06 15:33:53 user nova-compute[75337]:       <feature policy='require' name='ssbd'/>
Nov 06 15:33:53 user nova-compute[75337]:       <feature policy='require' name='invtsc'/>
Nov 06 15:33:53 user nova-compute[75337]:       <feature policy='require' name='ibpb'/>
Nov 06 15:33:53 user nova-compute[75337]:       <feature policy='require' name='ibrs'/>
Nov 06 15:33:53 user nova-compute[75337]:       <feature policy='require' name='amd-stibp'/>
Nov 06 15:33:53 user nova-compute[75337]:       <feature policy='require' name='amd-ssbd'/>
Nov 06 15:33:53 user nova-compute[75337]:       <feature policy='require' name='rsba'/>
Nov 06 15:33:53 user nova-compute[75337]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 06 15:33:53 user nova-compute[75337]:       <feature policy='require' name='pschange-mc-no'/>
Nov 06 15:33:53 user nova-compute[75337]:       <feature policy='disable' name='erms'/>
Nov 06 15:33:53 user nova-compute[75337]:       <feature policy='disable' name='xsaveopt'/>
Nov 06 15:33:53 user nova-compute[75337]:     </mode>
Nov 06 15:33:53 user nova-compute[75337]:     <mode name='custom' supported='yes'>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>qemu64</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='yes'>qemu32</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>phenom</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='yes'>pentium3</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='yes'>pentium2</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='yes'>pentium</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>n270</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='yes'>kvm64</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='yes'>kvm32</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='yes'>coreduo</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='yes'>core2duo</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>athlon</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='yes'>Westmere-IBRS</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='yes'>Westmere</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Snowridge</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Skylake-Server</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Skylake-Client</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>SandyBridge</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='yes'>Penryn</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Opteron_G5</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Opteron_G4</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Opteron_G3</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Opteron_G2</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='yes'>Opteron_G1</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='yes'>Nehalem</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>IvyBridge</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Icelake-Server</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Haswell-noTSX</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Haswell-IBRS</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Haswell</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>EPYC-Rome</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>EPYC-Milan</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>EPYC-IBPB</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>EPYC</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Dhyana</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Cooperlake</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='yes'>Conroe</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Cascadelake-Server</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Broadwell-noTSX</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Broadwell-IBRS</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Broadwell</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='yes'>486</model>
Nov 06 15:33:53 user nova-compute[75337]:     </mode>
Nov 06 15:33:53 user nova-compute[75337]:   </cpu>
Nov 06 15:33:53 user nova-compute[75337]:   <memoryBacking supported='yes'>
Nov 06 15:33:53 user nova-compute[75337]:     <enum name='sourceType'>
Nov 06 15:33:53 user nova-compute[75337]:       <value>file</value>
Nov 06 15:33:53 user nova-compute[75337]:       <value>anonymous</value>
Nov 06 15:33:53 user nova-compute[75337]:       <value>memfd</value>
Nov 06 15:33:53 user nova-compute[75337]:     </enum>
Nov 06 15:33:53 user nova-compute[75337]:   </memoryBacking>
Nov 06 15:33:53 user nova-compute[75337]:   <devices>
Nov 06 15:33:53 user nova-compute[75337]:     <disk supported='yes'>
Nov 06 15:33:53 user nova-compute[75337]:       <enum name='diskDevice'>
Nov 06 15:33:53 user nova-compute[75337]:         <value>disk</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>cdrom</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>floppy</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>lun</value>
Nov 06 15:33:53 user nova-compute[75337]:       </enum>
Nov 06 15:33:53 user nova-compute[75337]:       <enum name='bus'>
Nov 06 15:33:53 user nova-compute[75337]:         <value>fdc</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>scsi</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>virtio</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>usb</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>sata</value>
Nov 06 15:33:53 user nova-compute[75337]:       </enum>
Nov 06 15:33:53 user nova-compute[75337]:       <enum name='model'>
Nov 06 15:33:53 user nova-compute[75337]:         <value>virtio</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>virtio-transitional</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>virtio-non-transitional</value>
Nov 06 15:33:53 user nova-compute[75337]:       </enum>
Nov 06 15:33:53 user nova-compute[75337]:     </disk>
Nov 06 15:33:53 user nova-compute[75337]:     <graphics supported='yes'>
Nov 06 15:33:53 user nova-compute[75337]:       <enum name='type'>
Nov 06 15:33:53 user nova-compute[75337]:         <value>sdl</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>vnc</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>spice</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>egl-headless</value>
Nov 06 15:33:53 user nova-compute[75337]:       </enum>
Nov 06 15:33:53 user nova-compute[75337]:     </graphics>
Nov 06 15:33:53 user nova-compute[75337]:     <video supported='yes'>
Nov 06 15:33:53 user nova-compute[75337]:       <enum name='modelType'>
Nov 06 15:33:53 user nova-compute[75337]:         <value>vga</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>cirrus</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>vmvga</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>qxl</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>virtio</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>none</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>bochs</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>ramfb</value>
Nov 06 15:33:53 user nova-compute[75337]:       </enum>
Nov 06 15:33:53 user nova-compute[75337]:     </video>
Nov 06 15:33:53 user nova-compute[75337]:     <hostdev supported='yes'>
Nov 06 15:33:53 user nova-compute[75337]:       <enum name='mode'>
Nov 06 15:33:53 user nova-compute[75337]:         <value>subsystem</value>
Nov 06 15:33:53 user nova-compute[75337]:       </enum>
Nov 06 15:33:53 user nova-compute[75337]:       <enum name='startupPolicy'>
Nov 06 15:33:53 user nova-compute[75337]:         <value>default</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>mandatory</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>requisite</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>optional</value>
Nov 06 15:33:53 user nova-compute[75337]:       </enum>
Nov 06 15:33:53 user nova-compute[75337]:       <enum name='subsysType'>
Nov 06 15:33:53 user nova-compute[75337]:         <value>usb</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>pci</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>scsi</value>
Nov 06 15:33:53 user nova-compute[75337]:       </enum>
Nov 06 15:33:53 user nova-compute[75337]:       <enum name='capsType'/>
Nov 06 15:33:53 user nova-compute[75337]:       <enum name='pciBackend'/>
Nov 06 15:33:53 user nova-compute[75337]:     </hostdev>
Nov 06 15:33:53 user nova-compute[75337]:     <rng supported='yes'>
Nov 06 15:33:53 user nova-compute[75337]:       <enum name='model'>
Nov 06 15:33:53 user nova-compute[75337]:         <value>virtio</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>virtio-transitional</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>virtio-non-transitional</value>
Nov 06 15:33:53 user nova-compute[75337]:       </enum>
Nov 06 15:33:53 user nova-compute[75337]:       <enum name='backendModel'>
Nov 06 15:33:53 user nova-compute[75337]:         <value>random</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>egd</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>builtin</value>
Nov 06 15:33:53 user nova-compute[75337]:       </enum>
Nov 06 15:33:53 user nova-compute[75337]:     </rng>
Nov 06 15:33:53 user nova-compute[75337]:     <filesystem supported='yes'>
Nov 06 15:33:53 user nova-compute[75337]:       <enum name='driverType'>
Nov 06 15:33:53 user nova-compute[75337]:         <value>path</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>handle</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>virtiofs</value>
Nov 06 15:33:53 user nova-compute[75337]:       </enum>
Nov 06 15:33:53 user nova-compute[75337]:     </filesystem>
Nov 06 15:33:53 user nova-compute[75337]:     <tpm supported='yes'>
Nov 06 15:33:53 user nova-compute[75337]:       <enum name='model'>
Nov 06 15:33:53 user nova-compute[75337]:         <value>tpm-tis</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>tpm-crb</value>
Nov 06 15:33:53 user nova-compute[75337]:       </enum>
Nov 06 15:33:53 user nova-compute[75337]:       <enum name='backendModel'>
Nov 06 15:33:53 user nova-compute[75337]:         <value>passthrough</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>emulator</value>
Nov 06 15:33:53 user nova-compute[75337]:       </enum>
Nov 06 15:33:53 user nova-compute[75337]:     </tpm>
Nov 06 15:33:53 user nova-compute[75337]:   </devices>
Nov 06 15:33:53 user nova-compute[75337]:   <features>
Nov 06 15:33:53 user nova-compute[75337]:     <gic supported='no'/>
Nov 06 15:33:53 user nova-compute[75337]:     <vmcoreinfo supported='yes'/>
Nov 06 15:33:53 user nova-compute[75337]:     <genid supported='yes'/>
Nov 06 15:33:53 user nova-compute[75337]:     <backingStoreInput supported='yes'/>
Nov 06 15:33:53 user nova-compute[75337]:     <backup supported='yes'/>
Nov 06 15:33:53 user nova-compute[75337]:     <sev supported='no'/>
Nov 06 15:33:53 user nova-compute[75337]:   </features>
Nov 06 15:33:53 user nova-compute[75337]: </domainCapabilities>
Nov 06 15:33:53 user nova-compute[75337]:  {{(pid=75337) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 06 15:33:53 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-1e6ae7ea-ba7d-43af-87d6-9a560ad5df4b None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Nov 06 15:33:53 user nova-compute[75337]: <domainCapabilities>
Nov 06 15:33:53 user nova-compute[75337]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 06 15:33:53 user nova-compute[75337]:   <domain>kvm</domain>
Nov 06 15:33:53 user nova-compute[75337]:   <machine>pc-i440fx-jammy</machine>
Nov 06 15:33:53 user nova-compute[75337]:   <arch>x86_64</arch>
Nov 06 15:33:53 user nova-compute[75337]:   <vcpu max='255'/>
Nov 06 15:33:53 user nova-compute[75337]:   <iothreads supported='yes'/>
Nov 06 15:33:53 user nova-compute[75337]:   <os supported='yes'>
Nov 06 15:33:53 user nova-compute[75337]:     <enum name='firmware'>
Nov 06 15:33:53 user nova-compute[75337]:       <value>efi</value>
Nov 06 15:33:53 user nova-compute[75337]:     </enum>
Nov 06 15:33:53 user nova-compute[75337]:     <loader supported='yes'>
Nov 06 15:33:53 user nova-compute[75337]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 06 15:33:53 user nova-compute[75337]:       <enum name='type'>
Nov 06 15:33:53 user nova-compute[75337]:         <value>rom</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>pflash</value>
Nov 06 15:33:53 user nova-compute[75337]:       </enum>
Nov 06 15:33:53 user nova-compute[75337]:       <enum name='readonly'>
Nov 06 15:33:53 user nova-compute[75337]:         <value>yes</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>no</value>
Nov 06 15:33:53 user nova-compute[75337]:       </enum>
Nov 06 15:33:53 user nova-compute[75337]:       <enum name='secure'>
Nov 06 15:33:53 user nova-compute[75337]:         <value>no</value>
Nov 06 15:33:53 user nova-compute[75337]:       </enum>
Nov 06 15:33:53 user nova-compute[75337]:     </loader>
Nov 06 15:33:53 user nova-compute[75337]:   </os>
Nov 06 15:33:53 user nova-compute[75337]:   <cpu>
Nov 06 15:33:53 user nova-compute[75337]:     <mode name='host-passthrough' supported='yes'>
Nov 06 15:33:53 user nova-compute[75337]:       <enum name='hostPassthroughMigratable'>
Nov 06 15:33:53 user nova-compute[75337]:         <value>on</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>off</value>
Nov 06 15:33:53 user nova-compute[75337]:       </enum>
Nov 06 15:33:53 user nova-compute[75337]:     </mode>
Nov 06 15:33:53 user nova-compute[75337]:     <mode name='maximum' supported='yes'>
Nov 06 15:33:53 user nova-compute[75337]:       <enum name='maximumMigratable'>
Nov 06 15:33:53 user nova-compute[75337]:         <value>on</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>off</value>
Nov 06 15:33:53 user nova-compute[75337]:       </enum>
Nov 06 15:33:53 user nova-compute[75337]:     </mode>
Nov 06 15:33:53 user nova-compute[75337]:     <mode name='host-model' supported='yes'>
Nov 06 15:33:53 user nova-compute[75337]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 06 15:33:53 user nova-compute[75337]:       <vendor>Intel</vendor>
Nov 06 15:33:53 user nova-compute[75337]:       <feature policy='require' name='ss'/>
Nov 06 15:33:53 user nova-compute[75337]:       <feature policy='require' name='vmx'/>
Nov 06 15:33:53 user nova-compute[75337]:       <feature policy='require' name='pcid'/>
Nov 06 15:33:53 user nova-compute[75337]:       <feature policy='require' name='hypervisor'/>
Nov 06 15:33:53 user nova-compute[75337]:       <feature policy='require' name='arat'/>
Nov 06 15:33:53 user nova-compute[75337]:       <feature policy='require' name='tsc_adjust'/>
Nov 06 15:33:53 user nova-compute[75337]:       <feature policy='require' name='umip'/>
Nov 06 15:33:53 user nova-compute[75337]:       <feature policy='require' name='md-clear'/>
Nov 06 15:33:53 user nova-compute[75337]:       <feature policy='require' name='stibp'/>
Nov 06 15:33:53 user nova-compute[75337]:       <feature policy='require' name='arch-capabilities'/>
Nov 06 15:33:53 user nova-compute[75337]:       <feature policy='require' name='ssbd'/>
Nov 06 15:33:53 user nova-compute[75337]:       <feature policy='require' name='invtsc'/>
Nov 06 15:33:53 user nova-compute[75337]:       <feature policy='require' name='ibpb'/>
Nov 06 15:33:53 user nova-compute[75337]:       <feature policy='require' name='ibrs'/>
Nov 06 15:33:53 user nova-compute[75337]:       <feature policy='require' name='amd-stibp'/>
Nov 06 15:33:53 user nova-compute[75337]:       <feature policy='require' name='amd-ssbd'/>
Nov 06 15:33:53 user nova-compute[75337]:       <feature policy='require' name='rsba'/>
Nov 06 15:33:53 user nova-compute[75337]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 06 15:33:53 user nova-compute[75337]:       <feature policy='require' name='pschange-mc-no'/>
Nov 06 15:33:53 user nova-compute[75337]:       <feature policy='disable' name='erms'/>
Nov 06 15:33:53 user nova-compute[75337]:       <feature policy='disable' name='xsaveopt'/>
Nov 06 15:33:53 user nova-compute[75337]:     </mode>
Nov 06 15:33:53 user nova-compute[75337]:     <mode name='custom' supported='yes'>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>qemu64</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='yes'>qemu32</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>phenom</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='yes'>pentium3</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='yes'>pentium2</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='yes'>pentium</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>n270</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='yes'>kvm64</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='yes'>kvm32</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='yes'>coreduo</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='yes'>core2duo</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>athlon</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='yes'>Westmere-IBRS</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='yes'>Westmere</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Snowridge</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Skylake-Server</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Skylake-Client</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>SandyBridge</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='yes'>Penryn</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Opteron_G5</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Opteron_G4</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Opteron_G3</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Opteron_G2</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='yes'>Opteron_G1</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='yes'>Nehalem</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>IvyBridge</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Icelake-Server</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Haswell-noTSX</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Haswell-IBRS</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Haswell</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>EPYC-Rome</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>EPYC-Milan</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>EPYC-IBPB</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>EPYC</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Dhyana</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Cooperlake</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='yes'>Conroe</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Cascadelake-Server</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Broadwell-noTSX</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Broadwell-IBRS</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='no'>Broadwell</model>
Nov 06 15:33:53 user nova-compute[75337]:       <model usable='yes'>486</model>
Nov 06 15:33:53 user nova-compute[75337]:     </mode>
Nov 06 15:33:53 user nova-compute[75337]:   </cpu>
Nov 06 15:33:53 user nova-compute[75337]:   <memoryBacking supported='yes'>
Nov 06 15:33:53 user nova-compute[75337]:     <enum name='sourceType'>
Nov 06 15:33:53 user nova-compute[75337]:       <value>file</value>
Nov 06 15:33:53 user nova-compute[75337]:       <value>anonymous</value>
Nov 06 15:33:53 user nova-compute[75337]:       <value>memfd</value>
Nov 06 15:33:53 user nova-compute[75337]:     </enum>
Nov 06 15:33:53 user nova-compute[75337]:   </memoryBacking>
Nov 06 15:33:53 user nova-compute[75337]:   <devices>
Nov 06 15:33:53 user nova-compute[75337]:     <disk supported='yes'>
Nov 06 15:33:53 user nova-compute[75337]:       <enum name='diskDevice'>
Nov 06 15:33:53 user nova-compute[75337]:         <value>disk</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>cdrom</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>floppy</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>lun</value>
Nov 06 15:33:53 user nova-compute[75337]:       </enum>
Nov 06 15:33:53 user nova-compute[75337]:       <enum name='bus'>
Nov 06 15:33:53 user nova-compute[75337]:         <value>ide</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>fdc</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>scsi</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>virtio</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>usb</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>sata</value>
Nov 06 15:33:53 user nova-compute[75337]:       </enum>
Nov 06 15:33:53 user nova-compute[75337]:       <enum name='model'>
Nov 06 15:33:53 user nova-compute[75337]:         <value>virtio</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>virtio-transitional</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>virtio-non-transitional</value>
Nov 06 15:33:53 user nova-compute[75337]:       </enum>
Nov 06 15:33:53 user nova-compute[75337]:     </disk>
Nov 06 15:33:53 user nova-compute[75337]:     <graphics supported='yes'>
Nov 06 15:33:53 user nova-compute[75337]:       <enum name='type'>
Nov 06 15:33:53 user nova-compute[75337]:         <value>sdl</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>vnc</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>spice</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>egl-headless</value>
Nov 06 15:33:53 user nova-compute[75337]:       </enum>
Nov 06 15:33:53 user nova-compute[75337]:     </graphics>
Nov 06 15:33:53 user nova-compute[75337]:     <video supported='yes'>
Nov 06 15:33:53 user nova-compute[75337]:       <enum name='modelType'>
Nov 06 15:33:53 user nova-compute[75337]:         <value>vga</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>cirrus</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>vmvga</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>qxl</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>virtio</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>none</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>bochs</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>ramfb</value>
Nov 06 15:33:53 user nova-compute[75337]:       </enum>
Nov 06 15:33:53 user nova-compute[75337]:     </video>
Nov 06 15:33:53 user nova-compute[75337]:     <hostdev supported='yes'>
Nov 06 15:33:53 user nova-compute[75337]:       <enum name='mode'>
Nov 06 15:33:53 user nova-compute[75337]:         <value>subsystem</value>
Nov 06 15:33:53 user nova-compute[75337]:       </enum>
Nov 06 15:33:53 user nova-compute[75337]:       <enum name='startupPolicy'>
Nov 06 15:33:53 user nova-compute[75337]:         <value>default</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>mandatory</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>requisite</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>optional</value>
Nov 06 15:33:53 user nova-compute[75337]:       </enum>
Nov 06 15:33:53 user nova-compute[75337]:       <enum name='subsysType'>
Nov 06 15:33:53 user nova-compute[75337]:         <value>usb</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>pci</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>scsi</value>
Nov 06 15:33:53 user nova-compute[75337]:       </enum>
Nov 06 15:33:53 user nova-compute[75337]:       <enum name='capsType'/>
Nov 06 15:33:53 user nova-compute[75337]:       <enum name='pciBackend'/>
Nov 06 15:33:53 user nova-compute[75337]:     </hostdev>
Nov 06 15:33:53 user nova-compute[75337]:     <rng supported='yes'>
Nov 06 15:33:53 user nova-compute[75337]:       <enum name='model'>
Nov 06 15:33:53 user nova-compute[75337]:         <value>virtio</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>virtio-transitional</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>virtio-non-transitional</value>
Nov 06 15:33:53 user nova-compute[75337]:       </enum>
Nov 06 15:33:53 user nova-compute[75337]:       <enum name='backendModel'>
Nov 06 15:33:53 user nova-compute[75337]:         <value>random</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>egd</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>builtin</value>
Nov 06 15:33:53 user nova-compute[75337]:       </enum>
Nov 06 15:33:53 user nova-compute[75337]:     </rng>
Nov 06 15:33:53 user nova-compute[75337]:     <filesystem supported='yes'>
Nov 06 15:33:53 user nova-compute[75337]:       <enum name='driverType'>
Nov 06 15:33:53 user nova-compute[75337]:         <value>path</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>handle</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>virtiofs</value>
Nov 06 15:33:53 user nova-compute[75337]:       </enum>
Nov 06 15:33:53 user nova-compute[75337]:     </filesystem>
Nov 06 15:33:53 user nova-compute[75337]:     <tpm supported='yes'>
Nov 06 15:33:53 user nova-compute[75337]:       <enum name='model'>
Nov 06 15:33:53 user nova-compute[75337]:         <value>tpm-tis</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>tpm-crb</value>
Nov 06 15:33:53 user nova-compute[75337]:       </enum>
Nov 06 15:33:53 user nova-compute[75337]:       <enum name='backendModel'>
Nov 06 15:33:53 user nova-compute[75337]:         <value>passthrough</value>
Nov 06 15:33:53 user nova-compute[75337]:         <value>emulator</value>
Nov 06 15:33:53 user nova-compute[75337]:       </enum>
Nov 06 15:33:53 user nova-compute[75337]:     </tpm>
Nov 06 15:33:53 user nova-compute[75337]:   </devices>
Nov 06 15:33:53 user nova-compute[75337]:   <features>
Nov 06 15:33:53 user nova-compute[75337]:     <gic supported='no'/>
Nov 06 15:33:53 user nova-compute[75337]:     <vmcoreinfo supported='yes'/>
Nov 06 15:33:53 user nova-compute[75337]:     <genid supported='yes'/>
Nov 06 15:33:53 user nova-compute[75337]:     <backingStoreInput supported='yes'/>
Nov 06 15:33:53 user nova-compute[75337]:     <backup supported='yes'/>
Nov 06 15:33:53 user nova-compute[75337]:     <sev supported='no'/>
Nov 06 15:33:53 user nova-compute[75337]:   </features>
Nov 06 15:33:53 user nova-compute[75337]: </domainCapabilities>
Nov 06 15:33:53 user nova-compute[75337]:  {{(pid=75337) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 06 15:33:53 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-1e6ae7ea-ba7d-43af-87d6-9a560ad5df4b None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=75337) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 06 15:33:53 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-1e6ae7ea-ba7d-43af-87d6-9a560ad5df4b None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=75337) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 06 15:33:53 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-1e6ae7ea-ba7d-43af-87d6-9a560ad5df4b None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=75337) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 06 15:33:53 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-1e6ae7ea-ba7d-43af-87d6-9a560ad5df4b None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=75337) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 06 15:33:53 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-1e6ae7ea-ba7d-43af-87d6-9a560ad5df4b None None] Checking secure boot support for host arch (x86_64) {{(pid=75337) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 06 15:33:53 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-1e6ae7ea-ba7d-43af-87d6-9a560ad5df4b None None] Checking secure boot support for host arch (x86_64) {{(pid=75337) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 06 15:33:53 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-1e6ae7ea-ba7d-43af-87d6-9a560ad5df4b None None] Checking secure boot support for host arch (x86_64) {{(pid=75337) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 06 15:33:53 user nova-compute[75337]: INFO nova.virt.libvirt.host [None req-1e6ae7ea-ba7d-43af-87d6-9a560ad5df4b None None] Secure Boot support detected
Nov 06 15:33:53 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-1e6ae7ea-ba7d-43af-87d6-9a560ad5df4b None None] cpu compare xml: <cpu match="exact">
Nov 06 15:33:53 user nova-compute[75337]:   <model>Nehalem</model>
Nov 06 15:33:53 user nova-compute[75337]: </cpu>
Nov 06 15:33:53 user nova-compute[75337]:  {{(pid=75337) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Nov 06 15:33:53 user nova-compute[75337]: INFO nova.virt.node [None req-1e6ae7ea-ba7d-43af-87d6-9a560ad5df4b None None] Generated node identity 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7
Nov 06 15:33:53 user nova-compute[75337]: INFO nova.virt.node [None req-1e6ae7ea-ba7d-43af-87d6-9a560ad5df4b None None] Wrote node identity 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 to /opt/stack/data/nova/compute_id
Nov 06 15:33:53 user nova-compute[75337]: WARNING nova.compute.manager [None req-1e6ae7ea-ba7d-43af-87d6-9a560ad5df4b None None] Compute nodes ['4d91090a-92e5-4a8b-957b-2c8ad80bd8f7'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Nov 06 15:33:53 user nova-compute[75337]: INFO nova.compute.manager [None req-1e6ae7ea-ba7d-43af-87d6-9a560ad5df4b None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Nov 06 15:33:53 user nova-compute[75337]: WARNING nova.compute.manager [None req-1e6ae7ea-ba7d-43af-87d6-9a560ad5df4b None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 06 15:33:53 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-1e6ae7ea-ba7d-43af-87d6-9a560ad5df4b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:33:53 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-1e6ae7ea-ba7d-43af-87d6-9a560ad5df4b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:33:53 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-1e6ae7ea-ba7d-43af-87d6-9a560ad5df4b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:33:53 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-1e6ae7ea-ba7d-43af-87d6-9a560ad5df4b None None] Auditing locally available compute resources for user (node: user) {{(pid=75337) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 15:33:54 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-1e6ae7ea-ba7d-43af-87d6-9a560ad5df4b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 15:33:54 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-1e6ae7ea-ba7d-43af-87d6-9a560ad5df4b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 15:33:54 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-1e6ae7ea-ba7d-43af-87d6-9a560ad5df4b None None] Hypervisor/Node resource view: name=user free_ram=10939MB free_disk=26.13422393798828GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75337) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 15:33:54 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-1e6ae7ea-ba7d-43af-87d6-9a560ad5df4b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:33:54 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-1e6ae7ea-ba7d-43af-87d6-9a560ad5df4b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:33:54 user nova-compute[75337]: WARNING nova.compute.resource_tracker [None req-1e6ae7ea-ba7d-43af-87d6-9a560ad5df4b None None] No compute node record for user:4d91090a-92e5-4a8b-957b-2c8ad80bd8f7: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 could not be found.
Nov 06 15:33:54 user nova-compute[75337]: INFO nova.compute.resource_tracker [None req-1e6ae7ea-ba7d-43af-87d6-9a560ad5df4b None None] Compute node record created for user:user with uuid: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7
Nov 06 15:33:54 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-1e6ae7ea-ba7d-43af-87d6-9a560ad5df4b None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 15:33:54 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-1e6ae7ea-ba7d-43af-87d6-9a560ad5df4b None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 15:33:54 user nova-compute[75337]: INFO nova.scheduler.client.report [None req-1e6ae7ea-ba7d-43af-87d6-9a560ad5df4b None None] [req-edc22997-f2db-45f2-974e-1a303cd23673] Created resource provider record via placement API for resource provider with UUID 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 and name user.
Nov 06 15:33:54 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-1e6ae7ea-ba7d-43af-87d6-9a560ad5df4b None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=75337) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Nov 06 15:33:54 user nova-compute[75337]: INFO nova.virt.libvirt.host [None req-1e6ae7ea-ba7d-43af-87d6-9a560ad5df4b None None] kernel doesn't support AMD SEV
Nov 06 15:33:54 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-1e6ae7ea-ba7d-43af-87d6-9a560ad5df4b None None] Updating inventory in ProviderTree for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 06 15:33:54 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-1e6ae7ea-ba7d-43af-87d6-9a560ad5df4b None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75337) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 15:33:54 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-1e6ae7ea-ba7d-43af-87d6-9a560ad5df4b None None] Libvirt baseline CPU <cpu>
Nov 06 15:33:54 user nova-compute[75337]:   <arch>x86_64</arch>
Nov 06 15:33:54 user nova-compute[75337]:   <model>Nehalem</model>
Nov 06 15:33:54 user nova-compute[75337]:   <vendor>Intel</vendor>
Nov 06 15:33:54 user nova-compute[75337]:   <topology sockets="6" cores="1" threads="1"/>
Nov 06 15:33:54 user nova-compute[75337]: </cpu>
Nov 06 15:33:54 user nova-compute[75337]:  {{(pid=75337) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Nov 06 15:33:54 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-1e6ae7ea-ba7d-43af-87d6-9a560ad5df4b None None] Updated inventory for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Nov 06 15:33:54 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-1e6ae7ea-ba7d-43af-87d6-9a560ad5df4b None None] Updating resource provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 generation from 0 to 1 during operation: update_inventory {{(pid=75337) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 06 15:33:54 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-1e6ae7ea-ba7d-43af-87d6-9a560ad5df4b None None] Updating inventory in ProviderTree for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 06 15:33:54 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-1e6ae7ea-ba7d-43af-87d6-9a560ad5df4b None None] Updating resource provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 generation from 1 to 2 during operation: update_traits {{(pid=75337) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 06 15:33:54 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-1e6ae7ea-ba7d-43af-87d6-9a560ad5df4b None None] Compute_service record updated for user:user {{(pid=75337) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 15:33:54 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-1e6ae7ea-ba7d-43af-87d6-9a560ad5df4b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.645s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:33:54 user nova-compute[75337]: DEBUG nova.service [None req-1e6ae7ea-ba7d-43af-87d6-9a560ad5df4b None None] Creating RPC server for service compute {{(pid=75337) start /opt/stack/nova/nova/service.py:182}}
Nov 06 15:33:54 user nova-compute[75337]: DEBUG nova.service [None req-1e6ae7ea-ba7d-43af-87d6-9a560ad5df4b None None] Join ServiceGroup membership for this service compute {{(pid=75337) start /opt/stack/nova/nova/service.py:199}}
Nov 06 15:33:54 user nova-compute[75337]: DEBUG nova.servicegroup.drivers.db [None req-1e6ae7ea-ba7d-43af-87d6-9a560ad5df4b None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=75337) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Nov 06 15:34:29 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._sync_power_states {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:34:29 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:34:45 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:34:45 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:34:45 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Starting heal instance info cache {{(pid=75337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 15:34:45 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Rebuilding the list of instances to heal {{(pid=75337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 06 15:34:45 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Didn't find any instances for network info cache update. {{(pid=75337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 06 15:34:45 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:34:45 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:34:45 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:34:45 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:34:45 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:34:45 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:34:45 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75337) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 15:34:45 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager.update_available_resource {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:34:45 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:34:45 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:34:45 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:34:45 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Auditing locally available compute resources for user (node: user) {{(pid=75337) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 15:34:45 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 15:34:45 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 15:34:45 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Hypervisor/Node resource view: name=user free_ram=10368MB free_disk=26.03802490234375GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75337) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 15:34:45 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:34:45 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:34:45 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 15:34:45 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 15:34:45 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 15:34:45 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 15:34:46 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Compute_service record updated for user:user {{(pid=75337) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 15:34:46 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.166s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:35:46 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:35:46 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:35:46 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:35:46 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75337) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 15:35:46 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:35:46 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Starting heal instance info cache {{(pid=75337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 15:35:46 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Rebuilding the list of instances to heal {{(pid=75337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 06 15:35:46 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Didn't find any instances for network info cache update. {{(pid=75337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 06 15:35:46 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:35:47 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:35:47 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:35:47 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:35:47 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:35:47 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager.update_available_resource {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:35:47 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:35:47 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:35:47 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:35:47 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Auditing locally available compute resources for user (node: user) {{(pid=75337) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 15:35:47 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 15:35:47 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 15:35:47 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Hypervisor/Node resource view: name=user free_ram=10269MB free_disk=26.091304779052734GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75337) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 15:35:47 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:35:47 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:35:47 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 15:35:47 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 15:35:47 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 15:35:47 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 15:35:48 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Compute_service record updated for user:user {{(pid=75337) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 15:35:48 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.149s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:36:48 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:36:48 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:36:48 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Starting heal instance info cache {{(pid=75337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 15:36:48 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Rebuilding the list of instances to heal {{(pid=75337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 06 15:36:48 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Didn't find any instances for network info cache update. {{(pid=75337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 06 15:36:48 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:36:48 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:36:48 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:36:48 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:36:48 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:36:48 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75337) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 15:36:49 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:36:49 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager.update_available_resource {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:36:49 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:36:49 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:36:49 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:36:49 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Auditing locally available compute resources for user (node: user) {{(pid=75337) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 15:36:49 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 15:36:49 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 15:36:49 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Hypervisor/Node resource view: name=user free_ram=10257MB free_disk=25.85573959350586GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75337) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 15:36:49 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:36:49 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:36:49 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 15:36:49 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 15:36:49 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 15:36:49 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 15:36:49 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Compute_service record updated for user:user {{(pid=75337) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 15:36:49 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.133s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:37:47 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:37:47 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Starting heal instance info cache {{(pid=75337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 15:37:47 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Rebuilding the list of instances to heal {{(pid=75337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 06 15:37:47 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Didn't find any instances for network info cache update. {{(pid=75337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 06 15:37:47 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:37:47 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:37:48 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:37:48 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:37:48 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:37:48 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75337) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 15:37:49 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:37:49 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:37:49 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:37:49 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager.update_available_resource {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:37:49 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:37:49 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:37:49 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:37:49 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Auditing locally available compute resources for user (node: user) {{(pid=75337) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 15:37:49 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 15:37:49 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 15:37:49 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Hypervisor/Node resource view: name=user free_ram=9538MB free_disk=25.882980346679688GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75337) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 15:37:49 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:37:49 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:37:50 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 15:37:50 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 15:37:50 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 15:37:50 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 15:37:50 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Compute_service record updated for user:user {{(pid=75337) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 15:37:50 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.177s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:37:53 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-75bba3f0-8587-4ed8-bd52-888d6ae89130 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Acquiring lock "83516ff5-c4e7-4e91-a2f9-8af9b51cf475" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:37:53 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-75bba3f0-8587-4ed8-bd52-888d6ae89130 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Lock "83516ff5-c4e7-4e91-a2f9-8af9b51cf475" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:37:53 user nova-compute[75337]: DEBUG nova.compute.manager [None req-75bba3f0-8587-4ed8-bd52-888d6ae89130 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: 83516ff5-c4e7-4e91-a2f9-8af9b51cf475] Starting instance... {{(pid=75337) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 15:37:54 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-75bba3f0-8587-4ed8-bd52-888d6ae89130 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:37:54 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-75bba3f0-8587-4ed8-bd52-888d6ae89130 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:37:54 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-75bba3f0-8587-4ed8-bd52-888d6ae89130 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75337) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 15:37:54 user nova-compute[75337]: INFO nova.compute.claims [None req-75bba3f0-8587-4ed8-bd52-888d6ae89130 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: 83516ff5-c4e7-4e91-a2f9-8af9b51cf475] Claim successful on node user
Nov 06 15:37:54 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-75bba3f0-8587-4ed8-bd52-888d6ae89130 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 15:37:54 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-75bba3f0-8587-4ed8-bd52-888d6ae89130 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 15:37:54 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-75bba3f0-8587-4ed8-bd52-888d6ae89130 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.331s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:37:54 user nova-compute[75337]: DEBUG nova.compute.manager [None req-75bba3f0-8587-4ed8-bd52-888d6ae89130 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: 83516ff5-c4e7-4e91-a2f9-8af9b51cf475] Start building networks asynchronously for instance. {{(pid=75337) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 15:37:54 user nova-compute[75337]: DEBUG nova.compute.manager [None req-75bba3f0-8587-4ed8-bd52-888d6ae89130 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: 83516ff5-c4e7-4e91-a2f9-8af9b51cf475] Allocating IP information in the background. {{(pid=75337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 15:37:54 user nova-compute[75337]: DEBUG nova.network.neutron [None req-75bba3f0-8587-4ed8-bd52-888d6ae89130 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: 83516ff5-c4e7-4e91-a2f9-8af9b51cf475] allocate_for_instance() {{(pid=75337) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 15:37:54 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-75bba3f0-8587-4ed8-bd52-888d6ae89130 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: 83516ff5-c4e7-4e91-a2f9-8af9b51cf475] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 15:37:54 user nova-compute[75337]: DEBUG nova.compute.manager [None req-75bba3f0-8587-4ed8-bd52-888d6ae89130 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: 83516ff5-c4e7-4e91-a2f9-8af9b51cf475] Start building block device mappings for instance. {{(pid=75337) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 15:37:54 user nova-compute[75337]: DEBUG nova.compute.manager [None req-75bba3f0-8587-4ed8-bd52-888d6ae89130 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: 83516ff5-c4e7-4e91-a2f9-8af9b51cf475] Start spawning the instance on the hypervisor. {{(pid=75337) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 15:37:54 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-75bba3f0-8587-4ed8-bd52-888d6ae89130 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: 83516ff5-c4e7-4e91-a2f9-8af9b51cf475] Creating instance directory {{(pid=75337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 15:37:54 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-75bba3f0-8587-4ed8-bd52-888d6ae89130 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: 83516ff5-c4e7-4e91-a2f9-8af9b51cf475] Creating image(s)
Nov 06 15:37:54 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-75bba3f0-8587-4ed8-bd52-888d6ae89130 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Acquiring lock "/opt/stack/data/nova/instances/83516ff5-c4e7-4e91-a2f9-8af9b51cf475/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:37:54 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-75bba3f0-8587-4ed8-bd52-888d6ae89130 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Lock "/opt/stack/data/nova/instances/83516ff5-c4e7-4e91-a2f9-8af9b51cf475/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:37:54 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-75bba3f0-8587-4ed8-bd52-888d6ae89130 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Lock "/opt/stack/data/nova/instances/83516ff5-c4e7-4e91-a2f9-8af9b51cf475/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:37:54 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-75bba3f0-8587-4ed8-bd52-888d6ae89130 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Acquiring lock "06ba3c914798499e686c5ac75886932347225275" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:37:54 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-75bba3f0-8587-4ed8-bd52-888d6ae89130 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Lock "06ba3c914798499e686c5ac75886932347225275" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:37:55 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-75bba3f0-8587-4ed8-bd52-888d6ae89130 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275.part --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:37:55 user nova-compute[75337]: DEBUG nova.policy [None req-75bba3f0-8587-4ed8-bd52-888d6ae89130 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '74090d6e5b354d79bf6ded92e6de56aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb76b5b0f2b24f1c84a92403176bcc00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75337) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 15:37:55 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-75bba3f0-8587-4ed8-bd52-888d6ae89130 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275.part --force-share --output=json" returned: 0 in 0.197s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:37:55 user nova-compute[75337]: DEBUG nova.virt.images [None req-75bba3f0-8587-4ed8-bd52-888d6ae89130 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] 16b903ae-a40f-41a7-985b-4804cce92c62 was qcow2, converting to raw {{(pid=75337) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 06 15:37:55 user nova-compute[75337]: DEBUG nova.privsep.utils [None req-75bba3f0-8587-4ed8-bd52-888d6ae89130 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75337) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 06 15:37:55 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-75bba3f0-8587-4ed8-bd52-888d6ae89130 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275.part /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275.converted {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:37:55 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-75bba3f0-8587-4ed8-bd52-888d6ae89130 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275.part /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275.converted" returned: 0 in 0.183s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:37:55 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-75bba3f0-8587-4ed8-bd52-888d6ae89130 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275.converted --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:37:55 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-75bba3f0-8587-4ed8-bd52-888d6ae89130 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275.converted --force-share --output=json" returned: 0 in 0.209s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:37:55 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-75bba3f0-8587-4ed8-bd52-888d6ae89130 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Lock "06ba3c914798499e686c5ac75886932347225275" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.142s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:37:55 user nova-compute[75337]: INFO oslo.privsep.daemon [None req-75bba3f0-8587-4ed8-bd52-888d6ae89130 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpgl_2dyet/privsep.sock']
Nov 06 15:37:55 user sudo[84573]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpgl_2dyet/privsep.sock
Nov 06 15:37:55 user sudo[84573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 06 15:37:56 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-1fb51d76-ace3-4cae-bd21-10fb29d2c2fc tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] Acquiring lock "5f5fc58d-f946-4df0-b8d0-1aefbf0f8cd6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:37:56 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-1fb51d76-ace3-4cae-bd21-10fb29d2c2fc tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] Lock "5f5fc58d-f946-4df0-b8d0-1aefbf0f8cd6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:37:56 user nova-compute[75337]: DEBUG nova.compute.manager [None req-1fb51d76-ace3-4cae-bd21-10fb29d2c2fc tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] [instance: 5f5fc58d-f946-4df0-b8d0-1aefbf0f8cd6] Starting instance... {{(pid=75337) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 15:37:57 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-1fb51d76-ace3-4cae-bd21-10fb29d2c2fc tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:37:57 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-1fb51d76-ace3-4cae-bd21-10fb29d2c2fc tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:37:57 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-1fb51d76-ace3-4cae-bd21-10fb29d2c2fc tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75337) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 15:37:57 user nova-compute[75337]: INFO nova.compute.claims [None req-1fb51d76-ace3-4cae-bd21-10fb29d2c2fc tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] [instance: 5f5fc58d-f946-4df0-b8d0-1aefbf0f8cd6] Claim successful on node user
Nov 06 15:37:57 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-8ec9b84c-44ef-4746-b7cb-3670a5acf87d tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Acquiring lock "c8cf1ead-a87c-459c-b914-a0e976c9e464" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:37:57 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-8ec9b84c-44ef-4746-b7cb-3670a5acf87d tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Lock "c8cf1ead-a87c-459c-b914-a0e976c9e464" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:37:57 user nova-compute[75337]: DEBUG nova.compute.manager [None req-8ec9b84c-44ef-4746-b7cb-3670a5acf87d tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] [instance: c8cf1ead-a87c-459c-b914-a0e976c9e464] Starting instance... {{(pid=75337) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 15:37:57 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-8ec9b84c-44ef-4746-b7cb-3670a5acf87d tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:37:57 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-85a3dccf-6bd3-423b-963c-1b49593ba32d tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Acquiring lock "581cf468-65e7-42e5-9250-c3d645577011" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:37:57 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-85a3dccf-6bd3-423b-963c-1b49593ba32d tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Lock "581cf468-65e7-42e5-9250-c3d645577011" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:37:57 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-1fb51d76-ace3-4cae-bd21-10fb29d2c2fc tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 15:37:57 user nova-compute[75337]: DEBUG nova.compute.manager [None req-85a3dccf-6bd3-423b-963c-1b49593ba32d tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] [instance: 581cf468-65e7-42e5-9250-c3d645577011] Starting instance... {{(pid=75337) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 15:37:57 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-1fb51d76-ace3-4cae-bd21-10fb29d2c2fc tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 15:37:57 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-1fb51d76-ace3-4cae-bd21-10fb29d2c2fc tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.353s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:37:57 user nova-compute[75337]: DEBUG nova.compute.manager [None req-1fb51d76-ace3-4cae-bd21-10fb29d2c2fc tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] [instance: 5f5fc58d-f946-4df0-b8d0-1aefbf0f8cd6] Start building networks asynchronously for instance. {{(pid=75337) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 15:37:57 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-8ec9b84c-44ef-4746-b7cb-3670a5acf87d tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.120s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:37:57 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-8ec9b84c-44ef-4746-b7cb-3670a5acf87d tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75337) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 15:37:57 user nova-compute[75337]: INFO nova.compute.claims [None req-8ec9b84c-44ef-4746-b7cb-3670a5acf87d tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] [instance: c8cf1ead-a87c-459c-b914-a0e976c9e464] Claim successful on node user
Nov 06 15:37:57 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-85a3dccf-6bd3-423b-963c-1b49593ba32d tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:37:57 user nova-compute[75337]: DEBUG nova.compute.manager [None req-1fb51d76-ace3-4cae-bd21-10fb29d2c2fc tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] [instance: 5f5fc58d-f946-4df0-b8d0-1aefbf0f8cd6] Allocating IP information in the background. {{(pid=75337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 15:37:57 user nova-compute[75337]: DEBUG nova.network.neutron [None req-1fb51d76-ace3-4cae-bd21-10fb29d2c2fc tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] [instance: 5f5fc58d-f946-4df0-b8d0-1aefbf0f8cd6] allocate_for_instance() {{(pid=75337) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 15:37:57 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-1fb51d76-ace3-4cae-bd21-10fb29d2c2fc tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] [instance: 5f5fc58d-f946-4df0-b8d0-1aefbf0f8cd6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 15:37:57 user nova-compute[75337]: DEBUG nova.compute.manager [None req-1fb51d76-ace3-4cae-bd21-10fb29d2c2fc tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] [instance: 5f5fc58d-f946-4df0-b8d0-1aefbf0f8cd6] Start building block device mappings for instance. {{(pid=75337) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 15:37:57 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-8ec9b84c-44ef-4746-b7cb-3670a5acf87d tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 15:37:57 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-8ec9b84c-44ef-4746-b7cb-3670a5acf87d tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 15:37:57 user nova-compute[75337]: DEBUG nova.compute.manager [None req-1fb51d76-ace3-4cae-bd21-10fb29d2c2fc tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] [instance: 5f5fc58d-f946-4df0-b8d0-1aefbf0f8cd6] Start spawning the instance on the hypervisor. {{(pid=75337) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 15:37:57 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-1fb51d76-ace3-4cae-bd21-10fb29d2c2fc tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] [instance: 5f5fc58d-f946-4df0-b8d0-1aefbf0f8cd6] Creating instance directory {{(pid=75337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 15:37:57 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-1fb51d76-ace3-4cae-bd21-10fb29d2c2fc tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] [instance: 5f5fc58d-f946-4df0-b8d0-1aefbf0f8cd6] Creating image(s)
Nov 06 15:37:57 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-1fb51d76-ace3-4cae-bd21-10fb29d2c2fc tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] Acquiring lock "/opt/stack/data/nova/instances/5f5fc58d-f946-4df0-b8d0-1aefbf0f8cd6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:37:57 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-1fb51d76-ace3-4cae-bd21-10fb29d2c2fc tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] Lock "/opt/stack/data/nova/instances/5f5fc58d-f946-4df0-b8d0-1aefbf0f8cd6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:37:57 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-1fb51d76-ace3-4cae-bd21-10fb29d2c2fc tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] Lock "/opt/stack/data/nova/instances/5f5fc58d-f946-4df0-b8d0-1aefbf0f8cd6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:37:57 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-8ec9b84c-44ef-4746-b7cb-3670a5acf87d tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.377s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:37:57 user nova-compute[75337]: DEBUG nova.compute.manager [None req-8ec9b84c-44ef-4746-b7cb-3670a5acf87d tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] [instance: c8cf1ead-a87c-459c-b914-a0e976c9e464] Start building networks asynchronously for instance. {{(pid=75337) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 15:37:57 user sudo[84573]: pam_unix(sudo:session): session closed for user root
Nov 06 15:37:57 user nova-compute[75337]: DEBUG nova.network.neutron [None req-75bba3f0-8587-4ed8-bd52-888d6ae89130 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: 83516ff5-c4e7-4e91-a2f9-8af9b51cf475] Successfully created port: 452cb189-f59e-42e1-80e1-9eebb0c65bd7 {{(pid=75337) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 15:37:57 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-85a3dccf-6bd3-423b-963c-1b49593ba32d tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.309s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:37:57 user nova-compute[75337]: INFO oslo.privsep.daemon [None req-75bba3f0-8587-4ed8-bd52-888d6ae89130 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Spawned new privsep daemon via rootwrap
Nov 06 15:37:57 user nova-compute[75337]: DEBUG nova.policy [None req-1fb51d76-ace3-4cae-bd21-10fb29d2c2fc tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '92b6d879877241fa9372d76e52d41c6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b38d5a3287447a580dbd965f44e042c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75337) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 15:37:57 user nova-compute[75337]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 06 15:37:57 user nova-compute[75337]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 06 15:37:57 user nova-compute[75337]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Nov 06 15:37:57 user nova-compute[75337]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84594
Nov 06 15:37:57 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-85a3dccf-6bd3-423b-963c-1b49593ba32d tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75337) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 15:37:57 user nova-compute[75337]: INFO nova.compute.claims [None req-85a3dccf-6bd3-423b-963c-1b49593ba32d tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] [instance: 581cf468-65e7-42e5-9250-c3d645577011] Claim successful on node user
Nov 06 15:37:57 user nova-compute[75337]: WARNING oslo_privsep.priv_context [None req-1fb51d76-ace3-4cae-bd21-10fb29d2c2fc tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] privsep daemon already running
Nov 06 15:37:57 user nova-compute[75337]: DEBUG nova.compute.manager [None req-8ec9b84c-44ef-4746-b7cb-3670a5acf87d tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] [instance: c8cf1ead-a87c-459c-b914-a0e976c9e464] Allocating IP information in the background. {{(pid=75337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 15:37:57 user nova-compute[75337]: DEBUG nova.network.neutron [None req-8ec9b84c-44ef-4746-b7cb-3670a5acf87d tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] [instance: c8cf1ead-a87c-459c-b914-a0e976c9e464] allocate_for_instance() {{(pid=75337) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 15:37:57 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-8ec9b84c-44ef-4746-b7cb-3670a5acf87d tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] [instance: c8cf1ead-a87c-459c-b914-a0e976c9e464] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 15:37:57 user nova-compute[75337]: DEBUG nova.compute.manager [None req-8ec9b84c-44ef-4746-b7cb-3670a5acf87d tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] [instance: c8cf1ead-a87c-459c-b914-a0e976c9e464] Start building block device mappings for instance. {{(pid=75337) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 15:37:57 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-75bba3f0-8587-4ed8-bd52-888d6ae89130 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:37:57 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-1fb51d76-ace3-4cae-bd21-10fb29d2c2fc tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:37:58 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-75bba3f0-8587-4ed8-bd52-888d6ae89130 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json" returned: 0 in 0.208s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:37:58 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-1fb51d76-ace3-4cae-bd21-10fb29d2c2fc tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json" returned: 0 in 0.182s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:37:58 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-75bba3f0-8587-4ed8-bd52-888d6ae89130 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Acquiring lock "06ba3c914798499e686c5ac75886932347225275" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:37:58 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-75bba3f0-8587-4ed8-bd52-888d6ae89130 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Lock "06ba3c914798499e686c5ac75886932347225275" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:37:58 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-75bba3f0-8587-4ed8-bd52-888d6ae89130 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:37:58 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-1fb51d76-ace3-4cae-bd21-10fb29d2c2fc tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] Acquiring lock "06ba3c914798499e686c5ac75886932347225275" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:37:58 user nova-compute[75337]: DEBUG nova.policy [None req-8ec9b84c-44ef-4746-b7cb-3670a5acf87d tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f5356a7304a34428bbb0f39fb7d9a489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86f4b41336384a53a3fd22caa0fe8e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75337) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 15:37:58 user nova-compute[75337]: DEBUG nova.compute.manager [None req-8ec9b84c-44ef-4746-b7cb-3670a5acf87d tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] [instance: c8cf1ead-a87c-459c-b914-a0e976c9e464] Start spawning the instance on the hypervisor. {{(pid=75337) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 15:37:58 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-8ec9b84c-44ef-4746-b7cb-3670a5acf87d tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] [instance: c8cf1ead-a87c-459c-b914-a0e976c9e464] Creating instance directory {{(pid=75337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 15:37:58 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-8ec9b84c-44ef-4746-b7cb-3670a5acf87d tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] [instance: c8cf1ead-a87c-459c-b914-a0e976c9e464] Creating image(s)
Nov 06 15:37:58 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-8ec9b84c-44ef-4746-b7cb-3670a5acf87d tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Acquiring lock "/opt/stack/data/nova/instances/c8cf1ead-a87c-459c-b914-a0e976c9e464/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:37:58 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-8ec9b84c-44ef-4746-b7cb-3670a5acf87d tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Lock "/opt/stack/data/nova/instances/c8cf1ead-a87c-459c-b914-a0e976c9e464/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:37:58 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-8ec9b84c-44ef-4746-b7cb-3670a5acf87d tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Lock "/opt/stack/data/nova/instances/c8cf1ead-a87c-459c-b914-a0e976c9e464/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:37:58 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-8ec9b84c-44ef-4746-b7cb-3670a5acf87d tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:37:58 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-85a3dccf-6bd3-423b-963c-1b49593ba32d tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 15:37:58 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-75bba3f0-8587-4ed8-bd52-888d6ae89130 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json" returned: 0 in 0.210s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:37:58 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-75bba3f0-8587-4ed8-bd52-888d6ae89130 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275,backing_fmt=raw /opt/stack/data/nova/instances/83516ff5-c4e7-4e91-a2f9-8af9b51cf475/disk 1073741824 {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:37:58 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-85a3dccf-6bd3-423b-963c-1b49593ba32d tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 15:37:58 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-75bba3f0-8587-4ed8-bd52-888d6ae89130 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275,backing_fmt=raw /opt/stack/data/nova/instances/83516ff5-c4e7-4e91-a2f9-8af9b51cf475/disk 1073741824" returned: 0 in 0.071s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:37:58 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-de8e0a8f-0037-401a-bdef-954826a647d4 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Acquiring lock "8a600bd8-b94a-4242-a443-c2defb002280" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:37:58 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-de8e0a8f-0037-401a-bdef-954826a647d4 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Lock "8a600bd8-b94a-4242-a443-c2defb002280" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:37:58 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-75bba3f0-8587-4ed8-bd52-888d6ae89130 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Lock "06ba3c914798499e686c5ac75886932347225275" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.295s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:37:58 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-75bba3f0-8587-4ed8-bd52-888d6ae89130 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:37:58 user nova-compute[75337]: DEBUG nova.compute.manager [None req-de8e0a8f-0037-401a-bdef-954826a647d4 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] [instance: 8a600bd8-b94a-4242-a443-c2defb002280] Starting instance... {{(pid=75337) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 15:37:58 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-8ec9b84c-44ef-4746-b7cb-3670a5acf87d tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json" returned: 0 in 0.255s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:37:58 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-1fb51d76-ace3-4cae-bd21-10fb29d2c2fc tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] Lock "06ba3c914798499e686c5ac75886932347225275" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.307s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:37:58 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-1fb51d76-ace3-4cae-bd21-10fb29d2c2fc tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:37:58 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-85a3dccf-6bd3-423b-963c-1b49593ba32d tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.766s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:37:58 user nova-compute[75337]: DEBUG nova.compute.manager [None req-85a3dccf-6bd3-423b-963c-1b49593ba32d tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] [instance: 581cf468-65e7-42e5-9250-c3d645577011] Start building networks asynchronously for instance. {{(pid=75337) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 15:37:58 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-8ec9b84c-44ef-4746-b7cb-3670a5acf87d tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Acquiring lock "06ba3c914798499e686c5ac75886932347225275" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:37:58 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-de8e0a8f-0037-401a-bdef-954826a647d4 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:37:58 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-de8e0a8f-0037-401a-bdef-954826a647d4 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:37:58 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-de8e0a8f-0037-401a-bdef-954826a647d4 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75337) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 15:37:58 user nova-compute[75337]: INFO nova.compute.claims [None req-de8e0a8f-0037-401a-bdef-954826a647d4 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] [instance: 8a600bd8-b94a-4242-a443-c2defb002280] Claim successful on node user
Nov 06 15:37:58 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-75bba3f0-8587-4ed8-bd52-888d6ae89130 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json" returned: 0 in 0.184s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:37:58 user nova-compute[75337]: DEBUG nova.virt.disk.api [None req-75bba3f0-8587-4ed8-bd52-888d6ae89130 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Checking if we can resize image /opt/stack/data/nova/instances/83516ff5-c4e7-4e91-a2f9-8af9b51cf475/disk. size=1073741824 {{(pid=75337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 15:37:58 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-75bba3f0-8587-4ed8-bd52-888d6ae89130 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83516ff5-c4e7-4e91-a2f9-8af9b51cf475/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:37:58 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-1fb51d76-ace3-4cae-bd21-10fb29d2c2fc tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json" returned: 0 in 0.190s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:37:58 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-1fb51d76-ace3-4cae-bd21-10fb29d2c2fc tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275,backing_fmt=raw /opt/stack/data/nova/instances/5f5fc58d-f946-4df0-b8d0-1aefbf0f8cd6/disk 1073741824 {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:37:58 user nova-compute[75337]: DEBUG nova.compute.manager [None req-85a3dccf-6bd3-423b-963c-1b49593ba32d tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] [instance: 581cf468-65e7-42e5-9250-c3d645577011] Allocating IP information in the background. {{(pid=75337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 15:37:58 user nova-compute[75337]: DEBUG nova.network.neutron [None req-85a3dccf-6bd3-423b-963c-1b49593ba32d tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] [instance: 581cf468-65e7-42e5-9250-c3d645577011] allocate_for_instance() {{(pid=75337) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 15:37:58 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-1fb51d76-ace3-4cae-bd21-10fb29d2c2fc tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275,backing_fmt=raw /opt/stack/data/nova/instances/5f5fc58d-f946-4df0-b8d0-1aefbf0f8cd6/disk 1073741824" returned: 0 in 0.062s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:37:58 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-1fb51d76-ace3-4cae-bd21-10fb29d2c2fc tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] Lock "06ba3c914798499e686c5ac75886932347225275" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.257s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:37:58 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-1fb51d76-ace3-4cae-bd21-10fb29d2c2fc tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:37:58 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-8ec9b84c-44ef-4746-b7cb-3670a5acf87d tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Lock "06ba3c914798499e686c5ac75886932347225275" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.238s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:37:58 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-8ec9b84c-44ef-4746-b7cb-3670a5acf87d tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:37:58 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-85a3dccf-6bd3-423b-963c-1b49593ba32d tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] [instance: 581cf468-65e7-42e5-9250-c3d645577011] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 15:37:58 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-75bba3f0-8587-4ed8-bd52-888d6ae89130 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83516ff5-c4e7-4e91-a2f9-8af9b51cf475/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:37:58 user nova-compute[75337]: DEBUG nova.virt.disk.api [None req-75bba3f0-8587-4ed8-bd52-888d6ae89130 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Cannot resize image /opt/stack/data/nova/instances/83516ff5-c4e7-4e91-a2f9-8af9b51cf475/disk to a smaller size. {{(pid=75337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 06 15:37:58 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-75bba3f0-8587-4ed8-bd52-888d6ae89130 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: 83516ff5-c4e7-4e91-a2f9-8af9b51cf475] Created local disks {{(pid=75337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 15:37:58 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-75bba3f0-8587-4ed8-bd52-888d6ae89130 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: 83516ff5-c4e7-4e91-a2f9-8af9b51cf475] Ensure instance console log exists: /opt/stack/data/nova/instances/83516ff5-c4e7-4e91-a2f9-8af9b51cf475/console.log {{(pid=75337) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 15:37:58 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-75bba3f0-8587-4ed8-bd52-888d6ae89130 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:37:58 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-75bba3f0-8587-4ed8-bd52-888d6ae89130 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:37:58 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-75bba3f0-8587-4ed8-bd52-888d6ae89130 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:37:58 user nova-compute[75337]: DEBUG nova.compute.manager [None req-85a3dccf-6bd3-423b-963c-1b49593ba32d tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] [instance: 581cf468-65e7-42e5-9250-c3d645577011] Start building block device mappings for instance. {{(pid=75337) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 15:37:58 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-1fb51d76-ace3-4cae-bd21-10fb29d2c2fc tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json" returned: 0 in 0.193s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:37:58 user nova-compute[75337]: DEBUG nova.virt.disk.api [None req-1fb51d76-ace3-4cae-bd21-10fb29d2c2fc tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5f5fc58d-f946-4df0-b8d0-1aefbf0f8cd6/disk. size=1073741824 {{(pid=75337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 15:37:58 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-1fb51d76-ace3-4cae-bd21-10fb29d2c2fc tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f5fc58d-f946-4df0-b8d0-1aefbf0f8cd6/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:37:59 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-8ec9b84c-44ef-4746-b7cb-3670a5acf87d tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json" returned: 0 in 0.194s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:37:59 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-8ec9b84c-44ef-4746-b7cb-3670a5acf87d tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275,backing_fmt=raw /opt/stack/data/nova/instances/c8cf1ead-a87c-459c-b914-a0e976c9e464/disk 1073741824 {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:37:59 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-8ec9b84c-44ef-4746-b7cb-3670a5acf87d tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275,backing_fmt=raw /opt/stack/data/nova/instances/c8cf1ead-a87c-459c-b914-a0e976c9e464/disk 1073741824" returned: 0 in 0.049s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:37:59 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-8ec9b84c-44ef-4746-b7cb-3670a5acf87d tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Lock "06ba3c914798499e686c5ac75886932347225275" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.248s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:37:59 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-8ec9b84c-44ef-4746-b7cb-3670a5acf87d tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:37:59 user nova-compute[75337]: DEBUG nova.compute.manager [None req-85a3dccf-6bd3-423b-963c-1b49593ba32d tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] [instance: 581cf468-65e7-42e5-9250-c3d645577011] Start spawning the instance on the hypervisor. {{(pid=75337) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 15:37:59 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-85a3dccf-6bd3-423b-963c-1b49593ba32d tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] [instance: 581cf468-65e7-42e5-9250-c3d645577011] Creating instance directory {{(pid=75337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 15:37:59 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-85a3dccf-6bd3-423b-963c-1b49593ba32d tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] [instance: 581cf468-65e7-42e5-9250-c3d645577011] Creating image(s)
Nov 06 15:37:59 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-85a3dccf-6bd3-423b-963c-1b49593ba32d tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Acquiring lock "/opt/stack/data/nova/instances/581cf468-65e7-42e5-9250-c3d645577011/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:37:59 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-85a3dccf-6bd3-423b-963c-1b49593ba32d tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Lock "/opt/stack/data/nova/instances/581cf468-65e7-42e5-9250-c3d645577011/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:37:59 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-85a3dccf-6bd3-423b-963c-1b49593ba32d tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Lock "/opt/stack/data/nova/instances/581cf468-65e7-42e5-9250-c3d645577011/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:37:59 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-85a3dccf-6bd3-423b-963c-1b49593ba32d tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:37:59 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-1fb51d76-ace3-4cae-bd21-10fb29d2c2fc tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f5fc58d-f946-4df0-b8d0-1aefbf0f8cd6/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:37:59 user nova-compute[75337]: DEBUG nova.virt.disk.api [None req-1fb51d76-ace3-4cae-bd21-10fb29d2c2fc tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] Cannot resize image /opt/stack/data/nova/instances/5f5fc58d-f946-4df0-b8d0-1aefbf0f8cd6/disk to a smaller size. {{(pid=75337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 06 15:37:59 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-1fb51d76-ace3-4cae-bd21-10fb29d2c2fc tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] [instance: 5f5fc58d-f946-4df0-b8d0-1aefbf0f8cd6] Created local disks {{(pid=75337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 15:37:59 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-1fb51d76-ace3-4cae-bd21-10fb29d2c2fc tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] [instance: 5f5fc58d-f946-4df0-b8d0-1aefbf0f8cd6] Ensure instance console log exists: /opt/stack/data/nova/instances/5f5fc58d-f946-4df0-b8d0-1aefbf0f8cd6/console.log {{(pid=75337) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 15:37:59 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-1fb51d76-ace3-4cae-bd21-10fb29d2c2fc tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:37:59 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-1fb51d76-ace3-4cae-bd21-10fb29d2c2fc tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:37:59 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-1fb51d76-ace3-4cae-bd21-10fb29d2c2fc tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:37:59 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-de8e0a8f-0037-401a-bdef-954826a647d4 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 15:37:59 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-de8e0a8f-0037-401a-bdef-954826a647d4 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 15:37:59 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-8ec9b84c-44ef-4746-b7cb-3670a5acf87d tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json" returned: 0 in 0.165s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:37:59 user nova-compute[75337]: DEBUG nova.virt.disk.api [None req-8ec9b84c-44ef-4746-b7cb-3670a5acf87d tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c8cf1ead-a87c-459c-b914-a0e976c9e464/disk. size=1073741824 {{(pid=75337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 15:37:59 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-8ec9b84c-44ef-4746-b7cb-3670a5acf87d tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8cf1ead-a87c-459c-b914-a0e976c9e464/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:37:59 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-de8e0a8f-0037-401a-bdef-954826a647d4 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.635s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:37:59 user nova-compute[75337]: DEBUG nova.compute.manager [None req-de8e0a8f-0037-401a-bdef-954826a647d4 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] [instance: 8a600bd8-b94a-4242-a443-c2defb002280] Start building networks asynchronously for instance. {{(pid=75337) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 15:37:59 user nova-compute[75337]: DEBUG nova.policy [None req-85a3dccf-6bd3-423b-963c-1b49593ba32d tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2810a15c1608465aa7465eae455eb5c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40165c076e341bba42fb537ce98bbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75337) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 15:37:59 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-85a3dccf-6bd3-423b-963c-1b49593ba32d tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json" returned: 0 in 0.193s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:37:59 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-85a3dccf-6bd3-423b-963c-1b49593ba32d tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Acquiring lock "06ba3c914798499e686c5ac75886932347225275" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:37:59 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-85a3dccf-6bd3-423b-963c-1b49593ba32d tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Lock "06ba3c914798499e686c5ac75886932347225275" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:37:59 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-85a3dccf-6bd3-423b-963c-1b49593ba32d tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:37:59 user nova-compute[75337]: DEBUG nova.compute.manager [None req-de8e0a8f-0037-401a-bdef-954826a647d4 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] [instance: 8a600bd8-b94a-4242-a443-c2defb002280] Allocating IP information in the background. {{(pid=75337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 15:37:59 user nova-compute[75337]: DEBUG nova.network.neutron [None req-de8e0a8f-0037-401a-bdef-954826a647d4 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] [instance: 8a600bd8-b94a-4242-a443-c2defb002280] allocate_for_instance() {{(pid=75337) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 15:37:59 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-de8e0a8f-0037-401a-bdef-954826a647d4 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] [instance: 8a600bd8-b94a-4242-a443-c2defb002280] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 15:37:59 user nova-compute[75337]: DEBUG nova.compute.manager [None req-de8e0a8f-0037-401a-bdef-954826a647d4 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] [instance: 8a600bd8-b94a-4242-a443-c2defb002280] Start building block device mappings for instance. {{(pid=75337) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 15:37:59 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-8ec9b84c-44ef-4746-b7cb-3670a5acf87d tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8cf1ead-a87c-459c-b914-a0e976c9e464/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:37:59 user nova-compute[75337]: DEBUG nova.virt.disk.api [None req-8ec9b84c-44ef-4746-b7cb-3670a5acf87d tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Cannot resize image /opt/stack/data/nova/instances/c8cf1ead-a87c-459c-b914-a0e976c9e464/disk to a smaller size. {{(pid=75337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 06 15:37:59 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-8ec9b84c-44ef-4746-b7cb-3670a5acf87d tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] [instance: c8cf1ead-a87c-459c-b914-a0e976c9e464] Created local disks {{(pid=75337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 15:37:59 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-8ec9b84c-44ef-4746-b7cb-3670a5acf87d tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] [instance: c8cf1ead-a87c-459c-b914-a0e976c9e464] Ensure instance console log exists: /opt/stack/data/nova/instances/c8cf1ead-a87c-459c-b914-a0e976c9e464/console.log {{(pid=75337) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 15:37:59 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-8ec9b84c-44ef-4746-b7cb-3670a5acf87d tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:37:59 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-8ec9b84c-44ef-4746-b7cb-3670a5acf87d tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:37:59 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-8ec9b84c-44ef-4746-b7cb-3670a5acf87d tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:37:59 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-85a3dccf-6bd3-423b-963c-1b49593ba32d tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json" returned: 0 in 0.202s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:37:59 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-85a3dccf-6bd3-423b-963c-1b49593ba32d tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275,backing_fmt=raw /opt/stack/data/nova/instances/581cf468-65e7-42e5-9250-c3d645577011/disk 1073741824 {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:37:59 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-85a3dccf-6bd3-423b-963c-1b49593ba32d tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275,backing_fmt=raw /opt/stack/data/nova/instances/581cf468-65e7-42e5-9250-c3d645577011/disk 1073741824" returned: 0 in 0.049s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:37:59 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-85a3dccf-6bd3-423b-963c-1b49593ba32d tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Lock "06ba3c914798499e686c5ac75886932347225275" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.254s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:37:59 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-85a3dccf-6bd3-423b-963c-1b49593ba32d tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:37:59 user nova-compute[75337]: DEBUG nova.compute.manager [None req-de8e0a8f-0037-401a-bdef-954826a647d4 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] [instance: 8a600bd8-b94a-4242-a443-c2defb002280] Start spawning the instance on the hypervisor. {{(pid=75337) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 15:37:59 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-de8e0a8f-0037-401a-bdef-954826a647d4 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] [instance: 8a600bd8-b94a-4242-a443-c2defb002280] Creating instance directory {{(pid=75337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 15:37:59 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-de8e0a8f-0037-401a-bdef-954826a647d4 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] [instance: 8a600bd8-b94a-4242-a443-c2defb002280] Creating image(s)
Nov 06 15:37:59 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-de8e0a8f-0037-401a-bdef-954826a647d4 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Acquiring lock "/opt/stack/data/nova/instances/8a600bd8-b94a-4242-a443-c2defb002280/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:37:59 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-de8e0a8f-0037-401a-bdef-954826a647d4 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Lock "/opt/stack/data/nova/instances/8a600bd8-b94a-4242-a443-c2defb002280/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:37:59 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-de8e0a8f-0037-401a-bdef-954826a647d4 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Lock "/opt/stack/data/nova/instances/8a600bd8-b94a-4242-a443-c2defb002280/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:37:59 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-de8e0a8f-0037-401a-bdef-954826a647d4 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:37:59 user nova-compute[75337]: DEBUG nova.policy [None req-de8e0a8f-0037-401a-bdef-954826a647d4 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9e1c021de4da40518ddc45a57ef79d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed09a1def6f0477796404d9bd3357dd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75337) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 15:37:59 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-85a3dccf-6bd3-423b-963c-1b49593ba32d tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json" returned: 0 in 0.186s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:37:59 user nova-compute[75337]: DEBUG nova.virt.disk.api [None req-85a3dccf-6bd3-423b-963c-1b49593ba32d tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Checking if we can resize image /opt/stack/data/nova/instances/581cf468-65e7-42e5-9250-c3d645577011/disk. size=1073741824 {{(pid=75337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 15:37:59 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-85a3dccf-6bd3-423b-963c-1b49593ba32d tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/581cf468-65e7-42e5-9250-c3d645577011/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:37:59 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-de8e0a8f-0037-401a-bdef-954826a647d4 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json" returned: 0 in 0.166s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:37:59 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-de8e0a8f-0037-401a-bdef-954826a647d4 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Acquiring lock "06ba3c914798499e686c5ac75886932347225275" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:37:59 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-de8e0a8f-0037-401a-bdef-954826a647d4 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Lock "06ba3c914798499e686c5ac75886932347225275" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:37:59 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-de8e0a8f-0037-401a-bdef-954826a647d4 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:37:59 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-85a3dccf-6bd3-423b-963c-1b49593ba32d tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/581cf468-65e7-42e5-9250-c3d645577011/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:37:59 user nova-compute[75337]: DEBUG nova.virt.disk.api [None req-85a3dccf-6bd3-423b-963c-1b49593ba32d tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Cannot resize image /opt/stack/data/nova/instances/581cf468-65e7-42e5-9250-c3d645577011/disk to a smaller size. {{(pid=75337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 06 15:37:59 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-85a3dccf-6bd3-423b-963c-1b49593ba32d tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] [instance: 581cf468-65e7-42e5-9250-c3d645577011] Created local disks {{(pid=75337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 15:37:59 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-85a3dccf-6bd3-423b-963c-1b49593ba32d tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] [instance: 581cf468-65e7-42e5-9250-c3d645577011] Ensure instance console log exists: /opt/stack/data/nova/instances/581cf468-65e7-42e5-9250-c3d645577011/console.log {{(pid=75337) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 15:37:59 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-85a3dccf-6bd3-423b-963c-1b49593ba32d tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:37:59 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-85a3dccf-6bd3-423b-963c-1b49593ba32d tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:37:59 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-85a3dccf-6bd3-423b-963c-1b49593ba32d tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:38:00 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-de8e0a8f-0037-401a-bdef-954826a647d4 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json" returned: 0 in 0.190s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:38:00 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-de8e0a8f-0037-401a-bdef-954826a647d4 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275,backing_fmt=raw /opt/stack/data/nova/instances/8a600bd8-b94a-4242-a443-c2defb002280/disk 1073741824 {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:38:00 user nova-compute[75337]: DEBUG nova.network.neutron [None req-1fb51d76-ace3-4cae-bd21-10fb29d2c2fc tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] [instance: 5f5fc58d-f946-4df0-b8d0-1aefbf0f8cd6] Successfully created port: 9e5c665f-7b51-497e-b9b7-a0f652321a96 {{(pid=75337) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 15:38:00 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-de8e0a8f-0037-401a-bdef-954826a647d4 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275,backing_fmt=raw /opt/stack/data/nova/instances/8a600bd8-b94a-4242-a443-c2defb002280/disk 1073741824" returned: 0 in 0.048s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:38:00 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-de8e0a8f-0037-401a-bdef-954826a647d4 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Lock "06ba3c914798499e686c5ac75886932347225275" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:38:00 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-de8e0a8f-0037-401a-bdef-954826a647d4 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:38:00 user nova-compute[75337]: DEBUG nova.network.neutron [None req-8ec9b84c-44ef-4746-b7cb-3670a5acf87d tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] [instance: c8cf1ead-a87c-459c-b914-a0e976c9e464] Successfully created port: b33373f6-0289-4623-90ac-f5c3db0d3681 {{(pid=75337) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 15:38:00 user nova-compute[75337]: DEBUG nova.network.neutron [None req-75bba3f0-8587-4ed8-bd52-888d6ae89130 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: 83516ff5-c4e7-4e91-a2f9-8af9b51cf475] Successfully updated port: 452cb189-f59e-42e1-80e1-9eebb0c65bd7 {{(pid=75337) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 15:38:00 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-75bba3f0-8587-4ed8-bd52-888d6ae89130 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Acquiring lock "refresh_cache-83516ff5-c4e7-4e91-a2f9-8af9b51cf475" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 15:38:00 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-75bba3f0-8587-4ed8-bd52-888d6ae89130 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Acquired lock "refresh_cache-83516ff5-c4e7-4e91-a2f9-8af9b51cf475" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 15:38:00 user nova-compute[75337]: DEBUG nova.network.neutron [None req-75bba3f0-8587-4ed8-bd52-888d6ae89130 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: 83516ff5-c4e7-4e91-a2f9-8af9b51cf475] Building network info cache for instance {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 15:38:00 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-de8e0a8f-0037-401a-bdef-954826a647d4 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json" returned: 0 in 0.189s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:38:00 user nova-compute[75337]: DEBUG nova.virt.disk.api [None req-de8e0a8f-0037-401a-bdef-954826a647d4 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8a600bd8-b94a-4242-a443-c2defb002280/disk. size=1073741824 {{(pid=75337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 15:38:00 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-de8e0a8f-0037-401a-bdef-954826a647d4 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a600bd8-b94a-4242-a443-c2defb002280/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:38:00 user nova-compute[75337]: DEBUG nova.network.neutron [None req-75bba3f0-8587-4ed8-bd52-888d6ae89130 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: 83516ff5-c4e7-4e91-a2f9-8af9b51cf475] Instance cache missing network info. {{(pid=75337) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 15:38:00 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-de8e0a8f-0037-401a-bdef-954826a647d4 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a600bd8-b94a-4242-a443-c2defb002280/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:38:00 user nova-compute[75337]: DEBUG nova.virt.disk.api [None req-de8e0a8f-0037-401a-bdef-954826a647d4 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Cannot resize image /opt/stack/data/nova/instances/8a600bd8-b94a-4242-a443-c2defb002280/disk to a smaller size. {{(pid=75337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 06 15:38:00 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-de8e0a8f-0037-401a-bdef-954826a647d4 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] [instance: 8a600bd8-b94a-4242-a443-c2defb002280] Created local disks {{(pid=75337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 15:38:00 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-de8e0a8f-0037-401a-bdef-954826a647d4 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] [instance: 8a600bd8-b94a-4242-a443-c2defb002280] Ensure instance console log exists: /opt/stack/data/nova/instances/8a600bd8-b94a-4242-a443-c2defb002280/console.log {{(pid=75337) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 15:38:00 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-de8e0a8f-0037-401a-bdef-954826a647d4 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:38:00 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-de8e0a8f-0037-401a-bdef-954826a647d4 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:38:00 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-de8e0a8f-0037-401a-bdef-954826a647d4 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:38:00 user nova-compute[75337]: DEBUG nova.compute.manager [req-5254654e-a4f9-4a2b-a434-5eeb2c66bc14 req-2ff3befe-2857-4021-b661-3bc02bb2d1db service nova] [instance: 83516ff5-c4e7-4e91-a2f9-8af9b51cf475] Received event network-changed-452cb189-f59e-42e1-80e1-9eebb0c65bd7 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:38:00 user nova-compute[75337]: DEBUG nova.compute.manager [req-5254654e-a4f9-4a2b-a434-5eeb2c66bc14 req-2ff3befe-2857-4021-b661-3bc02bb2d1db service nova] [instance: 83516ff5-c4e7-4e91-a2f9-8af9b51cf475] Refreshing instance network info cache due to event network-changed-452cb189-f59e-42e1-80e1-9eebb0c65bd7. {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 15:38:00 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-5254654e-a4f9-4a2b-a434-5eeb2c66bc14 req-2ff3befe-2857-4021-b661-3bc02bb2d1db service nova] Acquiring lock "refresh_cache-83516ff5-c4e7-4e91-a2f9-8af9b51cf475" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 15:38:00 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-2c2d9eec-5e43-48a3-8c5c-46fb52f23c04 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Acquiring lock "dfadb21f-5ed1-42f4-956b-95cccf128b6a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:38:00 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-2c2d9eec-5e43-48a3-8c5c-46fb52f23c04 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Lock "dfadb21f-5ed1-42f4-956b-95cccf128b6a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:38:01 user nova-compute[75337]: DEBUG nova.network.neutron [None req-75bba3f0-8587-4ed8-bd52-888d6ae89130 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: 83516ff5-c4e7-4e91-a2f9-8af9b51cf475] Updating instance_info_cache with network_info: [{"id": "452cb189-f59e-42e1-80e1-9eebb0c65bd7", "address": "fa:16:3e:f6:56:c4", "network": {"id": "736be000-ee94-41fd-9de0-f2f885ec9be7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1715443852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb76b5b0f2b24f1c84a92403176bcc00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap452cb189-f5", "ovs_interfaceid": "452cb189-f59e-42e1-80e1-9eebb0c65bd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:38:01 user nova-compute[75337]: DEBUG nova.compute.manager [None req-2c2d9eec-5e43-48a3-8c5c-46fb52f23c04 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] [instance: dfadb21f-5ed1-42f4-956b-95cccf128b6a] Starting instance... {{(pid=75337) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 15:38:01 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-75bba3f0-8587-4ed8-bd52-888d6ae89130 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Releasing lock "refresh_cache-83516ff5-c4e7-4e91-a2f9-8af9b51cf475" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 15:38:01 user nova-compute[75337]: DEBUG nova.compute.manager [None req-75bba3f0-8587-4ed8-bd52-888d6ae89130 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: 83516ff5-c4e7-4e91-a2f9-8af9b51cf475] Instance network_info: |[{"id": "452cb189-f59e-42e1-80e1-9eebb0c65bd7", "address": "fa:16:3e:f6:56:c4", "network": {"id": "736be000-ee94-41fd-9de0-f2f885ec9be7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1715443852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb76b5b0f2b24f1c84a92403176bcc00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap452cb189-f5", "ovs_interfaceid": "452cb189-f59e-42e1-80e1-9eebb0c65bd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 15:38:01 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-5254654e-a4f9-4a2b-a434-5eeb2c66bc14 req-2ff3befe-2857-4021-b661-3bc02bb2d1db service nova] Acquired lock "refresh_cache-83516ff5-c4e7-4e91-a2f9-8af9b51cf475" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 15:38:01 user nova-compute[75337]: DEBUG nova.network.neutron [req-5254654e-a4f9-4a2b-a434-5eeb2c66bc14 req-2ff3befe-2857-4021-b661-3bc02bb2d1db service nova] [instance: 83516ff5-c4e7-4e91-a2f9-8af9b51cf475] Refreshing network info cache for port 452cb189-f59e-42e1-80e1-9eebb0c65bd7 {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 15:38:01 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-75bba3f0-8587-4ed8-bd52-888d6ae89130 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: 83516ff5-c4e7-4e91-a2f9-8af9b51cf475] Start _get_guest_xml network_info=[{"id": "452cb189-f59e-42e1-80e1-9eebb0c65bd7", "address": "fa:16:3e:f6:56:c4", "network": {"id": "736be000-ee94-41fd-9de0-f2f885ec9be7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1715443852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb76b5b0f2b24f1c84a92403176bcc00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap452cb189-f5", "ovs_interfaceid": "452cb189-f59e-42e1-80e1-9eebb0c65bd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T15:34:14Z,direct_url=<?>,disk_format='qcow2',id=16b903ae-a40f-41a7-985b-4804cce92c62,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6549a15819f1469bbd5eeae8190e3d44',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T15:34:15Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'guest_format': None, 'size': 0, 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '16b903ae-a40f-41a7-985b-4804cce92c62'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 15:38:01 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-75bba3f0-8587-4ed8-bd52-888d6ae89130 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 15:38:01 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-75bba3f0-8587-4ed8-bd52-888d6ae89130 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 15:38:01 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-75bba3f0-8587-4ed8-bd52-888d6ae89130 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 15:38:01 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-75bba3f0-8587-4ed8-bd52-888d6ae89130 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] CPU controller missing on host. {{(pid=75337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 15:38:01 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-75bba3f0-8587-4ed8-bd52-888d6ae89130 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 15:38:01 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-75bba3f0-8587-4ed8-bd52-888d6ae89130 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] CPU controller found on host. {{(pid=75337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 15:38:01 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-75bba3f0-8587-4ed8-bd52-888d6ae89130 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75337) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 15:38:01 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-75bba3f0-8587-4ed8-bd52-888d6ae89130 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T15:34:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T15:34:14Z,direct_url=<?>,disk_format='qcow2',id=16b903ae-a40f-41a7-985b-4804cce92c62,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6549a15819f1469bbd5eeae8190e3d44',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T15:34:15Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 15:38:01 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-75bba3f0-8587-4ed8-bd52-888d6ae89130 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Flavor limits 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 15:38:01 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-75bba3f0-8587-4ed8-bd52-888d6ae89130 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Image limits 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 15:38:01 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-75bba3f0-8587-4ed8-bd52-888d6ae89130 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Flavor pref 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 15:38:01 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-75bba3f0-8587-4ed8-bd52-888d6ae89130 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Image pref 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 15:38:01 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-75bba3f0-8587-4ed8-bd52-888d6ae89130 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 15:38:01 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-75bba3f0-8587-4ed8-bd52-888d6ae89130 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 15:38:01 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-75bba3f0-8587-4ed8-bd52-888d6ae89130 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 15:38:01 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-75bba3f0-8587-4ed8-bd52-888d6ae89130 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Got 1 possible topologies {{(pid=75337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 15:38:01 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-75bba3f0-8587-4ed8-bd52-888d6ae89130 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 15:38:01 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-75bba3f0-8587-4ed8-bd52-888d6ae89130 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 15:38:01 user nova-compute[75337]: DEBUG nova.privsep.utils [None req-75bba3f0-8587-4ed8-bd52-888d6ae89130 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75337) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 06 15:38:01 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-75bba3f0-8587-4ed8-bd52-888d6ae89130 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T15:37:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1396250350',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1396250350',id=1,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eb76b5b0f2b24f1c84a92403176bcc00',ramdisk_id='',reservation_id='r-of23go0w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2044295020',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T15:37:55Z,user_data=None,user_id='74090d6e5b354d79bf6ded92e6de56aa',uuid=83516ff5-c4e7-4e91-a2f9-8af9b51cf475,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "452cb189-f59e-42e1-80e1-9eebb0c65bd7", "address": "fa:16:3e:f6:56:c4", "network": {"id": "736be000-ee94-41fd-9de0-f2f885ec9be7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1715443852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb76b5b0f2b24f1c84a92403176bcc00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap452cb189-f5", "ovs_interfaceid": "452cb189-f59e-42e1-80e1-9eebb0c65bd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75337) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 15:38:01 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-75bba3f0-8587-4ed8-bd52-888d6ae89130 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Converting VIF {"id": "452cb189-f59e-42e1-80e1-9eebb0c65bd7", "address": "fa:16:3e:f6:56:c4", "network": {"id": "736be000-ee94-41fd-9de0-f2f885ec9be7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1715443852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb76b5b0f2b24f1c84a92403176bcc00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap452cb189-f5", "ovs_interfaceid": "452cb189-f59e-42e1-80e1-9eebb0c65bd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 15:38:01 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-75bba3f0-8587-4ed8-bd52-888d6ae89130 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:56:c4,bridge_name='br-int',has_traffic_filtering=True,id=452cb189-f59e-42e1-80e1-9eebb0c65bd7,network=Network(736be000-ee94-41fd-9de0-f2f885ec9be7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap452cb189-f5') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 15:38:01 user nova-compute[75337]: DEBUG nova.objects.instance [None req-75bba3f0-8587-4ed8-bd52-888d6ae89130 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Lazy-loading 'pci_devices' on Instance uuid 83516ff5-c4e7-4e91-a2f9-8af9b51cf475 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 15:38:01 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-75bba3f0-8587-4ed8-bd52-888d6ae89130 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: 83516ff5-c4e7-4e91-a2f9-8af9b51cf475] End _get_guest_xml xml=<domain type="kvm">
Nov 06 15:38:01 user nova-compute[75337]:   <uuid>83516ff5-c4e7-4e91-a2f9-8af9b51cf475</uuid>
Nov 06 15:38:01 user nova-compute[75337]:   <name>instance-00000001</name>
Nov 06 15:38:01 user nova-compute[75337]:   <memory>524288</memory>
Nov 06 15:38:01 user nova-compute[75337]:   <vcpu>1</vcpu>
Nov 06 15:38:01 user nova-compute[75337]:   <metadata>
Nov 06 15:38:01 user nova-compute[75337]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 15:38:01 user nova-compute[75337]:       <nova:package version="0.0.0"/>
Nov 06 15:38:01 user nova-compute[75337]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1396250350</nova:name>
Nov 06 15:38:01 user nova-compute[75337]:       <nova:creationTime>2023-11-06 15:38:01</nova:creationTime>
Nov 06 15:38:01 user nova-compute[75337]:       <nova:flavor name="m1.tiny">
Nov 06 15:38:01 user nova-compute[75337]:         <nova:memory>512</nova:memory>
Nov 06 15:38:01 user nova-compute[75337]:         <nova:disk>1</nova:disk>
Nov 06 15:38:01 user nova-compute[75337]:         <nova:swap>0</nova:swap>
Nov 06 15:38:01 user nova-compute[75337]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 15:38:01 user nova-compute[75337]:         <nova:vcpus>1</nova:vcpus>
Nov 06 15:38:01 user nova-compute[75337]:       </nova:flavor>
Nov 06 15:38:01 user nova-compute[75337]:       <nova:owner>
Nov 06 15:38:01 user nova-compute[75337]:         <nova:user uuid="74090d6e5b354d79bf6ded92e6de56aa">tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member</nova:user>
Nov 06 15:38:01 user nova-compute[75337]:         <nova:project uuid="eb76b5b0f2b24f1c84a92403176bcc00">tempest-ServerBootFromVolumeStableRescueTest-2044295020</nova:project>
Nov 06 15:38:01 user nova-compute[75337]:       </nova:owner>
Nov 06 15:38:01 user nova-compute[75337]:       <nova:root type="image" uuid="16b903ae-a40f-41a7-985b-4804cce92c62"/>
Nov 06 15:38:01 user nova-compute[75337]:       <nova:ports>
Nov 06 15:38:01 user nova-compute[75337]:         <nova:port uuid="452cb189-f59e-42e1-80e1-9eebb0c65bd7">
Nov 06 15:38:01 user nova-compute[75337]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 06 15:38:01 user nova-compute[75337]:         </nova:port>
Nov 06 15:38:01 user nova-compute[75337]:       </nova:ports>
Nov 06 15:38:01 user nova-compute[75337]:     </nova:instance>
Nov 06 15:38:01 user nova-compute[75337]:   </metadata>
Nov 06 15:38:01 user nova-compute[75337]:   <sysinfo type="smbios">
Nov 06 15:38:01 user nova-compute[75337]:     <system>
Nov 06 15:38:01 user nova-compute[75337]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 15:38:01 user nova-compute[75337]:       <entry name="product">OpenStack Nova</entry>
Nov 06 15:38:01 user nova-compute[75337]:       <entry name="version">0.0.0</entry>
Nov 06 15:38:01 user nova-compute[75337]:       <entry name="serial">83516ff5-c4e7-4e91-a2f9-8af9b51cf475</entry>
Nov 06 15:38:01 user nova-compute[75337]:       <entry name="uuid">83516ff5-c4e7-4e91-a2f9-8af9b51cf475</entry>
Nov 06 15:38:01 user nova-compute[75337]:       <entry name="family">Virtual Machine</entry>
Nov 06 15:38:01 user nova-compute[75337]:     </system>
Nov 06 15:38:01 user nova-compute[75337]:   </sysinfo>
Nov 06 15:38:01 user nova-compute[75337]:   <os>
Nov 06 15:38:01 user nova-compute[75337]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 15:38:01 user nova-compute[75337]:     <boot dev="hd"/>
Nov 06 15:38:01 user nova-compute[75337]:     <smbios mode="sysinfo"/>
Nov 06 15:38:01 user nova-compute[75337]:   </os>
Nov 06 15:38:01 user nova-compute[75337]:   <features>
Nov 06 15:38:01 user nova-compute[75337]:     <acpi/>
Nov 06 15:38:01 user nova-compute[75337]:     <apic/>
Nov 06 15:38:01 user nova-compute[75337]:     <vmcoreinfo/>
Nov 06 15:38:01 user nova-compute[75337]:   </features>
Nov 06 15:38:01 user nova-compute[75337]:   <clock offset="utc">
Nov 06 15:38:01 user nova-compute[75337]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 15:38:01 user nova-compute[75337]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 15:38:01 user nova-compute[75337]:     <timer name="hpet" present="no"/>
Nov 06 15:38:01 user nova-compute[75337]:   </clock>
Nov 06 15:38:01 user nova-compute[75337]:   <cpu mode="custom" match="exact">
Nov 06 15:38:01 user nova-compute[75337]:     <model>Nehalem</model>
Nov 06 15:38:01 user nova-compute[75337]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 15:38:01 user nova-compute[75337]:   </cpu>
Nov 06 15:38:01 user nova-compute[75337]:   <devices>
Nov 06 15:38:01 user nova-compute[75337]:     <disk type="file" device="disk">
Nov 06 15:38:01 user nova-compute[75337]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 15:38:01 user nova-compute[75337]:       <source file="/opt/stack/data/nova/instances/83516ff5-c4e7-4e91-a2f9-8af9b51cf475/disk"/>
Nov 06 15:38:01 user nova-compute[75337]:       <target dev="vda" bus="virtio"/>
Nov 06 15:38:01 user nova-compute[75337]:     </disk>
Nov 06 15:38:01 user nova-compute[75337]:     <interface type="ethernet">
Nov 06 15:38:01 user nova-compute[75337]:       <mac address="fa:16:3e:f6:56:c4"/>
Nov 06 15:38:01 user nova-compute[75337]:       <model type="virtio"/>
Nov 06 15:38:01 user nova-compute[75337]:       <mtu size="1442"/>
Nov 06 15:38:01 user nova-compute[75337]:       <target dev="tap452cb189-f5"/>
Nov 06 15:38:01 user nova-compute[75337]:     </interface>
Nov 06 15:38:01 user nova-compute[75337]:     <serial type="pty">
Nov 06 15:38:01 user nova-compute[75337]:       <log file="/opt/stack/data/nova/instances/83516ff5-c4e7-4e91-a2f9-8af9b51cf475/console.log" append="off"/>
Nov 06 15:38:01 user nova-compute[75337]:     </serial>
Nov 06 15:38:01 user nova-compute[75337]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 15:38:01 user nova-compute[75337]:     <video>
Nov 06 15:38:01 user nova-compute[75337]:       <model type="virtio"/>
Nov 06 15:38:01 user nova-compute[75337]:     </video>
Nov 06 15:38:01 user nova-compute[75337]:     <rng model="virtio">
Nov 06 15:38:01 user nova-compute[75337]:       <backend model="random">/dev/urandom</backend>
Nov 06 15:38:01 user nova-compute[75337]:     </rng>
Nov 06 15:38:01 user nova-compute[75337]:     <controller type="usb" index="0" model="none"/>
Nov 06 15:38:01 user nova-compute[75337]:     <memballoon model="virtio">
Nov 06 15:38:01 user nova-compute[75337]:       <stats period="10"/>
Nov 06 15:38:01 user nova-compute[75337]:     </memballoon>
Nov 06 15:38:01 user nova-compute[75337]:   </devices>
Nov 06 15:38:01 user nova-compute[75337]: </domain>
Nov 06 15:38:01 user nova-compute[75337]:  {{(pid=75337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 15:38:01 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-75bba3f0-8587-4ed8-bd52-888d6ae89130 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T15:37:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1396250350',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1396250350',id=1,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eb76b5b0f2b24f1c84a92403176bcc00',ramdisk_id='',reservation_id='r-of23go0w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2044295020',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T15:37:55Z,user_data=None,user_id='74090d6e5b354d79bf6ded92e6de56aa',uuid=83516ff5-c4e7-4e91-a2f9-8af9b51cf475,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "452cb189-f59e-42e1-80e1-9eebb0c65bd7", "address": "fa:16:3e:f6:56:c4", "network": {"id": "736be000-ee94-41fd-9de0-f2f885ec9be7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1715443852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb76b5b0f2b24f1c84a92403176bcc00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap452cb189-f5", "ovs_interfaceid": "452cb189-f59e-42e1-80e1-9eebb0c65bd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 15:38:01 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-75bba3f0-8587-4ed8-bd52-888d6ae89130 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Converting VIF {"id": "452cb189-f59e-42e1-80e1-9eebb0c65bd7", "address": "fa:16:3e:f6:56:c4", "network": {"id": "736be000-ee94-41fd-9de0-f2f885ec9be7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1715443852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb76b5b0f2b24f1c84a92403176bcc00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap452cb189-f5", "ovs_interfaceid": "452cb189-f59e-42e1-80e1-9eebb0c65bd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 15:38:01 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-75bba3f0-8587-4ed8-bd52-888d6ae89130 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:56:c4,bridge_name='br-int',has_traffic_filtering=True,id=452cb189-f59e-42e1-80e1-9eebb0c65bd7,network=Network(736be000-ee94-41fd-9de0-f2f885ec9be7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap452cb189-f5') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 15:38:01 user nova-compute[75337]: DEBUG os_vif [None req-75bba3f0-8587-4ed8-bd52-888d6ae89130 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:56:c4,bridge_name='br-int',has_traffic_filtering=True,id=452cb189-f59e-42e1-80e1-9eebb0c65bd7,network=Network(736be000-ee94-41fd-9de0-f2f885ec9be7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap452cb189-f5') {{(pid=75337) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 15:38:01 user nova-compute[75337]: DEBUG nova.network.neutron [None req-85a3dccf-6bd3-423b-963c-1b49593ba32d tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] [instance: 581cf468-65e7-42e5-9250-c3d645577011] Successfully created port: d1c68bac-be37-4645-afcb-2b89f47c1793 {{(pid=75337) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 15:38:01 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-2c2d9eec-5e43-48a3-8c5c-46fb52f23c04 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:38:01 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-2c2d9eec-5e43-48a3-8c5c-46fb52f23c04 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:38:01 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl [None req-75bba3f0-8587-4ed8-bd52-888d6ae89130 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Created schema index Interface.name {{(pid=75337) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 06 15:38:01 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl [None req-75bba3f0-8587-4ed8-bd52-888d6ae89130 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Created schema index Port.name {{(pid=75337) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 06 15:38:01 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl [None req-75bba3f0-8587-4ed8-bd52-888d6ae89130 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Created schema index Bridge.name {{(pid=75337) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 06 15:38:01 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-75bba3f0-8587-4ed8-bd52-888d6ae89130 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=75337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 15:38:01 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-75bba3f0-8587-4ed8-bd52-888d6ae89130 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [POLLOUT] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:38:01 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-75bba3f0-8587-4ed8-bd52-888d6ae89130 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 15:38:01 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-75bba3f0-8587-4ed8-bd52-888d6ae89130 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:38:01 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-75bba3f0-8587-4ed8-bd52-888d6ae89130 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:38:01 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-2c2d9eec-5e43-48a3-8c5c-46fb52f23c04 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75337) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 15:38:01 user nova-compute[75337]: INFO nova.compute.claims [None req-2c2d9eec-5e43-48a3-8c5c-46fb52f23c04 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] [instance: dfadb21f-5ed1-42f4-956b-95cccf128b6a] Claim successful on node user
Nov 06 15:38:01 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-75bba3f0-8587-4ed8-bd52-888d6ae89130 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:38:01 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:38:01 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:38:01 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 15:38:01 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:38:01 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd46befae-287a-52aa-a898-c57eacb9f2e8', '_type': 'linux-noop'}}, row=False) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:38:01 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:38:01 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:38:01 user nova-compute[75337]: INFO oslo.privsep.daemon [None req-75bba3f0-8587-4ed8-bd52-888d6ae89130 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmppd_z60xv/privsep.sock']
Nov 06 15:38:01 user sudo[84674]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmppd_z60xv/privsep.sock
Nov 06 15:38:01 user sudo[84674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 06 15:38:01 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-2c2d9eec-5e43-48a3-8c5c-46fb52f23c04 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 15:38:01 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-2c2d9eec-5e43-48a3-8c5c-46fb52f23c04 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 15:38:01 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-2c2d9eec-5e43-48a3-8c5c-46fb52f23c04 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.619s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:38:01 user nova-compute[75337]: DEBUG nova.compute.manager [None req-2c2d9eec-5e43-48a3-8c5c-46fb52f23c04 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] [instance: dfadb21f-5ed1-42f4-956b-95cccf128b6a] Start building networks asynchronously for instance. {{(pid=75337) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 15:38:01 user nova-compute[75337]: DEBUG nova.network.neutron [None req-de8e0a8f-0037-401a-bdef-954826a647d4 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] [instance: 8a600bd8-b94a-4242-a443-c2defb002280] Successfully created port: 01aa7168-78cd-44e6-8496-08d468f62cfe {{(pid=75337) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 15:38:01 user nova-compute[75337]: DEBUG nova.compute.manager [None req-2c2d9eec-5e43-48a3-8c5c-46fb52f23c04 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] [instance: dfadb21f-5ed1-42f4-956b-95cccf128b6a] Allocating IP information in the background. {{(pid=75337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 15:38:01 user nova-compute[75337]: DEBUG nova.network.neutron [None req-2c2d9eec-5e43-48a3-8c5c-46fb52f23c04 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] [instance: dfadb21f-5ed1-42f4-956b-95cccf128b6a] allocate_for_instance() {{(pid=75337) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 15:38:01 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-2c2d9eec-5e43-48a3-8c5c-46fb52f23c04 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] [instance: dfadb21f-5ed1-42f4-956b-95cccf128b6a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 15:38:02 user nova-compute[75337]: DEBUG nova.compute.manager [None req-2c2d9eec-5e43-48a3-8c5c-46fb52f23c04 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] [instance: dfadb21f-5ed1-42f4-956b-95cccf128b6a] Start building block device mappings for instance. {{(pid=75337) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 15:38:02 user nova-compute[75337]: DEBUG nova.policy [None req-2c2d9eec-5e43-48a3-8c5c-46fb52f23c04 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'aeeea58fcd3e4217a34a4a38be6adf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1013e7afbefd4146a3be04587710b1de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75337) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 15:38:02 user nova-compute[75337]: DEBUG nova.compute.manager [None req-2c2d9eec-5e43-48a3-8c5c-46fb52f23c04 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] [instance: dfadb21f-5ed1-42f4-956b-95cccf128b6a] Start spawning the instance on the hypervisor. {{(pid=75337) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 15:38:02 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-2c2d9eec-5e43-48a3-8c5c-46fb52f23c04 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] [instance: dfadb21f-5ed1-42f4-956b-95cccf128b6a] Creating instance directory {{(pid=75337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 15:38:02 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-2c2d9eec-5e43-48a3-8c5c-46fb52f23c04 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] [instance: dfadb21f-5ed1-42f4-956b-95cccf128b6a] Creating image(s)
Nov 06 15:38:02 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-2c2d9eec-5e43-48a3-8c5c-46fb52f23c04 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Acquiring lock "/opt/stack/data/nova/instances/dfadb21f-5ed1-42f4-956b-95cccf128b6a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:38:02 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-2c2d9eec-5e43-48a3-8c5c-46fb52f23c04 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Lock "/opt/stack/data/nova/instances/dfadb21f-5ed1-42f4-956b-95cccf128b6a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:38:02 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-2c2d9eec-5e43-48a3-8c5c-46fb52f23c04 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Lock "/opt/stack/data/nova/instances/dfadb21f-5ed1-42f4-956b-95cccf128b6a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:38:02 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-2c2d9eec-5e43-48a3-8c5c-46fb52f23c04 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:38:02 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-2c2d9eec-5e43-48a3-8c5c-46fb52f23c04 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json" returned: 0 in 0.192s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:38:02 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-2c2d9eec-5e43-48a3-8c5c-46fb52f23c04 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Acquiring lock "06ba3c914798499e686c5ac75886932347225275" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:38:02 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-2c2d9eec-5e43-48a3-8c5c-46fb52f23c04 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Lock "06ba3c914798499e686c5ac75886932347225275" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:38:02 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-2c2d9eec-5e43-48a3-8c5c-46fb52f23c04 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:38:02 user nova-compute[75337]: DEBUG nova.network.neutron [None req-1fb51d76-ace3-4cae-bd21-10fb29d2c2fc tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] [instance: 5f5fc58d-f946-4df0-b8d0-1aefbf0f8cd6] Successfully updated port: 9e5c665f-7b51-497e-b9b7-a0f652321a96 {{(pid=75337) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 15:38:02 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-1fb51d76-ace3-4cae-bd21-10fb29d2c2fc tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] Acquiring lock "refresh_cache-5f5fc58d-f946-4df0-b8d0-1aefbf0f8cd6" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 15:38:02 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-1fb51d76-ace3-4cae-bd21-10fb29d2c2fc tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] Acquired lock "refresh_cache-5f5fc58d-f946-4df0-b8d0-1aefbf0f8cd6" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 15:38:02 user nova-compute[75337]: DEBUG nova.network.neutron [None req-1fb51d76-ace3-4cae-bd21-10fb29d2c2fc tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] [instance: 5f5fc58d-f946-4df0-b8d0-1aefbf0f8cd6] Building network info cache for instance {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 15:38:02 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-2c2d9eec-5e43-48a3-8c5c-46fb52f23c04 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json" returned: 0 in 0.181s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:38:02 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-2c2d9eec-5e43-48a3-8c5c-46fb52f23c04 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275,backing_fmt=raw /opt/stack/data/nova/instances/dfadb21f-5ed1-42f4-956b-95cccf128b6a/disk 1073741824 {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:38:02 user nova-compute[75337]: DEBUG nova.network.neutron [None req-1fb51d76-ace3-4cae-bd21-10fb29d2c2fc tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] [instance: 5f5fc58d-f946-4df0-b8d0-1aefbf0f8cd6] Instance cache missing network info. {{(pid=75337) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 15:38:02 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-2c2d9eec-5e43-48a3-8c5c-46fb52f23c04 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275,backing_fmt=raw /opt/stack/data/nova/instances/dfadb21f-5ed1-42f4-956b-95cccf128b6a/disk 1073741824" returned: 0 in 0.051s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:38:02 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-2c2d9eec-5e43-48a3-8c5c-46fb52f23c04 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Lock "06ba3c914798499e686c5ac75886932347225275" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:38:02 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-2c2d9eec-5e43-48a3-8c5c-46fb52f23c04 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:38:02 user nova-compute[75337]: DEBUG nova.compute.manager [req-7714edd2-e498-42a9-9883-1b8c6a65095d req-8c4c89fa-383e-4e7b-9721-474a3ef78372 service nova] [instance: 5f5fc58d-f946-4df0-b8d0-1aefbf0f8cd6] Received event network-changed-9e5c665f-7b51-497e-b9b7-a0f652321a96 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:38:02 user nova-compute[75337]: DEBUG nova.compute.manager [req-7714edd2-e498-42a9-9883-1b8c6a65095d req-8c4c89fa-383e-4e7b-9721-474a3ef78372 service nova] [instance: 5f5fc58d-f946-4df0-b8d0-1aefbf0f8cd6] Refreshing instance network info cache due to event network-changed-9e5c665f-7b51-497e-b9b7-a0f652321a96. {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 15:38:02 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-7714edd2-e498-42a9-9883-1b8c6a65095d req-8c4c89fa-383e-4e7b-9721-474a3ef78372 service nova] Acquiring lock "refresh_cache-5f5fc58d-f946-4df0-b8d0-1aefbf0f8cd6" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 15:38:02 user nova-compute[75337]: DEBUG nova.network.neutron [None req-8ec9b84c-44ef-4746-b7cb-3670a5acf87d tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] [instance: c8cf1ead-a87c-459c-b914-a0e976c9e464] Successfully updated port: b33373f6-0289-4623-90ac-f5c3db0d3681 {{(pid=75337) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 15:38:02 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-8ec9b84c-44ef-4746-b7cb-3670a5acf87d tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Acquiring lock "refresh_cache-c8cf1ead-a87c-459c-b914-a0e976c9e464" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 15:38:02 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-8ec9b84c-44ef-4746-b7cb-3670a5acf87d tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Acquired lock "refresh_cache-c8cf1ead-a87c-459c-b914-a0e976c9e464" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 15:38:02 user nova-compute[75337]: DEBUG nova.network.neutron [None req-8ec9b84c-44ef-4746-b7cb-3670a5acf87d tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] [instance: c8cf1ead-a87c-459c-b914-a0e976c9e464] Building network info cache for instance {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 15:38:02 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-2c2d9eec-5e43-48a3-8c5c-46fb52f23c04 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json" returned: 0 in 0.162s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:38:02 user nova-compute[75337]: DEBUG nova.virt.disk.api [None req-2c2d9eec-5e43-48a3-8c5c-46fb52f23c04 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Checking if we can resize image /opt/stack/data/nova/instances/dfadb21f-5ed1-42f4-956b-95cccf128b6a/disk. size=1073741824 {{(pid=75337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 15:38:02 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-2c2d9eec-5e43-48a3-8c5c-46fb52f23c04 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfadb21f-5ed1-42f4-956b-95cccf128b6a/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:38:02 user nova-compute[75337]: DEBUG nova.network.neutron [req-5254654e-a4f9-4a2b-a434-5eeb2c66bc14 req-2ff3befe-2857-4021-b661-3bc02bb2d1db service nova] [instance: 83516ff5-c4e7-4e91-a2f9-8af9b51cf475] Updated VIF entry in instance network info cache for port 452cb189-f59e-42e1-80e1-9eebb0c65bd7. {{(pid=75337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 15:38:02 user nova-compute[75337]: DEBUG nova.network.neutron [req-5254654e-a4f9-4a2b-a434-5eeb2c66bc14 req-2ff3befe-2857-4021-b661-3bc02bb2d1db service nova] [instance: 83516ff5-c4e7-4e91-a2f9-8af9b51cf475] Updating instance_info_cache with network_info: [{"id": "452cb189-f59e-42e1-80e1-9eebb0c65bd7", "address": "fa:16:3e:f6:56:c4", "network": {"id": "736be000-ee94-41fd-9de0-f2f885ec9be7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1715443852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb76b5b0f2b24f1c84a92403176bcc00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap452cb189-f5", "ovs_interfaceid": "452cb189-f59e-42e1-80e1-9eebb0c65bd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:38:02 user nova-compute[75337]: DEBUG nova.compute.manager [req-96aab58a-2395-49b6-b3e9-1f32c9c7aa64 req-e298c69d-39e2-46ad-ad6c-4a44470780b9 service nova] [instance: c8cf1ead-a87c-459c-b914-a0e976c9e464] Received event network-changed-b33373f6-0289-4623-90ac-f5c3db0d3681 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:38:02 user nova-compute[75337]: DEBUG nova.compute.manager [req-96aab58a-2395-49b6-b3e9-1f32c9c7aa64 req-e298c69d-39e2-46ad-ad6c-4a44470780b9 service nova] [instance: c8cf1ead-a87c-459c-b914-a0e976c9e464] Refreshing instance network info cache due to event network-changed-b33373f6-0289-4623-90ac-f5c3db0d3681. {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 15:38:02 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-96aab58a-2395-49b6-b3e9-1f32c9c7aa64 req-e298c69d-39e2-46ad-ad6c-4a44470780b9 service nova] Acquiring lock "refresh_cache-c8cf1ead-a87c-459c-b914-a0e976c9e464" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 15:38:02 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-5254654e-a4f9-4a2b-a434-5eeb2c66bc14 req-2ff3befe-2857-4021-b661-3bc02bb2d1db service nova] Releasing lock "refresh_cache-83516ff5-c4e7-4e91-a2f9-8af9b51cf475" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 15:38:02 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-2c2d9eec-5e43-48a3-8c5c-46fb52f23c04 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfadb21f-5ed1-42f4-956b-95cccf128b6a/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:38:02 user nova-compute[75337]: DEBUG nova.virt.disk.api [None req-2c2d9eec-5e43-48a3-8c5c-46fb52f23c04 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Cannot resize image /opt/stack/data/nova/instances/dfadb21f-5ed1-42f4-956b-95cccf128b6a/disk to a smaller size. {{(pid=75337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 06 15:38:02 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-2c2d9eec-5e43-48a3-8c5c-46fb52f23c04 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] [instance: dfadb21f-5ed1-42f4-956b-95cccf128b6a] Created local disks {{(pid=75337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 15:38:02 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-2c2d9eec-5e43-48a3-8c5c-46fb52f23c04 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] [instance: dfadb21f-5ed1-42f4-956b-95cccf128b6a] Ensure instance console log exists: /opt/stack/data/nova/instances/dfadb21f-5ed1-42f4-956b-95cccf128b6a/console.log {{(pid=75337) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 15:38:02 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-2c2d9eec-5e43-48a3-8c5c-46fb52f23c04 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:38:02 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-2c2d9eec-5e43-48a3-8c5c-46fb52f23c04 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:38:02 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-2c2d9eec-5e43-48a3-8c5c-46fb52f23c04 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:38:02 user nova-compute[75337]: DEBUG nova.network.neutron [None req-8ec9b84c-44ef-4746-b7cb-3670a5acf87d tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] [instance: c8cf1ead-a87c-459c-b914-a0e976c9e464] Instance cache missing network info. {{(pid=75337) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 15:38:02 user sudo[84674]: pam_unix(sudo:session): session closed for user root
Nov 06 15:38:02 user nova-compute[75337]: INFO oslo.privsep.daemon [None req-75bba3f0-8587-4ed8-bd52-888d6ae89130 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Spawned new privsep daemon via rootwrap
Nov 06 15:38:02 user nova-compute[75337]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 06 15:38:02 user nova-compute[75337]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 06 15:38:02 user nova-compute[75337]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Nov 06 15:38:02 user nova-compute[75337]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84687
Nov 06 15:38:02 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:38:03 user nova-compute[75337]: DEBUG nova.network.neutron [None req-1fb51d76-ace3-4cae-bd21-10fb29d2c2fc tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] [instance: 5f5fc58d-f946-4df0-b8d0-1aefbf0f8cd6] Updating instance_info_cache with network_info: [{"id": "9e5c665f-7b51-497e-b9b7-a0f652321a96", "address": "fa:16:3e:f7:8a:4e", "network": {"id": "fa9a4651-99aa-40d8-9010-136c5b9f4c02", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-501845579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b38d5a3287447a580dbd965f44e042c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e5c665f-7b", "ovs_interfaceid": "9e5c665f-7b51-497e-b9b7-a0f652321a96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:38:03 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-1fb51d76-ace3-4cae-bd21-10fb29d2c2fc tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] Releasing lock "refresh_cache-5f5fc58d-f946-4df0-b8d0-1aefbf0f8cd6" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 15:38:03 user nova-compute[75337]: DEBUG nova.compute.manager [None req-1fb51d76-ace3-4cae-bd21-10fb29d2c2fc tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] [instance: 5f5fc58d-f946-4df0-b8d0-1aefbf0f8cd6] Instance network_info: |[{"id": "9e5c665f-7b51-497e-b9b7-a0f652321a96", "address": "fa:16:3e:f7:8a:4e", "network": {"id": "fa9a4651-99aa-40d8-9010-136c5b9f4c02", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-501845579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b38d5a3287447a580dbd965f44e042c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e5c665f-7b", "ovs_interfaceid": "9e5c665f-7b51-497e-b9b7-a0f652321a96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 15:38:03 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-7714edd2-e498-42a9-9883-1b8c6a65095d req-8c4c89fa-383e-4e7b-9721-474a3ef78372 service nova] Acquired lock "refresh_cache-5f5fc58d-f946-4df0-b8d0-1aefbf0f8cd6" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 15:38:03 user nova-compute[75337]: DEBUG nova.network.neutron [req-7714edd2-e498-42a9-9883-1b8c6a65095d req-8c4c89fa-383e-4e7b-9721-474a3ef78372 service nova] [instance: 5f5fc58d-f946-4df0-b8d0-1aefbf0f8cd6] Refreshing network info cache for port 9e5c665f-7b51-497e-b9b7-a0f652321a96 {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 15:38:03 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-1fb51d76-ace3-4cae-bd21-10fb29d2c2fc tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] [instance: 5f5fc58d-f946-4df0-b8d0-1aefbf0f8cd6] Start _get_guest_xml network_info=[{"id": "9e5c665f-7b51-497e-b9b7-a0f652321a96", "address": "fa:16:3e:f7:8a:4e", "network": {"id": "fa9a4651-99aa-40d8-9010-136c5b9f4c02", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-501845579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b38d5a3287447a580dbd965f44e042c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e5c665f-7b", "ovs_interfaceid": "9e5c665f-7b51-497e-b9b7-a0f652321a96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T15:34:14Z,direct_url=<?>,disk_format='qcow2',id=16b903ae-a40f-41a7-985b-4804cce92c62,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6549a15819f1469bbd5eeae8190e3d44',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T15:34:15Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'guest_format': None, 'size': 0, 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '16b903ae-a40f-41a7-985b-4804cce92c62'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 15:38:03 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-1fb51d76-ace3-4cae-bd21-10fb29d2c2fc tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 15:38:03 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-1fb51d76-ace3-4cae-bd21-10fb29d2c2fc tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 15:38:03 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-1fb51d76-ace3-4cae-bd21-10fb29d2c2fc tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 15:38:03 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-1fb51d76-ace3-4cae-bd21-10fb29d2c2fc tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] CPU controller missing on host. {{(pid=75337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 15:38:03 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-1fb51d76-ace3-4cae-bd21-10fb29d2c2fc tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 15:38:03 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-1fb51d76-ace3-4cae-bd21-10fb29d2c2fc tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] CPU controller found on host. {{(pid=75337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 15:38:03 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-1fb51d76-ace3-4cae-bd21-10fb29d2c2fc tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75337) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 15:38:03 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-1fb51d76-ace3-4cae-bd21-10fb29d2c2fc tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T15:34:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T15:34:14Z,direct_url=<?>,disk_format='qcow2',id=16b903ae-a40f-41a7-985b-4804cce92c62,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6549a15819f1469bbd5eeae8190e3d44',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T15:34:15Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 15:38:03 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-1fb51d76-ace3-4cae-bd21-10fb29d2c2fc tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] Flavor limits 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 15:38:03 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-1fb51d76-ace3-4cae-bd21-10fb29d2c2fc tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] Image limits 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 15:38:03 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-1fb51d76-ace3-4cae-bd21-10fb29d2c2fc tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] Flavor pref 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 15:38:03 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-1fb51d76-ace3-4cae-bd21-10fb29d2c2fc tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] Image pref 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 15:38:03 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-1fb51d76-ace3-4cae-bd21-10fb29d2c2fc tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 15:38:03 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-1fb51d76-ace3-4cae-bd21-10fb29d2c2fc tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 15:38:03 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-1fb51d76-ace3-4cae-bd21-10fb29d2c2fc tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 15:38:03 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-1fb51d76-ace3-4cae-bd21-10fb29d2c2fc tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] Got 1 possible topologies {{(pid=75337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 15:38:03 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-1fb51d76-ace3-4cae-bd21-10fb29d2c2fc tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 15:38:03 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-1fb51d76-ace3-4cae-bd21-10fb29d2c2fc tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 15:38:03 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-1fb51d76-ace3-4cae-bd21-10fb29d2c2fc tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T15:37:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1150753702',display_name='tempest-DeleteServersTestJSON-server-1150753702',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1150753702',id=2,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0b38d5a3287447a580dbd965f44e042c',ramdisk_id='',reservation_id='r-kfcfq5qs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-706109674',owner_user_name='tempest-DeleteServersTestJSON-706109674-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T15:37:58Z,user_data=None,user_id='92b6d879877241fa9372d76e52d41c6b',uuid=5f5fc58d-f946-4df0-b8d0-1aefbf0f8cd6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9e5c665f-7b51-497e-b9b7-a0f652321a96", "address": "fa:16:3e:f7:8a:4e", "network": {"id": "fa9a4651-99aa-40d8-9010-136c5b9f4c02", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-501845579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b38d5a3287447a580dbd965f44e042c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e5c665f-7b", "ovs_interfaceid": "9e5c665f-7b51-497e-b9b7-a0f652321a96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75337) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 15:38:03 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-1fb51d76-ace3-4cae-bd21-10fb29d2c2fc tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] Converting VIF {"id": "9e5c665f-7b51-497e-b9b7-a0f652321a96", "address": "fa:16:3e:f7:8a:4e", "network": {"id": "fa9a4651-99aa-40d8-9010-136c5b9f4c02", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-501845579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b38d5a3287447a580dbd965f44e042c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e5c665f-7b", "ovs_interfaceid": "9e5c665f-7b51-497e-b9b7-a0f652321a96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 15:38:03 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-1fb51d76-ace3-4cae-bd21-10fb29d2c2fc tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:8a:4e,bridge_name='br-int',has_traffic_filtering=True,id=9e5c665f-7b51-497e-b9b7-a0f652321a96,network=Network(fa9a4651-99aa-40d8-9010-136c5b9f4c02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e5c665f-7b') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 15:38:03 user nova-compute[75337]: DEBUG nova.objects.instance [None req-1fb51d76-ace3-4cae-bd21-10fb29d2c2fc tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] Lazy-loading 'pci_devices' on Instance uuid 5f5fc58d-f946-4df0-b8d0-1aefbf0f8cd6 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 15:38:03 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-1fb51d76-ace3-4cae-bd21-10fb29d2c2fc tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] [instance: 5f5fc58d-f946-4df0-b8d0-1aefbf0f8cd6] End _get_guest_xml xml=<domain type="kvm">
Nov 06 15:38:03 user nova-compute[75337]:   <uuid>5f5fc58d-f946-4df0-b8d0-1aefbf0f8cd6</uuid>
Nov 06 15:38:03 user nova-compute[75337]:   <name>instance-00000002</name>
Nov 06 15:38:03 user nova-compute[75337]:   <memory>524288</memory>
Nov 06 15:38:03 user nova-compute[75337]:   <vcpu>1</vcpu>
Nov 06 15:38:03 user nova-compute[75337]:   <metadata>
Nov 06 15:38:03 user nova-compute[75337]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 15:38:03 user nova-compute[75337]:       <nova:package version="0.0.0"/>
Nov 06 15:38:03 user nova-compute[75337]:       <nova:name>tempest-DeleteServersTestJSON-server-1150753702</nova:name>
Nov 06 15:38:03 user nova-compute[75337]:       <nova:creationTime>2023-11-06 15:38:03</nova:creationTime>
Nov 06 15:38:03 user nova-compute[75337]:       <nova:flavor name="m1.tiny">
Nov 06 15:38:03 user nova-compute[75337]:         <nova:memory>512</nova:memory>
Nov 06 15:38:03 user nova-compute[75337]:         <nova:disk>1</nova:disk>
Nov 06 15:38:03 user nova-compute[75337]:         <nova:swap>0</nova:swap>
Nov 06 15:38:03 user nova-compute[75337]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 15:38:03 user nova-compute[75337]:         <nova:vcpus>1</nova:vcpus>
Nov 06 15:38:03 user nova-compute[75337]:       </nova:flavor>
Nov 06 15:38:03 user nova-compute[75337]:       <nova:owner>
Nov 06 15:38:03 user nova-compute[75337]:         <nova:user uuid="92b6d879877241fa9372d76e52d41c6b">tempest-DeleteServersTestJSON-706109674-project-member</nova:user>
Nov 06 15:38:03 user nova-compute[75337]:         <nova:project uuid="0b38d5a3287447a580dbd965f44e042c">tempest-DeleteServersTestJSON-706109674</nova:project>
Nov 06 15:38:03 user nova-compute[75337]:       </nova:owner>
Nov 06 15:38:03 user nova-compute[75337]:       <nova:root type="image" uuid="16b903ae-a40f-41a7-985b-4804cce92c62"/>
Nov 06 15:38:03 user nova-compute[75337]:       <nova:ports>
Nov 06 15:38:03 user nova-compute[75337]:         <nova:port uuid="9e5c665f-7b51-497e-b9b7-a0f652321a96">
Nov 06 15:38:03 user nova-compute[75337]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 06 15:38:03 user nova-compute[75337]:         </nova:port>
Nov 06 15:38:03 user nova-compute[75337]:       </nova:ports>
Nov 06 15:38:03 user nova-compute[75337]:     </nova:instance>
Nov 06 15:38:03 user nova-compute[75337]:   </metadata>
Nov 06 15:38:03 user nova-compute[75337]:   <sysinfo type="smbios">
Nov 06 15:38:03 user nova-compute[75337]:     <system>
Nov 06 15:38:03 user nova-compute[75337]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 15:38:03 user nova-compute[75337]:       <entry name="product">OpenStack Nova</entry>
Nov 06 15:38:03 user nova-compute[75337]:       <entry name="version">0.0.0</entry>
Nov 06 15:38:03 user nova-compute[75337]:       <entry name="serial">5f5fc58d-f946-4df0-b8d0-1aefbf0f8cd6</entry>
Nov 06 15:38:03 user nova-compute[75337]:       <entry name="uuid">5f5fc58d-f946-4df0-b8d0-1aefbf0f8cd6</entry>
Nov 06 15:38:03 user nova-compute[75337]:       <entry name="family">Virtual Machine</entry>
Nov 06 15:38:03 user nova-compute[75337]:     </system>
Nov 06 15:38:03 user nova-compute[75337]:   </sysinfo>
Nov 06 15:38:03 user nova-compute[75337]:   <os>
Nov 06 15:38:03 user nova-compute[75337]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 15:38:03 user nova-compute[75337]:     <boot dev="hd"/>
Nov 06 15:38:03 user nova-compute[75337]:     <smbios mode="sysinfo"/>
Nov 06 15:38:03 user nova-compute[75337]:   </os>
Nov 06 15:38:03 user nova-compute[75337]:   <features>
Nov 06 15:38:03 user nova-compute[75337]:     <acpi/>
Nov 06 15:38:03 user nova-compute[75337]:     <apic/>
Nov 06 15:38:03 user nova-compute[75337]:     <vmcoreinfo/>
Nov 06 15:38:03 user nova-compute[75337]:   </features>
Nov 06 15:38:03 user nova-compute[75337]:   <clock offset="utc">
Nov 06 15:38:03 user nova-compute[75337]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 15:38:03 user nova-compute[75337]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 15:38:03 user nova-compute[75337]:     <timer name="hpet" present="no"/>
Nov 06 15:38:03 user nova-compute[75337]:   </clock>
Nov 06 15:38:03 user nova-compute[75337]:   <cpu mode="custom" match="exact">
Nov 06 15:38:03 user nova-compute[75337]:     <model>Nehalem</model>
Nov 06 15:38:03 user nova-compute[75337]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 15:38:03 user nova-compute[75337]:   </cpu>
Nov 06 15:38:03 user nova-compute[75337]:   <devices>
Nov 06 15:38:03 user nova-compute[75337]:     <disk type="file" device="disk">
Nov 06 15:38:03 user nova-compute[75337]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 15:38:03 user nova-compute[75337]:       <source file="/opt/stack/data/nova/instances/5f5fc58d-f946-4df0-b8d0-1aefbf0f8cd6/disk"/>
Nov 06 15:38:03 user nova-compute[75337]:       <target dev="vda" bus="virtio"/>
Nov 06 15:38:03 user nova-compute[75337]:     </disk>
Nov 06 15:38:03 user nova-compute[75337]:     <interface type="ethernet">
Nov 06 15:38:03 user nova-compute[75337]:       <mac address="fa:16:3e:f7:8a:4e"/>
Nov 06 15:38:03 user nova-compute[75337]:       <model type="virtio"/>
Nov 06 15:38:03 user nova-compute[75337]:       <mtu size="1442"/>
Nov 06 15:38:03 user nova-compute[75337]:       <target dev="tap9e5c665f-7b"/>
Nov 06 15:38:03 user nova-compute[75337]:     </interface>
Nov 06 15:38:03 user nova-compute[75337]:     <serial type="pty">
Nov 06 15:38:03 user nova-compute[75337]:       <log file="/opt/stack/data/nova/instances/5f5fc58d-f946-4df0-b8d0-1aefbf0f8cd6/console.log" append="off"/>
Nov 06 15:38:03 user nova-compute[75337]:     </serial>
Nov 06 15:38:03 user nova-compute[75337]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 15:38:03 user nova-compute[75337]:     <video>
Nov 06 15:38:03 user nova-compute[75337]:       <model type="virtio"/>
Nov 06 15:38:03 user nova-compute[75337]:     </video>
Nov 06 15:38:03 user nova-compute[75337]:     <rng model="virtio">
Nov 06 15:38:03 user nova-compute[75337]:       <backend model="random">/dev/urandom</backend>
Nov 06 15:38:03 user nova-compute[75337]:     </rng>
Nov 06 15:38:03 user nova-compute[75337]:     <controller type="usb" index="0" model="none"/>
Nov 06 15:38:03 user nova-compute[75337]:     <memballoon model="virtio">
Nov 06 15:38:03 user nova-compute[75337]:       <stats period="10"/>
Nov 06 15:38:03 user nova-compute[75337]:     </memballoon>
Nov 06 15:38:03 user nova-compute[75337]:   </devices>
Nov 06 15:38:03 user nova-compute[75337]: </domain>
Nov 06 15:38:03 user nova-compute[75337]:  {{(pid=75337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 15:38:03 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-1fb51d76-ace3-4cae-bd21-10fb29d2c2fc tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T15:37:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1150753702',display_name='tempest-DeleteServersTestJSON-server-1150753702',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1150753702',id=2,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0b38d5a3287447a580dbd965f44e042c',ramdisk_id='',reservation_id='r-kfcfq5qs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-706109674',owner_user_name='tempest-DeleteServersTestJSON-706109674-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T15:37:58Z,user_data=None,user_id='92b6d879877241fa9372d76e52d41c6b',uuid=5f5fc58d-f946-4df0-b8d0-1aefbf0f8cd6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9e5c665f-7b51-497e-b9b7-a0f652321a96", "address": "fa:16:3e:f7:8a:4e", "network": {"id": "fa9a4651-99aa-40d8-9010-136c5b9f4c02", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-501845579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b38d5a3287447a580dbd965f44e042c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e5c665f-7b", "ovs_interfaceid": "9e5c665f-7b51-497e-b9b7-a0f652321a96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 15:38:03 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-1fb51d76-ace3-4cae-bd21-10fb29d2c2fc tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] Converting VIF {"id": "9e5c665f-7b51-497e-b9b7-a0f652321a96", "address": "fa:16:3e:f7:8a:4e", "network": {"id": "fa9a4651-99aa-40d8-9010-136c5b9f4c02", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-501845579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b38d5a3287447a580dbd965f44e042c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e5c665f-7b", "ovs_interfaceid": "9e5c665f-7b51-497e-b9b7-a0f652321a96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 15:38:03 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-1fb51d76-ace3-4cae-bd21-10fb29d2c2fc tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:8a:4e,bridge_name='br-int',has_traffic_filtering=True,id=9e5c665f-7b51-497e-b9b7-a0f652321a96,network=Network(fa9a4651-99aa-40d8-9010-136c5b9f4c02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e5c665f-7b') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 15:38:03 user nova-compute[75337]: DEBUG os_vif [None req-1fb51d76-ace3-4cae-bd21-10fb29d2c2fc tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:8a:4e,bridge_name='br-int',has_traffic_filtering=True,id=9e5c665f-7b51-497e-b9b7-a0f652321a96,network=Network(fa9a4651-99aa-40d8-9010-136c5b9f4c02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e5c665f-7b') {{(pid=75337) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 15:38:03 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:38:03 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:38:03 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 15:38:03 user nova-compute[75337]: DEBUG nova.network.neutron [None req-85a3dccf-6bd3-423b-963c-1b49593ba32d tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] [instance: 581cf468-65e7-42e5-9250-c3d645577011] Successfully updated port: d1c68bac-be37-4645-afcb-2b89f47c1793 {{(pid=75337) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 15:38:03 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:38:03 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '95848268-07d4-5d21-9bf2-e1d6f3430465', '_type': 'linux-noop'}}, row=False) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:38:03 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:38:03 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:38:03 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-85a3dccf-6bd3-423b-963c-1b49593ba32d tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Acquiring lock "refresh_cache-581cf468-65e7-42e5-9250-c3d645577011" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 15:38:03 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-85a3dccf-6bd3-423b-963c-1b49593ba32d tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Acquired lock "refresh_cache-581cf468-65e7-42e5-9250-c3d645577011" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 15:38:03 user nova-compute[75337]: DEBUG nova.network.neutron [None req-85a3dccf-6bd3-423b-963c-1b49593ba32d tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] [instance: 581cf468-65e7-42e5-9250-c3d645577011] Building network info cache for instance {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 15:38:03 user nova-compute[75337]: DEBUG nova.network.neutron [None req-85a3dccf-6bd3-423b-963c-1b49593ba32d tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] [instance: 581cf468-65e7-42e5-9250-c3d645577011] Instance cache missing network info. {{(pid=75337) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 15:38:03 user nova-compute[75337]: DEBUG nova.compute.manager [req-7fdaffb1-7bfb-465d-9c45-9c8f91d129fa req-b48dfd58-4697-4f20-9e42-16666758e796 service nova] [instance: 581cf468-65e7-42e5-9250-c3d645577011] Received event network-changed-d1c68bac-be37-4645-afcb-2b89f47c1793 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:38:03 user nova-compute[75337]: DEBUG nova.compute.manager [req-7fdaffb1-7bfb-465d-9c45-9c8f91d129fa req-b48dfd58-4697-4f20-9e42-16666758e796 service nova] [instance: 581cf468-65e7-42e5-9250-c3d645577011] Refreshing instance network info cache due to event network-changed-d1c68bac-be37-4645-afcb-2b89f47c1793. {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 15:38:03 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-7fdaffb1-7bfb-465d-9c45-9c8f91d129fa req-b48dfd58-4697-4f20-9e42-16666758e796 service nova] Acquiring lock "refresh_cache-581cf468-65e7-42e5-9250-c3d645577011" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 15:38:03 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:38:03 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9e5c665f-7b, may_exist=True, interface_attrs={}) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:38:03 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9e5c665f-7b, col_values=(('qos', UUID('fefd5627-c3b0-466b-a7dd-15cd9ae439f2')),), if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:38:03 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9e5c665f-7b, col_values=(('external_ids', {'iface-id': '9e5c665f-7b51-497e-b9b7-a0f652321a96', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f7:8a:4e', 'vm-uuid': '5f5fc58d-f946-4df0-b8d0-1aefbf0f8cd6'}),), if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:38:03 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:38:03 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:38:03 user nova-compute[75337]: DEBUG nova.network.neutron [None req-8ec9b84c-44ef-4746-b7cb-3670a5acf87d tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] [instance: c8cf1ead-a87c-459c-b914-a0e976c9e464] Updating instance_info_cache with network_info: [{"id": "b33373f6-0289-4623-90ac-f5c3db0d3681", "address": "fa:16:3e:37:16:66", "network": {"id": "a839a9d1-fdf3-4a72-898b-6829ceef2055", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1927950273-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86f4b41336384a53a3fd22caa0fe8e6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb33373f6-02", "ovs_interfaceid": "b33373f6-0289-4623-90ac-f5c3db0d3681", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:38:03 user nova-compute[75337]: INFO os_vif [None req-1fb51d76-ace3-4cae-bd21-10fb29d2c2fc tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:8a:4e,bridge_name='br-int',has_traffic_filtering=True,id=9e5c665f-7b51-497e-b9b7-a0f652321a96,network=Network(fa9a4651-99aa-40d8-9010-136c5b9f4c02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e5c665f-7b')
Nov 06 15:38:03 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:38:03 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap452cb189-f5, may_exist=True, interface_attrs={}) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:38:03 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap452cb189-f5, col_values=(('qos', UUID('50c90e37-292f-4c01-9b6d-af2e93837530')),), if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:38:03 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap452cb189-f5, col_values=(('external_ids', {'iface-id': '452cb189-f59e-42e1-80e1-9eebb0c65bd7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f6:56:c4', 'vm-uuid': '83516ff5-c4e7-4e91-a2f9-8af9b51cf475'}),), if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:38:03 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:38:03 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:38:03 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-8ec9b84c-44ef-4746-b7cb-3670a5acf87d tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Releasing lock "refresh_cache-c8cf1ead-a87c-459c-b914-a0e976c9e464" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 15:38:03 user nova-compute[75337]: DEBUG nova.compute.manager [None req-8ec9b84c-44ef-4746-b7cb-3670a5acf87d tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] [instance: c8cf1ead-a87c-459c-b914-a0e976c9e464] Instance network_info: |[{"id": "b33373f6-0289-4623-90ac-f5c3db0d3681", "address": "fa:16:3e:37:16:66", "network": {"id": "a839a9d1-fdf3-4a72-898b-6829ceef2055", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1927950273-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86f4b41336384a53a3fd22caa0fe8e6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb33373f6-02", "ovs_interfaceid": "b33373f6-0289-4623-90ac-f5c3db0d3681", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 15:38:03 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-96aab58a-2395-49b6-b3e9-1f32c9c7aa64 req-e298c69d-39e2-46ad-ad6c-4a44470780b9 service nova] Acquired lock "refresh_cache-c8cf1ead-a87c-459c-b914-a0e976c9e464" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 15:38:03 user nova-compute[75337]: DEBUG nova.network.neutron [req-96aab58a-2395-49b6-b3e9-1f32c9c7aa64 req-e298c69d-39e2-46ad-ad6c-4a44470780b9 service nova] [instance: c8cf1ead-a87c-459c-b914-a0e976c9e464] Refreshing network info cache for port b33373f6-0289-4623-90ac-f5c3db0d3681 {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 15:38:03 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-8ec9b84c-44ef-4746-b7cb-3670a5acf87d tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] [instance: c8cf1ead-a87c-459c-b914-a0e976c9e464] Start _get_guest_xml network_info=[{"id": "b33373f6-0289-4623-90ac-f5c3db0d3681", "address": "fa:16:3e:37:16:66", "network": {"id": "a839a9d1-fdf3-4a72-898b-6829ceef2055", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1927950273-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86f4b41336384a53a3fd22caa0fe8e6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb33373f6-02", "ovs_interfaceid": "b33373f6-0289-4623-90ac-f5c3db0d3681", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T15:34:14Z,direct_url=<?>,disk_format='qcow2',id=16b903ae-a40f-41a7-985b-4804cce92c62,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6549a15819f1469bbd5eeae8190e3d44',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T15:34:15Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'guest_format': None, 'size': 0, 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '16b903ae-a40f-41a7-985b-4804cce92c62'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 15:38:03 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:38:03 user nova-compute[75337]: INFO os_vif [None req-75bba3f0-8587-4ed8-bd52-888d6ae89130 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:56:c4,bridge_name='br-int',has_traffic_filtering=True,id=452cb189-f59e-42e1-80e1-9eebb0c65bd7,network=Network(736be000-ee94-41fd-9de0-f2f885ec9be7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap452cb189-f5')
Nov 06 15:38:03 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-8ec9b84c-44ef-4746-b7cb-3670a5acf87d tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 15:38:03 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-8ec9b84c-44ef-4746-b7cb-3670a5acf87d tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 15:38:03 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-8ec9b84c-44ef-4746-b7cb-3670a5acf87d tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 15:38:03 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-8ec9b84c-44ef-4746-b7cb-3670a5acf87d tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] CPU controller missing on host. {{(pid=75337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 15:38:03 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-8ec9b84c-44ef-4746-b7cb-3670a5acf87d tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 15:38:03 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-8ec9b84c-44ef-4746-b7cb-3670a5acf87d tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] CPU controller found on host. {{(pid=75337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 15:38:03 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-8ec9b84c-44ef-4746-b7cb-3670a5acf87d tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75337) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 15:38:03 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-8ec9b84c-44ef-4746-b7cb-3670a5acf87d tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T15:34:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T15:34:14Z,direct_url=<?>,disk_format='qcow2',id=16b903ae-a40f-41a7-985b-4804cce92c62,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6549a15819f1469bbd5eeae8190e3d44',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T15:34:15Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 15:38:03 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-8ec9b84c-44ef-4746-b7cb-3670a5acf87d tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Flavor limits 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 15:38:03 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-8ec9b84c-44ef-4746-b7cb-3670a5acf87d tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Image limits 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 15:38:03 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-8ec9b84c-44ef-4746-b7cb-3670a5acf87d tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Flavor pref 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 15:38:03 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-8ec9b84c-44ef-4746-b7cb-3670a5acf87d tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Image pref 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 15:38:03 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-8ec9b84c-44ef-4746-b7cb-3670a5acf87d tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 15:38:03 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-8ec9b84c-44ef-4746-b7cb-3670a5acf87d tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 15:38:03 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-8ec9b84c-44ef-4746-b7cb-3670a5acf87d tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 15:38:03 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-8ec9b84c-44ef-4746-b7cb-3670a5acf87d tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Got 1 possible topologies {{(pid=75337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 15:38:03 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-8ec9b84c-44ef-4746-b7cb-3670a5acf87d tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 15:38:03 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-8ec9b84c-44ef-4746-b7cb-3670a5acf87d tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 15:38:03 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-8ec9b84c-44ef-4746-b7cb-3670a5acf87d tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T15:37:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1460081442',display_name='tempest-ServerStableDeviceRescueTest-server-1460081442',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1460081442',id=3,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNhWd6+eUiIBQZGc6LZ0InXN96wVpRF9RHeVy5tDr/sqc5jJYeqvZnGJOTX8afCIFIyA3qCwBSUAfC6fowKfta99KGcXm2stZlkUkyQJaJ7NDTIzQAW/nlfJ0mGtYGBdsw==',key_name='tempest-keypair-2068455996',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='86f4b41336384a53a3fd22caa0fe8e6e',ramdisk_id='',reservation_id='r-dfh80oqh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1727960867',owner_user_name='tempest-ServerStableDeviceRescueTest-1727960867-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T15:37:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f5356a7304a34428bbb0f39fb7d9a489',uuid=c8cf1ead-a87c-459c-b914-a0e976c9e464,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b33373f6-0289-4623-90ac-f5c3db0d3681", "address": "fa:16:3e:37:16:66", "network": {"id": "a839a9d1-fdf3-4a72-898b-6829ceef2055", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1927950273-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86f4b41336384a53a3fd22caa0fe8e6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb33373f6-02", "ovs_interfaceid": "b33373f6-0289-4623-90ac-f5c3db0d3681", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75337) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 15:38:03 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-8ec9b84c-44ef-4746-b7cb-3670a5acf87d tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Converting VIF {"id": "b33373f6-0289-4623-90ac-f5c3db0d3681", "address": "fa:16:3e:37:16:66", "network": {"id": "a839a9d1-fdf3-4a72-898b-6829ceef2055", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1927950273-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86f4b41336384a53a3fd22caa0fe8e6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb33373f6-02", "ovs_interfaceid": "b33373f6-0289-4623-90ac-f5c3db0d3681", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 15:38:03 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-8ec9b84c-44ef-4746-b7cb-3670a5acf87d tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:16:66,bridge_name='br-int',has_traffic_filtering=True,id=b33373f6-0289-4623-90ac-f5c3db0d3681,network=Network(a839a9d1-fdf3-4a72-898b-6829ceef2055),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb33373f6-02') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 15:38:03 user nova-compute[75337]: DEBUG nova.objects.instance [None req-8ec9b84c-44ef-4746-b7cb-3670a5acf87d tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Lazy-loading 'pci_devices' on Instance uuid c8cf1ead-a87c-459c-b914-a0e976c9e464 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 15:38:03 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-1fb51d76-ace3-4cae-bd21-10fb29d2c2fc tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] No BDM found with device name vda, not building metadata. {{(pid=75337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 15:38:03 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-1fb51d76-ace3-4cae-bd21-10fb29d2c2fc tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] No VIF found with MAC fa:16:3e:f7:8a:4e, not building metadata {{(pid=75337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 15:38:03 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-8ec9b84c-44ef-4746-b7cb-3670a5acf87d tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] [instance: c8cf1ead-a87c-459c-b914-a0e976c9e464] End _get_guest_xml xml=<domain type="kvm">
Nov 06 15:38:03 user nova-compute[75337]:   <uuid>c8cf1ead-a87c-459c-b914-a0e976c9e464</uuid>
Nov 06 15:38:03 user nova-compute[75337]:   <name>instance-00000003</name>
Nov 06 15:38:03 user nova-compute[75337]:   <memory>524288</memory>
Nov 06 15:38:03 user nova-compute[75337]:   <vcpu>1</vcpu>
Nov 06 15:38:03 user nova-compute[75337]:   <metadata>
Nov 06 15:38:03 user nova-compute[75337]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 15:38:03 user nova-compute[75337]:       <nova:package version="0.0.0"/>
Nov 06 15:38:03 user nova-compute[75337]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1460081442</nova:name>
Nov 06 15:38:03 user nova-compute[75337]:       <nova:creationTime>2023-11-06 15:38:03</nova:creationTime>
Nov 06 15:38:03 user nova-compute[75337]:       <nova:flavor name="m1.tiny">
Nov 06 15:38:03 user nova-compute[75337]:         <nova:memory>512</nova:memory>
Nov 06 15:38:03 user nova-compute[75337]:         <nova:disk>1</nova:disk>
Nov 06 15:38:03 user nova-compute[75337]:         <nova:swap>0</nova:swap>
Nov 06 15:38:03 user nova-compute[75337]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 15:38:03 user nova-compute[75337]:         <nova:vcpus>1</nova:vcpus>
Nov 06 15:38:03 user nova-compute[75337]:       </nova:flavor>
Nov 06 15:38:03 user nova-compute[75337]:       <nova:owner>
Nov 06 15:38:03 user nova-compute[75337]:         <nova:user uuid="f5356a7304a34428bbb0f39fb7d9a489">tempest-ServerStableDeviceRescueTest-1727960867-project-member</nova:user>
Nov 06 15:38:03 user nova-compute[75337]:         <nova:project uuid="86f4b41336384a53a3fd22caa0fe8e6e">tempest-ServerStableDeviceRescueTest-1727960867</nova:project>
Nov 06 15:38:03 user nova-compute[75337]:       </nova:owner>
Nov 06 15:38:03 user nova-compute[75337]:       <nova:root type="image" uuid="16b903ae-a40f-41a7-985b-4804cce92c62"/>
Nov 06 15:38:03 user nova-compute[75337]:       <nova:ports>
Nov 06 15:38:03 user nova-compute[75337]:         <nova:port uuid="b33373f6-0289-4623-90ac-f5c3db0d3681">
Nov 06 15:38:03 user nova-compute[75337]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 06 15:38:03 user nova-compute[75337]:         </nova:port>
Nov 06 15:38:03 user nova-compute[75337]:       </nova:ports>
Nov 06 15:38:03 user nova-compute[75337]:     </nova:instance>
Nov 06 15:38:03 user nova-compute[75337]:   </metadata>
Nov 06 15:38:03 user nova-compute[75337]:   <sysinfo type="smbios">
Nov 06 15:38:03 user nova-compute[75337]:     <system>
Nov 06 15:38:03 user nova-compute[75337]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 15:38:03 user nova-compute[75337]:       <entry name="product">OpenStack Nova</entry>
Nov 06 15:38:03 user nova-compute[75337]:       <entry name="version">0.0.0</entry>
Nov 06 15:38:03 user nova-compute[75337]:       <entry name="serial">c8cf1ead-a87c-459c-b914-a0e976c9e464</entry>
Nov 06 15:38:03 user nova-compute[75337]:       <entry name="uuid">c8cf1ead-a87c-459c-b914-a0e976c9e464</entry>
Nov 06 15:38:03 user nova-compute[75337]:       <entry name="family">Virtual Machine</entry>
Nov 06 15:38:03 user nova-compute[75337]:     </system>
Nov 06 15:38:03 user nova-compute[75337]:   </sysinfo>
Nov 06 15:38:03 user nova-compute[75337]:   <os>
Nov 06 15:38:03 user nova-compute[75337]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 15:38:03 user nova-compute[75337]:     <boot dev="hd"/>
Nov 06 15:38:03 user nova-compute[75337]:     <smbios mode="sysinfo"/>
Nov 06 15:38:03 user nova-compute[75337]:   </os>
Nov 06 15:38:03 user nova-compute[75337]:   <features>
Nov 06 15:38:03 user nova-compute[75337]:     <acpi/>
Nov 06 15:38:03 user nova-compute[75337]:     <apic/>
Nov 06 15:38:03 user nova-compute[75337]:     <vmcoreinfo/>
Nov 06 15:38:03 user nova-compute[75337]:   </features>
Nov 06 15:38:03 user nova-compute[75337]:   <clock offset="utc">
Nov 06 15:38:03 user nova-compute[75337]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 15:38:03 user nova-compute[75337]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 15:38:03 user nova-compute[75337]:     <timer name="hpet" present="no"/>
Nov 06 15:38:03 user nova-compute[75337]:   </clock>
Nov 06 15:38:03 user nova-compute[75337]:   <cpu mode="custom" match="exact">
Nov 06 15:38:03 user nova-compute[75337]:     <model>Nehalem</model>
Nov 06 15:38:03 user nova-compute[75337]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 15:38:03 user nova-compute[75337]:   </cpu>
Nov 06 15:38:03 user nova-compute[75337]:   <devices>
Nov 06 15:38:03 user nova-compute[75337]:     <disk type="file" device="disk">
Nov 06 15:38:03 user nova-compute[75337]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 15:38:03 user nova-compute[75337]:       <source file="/opt/stack/data/nova/instances/c8cf1ead-a87c-459c-b914-a0e976c9e464/disk"/>
Nov 06 15:38:03 user nova-compute[75337]:       <target dev="vda" bus="virtio"/>
Nov 06 15:38:03 user nova-compute[75337]:     </disk>
Nov 06 15:38:03 user nova-compute[75337]:     <interface type="ethernet">
Nov 06 15:38:03 user nova-compute[75337]:       <mac address="fa:16:3e:37:16:66"/>
Nov 06 15:38:03 user nova-compute[75337]:       <model type="virtio"/>
Nov 06 15:38:03 user nova-compute[75337]:       <mtu size="1442"/>
Nov 06 15:38:03 user nova-compute[75337]:       <target dev="tapb33373f6-02"/>
Nov 06 15:38:03 user nova-compute[75337]:     </interface>
Nov 06 15:38:03 user nova-compute[75337]:     <serial type="pty">
Nov 06 15:38:03 user nova-compute[75337]:       <log file="/opt/stack/data/nova/instances/c8cf1ead-a87c-459c-b914-a0e976c9e464/console.log" append="off"/>
Nov 06 15:38:03 user nova-compute[75337]:     </serial>
Nov 06 15:38:03 user nova-compute[75337]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 15:38:03 user nova-compute[75337]:     <video>
Nov 06 15:38:03 user nova-compute[75337]:       <model type="virtio"/>
Nov 06 15:38:03 user nova-compute[75337]:     </video>
Nov 06 15:38:03 user nova-compute[75337]:     <rng model="virtio">
Nov 06 15:38:03 user nova-compute[75337]:       <backend model="random">/dev/urandom</backend>
Nov 06 15:38:03 user nova-compute[75337]:     </rng>
Nov 06 15:38:03 user nova-compute[75337]:     <controller type="usb" index="0" model="none"/>
Nov 06 15:38:03 user nova-compute[75337]:     <memballoon model="virtio">
Nov 06 15:38:03 user nova-compute[75337]:       <stats period="10"/>
Nov 06 15:38:03 user nova-compute[75337]:     </memballoon>
Nov 06 15:38:03 user nova-compute[75337]:   </devices>
Nov 06 15:38:03 user nova-compute[75337]: </domain>
Nov 06 15:38:03 user nova-compute[75337]:  {{(pid=75337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 15:38:03 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-8ec9b84c-44ef-4746-b7cb-3670a5acf87d tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T15:37:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1460081442',display_name='tempest-ServerStableDeviceRescueTest-server-1460081442',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1460081442',id=3,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNhWd6+eUiIBQZGc6LZ0InXN96wVpRF9RHeVy5tDr/sqc5jJYeqvZnGJOTX8afCIFIyA3qCwBSUAfC6fowKfta99KGcXm2stZlkUkyQJaJ7NDTIzQAW/nlfJ0mGtYGBdsw==',key_name='tempest-keypair-2068455996',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='86f4b41336384a53a3fd22caa0fe8e6e',ramdisk_id='',reservation_id='r-dfh80oqh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1727960867',owner_user_name='tempest-ServerStableDeviceRescueTest-1727960867-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T15:37:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f5356a7304a34428bbb0f39fb7d9a489',uuid=c8cf1ead-a87c-459c-b914-a0e976c9e464,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b33373f6-0289-4623-90ac-f5c3db0d3681", "address": "fa:16:3e:37:16:66", "network": {"id": "a839a9d1-fdf3-4a72-898b-6829ceef2055", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1927950273-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86f4b41336384a53a3fd22caa0fe8e6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb33373f6-02", "ovs_interfaceid": "b33373f6-0289-4623-90ac-f5c3db0d3681", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 15:38:03 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-8ec9b84c-44ef-4746-b7cb-3670a5acf87d tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Converting VIF {"id": "b33373f6-0289-4623-90ac-f5c3db0d3681", "address": "fa:16:3e:37:16:66", "network": {"id": "a839a9d1-fdf3-4a72-898b-6829ceef2055", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1927950273-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86f4b41336384a53a3fd22caa0fe8e6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb33373f6-02", "ovs_interfaceid": "b33373f6-0289-4623-90ac-f5c3db0d3681", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 15:38:03 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-8ec9b84c-44ef-4746-b7cb-3670a5acf87d tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:16:66,bridge_name='br-int',has_traffic_filtering=True,id=b33373f6-0289-4623-90ac-f5c3db0d3681,network=Network(a839a9d1-fdf3-4a72-898b-6829ceef2055),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb33373f6-02') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 15:38:03 user nova-compute[75337]: DEBUG os_vif [None req-8ec9b84c-44ef-4746-b7cb-3670a5acf87d tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:16:66,bridge_name='br-int',has_traffic_filtering=True,id=b33373f6-0289-4623-90ac-f5c3db0d3681,network=Network(a839a9d1-fdf3-4a72-898b-6829ceef2055),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb33373f6-02') {{(pid=75337) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 15:38:03 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:38:03 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:38:03 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 15:38:03 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:38:03 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a135f4eb-a415-5961-a899-87ee47f3e673', '_type': 'linux-noop'}}, row=False) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:38:03 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:38:03 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:38:03 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-75bba3f0-8587-4ed8-bd52-888d6ae89130 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] No BDM found with device name vda, not building metadata. {{(pid=75337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 15:38:03 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-75bba3f0-8587-4ed8-bd52-888d6ae89130 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] No VIF found with MAC fa:16:3e:f6:56:c4, not building metadata {{(pid=75337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 15:38:03 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:38:03 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:38:03 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb33373f6-02, may_exist=True, interface_attrs={}) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:38:03 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb33373f6-02, col_values=(('qos', UUID('1443d31b-ad79-48db-a057-6f259fc19722')),), if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:38:03 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb33373f6-02, col_values=(('external_ids', {'iface-id': 'b33373f6-0289-4623-90ac-f5c3db0d3681', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:37:16:66', 'vm-uuid': 'c8cf1ead-a87c-459c-b914-a0e976c9e464'}),), if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:38:03 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:38:03 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:38:03 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:38:03 user nova-compute[75337]: INFO os_vif [None req-8ec9b84c-44ef-4746-b7cb-3670a5acf87d tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:16:66,bridge_name='br-int',has_traffic_filtering=True,id=b33373f6-0289-4623-90ac-f5c3db0d3681,network=Network(a839a9d1-fdf3-4a72-898b-6829ceef2055),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb33373f6-02')
Nov 06 15:38:03 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-8ec9b84c-44ef-4746-b7cb-3670a5acf87d tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] No BDM found with device name vda, not building metadata. {{(pid=75337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 15:38:03 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-8ec9b84c-44ef-4746-b7cb-3670a5acf87d tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] No VIF found with MAC fa:16:3e:37:16:66, not building metadata {{(pid=75337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 15:38:03 user nova-compute[75337]: DEBUG nova.network.neutron [None req-de8e0a8f-0037-401a-bdef-954826a647d4 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] [instance: 8a600bd8-b94a-4242-a443-c2defb002280] Successfully updated port: 01aa7168-78cd-44e6-8496-08d468f62cfe {{(pid=75337) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 15:38:04 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-de8e0a8f-0037-401a-bdef-954826a647d4 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Acquiring lock "refresh_cache-8a600bd8-b94a-4242-a443-c2defb002280" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 15:38:04 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-de8e0a8f-0037-401a-bdef-954826a647d4 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Acquired lock "refresh_cache-8a600bd8-b94a-4242-a443-c2defb002280" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 15:38:04 user nova-compute[75337]: DEBUG nova.network.neutron [None req-de8e0a8f-0037-401a-bdef-954826a647d4 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] [instance: 8a600bd8-b94a-4242-a443-c2defb002280] Building network info cache for instance {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 15:38:04 user nova-compute[75337]: DEBUG nova.network.neutron [None req-de8e0a8f-0037-401a-bdef-954826a647d4 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] [instance: 8a600bd8-b94a-4242-a443-c2defb002280] Instance cache missing network info. {{(pid=75337) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 15:38:04 user nova-compute[75337]: DEBUG nova.network.neutron [None req-2c2d9eec-5e43-48a3-8c5c-46fb52f23c04 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] [instance: dfadb21f-5ed1-42f4-956b-95cccf128b6a] Successfully created port: 8592b366-9f21-4d92-b297-8872d9a7110f {{(pid=75337) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 15:38:04 user nova-compute[75337]: DEBUG nova.network.neutron [req-7714edd2-e498-42a9-9883-1b8c6a65095d req-8c4c89fa-383e-4e7b-9721-474a3ef78372 service nova] [instance: 5f5fc58d-f946-4df0-b8d0-1aefbf0f8cd6] Updated VIF entry in instance network info cache for port 9e5c665f-7b51-497e-b9b7-a0f652321a96. {{(pid=75337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 15:38:04 user nova-compute[75337]: DEBUG nova.network.neutron [req-7714edd2-e498-42a9-9883-1b8c6a65095d req-8c4c89fa-383e-4e7b-9721-474a3ef78372 service nova] [instance: 5f5fc58d-f946-4df0-b8d0-1aefbf0f8cd6] Updating instance_info_cache with network_info: [{"id": "9e5c665f-7b51-497e-b9b7-a0f652321a96", "address": "fa:16:3e:f7:8a:4e", "network": {"id": "fa9a4651-99aa-40d8-9010-136c5b9f4c02", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-501845579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b38d5a3287447a580dbd965f44e042c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e5c665f-7b", "ovs_interfaceid": "9e5c665f-7b51-497e-b9b7-a0f652321a96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:38:04 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-7714edd2-e498-42a9-9883-1b8c6a65095d req-8c4c89fa-383e-4e7b-9721-474a3ef78372 service nova] Releasing lock "refresh_cache-5f5fc58d-f946-4df0-b8d0-1aefbf0f8cd6" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 15:38:04 user nova-compute[75337]: DEBUG nova.network.neutron [None req-85a3dccf-6bd3-423b-963c-1b49593ba32d tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] [instance: 581cf468-65e7-42e5-9250-c3d645577011] Updating instance_info_cache with network_info: [{"id": "d1c68bac-be37-4645-afcb-2b89f47c1793", "address": "fa:16:3e:00:1c:74", "network": {"id": "2623bcbf-c77c-47b4-abd5-ab538f9a2814", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1497688706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f40165c076e341bba42fb537ce98bbe2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1c68bac-be", "ovs_interfaceid": "d1c68bac-be37-4645-afcb-2b89f47c1793", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:38:04 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-85a3dccf-6bd3-423b-963c-1b49593ba32d tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Releasing lock "refresh_cache-581cf468-65e7-42e5-9250-c3d645577011" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 15:38:04 user nova-compute[75337]: DEBUG nova.compute.manager [None req-85a3dccf-6bd3-423b-963c-1b49593ba32d tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] [instance: 581cf468-65e7-42e5-9250-c3d645577011] Instance network_info: |[{"id": "d1c68bac-be37-4645-afcb-2b89f47c1793", "address": "fa:16:3e:00:1c:74", "network": {"id": "2623bcbf-c77c-47b4-abd5-ab538f9a2814", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1497688706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f40165c076e341bba42fb537ce98bbe2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1c68bac-be", "ovs_interfaceid": "d1c68bac-be37-4645-afcb-2b89f47c1793", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 15:38:04 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-7fdaffb1-7bfb-465d-9c45-9c8f91d129fa req-b48dfd58-4697-4f20-9e42-16666758e796 service nova] Acquired lock "refresh_cache-581cf468-65e7-42e5-9250-c3d645577011" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 15:38:04 user nova-compute[75337]: DEBUG nova.network.neutron [req-7fdaffb1-7bfb-465d-9c45-9c8f91d129fa req-b48dfd58-4697-4f20-9e42-16666758e796 service nova] [instance: 581cf468-65e7-42e5-9250-c3d645577011] Refreshing network info cache for port d1c68bac-be37-4645-afcb-2b89f47c1793 {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 15:38:04 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-85a3dccf-6bd3-423b-963c-1b49593ba32d tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] [instance: 581cf468-65e7-42e5-9250-c3d645577011] Start _get_guest_xml network_info=[{"id": "d1c68bac-be37-4645-afcb-2b89f47c1793", "address": "fa:16:3e:00:1c:74", "network": {"id": "2623bcbf-c77c-47b4-abd5-ab538f9a2814", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1497688706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f40165c076e341bba42fb537ce98bbe2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1c68bac-be", "ovs_interfaceid": "d1c68bac-be37-4645-afcb-2b89f47c1793", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T15:34:14Z,direct_url=<?>,disk_format='qcow2',id=16b903ae-a40f-41a7-985b-4804cce92c62,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6549a15819f1469bbd5eeae8190e3d44',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T15:34:15Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'guest_format': None, 'size': 0, 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '16b903ae-a40f-41a7-985b-4804cce92c62'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 15:38:04 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-85a3dccf-6bd3-423b-963c-1b49593ba32d tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 15:38:04 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-85a3dccf-6bd3-423b-963c-1b49593ba32d tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 15:38:04 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-85a3dccf-6bd3-423b-963c-1b49593ba32d tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 15:38:04 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-85a3dccf-6bd3-423b-963c-1b49593ba32d tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] CPU controller missing on host. {{(pid=75337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 15:38:04 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-85a3dccf-6bd3-423b-963c-1b49593ba32d tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 15:38:04 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-85a3dccf-6bd3-423b-963c-1b49593ba32d tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] CPU controller found on host. {{(pid=75337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 15:38:04 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-85a3dccf-6bd3-423b-963c-1b49593ba32d tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75337) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 15:38:04 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-85a3dccf-6bd3-423b-963c-1b49593ba32d tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T15:34:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T15:34:14Z,direct_url=<?>,disk_format='qcow2',id=16b903ae-a40f-41a7-985b-4804cce92c62,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6549a15819f1469bbd5eeae8190e3d44',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T15:34:15Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 15:38:04 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-85a3dccf-6bd3-423b-963c-1b49593ba32d tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Flavor limits 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 15:38:04 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-85a3dccf-6bd3-423b-963c-1b49593ba32d tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Image limits 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 15:38:04 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-85a3dccf-6bd3-423b-963c-1b49593ba32d tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Flavor pref 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 15:38:04 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-85a3dccf-6bd3-423b-963c-1b49593ba32d tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Image pref 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 15:38:04 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-85a3dccf-6bd3-423b-963c-1b49593ba32d tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 15:38:04 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-85a3dccf-6bd3-423b-963c-1b49593ba32d tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 15:38:04 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-85a3dccf-6bd3-423b-963c-1b49593ba32d tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 15:38:04 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-85a3dccf-6bd3-423b-963c-1b49593ba32d tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Got 1 possible topologies {{(pid=75337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 15:38:04 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-85a3dccf-6bd3-423b-963c-1b49593ba32d tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 15:38:04 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-85a3dccf-6bd3-423b-963c-1b49593ba32d tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 15:38:04 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-85a3dccf-6bd3-423b-963c-1b49593ba32d tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T15:37:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-143035342',display_name='tempest-ServerActionsTestOtherB-server-143035342',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-143035342',id=4,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGvgawdpwOKUFbYuIfCQHAYAwMkYeyGp/mWnvHMxoikCW6rq7Lc9iVzhCxfsvGYfdcuDE3wf7kwN77XNEdHIhKuYJC28UJSD4qJahdz/1x3pQWmM3jC4aksXmnaw21FVfw==',key_name='tempest-keypair-1619039595',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f40165c076e341bba42fb537ce98bbe2',ramdisk_id='',reservation_id='r-w3wq64j4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-464439480',owner_user_name='tempest-ServerActionsTestOtherB-464439480-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T15:37:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2810a15c1608465aa7465eae455eb5c6',uuid=581cf468-65e7-42e5-9250-c3d645577011,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d1c68bac-be37-4645-afcb-2b89f47c1793", "address": "fa:16:3e:00:1c:74", "network": {"id": "2623bcbf-c77c-47b4-abd5-ab538f9a2814", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1497688706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f40165c076e341bba42fb537ce98bbe2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1c68bac-be", "ovs_interfaceid": "d1c68bac-be37-4645-afcb-2b89f47c1793", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75337) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 15:38:04 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-85a3dccf-6bd3-423b-963c-1b49593ba32d tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Converting VIF {"id": "d1c68bac-be37-4645-afcb-2b89f47c1793", "address": "fa:16:3e:00:1c:74", "network": {"id": "2623bcbf-c77c-47b4-abd5-ab538f9a2814", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1497688706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f40165c076e341bba42fb537ce98bbe2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1c68bac-be", "ovs_interfaceid": "d1c68bac-be37-4645-afcb-2b89f47c1793", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 15:38:04 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-85a3dccf-6bd3-423b-963c-1b49593ba32d tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:1c:74,bridge_name='br-int',has_traffic_filtering=True,id=d1c68bac-be37-4645-afcb-2b89f47c1793,network=Network(2623bcbf-c77c-47b4-abd5-ab538f9a2814),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1c68bac-be') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 15:38:04 user nova-compute[75337]: DEBUG nova.objects.instance [None req-85a3dccf-6bd3-423b-963c-1b49593ba32d tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Lazy-loading 'pci_devices' on Instance uuid 581cf468-65e7-42e5-9250-c3d645577011 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 15:38:04 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-85a3dccf-6bd3-423b-963c-1b49593ba32d tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] [instance: 581cf468-65e7-42e5-9250-c3d645577011] End _get_guest_xml xml=<domain type="kvm">
Nov 06 15:38:04 user nova-compute[75337]:   <uuid>581cf468-65e7-42e5-9250-c3d645577011</uuid>
Nov 06 15:38:04 user nova-compute[75337]:   <name>instance-00000004</name>
Nov 06 15:38:04 user nova-compute[75337]:   <memory>524288</memory>
Nov 06 15:38:04 user nova-compute[75337]:   <vcpu>1</vcpu>
Nov 06 15:38:04 user nova-compute[75337]:   <metadata>
Nov 06 15:38:04 user nova-compute[75337]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 15:38:04 user nova-compute[75337]:       <nova:package version="0.0.0"/>
Nov 06 15:38:04 user nova-compute[75337]:       <nova:name>tempest-ServerActionsTestOtherB-server-143035342</nova:name>
Nov 06 15:38:04 user nova-compute[75337]:       <nova:creationTime>2023-11-06 15:38:04</nova:creationTime>
Nov 06 15:38:04 user nova-compute[75337]:       <nova:flavor name="m1.tiny">
Nov 06 15:38:04 user nova-compute[75337]:         <nova:memory>512</nova:memory>
Nov 06 15:38:04 user nova-compute[75337]:         <nova:disk>1</nova:disk>
Nov 06 15:38:04 user nova-compute[75337]:         <nova:swap>0</nova:swap>
Nov 06 15:38:04 user nova-compute[75337]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 15:38:04 user nova-compute[75337]:         <nova:vcpus>1</nova:vcpus>
Nov 06 15:38:04 user nova-compute[75337]:       </nova:flavor>
Nov 06 15:38:04 user nova-compute[75337]:       <nova:owner>
Nov 06 15:38:04 user nova-compute[75337]:         <nova:user uuid="2810a15c1608465aa7465eae455eb5c6">tempest-ServerActionsTestOtherB-464439480-project-member</nova:user>
Nov 06 15:38:04 user nova-compute[75337]:         <nova:project uuid="f40165c076e341bba42fb537ce98bbe2">tempest-ServerActionsTestOtherB-464439480</nova:project>
Nov 06 15:38:04 user nova-compute[75337]:       </nova:owner>
Nov 06 15:38:04 user nova-compute[75337]:       <nova:root type="image" uuid="16b903ae-a40f-41a7-985b-4804cce92c62"/>
Nov 06 15:38:04 user nova-compute[75337]:       <nova:ports>
Nov 06 15:38:04 user nova-compute[75337]:         <nova:port uuid="d1c68bac-be37-4645-afcb-2b89f47c1793">
Nov 06 15:38:04 user nova-compute[75337]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 06 15:38:04 user nova-compute[75337]:         </nova:port>
Nov 06 15:38:04 user nova-compute[75337]:       </nova:ports>
Nov 06 15:38:04 user nova-compute[75337]:     </nova:instance>
Nov 06 15:38:04 user nova-compute[75337]:   </metadata>
Nov 06 15:38:04 user nova-compute[75337]:   <sysinfo type="smbios">
Nov 06 15:38:04 user nova-compute[75337]:     <system>
Nov 06 15:38:04 user nova-compute[75337]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 15:38:04 user nova-compute[75337]:       <entry name="product">OpenStack Nova</entry>
Nov 06 15:38:04 user nova-compute[75337]:       <entry name="version">0.0.0</entry>
Nov 06 15:38:04 user nova-compute[75337]:       <entry name="serial">581cf468-65e7-42e5-9250-c3d645577011</entry>
Nov 06 15:38:04 user nova-compute[75337]:       <entry name="uuid">581cf468-65e7-42e5-9250-c3d645577011</entry>
Nov 06 15:38:04 user nova-compute[75337]:       <entry name="family">Virtual Machine</entry>
Nov 06 15:38:04 user nova-compute[75337]:     </system>
Nov 06 15:38:04 user nova-compute[75337]:   </sysinfo>
Nov 06 15:38:04 user nova-compute[75337]:   <os>
Nov 06 15:38:04 user nova-compute[75337]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 15:38:04 user nova-compute[75337]:     <boot dev="hd"/>
Nov 06 15:38:04 user nova-compute[75337]:     <smbios mode="sysinfo"/>
Nov 06 15:38:04 user nova-compute[75337]:   </os>
Nov 06 15:38:04 user nova-compute[75337]:   <features>
Nov 06 15:38:04 user nova-compute[75337]:     <acpi/>
Nov 06 15:38:04 user nova-compute[75337]:     <apic/>
Nov 06 15:38:04 user nova-compute[75337]:     <vmcoreinfo/>
Nov 06 15:38:04 user nova-compute[75337]:   </features>
Nov 06 15:38:04 user nova-compute[75337]:   <clock offset="utc">
Nov 06 15:38:04 user nova-compute[75337]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 15:38:04 user nova-compute[75337]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 15:38:04 user nova-compute[75337]:     <timer name="hpet" present="no"/>
Nov 06 15:38:04 user nova-compute[75337]:   </clock>
Nov 06 15:38:04 user nova-compute[75337]:   <cpu mode="custom" match="exact">
Nov 06 15:38:04 user nova-compute[75337]:     <model>Nehalem</model>
Nov 06 15:38:04 user nova-compute[75337]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 15:38:04 user nova-compute[75337]:   </cpu>
Nov 06 15:38:04 user nova-compute[75337]:   <devices>
Nov 06 15:38:04 user nova-compute[75337]:     <disk type="file" device="disk">
Nov 06 15:38:04 user nova-compute[75337]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 15:38:04 user nova-compute[75337]:       <source file="/opt/stack/data/nova/instances/581cf468-65e7-42e5-9250-c3d645577011/disk"/>
Nov 06 15:38:04 user nova-compute[75337]:       <target dev="vda" bus="virtio"/>
Nov 06 15:38:04 user nova-compute[75337]:     </disk>
Nov 06 15:38:04 user nova-compute[75337]:     <interface type="ethernet">
Nov 06 15:38:04 user nova-compute[75337]:       <mac address="fa:16:3e:00:1c:74"/>
Nov 06 15:38:04 user nova-compute[75337]:       <model type="virtio"/>
Nov 06 15:38:04 user nova-compute[75337]:       <mtu size="1442"/>
Nov 06 15:38:04 user nova-compute[75337]:       <target dev="tapd1c68bac-be"/>
Nov 06 15:38:04 user nova-compute[75337]:     </interface>
Nov 06 15:38:04 user nova-compute[75337]:     <serial type="pty">
Nov 06 15:38:04 user nova-compute[75337]:       <log file="/opt/stack/data/nova/instances/581cf468-65e7-42e5-9250-c3d645577011/console.log" append="off"/>
Nov 06 15:38:04 user nova-compute[75337]:     </serial>
Nov 06 15:38:04 user nova-compute[75337]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 15:38:04 user nova-compute[75337]:     <video>
Nov 06 15:38:04 user nova-compute[75337]:       <model type="virtio"/>
Nov 06 15:38:04 user nova-compute[75337]:     </video>
Nov 06 15:38:04 user nova-compute[75337]:     <rng model="virtio">
Nov 06 15:38:04 user nova-compute[75337]:       <backend model="random">/dev/urandom</backend>
Nov 06 15:38:04 user nova-compute[75337]:     </rng>
Nov 06 15:38:04 user nova-compute[75337]:     <controller type="usb" index="0" model="none"/>
Nov 06 15:38:04 user nova-compute[75337]:     <memballoon model="virtio">
Nov 06 15:38:04 user nova-compute[75337]:       <stats period="10"/>
Nov 06 15:38:04 user nova-compute[75337]:     </memballoon>
Nov 06 15:38:04 user nova-compute[75337]:   </devices>
Nov 06 15:38:04 user nova-compute[75337]: </domain>
Nov 06 15:38:04 user nova-compute[75337]:  {{(pid=75337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 15:38:04 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-85a3dccf-6bd3-423b-963c-1b49593ba32d tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T15:37:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-143035342',display_name='tempest-ServerActionsTestOtherB-server-143035342',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-143035342',id=4,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGvgawdpwOKUFbYuIfCQHAYAwMkYeyGp/mWnvHMxoikCW6rq7Lc9iVzhCxfsvGYfdcuDE3wf7kwN77XNEdHIhKuYJC28UJSD4qJahdz/1x3pQWmM3jC4aksXmnaw21FVfw==',key_name='tempest-keypair-1619039595',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f40165c076e341bba42fb537ce98bbe2',ramdisk_id='',reservation_id='r-w3wq64j4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-464439480',owner_user_name='tempest-ServerActionsTestOtherB-464439480-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T15:37:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2810a15c1608465aa7465eae455eb5c6',uuid=581cf468-65e7-42e5-9250-c3d645577011,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d1c68bac-be37-4645-afcb-2b89f47c1793", "address": "fa:16:3e:00:1c:74", "network": {"id": "2623bcbf-c77c-47b4-abd5-ab538f9a2814", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1497688706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f40165c076e341bba42fb537ce98bbe2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1c68bac-be", "ovs_interfaceid": "d1c68bac-be37-4645-afcb-2b89f47c1793", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 15:38:04 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-85a3dccf-6bd3-423b-963c-1b49593ba32d tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Converting VIF {"id": "d1c68bac-be37-4645-afcb-2b89f47c1793", "address": "fa:16:3e:00:1c:74", "network": {"id": "2623bcbf-c77c-47b4-abd5-ab538f9a2814", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1497688706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f40165c076e341bba42fb537ce98bbe2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1c68bac-be", "ovs_interfaceid": "d1c68bac-be37-4645-afcb-2b89f47c1793", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 15:38:04 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-85a3dccf-6bd3-423b-963c-1b49593ba32d tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:1c:74,bridge_name='br-int',has_traffic_filtering=True,id=d1c68bac-be37-4645-afcb-2b89f47c1793,network=Network(2623bcbf-c77c-47b4-abd5-ab538f9a2814),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1c68bac-be') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 15:38:04 user nova-compute[75337]: DEBUG os_vif [None req-85a3dccf-6bd3-423b-963c-1b49593ba32d tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:1c:74,bridge_name='br-int',has_traffic_filtering=True,id=d1c68bac-be37-4645-afcb-2b89f47c1793,network=Network(2623bcbf-c77c-47b4-abd5-ab538f9a2814),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1c68bac-be') {{(pid=75337) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 15:38:04 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:38:04 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:38:04 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 15:38:04 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:38:04 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c7c8f7f7-a966-5f35-8c9b-6076307a23c7', '_type': 'linux-noop'}}, row=False) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:38:04 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:38:04 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:38:04 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:38:04 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:38:04 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd1c68bac-be, may_exist=True, interface_attrs={}) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:38:04 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd1c68bac-be, col_values=(('qos', UUID('b6f956a3-6706-444c-9205-9ac10f27677b')),), if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:38:04 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd1c68bac-be, col_values=(('external_ids', {'iface-id': 'd1c68bac-be37-4645-afcb-2b89f47c1793', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:00:1c:74', 'vm-uuid': '581cf468-65e7-42e5-9250-c3d645577011'}),), if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:38:04 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:38:04 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:38:04 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:38:04 user nova-compute[75337]: INFO os_vif [None req-85a3dccf-6bd3-423b-963c-1b49593ba32d tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:1c:74,bridge_name='br-int',has_traffic_filtering=True,id=d1c68bac-be37-4645-afcb-2b89f47c1793,network=Network(2623bcbf-c77c-47b4-abd5-ab538f9a2814),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1c68bac-be')
Nov 06 15:38:04 user nova-compute[75337]: DEBUG nova.network.neutron [None req-de8e0a8f-0037-401a-bdef-954826a647d4 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] [instance: 8a600bd8-b94a-4242-a443-c2defb002280] Updating instance_info_cache with network_info: [{"id": "01aa7168-78cd-44e6-8496-08d468f62cfe", "address": "fa:16:3e:f1:25:3e", "network": {"id": "f24470c2-ff6f-49fd-b28f-16b8a87ed3b4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-217486733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed09a1def6f0477796404d9bd3357dd0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01aa7168-78", "ovs_interfaceid": "01aa7168-78cd-44e6-8496-08d468f62cfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:38:04 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-de8e0a8f-0037-401a-bdef-954826a647d4 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Releasing lock "refresh_cache-8a600bd8-b94a-4242-a443-c2defb002280" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 15:38:04 user nova-compute[75337]: DEBUG nova.compute.manager [None req-de8e0a8f-0037-401a-bdef-954826a647d4 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] [instance: 8a600bd8-b94a-4242-a443-c2defb002280] Instance network_info: |[{"id": "01aa7168-78cd-44e6-8496-08d468f62cfe", "address": "fa:16:3e:f1:25:3e", "network": {"id": "f24470c2-ff6f-49fd-b28f-16b8a87ed3b4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-217486733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed09a1def6f0477796404d9bd3357dd0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01aa7168-78", "ovs_interfaceid": "01aa7168-78cd-44e6-8496-08d468f62cfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 15:38:04 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-de8e0a8f-0037-401a-bdef-954826a647d4 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] [instance: 8a600bd8-b94a-4242-a443-c2defb002280] Start _get_guest_xml network_info=[{"id": "01aa7168-78cd-44e6-8496-08d468f62cfe", "address": "fa:16:3e:f1:25:3e", "network": {"id": "f24470c2-ff6f-49fd-b28f-16b8a87ed3b4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-217486733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed09a1def6f0477796404d9bd3357dd0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01aa7168-78", "ovs_interfaceid": "01aa7168-78cd-44e6-8496-08d468f62cfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T15:34:14Z,direct_url=<?>,disk_format='qcow2',id=16b903ae-a40f-41a7-985b-4804cce92c62,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6549a15819f1469bbd5eeae8190e3d44',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T15:34:15Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'guest_format': None, 'size': 0, 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '16b903ae-a40f-41a7-985b-4804cce92c62'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 15:38:04 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-de8e0a8f-0037-401a-bdef-954826a647d4 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 15:38:04 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-de8e0a8f-0037-401a-bdef-954826a647d4 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 15:38:04 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-85a3dccf-6bd3-423b-963c-1b49593ba32d tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] No BDM found with device name vda, not building metadata. {{(pid=75337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 15:38:04 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-85a3dccf-6bd3-423b-963c-1b49593ba32d tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] No VIF found with MAC fa:16:3e:00:1c:74, not building metadata {{(pid=75337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 15:38:04 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-de8e0a8f-0037-401a-bdef-954826a647d4 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 15:38:04 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-de8e0a8f-0037-401a-bdef-954826a647d4 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] CPU controller missing on host. {{(pid=75337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 15:38:04 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-de8e0a8f-0037-401a-bdef-954826a647d4 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 15:38:04 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-de8e0a8f-0037-401a-bdef-954826a647d4 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] CPU controller found on host. {{(pid=75337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 15:38:04 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-de8e0a8f-0037-401a-bdef-954826a647d4 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75337) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 15:38:04 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-de8e0a8f-0037-401a-bdef-954826a647d4 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T15:34:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T15:34:14Z,direct_url=<?>,disk_format='qcow2',id=16b903ae-a40f-41a7-985b-4804cce92c62,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6549a15819f1469bbd5eeae8190e3d44',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T15:34:15Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 15:38:04 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-de8e0a8f-0037-401a-bdef-954826a647d4 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Flavor limits 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 15:38:04 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-de8e0a8f-0037-401a-bdef-954826a647d4 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Image limits 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 15:38:04 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-de8e0a8f-0037-401a-bdef-954826a647d4 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Flavor pref 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 15:38:04 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-de8e0a8f-0037-401a-bdef-954826a647d4 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Image pref 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 15:38:04 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-de8e0a8f-0037-401a-bdef-954826a647d4 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 15:38:04 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-de8e0a8f-0037-401a-bdef-954826a647d4 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 15:38:04 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-de8e0a8f-0037-401a-bdef-954826a647d4 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 15:38:04 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-de8e0a8f-0037-401a-bdef-954826a647d4 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Got 1 possible topologies {{(pid=75337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 15:38:04 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-de8e0a8f-0037-401a-bdef-954826a647d4 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 15:38:04 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-de8e0a8f-0037-401a-bdef-954826a647d4 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 15:38:04 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-de8e0a8f-0037-401a-bdef-954826a647d4 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T15:37:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1664848086',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1664848086',id=5,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC0FniBLNu9YJVY4Z8IGuBWVqyZPytkJWiSZMci+GzSs1MwK9lb3C3ke0n2MIwR14vwCuigfmGIf66GQZ9tJlOwMOS19unmyr2FElzX/8lOCboMN5SHwokzc4XAnJBg1jA==',key_name='tempest-keypair-1277258187',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ed09a1def6f0477796404d9bd3357dd0',ramdisk_id='',reservation_id='r-4kx37btu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-417383725',owner_user_name='tempest-AttachVolumeShelveTestJSON-417383725-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T15:37:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9e1c021de4da40518ddc45a57ef79d6f',uuid=8a600bd8-b94a-4242-a443-c2defb002280,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "01aa7168-78cd-44e6-8496-08d468f62cfe", "address": "fa:16:3e:f1:25:3e", "network": {"id": "f24470c2-ff6f-49fd-b28f-16b8a87ed3b4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-217486733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed09a1def6f0477796404d9bd3357dd0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01aa7168-78", "ovs_interfaceid": "01aa7168-78cd-44e6-8496-08d468f62cfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75337) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 15:38:04 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-de8e0a8f-0037-401a-bdef-954826a647d4 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Converting VIF {"id": "01aa7168-78cd-44e6-8496-08d468f62cfe", "address": "fa:16:3e:f1:25:3e", "network": {"id": "f24470c2-ff6f-49fd-b28f-16b8a87ed3b4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-217486733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed09a1def6f0477796404d9bd3357dd0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01aa7168-78", "ovs_interfaceid": "01aa7168-78cd-44e6-8496-08d468f62cfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 15:38:04 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-de8e0a8f-0037-401a-bdef-954826a647d4 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:25:3e,bridge_name='br-int',has_traffic_filtering=True,id=01aa7168-78cd-44e6-8496-08d468f62cfe,network=Network(f24470c2-ff6f-49fd-b28f-16b8a87ed3b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01aa7168-78') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 15:38:04 user nova-compute[75337]: DEBUG nova.objects.instance [None req-de8e0a8f-0037-401a-bdef-954826a647d4 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Lazy-loading 'pci_devices' on Instance uuid 8a600bd8-b94a-4242-a443-c2defb002280 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 15:38:04 user nova-compute[75337]: DEBUG nova.network.neutron [req-96aab58a-2395-49b6-b3e9-1f32c9c7aa64 req-e298c69d-39e2-46ad-ad6c-4a44470780b9 service nova] [instance: c8cf1ead-a87c-459c-b914-a0e976c9e464] Updated VIF entry in instance network info cache for port b33373f6-0289-4623-90ac-f5c3db0d3681. {{(pid=75337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 15:38:04 user nova-compute[75337]: DEBUG nova.network.neutron [req-96aab58a-2395-49b6-b3e9-1f32c9c7aa64 req-e298c69d-39e2-46ad-ad6c-4a44470780b9 service nova] [instance: c8cf1ead-a87c-459c-b914-a0e976c9e464] Updating instance_info_cache with network_info: [{"id": "b33373f6-0289-4623-90ac-f5c3db0d3681", "address": "fa:16:3e:37:16:66", "network": {"id": "a839a9d1-fdf3-4a72-898b-6829ceef2055", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1927950273-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86f4b41336384a53a3fd22caa0fe8e6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb33373f6-02", "ovs_interfaceid": "b33373f6-0289-4623-90ac-f5c3db0d3681", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:38:04 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-de8e0a8f-0037-401a-bdef-954826a647d4 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] [instance: 8a600bd8-b94a-4242-a443-c2defb002280] End _get_guest_xml xml=<domain type="kvm">
Nov 06 15:38:04 user nova-compute[75337]:   <uuid>8a600bd8-b94a-4242-a443-c2defb002280</uuid>
Nov 06 15:38:04 user nova-compute[75337]:   <name>instance-00000005</name>
Nov 06 15:38:04 user nova-compute[75337]:   <memory>524288</memory>
Nov 06 15:38:04 user nova-compute[75337]:   <vcpu>1</vcpu>
Nov 06 15:38:04 user nova-compute[75337]:   <metadata>
Nov 06 15:38:04 user nova-compute[75337]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 15:38:04 user nova-compute[75337]:       <nova:package version="0.0.0"/>
Nov 06 15:38:04 user nova-compute[75337]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1664848086</nova:name>
Nov 06 15:38:04 user nova-compute[75337]:       <nova:creationTime>2023-11-06 15:38:04</nova:creationTime>
Nov 06 15:38:04 user nova-compute[75337]:       <nova:flavor name="m1.tiny">
Nov 06 15:38:04 user nova-compute[75337]:         <nova:memory>512</nova:memory>
Nov 06 15:38:04 user nova-compute[75337]:         <nova:disk>1</nova:disk>
Nov 06 15:38:04 user nova-compute[75337]:         <nova:swap>0</nova:swap>
Nov 06 15:38:04 user nova-compute[75337]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 15:38:04 user nova-compute[75337]:         <nova:vcpus>1</nova:vcpus>
Nov 06 15:38:04 user nova-compute[75337]:       </nova:flavor>
Nov 06 15:38:04 user nova-compute[75337]:       <nova:owner>
Nov 06 15:38:04 user nova-compute[75337]:         <nova:user uuid="9e1c021de4da40518ddc45a57ef79d6f">tempest-AttachVolumeShelveTestJSON-417383725-project-member</nova:user>
Nov 06 15:38:04 user nova-compute[75337]:         <nova:project uuid="ed09a1def6f0477796404d9bd3357dd0">tempest-AttachVolumeShelveTestJSON-417383725</nova:project>
Nov 06 15:38:04 user nova-compute[75337]:       </nova:owner>
Nov 06 15:38:04 user nova-compute[75337]:       <nova:root type="image" uuid="16b903ae-a40f-41a7-985b-4804cce92c62"/>
Nov 06 15:38:04 user nova-compute[75337]:       <nova:ports>
Nov 06 15:38:04 user nova-compute[75337]:         <nova:port uuid="01aa7168-78cd-44e6-8496-08d468f62cfe">
Nov 06 15:38:04 user nova-compute[75337]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 06 15:38:04 user nova-compute[75337]:         </nova:port>
Nov 06 15:38:04 user nova-compute[75337]:       </nova:ports>
Nov 06 15:38:04 user nova-compute[75337]:     </nova:instance>
Nov 06 15:38:04 user nova-compute[75337]:   </metadata>
Nov 06 15:38:04 user nova-compute[75337]:   <sysinfo type="smbios">
Nov 06 15:38:04 user nova-compute[75337]:     <system>
Nov 06 15:38:04 user nova-compute[75337]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 15:38:04 user nova-compute[75337]:       <entry name="product">OpenStack Nova</entry>
Nov 06 15:38:04 user nova-compute[75337]:       <entry name="version">0.0.0</entry>
Nov 06 15:38:04 user nova-compute[75337]:       <entry name="serial">8a600bd8-b94a-4242-a443-c2defb002280</entry>
Nov 06 15:38:04 user nova-compute[75337]:       <entry name="uuid">8a600bd8-b94a-4242-a443-c2defb002280</entry>
Nov 06 15:38:04 user nova-compute[75337]:       <entry name="family">Virtual Machine</entry>
Nov 06 15:38:04 user nova-compute[75337]:     </system>
Nov 06 15:38:04 user nova-compute[75337]:   </sysinfo>
Nov 06 15:38:04 user nova-compute[75337]:   <os>
Nov 06 15:38:04 user nova-compute[75337]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 15:38:04 user nova-compute[75337]:     <boot dev="hd"/>
Nov 06 15:38:04 user nova-compute[75337]:     <smbios mode="sysinfo"/>
Nov 06 15:38:04 user nova-compute[75337]:   </os>
Nov 06 15:38:04 user nova-compute[75337]:   <features>
Nov 06 15:38:04 user nova-compute[75337]:     <acpi/>
Nov 06 15:38:04 user nova-compute[75337]:     <apic/>
Nov 06 15:38:04 user nova-compute[75337]:     <vmcoreinfo/>
Nov 06 15:38:04 user nova-compute[75337]:   </features>
Nov 06 15:38:04 user nova-compute[75337]:   <clock offset="utc">
Nov 06 15:38:04 user nova-compute[75337]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 15:38:04 user nova-compute[75337]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 15:38:04 user nova-compute[75337]:     <timer name="hpet" present="no"/>
Nov 06 15:38:04 user nova-compute[75337]:   </clock>
Nov 06 15:38:04 user nova-compute[75337]:   <cpu mode="custom" match="exact">
Nov 06 15:38:04 user nova-compute[75337]:     <model>Nehalem</model>
Nov 06 15:38:04 user nova-compute[75337]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 15:38:04 user nova-compute[75337]:   </cpu>
Nov 06 15:38:04 user nova-compute[75337]:   <devices>
Nov 06 15:38:04 user nova-compute[75337]:     <disk type="file" device="disk">
Nov 06 15:38:04 user nova-compute[75337]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 15:38:04 user nova-compute[75337]:       <source file="/opt/stack/data/nova/instances/8a600bd8-b94a-4242-a443-c2defb002280/disk"/>
Nov 06 15:38:04 user nova-compute[75337]:       <target dev="vda" bus="virtio"/>
Nov 06 15:38:04 user nova-compute[75337]:     </disk>
Nov 06 15:38:04 user nova-compute[75337]:     <interface type="ethernet">
Nov 06 15:38:04 user nova-compute[75337]:       <mac address="fa:16:3e:f1:25:3e"/>
Nov 06 15:38:04 user nova-compute[75337]:       <model type="virtio"/>
Nov 06 15:38:04 user nova-compute[75337]:       <mtu size="1442"/>
Nov 06 15:38:04 user nova-compute[75337]:       <target dev="tap01aa7168-78"/>
Nov 06 15:38:04 user nova-compute[75337]:     </interface>
Nov 06 15:38:04 user nova-compute[75337]:     <serial type="pty">
Nov 06 15:38:04 user nova-compute[75337]:       <log file="/opt/stack/data/nova/instances/8a600bd8-b94a-4242-a443-c2defb002280/console.log" append="off"/>
Nov 06 15:38:04 user nova-compute[75337]:     </serial>
Nov 06 15:38:04 user nova-compute[75337]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 15:38:04 user nova-compute[75337]:     <video>
Nov 06 15:38:04 user nova-compute[75337]:       <model type="virtio"/>
Nov 06 15:38:04 user nova-compute[75337]:     </video>
Nov 06 15:38:04 user nova-compute[75337]:     <rng model="virtio">
Nov 06 15:38:04 user nova-compute[75337]:       <backend model="random">/dev/urandom</backend>
Nov 06 15:38:04 user nova-compute[75337]:     </rng>
Nov 06 15:38:04 user nova-compute[75337]:     <controller type="usb" index="0" model="none"/>
Nov 06 15:38:04 user nova-compute[75337]:     <memballoon model="virtio">
Nov 06 15:38:04 user nova-compute[75337]:       <stats period="10"/>
Nov 06 15:38:04 user nova-compute[75337]:     </memballoon>
Nov 06 15:38:04 user nova-compute[75337]:   </devices>
Nov 06 15:38:04 user nova-compute[75337]: </domain>
Nov 06 15:38:04 user nova-compute[75337]:  {{(pid=75337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 15:38:04 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-de8e0a8f-0037-401a-bdef-954826a647d4 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T15:37:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1664848086',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1664848086',id=5,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC0FniBLNu9YJVY4Z8IGuBWVqyZPytkJWiSZMci+GzSs1MwK9lb3C3ke0n2MIwR14vwCuigfmGIf66GQZ9tJlOwMOS19unmyr2FElzX/8lOCboMN5SHwokzc4XAnJBg1jA==',key_name='tempest-keypair-1277258187',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ed09a1def6f0477796404d9bd3357dd0',ramdisk_id='',reservation_id='r-4kx37btu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-417383725',owner_user_name='tempest-AttachVolumeShelveTestJSON-417383725-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T15:37:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9e1c021de4da40518ddc45a57ef79d6f',uuid=8a600bd8-b94a-4242-a443-c2defb002280,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "01aa7168-78cd-44e6-8496-08d468f62cfe", "address": "fa:16:3e:f1:25:3e", "network": {"id": "f24470c2-ff6f-49fd-b28f-16b8a87ed3b4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-217486733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed09a1def6f0477796404d9bd3357dd0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01aa7168-78", "ovs_interfaceid": "01aa7168-78cd-44e6-8496-08d468f62cfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 15:38:04 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-de8e0a8f-0037-401a-bdef-954826a647d4 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Converting VIF {"id": "01aa7168-78cd-44e6-8496-08d468f62cfe", "address": "fa:16:3e:f1:25:3e", "network": {"id": "f24470c2-ff6f-49fd-b28f-16b8a87ed3b4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-217486733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed09a1def6f0477796404d9bd3357dd0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01aa7168-78", "ovs_interfaceid": "01aa7168-78cd-44e6-8496-08d468f62cfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 15:38:04 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-de8e0a8f-0037-401a-bdef-954826a647d4 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:25:3e,bridge_name='br-int',has_traffic_filtering=True,id=01aa7168-78cd-44e6-8496-08d468f62cfe,network=Network(f24470c2-ff6f-49fd-b28f-16b8a87ed3b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01aa7168-78') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 15:38:04 user nova-compute[75337]: DEBUG os_vif [None req-de8e0a8f-0037-401a-bdef-954826a647d4 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:25:3e,bridge_name='br-int',has_traffic_filtering=True,id=01aa7168-78cd-44e6-8496-08d468f62cfe,network=Network(f24470c2-ff6f-49fd-b28f-16b8a87ed3b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01aa7168-78') {{(pid=75337) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 15:38:04 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:38:04 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:38:04 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 15:38:04 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-96aab58a-2395-49b6-b3e9-1f32c9c7aa64 req-e298c69d-39e2-46ad-ad6c-4a44470780b9 service nova] Releasing lock "refresh_cache-c8cf1ead-a87c-459c-b914-a0e976c9e464" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 15:38:04 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:38:04 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c1f8d2fe-3b7b-5a9c-a24f-6ba1913d4ec2', '_type': 'linux-noop'}}, row=False) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:38:04 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:38:04 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:38:04 user nova-compute[75337]: DEBUG nova.compute.manager [req-538d4669-feac-4530-ad5c-f8289777a4dd req-cf2b0e9a-efad-451b-9420-b327e2bc5440 service nova] [instance: 8a600bd8-b94a-4242-a443-c2defb002280] Received event network-changed-01aa7168-78cd-44e6-8496-08d468f62cfe {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:38:04 user nova-compute[75337]: DEBUG nova.compute.manager [req-538d4669-feac-4530-ad5c-f8289777a4dd req-cf2b0e9a-efad-451b-9420-b327e2bc5440 service nova] [instance: 8a600bd8-b94a-4242-a443-c2defb002280] Refreshing instance network info cache due to event network-changed-01aa7168-78cd-44e6-8496-08d468f62cfe. {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 15:38:04 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-538d4669-feac-4530-ad5c-f8289777a4dd req-cf2b0e9a-efad-451b-9420-b327e2bc5440 service nova] Acquiring lock "refresh_cache-8a600bd8-b94a-4242-a443-c2defb002280" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 15:38:04 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-538d4669-feac-4530-ad5c-f8289777a4dd req-cf2b0e9a-efad-451b-9420-b327e2bc5440 service nova] Acquired lock "refresh_cache-8a600bd8-b94a-4242-a443-c2defb002280" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 15:38:04 user nova-compute[75337]: DEBUG nova.network.neutron [req-538d4669-feac-4530-ad5c-f8289777a4dd req-cf2b0e9a-efad-451b-9420-b327e2bc5440 service nova] [instance: 8a600bd8-b94a-4242-a443-c2defb002280] Refreshing network info cache for port 01aa7168-78cd-44e6-8496-08d468f62cfe {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 15:38:04 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:38:04 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:38:04 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap01aa7168-78, may_exist=True, interface_attrs={}) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:38:04 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap01aa7168-78, col_values=(('qos', UUID('84b68102-6714-48f9-b4e8-c2f4c6d4a192')),), if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:38:04 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap01aa7168-78, col_values=(('external_ids', {'iface-id': '01aa7168-78cd-44e6-8496-08d468f62cfe', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f1:25:3e', 'vm-uuid': '8a600bd8-b94a-4242-a443-c2defb002280'}),), if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:38:04 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:38:04 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:38:04 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:38:04 user nova-compute[75337]: INFO os_vif [None req-de8e0a8f-0037-401a-bdef-954826a647d4 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:25:3e,bridge_name='br-int',has_traffic_filtering=True,id=01aa7168-78cd-44e6-8496-08d468f62cfe,network=Network(f24470c2-ff6f-49fd-b28f-16b8a87ed3b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01aa7168-78')
Nov 06 15:38:04 user nova-compute[75337]: DEBUG nova.network.neutron [None req-2c2d9eec-5e43-48a3-8c5c-46fb52f23c04 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] [instance: dfadb21f-5ed1-42f4-956b-95cccf128b6a] Successfully updated port: 8592b366-9f21-4d92-b297-8872d9a7110f {{(pid=75337) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 15:38:04 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-de8e0a8f-0037-401a-bdef-954826a647d4 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] No BDM found with device name vda, not building metadata. {{(pid=75337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 15:38:04 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-de8e0a8f-0037-401a-bdef-954826a647d4 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] No VIF found with MAC fa:16:3e:f1:25:3e, not building metadata {{(pid=75337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 15:38:04 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-2c2d9eec-5e43-48a3-8c5c-46fb52f23c04 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Acquiring lock "refresh_cache-dfadb21f-5ed1-42f4-956b-95cccf128b6a" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 15:38:04 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-2c2d9eec-5e43-48a3-8c5c-46fb52f23c04 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Acquired lock "refresh_cache-dfadb21f-5ed1-42f4-956b-95cccf128b6a" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 15:38:04 user nova-compute[75337]: DEBUG nova.network.neutron [None req-2c2d9eec-5e43-48a3-8c5c-46fb52f23c04 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] [instance: dfadb21f-5ed1-42f4-956b-95cccf128b6a] Building network info cache for instance {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 15:38:04 user nova-compute[75337]: DEBUG nova.network.neutron [None req-2c2d9eec-5e43-48a3-8c5c-46fb52f23c04 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] [instance: dfadb21f-5ed1-42f4-956b-95cccf128b6a] Instance cache missing network info. {{(pid=75337) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 15:38:05 user nova-compute[75337]: DEBUG nova.network.neutron [None req-2c2d9eec-5e43-48a3-8c5c-46fb52f23c04 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] [instance: dfadb21f-5ed1-42f4-956b-95cccf128b6a] Updating instance_info_cache with network_info: [{"id": "8592b366-9f21-4d92-b297-8872d9a7110f", "address": "fa:16:3e:f8:26:1d", "network": {"id": "48f1545d-7e80-462f-9dbf-f1102ddcda9a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1210368397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1013e7afbefd4146a3be04587710b1de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8592b366-9f", "ovs_interfaceid": "8592b366-9f21-4d92-b297-8872d9a7110f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:38:05 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-2c2d9eec-5e43-48a3-8c5c-46fb52f23c04 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Releasing lock "refresh_cache-dfadb21f-5ed1-42f4-956b-95cccf128b6a" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 15:38:05 user nova-compute[75337]: DEBUG nova.compute.manager [None req-2c2d9eec-5e43-48a3-8c5c-46fb52f23c04 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] [instance: dfadb21f-5ed1-42f4-956b-95cccf128b6a] Instance network_info: |[{"id": "8592b366-9f21-4d92-b297-8872d9a7110f", "address": "fa:16:3e:f8:26:1d", "network": {"id": "48f1545d-7e80-462f-9dbf-f1102ddcda9a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1210368397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1013e7afbefd4146a3be04587710b1de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8592b366-9f", "ovs_interfaceid": "8592b366-9f21-4d92-b297-8872d9a7110f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 15:38:05 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-2c2d9eec-5e43-48a3-8c5c-46fb52f23c04 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] [instance: dfadb21f-5ed1-42f4-956b-95cccf128b6a] Start _get_guest_xml network_info=[{"id": "8592b366-9f21-4d92-b297-8872d9a7110f", "address": "fa:16:3e:f8:26:1d", "network": {"id": "48f1545d-7e80-462f-9dbf-f1102ddcda9a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1210368397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1013e7afbefd4146a3be04587710b1de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8592b366-9f", "ovs_interfaceid": "8592b366-9f21-4d92-b297-8872d9a7110f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T15:34:14Z,direct_url=<?>,disk_format='qcow2',id=16b903ae-a40f-41a7-985b-4804cce92c62,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6549a15819f1469bbd5eeae8190e3d44',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T15:34:15Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'guest_format': None, 'size': 0, 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '16b903ae-a40f-41a7-985b-4804cce92c62'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 15:38:05 user nova-compute[75337]: DEBUG nova.network.neutron [req-538d4669-feac-4530-ad5c-f8289777a4dd req-cf2b0e9a-efad-451b-9420-b327e2bc5440 service nova] [instance: 8a600bd8-b94a-4242-a443-c2defb002280] Updated VIF entry in instance network info cache for port 01aa7168-78cd-44e6-8496-08d468f62cfe. {{(pid=75337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 15:38:05 user nova-compute[75337]: DEBUG nova.network.neutron [req-538d4669-feac-4530-ad5c-f8289777a4dd req-cf2b0e9a-efad-451b-9420-b327e2bc5440 service nova] [instance: 8a600bd8-b94a-4242-a443-c2defb002280] Updating instance_info_cache with network_info: [{"id": "01aa7168-78cd-44e6-8496-08d468f62cfe", "address": "fa:16:3e:f1:25:3e", "network": {"id": "f24470c2-ff6f-49fd-b28f-16b8a87ed3b4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-217486733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed09a1def6f0477796404d9bd3357dd0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01aa7168-78", "ovs_interfaceid": "01aa7168-78cd-44e6-8496-08d468f62cfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:38:05 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-538d4669-feac-4530-ad5c-f8289777a4dd req-cf2b0e9a-efad-451b-9420-b327e2bc5440 service nova] Releasing lock "refresh_cache-8a600bd8-b94a-4242-a443-c2defb002280" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 15:38:05 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:38:06 user nova-compute[75337]: DEBUG nova.network.neutron [req-7fdaffb1-7bfb-465d-9c45-9c8f91d129fa req-b48dfd58-4697-4f20-9e42-16666758e796 service nova] [instance: 581cf468-65e7-42e5-9250-c3d645577011] Updated VIF entry in instance network info cache for port d1c68bac-be37-4645-afcb-2b89f47c1793. {{(pid=75337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 15:38:06 user nova-compute[75337]: DEBUG nova.network.neutron [req-7fdaffb1-7bfb-465d-9c45-9c8f91d129fa req-b48dfd58-4697-4f20-9e42-16666758e796 service nova] [instance: 581cf468-65e7-42e5-9250-c3d645577011] Updating instance_info_cache with network_info: [{"id": "d1c68bac-be37-4645-afcb-2b89f47c1793", "address": "fa:16:3e:00:1c:74", "network": {"id": "2623bcbf-c77c-47b4-abd5-ab538f9a2814", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1497688706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f40165c076e341bba42fb537ce98bbe2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1c68bac-be", "ovs_interfaceid": "d1c68bac-be37-4645-afcb-2b89f47c1793", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:38:06 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:38:06 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-7fdaffb1-7bfb-465d-9c45-9c8f91d129fa req-b48dfd58-4697-4f20-9e42-16666758e796 service nova] Releasing lock "refresh_cache-581cf468-65e7-42e5-9250-c3d645577011" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 15:38:06 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:38:06 user nova-compute[75337]: DEBUG nova.compute.manager [req-37a3e741-ae66-4905-83c6-da2058a29af3 req-263f2f02-52f4-4d30-8780-64145648064a service nova] [instance: dfadb21f-5ed1-42f4-956b-95cccf128b6a] Received event network-changed-8592b366-9f21-4d92-b297-8872d9a7110f {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:38:06 user nova-compute[75337]: DEBUG nova.compute.manager [req-37a3e741-ae66-4905-83c6-da2058a29af3 req-263f2f02-52f4-4d30-8780-64145648064a service nova] [instance: dfadb21f-5ed1-42f4-956b-95cccf128b6a] Refreshing instance network info cache due to event network-changed-8592b366-9f21-4d92-b297-8872d9a7110f. {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 15:38:06 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-37a3e741-ae66-4905-83c6-da2058a29af3 req-263f2f02-52f4-4d30-8780-64145648064a service nova] Acquiring lock "refresh_cache-dfadb21f-5ed1-42f4-956b-95cccf128b6a" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 15:38:06 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-37a3e741-ae66-4905-83c6-da2058a29af3 req-263f2f02-52f4-4d30-8780-64145648064a service nova] Acquired lock "refresh_cache-dfadb21f-5ed1-42f4-956b-95cccf128b6a" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 15:38:06 user nova-compute[75337]: DEBUG nova.network.neutron [req-37a3e741-ae66-4905-83c6-da2058a29af3 req-263f2f02-52f4-4d30-8780-64145648064a service nova] [instance: dfadb21f-5ed1-42f4-956b-95cccf128b6a] Refreshing network info cache for port 8592b366-9f21-4d92-b297-8872d9a7110f {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 15:38:07 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:38:08 user nova-compute[75337]: DEBUG nova.network.neutron [req-37a3e741-ae66-4905-83c6-da2058a29af3 req-263f2f02-52f4-4d30-8780-64145648064a service nova] [instance: dfadb21f-5ed1-42f4-956b-95cccf128b6a] Updated VIF entry in instance network info cache for port 8592b366-9f21-4d92-b297-8872d9a7110f. {{(pid=75337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 15:38:08 user nova-compute[75337]: DEBUG nova.network.neutron [req-37a3e741-ae66-4905-83c6-da2058a29af3 req-263f2f02-52f4-4d30-8780-64145648064a service nova] [instance: dfadb21f-5ed1-42f4-956b-95cccf128b6a] Updating instance_info_cache with network_info: [{"id": "8592b366-9f21-4d92-b297-8872d9a7110f", "address": "fa:16:3e:f8:26:1d", "network": {"id": "48f1545d-7e80-462f-9dbf-f1102ddcda9a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1210368397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1013e7afbefd4146a3be04587710b1de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8592b366-9f", "ovs_interfaceid": "8592b366-9f21-4d92-b297-8872d9a7110f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:38:08 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-37a3e741-ae66-4905-83c6-da2058a29af3 req-263f2f02-52f4-4d30-8780-64145648064a service nova] Releasing lock "refresh_cache-dfadb21f-5ed1-42f4-956b-95cccf128b6a" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 15:38:08 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:38:08 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:38:08 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:38:09 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:38:09 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:38:09 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:38:09 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:38:09 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:38:09 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:38:09 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:38:09 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:38:09 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:38:09 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:38:10 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:38:10 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:38:10 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:38:10 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:38:10 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:38:11 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:38:11 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:38:12 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:38:13 user nova-compute[75337]: DEBUG nova.compute.manager [None req-1fb51d76-ace3-4cae-bd21-10fb29d2c2fc tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] [instance: 5f5fc58d-f946-4df0-b8d0-1aefbf0f8cd6] Instance event wait completed in 0 seconds for  {{(pid=75337) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 15:38:13 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-1fb51d76-ace3-4cae-bd21-10fb29d2c2fc tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] [instance: 5f5fc58d-f946-4df0-b8d0-1aefbf0f8cd6] Guest created on hypervisor {{(pid=75337) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 15:38:13 user nova-compute[75337]: DEBUG nova.compute.manager [None req-8ec9b84c-44ef-4746-b7cb-3670a5acf87d tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] [instance: c8cf1ead-a87c-459c-b914-a0e976c9e464] Instance event wait completed in 0 seconds for  {{(pid=75337) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 15:38:13 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-8ec9b84c-44ef-4746-b7cb-3670a5acf87d tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] [instance: c8cf1ead-a87c-459c-b914-a0e976c9e464] Guest created on hypervisor {{(pid=75337) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 15:38:13 user nova-compute[75337]: INFO nova.virt.libvirt.driver [-] [instance: 5f5fc58d-f946-4df0-b8d0-1aefbf0f8cd6] Instance spawned successfully.
Nov 06 15:38:13 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-1fb51d76-ace3-4cae-bd21-10fb29d2c2fc tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] [instance: 5f5fc58d-f946-4df0-b8d0-1aefbf0f8cd6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 15:38:13 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-2c2d9eec-5e43-48a3-8c5c-46fb52f23c04 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 15:38:13 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-2c2d9eec-5e43-48a3-8c5c-46fb52f23c04 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 15:38:13 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-2c2d9eec-5e43-48a3-8c5c-46fb52f23c04 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 15:38:13 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-2c2d9eec-5e43-48a3-8c5c-46fb52f23c04 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] CPU controller missing on host. {{(pid=75337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 15:38:13 user nova-compute[75337]: INFO nova.virt.libvirt.driver [-] [instance: c8cf1ead-a87c-459c-b914-a0e976c9e464] Instance spawned successfully.
Nov 06 15:38:13 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-8ec9b84c-44ef-4746-b7cb-3670a5acf87d tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] [instance: c8cf1ead-a87c-459c-b914-a0e976c9e464] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 15:38:13 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-2c2d9eec-5e43-48a3-8c5c-46fb52f23c04 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 15:38:13 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-2c2d9eec-5e43-48a3-8c5c-46fb52f23c04 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] CPU controller found on host. {{(pid=75337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 15:38:13 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-2c2d9eec-5e43-48a3-8c5c-46fb52f23c04 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75337) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 15:38:13 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-2c2d9eec-5e43-48a3-8c5c-46fb52f23c04 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T15:34:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T15:34:14Z,direct_url=<?>,disk_format='qcow2',id=16b903ae-a40f-41a7-985b-4804cce92c62,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6549a15819f1469bbd5eeae8190e3d44',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T15:34:15Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 15:38:13 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-2c2d9eec-5e43-48a3-8c5c-46fb52f23c04 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Flavor limits 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 15:38:13 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-2c2d9eec-5e43-48a3-8c5c-46fb52f23c04 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Image limits 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 15:38:13 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-2c2d9eec-5e43-48a3-8c5c-46fb52f23c04 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Flavor pref 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 15:38:13 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-2c2d9eec-5e43-48a3-8c5c-46fb52f23c04 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Image pref 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 15:38:13 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-2c2d9eec-5e43-48a3-8c5c-46fb52f23c04 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 15:38:13 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-2c2d9eec-5e43-48a3-8c5c-46fb52f23c04 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 15:38:13 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-2c2d9eec-5e43-48a3-8c5c-46fb52f23c04 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 15:38:13 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-2c2d9eec-5e43-48a3-8c5c-46fb52f23c04 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Got 1 possible topologies {{(pid=75337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 15:38:13 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-2c2d9eec-5e43-48a3-8c5c-46fb52f23c04 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 15:38:13 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-2c2d9eec-5e43-48a3-8c5c-46fb52f23c04 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 15:38:13 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-2c2d9eec-5e43-48a3-8c5c-46fb52f23c04 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T15:38:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1414083334',display_name='tempest-AttachVolumeNegativeTest-server-1414083334',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1414083334',id=6,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMM52JwCKgpkbgioUGMI0NI1B2YA6YCTZsHJyf9K8op+p9kwd0OG2YGfA8GNNGZDP2ZRZZV08pLVyNzsHr61PQwYkHr5Edy24Jllzi1i8a7jhx9bnOvb3N/DgbyCjt6ADA==',key_name='tempest-keypair-1468084483',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1013e7afbefd4146a3be04587710b1de',ramdisk_id='',reservation_id='r-f2mxi13h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1104237961',owner_user_name='tempest-AttachVolumeNegativeTest-1104237961-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T15:38:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aeeea58fcd3e4217a34a4a38be6adf30',uuid=dfadb21f-5ed1-42f4-956b-95cccf128b6a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8592b366-9f21-4d92-b297-8872d9a7110f", "address": "fa:16:3e:f8:26:1d", "network": {"id": "48f1545d-7e80-462f-9dbf-f1102ddcda9a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1210368397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1013e7afbefd4146a3be04587710b1de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8592b366-9f", "ovs_interfaceid": "8592b366-9f21-4d92-b297-8872d9a7110f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75337) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 15:38:13 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-2c2d9eec-5e43-48a3-8c5c-46fb52f23c04 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Converting VIF {"id": "8592b366-9f21-4d92-b297-8872d9a7110f", "address": "fa:16:3e:f8:26:1d", "network": {"id": "48f1545d-7e80-462f-9dbf-f1102ddcda9a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1210368397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1013e7afbefd4146a3be04587710b1de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8592b366-9f", "ovs_interfaceid": "8592b366-9f21-4d92-b297-8872d9a7110f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 15:38:13 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-2c2d9eec-5e43-48a3-8c5c-46fb52f23c04 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:26:1d,bridge_name='br-int',has_traffic_filtering=True,id=8592b366-9f21-4d92-b297-8872d9a7110f,network=Network(48f1545d-7e80-462f-9dbf-f1102ddcda9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8592b366-9f') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 15:38:13 user nova-compute[75337]: DEBUG nova.objects.instance [None req-2c2d9eec-5e43-48a3-8c5c-46fb52f23c04 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Lazy-loading 'pci_devices' on Instance uuid dfadb21f-5ed1-42f4-956b-95cccf128b6a {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 15:38:13 user nova-compute[75337]: DEBUG nova.compute.manager [None req-85a3dccf-6bd3-423b-963c-1b49593ba32d tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] [instance: 581cf468-65e7-42e5-9250-c3d645577011] Instance event wait completed in 0 seconds for  {{(pid=75337) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 15:38:13 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-85a3dccf-6bd3-423b-963c-1b49593ba32d tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] [instance: 581cf468-65e7-42e5-9250-c3d645577011] Guest created on hypervisor {{(pid=75337) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 15:38:13 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-1fb51d76-ace3-4cae-bd21-10fb29d2c2fc tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] [instance: 5f5fc58d-f946-4df0-b8d0-1aefbf0f8cd6] Found default for hw_cdrom_bus of ide {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:38:13 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-1fb51d76-ace3-4cae-bd21-10fb29d2c2fc tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] [instance: 5f5fc58d-f946-4df0-b8d0-1aefbf0f8cd6] Found default for hw_disk_bus of virtio {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:38:13 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-1fb51d76-ace3-4cae-bd21-10fb29d2c2fc tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] [instance: 5f5fc58d-f946-4df0-b8d0-1aefbf0f8cd6] Found default for hw_input_bus of None {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:38:13 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-1fb51d76-ace3-4cae-bd21-10fb29d2c2fc tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] [instance: 5f5fc58d-f946-4df0-b8d0-1aefbf0f8cd6] Found default for hw_pointer_model of None {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:38:13 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-1fb51d76-ace3-4cae-bd21-10fb29d2c2fc tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] [instance: 5f5fc58d-f946-4df0-b8d0-1aefbf0f8cd6] Found default for hw_video_model of virtio {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:38:13 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-1fb51d76-ace3-4cae-bd21-10fb29d2c2fc tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] [instance: 5f5fc58d-f946-4df0-b8d0-1aefbf0f8cd6] Found default for hw_vif_model of virtio {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:38:13 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-8ec9b84c-44ef-4746-b7cb-3670a5acf87d tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] [instance: c8cf1ead-a87c-459c-b914-a0e976c9e464] Found default for hw_cdrom_bus of ide {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:38:13 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-8ec9b84c-44ef-4746-b7cb-3670a5acf87d tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] [instance: c8cf1ead-a87c-459c-b914-a0e976c9e464] Found default for hw_disk_bus of virtio {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:38:13 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-8ec9b84c-44ef-4746-b7cb-3670a5acf87d tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] [instance: c8cf1ead-a87c-459c-b914-a0e976c9e464] Found default for hw_input_bus of None {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:38:13 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-8ec9b84c-44ef-4746-b7cb-3670a5acf87d tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] [instance: c8cf1ead-a87c-459c-b914-a0e976c9e464] Found default for hw_pointer_model of None {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:38:13 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-8ec9b84c-44ef-4746-b7cb-3670a5acf87d tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] [instance: c8cf1ead-a87c-459c-b914-a0e976c9e464] Found default for hw_video_model of virtio {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:38:13 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-8ec9b84c-44ef-4746-b7cb-3670a5acf87d tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] [instance: c8cf1ead-a87c-459c-b914-a0e976c9e464] Found default for hw_vif_model of virtio {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:38:13 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-2c2d9eec-5e43-48a3-8c5c-46fb52f23c04 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] [instance: dfadb21f-5ed1-42f4-956b-95cccf128b6a] End _get_guest_xml xml=<domain type="kvm">
Nov 06 15:38:13 user nova-compute[75337]:   <uuid>dfadb21f-5ed1-42f4-956b-95cccf128b6a</uuid>
Nov 06 15:38:13 user nova-compute[75337]:   <name>instance-00000006</name>
Nov 06 15:38:13 user nova-compute[75337]:   <memory>524288</memory>
Nov 06 15:38:13 user nova-compute[75337]:   <vcpu>1</vcpu>
Nov 06 15:38:13 user nova-compute[75337]:   <metadata>
Nov 06 15:38:13 user nova-compute[75337]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 15:38:13 user nova-compute[75337]:       <nova:package version="0.0.0"/>
Nov 06 15:38:13 user nova-compute[75337]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1414083334</nova:name>
Nov 06 15:38:13 user nova-compute[75337]:       <nova:creationTime>2023-11-06 15:38:13</nova:creationTime>
Nov 06 15:38:13 user nova-compute[75337]:       <nova:flavor name="m1.tiny">
Nov 06 15:38:13 user nova-compute[75337]:         <nova:memory>512</nova:memory>
Nov 06 15:38:13 user nova-compute[75337]:         <nova:disk>1</nova:disk>
Nov 06 15:38:13 user nova-compute[75337]:         <nova:swap>0</nova:swap>
Nov 06 15:38:13 user nova-compute[75337]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 15:38:13 user nova-compute[75337]:         <nova:vcpus>1</nova:vcpus>
Nov 06 15:38:13 user nova-compute[75337]:       </nova:flavor>
Nov 06 15:38:13 user nova-compute[75337]:       <nova:owner>
Nov 06 15:38:13 user nova-compute[75337]:         <nova:user uuid="aeeea58fcd3e4217a34a4a38be6adf30">tempest-AttachVolumeNegativeTest-1104237961-project-member</nova:user>
Nov 06 15:38:13 user nova-compute[75337]:         <nova:project uuid="1013e7afbefd4146a3be04587710b1de">tempest-AttachVolumeNegativeTest-1104237961</nova:project>
Nov 06 15:38:13 user nova-compute[75337]:       </nova:owner>
Nov 06 15:38:13 user nova-compute[75337]:       <nova:root type="image" uuid="16b903ae-a40f-41a7-985b-4804cce92c62"/>
Nov 06 15:38:13 user nova-compute[75337]:       <nova:ports>
Nov 06 15:38:13 user nova-compute[75337]:         <nova:port uuid="8592b366-9f21-4d92-b297-8872d9a7110f">
Nov 06 15:38:13 user nova-compute[75337]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 06 15:38:13 user nova-compute[75337]:         </nova:port>
Nov 06 15:38:13 user nova-compute[75337]:       </nova:ports>
Nov 06 15:38:13 user nova-compute[75337]:     </nova:instance>
Nov 06 15:38:13 user nova-compute[75337]:   </metadata>
Nov 06 15:38:13 user nova-compute[75337]:   <sysinfo type="smbios">
Nov 06 15:38:13 user nova-compute[75337]:     <system>
Nov 06 15:38:13 user nova-compute[75337]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 15:38:13 user nova-compute[75337]:       <entry name="product">OpenStack Nova</entry>
Nov 06 15:38:13 user nova-compute[75337]:       <entry name="version">0.0.0</entry>
Nov 06 15:38:13 user nova-compute[75337]:       <entry name="serial">dfadb21f-5ed1-42f4-956b-95cccf128b6a</entry>
Nov 06 15:38:13 user nova-compute[75337]:       <entry name="uuid">dfadb21f-5ed1-42f4-956b-95cccf128b6a</entry>
Nov 06 15:38:13 user nova-compute[75337]:       <entry name="family">Virtual Machine</entry>
Nov 06 15:38:13 user nova-compute[75337]:     </system>
Nov 06 15:38:13 user nova-compute[75337]:   </sysinfo>
Nov 06 15:38:13 user nova-compute[75337]:   <os>
Nov 06 15:38:13 user nova-compute[75337]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 15:38:13 user nova-compute[75337]:     <boot dev="hd"/>
Nov 06 15:38:13 user nova-compute[75337]:     <smbios mode="sysinfo"/>
Nov 06 15:38:13 user nova-compute[75337]:   </os>
Nov 06 15:38:13 user nova-compute[75337]:   <features>
Nov 06 15:38:13 user nova-compute[75337]:     <acpi/>
Nov 06 15:38:13 user nova-compute[75337]:     <apic/>
Nov 06 15:38:13 user nova-compute[75337]:     <vmcoreinfo/>
Nov 06 15:38:13 user nova-compute[75337]:   </features>
Nov 06 15:38:13 user nova-compute[75337]:   <clock offset="utc">
Nov 06 15:38:13 user nova-compute[75337]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 15:38:13 user nova-compute[75337]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 15:38:13 user nova-compute[75337]:     <timer name="hpet" present="no"/>
Nov 06 15:38:13 user nova-compute[75337]:   </clock>
Nov 06 15:38:13 user nova-compute[75337]:   <cpu mode="custom" match="exact">
Nov 06 15:38:13 user nova-compute[75337]:     <model>Nehalem</model>
Nov 06 15:38:13 user nova-compute[75337]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 15:38:13 user nova-compute[75337]:   </cpu>
Nov 06 15:38:13 user nova-compute[75337]:   <devices>
Nov 06 15:38:13 user nova-compute[75337]:     <disk type="file" device="disk">
Nov 06 15:38:13 user nova-compute[75337]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 15:38:13 user nova-compute[75337]:       <source file="/opt/stack/data/nova/instances/dfadb21f-5ed1-42f4-956b-95cccf128b6a/disk"/>
Nov 06 15:38:13 user nova-compute[75337]:       <target dev="vda" bus="virtio"/>
Nov 06 15:38:13 user nova-compute[75337]:     </disk>
Nov 06 15:38:13 user nova-compute[75337]:     <interface type="ethernet">
Nov 06 15:38:13 user nova-compute[75337]:       <mac address="fa:16:3e:f8:26:1d"/>
Nov 06 15:38:13 user nova-compute[75337]:       <model type="virtio"/>
Nov 06 15:38:13 user nova-compute[75337]:       <mtu size="1442"/>
Nov 06 15:38:13 user nova-compute[75337]:       <target dev="tap8592b366-9f"/>
Nov 06 15:38:13 user nova-compute[75337]:     </interface>
Nov 06 15:38:13 user nova-compute[75337]:     <serial type="pty">
Nov 06 15:38:13 user nova-compute[75337]:       <log file="/opt/stack/data/nova/instances/dfadb21f-5ed1-42f4-956b-95cccf128b6a/console.log" append="off"/>
Nov 06 15:38:13 user nova-compute[75337]:     </serial>
Nov 06 15:38:13 user nova-compute[75337]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 15:38:13 user nova-compute[75337]:     <video>
Nov 06 15:38:13 user nova-compute[75337]:       <model type="virtio"/>
Nov 06 15:38:13 user nova-compute[75337]:     </video>
Nov 06 15:38:13 user nova-compute[75337]:     <rng model="virtio">
Nov 06 15:38:13 user nova-compute[75337]:       <backend model="random">/dev/urandom</backend>
Nov 06 15:38:13 user nova-compute[75337]:     </rng>
Nov 06 15:38:13 user nova-compute[75337]:     <controller type="usb" index="0" model="none"/>
Nov 06 15:38:13 user nova-compute[75337]:     <memballoon model="virtio">
Nov 06 15:38:13 user nova-compute[75337]:       <stats period="10"/>
Nov 06 15:38:13 user nova-compute[75337]:     </memballoon>
Nov 06 15:38:13 user nova-compute[75337]:   </devices>
Nov 06 15:38:13 user nova-compute[75337]: </domain>
Nov 06 15:38:13 user nova-compute[75337]:  {{(pid=75337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 15:38:13 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-2c2d9eec-5e43-48a3-8c5c-46fb52f23c04 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T15:38:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1414083334',display_name='tempest-AttachVolumeNegativeTest-server-1414083334',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1414083334',id=6,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMM52JwCKgpkbgioUGMI0NI1B2YA6YCTZsHJyf9K8op+p9kwd0OG2YGfA8GNNGZDP2ZRZZV08pLVyNzsHr61PQwYkHr5Edy24Jllzi1i8a7jhx9bnOvb3N/DgbyCjt6ADA==',key_name='tempest-keypair-1468084483',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1013e7afbefd4146a3be04587710b1de',ramdisk_id='',reservation_id='r-f2mxi13h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1104237961',owner_user_name='tempest-AttachVolumeNegativeTest-1104237961-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T15:38:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aeeea58fcd3e4217a34a4a38be6adf30',uuid=dfadb21f-5ed1-42f4-956b-95cccf128b6a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8592b366-9f21-4d92-b297-8872d9a7110f", "address": "fa:16:3e:f8:26:1d", "network": {"id": "48f1545d-7e80-462f-9dbf-f1102ddcda9a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1210368397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1013e7afbefd4146a3be04587710b1de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8592b366-9f", "ovs_interfaceid": "8592b366-9f21-4d92-b297-8872d9a7110f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 15:38:13 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-2c2d9eec-5e43-48a3-8c5c-46fb52f23c04 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Converting VIF {"id": "8592b366-9f21-4d92-b297-8872d9a7110f", "address": "fa:16:3e:f8:26:1d", "network": {"id": "48f1545d-7e80-462f-9dbf-f1102ddcda9a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1210368397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1013e7afbefd4146a3be04587710b1de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8592b366-9f", "ovs_interfaceid": "8592b366-9f21-4d92-b297-8872d9a7110f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 15:38:13 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-2c2d9eec-5e43-48a3-8c5c-46fb52f23c04 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:26:1d,bridge_name='br-int',has_traffic_filtering=True,id=8592b366-9f21-4d92-b297-8872d9a7110f,network=Network(48f1545d-7e80-462f-9dbf-f1102ddcda9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8592b366-9f') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 15:38:13 user nova-compute[75337]: DEBUG os_vif [None req-2c2d9eec-5e43-48a3-8c5c-46fb52f23c04 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:26:1d,bridge_name='br-int',has_traffic_filtering=True,id=8592b366-9f21-4d92-b297-8872d9a7110f,network=Network(48f1545d-7e80-462f-9dbf-f1102ddcda9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8592b366-9f') {{(pid=75337) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 15:38:13 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:38:13 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:38:13 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 15:38:13 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:38:13 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '01bf48da-0a03-56d0-a8cd-46a7d17bc023', '_type': 'linux-noop'}}, row=False) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:38:13 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:38:13 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:38:13 user nova-compute[75337]: INFO nova.virt.libvirt.driver [-] [instance: 581cf468-65e7-42e5-9250-c3d645577011] Instance spawned successfully.
Nov 06 15:38:13 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-85a3dccf-6bd3-423b-963c-1b49593ba32d tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] [instance: 581cf468-65e7-42e5-9250-c3d645577011] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 15:38:13 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:38:13 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8592b366-9f, may_exist=True, interface_attrs={}) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:38:13 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8592b366-9f, col_values=(('qos', UUID('eb8f37ad-cd01-456a-9da7-c98c15de0f29')),), if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:38:13 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8592b366-9f, col_values=(('external_ids', {'iface-id': '8592b366-9f21-4d92-b297-8872d9a7110f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f8:26:1d', 'vm-uuid': 'dfadb21f-5ed1-42f4-956b-95cccf128b6a'}),), if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:38:13 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:38:13 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:38:13 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:38:13 user nova-compute[75337]: INFO os_vif [None req-2c2d9eec-5e43-48a3-8c5c-46fb52f23c04 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:26:1d,bridge_name='br-int',has_traffic_filtering=True,id=8592b366-9f21-4d92-b297-8872d9a7110f,network=Network(48f1545d-7e80-462f-9dbf-f1102ddcda9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8592b366-9f')
Nov 06 15:38:13 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-85a3dccf-6bd3-423b-963c-1b49593ba32d tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] [instance: 581cf468-65e7-42e5-9250-c3d645577011] Found default for hw_cdrom_bus of ide {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:38:13 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-85a3dccf-6bd3-423b-963c-1b49593ba32d tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] [instance: 581cf468-65e7-42e5-9250-c3d645577011] Found default for hw_disk_bus of virtio {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:38:13 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-85a3dccf-6bd3-423b-963c-1b49593ba32d tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] [instance: 581cf468-65e7-42e5-9250-c3d645577011] Found default for hw_input_bus of None {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:38:13 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-85a3dccf-6bd3-423b-963c-1b49593ba32d tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] [instance: 581cf468-65e7-42e5-9250-c3d645577011] Found default for hw_pointer_model of None {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:38:13 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-85a3dccf-6bd3-423b-963c-1b49593ba32d tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] [instance: 581cf468-65e7-42e5-9250-c3d645577011] Found default for hw_video_model of virtio {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:38:13 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-85a3dccf-6bd3-423b-963c-1b49593ba32d tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] [instance: 581cf468-65e7-42e5-9250-c3d645577011] Found default for hw_vif_model of virtio {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:38:13 user nova-compute[75337]: INFO nova.compute.manager [None req-8ec9b84c-44ef-4746-b7cb-3670a5acf87d tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] [instance: c8cf1ead-a87c-459c-b914-a0e976c9e464] Took 15.38 seconds to spawn the instance on the hypervisor.
Nov 06 15:38:13 user nova-compute[75337]: DEBUG nova.compute.manager [None req-8ec9b84c-44ef-4746-b7cb-3670a5acf87d tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] [instance: c8cf1ead-a87c-459c-b914-a0e976c9e464] Checking state {{(pid=75337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 15:38:13 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-2c2d9eec-5e43-48a3-8c5c-46fb52f23c04 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] No BDM found with device name vda, not building metadata. {{(pid=75337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 15:38:13 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-2c2d9eec-5e43-48a3-8c5c-46fb52f23c04 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] No VIF found with MAC fa:16:3e:f8:26:1d, not building metadata {{(pid=75337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 15:38:13 user nova-compute[75337]: INFO nova.compute.manager [None req-1fb51d76-ace3-4cae-bd21-10fb29d2c2fc tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] [instance: 5f5fc58d-f946-4df0-b8d0-1aefbf0f8cd6] Took 15.99 seconds to spawn the instance on the hypervisor.
Nov 06 15:38:13 user nova-compute[75337]: DEBUG nova.compute.manager [None req-1fb51d76-ace3-4cae-bd21-10fb29d2c2fc tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] [instance: 5f5fc58d-f946-4df0-b8d0-1aefbf0f8cd6] Checking state {{(pid=75337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 15:38:13 user nova-compute[75337]: DEBUG nova.compute.manager [None req-de8e0a8f-0037-401a-bdef-954826a647d4 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] [instance: 8a600bd8-b94a-4242-a443-c2defb002280] Instance event wait completed in 0 seconds for  {{(pid=75337) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 15:38:13 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-de8e0a8f-0037-401a-bdef-954826a647d4 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] [instance: 8a600bd8-b94a-4242-a443-c2defb002280] Guest created on hypervisor {{(pid=75337) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 15:38:13 user nova-compute[75337]: DEBUG nova.compute.manager [None req-75bba3f0-8587-4ed8-bd52-888d6ae89130 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: 83516ff5-c4e7-4e91-a2f9-8af9b51cf475] Instance event wait completed in 0 seconds for  {{(pid=75337) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 15:38:13 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-75bba3f0-8587-4ed8-bd52-888d6ae89130 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: 83516ff5-c4e7-4e91-a2f9-8af9b51cf475] Guest created on hypervisor {{(pid=75337) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 15:38:13 user nova-compute[75337]: INFO nova.virt.libvirt.driver [-] [instance: 8a600bd8-b94a-4242-a443-c2defb002280] Instance spawned successfully.
Nov 06 15:38:13 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-de8e0a8f-0037-401a-bdef-954826a647d4 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] [instance: 8a600bd8-b94a-4242-a443-c2defb002280] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 15:38:13 user nova-compute[75337]: INFO nova.virt.libvirt.driver [-] [instance: 83516ff5-c4e7-4e91-a2f9-8af9b51cf475] Instance spawned successfully.
Nov 06 15:38:13 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-75bba3f0-8587-4ed8-bd52-888d6ae89130 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: 83516ff5-c4e7-4e91-a2f9-8af9b51cf475] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 15:38:13 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-de8e0a8f-0037-401a-bdef-954826a647d4 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] [instance: 8a600bd8-b94a-4242-a443-c2defb002280] Found default for hw_cdrom_bus of ide {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:38:13 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-de8e0a8f-0037-401a-bdef-954826a647d4 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] [instance: 8a600bd8-b94a-4242-a443-c2defb002280] Found default for hw_disk_bus of virtio {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:38:13 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-de8e0a8f-0037-401a-bdef-954826a647d4 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] [instance: 8a600bd8-b94a-4242-a443-c2defb002280] Found default for hw_input_bus of None {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:38:13 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-de8e0a8f-0037-401a-bdef-954826a647d4 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] [instance: 8a600bd8-b94a-4242-a443-c2defb002280] Found default for hw_pointer_model of None {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:38:13 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-de8e0a8f-0037-401a-bdef-954826a647d4 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] [instance: 8a600bd8-b94a-4242-a443-c2defb002280] Found default for hw_video_model of virtio {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:38:13 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-de8e0a8f-0037-401a-bdef-954826a647d4 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] [instance: 8a600bd8-b94a-4242-a443-c2defb002280] Found default for hw_vif_model of virtio {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:38:14 user nova-compute[75337]: DEBUG nova.compute.manager [req-de3f18ac-fd00-4a25-ba2d-d909da541199 req-f2a8cefb-cf7b-4f57-864c-38b5da403648 service nova] [instance: 8a600bd8-b94a-4242-a443-c2defb002280] Received event network-vif-plugged-01aa7168-78cd-44e6-8496-08d468f62cfe {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:38:14 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-de3f18ac-fd00-4a25-ba2d-d909da541199 req-f2a8cefb-cf7b-4f57-864c-38b5da403648 service nova] Acquiring lock "8a600bd8-b94a-4242-a443-c2defb002280-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:38:14 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-de3f18ac-fd00-4a25-ba2d-d909da541199 req-f2a8cefb-cf7b-4f57-864c-38b5da403648 service nova] Lock "8a600bd8-b94a-4242-a443-c2defb002280-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:38:14 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-de3f18ac-fd00-4a25-ba2d-d909da541199 req-f2a8cefb-cf7b-4f57-864c-38b5da403648 service nova] Lock "8a600bd8-b94a-4242-a443-c2defb002280-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:38:14 user nova-compute[75337]: DEBUG nova.compute.manager [req-de3f18ac-fd00-4a25-ba2d-d909da541199 req-f2a8cefb-cf7b-4f57-864c-38b5da403648 service nova] [instance: 8a600bd8-b94a-4242-a443-c2defb002280] No waiting events found dispatching network-vif-plugged-01aa7168-78cd-44e6-8496-08d468f62cfe {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:38:14 user nova-compute[75337]: WARNING nova.compute.manager [req-de3f18ac-fd00-4a25-ba2d-d909da541199 req-f2a8cefb-cf7b-4f57-864c-38b5da403648 service nova] [instance: 8a600bd8-b94a-4242-a443-c2defb002280] Received unexpected event network-vif-plugged-01aa7168-78cd-44e6-8496-08d468f62cfe for instance with vm_state building and task_state spawning.
Nov 06 15:38:14 user nova-compute[75337]: INFO nova.compute.manager [None req-1fb51d76-ace3-4cae-bd21-10fb29d2c2fc tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] [instance: 5f5fc58d-f946-4df0-b8d0-1aefbf0f8cd6] Took 17.12 seconds to build instance.
Nov 06 15:38:14 user nova-compute[75337]: INFO nova.compute.manager [None req-85a3dccf-6bd3-423b-963c-1b49593ba32d tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] [instance: 581cf468-65e7-42e5-9250-c3d645577011] Took 15.08 seconds to spawn the instance on the hypervisor.
Nov 06 15:38:14 user nova-compute[75337]: DEBUG nova.compute.manager [None req-85a3dccf-6bd3-423b-963c-1b49593ba32d tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] [instance: 581cf468-65e7-42e5-9250-c3d645577011] Checking state {{(pid=75337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 15:38:14 user nova-compute[75337]: INFO nova.compute.manager [None req-8ec9b84c-44ef-4746-b7cb-3670a5acf87d tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] [instance: c8cf1ead-a87c-459c-b914-a0e976c9e464] Took 16.98 seconds to build instance.
Nov 06 15:38:14 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-1fb51d76-ace3-4cae-bd21-10fb29d2c2fc tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] Lock "5f5fc58d-f946-4df0-b8d0-1aefbf0f8cd6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.327s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:38:14 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-75bba3f0-8587-4ed8-bd52-888d6ae89130 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: 83516ff5-c4e7-4e91-a2f9-8af9b51cf475] Found default for hw_cdrom_bus of ide {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:38:14 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-75bba3f0-8587-4ed8-bd52-888d6ae89130 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: 83516ff5-c4e7-4e91-a2f9-8af9b51cf475] Found default for hw_disk_bus of virtio {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:38:14 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-75bba3f0-8587-4ed8-bd52-888d6ae89130 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: 83516ff5-c4e7-4e91-a2f9-8af9b51cf475] Found default for hw_input_bus of None {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:38:14 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-75bba3f0-8587-4ed8-bd52-888d6ae89130 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: 83516ff5-c4e7-4e91-a2f9-8af9b51cf475] Found default for hw_pointer_model of None {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:38:14 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-75bba3f0-8587-4ed8-bd52-888d6ae89130 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: 83516ff5-c4e7-4e91-a2f9-8af9b51cf475] Found default for hw_video_model of virtio {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:38:14 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-75bba3f0-8587-4ed8-bd52-888d6ae89130 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: 83516ff5-c4e7-4e91-a2f9-8af9b51cf475] Found default for hw_vif_model of virtio {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:38:14 user nova-compute[75337]: INFO nova.compute.manager [None req-de8e0a8f-0037-401a-bdef-954826a647d4 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] [instance: 8a600bd8-b94a-4242-a443-c2defb002280] Took 14.62 seconds to spawn the instance on the hypervisor.
Nov 06 15:38:14 user nova-compute[75337]: DEBUG nova.compute.manager [None req-de8e0a8f-0037-401a-bdef-954826a647d4 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] [instance: 8a600bd8-b94a-4242-a443-c2defb002280] Checking state {{(pid=75337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 15:38:14 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-8ec9b84c-44ef-4746-b7cb-3670a5acf87d tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Lock "c8cf1ead-a87c-459c-b914-a0e976c9e464" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.186s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:38:14 user nova-compute[75337]: INFO nova.compute.manager [None req-75bba3f0-8587-4ed8-bd52-888d6ae89130 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: 83516ff5-c4e7-4e91-a2f9-8af9b51cf475] Took 19.56 seconds to spawn the instance on the hypervisor.
Nov 06 15:38:14 user nova-compute[75337]: DEBUG nova.compute.manager [None req-75bba3f0-8587-4ed8-bd52-888d6ae89130 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: 83516ff5-c4e7-4e91-a2f9-8af9b51cf475] Checking state {{(pid=75337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 15:38:14 user nova-compute[75337]: INFO nova.compute.manager [None req-85a3dccf-6bd3-423b-963c-1b49593ba32d tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] [instance: 581cf468-65e7-42e5-9250-c3d645577011] Took 17.12 seconds to build instance.
Nov 06 15:38:14 user nova-compute[75337]: INFO nova.compute.manager [None req-75bba3f0-8587-4ed8-bd52-888d6ae89130 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: 83516ff5-c4e7-4e91-a2f9-8af9b51cf475] Took 20.55 seconds to build instance.
Nov 06 15:38:14 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-85a3dccf-6bd3-423b-963c-1b49593ba32d tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Lock "581cf468-65e7-42e5-9250-c3d645577011" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.290s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:38:14 user nova-compute[75337]: INFO nova.compute.manager [None req-de8e0a8f-0037-401a-bdef-954826a647d4 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] [instance: 8a600bd8-b94a-4242-a443-c2defb002280] Took 16.04 seconds to build instance.
Nov 06 15:38:14 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-75bba3f0-8587-4ed8-bd52-888d6ae89130 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Lock "83516ff5-c4e7-4e91-a2f9-8af9b51cf475" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.142s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:38:14 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-de8e0a8f-0037-401a-bdef-954826a647d4 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Lock "8a600bd8-b94a-4242-a443-c2defb002280" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.211s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:38:15 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:38:15 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:38:15 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:38:15 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:38:16 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:38:16 user nova-compute[75337]: DEBUG nova.compute.manager [req-cce87806-842f-46e4-a57a-ec3e2673ec55 req-c0951b91-7cb0-40e4-aa10-cd38595b9853 service nova] [instance: 8a600bd8-b94a-4242-a443-c2defb002280] Received event network-vif-plugged-01aa7168-78cd-44e6-8496-08d468f62cfe {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:38:16 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-cce87806-842f-46e4-a57a-ec3e2673ec55 req-c0951b91-7cb0-40e4-aa10-cd38595b9853 service nova] Acquiring lock "8a600bd8-b94a-4242-a443-c2defb002280-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:38:16 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-cce87806-842f-46e4-a57a-ec3e2673ec55 req-c0951b91-7cb0-40e4-aa10-cd38595b9853 service nova] Lock "8a600bd8-b94a-4242-a443-c2defb002280-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.005s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:38:16 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-cce87806-842f-46e4-a57a-ec3e2673ec55 req-c0951b91-7cb0-40e4-aa10-cd38595b9853 service nova] Lock "8a600bd8-b94a-4242-a443-c2defb002280-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:38:16 user nova-compute[75337]: DEBUG nova.compute.manager [req-cce87806-842f-46e4-a57a-ec3e2673ec55 req-c0951b91-7cb0-40e4-aa10-cd38595b9853 service nova] [instance: 8a600bd8-b94a-4242-a443-c2defb002280] No waiting events found dispatching network-vif-plugged-01aa7168-78cd-44e6-8496-08d468f62cfe {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:38:16 user nova-compute[75337]: WARNING nova.compute.manager [req-cce87806-842f-46e4-a57a-ec3e2673ec55 req-c0951b91-7cb0-40e4-aa10-cd38595b9853 service nova] [instance: 8a600bd8-b94a-4242-a443-c2defb002280] Received unexpected event network-vif-plugged-01aa7168-78cd-44e6-8496-08d468f62cfe for instance with vm_state active and task_state None.
Nov 06 15:38:16 user nova-compute[75337]: DEBUG nova.compute.manager [req-cce87806-842f-46e4-a57a-ec3e2673ec55 req-c0951b91-7cb0-40e4-aa10-cd38595b9853 service nova] [instance: dfadb21f-5ed1-42f4-956b-95cccf128b6a] Received event network-vif-plugged-8592b366-9f21-4d92-b297-8872d9a7110f {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:38:16 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-cce87806-842f-46e4-a57a-ec3e2673ec55 req-c0951b91-7cb0-40e4-aa10-cd38595b9853 service nova] Acquiring lock "dfadb21f-5ed1-42f4-956b-95cccf128b6a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:38:16 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-cce87806-842f-46e4-a57a-ec3e2673ec55 req-c0951b91-7cb0-40e4-aa10-cd38595b9853 service nova] Lock "dfadb21f-5ed1-42f4-956b-95cccf128b6a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:38:16 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-cce87806-842f-46e4-a57a-ec3e2673ec55 req-c0951b91-7cb0-40e4-aa10-cd38595b9853 service nova] Lock "dfadb21f-5ed1-42f4-956b-95cccf128b6a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:38:16 user nova-compute[75337]: DEBUG nova.compute.manager [req-cce87806-842f-46e4-a57a-ec3e2673ec55 req-c0951b91-7cb0-40e4-aa10-cd38595b9853 service nova] [instance: dfadb21f-5ed1-42f4-956b-95cccf128b6a] No waiting events found dispatching network-vif-plugged-8592b366-9f21-4d92-b297-8872d9a7110f {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:38:16 user nova-compute[75337]: WARNING nova.compute.manager [req-cce87806-842f-46e4-a57a-ec3e2673ec55 req-c0951b91-7cb0-40e4-aa10-cd38595b9853 service nova] [instance: dfadb21f-5ed1-42f4-956b-95cccf128b6a] Received unexpected event network-vif-plugged-8592b366-9f21-4d92-b297-8872d9a7110f for instance with vm_state building and task_state spawning.
Nov 06 15:38:16 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:38:16 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:38:17 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:38:17 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:38:18 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:38:18 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:38:18 user nova-compute[75337]: DEBUG nova.compute.manager [req-7920ae66-57b6-4c64-9082-e511549ddf39 req-808d4ceb-98a1-4642-9616-55d347d212f8 service nova] [instance: dfadb21f-5ed1-42f4-956b-95cccf128b6a] Received event network-vif-plugged-8592b366-9f21-4d92-b297-8872d9a7110f {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:38:18 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-7920ae66-57b6-4c64-9082-e511549ddf39 req-808d4ceb-98a1-4642-9616-55d347d212f8 service nova] Acquiring lock "dfadb21f-5ed1-42f4-956b-95cccf128b6a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:38:18 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-7920ae66-57b6-4c64-9082-e511549ddf39 req-808d4ceb-98a1-4642-9616-55d347d212f8 service nova] Lock "dfadb21f-5ed1-42f4-956b-95cccf128b6a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:38:18 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-7920ae66-57b6-4c64-9082-e511549ddf39 req-808d4ceb-98a1-4642-9616-55d347d212f8 service nova] Lock "dfadb21f-5ed1-42f4-956b-95cccf128b6a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:38:18 user nova-compute[75337]: DEBUG nova.compute.manager [req-7920ae66-57b6-4c64-9082-e511549ddf39 req-808d4ceb-98a1-4642-9616-55d347d212f8 service nova] [instance: dfadb21f-5ed1-42f4-956b-95cccf128b6a] No waiting events found dispatching network-vif-plugged-8592b366-9f21-4d92-b297-8872d9a7110f {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:38:18 user nova-compute[75337]: WARNING nova.compute.manager [req-7920ae66-57b6-4c64-9082-e511549ddf39 req-808d4ceb-98a1-4642-9616-55d347d212f8 service nova] [instance: dfadb21f-5ed1-42f4-956b-95cccf128b6a] Received unexpected event network-vif-plugged-8592b366-9f21-4d92-b297-8872d9a7110f for instance with vm_state building and task_state spawning.
Nov 06 15:38:18 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:38:18 user nova-compute[75337]: DEBUG nova.compute.manager [None req-2c2d9eec-5e43-48a3-8c5c-46fb52f23c04 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] [instance: dfadb21f-5ed1-42f4-956b-95cccf128b6a] Instance event wait completed in 0 seconds for  {{(pid=75337) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 15:38:18 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-2c2d9eec-5e43-48a3-8c5c-46fb52f23c04 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] [instance: dfadb21f-5ed1-42f4-956b-95cccf128b6a] Guest created on hypervisor {{(pid=75337) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 15:38:18 user nova-compute[75337]: INFO nova.virt.libvirt.driver [-] [instance: dfadb21f-5ed1-42f4-956b-95cccf128b6a] Instance spawned successfully.
Nov 06 15:38:18 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-2c2d9eec-5e43-48a3-8c5c-46fb52f23c04 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] [instance: dfadb21f-5ed1-42f4-956b-95cccf128b6a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 15:38:18 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-2c2d9eec-5e43-48a3-8c5c-46fb52f23c04 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] [instance: dfadb21f-5ed1-42f4-956b-95cccf128b6a] Found default for hw_cdrom_bus of ide {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:38:18 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-2c2d9eec-5e43-48a3-8c5c-46fb52f23c04 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] [instance: dfadb21f-5ed1-42f4-956b-95cccf128b6a] Found default for hw_disk_bus of virtio {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:38:18 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-2c2d9eec-5e43-48a3-8c5c-46fb52f23c04 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] [instance: dfadb21f-5ed1-42f4-956b-95cccf128b6a] Found default for hw_input_bus of None {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:38:18 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-2c2d9eec-5e43-48a3-8c5c-46fb52f23c04 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] [instance: dfadb21f-5ed1-42f4-956b-95cccf128b6a] Found default for hw_pointer_model of None {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:38:18 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-2c2d9eec-5e43-48a3-8c5c-46fb52f23c04 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] [instance: dfadb21f-5ed1-42f4-956b-95cccf128b6a] Found default for hw_video_model of virtio {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:38:18 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-2c2d9eec-5e43-48a3-8c5c-46fb52f23c04 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] [instance: dfadb21f-5ed1-42f4-956b-95cccf128b6a] Found default for hw_vif_model of virtio {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:38:18 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:38:18 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:38:19 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:38:19 user nova-compute[75337]: INFO nova.compute.manager [None req-2c2d9eec-5e43-48a3-8c5c-46fb52f23c04 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] [instance: dfadb21f-5ed1-42f4-956b-95cccf128b6a] Took 17.00 seconds to spawn the instance on the hypervisor.
Nov 06 15:38:19 user nova-compute[75337]: DEBUG nova.compute.manager [None req-2c2d9eec-5e43-48a3-8c5c-46fb52f23c04 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] [instance: dfadb21f-5ed1-42f4-956b-95cccf128b6a] Checking state {{(pid=75337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 15:38:19 user nova-compute[75337]: INFO nova.compute.manager [None req-2c2d9eec-5e43-48a3-8c5c-46fb52f23c04 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] [instance: dfadb21f-5ed1-42f4-956b-95cccf128b6a] Took 18.25 seconds to build instance.
Nov 06 15:38:19 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-2c2d9eec-5e43-48a3-8c5c-46fb52f23c04 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Lock "dfadb21f-5ed1-42f4-956b-95cccf128b6a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.457s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:38:20 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:38:20 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:38:20 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:38:21 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:38:21 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:38:21 user nova-compute[75337]: DEBUG nova.compute.manager [req-b1b9b782-7533-4e35-a342-9c61a2fda912 req-ed06e4d5-e540-4f67-898c-a307d98648f1 service nova] [instance: c8cf1ead-a87c-459c-b914-a0e976c9e464] Received event network-vif-plugged-b33373f6-0289-4623-90ac-f5c3db0d3681 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:38:21 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-b1b9b782-7533-4e35-a342-9c61a2fda912 req-ed06e4d5-e540-4f67-898c-a307d98648f1 service nova] Acquiring lock "c8cf1ead-a87c-459c-b914-a0e976c9e464-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:38:21 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-b1b9b782-7533-4e35-a342-9c61a2fda912 req-ed06e4d5-e540-4f67-898c-a307d98648f1 service nova] Lock "c8cf1ead-a87c-459c-b914-a0e976c9e464-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:38:21 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-b1b9b782-7533-4e35-a342-9c61a2fda912 req-ed06e4d5-e540-4f67-898c-a307d98648f1 service nova] Lock "c8cf1ead-a87c-459c-b914-a0e976c9e464-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:38:21 user nova-compute[75337]: DEBUG nova.compute.manager [req-b1b9b782-7533-4e35-a342-9c61a2fda912 req-ed06e4d5-e540-4f67-898c-a307d98648f1 service nova] [instance: c8cf1ead-a87c-459c-b914-a0e976c9e464] No waiting events found dispatching network-vif-plugged-b33373f6-0289-4623-90ac-f5c3db0d3681 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:38:21 user nova-compute[75337]: WARNING nova.compute.manager [req-b1b9b782-7533-4e35-a342-9c61a2fda912 req-ed06e4d5-e540-4f67-898c-a307d98648f1 service nova] [instance: c8cf1ead-a87c-459c-b914-a0e976c9e464] Received unexpected event network-vif-plugged-b33373f6-0289-4623-90ac-f5c3db0d3681 for instance with vm_state active and task_state None.
Nov 06 15:38:22 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:38:22 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-0a5d741a-2c6d-4d60-9dee-9e53836e0a4d tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] Acquiring lock "8858d90e-ee14-494b-80da-904cd97cdff0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:38:22 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-0a5d741a-2c6d-4d60-9dee-9e53836e0a4d tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] Lock "8858d90e-ee14-494b-80da-904cd97cdff0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:38:23 user nova-compute[75337]: DEBUG nova.compute.manager [None req-0a5d741a-2c6d-4d60-9dee-9e53836e0a4d tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] [instance: 8858d90e-ee14-494b-80da-904cd97cdff0] Starting instance... {{(pid=75337) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 15:38:23 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:38:23 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:38:23 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:38:23 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-0a5d741a-2c6d-4d60-9dee-9e53836e0a4d tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:38:23 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-0a5d741a-2c6d-4d60-9dee-9e53836e0a4d tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:38:23 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-0a5d741a-2c6d-4d60-9dee-9e53836e0a4d tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75337) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 15:38:23 user nova-compute[75337]: INFO nova.compute.claims [None req-0a5d741a-2c6d-4d60-9dee-9e53836e0a4d tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] [instance: 8858d90e-ee14-494b-80da-904cd97cdff0] Claim successful on node user
Nov 06 15:38:23 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:38:23 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-0a5d741a-2c6d-4d60-9dee-9e53836e0a4d tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 15:38:23 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-0a5d741a-2c6d-4d60-9dee-9e53836e0a4d tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 15:38:23 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-0a5d741a-2c6d-4d60-9dee-9e53836e0a4d tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.566s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:38:23 user nova-compute[75337]: DEBUG nova.compute.manager [None req-0a5d741a-2c6d-4d60-9dee-9e53836e0a4d tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] [instance: 8858d90e-ee14-494b-80da-904cd97cdff0] Start building networks asynchronously for instance. {{(pid=75337) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 15:38:23 user nova-compute[75337]: DEBUG nova.compute.manager [None req-0a5d741a-2c6d-4d60-9dee-9e53836e0a4d tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] [instance: 8858d90e-ee14-494b-80da-904cd97cdff0] Allocating IP information in the background. {{(pid=75337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 15:38:23 user nova-compute[75337]: DEBUG nova.network.neutron [None req-0a5d741a-2c6d-4d60-9dee-9e53836e0a4d tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] [instance: 8858d90e-ee14-494b-80da-904cd97cdff0] allocate_for_instance() {{(pid=75337) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 15:38:23 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-0a5d741a-2c6d-4d60-9dee-9e53836e0a4d tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] [instance: 8858d90e-ee14-494b-80da-904cd97cdff0] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Nov 06 15:38:23 user nova-compute[75337]: DEBUG nova.compute.manager [None req-0a5d741a-2c6d-4d60-9dee-9e53836e0a4d tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] [instance: 8858d90e-ee14-494b-80da-904cd97cdff0] Start building block device mappings for instance. {{(pid=75337) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 15:38:23 user nova-compute[75337]: DEBUG nova.policy [None req-0a5d741a-2c6d-4d60-9dee-9e53836e0a4d tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4eb5c53de9ed4929aa60551a1cd99d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc4e4ce6f66541f380a8bbb0671657f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75337) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 15:38:24 user nova-compute[75337]: DEBUG nova.compute.manager [req-28df1dc5-8186-4999-946c-f0590f2a5b8d req-a79880bb-2e16-478f-98a9-acd1569559bc service nova] [instance: c8cf1ead-a87c-459c-b914-a0e976c9e464] Received event network-vif-plugged-b33373f6-0289-4623-90ac-f5c3db0d3681 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:38:24 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-28df1dc5-8186-4999-946c-f0590f2a5b8d req-a79880bb-2e16-478f-98a9-acd1569559bc service nova] Acquiring lock "c8cf1ead-a87c-459c-b914-a0e976c9e464-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:38:24 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-28df1dc5-8186-4999-946c-f0590f2a5b8d req-a79880bb-2e16-478f-98a9-acd1569559bc service nova] Lock "c8cf1ead-a87c-459c-b914-a0e976c9e464-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:38:24 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-28df1dc5-8186-4999-946c-f0590f2a5b8d req-a79880bb-2e16-478f-98a9-acd1569559bc service nova] Lock "c8cf1ead-a87c-459c-b914-a0e976c9e464-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:38:24 user nova-compute[75337]: DEBUG nova.compute.manager [req-28df1dc5-8186-4999-946c-f0590f2a5b8d req-a79880bb-2e16-478f-98a9-acd1569559bc service nova] [instance: c8cf1ead-a87c-459c-b914-a0e976c9e464] No waiting events found dispatching network-vif-plugged-b33373f6-0289-4623-90ac-f5c3db0d3681 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:38:24 user nova-compute[75337]: WARNING nova.compute.manager [req-28df1dc5-8186-4999-946c-f0590f2a5b8d req-a79880bb-2e16-478f-98a9-acd1569559bc service nova] [instance: c8cf1ead-a87c-459c-b914-a0e976c9e464] Received unexpected event network-vif-plugged-b33373f6-0289-4623-90ac-f5c3db0d3681 for instance with vm_state active and task_state None.
Nov 06 15:38:24 user nova-compute[75337]: DEBUG nova.compute.manager [None req-0a5d741a-2c6d-4d60-9dee-9e53836e0a4d tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] [instance: 8858d90e-ee14-494b-80da-904cd97cdff0] Start spawning the instance on the hypervisor. {{(pid=75337) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 15:38:24 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-0a5d741a-2c6d-4d60-9dee-9e53836e0a4d tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] [instance: 8858d90e-ee14-494b-80da-904cd97cdff0] Creating instance directory {{(pid=75337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 15:38:24 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-0a5d741a-2c6d-4d60-9dee-9e53836e0a4d tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] [instance: 8858d90e-ee14-494b-80da-904cd97cdff0] Creating image(s)
Nov 06 15:38:24 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-0a5d741a-2c6d-4d60-9dee-9e53836e0a4d tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] Acquiring lock "/opt/stack/data/nova/instances/8858d90e-ee14-494b-80da-904cd97cdff0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:38:24 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-0a5d741a-2c6d-4d60-9dee-9e53836e0a4d tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] Lock "/opt/stack/data/nova/instances/8858d90e-ee14-494b-80da-904cd97cdff0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:38:24 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-0a5d741a-2c6d-4d60-9dee-9e53836e0a4d tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] Lock "/opt/stack/data/nova/instances/8858d90e-ee14-494b-80da-904cd97cdff0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:38:24 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-0a5d741a-2c6d-4d60-9dee-9e53836e0a4d tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] Acquiring lock "6445952603fe665f75c52025b807ae6a15716542" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:38:24 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-0a5d741a-2c6d-4d60-9dee-9e53836e0a4d tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] Lock "6445952603fe665f75c52025b807ae6a15716542" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:38:24 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-0a5d741a-2c6d-4d60-9dee-9e53836e0a4d tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6445952603fe665f75c52025b807ae6a15716542.part --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:38:25 user nova-compute[75337]: DEBUG nova.network.neutron [None req-0a5d741a-2c6d-4d60-9dee-9e53836e0a4d tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] [instance: 8858d90e-ee14-494b-80da-904cd97cdff0] Successfully created port: d4c8113e-f11f-442c-bd08-206acb4a0416 {{(pid=75337) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 15:38:25 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-0a5d741a-2c6d-4d60-9dee-9e53836e0a4d tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6445952603fe665f75c52025b807ae6a15716542.part --force-share --output=json" returned: 0 in 0.324s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:38:25 user nova-compute[75337]: DEBUG nova.virt.images [None req-0a5d741a-2c6d-4d60-9dee-9e53836e0a4d tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] f8a9eaef-bb42-42c2-8a3f-18ae9a3e629b was qcow2, converting to raw {{(pid=75337) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 06 15:38:25 user nova-compute[75337]: DEBUG nova.privsep.utils [None req-0a5d741a-2c6d-4d60-9dee-9e53836e0a4d tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75337) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 06 15:38:25 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-0a5d741a-2c6d-4d60-9dee-9e53836e0a4d tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/6445952603fe665f75c52025b807ae6a15716542.part /opt/stack/data/nova/instances/_base/6445952603fe665f75c52025b807ae6a15716542.converted {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:38:25 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-0a5d741a-2c6d-4d60-9dee-9e53836e0a4d tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/6445952603fe665f75c52025b807ae6a15716542.part /opt/stack/data/nova/instances/_base/6445952603fe665f75c52025b807ae6a15716542.converted" returned: 0 in 0.360s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:38:25 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-0a5d741a-2c6d-4d60-9dee-9e53836e0a4d tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6445952603fe665f75c52025b807ae6a15716542.converted --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:38:25 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-0a5d741a-2c6d-4d60-9dee-9e53836e0a4d tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6445952603fe665f75c52025b807ae6a15716542.converted --force-share --output=json" returned: 0 in 0.307s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:38:25 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-0a5d741a-2c6d-4d60-9dee-9e53836e0a4d tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] Lock "6445952603fe665f75c52025b807ae6a15716542" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.765s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:38:25 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-0a5d741a-2c6d-4d60-9dee-9e53836e0a4d tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6445952603fe665f75c52025b807ae6a15716542 --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:38:26 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-0a5d741a-2c6d-4d60-9dee-9e53836e0a4d tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6445952603fe665f75c52025b807ae6a15716542 --force-share --output=json" returned: 0 in 0.285s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:38:26 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-0a5d741a-2c6d-4d60-9dee-9e53836e0a4d tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] Acquiring lock "6445952603fe665f75c52025b807ae6a15716542" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:38:26 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-0a5d741a-2c6d-4d60-9dee-9e53836e0a4d tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] Lock "6445952603fe665f75c52025b807ae6a15716542" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:38:26 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-0a5d741a-2c6d-4d60-9dee-9e53836e0a4d tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6445952603fe665f75c52025b807ae6a15716542 --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:38:26 user nova-compute[75337]: DEBUG nova.network.neutron [None req-0a5d741a-2c6d-4d60-9dee-9e53836e0a4d tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] [instance: 8858d90e-ee14-494b-80da-904cd97cdff0] Successfully updated port: d4c8113e-f11f-442c-bd08-206acb4a0416 {{(pid=75337) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 15:38:26 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-0a5d741a-2c6d-4d60-9dee-9e53836e0a4d tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] Acquiring lock "refresh_cache-8858d90e-ee14-494b-80da-904cd97cdff0" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 15:38:26 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-0a5d741a-2c6d-4d60-9dee-9e53836e0a4d tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] Acquired lock "refresh_cache-8858d90e-ee14-494b-80da-904cd97cdff0" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 15:38:26 user nova-compute[75337]: DEBUG nova.network.neutron [None req-0a5d741a-2c6d-4d60-9dee-9e53836e0a4d tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] [instance: 8858d90e-ee14-494b-80da-904cd97cdff0] Building network info cache for instance {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 15:38:26 user nova-compute[75337]: DEBUG nova.compute.manager [req-42f09932-6995-46d9-bef6-97bc2589f3cf req-ec80325e-725e-4916-9c9f-d679cd3e28e9 service nova] [instance: 8858d90e-ee14-494b-80da-904cd97cdff0] Received event network-changed-d4c8113e-f11f-442c-bd08-206acb4a0416 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:38:26 user nova-compute[75337]: DEBUG nova.compute.manager [req-42f09932-6995-46d9-bef6-97bc2589f3cf req-ec80325e-725e-4916-9c9f-d679cd3e28e9 service nova] [instance: 8858d90e-ee14-494b-80da-904cd97cdff0] Refreshing instance network info cache due to event network-changed-d4c8113e-f11f-442c-bd08-206acb4a0416. {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 15:38:26 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-42f09932-6995-46d9-bef6-97bc2589f3cf req-ec80325e-725e-4916-9c9f-d679cd3e28e9 service nova] Acquiring lock "refresh_cache-8858d90e-ee14-494b-80da-904cd97cdff0" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 15:38:26 user nova-compute[75337]: DEBUG nova.network.neutron [None req-0a5d741a-2c6d-4d60-9dee-9e53836e0a4d tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] [instance: 8858d90e-ee14-494b-80da-904cd97cdff0] Instance cache missing network info. {{(pid=75337) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 15:38:26 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-0a5d741a-2c6d-4d60-9dee-9e53836e0a4d tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6445952603fe665f75c52025b807ae6a15716542 --force-share --output=json" returned: 0 in 0.296s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:38:26 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-0a5d741a-2c6d-4d60-9dee-9e53836e0a4d tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6445952603fe665f75c52025b807ae6a15716542,backing_fmt=raw /opt/stack/data/nova/instances/8858d90e-ee14-494b-80da-904cd97cdff0/disk 1073741824 {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:38:26 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-0a5d741a-2c6d-4d60-9dee-9e53836e0a4d tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6445952603fe665f75c52025b807ae6a15716542,backing_fmt=raw /opt/stack/data/nova/instances/8858d90e-ee14-494b-80da-904cd97cdff0/disk 1073741824" returned: 0 in 0.087s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:38:26 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-0a5d741a-2c6d-4d60-9dee-9e53836e0a4d tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] Lock "6445952603fe665f75c52025b807ae6a15716542" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.389s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:38:26 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-0a5d741a-2c6d-4d60-9dee-9e53836e0a4d tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6445952603fe665f75c52025b807ae6a15716542 --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:38:26 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-0a5d741a-2c6d-4d60-9dee-9e53836e0a4d tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6445952603fe665f75c52025b807ae6a15716542 --force-share --output=json" returned: 0 in 0.294s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:38:26 user nova-compute[75337]: DEBUG nova.virt.disk.api [None req-0a5d741a-2c6d-4d60-9dee-9e53836e0a4d tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8858d90e-ee14-494b-80da-904cd97cdff0/disk. size=1073741824 {{(pid=75337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 15:38:26 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-0a5d741a-2c6d-4d60-9dee-9e53836e0a4d tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8858d90e-ee14-494b-80da-904cd97cdff0/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:38:27 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-0a5d741a-2c6d-4d60-9dee-9e53836e0a4d tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8858d90e-ee14-494b-80da-904cd97cdff0/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:38:27 user nova-compute[75337]: DEBUG nova.virt.disk.api [None req-0a5d741a-2c6d-4d60-9dee-9e53836e0a4d tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] Cannot resize image /opt/stack/data/nova/instances/8858d90e-ee14-494b-80da-904cd97cdff0/disk to a smaller size. {{(pid=75337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 06 15:38:27 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-0a5d741a-2c6d-4d60-9dee-9e53836e0a4d tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] [instance: 8858d90e-ee14-494b-80da-904cd97cdff0] Created local disks {{(pid=75337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 15:38:27 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-0a5d741a-2c6d-4d60-9dee-9e53836e0a4d tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] [instance: 8858d90e-ee14-494b-80da-904cd97cdff0] Ensure instance console log exists: /opt/stack/data/nova/instances/8858d90e-ee14-494b-80da-904cd97cdff0/console.log {{(pid=75337) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 15:38:27 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-0a5d741a-2c6d-4d60-9dee-9e53836e0a4d tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:38:27 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-0a5d741a-2c6d-4d60-9dee-9e53836e0a4d tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:38:27 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-0a5d741a-2c6d-4d60-9dee-9e53836e0a4d tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:38:27 user nova-compute[75337]: DEBUG nova.network.neutron [None req-0a5d741a-2c6d-4d60-9dee-9e53836e0a4d tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] [instance: 8858d90e-ee14-494b-80da-904cd97cdff0] Updating instance_info_cache with network_info: [{"id": "d4c8113e-f11f-442c-bd08-206acb4a0416", "address": "fa:16:3e:d5:8c:cf", "network": {"id": "54c79a10-5da3-4de7-b93f-855e966b7101", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-39876549-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc4e4ce6f66541f380a8bbb0671657f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4c8113e-f1", "ovs_interfaceid": "d4c8113e-f11f-442c-bd08-206acb4a0416", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:38:27 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-0a5d741a-2c6d-4d60-9dee-9e53836e0a4d tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] Releasing lock "refresh_cache-8858d90e-ee14-494b-80da-904cd97cdff0" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 15:38:27 user nova-compute[75337]: DEBUG nova.compute.manager [None req-0a5d741a-2c6d-4d60-9dee-9e53836e0a4d tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] [instance: 8858d90e-ee14-494b-80da-904cd97cdff0] Instance network_info: |[{"id": "d4c8113e-f11f-442c-bd08-206acb4a0416", "address": "fa:16:3e:d5:8c:cf", "network": {"id": "54c79a10-5da3-4de7-b93f-855e966b7101", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-39876549-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc4e4ce6f66541f380a8bbb0671657f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4c8113e-f1", "ovs_interfaceid": "d4c8113e-f11f-442c-bd08-206acb4a0416", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 15:38:27 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-42f09932-6995-46d9-bef6-97bc2589f3cf req-ec80325e-725e-4916-9c9f-d679cd3e28e9 service nova] Acquired lock "refresh_cache-8858d90e-ee14-494b-80da-904cd97cdff0" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 15:38:27 user nova-compute[75337]: DEBUG nova.network.neutron [req-42f09932-6995-46d9-bef6-97bc2589f3cf req-ec80325e-725e-4916-9c9f-d679cd3e28e9 service nova] [instance: 8858d90e-ee14-494b-80da-904cd97cdff0] Refreshing network info cache for port d4c8113e-f11f-442c-bd08-206acb4a0416 {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 15:38:27 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-0a5d741a-2c6d-4d60-9dee-9e53836e0a4d tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] [instance: 8858d90e-ee14-494b-80da-904cd97cdff0] Start _get_guest_xml network_info=[{"id": "d4c8113e-f11f-442c-bd08-206acb4a0416", "address": "fa:16:3e:d5:8c:cf", "network": {"id": "54c79a10-5da3-4de7-b93f-855e966b7101", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-39876549-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc4e4ce6f66541f380a8bbb0671657f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4c8113e-f1", "ovs_interfaceid": "d4c8113e-f11f-442c-bd08-206acb4a0416", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T15:38:13Z,direct_url=<?>,disk_format='qcow2',id=f8a9eaef-bb42-42c2-8a3f-18ae9a3e629b,min_disk=0,min_ram=0,name='',owner='ab7ff05dd4194200a62fdb96e6b1ab01',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T15:38:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'encryption_format': None, 'encryption_options': None, 'guest_format': None, 'size': 0, 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'disk_bus': 'scsi', 'encryption_secret_uuid': None, 'device_name': '/dev/sda', 'image_id': 'f8a9eaef-bb42-42c2-8a3f-18ae9a3e629b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 15:38:27 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-0a5d741a-2c6d-4d60-9dee-9e53836e0a4d tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 15:38:27 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-0a5d741a-2c6d-4d60-9dee-9e53836e0a4d tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 15:38:27 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-0a5d741a-2c6d-4d60-9dee-9e53836e0a4d tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 15:38:27 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-0a5d741a-2c6d-4d60-9dee-9e53836e0a4d tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] CPU controller missing on host. {{(pid=75337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 15:38:27 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-0a5d741a-2c6d-4d60-9dee-9e53836e0a4d tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 15:38:27 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-0a5d741a-2c6d-4d60-9dee-9e53836e0a4d tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] CPU controller found on host. {{(pid=75337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 15:38:27 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-0a5d741a-2c6d-4d60-9dee-9e53836e0a4d tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75337) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 15:38:27 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-0a5d741a-2c6d-4d60-9dee-9e53836e0a4d tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T15:34:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T15:38:13Z,direct_url=<?>,disk_format='qcow2',id=f8a9eaef-bb42-42c2-8a3f-18ae9a3e629b,min_disk=0,min_ram=0,name='',owner='ab7ff05dd4194200a62fdb96e6b1ab01',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T15:38:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 15:38:27 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-0a5d741a-2c6d-4d60-9dee-9e53836e0a4d tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] Flavor limits 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 15:38:27 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-0a5d741a-2c6d-4d60-9dee-9e53836e0a4d tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] Image limits 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 15:38:27 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-0a5d741a-2c6d-4d60-9dee-9e53836e0a4d tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] Flavor pref 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 15:38:27 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-0a5d741a-2c6d-4d60-9dee-9e53836e0a4d tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] Image pref 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 15:38:27 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-0a5d741a-2c6d-4d60-9dee-9e53836e0a4d tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 15:38:27 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-0a5d741a-2c6d-4d60-9dee-9e53836e0a4d tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 15:38:27 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-0a5d741a-2c6d-4d60-9dee-9e53836e0a4d tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 15:38:27 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-0a5d741a-2c6d-4d60-9dee-9e53836e0a4d tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] Got 1 possible topologies {{(pid=75337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 15:38:27 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-0a5d741a-2c6d-4d60-9dee-9e53836e0a4d tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 15:38:27 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-0a5d741a-2c6d-4d60-9dee-9e53836e0a4d tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 15:38:27 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-0a5d741a-2c6d-4d60-9dee-9e53836e0a4d tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T15:38:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-201329404',display_name='tempest-AttachSCSIVolumeTestJSON-server-201329404',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-201329404',id=7,image_ref='f8a9eaef-bb42-42c2-8a3f-18ae9a3e629b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCc9GjtpgedV1+fm3enhgtH75uDO4F0PRkthdweNfH+DjinweR/KsJr5LkNKl4WEwMAL8dd/5Pvlm0dpc330PZuZxpKPkllX2DeUgzAxJpScFt3H3rso5vDvEICm7GRZ5g==',key_name='tempest-keypair-512953345',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dc4e4ce6f66541f380a8bbb0671657f3',ramdisk_id='',reservation_id='r-rjbc7q98',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f8a9eaef-bb42-42c2-8a3f-18ae9a3e629b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-2089763587',owner_user_name='tempest-AttachSCSIVolumeTestJSON-2089763587-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T15:38:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4eb5c53de9ed4929aa60551a1cd99d3d',uuid=8858d90e-ee14-494b-80da-904cd97cdff0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d4c8113e-f11f-442c-bd08-206acb4a0416", "address": "fa:16:3e:d5:8c:cf", "network": {"id": "54c79a10-5da3-4de7-b93f-855e966b7101", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-39876549-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc4e4ce6f66541f380a8bbb0671657f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4c8113e-f1", "ovs_interfaceid": "d4c8113e-f11f-442c-bd08-206acb4a0416", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75337) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 15:38:27 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-0a5d741a-2c6d-4d60-9dee-9e53836e0a4d tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] Converting VIF {"id": "d4c8113e-f11f-442c-bd08-206acb4a0416", "address": "fa:16:3e:d5:8c:cf", "network": {"id": "54c79a10-5da3-4de7-b93f-855e966b7101", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-39876549-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc4e4ce6f66541f380a8bbb0671657f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4c8113e-f1", "ovs_interfaceid": "d4c8113e-f11f-442c-bd08-206acb4a0416", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 15:38:27 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-0a5d741a-2c6d-4d60-9dee-9e53836e0a4d tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:8c:cf,bridge_name='br-int',has_traffic_filtering=True,id=d4c8113e-f11f-442c-bd08-206acb4a0416,network=Network(54c79a10-5da3-4de7-b93f-855e966b7101),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4c8113e-f1') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 15:38:27 user nova-compute[75337]: DEBUG nova.objects.instance [None req-0a5d741a-2c6d-4d60-9dee-9e53836e0a4d tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] Lazy-loading 'pci_devices' on Instance uuid 8858d90e-ee14-494b-80da-904cd97cdff0 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 15:38:27 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-0a5d741a-2c6d-4d60-9dee-9e53836e0a4d tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] [instance: 8858d90e-ee14-494b-80da-904cd97cdff0] End _get_guest_xml xml=<domain type="kvm">
Nov 06 15:38:27 user nova-compute[75337]:   <uuid>8858d90e-ee14-494b-80da-904cd97cdff0</uuid>
Nov 06 15:38:27 user nova-compute[75337]:   <name>instance-00000007</name>
Nov 06 15:38:27 user nova-compute[75337]:   <memory>524288</memory>
Nov 06 15:38:27 user nova-compute[75337]:   <vcpu>1</vcpu>
Nov 06 15:38:27 user nova-compute[75337]:   <metadata>
Nov 06 15:38:27 user nova-compute[75337]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 15:38:27 user nova-compute[75337]:       <nova:package version="0.0.0"/>
Nov 06 15:38:27 user nova-compute[75337]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-201329404</nova:name>
Nov 06 15:38:27 user nova-compute[75337]:       <nova:creationTime>2023-11-06 15:38:27</nova:creationTime>
Nov 06 15:38:27 user nova-compute[75337]:       <nova:flavor name="m1.tiny">
Nov 06 15:38:27 user nova-compute[75337]:         <nova:memory>512</nova:memory>
Nov 06 15:38:27 user nova-compute[75337]:         <nova:disk>1</nova:disk>
Nov 06 15:38:27 user nova-compute[75337]:         <nova:swap>0</nova:swap>
Nov 06 15:38:27 user nova-compute[75337]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 15:38:27 user nova-compute[75337]:         <nova:vcpus>1</nova:vcpus>
Nov 06 15:38:27 user nova-compute[75337]:       </nova:flavor>
Nov 06 15:38:27 user nova-compute[75337]:       <nova:owner>
Nov 06 15:38:27 user nova-compute[75337]:         <nova:user uuid="4eb5c53de9ed4929aa60551a1cd99d3d">tempest-AttachSCSIVolumeTestJSON-2089763587-project-member</nova:user>
Nov 06 15:38:27 user nova-compute[75337]:         <nova:project uuid="dc4e4ce6f66541f380a8bbb0671657f3">tempest-AttachSCSIVolumeTestJSON-2089763587</nova:project>
Nov 06 15:38:27 user nova-compute[75337]:       </nova:owner>
Nov 06 15:38:27 user nova-compute[75337]:       <nova:root type="image" uuid="f8a9eaef-bb42-42c2-8a3f-18ae9a3e629b"/>
Nov 06 15:38:27 user nova-compute[75337]:       <nova:ports>
Nov 06 15:38:27 user nova-compute[75337]:         <nova:port uuid="d4c8113e-f11f-442c-bd08-206acb4a0416">
Nov 06 15:38:27 user nova-compute[75337]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 06 15:38:27 user nova-compute[75337]:         </nova:port>
Nov 06 15:38:27 user nova-compute[75337]:       </nova:ports>
Nov 06 15:38:27 user nova-compute[75337]:     </nova:instance>
Nov 06 15:38:27 user nova-compute[75337]:   </metadata>
Nov 06 15:38:27 user nova-compute[75337]:   <sysinfo type="smbios">
Nov 06 15:38:27 user nova-compute[75337]:     <system>
Nov 06 15:38:27 user nova-compute[75337]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 15:38:27 user nova-compute[75337]:       <entry name="product">OpenStack Nova</entry>
Nov 06 15:38:27 user nova-compute[75337]:       <entry name="version">0.0.0</entry>
Nov 06 15:38:27 user nova-compute[75337]:       <entry name="serial">8858d90e-ee14-494b-80da-904cd97cdff0</entry>
Nov 06 15:38:27 user nova-compute[75337]:       <entry name="uuid">8858d90e-ee14-494b-80da-904cd97cdff0</entry>
Nov 06 15:38:27 user nova-compute[75337]:       <entry name="family">Virtual Machine</entry>
Nov 06 15:38:27 user nova-compute[75337]:     </system>
Nov 06 15:38:27 user nova-compute[75337]:   </sysinfo>
Nov 06 15:38:27 user nova-compute[75337]:   <os>
Nov 06 15:38:27 user nova-compute[75337]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 15:38:27 user nova-compute[75337]:     <boot dev="hd"/>
Nov 06 15:38:27 user nova-compute[75337]:     <smbios mode="sysinfo"/>
Nov 06 15:38:27 user nova-compute[75337]:   </os>
Nov 06 15:38:27 user nova-compute[75337]:   <features>
Nov 06 15:38:27 user nova-compute[75337]:     <acpi/>
Nov 06 15:38:27 user nova-compute[75337]:     <apic/>
Nov 06 15:38:27 user nova-compute[75337]:     <vmcoreinfo/>
Nov 06 15:38:27 user nova-compute[75337]:   </features>
Nov 06 15:38:27 user nova-compute[75337]:   <clock offset="utc">
Nov 06 15:38:27 user nova-compute[75337]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 15:38:27 user nova-compute[75337]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 15:38:27 user nova-compute[75337]:     <timer name="hpet" present="no"/>
Nov 06 15:38:27 user nova-compute[75337]:   </clock>
Nov 06 15:38:27 user nova-compute[75337]:   <cpu mode="custom" match="exact">
Nov 06 15:38:27 user nova-compute[75337]:     <model>Nehalem</model>
Nov 06 15:38:27 user nova-compute[75337]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 15:38:27 user nova-compute[75337]:   </cpu>
Nov 06 15:38:27 user nova-compute[75337]:   <devices>
Nov 06 15:38:27 user nova-compute[75337]:     <disk type="file" device="disk">
Nov 06 15:38:27 user nova-compute[75337]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 15:38:27 user nova-compute[75337]:       <source file="/opt/stack/data/nova/instances/8858d90e-ee14-494b-80da-904cd97cdff0/disk"/>
Nov 06 15:38:27 user nova-compute[75337]:       <target dev="sda" bus="scsi"/>
Nov 06 15:38:27 user nova-compute[75337]:       <address type="drive" controller="0" unit="0"/>
Nov 06 15:38:27 user nova-compute[75337]:     </disk>
Nov 06 15:38:27 user nova-compute[75337]:     <disk type="file" device="cdrom">
Nov 06 15:38:27 user nova-compute[75337]:       <driver name="qemu" type="raw" cache="none"/>
Nov 06 15:38:27 user nova-compute[75337]:       <source file="/opt/stack/data/nova/instances/8858d90e-ee14-494b-80da-904cd97cdff0/disk.config"/>
Nov 06 15:38:27 user nova-compute[75337]:       <target dev="sdb" bus="scsi"/>
Nov 06 15:38:27 user nova-compute[75337]:       <address type="drive" controller="0" unit="1"/>
Nov 06 15:38:27 user nova-compute[75337]:     </disk>
Nov 06 15:38:27 user nova-compute[75337]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Nov 06 15:38:27 user nova-compute[75337]:     <interface type="ethernet">
Nov 06 15:38:27 user nova-compute[75337]:       <mac address="fa:16:3e:d5:8c:cf"/>
Nov 06 15:38:27 user nova-compute[75337]:       <model type="virtio"/>
Nov 06 15:38:27 user nova-compute[75337]:       <mtu size="1442"/>
Nov 06 15:38:27 user nova-compute[75337]:       <target dev="tapd4c8113e-f1"/>
Nov 06 15:38:27 user nova-compute[75337]:     </interface>
Nov 06 15:38:27 user nova-compute[75337]:     <serial type="pty">
Nov 06 15:38:27 user nova-compute[75337]:       <log file="/opt/stack/data/nova/instances/8858d90e-ee14-494b-80da-904cd97cdff0/console.log" append="off"/>
Nov 06 15:38:27 user nova-compute[75337]:     </serial>
Nov 06 15:38:27 user nova-compute[75337]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 15:38:27 user nova-compute[75337]:     <video>
Nov 06 15:38:27 user nova-compute[75337]:       <model type="virtio"/>
Nov 06 15:38:27 user nova-compute[75337]:     </video>
Nov 06 15:38:27 user nova-compute[75337]:     <rng model="virtio">
Nov 06 15:38:27 user nova-compute[75337]:       <backend model="random">/dev/urandom</backend>
Nov 06 15:38:27 user nova-compute[75337]:     </rng>
Nov 06 15:38:27 user nova-compute[75337]:     <controller type="usb" index="0" model="none"/>
Nov 06 15:38:27 user nova-compute[75337]:     <memballoon model="virtio">
Nov 06 15:38:27 user nova-compute[75337]:       <stats period="10"/>
Nov 06 15:38:27 user nova-compute[75337]:     </memballoon>
Nov 06 15:38:27 user nova-compute[75337]:   </devices>
Nov 06 15:38:27 user nova-compute[75337]: </domain>
Nov 06 15:38:27 user nova-compute[75337]:  {{(pid=75337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 15:38:27 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-0a5d741a-2c6d-4d60-9dee-9e53836e0a4d tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T15:38:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-201329404',display_name='tempest-AttachSCSIVolumeTestJSON-server-201329404',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-201329404',id=7,image_ref='f8a9eaef-bb42-42c2-8a3f-18ae9a3e629b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCc9GjtpgedV1+fm3enhgtH75uDO4F0PRkthdweNfH+DjinweR/KsJr5LkNKl4WEwMAL8dd/5Pvlm0dpc330PZuZxpKPkllX2DeUgzAxJpScFt3H3rso5vDvEICm7GRZ5g==',key_name='tempest-keypair-512953345',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dc4e4ce6f66541f380a8bbb0671657f3',ramdisk_id='',reservation_id='r-rjbc7q98',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f8a9eaef-bb42-42c2-8a3f-18ae9a3e629b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-2089763587',owner_user_name='tempest-AttachSCSIVolumeTestJSON-2089763587-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T15:38:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4eb5c53de9ed4929aa60551a1cd99d3d',uuid=8858d90e-ee14-494b-80da-904cd97cdff0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d4c8113e-f11f-442c-bd08-206acb4a0416", "address": "fa:16:3e:d5:8c:cf", "network": {"id": "54c79a10-5da3-4de7-b93f-855e966b7101", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-39876549-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc4e4ce6f66541f380a8bbb0671657f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4c8113e-f1", "ovs_interfaceid": "d4c8113e-f11f-442c-bd08-206acb4a0416", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 15:38:27 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-0a5d741a-2c6d-4d60-9dee-9e53836e0a4d tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] Converting VIF {"id": "d4c8113e-f11f-442c-bd08-206acb4a0416", "address": "fa:16:3e:d5:8c:cf", "network": {"id": "54c79a10-5da3-4de7-b93f-855e966b7101", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-39876549-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc4e4ce6f66541f380a8bbb0671657f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4c8113e-f1", "ovs_interfaceid": "d4c8113e-f11f-442c-bd08-206acb4a0416", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 15:38:27 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-0a5d741a-2c6d-4d60-9dee-9e53836e0a4d tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:8c:cf,bridge_name='br-int',has_traffic_filtering=True,id=d4c8113e-f11f-442c-bd08-206acb4a0416,network=Network(54c79a10-5da3-4de7-b93f-855e966b7101),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4c8113e-f1') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 15:38:27 user nova-compute[75337]: DEBUG os_vif [None req-0a5d741a-2c6d-4d60-9dee-9e53836e0a4d tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:8c:cf,bridge_name='br-int',has_traffic_filtering=True,id=d4c8113e-f11f-442c-bd08-206acb4a0416,network=Network(54c79a10-5da3-4de7-b93f-855e966b7101),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4c8113e-f1') {{(pid=75337) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 15:38:27 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:38:27 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:38:27 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 15:38:27 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:38:27 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'db38ea58-e8a6-5783-9c16-06d3a987119d', '_type': 'linux-noop'}}, row=False) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:38:27 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:38:27 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:38:27 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:38:27 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:38:27 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd4c8113e-f1, may_exist=True, interface_attrs={}) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:38:27 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd4c8113e-f1, col_values=(('qos', UUID('bd2fc06b-1ccb-45c8-be0f-f17993644027')),), if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:38:27 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd4c8113e-f1, col_values=(('external_ids', {'iface-id': 'd4c8113e-f11f-442c-bd08-206acb4a0416', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d5:8c:cf', 'vm-uuid': '8858d90e-ee14-494b-80da-904cd97cdff0'}),), if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:38:27 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:38:27 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:38:27 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:38:27 user nova-compute[75337]: INFO os_vif [None req-0a5d741a-2c6d-4d60-9dee-9e53836e0a4d tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:8c:cf,bridge_name='br-int',has_traffic_filtering=True,id=d4c8113e-f11f-442c-bd08-206acb4a0416,network=Network(54c79a10-5da3-4de7-b93f-855e966b7101),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4c8113e-f1')
Nov 06 15:38:27 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-0a5d741a-2c6d-4d60-9dee-9e53836e0a4d tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] No BDM found with device name sda, not building metadata. {{(pid=75337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 15:38:27 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-0a5d741a-2c6d-4d60-9dee-9e53836e0a4d tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] No BDM found with device name sdb, not building metadata. {{(pid=75337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 15:38:27 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-0a5d741a-2c6d-4d60-9dee-9e53836e0a4d tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] No VIF found with MAC fa:16:3e:d5:8c:cf, not building metadata {{(pid=75337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 15:38:27 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-0a5d741a-2c6d-4d60-9dee-9e53836e0a4d tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] [instance: 8858d90e-ee14-494b-80da-904cd97cdff0] Using config drive
Nov 06 15:38:28 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:38:28 user nova-compute[75337]: DEBUG nova.network.neutron [req-42f09932-6995-46d9-bef6-97bc2589f3cf req-ec80325e-725e-4916-9c9f-d679cd3e28e9 service nova] [instance: 8858d90e-ee14-494b-80da-904cd97cdff0] Updated VIF entry in instance network info cache for port d4c8113e-f11f-442c-bd08-206acb4a0416. {{(pid=75337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 15:38:28 user nova-compute[75337]: DEBUG nova.network.neutron [req-42f09932-6995-46d9-bef6-97bc2589f3cf req-ec80325e-725e-4916-9c9f-d679cd3e28e9 service nova] [instance: 8858d90e-ee14-494b-80da-904cd97cdff0] Updating instance_info_cache with network_info: [{"id": "d4c8113e-f11f-442c-bd08-206acb4a0416", "address": "fa:16:3e:d5:8c:cf", "network": {"id": "54c79a10-5da3-4de7-b93f-855e966b7101", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-39876549-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc4e4ce6f66541f380a8bbb0671657f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4c8113e-f1", "ovs_interfaceid": "d4c8113e-f11f-442c-bd08-206acb4a0416", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:38:28 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-42f09932-6995-46d9-bef6-97bc2589f3cf req-ec80325e-725e-4916-9c9f-d679cd3e28e9 service nova] Releasing lock "refresh_cache-8858d90e-ee14-494b-80da-904cd97cdff0" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 15:38:28 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-0a5d741a-2c6d-4d60-9dee-9e53836e0a4d tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] [instance: 8858d90e-ee14-494b-80da-904cd97cdff0] Creating config drive at /opt/stack/data/nova/instances/8858d90e-ee14-494b-80da-904cd97cdff0/disk.config
Nov 06 15:38:28 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-0a5d741a-2c6d-4d60-9dee-9e53836e0a4d tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/8858d90e-ee14-494b-80da-904cd97cdff0/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpd20ftu6p {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:38:28 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-0a5d741a-2c6d-4d60-9dee-9e53836e0a4d tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/8858d90e-ee14-494b-80da-904cd97cdff0/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpd20ftu6p" returned: 0 in 0.092s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:38:30 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:38:30 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:38:30 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:38:31 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:38:31 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:38:31 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:38:31 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:38:32 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:38:33 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:38:33 user nova-compute[75337]: DEBUG nova.compute.manager [None req-0a5d741a-2c6d-4d60-9dee-9e53836e0a4d tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] [instance: 8858d90e-ee14-494b-80da-904cd97cdff0] Instance event wait completed in 0 seconds for  {{(pid=75337) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 15:38:33 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-0a5d741a-2c6d-4d60-9dee-9e53836e0a4d tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] [instance: 8858d90e-ee14-494b-80da-904cd97cdff0] Guest created on hypervisor {{(pid=75337) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 15:38:33 user nova-compute[75337]: INFO nova.virt.libvirt.driver [-] [instance: 8858d90e-ee14-494b-80da-904cd97cdff0] Instance spawned successfully.
Nov 06 15:38:33 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-0a5d741a-2c6d-4d60-9dee-9e53836e0a4d tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] [instance: 8858d90e-ee14-494b-80da-904cd97cdff0] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 15:38:33 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-0a5d741a-2c6d-4d60-9dee-9e53836e0a4d tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] [instance: 8858d90e-ee14-494b-80da-904cd97cdff0] Found default for hw_input_bus of None {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:38:33 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-0a5d741a-2c6d-4d60-9dee-9e53836e0a4d tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] [instance: 8858d90e-ee14-494b-80da-904cd97cdff0] Found default for hw_pointer_model of None {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:38:33 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-0a5d741a-2c6d-4d60-9dee-9e53836e0a4d tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] [instance: 8858d90e-ee14-494b-80da-904cd97cdff0] Found default for hw_video_model of virtio {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:38:33 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-0a5d741a-2c6d-4d60-9dee-9e53836e0a4d tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] [instance: 8858d90e-ee14-494b-80da-904cd97cdff0] Found default for hw_vif_model of virtio {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:38:34 user nova-compute[75337]: INFO nova.compute.manager [None req-0a5d741a-2c6d-4d60-9dee-9e53836e0a4d tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] [instance: 8858d90e-ee14-494b-80da-904cd97cdff0] Took 9.94 seconds to spawn the instance on the hypervisor.
Nov 06 15:38:34 user nova-compute[75337]: DEBUG nova.compute.manager [None req-0a5d741a-2c6d-4d60-9dee-9e53836e0a4d tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] [instance: 8858d90e-ee14-494b-80da-904cd97cdff0] Checking state {{(pid=75337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 15:38:34 user nova-compute[75337]: INFO nova.compute.manager [None req-0a5d741a-2c6d-4d60-9dee-9e53836e0a4d tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] [instance: 8858d90e-ee14-494b-80da-904cd97cdff0] Took 11.03 seconds to build instance.
Nov 06 15:38:34 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-0a5d741a-2c6d-4d60-9dee-9e53836e0a4d tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] Lock "8858d90e-ee14-494b-80da-904cd97cdff0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.226s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:38:35 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-be864ead-43f0-4519-a6cc-da53723e90b6 tempest-VolumesAssistedSnapshotsTest-618385559 tempest-VolumesAssistedSnapshotsTest-618385559-project-member] Acquiring lock "cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:38:35 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-be864ead-43f0-4519-a6cc-da53723e90b6 tempest-VolumesAssistedSnapshotsTest-618385559 tempest-VolumesAssistedSnapshotsTest-618385559-project-member] Lock "cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:38:35 user nova-compute[75337]: DEBUG nova.compute.manager [None req-be864ead-43f0-4519-a6cc-da53723e90b6 tempest-VolumesAssistedSnapshotsTest-618385559 tempest-VolumesAssistedSnapshotsTest-618385559-project-member] [instance: cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1] Starting instance... {{(pid=75337) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 15:38:36 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-be864ead-43f0-4519-a6cc-da53723e90b6 tempest-VolumesAssistedSnapshotsTest-618385559 tempest-VolumesAssistedSnapshotsTest-618385559-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:38:36 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-be864ead-43f0-4519-a6cc-da53723e90b6 tempest-VolumesAssistedSnapshotsTest-618385559 tempest-VolumesAssistedSnapshotsTest-618385559-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:38:36 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-be864ead-43f0-4519-a6cc-da53723e90b6 tempest-VolumesAssistedSnapshotsTest-618385559 tempest-VolumesAssistedSnapshotsTest-618385559-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75337) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 15:38:36 user nova-compute[75337]: INFO nova.compute.claims [None req-be864ead-43f0-4519-a6cc-da53723e90b6 tempest-VolumesAssistedSnapshotsTest-618385559 tempest-VolumesAssistedSnapshotsTest-618385559-project-member] [instance: cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1] Claim successful on node user
Nov 06 15:38:36 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-be864ead-43f0-4519-a6cc-da53723e90b6 tempest-VolumesAssistedSnapshotsTest-618385559 tempest-VolumesAssistedSnapshotsTest-618385559-project-member] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 15:38:36 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-be864ead-43f0-4519-a6cc-da53723e90b6 tempest-VolumesAssistedSnapshotsTest-618385559 tempest-VolumesAssistedSnapshotsTest-618385559-project-member] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 15:38:36 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-be864ead-43f0-4519-a6cc-da53723e90b6 tempest-VolumesAssistedSnapshotsTest-618385559 tempest-VolumesAssistedSnapshotsTest-618385559-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.460s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:38:36 user nova-compute[75337]: DEBUG nova.compute.manager [None req-be864ead-43f0-4519-a6cc-da53723e90b6 tempest-VolumesAssistedSnapshotsTest-618385559 tempest-VolumesAssistedSnapshotsTest-618385559-project-member] [instance: cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1] Start building networks asynchronously for instance. {{(pid=75337) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 15:38:36 user nova-compute[75337]: DEBUG nova.compute.manager [None req-be864ead-43f0-4519-a6cc-da53723e90b6 tempest-VolumesAssistedSnapshotsTest-618385559 tempest-VolumesAssistedSnapshotsTest-618385559-project-member] [instance: cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1] Allocating IP information in the background. {{(pid=75337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 15:38:36 user nova-compute[75337]: DEBUG nova.network.neutron [None req-be864ead-43f0-4519-a6cc-da53723e90b6 tempest-VolumesAssistedSnapshotsTest-618385559 tempest-VolumesAssistedSnapshotsTest-618385559-project-member] [instance: cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1] allocate_for_instance() {{(pid=75337) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 15:38:36 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-be864ead-43f0-4519-a6cc-da53723e90b6 tempest-VolumesAssistedSnapshotsTest-618385559 tempest-VolumesAssistedSnapshotsTest-618385559-project-member] [instance: cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 15:38:36 user nova-compute[75337]: DEBUG nova.compute.manager [None req-be864ead-43f0-4519-a6cc-da53723e90b6 tempest-VolumesAssistedSnapshotsTest-618385559 tempest-VolumesAssistedSnapshotsTest-618385559-project-member] [instance: cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1] Start building block device mappings for instance. {{(pid=75337) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 15:38:36 user nova-compute[75337]: DEBUG nova.policy [None req-be864ead-43f0-4519-a6cc-da53723e90b6 tempest-VolumesAssistedSnapshotsTest-618385559 tempest-VolumesAssistedSnapshotsTest-618385559-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '68419640fdfc49f2a7f25fabecba9b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '680aa228c77c472abce167f646caeffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75337) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 15:38:36 user nova-compute[75337]: DEBUG nova.compute.manager [None req-be864ead-43f0-4519-a6cc-da53723e90b6 tempest-VolumesAssistedSnapshotsTest-618385559 tempest-VolumesAssistedSnapshotsTest-618385559-project-member] [instance: cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1] Start spawning the instance on the hypervisor. {{(pid=75337) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 15:38:36 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-be864ead-43f0-4519-a6cc-da53723e90b6 tempest-VolumesAssistedSnapshotsTest-618385559 tempest-VolumesAssistedSnapshotsTest-618385559-project-member] [instance: cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1] Creating instance directory {{(pid=75337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 15:38:36 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-be864ead-43f0-4519-a6cc-da53723e90b6 tempest-VolumesAssistedSnapshotsTest-618385559 tempest-VolumesAssistedSnapshotsTest-618385559-project-member] [instance: cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1] Creating image(s)
Nov 06 15:38:36 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-be864ead-43f0-4519-a6cc-da53723e90b6 tempest-VolumesAssistedSnapshotsTest-618385559 tempest-VolumesAssistedSnapshotsTest-618385559-project-member] Acquiring lock "/opt/stack/data/nova/instances/cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:38:36 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-be864ead-43f0-4519-a6cc-da53723e90b6 tempest-VolumesAssistedSnapshotsTest-618385559 tempest-VolumesAssistedSnapshotsTest-618385559-project-member] Lock "/opt/stack/data/nova/instances/cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:38:36 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-be864ead-43f0-4519-a6cc-da53723e90b6 tempest-VolumesAssistedSnapshotsTest-618385559 tempest-VolumesAssistedSnapshotsTest-618385559-project-member] Lock "/opt/stack/data/nova/instances/cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:38:36 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-be864ead-43f0-4519-a6cc-da53723e90b6 tempest-VolumesAssistedSnapshotsTest-618385559 tempest-VolumesAssistedSnapshotsTest-618385559-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:38:37 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-be864ead-43f0-4519-a6cc-da53723e90b6 tempest-VolumesAssistedSnapshotsTest-618385559 tempest-VolumesAssistedSnapshotsTest-618385559-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json" returned: 0 in 0.212s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:38:37 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-be864ead-43f0-4519-a6cc-da53723e90b6 tempest-VolumesAssistedSnapshotsTest-618385559 tempest-VolumesAssistedSnapshotsTest-618385559-project-member] Acquiring lock "06ba3c914798499e686c5ac75886932347225275" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:38:37 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-be864ead-43f0-4519-a6cc-da53723e90b6 tempest-VolumesAssistedSnapshotsTest-618385559 tempest-VolumesAssistedSnapshotsTest-618385559-project-member] Lock "06ba3c914798499e686c5ac75886932347225275" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:38:37 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-be864ead-43f0-4519-a6cc-da53723e90b6 tempest-VolumesAssistedSnapshotsTest-618385559 tempest-VolumesAssistedSnapshotsTest-618385559-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:38:37 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-be864ead-43f0-4519-a6cc-da53723e90b6 tempest-VolumesAssistedSnapshotsTest-618385559 tempest-VolumesAssistedSnapshotsTest-618385559-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json" returned: 0 in 0.223s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:38:37 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-be864ead-43f0-4519-a6cc-da53723e90b6 tempest-VolumesAssistedSnapshotsTest-618385559 tempest-VolumesAssistedSnapshotsTest-618385559-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275,backing_fmt=raw /opt/stack/data/nova/instances/cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1/disk 1073741824 {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:38:37 user nova-compute[75337]: DEBUG nova.network.neutron [None req-be864ead-43f0-4519-a6cc-da53723e90b6 tempest-VolumesAssistedSnapshotsTest-618385559 tempest-VolumesAssistedSnapshotsTest-618385559-project-member] [instance: cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1] Successfully created port: 5b01e7c7-929d-4e31-b8d4-e4ba3bba4ea2 {{(pid=75337) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 15:38:37 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-be864ead-43f0-4519-a6cc-da53723e90b6 tempest-VolumesAssistedSnapshotsTest-618385559 tempest-VolumesAssistedSnapshotsTest-618385559-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275,backing_fmt=raw /opt/stack/data/nova/instances/cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1/disk 1073741824" returned: 0 in 0.083s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:38:37 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-be864ead-43f0-4519-a6cc-da53723e90b6 tempest-VolumesAssistedSnapshotsTest-618385559 tempest-VolumesAssistedSnapshotsTest-618385559-project-member] Lock "06ba3c914798499e686c5ac75886932347225275" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.316s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:38:37 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-be864ead-43f0-4519-a6cc-da53723e90b6 tempest-VolumesAssistedSnapshotsTest-618385559 tempest-VolumesAssistedSnapshotsTest-618385559-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:38:37 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:38:37 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-be864ead-43f0-4519-a6cc-da53723e90b6 tempest-VolumesAssistedSnapshotsTest-618385559 tempest-VolumesAssistedSnapshotsTest-618385559-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json" returned: 0 in 0.273s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:38:37 user nova-compute[75337]: DEBUG nova.virt.disk.api [None req-be864ead-43f0-4519-a6cc-da53723e90b6 tempest-VolumesAssistedSnapshotsTest-618385559 tempest-VolumesAssistedSnapshotsTest-618385559-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1/disk. size=1073741824 {{(pid=75337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 15:38:37 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-be864ead-43f0-4519-a6cc-da53723e90b6 tempest-VolumesAssistedSnapshotsTest-618385559 tempest-VolumesAssistedSnapshotsTest-618385559-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:38:37 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-be864ead-43f0-4519-a6cc-da53723e90b6 tempest-VolumesAssistedSnapshotsTest-618385559 tempest-VolumesAssistedSnapshotsTest-618385559-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:38:37 user nova-compute[75337]: DEBUG nova.virt.disk.api [None req-be864ead-43f0-4519-a6cc-da53723e90b6 tempest-VolumesAssistedSnapshotsTest-618385559 tempest-VolumesAssistedSnapshotsTest-618385559-project-member] Cannot resize image /opt/stack/data/nova/instances/cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1/disk to a smaller size. {{(pid=75337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 06 15:38:37 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-be864ead-43f0-4519-a6cc-da53723e90b6 tempest-VolumesAssistedSnapshotsTest-618385559 tempest-VolumesAssistedSnapshotsTest-618385559-project-member] [instance: cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1] Created local disks {{(pid=75337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 15:38:37 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-be864ead-43f0-4519-a6cc-da53723e90b6 tempest-VolumesAssistedSnapshotsTest-618385559 tempest-VolumesAssistedSnapshotsTest-618385559-project-member] [instance: cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1] Ensure instance console log exists: /opt/stack/data/nova/instances/cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1/console.log {{(pid=75337) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 15:38:37 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-be864ead-43f0-4519-a6cc-da53723e90b6 tempest-VolumesAssistedSnapshotsTest-618385559 tempest-VolumesAssistedSnapshotsTest-618385559-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:38:37 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-be864ead-43f0-4519-a6cc-da53723e90b6 tempest-VolumesAssistedSnapshotsTest-618385559 tempest-VolumesAssistedSnapshotsTest-618385559-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:38:37 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-be864ead-43f0-4519-a6cc-da53723e90b6 tempest-VolumesAssistedSnapshotsTest-618385559 tempest-VolumesAssistedSnapshotsTest-618385559-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:38:38 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:38:38 user nova-compute[75337]: DEBUG nova.network.neutron [None req-be864ead-43f0-4519-a6cc-da53723e90b6 tempest-VolumesAssistedSnapshotsTest-618385559 tempest-VolumesAssistedSnapshotsTest-618385559-project-member] [instance: cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1] Successfully updated port: 5b01e7c7-929d-4e31-b8d4-e4ba3bba4ea2 {{(pid=75337) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 15:38:38 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-be864ead-43f0-4519-a6cc-da53723e90b6 tempest-VolumesAssistedSnapshotsTest-618385559 tempest-VolumesAssistedSnapshotsTest-618385559-project-member] Acquiring lock "refresh_cache-cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 15:38:38 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-be864ead-43f0-4519-a6cc-da53723e90b6 tempest-VolumesAssistedSnapshotsTest-618385559 tempest-VolumesAssistedSnapshotsTest-618385559-project-member] Acquired lock "refresh_cache-cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 15:38:38 user nova-compute[75337]: DEBUG nova.network.neutron [None req-be864ead-43f0-4519-a6cc-da53723e90b6 tempest-VolumesAssistedSnapshotsTest-618385559 tempest-VolumesAssistedSnapshotsTest-618385559-project-member] [instance: cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1] Building network info cache for instance {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 15:38:38 user nova-compute[75337]: DEBUG nova.compute.manager [req-7076e6a4-71ae-4547-9ba5-d7e21ddfdfff req-d1be6559-2354-48c3-beb8-1dc582557368 service nova] [instance: cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1] Received event network-changed-5b01e7c7-929d-4e31-b8d4-e4ba3bba4ea2 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:38:38 user nova-compute[75337]: DEBUG nova.compute.manager [req-7076e6a4-71ae-4547-9ba5-d7e21ddfdfff req-d1be6559-2354-48c3-beb8-1dc582557368 service nova] [instance: cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1] Refreshing instance network info cache due to event network-changed-5b01e7c7-929d-4e31-b8d4-e4ba3bba4ea2. {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 15:38:38 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-7076e6a4-71ae-4547-9ba5-d7e21ddfdfff req-d1be6559-2354-48c3-beb8-1dc582557368 service nova] Acquiring lock "refresh_cache-cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 15:38:38 user nova-compute[75337]: DEBUG nova.network.neutron [None req-be864ead-43f0-4519-a6cc-da53723e90b6 tempest-VolumesAssistedSnapshotsTest-618385559 tempest-VolumesAssistedSnapshotsTest-618385559-project-member] [instance: cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1] Instance cache missing network info. {{(pid=75337) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 15:38:38 user nova-compute[75337]: DEBUG nova.network.neutron [None req-be864ead-43f0-4519-a6cc-da53723e90b6 tempest-VolumesAssistedSnapshotsTest-618385559 tempest-VolumesAssistedSnapshotsTest-618385559-project-member] [instance: cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1] Updating instance_info_cache with network_info: [{"id": "5b01e7c7-929d-4e31-b8d4-e4ba3bba4ea2", "address": "fa:16:3e:67:5c:a5", "network": {"id": "dd669c8a-2e05-46a7-a5e7-4dc06eec4b48", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2014981732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "680aa228c77c472abce167f646caeffd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b01e7c7-92", "ovs_interfaceid": "5b01e7c7-929d-4e31-b8d4-e4ba3bba4ea2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:38:38 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-be864ead-43f0-4519-a6cc-da53723e90b6 tempest-VolumesAssistedSnapshotsTest-618385559 tempest-VolumesAssistedSnapshotsTest-618385559-project-member] Releasing lock "refresh_cache-cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 15:38:38 user nova-compute[75337]: DEBUG nova.compute.manager [None req-be864ead-43f0-4519-a6cc-da53723e90b6 tempest-VolumesAssistedSnapshotsTest-618385559 tempest-VolumesAssistedSnapshotsTest-618385559-project-member] [instance: cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1] Instance network_info: |[{"id": "5b01e7c7-929d-4e31-b8d4-e4ba3bba4ea2", "address": "fa:16:3e:67:5c:a5", "network": {"id": "dd669c8a-2e05-46a7-a5e7-4dc06eec4b48", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2014981732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "680aa228c77c472abce167f646caeffd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b01e7c7-92", "ovs_interfaceid": "5b01e7c7-929d-4e31-b8d4-e4ba3bba4ea2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 15:38:38 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-7076e6a4-71ae-4547-9ba5-d7e21ddfdfff req-d1be6559-2354-48c3-beb8-1dc582557368 service nova] Acquired lock "refresh_cache-cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 15:38:38 user nova-compute[75337]: DEBUG nova.network.neutron [req-7076e6a4-71ae-4547-9ba5-d7e21ddfdfff req-d1be6559-2354-48c3-beb8-1dc582557368 service nova] [instance: cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1] Refreshing network info cache for port 5b01e7c7-929d-4e31-b8d4-e4ba3bba4ea2 {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 15:38:38 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-be864ead-43f0-4519-a6cc-da53723e90b6 tempest-VolumesAssistedSnapshotsTest-618385559 tempest-VolumesAssistedSnapshotsTest-618385559-project-member] [instance: cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1] Start _get_guest_xml network_info=[{"id": "5b01e7c7-929d-4e31-b8d4-e4ba3bba4ea2", "address": "fa:16:3e:67:5c:a5", "network": {"id": "dd669c8a-2e05-46a7-a5e7-4dc06eec4b48", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2014981732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "680aa228c77c472abce167f646caeffd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b01e7c7-92", "ovs_interfaceid": "5b01e7c7-929d-4e31-b8d4-e4ba3bba4ea2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T15:34:14Z,direct_url=<?>,disk_format='qcow2',id=16b903ae-a40f-41a7-985b-4804cce92c62,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6549a15819f1469bbd5eeae8190e3d44',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T15:34:15Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'guest_format': None, 'size': 0, 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '16b903ae-a40f-41a7-985b-4804cce92c62'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 15:38:38 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-be864ead-43f0-4519-a6cc-da53723e90b6 tempest-VolumesAssistedSnapshotsTest-618385559 tempest-VolumesAssistedSnapshotsTest-618385559-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 15:38:38 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-be864ead-43f0-4519-a6cc-da53723e90b6 tempest-VolumesAssistedSnapshotsTest-618385559 tempest-VolumesAssistedSnapshotsTest-618385559-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 15:38:38 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-be864ead-43f0-4519-a6cc-da53723e90b6 tempest-VolumesAssistedSnapshotsTest-618385559 tempest-VolumesAssistedSnapshotsTest-618385559-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 15:38:38 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-be864ead-43f0-4519-a6cc-da53723e90b6 tempest-VolumesAssistedSnapshotsTest-618385559 tempest-VolumesAssistedSnapshotsTest-618385559-project-member] CPU controller missing on host. {{(pid=75337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 15:38:38 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-be864ead-43f0-4519-a6cc-da53723e90b6 tempest-VolumesAssistedSnapshotsTest-618385559 tempest-VolumesAssistedSnapshotsTest-618385559-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 15:38:38 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-be864ead-43f0-4519-a6cc-da53723e90b6 tempest-VolumesAssistedSnapshotsTest-618385559 tempest-VolumesAssistedSnapshotsTest-618385559-project-member] CPU controller found on host. {{(pid=75337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 15:38:39 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-be864ead-43f0-4519-a6cc-da53723e90b6 tempest-VolumesAssistedSnapshotsTest-618385559 tempest-VolumesAssistedSnapshotsTest-618385559-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75337) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 15:38:39 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-be864ead-43f0-4519-a6cc-da53723e90b6 tempest-VolumesAssistedSnapshotsTest-618385559 tempest-VolumesAssistedSnapshotsTest-618385559-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T15:34:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T15:34:14Z,direct_url=<?>,disk_format='qcow2',id=16b903ae-a40f-41a7-985b-4804cce92c62,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6549a15819f1469bbd5eeae8190e3d44',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T15:34:15Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 15:38:39 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-be864ead-43f0-4519-a6cc-da53723e90b6 tempest-VolumesAssistedSnapshotsTest-618385559 tempest-VolumesAssistedSnapshotsTest-618385559-project-member] Flavor limits 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 15:38:39 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-be864ead-43f0-4519-a6cc-da53723e90b6 tempest-VolumesAssistedSnapshotsTest-618385559 tempest-VolumesAssistedSnapshotsTest-618385559-project-member] Image limits 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 15:38:39 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-be864ead-43f0-4519-a6cc-da53723e90b6 tempest-VolumesAssistedSnapshotsTest-618385559 tempest-VolumesAssistedSnapshotsTest-618385559-project-member] Flavor pref 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 15:38:39 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-be864ead-43f0-4519-a6cc-da53723e90b6 tempest-VolumesAssistedSnapshotsTest-618385559 tempest-VolumesAssistedSnapshotsTest-618385559-project-member] Image pref 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 15:38:39 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-be864ead-43f0-4519-a6cc-da53723e90b6 tempest-VolumesAssistedSnapshotsTest-618385559 tempest-VolumesAssistedSnapshotsTest-618385559-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 15:38:39 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-be864ead-43f0-4519-a6cc-da53723e90b6 tempest-VolumesAssistedSnapshotsTest-618385559 tempest-VolumesAssistedSnapshotsTest-618385559-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 15:38:39 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-be864ead-43f0-4519-a6cc-da53723e90b6 tempest-VolumesAssistedSnapshotsTest-618385559 tempest-VolumesAssistedSnapshotsTest-618385559-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 15:38:39 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-be864ead-43f0-4519-a6cc-da53723e90b6 tempest-VolumesAssistedSnapshotsTest-618385559 tempest-VolumesAssistedSnapshotsTest-618385559-project-member] Got 1 possible topologies {{(pid=75337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 15:38:39 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-be864ead-43f0-4519-a6cc-da53723e90b6 tempest-VolumesAssistedSnapshotsTest-618385559 tempest-VolumesAssistedSnapshotsTest-618385559-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 15:38:39 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-be864ead-43f0-4519-a6cc-da53723e90b6 tempest-VolumesAssistedSnapshotsTest-618385559 tempest-VolumesAssistedSnapshotsTest-618385559-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 15:38:39 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-be864ead-43f0-4519-a6cc-da53723e90b6 tempest-VolumesAssistedSnapshotsTest-618385559 tempest-VolumesAssistedSnapshotsTest-618385559-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T15:38:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1302777858',display_name='tempest-VolumesAssistedSnapshotsTest-server-1302777858',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1302777858',id=8,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIhsWHqDTODuLcBxiRUSQheX7d86sMhaM965PgzxoYCmGvOCnp3yCsCa+wanUUhhGedZ+08YfH+0isFE7PuB7qhSLyignpBOtvy6G/pBgvG8dRo87M+p5bgGHRyEayA+oQ==',key_name='tempest-keypair-160800368',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='680aa228c77c472abce167f646caeffd',ramdisk_id='',reservation_id='r-2tji0rxr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-618385559',owner_user_name='tempest-VolumesAssistedSnapshotsTest-618385559-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T15:38:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='68419640fdfc49f2a7f25fabecba9b42',uuid=cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5b01e7c7-929d-4e31-b8d4-e4ba3bba4ea2", "address": "fa:16:3e:67:5c:a5", "network": {"id": "dd669c8a-2e05-46a7-a5e7-4dc06eec4b48", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2014981732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "680aa228c77c472abce167f646caeffd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b01e7c7-92", "ovs_interfaceid": "5b01e7c7-929d-4e31-b8d4-e4ba3bba4ea2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75337) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 15:38:39 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-be864ead-43f0-4519-a6cc-da53723e90b6 tempest-VolumesAssistedSnapshotsTest-618385559 tempest-VolumesAssistedSnapshotsTest-618385559-project-member] Converting VIF {"id": "5b01e7c7-929d-4e31-b8d4-e4ba3bba4ea2", "address": "fa:16:3e:67:5c:a5", "network": {"id": "dd669c8a-2e05-46a7-a5e7-4dc06eec4b48", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2014981732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "680aa228c77c472abce167f646caeffd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b01e7c7-92", "ovs_interfaceid": "5b01e7c7-929d-4e31-b8d4-e4ba3bba4ea2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 15:38:39 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-be864ead-43f0-4519-a6cc-da53723e90b6 tempest-VolumesAssistedSnapshotsTest-618385559 tempest-VolumesAssistedSnapshotsTest-618385559-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:5c:a5,bridge_name='br-int',has_traffic_filtering=True,id=5b01e7c7-929d-4e31-b8d4-e4ba3bba4ea2,network=Network(dd669c8a-2e05-46a7-a5e7-4dc06eec4b48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b01e7c7-92') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 15:38:39 user nova-compute[75337]: DEBUG nova.objects.instance [None req-be864ead-43f0-4519-a6cc-da53723e90b6 tempest-VolumesAssistedSnapshotsTest-618385559 tempest-VolumesAssistedSnapshotsTest-618385559-project-member] Lazy-loading 'pci_devices' on Instance uuid cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 15:38:39 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-be864ead-43f0-4519-a6cc-da53723e90b6 tempest-VolumesAssistedSnapshotsTest-618385559 tempest-VolumesAssistedSnapshotsTest-618385559-project-member] [instance: cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1] End _get_guest_xml xml=<domain type="kvm">
Nov 06 15:38:39 user nova-compute[75337]:   <uuid>cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1</uuid>
Nov 06 15:38:39 user nova-compute[75337]:   <name>instance-00000008</name>
Nov 06 15:38:39 user nova-compute[75337]:   <memory>524288</memory>
Nov 06 15:38:39 user nova-compute[75337]:   <vcpu>1</vcpu>
Nov 06 15:38:39 user nova-compute[75337]:   <metadata>
Nov 06 15:38:39 user nova-compute[75337]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 15:38:39 user nova-compute[75337]:       <nova:package version="0.0.0"/>
Nov 06 15:38:39 user nova-compute[75337]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-1302777858</nova:name>
Nov 06 15:38:39 user nova-compute[75337]:       <nova:creationTime>2023-11-06 15:38:38</nova:creationTime>
Nov 06 15:38:39 user nova-compute[75337]:       <nova:flavor name="m1.tiny">
Nov 06 15:38:39 user nova-compute[75337]:         <nova:memory>512</nova:memory>
Nov 06 15:38:39 user nova-compute[75337]:         <nova:disk>1</nova:disk>
Nov 06 15:38:39 user nova-compute[75337]:         <nova:swap>0</nova:swap>
Nov 06 15:38:39 user nova-compute[75337]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 15:38:39 user nova-compute[75337]:         <nova:vcpus>1</nova:vcpus>
Nov 06 15:38:39 user nova-compute[75337]:       </nova:flavor>
Nov 06 15:38:39 user nova-compute[75337]:       <nova:owner>
Nov 06 15:38:39 user nova-compute[75337]:         <nova:user uuid="68419640fdfc49f2a7f25fabecba9b42">tempest-VolumesAssistedSnapshotsTest-618385559-project-member</nova:user>
Nov 06 15:38:39 user nova-compute[75337]:         <nova:project uuid="680aa228c77c472abce167f646caeffd">tempest-VolumesAssistedSnapshotsTest-618385559</nova:project>
Nov 06 15:38:39 user nova-compute[75337]:       </nova:owner>
Nov 06 15:38:39 user nova-compute[75337]:       <nova:root type="image" uuid="16b903ae-a40f-41a7-985b-4804cce92c62"/>
Nov 06 15:38:39 user nova-compute[75337]:       <nova:ports>
Nov 06 15:38:39 user nova-compute[75337]:         <nova:port uuid="5b01e7c7-929d-4e31-b8d4-e4ba3bba4ea2">
Nov 06 15:38:39 user nova-compute[75337]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 06 15:38:39 user nova-compute[75337]:         </nova:port>
Nov 06 15:38:39 user nova-compute[75337]:       </nova:ports>
Nov 06 15:38:39 user nova-compute[75337]:     </nova:instance>
Nov 06 15:38:39 user nova-compute[75337]:   </metadata>
Nov 06 15:38:39 user nova-compute[75337]:   <sysinfo type="smbios">
Nov 06 15:38:39 user nova-compute[75337]:     <system>
Nov 06 15:38:39 user nova-compute[75337]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 15:38:39 user nova-compute[75337]:       <entry name="product">OpenStack Nova</entry>
Nov 06 15:38:39 user nova-compute[75337]:       <entry name="version">0.0.0</entry>
Nov 06 15:38:39 user nova-compute[75337]:       <entry name="serial">cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1</entry>
Nov 06 15:38:39 user nova-compute[75337]:       <entry name="uuid">cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1</entry>
Nov 06 15:38:39 user nova-compute[75337]:       <entry name="family">Virtual Machine</entry>
Nov 06 15:38:39 user nova-compute[75337]:     </system>
Nov 06 15:38:39 user nova-compute[75337]:   </sysinfo>
Nov 06 15:38:39 user nova-compute[75337]:   <os>
Nov 06 15:38:39 user nova-compute[75337]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 15:38:39 user nova-compute[75337]:     <boot dev="hd"/>
Nov 06 15:38:39 user nova-compute[75337]:     <smbios mode="sysinfo"/>
Nov 06 15:38:39 user nova-compute[75337]:   </os>
Nov 06 15:38:39 user nova-compute[75337]:   <features>
Nov 06 15:38:39 user nova-compute[75337]:     <acpi/>
Nov 06 15:38:39 user nova-compute[75337]:     <apic/>
Nov 06 15:38:39 user nova-compute[75337]:     <vmcoreinfo/>
Nov 06 15:38:39 user nova-compute[75337]:   </features>
Nov 06 15:38:39 user nova-compute[75337]:   <clock offset="utc">
Nov 06 15:38:39 user nova-compute[75337]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 15:38:39 user nova-compute[75337]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 15:38:39 user nova-compute[75337]:     <timer name="hpet" present="no"/>
Nov 06 15:38:39 user nova-compute[75337]:   </clock>
Nov 06 15:38:39 user nova-compute[75337]:   <cpu mode="custom" match="exact">
Nov 06 15:38:39 user nova-compute[75337]:     <model>Nehalem</model>
Nov 06 15:38:39 user nova-compute[75337]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 15:38:39 user nova-compute[75337]:   </cpu>
Nov 06 15:38:39 user nova-compute[75337]:   <devices>
Nov 06 15:38:39 user nova-compute[75337]:     <disk type="file" device="disk">
Nov 06 15:38:39 user nova-compute[75337]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 15:38:39 user nova-compute[75337]:       <source file="/opt/stack/data/nova/instances/cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1/disk"/>
Nov 06 15:38:39 user nova-compute[75337]:       <target dev="vda" bus="virtio"/>
Nov 06 15:38:39 user nova-compute[75337]:     </disk>
Nov 06 15:38:39 user nova-compute[75337]:     <interface type="ethernet">
Nov 06 15:38:39 user nova-compute[75337]:       <mac address="fa:16:3e:67:5c:a5"/>
Nov 06 15:38:39 user nova-compute[75337]:       <model type="virtio"/>
Nov 06 15:38:39 user nova-compute[75337]:       <mtu size="1442"/>
Nov 06 15:38:39 user nova-compute[75337]:       <target dev="tap5b01e7c7-92"/>
Nov 06 15:38:39 user nova-compute[75337]:     </interface>
Nov 06 15:38:39 user nova-compute[75337]:     <serial type="pty">
Nov 06 15:38:39 user nova-compute[75337]:       <log file="/opt/stack/data/nova/instances/cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1/console.log" append="off"/>
Nov 06 15:38:39 user nova-compute[75337]:     </serial>
Nov 06 15:38:39 user nova-compute[75337]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 15:38:39 user nova-compute[75337]:     <video>
Nov 06 15:38:39 user nova-compute[75337]:       <model type="virtio"/>
Nov 06 15:38:39 user nova-compute[75337]:     </video>
Nov 06 15:38:39 user nova-compute[75337]:     <rng model="virtio">
Nov 06 15:38:39 user nova-compute[75337]:       <backend model="random">/dev/urandom</backend>
Nov 06 15:38:39 user nova-compute[75337]:     </rng>
Nov 06 15:38:39 user nova-compute[75337]:     <controller type="usb" index="0" model="none"/>
Nov 06 15:38:39 user nova-compute[75337]:     <memballoon model="virtio">
Nov 06 15:38:39 user nova-compute[75337]:       <stats period="10"/>
Nov 06 15:38:39 user nova-compute[75337]:     </memballoon>
Nov 06 15:38:39 user nova-compute[75337]:   </devices>
Nov 06 15:38:39 user nova-compute[75337]: </domain>
Nov 06 15:38:39 user nova-compute[75337]:  {{(pid=75337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 15:38:39 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-be864ead-43f0-4519-a6cc-da53723e90b6 tempest-VolumesAssistedSnapshotsTest-618385559 tempest-VolumesAssistedSnapshotsTest-618385559-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T15:38:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1302777858',display_name='tempest-VolumesAssistedSnapshotsTest-server-1302777858',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1302777858',id=8,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIhsWHqDTODuLcBxiRUSQheX7d86sMhaM965PgzxoYCmGvOCnp3yCsCa+wanUUhhGedZ+08YfH+0isFE7PuB7qhSLyignpBOtvy6G/pBgvG8dRo87M+p5bgGHRyEayA+oQ==',key_name='tempest-keypair-160800368',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='680aa228c77c472abce167f646caeffd',ramdisk_id='',reservation_id='r-2tji0rxr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-618385559',owner_user_name='tempest-VolumesAssistedSnapshotsTest-618385559-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T15:38:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='68419640fdfc49f2a7f25fabecba9b42',uuid=cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5b01e7c7-929d-4e31-b8d4-e4ba3bba4ea2", "address": "fa:16:3e:67:5c:a5", "network": {"id": "dd669c8a-2e05-46a7-a5e7-4dc06eec4b48", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2014981732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "680aa228c77c472abce167f646caeffd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b01e7c7-92", "ovs_interfaceid": "5b01e7c7-929d-4e31-b8d4-e4ba3bba4ea2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 15:38:39 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-be864ead-43f0-4519-a6cc-da53723e90b6 tempest-VolumesAssistedSnapshotsTest-618385559 tempest-VolumesAssistedSnapshotsTest-618385559-project-member] Converting VIF {"id": "5b01e7c7-929d-4e31-b8d4-e4ba3bba4ea2", "address": "fa:16:3e:67:5c:a5", "network": {"id": "dd669c8a-2e05-46a7-a5e7-4dc06eec4b48", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2014981732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "680aa228c77c472abce167f646caeffd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b01e7c7-92", "ovs_interfaceid": "5b01e7c7-929d-4e31-b8d4-e4ba3bba4ea2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 15:38:39 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-be864ead-43f0-4519-a6cc-da53723e90b6 tempest-VolumesAssistedSnapshotsTest-618385559 tempest-VolumesAssistedSnapshotsTest-618385559-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:5c:a5,bridge_name='br-int',has_traffic_filtering=True,id=5b01e7c7-929d-4e31-b8d4-e4ba3bba4ea2,network=Network(dd669c8a-2e05-46a7-a5e7-4dc06eec4b48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b01e7c7-92') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 15:38:39 user nova-compute[75337]: DEBUG os_vif [None req-be864ead-43f0-4519-a6cc-da53723e90b6 tempest-VolumesAssistedSnapshotsTest-618385559 tempest-VolumesAssistedSnapshotsTest-618385559-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:5c:a5,bridge_name='br-int',has_traffic_filtering=True,id=5b01e7c7-929d-4e31-b8d4-e4ba3bba4ea2,network=Network(dd669c8a-2e05-46a7-a5e7-4dc06eec4b48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b01e7c7-92') {{(pid=75337) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 15:38:39 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:38:39 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:38:39 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 15:38:39 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:38:39 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '03ad8e3a-203b-5aa6-ae40-abe4896332fb', '_type': 'linux-noop'}}, row=False) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:38:39 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:38:39 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:38:39 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:38:39 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5b01e7c7-92, may_exist=True, interface_attrs={}) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:38:39 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5b01e7c7-92, col_values=(('qos', UUID('016244cb-42d5-4b3d-b9b5-980253f9b056')),), if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:38:39 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5b01e7c7-92, col_values=(('external_ids', {'iface-id': '5b01e7c7-929d-4e31-b8d4-e4ba3bba4ea2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:67:5c:a5', 'vm-uuid': 'cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1'}),), if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:38:39 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:38:39 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:38:39 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:38:39 user nova-compute[75337]: INFO os_vif [None req-be864ead-43f0-4519-a6cc-da53723e90b6 tempest-VolumesAssistedSnapshotsTest-618385559 tempest-VolumesAssistedSnapshotsTest-618385559-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:5c:a5,bridge_name='br-int',has_traffic_filtering=True,id=5b01e7c7-929d-4e31-b8d4-e4ba3bba4ea2,network=Network(dd669c8a-2e05-46a7-a5e7-4dc06eec4b48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b01e7c7-92')
Nov 06 15:38:39 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-be864ead-43f0-4519-a6cc-da53723e90b6 tempest-VolumesAssistedSnapshotsTest-618385559 tempest-VolumesAssistedSnapshotsTest-618385559-project-member] No BDM found with device name vda, not building metadata. {{(pid=75337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 15:38:39 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-be864ead-43f0-4519-a6cc-da53723e90b6 tempest-VolumesAssistedSnapshotsTest-618385559 tempest-VolumesAssistedSnapshotsTest-618385559-project-member] No VIF found with MAC fa:16:3e:67:5c:a5, not building metadata {{(pid=75337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 15:38:39 user nova-compute[75337]: DEBUG nova.network.neutron [req-7076e6a4-71ae-4547-9ba5-d7e21ddfdfff req-d1be6559-2354-48c3-beb8-1dc582557368 service nova] [instance: cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1] Updated VIF entry in instance network info cache for port 5b01e7c7-929d-4e31-b8d4-e4ba3bba4ea2. {{(pid=75337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 15:38:39 user nova-compute[75337]: DEBUG nova.network.neutron [req-7076e6a4-71ae-4547-9ba5-d7e21ddfdfff req-d1be6559-2354-48c3-beb8-1dc582557368 service nova] [instance: cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1] Updating instance_info_cache with network_info: [{"id": "5b01e7c7-929d-4e31-b8d4-e4ba3bba4ea2", "address": "fa:16:3e:67:5c:a5", "network": {"id": "dd669c8a-2e05-46a7-a5e7-4dc06eec4b48", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2014981732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "680aa228c77c472abce167f646caeffd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b01e7c7-92", "ovs_interfaceid": "5b01e7c7-929d-4e31-b8d4-e4ba3bba4ea2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:38:39 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-7076e6a4-71ae-4547-9ba5-d7e21ddfdfff req-d1be6559-2354-48c3-beb8-1dc582557368 service nova] Releasing lock "refresh_cache-cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 15:38:39 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:38:40 user nova-compute[75337]: DEBUG nova.compute.manager [req-ca8ab6d7-74f4-4565-b3f9-ed1e4f33a694 req-17f6fb50-da4e-4ea5-ad47-ab602aefe3c4 service nova] [instance: 581cf468-65e7-42e5-9250-c3d645577011] Received event network-vif-plugged-d1c68bac-be37-4645-afcb-2b89f47c1793 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:38:40 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-ca8ab6d7-74f4-4565-b3f9-ed1e4f33a694 req-17f6fb50-da4e-4ea5-ad47-ab602aefe3c4 service nova] Acquiring lock "581cf468-65e7-42e5-9250-c3d645577011-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:38:40 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-ca8ab6d7-74f4-4565-b3f9-ed1e4f33a694 req-17f6fb50-da4e-4ea5-ad47-ab602aefe3c4 service nova] Lock "581cf468-65e7-42e5-9250-c3d645577011-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:38:40 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-ca8ab6d7-74f4-4565-b3f9-ed1e4f33a694 req-17f6fb50-da4e-4ea5-ad47-ab602aefe3c4 service nova] Lock "581cf468-65e7-42e5-9250-c3d645577011-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:38:40 user nova-compute[75337]: DEBUG nova.compute.manager [req-ca8ab6d7-74f4-4565-b3f9-ed1e4f33a694 req-17f6fb50-da4e-4ea5-ad47-ab602aefe3c4 service nova] [instance: 581cf468-65e7-42e5-9250-c3d645577011] No waiting events found dispatching network-vif-plugged-d1c68bac-be37-4645-afcb-2b89f47c1793 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:38:40 user nova-compute[75337]: WARNING nova.compute.manager [req-ca8ab6d7-74f4-4565-b3f9-ed1e4f33a694 req-17f6fb50-da4e-4ea5-ad47-ab602aefe3c4 service nova] [instance: 581cf468-65e7-42e5-9250-c3d645577011] Received unexpected event network-vif-plugged-d1c68bac-be37-4645-afcb-2b89f47c1793 for instance with vm_state active and task_state None.
Nov 06 15:38:40 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:38:40 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:38:40 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:38:40 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:38:41 user nova-compute[75337]: DEBUG nova.compute.manager [req-232ac2f3-37e4-4de4-881c-94a6de520c48 req-e604ff0f-b515-45d6-a588-6ee80ce64b0b service nova] [instance: cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1] Received event network-vif-plugged-5b01e7c7-929d-4e31-b8d4-e4ba3bba4ea2 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:38:41 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-232ac2f3-37e4-4de4-881c-94a6de520c48 req-e604ff0f-b515-45d6-a588-6ee80ce64b0b service nova] Acquiring lock "cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:38:41 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-232ac2f3-37e4-4de4-881c-94a6de520c48 req-e604ff0f-b515-45d6-a588-6ee80ce64b0b service nova] Lock "cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:38:41 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-232ac2f3-37e4-4de4-881c-94a6de520c48 req-e604ff0f-b515-45d6-a588-6ee80ce64b0b service nova] Lock "cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:38:41 user nova-compute[75337]: DEBUG nova.compute.manager [req-232ac2f3-37e4-4de4-881c-94a6de520c48 req-e604ff0f-b515-45d6-a588-6ee80ce64b0b service nova] [instance: cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1] No waiting events found dispatching network-vif-plugged-5b01e7c7-929d-4e31-b8d4-e4ba3bba4ea2 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:38:41 user nova-compute[75337]: WARNING nova.compute.manager [req-232ac2f3-37e4-4de4-881c-94a6de520c48 req-e604ff0f-b515-45d6-a588-6ee80ce64b0b service nova] [instance: cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1] Received unexpected event network-vif-plugged-5b01e7c7-929d-4e31-b8d4-e4ba3bba4ea2 for instance with vm_state building and task_state spawning.
Nov 06 15:38:41 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:38:41 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:38:42 user nova-compute[75337]: DEBUG nova.compute.manager [req-6c1783b9-4f37-4a5f-a564-b6a3c920ebda req-72b9432f-3c1c-4637-87bf-4498be43cbe7 service nova] [instance: 581cf468-65e7-42e5-9250-c3d645577011] Received event network-vif-plugged-d1c68bac-be37-4645-afcb-2b89f47c1793 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:38:42 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-6c1783b9-4f37-4a5f-a564-b6a3c920ebda req-72b9432f-3c1c-4637-87bf-4498be43cbe7 service nova] Acquiring lock "581cf468-65e7-42e5-9250-c3d645577011-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:38:42 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-6c1783b9-4f37-4a5f-a564-b6a3c920ebda req-72b9432f-3c1c-4637-87bf-4498be43cbe7 service nova] Lock "581cf468-65e7-42e5-9250-c3d645577011-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:38:42 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-6c1783b9-4f37-4a5f-a564-b6a3c920ebda req-72b9432f-3c1c-4637-87bf-4498be43cbe7 service nova] Lock "581cf468-65e7-42e5-9250-c3d645577011-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:38:42 user nova-compute[75337]: DEBUG nova.compute.manager [req-6c1783b9-4f37-4a5f-a564-b6a3c920ebda req-72b9432f-3c1c-4637-87bf-4498be43cbe7 service nova] [instance: 581cf468-65e7-42e5-9250-c3d645577011] No waiting events found dispatching network-vif-plugged-d1c68bac-be37-4645-afcb-2b89f47c1793 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:38:42 user nova-compute[75337]: WARNING nova.compute.manager [req-6c1783b9-4f37-4a5f-a564-b6a3c920ebda req-72b9432f-3c1c-4637-87bf-4498be43cbe7 service nova] [instance: 581cf468-65e7-42e5-9250-c3d645577011] Received unexpected event network-vif-plugged-d1c68bac-be37-4645-afcb-2b89f47c1793 for instance with vm_state active and task_state None.
Nov 06 15:38:43 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:38:43 user nova-compute[75337]: DEBUG nova.compute.manager [req-e0ce7dd2-61d3-499c-bfa5-987ce6212782 req-69e7bdc7-d6b5-4958-bc7c-f7ebf5e8573d service nova] [instance: cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1] Received event network-vif-plugged-5b01e7c7-929d-4e31-b8d4-e4ba3bba4ea2 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:38:43 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-e0ce7dd2-61d3-499c-bfa5-987ce6212782 req-69e7bdc7-d6b5-4958-bc7c-f7ebf5e8573d service nova] Acquiring lock "cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:38:43 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-e0ce7dd2-61d3-499c-bfa5-987ce6212782 req-69e7bdc7-d6b5-4958-bc7c-f7ebf5e8573d service nova] Lock "cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:38:43 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-e0ce7dd2-61d3-499c-bfa5-987ce6212782 req-69e7bdc7-d6b5-4958-bc7c-f7ebf5e8573d service nova] Lock "cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:38:43 user nova-compute[75337]: DEBUG nova.compute.manager [req-e0ce7dd2-61d3-499c-bfa5-987ce6212782 req-69e7bdc7-d6b5-4958-bc7c-f7ebf5e8573d service nova] [instance: cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1] No waiting events found dispatching network-vif-plugged-5b01e7c7-929d-4e31-b8d4-e4ba3bba4ea2 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:38:43 user nova-compute[75337]: WARNING nova.compute.manager [req-e0ce7dd2-61d3-499c-bfa5-987ce6212782 req-69e7bdc7-d6b5-4958-bc7c-f7ebf5e8573d service nova] [instance: cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1] Received unexpected event network-vif-plugged-5b01e7c7-929d-4e31-b8d4-e4ba3bba4ea2 for instance with vm_state building and task_state spawning.
Nov 06 15:38:43 user nova-compute[75337]: DEBUG nova.compute.manager [None req-be864ead-43f0-4519-a6cc-da53723e90b6 tempest-VolumesAssistedSnapshotsTest-618385559 tempest-VolumesAssistedSnapshotsTest-618385559-project-member] [instance: cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1] Instance event wait completed in 0 seconds for  {{(pid=75337) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 15:38:43 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-be864ead-43f0-4519-a6cc-da53723e90b6 tempest-VolumesAssistedSnapshotsTest-618385559 tempest-VolumesAssistedSnapshotsTest-618385559-project-member] [instance: cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1] Guest created on hypervisor {{(pid=75337) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 15:38:43 user nova-compute[75337]: INFO nova.virt.libvirt.driver [-] [instance: cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1] Instance spawned successfully.
Nov 06 15:38:43 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-be864ead-43f0-4519-a6cc-da53723e90b6 tempest-VolumesAssistedSnapshotsTest-618385559 tempest-VolumesAssistedSnapshotsTest-618385559-project-member] [instance: cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 15:38:43 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-be864ead-43f0-4519-a6cc-da53723e90b6 tempest-VolumesAssistedSnapshotsTest-618385559 tempest-VolumesAssistedSnapshotsTest-618385559-project-member] [instance: cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1] Found default for hw_cdrom_bus of ide {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:38:43 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-be864ead-43f0-4519-a6cc-da53723e90b6 tempest-VolumesAssistedSnapshotsTest-618385559 tempest-VolumesAssistedSnapshotsTest-618385559-project-member] [instance: cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1] Found default for hw_disk_bus of virtio {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:38:43 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-be864ead-43f0-4519-a6cc-da53723e90b6 tempest-VolumesAssistedSnapshotsTest-618385559 tempest-VolumesAssistedSnapshotsTest-618385559-project-member] [instance: cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1] Found default for hw_input_bus of None {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:38:43 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-be864ead-43f0-4519-a6cc-da53723e90b6 tempest-VolumesAssistedSnapshotsTest-618385559 tempest-VolumesAssistedSnapshotsTest-618385559-project-member] [instance: cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1] Found default for hw_pointer_model of None {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:38:43 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-be864ead-43f0-4519-a6cc-da53723e90b6 tempest-VolumesAssistedSnapshotsTest-618385559 tempest-VolumesAssistedSnapshotsTest-618385559-project-member] [instance: cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1] Found default for hw_video_model of virtio {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:38:43 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-be864ead-43f0-4519-a6cc-da53723e90b6 tempest-VolumesAssistedSnapshotsTest-618385559 tempest-VolumesAssistedSnapshotsTest-618385559-project-member] [instance: cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1] Found default for hw_vif_model of virtio {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:38:43 user nova-compute[75337]: INFO nova.compute.manager [None req-be864ead-43f0-4519-a6cc-da53723e90b6 tempest-VolumesAssistedSnapshotsTest-618385559 tempest-VolumesAssistedSnapshotsTest-618385559-project-member] [instance: cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1] Took 6.64 seconds to spawn the instance on the hypervisor.
Nov 06 15:38:43 user nova-compute[75337]: DEBUG nova.compute.manager [None req-be864ead-43f0-4519-a6cc-da53723e90b6 tempest-VolumesAssistedSnapshotsTest-618385559 tempest-VolumesAssistedSnapshotsTest-618385559-project-member] [instance: cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1] Checking state {{(pid=75337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 15:38:43 user nova-compute[75337]: INFO nova.compute.manager [None req-be864ead-43f0-4519-a6cc-da53723e90b6 tempest-VolumesAssistedSnapshotsTest-618385559 tempest-VolumesAssistedSnapshotsTest-618385559-project-member] [instance: cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1] Took 7.65 seconds to build instance.
Nov 06 15:38:43 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-be864ead-43f0-4519-a6cc-da53723e90b6 tempest-VolumesAssistedSnapshotsTest-618385559 tempest-VolumesAssistedSnapshotsTest-618385559-project-member] Lock "cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.808s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:38:44 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:38:45 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:38:45 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Cleaning up deleted instances {{(pid=75337) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 06 15:38:45 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] There are 0 instances to clean {{(pid=75337) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 06 15:38:45 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:38:45 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Cleaning up deleted instances with incomplete migration  {{(pid=75337) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 06 15:38:45 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:38:46 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-611805bc-0287-433d-a285-14ba3dde83ff tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] Acquiring lock "76ee582b-b887-4d46-8c78-29f42d1a0d26" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:38:46 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-611805bc-0287-433d-a285-14ba3dde83ff tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] Lock "76ee582b-b887-4d46-8c78-29f42d1a0d26" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:38:46 user nova-compute[75337]: DEBUG nova.compute.manager [None req-611805bc-0287-433d-a285-14ba3dde83ff tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] [instance: 76ee582b-b887-4d46-8c78-29f42d1a0d26] Starting instance... {{(pid=75337) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 15:38:46 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-611805bc-0287-433d-a285-14ba3dde83ff tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:38:46 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-611805bc-0287-433d-a285-14ba3dde83ff tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:38:46 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-611805bc-0287-433d-a285-14ba3dde83ff tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75337) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 15:38:46 user nova-compute[75337]: INFO nova.compute.claims [None req-611805bc-0287-433d-a285-14ba3dde83ff tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] [instance: 76ee582b-b887-4d46-8c78-29f42d1a0d26] Claim successful on node user
Nov 06 15:38:47 user nova-compute[75337]: DEBUG nova.compute.manager [req-abc11402-9770-4c21-b1d1-5642fa92e2b5 req-3f573935-48e7-4618-98dd-54e8963c9c12 service nova] [instance: 5f5fc58d-f946-4df0-b8d0-1aefbf0f8cd6] Received event network-vif-plugged-9e5c665f-7b51-497e-b9b7-a0f652321a96 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:38:47 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-abc11402-9770-4c21-b1d1-5642fa92e2b5 req-3f573935-48e7-4618-98dd-54e8963c9c12 service nova] Acquiring lock "5f5fc58d-f946-4df0-b8d0-1aefbf0f8cd6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:38:47 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-abc11402-9770-4c21-b1d1-5642fa92e2b5 req-3f573935-48e7-4618-98dd-54e8963c9c12 service nova] Lock "5f5fc58d-f946-4df0-b8d0-1aefbf0f8cd6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:38:47 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-abc11402-9770-4c21-b1d1-5642fa92e2b5 req-3f573935-48e7-4618-98dd-54e8963c9c12 service nova] Lock "5f5fc58d-f946-4df0-b8d0-1aefbf0f8cd6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:38:47 user nova-compute[75337]: DEBUG nova.compute.manager [req-abc11402-9770-4c21-b1d1-5642fa92e2b5 req-3f573935-48e7-4618-98dd-54e8963c9c12 service nova] [instance: 5f5fc58d-f946-4df0-b8d0-1aefbf0f8cd6] No waiting events found dispatching network-vif-plugged-9e5c665f-7b51-497e-b9b7-a0f652321a96 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:38:47 user nova-compute[75337]: WARNING nova.compute.manager [req-abc11402-9770-4c21-b1d1-5642fa92e2b5 req-3f573935-48e7-4618-98dd-54e8963c9c12 service nova] [instance: 5f5fc58d-f946-4df0-b8d0-1aefbf0f8cd6] Received unexpected event network-vif-plugged-9e5c665f-7b51-497e-b9b7-a0f652321a96 for instance with vm_state active and task_state None.
Nov 06 15:38:47 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-611805bc-0287-433d-a285-14ba3dde83ff tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 15:38:47 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-611805bc-0287-433d-a285-14ba3dde83ff tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 15:38:47 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-611805bc-0287-433d-a285-14ba3dde83ff tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.728s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:38:47 user nova-compute[75337]: DEBUG nova.compute.manager [None req-611805bc-0287-433d-a285-14ba3dde83ff tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] [instance: 76ee582b-b887-4d46-8c78-29f42d1a0d26] Start building networks asynchronously for instance. {{(pid=75337) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 15:38:47 user nova-compute[75337]: DEBUG nova.compute.manager [None req-611805bc-0287-433d-a285-14ba3dde83ff tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] [instance: 76ee582b-b887-4d46-8c78-29f42d1a0d26] Allocating IP information in the background. {{(pid=75337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 15:38:47 user nova-compute[75337]: DEBUG nova.network.neutron [None req-611805bc-0287-433d-a285-14ba3dde83ff tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] [instance: 76ee582b-b887-4d46-8c78-29f42d1a0d26] allocate_for_instance() {{(pid=75337) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 15:38:47 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:38:47 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-611805bc-0287-433d-a285-14ba3dde83ff tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] [instance: 76ee582b-b887-4d46-8c78-29f42d1a0d26] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 15:38:47 user nova-compute[75337]: DEBUG nova.compute.manager [None req-611805bc-0287-433d-a285-14ba3dde83ff tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] [instance: 76ee582b-b887-4d46-8c78-29f42d1a0d26] Start building block device mappings for instance. {{(pid=75337) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 15:38:47 user nova-compute[75337]: DEBUG nova.policy [None req-611805bc-0287-433d-a285-14ba3dde83ff tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '587c402e2f0d45ad909ae974a03cd20e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4180b3fb8de74de1ad134fe356b85d6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75337) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 15:38:47 user nova-compute[75337]: DEBUG nova.compute.manager [None req-611805bc-0287-433d-a285-14ba3dde83ff tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] [instance: 76ee582b-b887-4d46-8c78-29f42d1a0d26] Start spawning the instance on the hypervisor. {{(pid=75337) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 15:38:47 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-611805bc-0287-433d-a285-14ba3dde83ff tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] [instance: 76ee582b-b887-4d46-8c78-29f42d1a0d26] Creating instance directory {{(pid=75337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 15:38:47 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-611805bc-0287-433d-a285-14ba3dde83ff tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] [instance: 76ee582b-b887-4d46-8c78-29f42d1a0d26] Creating image(s)
Nov 06 15:38:47 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-611805bc-0287-433d-a285-14ba3dde83ff tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] Acquiring lock "/opt/stack/data/nova/instances/76ee582b-b887-4d46-8c78-29f42d1a0d26/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:38:47 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-611805bc-0287-433d-a285-14ba3dde83ff tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] Lock "/opt/stack/data/nova/instances/76ee582b-b887-4d46-8c78-29f42d1a0d26/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:38:47 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-611805bc-0287-433d-a285-14ba3dde83ff tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] Lock "/opt/stack/data/nova/instances/76ee582b-b887-4d46-8c78-29f42d1a0d26/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:38:47 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-611805bc-0287-433d-a285-14ba3dde83ff tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:38:48 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:38:48 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-611805bc-0287-433d-a285-14ba3dde83ff tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json" returned: 0 in 0.265s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:38:48 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-611805bc-0287-433d-a285-14ba3dde83ff tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] Acquiring lock "06ba3c914798499e686c5ac75886932347225275" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:38:48 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-611805bc-0287-433d-a285-14ba3dde83ff tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] Lock "06ba3c914798499e686c5ac75886932347225275" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:38:48 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-611805bc-0287-433d-a285-14ba3dde83ff tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:38:48 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-611805bc-0287-433d-a285-14ba3dde83ff tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json" returned: 0 in 0.290s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:38:48 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-611805bc-0287-433d-a285-14ba3dde83ff tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275,backing_fmt=raw /opt/stack/data/nova/instances/76ee582b-b887-4d46-8c78-29f42d1a0d26/disk 1073741824 {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:38:48 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-611805bc-0287-433d-a285-14ba3dde83ff tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275,backing_fmt=raw /opt/stack/data/nova/instances/76ee582b-b887-4d46-8c78-29f42d1a0d26/disk 1073741824" returned: 0 in 0.054s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:38:48 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-611805bc-0287-433d-a285-14ba3dde83ff tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] Lock "06ba3c914798499e686c5ac75886932347225275" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.350s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:38:48 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-611805bc-0287-433d-a285-14ba3dde83ff tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:38:48 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:38:48 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:38:48 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:38:48 user nova-compute[75337]: DEBUG nova.network.neutron [None req-611805bc-0287-433d-a285-14ba3dde83ff tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] [instance: 76ee582b-b887-4d46-8c78-29f42d1a0d26] Successfully created port: 8d52e5d0-96a2-44ca-9968-9ac564aeff2c {{(pid=75337) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 15:38:48 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-611805bc-0287-433d-a285-14ba3dde83ff tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json" returned: 0 in 0.235s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:38:48 user nova-compute[75337]: DEBUG nova.virt.disk.api [None req-611805bc-0287-433d-a285-14ba3dde83ff tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] Checking if we can resize image /opt/stack/data/nova/instances/76ee582b-b887-4d46-8c78-29f42d1a0d26/disk. size=1073741824 {{(pid=75337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 15:38:48 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-611805bc-0287-433d-a285-14ba3dde83ff tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76ee582b-b887-4d46-8c78-29f42d1a0d26/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:38:48 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-611805bc-0287-433d-a285-14ba3dde83ff tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76ee582b-b887-4d46-8c78-29f42d1a0d26/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:38:48 user nova-compute[75337]: DEBUG nova.virt.disk.api [None req-611805bc-0287-433d-a285-14ba3dde83ff tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] Cannot resize image /opt/stack/data/nova/instances/76ee582b-b887-4d46-8c78-29f42d1a0d26/disk to a smaller size. {{(pid=75337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 06 15:38:48 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-611805bc-0287-433d-a285-14ba3dde83ff tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] [instance: 76ee582b-b887-4d46-8c78-29f42d1a0d26] Created local disks {{(pid=75337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 15:38:48 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-611805bc-0287-433d-a285-14ba3dde83ff tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] [instance: 76ee582b-b887-4d46-8c78-29f42d1a0d26] Ensure instance console log exists: /opt/stack/data/nova/instances/76ee582b-b887-4d46-8c78-29f42d1a0d26/console.log {{(pid=75337) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 15:38:48 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-611805bc-0287-433d-a285-14ba3dde83ff tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:38:48 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-611805bc-0287-433d-a285-14ba3dde83ff tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:38:48 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-611805bc-0287-433d-a285-14ba3dde83ff tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:38:49 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:38:49 user nova-compute[75337]: DEBUG nova.compute.manager [req-edf5e03e-1d7b-4474-be72-863ed21af807 req-6a3cc2ea-9efb-4443-acba-62497e73bccb service nova] [instance: 5f5fc58d-f946-4df0-b8d0-1aefbf0f8cd6] Received event network-vif-plugged-9e5c665f-7b51-497e-b9b7-a0f652321a96 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:38:49 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-edf5e03e-1d7b-4474-be72-863ed21af807 req-6a3cc2ea-9efb-4443-acba-62497e73bccb service nova] Acquiring lock "5f5fc58d-f946-4df0-b8d0-1aefbf0f8cd6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:38:49 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-edf5e03e-1d7b-4474-be72-863ed21af807 req-6a3cc2ea-9efb-4443-acba-62497e73bccb service nova] Lock "5f5fc58d-f946-4df0-b8d0-1aefbf0f8cd6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:38:49 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-edf5e03e-1d7b-4474-be72-863ed21af807 req-6a3cc2ea-9efb-4443-acba-62497e73bccb service nova] Lock "5f5fc58d-f946-4df0-b8d0-1aefbf0f8cd6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:38:49 user nova-compute[75337]: DEBUG nova.compute.manager [req-edf5e03e-1d7b-4474-be72-863ed21af807 req-6a3cc2ea-9efb-4443-acba-62497e73bccb service nova] [instance: 5f5fc58d-f946-4df0-b8d0-1aefbf0f8cd6] No waiting events found dispatching network-vif-plugged-9e5c665f-7b51-497e-b9b7-a0f652321a96 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:38:49 user nova-compute[75337]: WARNING nova.compute.manager [req-edf5e03e-1d7b-4474-be72-863ed21af807 req-6a3cc2ea-9efb-4443-acba-62497e73bccb service nova] [instance: 5f5fc58d-f946-4df0-b8d0-1aefbf0f8cd6] Received unexpected event network-vif-plugged-9e5c665f-7b51-497e-b9b7-a0f652321a96 for instance with vm_state active and task_state None.
Nov 06 15:38:49 user nova-compute[75337]: DEBUG nova.compute.manager [req-edf5e03e-1d7b-4474-be72-863ed21af807 req-6a3cc2ea-9efb-4443-acba-62497e73bccb service nova] [instance: 83516ff5-c4e7-4e91-a2f9-8af9b51cf475] Received event network-vif-plugged-452cb189-f59e-42e1-80e1-9eebb0c65bd7 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:38:49 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-edf5e03e-1d7b-4474-be72-863ed21af807 req-6a3cc2ea-9efb-4443-acba-62497e73bccb service nova] Acquiring lock "83516ff5-c4e7-4e91-a2f9-8af9b51cf475-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:38:49 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-edf5e03e-1d7b-4474-be72-863ed21af807 req-6a3cc2ea-9efb-4443-acba-62497e73bccb service nova] Lock "83516ff5-c4e7-4e91-a2f9-8af9b51cf475-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:38:49 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-edf5e03e-1d7b-4474-be72-863ed21af807 req-6a3cc2ea-9efb-4443-acba-62497e73bccb service nova] Lock "83516ff5-c4e7-4e91-a2f9-8af9b51cf475-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:38:49 user nova-compute[75337]: DEBUG nova.compute.manager [req-edf5e03e-1d7b-4474-be72-863ed21af807 req-6a3cc2ea-9efb-4443-acba-62497e73bccb service nova] [instance: 83516ff5-c4e7-4e91-a2f9-8af9b51cf475] No waiting events found dispatching network-vif-plugged-452cb189-f59e-42e1-80e1-9eebb0c65bd7 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:38:49 user nova-compute[75337]: WARNING nova.compute.manager [req-edf5e03e-1d7b-4474-be72-863ed21af807 req-6a3cc2ea-9efb-4443-acba-62497e73bccb service nova] [instance: 83516ff5-c4e7-4e91-a2f9-8af9b51cf475] Received unexpected event network-vif-plugged-452cb189-f59e-42e1-80e1-9eebb0c65bd7 for instance with vm_state active and task_state None.
Nov 06 15:38:49 user nova-compute[75337]: DEBUG nova.compute.manager [req-edf5e03e-1d7b-4474-be72-863ed21af807 req-6a3cc2ea-9efb-4443-acba-62497e73bccb service nova] [instance: 83516ff5-c4e7-4e91-a2f9-8af9b51cf475] Received event network-vif-plugged-452cb189-f59e-42e1-80e1-9eebb0c65bd7 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:38:49 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-edf5e03e-1d7b-4474-be72-863ed21af807 req-6a3cc2ea-9efb-4443-acba-62497e73bccb service nova] Acquiring lock "83516ff5-c4e7-4e91-a2f9-8af9b51cf475-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:38:49 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-edf5e03e-1d7b-4474-be72-863ed21af807 req-6a3cc2ea-9efb-4443-acba-62497e73bccb service nova] Lock "83516ff5-c4e7-4e91-a2f9-8af9b51cf475-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:38:49 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-edf5e03e-1d7b-4474-be72-863ed21af807 req-6a3cc2ea-9efb-4443-acba-62497e73bccb service nova] Lock "83516ff5-c4e7-4e91-a2f9-8af9b51cf475-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:38:49 user nova-compute[75337]: DEBUG nova.compute.manager [req-edf5e03e-1d7b-4474-be72-863ed21af807 req-6a3cc2ea-9efb-4443-acba-62497e73bccb service nova] [instance: 83516ff5-c4e7-4e91-a2f9-8af9b51cf475] No waiting events found dispatching network-vif-plugged-452cb189-f59e-42e1-80e1-9eebb0c65bd7 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:38:49 user nova-compute[75337]: WARNING nova.compute.manager [req-edf5e03e-1d7b-4474-be72-863ed21af807 req-6a3cc2ea-9efb-4443-acba-62497e73bccb service nova] [instance: 83516ff5-c4e7-4e91-a2f9-8af9b51cf475] Received unexpected event network-vif-plugged-452cb189-f59e-42e1-80e1-9eebb0c65bd7 for instance with vm_state active and task_state None.
Nov 06 15:38:49 user nova-compute[75337]: DEBUG nova.compute.manager [req-edf5e03e-1d7b-4474-be72-863ed21af807 req-6a3cc2ea-9efb-4443-acba-62497e73bccb service nova] [instance: 8858d90e-ee14-494b-80da-904cd97cdff0] Received event network-vif-plugged-d4c8113e-f11f-442c-bd08-206acb4a0416 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:38:49 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-edf5e03e-1d7b-4474-be72-863ed21af807 req-6a3cc2ea-9efb-4443-acba-62497e73bccb service nova] Acquiring lock "8858d90e-ee14-494b-80da-904cd97cdff0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:38:49 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-edf5e03e-1d7b-4474-be72-863ed21af807 req-6a3cc2ea-9efb-4443-acba-62497e73bccb service nova] Lock "8858d90e-ee14-494b-80da-904cd97cdff0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:38:49 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-edf5e03e-1d7b-4474-be72-863ed21af807 req-6a3cc2ea-9efb-4443-acba-62497e73bccb service nova] Lock "8858d90e-ee14-494b-80da-904cd97cdff0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:38:49 user nova-compute[75337]: DEBUG nova.compute.manager [req-edf5e03e-1d7b-4474-be72-863ed21af807 req-6a3cc2ea-9efb-4443-acba-62497e73bccb service nova] [instance: 8858d90e-ee14-494b-80da-904cd97cdff0] No waiting events found dispatching network-vif-plugged-d4c8113e-f11f-442c-bd08-206acb4a0416 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:38:49 user nova-compute[75337]: WARNING nova.compute.manager [req-edf5e03e-1d7b-4474-be72-863ed21af807 req-6a3cc2ea-9efb-4443-acba-62497e73bccb service nova] [instance: 8858d90e-ee14-494b-80da-904cd97cdff0] Received unexpected event network-vif-plugged-d4c8113e-f11f-442c-bd08-206acb4a0416 for instance with vm_state active and task_state None.
Nov 06 15:38:49 user nova-compute[75337]: DEBUG nova.compute.manager [req-edf5e03e-1d7b-4474-be72-863ed21af807 req-6a3cc2ea-9efb-4443-acba-62497e73bccb service nova] [instance: 8858d90e-ee14-494b-80da-904cd97cdff0] Received event network-vif-plugged-d4c8113e-f11f-442c-bd08-206acb4a0416 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:38:49 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-edf5e03e-1d7b-4474-be72-863ed21af807 req-6a3cc2ea-9efb-4443-acba-62497e73bccb service nova] Acquiring lock "8858d90e-ee14-494b-80da-904cd97cdff0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:38:49 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-edf5e03e-1d7b-4474-be72-863ed21af807 req-6a3cc2ea-9efb-4443-acba-62497e73bccb service nova] Lock "8858d90e-ee14-494b-80da-904cd97cdff0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:38:49 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-edf5e03e-1d7b-4474-be72-863ed21af807 req-6a3cc2ea-9efb-4443-acba-62497e73bccb service nova] Lock "8858d90e-ee14-494b-80da-904cd97cdff0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:38:49 user nova-compute[75337]: DEBUG nova.compute.manager [req-edf5e03e-1d7b-4474-be72-863ed21af807 req-6a3cc2ea-9efb-4443-acba-62497e73bccb service nova] [instance: 8858d90e-ee14-494b-80da-904cd97cdff0] No waiting events found dispatching network-vif-plugged-d4c8113e-f11f-442c-bd08-206acb4a0416 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:38:49 user nova-compute[75337]: WARNING nova.compute.manager [req-edf5e03e-1d7b-4474-be72-863ed21af807 req-6a3cc2ea-9efb-4443-acba-62497e73bccb service nova] [instance: 8858d90e-ee14-494b-80da-904cd97cdff0] Received unexpected event network-vif-plugged-d4c8113e-f11f-442c-bd08-206acb4a0416 for instance with vm_state active and task_state None.
Nov 06 15:38:49 user nova-compute[75337]: DEBUG nova.network.neutron [None req-611805bc-0287-433d-a285-14ba3dde83ff tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] [instance: 76ee582b-b887-4d46-8c78-29f42d1a0d26] Successfully updated port: 8d52e5d0-96a2-44ca-9968-9ac564aeff2c {{(pid=75337) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 15:38:49 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-611805bc-0287-433d-a285-14ba3dde83ff tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] Acquiring lock "refresh_cache-76ee582b-b887-4d46-8c78-29f42d1a0d26" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 15:38:49 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-611805bc-0287-433d-a285-14ba3dde83ff tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] Acquired lock "refresh_cache-76ee582b-b887-4d46-8c78-29f42d1a0d26" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 15:38:49 user nova-compute[75337]: DEBUG nova.network.neutron [None req-611805bc-0287-433d-a285-14ba3dde83ff tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] [instance: 76ee582b-b887-4d46-8c78-29f42d1a0d26] Building network info cache for instance {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 15:38:49 user nova-compute[75337]: DEBUG nova.compute.manager [req-9d184114-1932-4ec8-93c0-5380894eea30 req-4664d806-8a35-49fa-b46f-eef84b6e3b5b service nova] [instance: 76ee582b-b887-4d46-8c78-29f42d1a0d26] Received event network-changed-8d52e5d0-96a2-44ca-9968-9ac564aeff2c {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:38:49 user nova-compute[75337]: DEBUG nova.compute.manager [req-9d184114-1932-4ec8-93c0-5380894eea30 req-4664d806-8a35-49fa-b46f-eef84b6e3b5b service nova] [instance: 76ee582b-b887-4d46-8c78-29f42d1a0d26] Refreshing instance network info cache due to event network-changed-8d52e5d0-96a2-44ca-9968-9ac564aeff2c. {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 15:38:49 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-9d184114-1932-4ec8-93c0-5380894eea30 req-4664d806-8a35-49fa-b46f-eef84b6e3b5b service nova] Acquiring lock "refresh_cache-76ee582b-b887-4d46-8c78-29f42d1a0d26" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 15:38:49 user nova-compute[75337]: DEBUG nova.network.neutron [None req-611805bc-0287-433d-a285-14ba3dde83ff tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] [instance: 76ee582b-b887-4d46-8c78-29f42d1a0d26] Instance cache missing network info. {{(pid=75337) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 15:38:49 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:38:49 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Starting heal instance info cache {{(pid=75337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 15:38:49 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Rebuilding the list of instances to heal {{(pid=75337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 06 15:38:49 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] [instance: 76ee582b-b887-4d46-8c78-29f42d1a0d26] Skipping network cache update for instance because it is Building. {{(pid=75337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 06 15:38:49 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "refresh_cache-83516ff5-c4e7-4e91-a2f9-8af9b51cf475" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 15:38:49 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquired lock "refresh_cache-83516ff5-c4e7-4e91-a2f9-8af9b51cf475" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 15:38:49 user nova-compute[75337]: DEBUG nova.network.neutron [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] [instance: 83516ff5-c4e7-4e91-a2f9-8af9b51cf475] Forcefully refreshing network info cache for instance {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 15:38:49 user nova-compute[75337]: DEBUG nova.objects.instance [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lazy-loading 'info_cache' on Instance uuid 83516ff5-c4e7-4e91-a2f9-8af9b51cf475 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 15:38:49 user nova-compute[75337]: DEBUG nova.network.neutron [None req-611805bc-0287-433d-a285-14ba3dde83ff tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] [instance: 76ee582b-b887-4d46-8c78-29f42d1a0d26] Updating instance_info_cache with network_info: [{"id": "8d52e5d0-96a2-44ca-9968-9ac564aeff2c", "address": "fa:16:3e:0b:83:6f", "network": {"id": "cd11ddce-8aa1-4ad8-8184-317c63f52be7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-265471432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4180b3fb8de74de1ad134fe356b85d6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d52e5d0-96", "ovs_interfaceid": "8d52e5d0-96a2-44ca-9968-9ac564aeff2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:38:49 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-611805bc-0287-433d-a285-14ba3dde83ff tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] Releasing lock "refresh_cache-76ee582b-b887-4d46-8c78-29f42d1a0d26" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 15:38:49 user nova-compute[75337]: DEBUG nova.compute.manager [None req-611805bc-0287-433d-a285-14ba3dde83ff tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] [instance: 76ee582b-b887-4d46-8c78-29f42d1a0d26] Instance network_info: |[{"id": "8d52e5d0-96a2-44ca-9968-9ac564aeff2c", "address": "fa:16:3e:0b:83:6f", "network": {"id": "cd11ddce-8aa1-4ad8-8184-317c63f52be7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-265471432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4180b3fb8de74de1ad134fe356b85d6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d52e5d0-96", "ovs_interfaceid": "8d52e5d0-96a2-44ca-9968-9ac564aeff2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 15:38:49 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-9d184114-1932-4ec8-93c0-5380894eea30 req-4664d806-8a35-49fa-b46f-eef84b6e3b5b service nova] Acquired lock "refresh_cache-76ee582b-b887-4d46-8c78-29f42d1a0d26" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 15:38:49 user nova-compute[75337]: DEBUG nova.network.neutron [req-9d184114-1932-4ec8-93c0-5380894eea30 req-4664d806-8a35-49fa-b46f-eef84b6e3b5b service nova] [instance: 76ee582b-b887-4d46-8c78-29f42d1a0d26] Refreshing network info cache for port 8d52e5d0-96a2-44ca-9968-9ac564aeff2c {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 15:38:49 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-611805bc-0287-433d-a285-14ba3dde83ff tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] [instance: 76ee582b-b887-4d46-8c78-29f42d1a0d26] Start _get_guest_xml network_info=[{"id": "8d52e5d0-96a2-44ca-9968-9ac564aeff2c", "address": "fa:16:3e:0b:83:6f", "network": {"id": "cd11ddce-8aa1-4ad8-8184-317c63f52be7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-265471432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4180b3fb8de74de1ad134fe356b85d6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d52e5d0-96", "ovs_interfaceid": "8d52e5d0-96a2-44ca-9968-9ac564aeff2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T15:34:14Z,direct_url=<?>,disk_format='qcow2',id=16b903ae-a40f-41a7-985b-4804cce92c62,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6549a15819f1469bbd5eeae8190e3d44',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T15:34:15Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'guest_format': None, 'size': 0, 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '16b903ae-a40f-41a7-985b-4804cce92c62'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 15:38:49 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-611805bc-0287-433d-a285-14ba3dde83ff tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 15:38:49 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-611805bc-0287-433d-a285-14ba3dde83ff tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 15:38:49 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-611805bc-0287-433d-a285-14ba3dde83ff tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 15:38:49 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-611805bc-0287-433d-a285-14ba3dde83ff tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] CPU controller missing on host. {{(pid=75337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 15:38:49 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-611805bc-0287-433d-a285-14ba3dde83ff tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 15:38:49 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-611805bc-0287-433d-a285-14ba3dde83ff tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] CPU controller found on host. {{(pid=75337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 15:38:49 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-611805bc-0287-433d-a285-14ba3dde83ff tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75337) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 15:38:49 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-611805bc-0287-433d-a285-14ba3dde83ff tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T15:34:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T15:34:14Z,direct_url=<?>,disk_format='qcow2',id=16b903ae-a40f-41a7-985b-4804cce92c62,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6549a15819f1469bbd5eeae8190e3d44',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T15:34:15Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 15:38:49 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-611805bc-0287-433d-a285-14ba3dde83ff tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] Flavor limits 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 15:38:49 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-611805bc-0287-433d-a285-14ba3dde83ff tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] Image limits 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 15:38:49 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-611805bc-0287-433d-a285-14ba3dde83ff tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] Flavor pref 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 15:38:49 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-611805bc-0287-433d-a285-14ba3dde83ff tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] Image pref 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 15:38:49 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-611805bc-0287-433d-a285-14ba3dde83ff tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 15:38:49 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-611805bc-0287-433d-a285-14ba3dde83ff tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 15:38:49 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-611805bc-0287-433d-a285-14ba3dde83ff tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 15:38:49 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-611805bc-0287-433d-a285-14ba3dde83ff tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] Got 1 possible topologies {{(pid=75337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 15:38:49 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-611805bc-0287-433d-a285-14ba3dde83ff tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 15:38:49 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-611805bc-0287-433d-a285-14ba3dde83ff tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 15:38:49 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-611805bc-0287-433d-a285-14ba3dde83ff tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T15:38:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1853414850',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1853414850',id=9,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFGP9zZx8/smrQZVJ9SjwMu8yi65szEQrklWGxwv+DWpP4x/gZJfYN1nhwlTtV8a2EPxv+zU/MdCKD4XLCPbyGN12jTTqoGcbI7kaYL/I7RmSLD+0nDNzAksw3YYfsN9cA==',key_name='tempest-keypair-135606244',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4180b3fb8de74de1ad134fe356b85d6f',ramdisk_id='',reservation_id='r-gdmig8v7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-387682144',owner_user_name='tempest-TaggedAttachmentsTest-387682144-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T15:38:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='587c402e2f0d45ad909ae974a03cd20e',uuid=76ee582b-b887-4d46-8c78-29f42d1a0d26,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8d52e5d0-96a2-44ca-9968-9ac564aeff2c", "address": "fa:16:3e:0b:83:6f", "network": {"id": "cd11ddce-8aa1-4ad8-8184-317c63f52be7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-265471432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4180b3fb8de74de1ad134fe356b85d6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d52e5d0-96", "ovs_interfaceid": "8d52e5d0-96a2-44ca-9968-9ac564aeff2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75337) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 15:38:49 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-611805bc-0287-433d-a285-14ba3dde83ff tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] Converting VIF {"id": "8d52e5d0-96a2-44ca-9968-9ac564aeff2c", "address": "fa:16:3e:0b:83:6f", "network": {"id": "cd11ddce-8aa1-4ad8-8184-317c63f52be7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-265471432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4180b3fb8de74de1ad134fe356b85d6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d52e5d0-96", "ovs_interfaceid": "8d52e5d0-96a2-44ca-9968-9ac564aeff2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 15:38:49 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-611805bc-0287-433d-a285-14ba3dde83ff tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:83:6f,bridge_name='br-int',has_traffic_filtering=True,id=8d52e5d0-96a2-44ca-9968-9ac564aeff2c,network=Network(cd11ddce-8aa1-4ad8-8184-317c63f52be7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d52e5d0-96') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 15:38:49 user nova-compute[75337]: DEBUG nova.objects.instance [None req-611805bc-0287-433d-a285-14ba3dde83ff tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] Lazy-loading 'pci_devices' on Instance uuid 76ee582b-b887-4d46-8c78-29f42d1a0d26 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 15:38:49 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-611805bc-0287-433d-a285-14ba3dde83ff tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] [instance: 76ee582b-b887-4d46-8c78-29f42d1a0d26] End _get_guest_xml xml=<domain type="kvm">
Nov 06 15:38:49 user nova-compute[75337]:   <uuid>76ee582b-b887-4d46-8c78-29f42d1a0d26</uuid>
Nov 06 15:38:49 user nova-compute[75337]:   <name>instance-00000009</name>
Nov 06 15:38:49 user nova-compute[75337]:   <memory>524288</memory>
Nov 06 15:38:49 user nova-compute[75337]:   <vcpu>1</vcpu>
Nov 06 15:38:49 user nova-compute[75337]:   <metadata>
Nov 06 15:38:49 user nova-compute[75337]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 15:38:49 user nova-compute[75337]:       <nova:package version="0.0.0"/>
Nov 06 15:38:49 user nova-compute[75337]:       <nova:name>tempest-device-tagging-server-1853414850</nova:name>
Nov 06 15:38:49 user nova-compute[75337]:       <nova:creationTime>2023-11-06 15:38:49</nova:creationTime>
Nov 06 15:38:49 user nova-compute[75337]:       <nova:flavor name="m1.tiny">
Nov 06 15:38:49 user nova-compute[75337]:         <nova:memory>512</nova:memory>
Nov 06 15:38:49 user nova-compute[75337]:         <nova:disk>1</nova:disk>
Nov 06 15:38:49 user nova-compute[75337]:         <nova:swap>0</nova:swap>
Nov 06 15:38:49 user nova-compute[75337]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 15:38:49 user nova-compute[75337]:         <nova:vcpus>1</nova:vcpus>
Nov 06 15:38:49 user nova-compute[75337]:       </nova:flavor>
Nov 06 15:38:49 user nova-compute[75337]:       <nova:owner>
Nov 06 15:38:49 user nova-compute[75337]:         <nova:user uuid="587c402e2f0d45ad909ae974a03cd20e">tempest-TaggedAttachmentsTest-387682144-project-member</nova:user>
Nov 06 15:38:49 user nova-compute[75337]:         <nova:project uuid="4180b3fb8de74de1ad134fe356b85d6f">tempest-TaggedAttachmentsTest-387682144</nova:project>
Nov 06 15:38:49 user nova-compute[75337]:       </nova:owner>
Nov 06 15:38:49 user nova-compute[75337]:       <nova:root type="image" uuid="16b903ae-a40f-41a7-985b-4804cce92c62"/>
Nov 06 15:38:49 user nova-compute[75337]:       <nova:ports>
Nov 06 15:38:49 user nova-compute[75337]:         <nova:port uuid="8d52e5d0-96a2-44ca-9968-9ac564aeff2c">
Nov 06 15:38:49 user nova-compute[75337]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 06 15:38:49 user nova-compute[75337]:         </nova:port>
Nov 06 15:38:49 user nova-compute[75337]:       </nova:ports>
Nov 06 15:38:49 user nova-compute[75337]:     </nova:instance>
Nov 06 15:38:49 user nova-compute[75337]:   </metadata>
Nov 06 15:38:49 user nova-compute[75337]:   <sysinfo type="smbios">
Nov 06 15:38:49 user nova-compute[75337]:     <system>
Nov 06 15:38:49 user nova-compute[75337]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 15:38:49 user nova-compute[75337]:       <entry name="product">OpenStack Nova</entry>
Nov 06 15:38:49 user nova-compute[75337]:       <entry name="version">0.0.0</entry>
Nov 06 15:38:49 user nova-compute[75337]:       <entry name="serial">76ee582b-b887-4d46-8c78-29f42d1a0d26</entry>
Nov 06 15:38:49 user nova-compute[75337]:       <entry name="uuid">76ee582b-b887-4d46-8c78-29f42d1a0d26</entry>
Nov 06 15:38:49 user nova-compute[75337]:       <entry name="family">Virtual Machine</entry>
Nov 06 15:38:49 user nova-compute[75337]:     </system>
Nov 06 15:38:49 user nova-compute[75337]:   </sysinfo>
Nov 06 15:38:49 user nova-compute[75337]:   <os>
Nov 06 15:38:49 user nova-compute[75337]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 15:38:49 user nova-compute[75337]:     <boot dev="hd"/>
Nov 06 15:38:49 user nova-compute[75337]:     <smbios mode="sysinfo"/>
Nov 06 15:38:49 user nova-compute[75337]:   </os>
Nov 06 15:38:49 user nova-compute[75337]:   <features>
Nov 06 15:38:49 user nova-compute[75337]:     <acpi/>
Nov 06 15:38:49 user nova-compute[75337]:     <apic/>
Nov 06 15:38:49 user nova-compute[75337]:     <vmcoreinfo/>
Nov 06 15:38:49 user nova-compute[75337]:   </features>
Nov 06 15:38:49 user nova-compute[75337]:   <clock offset="utc">
Nov 06 15:38:49 user nova-compute[75337]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 15:38:49 user nova-compute[75337]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 15:38:49 user nova-compute[75337]:     <timer name="hpet" present="no"/>
Nov 06 15:38:49 user nova-compute[75337]:   </clock>
Nov 06 15:38:49 user nova-compute[75337]:   <cpu mode="custom" match="exact">
Nov 06 15:38:49 user nova-compute[75337]:     <model>Nehalem</model>
Nov 06 15:38:49 user nova-compute[75337]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 15:38:49 user nova-compute[75337]:   </cpu>
Nov 06 15:38:49 user nova-compute[75337]:   <devices>
Nov 06 15:38:49 user nova-compute[75337]:     <disk type="file" device="disk">
Nov 06 15:38:49 user nova-compute[75337]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 15:38:49 user nova-compute[75337]:       <source file="/opt/stack/data/nova/instances/76ee582b-b887-4d46-8c78-29f42d1a0d26/disk"/>
Nov 06 15:38:49 user nova-compute[75337]:       <target dev="vda" bus="virtio"/>
Nov 06 15:38:49 user nova-compute[75337]:     </disk>
Nov 06 15:38:49 user nova-compute[75337]:     <disk type="file" device="cdrom">
Nov 06 15:38:49 user nova-compute[75337]:       <driver name="qemu" type="raw" cache="none"/>
Nov 06 15:38:49 user nova-compute[75337]:       <source file="/opt/stack/data/nova/instances/76ee582b-b887-4d46-8c78-29f42d1a0d26/disk.config"/>
Nov 06 15:38:49 user nova-compute[75337]:       <target dev="hda" bus="ide"/>
Nov 06 15:38:49 user nova-compute[75337]:     </disk>
Nov 06 15:38:49 user nova-compute[75337]:     <interface type="ethernet">
Nov 06 15:38:49 user nova-compute[75337]:       <mac address="fa:16:3e:0b:83:6f"/>
Nov 06 15:38:49 user nova-compute[75337]:       <model type="virtio"/>
Nov 06 15:38:49 user nova-compute[75337]:       <mtu size="1442"/>
Nov 06 15:38:49 user nova-compute[75337]:       <target dev="tap8d52e5d0-96"/>
Nov 06 15:38:49 user nova-compute[75337]:     </interface>
Nov 06 15:38:49 user nova-compute[75337]:     <serial type="pty">
Nov 06 15:38:49 user nova-compute[75337]:       <log file="/opt/stack/data/nova/instances/76ee582b-b887-4d46-8c78-29f42d1a0d26/console.log" append="off"/>
Nov 06 15:38:49 user nova-compute[75337]:     </serial>
Nov 06 15:38:49 user nova-compute[75337]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 15:38:49 user nova-compute[75337]:     <video>
Nov 06 15:38:49 user nova-compute[75337]:       <model type="virtio"/>
Nov 06 15:38:49 user nova-compute[75337]:     </video>
Nov 06 15:38:49 user nova-compute[75337]:     <rng model="virtio">
Nov 06 15:38:49 user nova-compute[75337]:       <backend model="random">/dev/urandom</backend>
Nov 06 15:38:49 user nova-compute[75337]:     </rng>
Nov 06 15:38:49 user nova-compute[75337]:     <controller type="usb" index="0" model="none"/>
Nov 06 15:38:49 user nova-compute[75337]:     <memballoon model="virtio">
Nov 06 15:38:49 user nova-compute[75337]:       <stats period="10"/>
Nov 06 15:38:49 user nova-compute[75337]:     </memballoon>
Nov 06 15:38:49 user nova-compute[75337]:   </devices>
Nov 06 15:38:49 user nova-compute[75337]: </domain>
Nov 06 15:38:49 user nova-compute[75337]:  {{(pid=75337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 15:38:49 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-611805bc-0287-433d-a285-14ba3dde83ff tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T15:38:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1853414850',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1853414850',id=9,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFGP9zZx8/smrQZVJ9SjwMu8yi65szEQrklWGxwv+DWpP4x/gZJfYN1nhwlTtV8a2EPxv+zU/MdCKD4XLCPbyGN12jTTqoGcbI7kaYL/I7RmSLD+0nDNzAksw3YYfsN9cA==',key_name='tempest-keypair-135606244',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4180b3fb8de74de1ad134fe356b85d6f',ramdisk_id='',reservation_id='r-gdmig8v7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-387682144',owner_user_name='tempest-TaggedAttachmentsTest-387682144-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T15:38:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='587c402e2f0d45ad909ae974a03cd20e',uuid=76ee582b-b887-4d46-8c78-29f42d1a0d26,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8d52e5d0-96a2-44ca-9968-9ac564aeff2c", "address": "fa:16:3e:0b:83:6f", "network": {"id": "cd11ddce-8aa1-4ad8-8184-317c63f52be7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-265471432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4180b3fb8de74de1ad134fe356b85d6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d52e5d0-96", "ovs_interfaceid": "8d52e5d0-96a2-44ca-9968-9ac564aeff2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 15:38:49 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-611805bc-0287-433d-a285-14ba3dde83ff tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] Converting VIF {"id": "8d52e5d0-96a2-44ca-9968-9ac564aeff2c", "address": "fa:16:3e:0b:83:6f", "network": {"id": "cd11ddce-8aa1-4ad8-8184-317c63f52be7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-265471432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4180b3fb8de74de1ad134fe356b85d6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d52e5d0-96", "ovs_interfaceid": "8d52e5d0-96a2-44ca-9968-9ac564aeff2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 15:38:49 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-611805bc-0287-433d-a285-14ba3dde83ff tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:83:6f,bridge_name='br-int',has_traffic_filtering=True,id=8d52e5d0-96a2-44ca-9968-9ac564aeff2c,network=Network(cd11ddce-8aa1-4ad8-8184-317c63f52be7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d52e5d0-96') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 15:38:49 user nova-compute[75337]: DEBUG os_vif [None req-611805bc-0287-433d-a285-14ba3dde83ff tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:83:6f,bridge_name='br-int',has_traffic_filtering=True,id=8d52e5d0-96a2-44ca-9968-9ac564aeff2c,network=Network(cd11ddce-8aa1-4ad8-8184-317c63f52be7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d52e5d0-96') {{(pid=75337) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 15:38:49 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:38:49 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:38:49 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 15:38:49 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:38:49 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'eceb06a1-7057-58bf-b038-ba6e5b011d51', '_type': 'linux-noop'}}, row=False) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:38:49 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:38:49 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:38:49 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:38:49 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8d52e5d0-96, may_exist=True, interface_attrs={}) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:38:49 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8d52e5d0-96, col_values=(('qos', UUID('838490b2-45a3-4801-aec4-c013c1845b43')),), if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:38:49 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8d52e5d0-96, col_values=(('external_ids', {'iface-id': '8d52e5d0-96a2-44ca-9968-9ac564aeff2c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0b:83:6f', 'vm-uuid': '76ee582b-b887-4d46-8c78-29f42d1a0d26'}),), if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:38:49 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:38:49 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:38:49 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:38:49 user nova-compute[75337]: INFO os_vif [None req-611805bc-0287-433d-a285-14ba3dde83ff tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:83:6f,bridge_name='br-int',has_traffic_filtering=True,id=8d52e5d0-96a2-44ca-9968-9ac564aeff2c,network=Network(cd11ddce-8aa1-4ad8-8184-317c63f52be7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d52e5d0-96')
Nov 06 15:38:50 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-611805bc-0287-433d-a285-14ba3dde83ff tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] No BDM found with device name vda, not building metadata. {{(pid=75337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 15:38:50 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-611805bc-0287-433d-a285-14ba3dde83ff tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] No BDM found with device name hda, not building metadata. {{(pid=75337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 15:38:50 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-611805bc-0287-433d-a285-14ba3dde83ff tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] No VIF found with MAC fa:16:3e:0b:83:6f, not building metadata {{(pid=75337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 15:38:50 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-611805bc-0287-433d-a285-14ba3dde83ff tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] [instance: 76ee582b-b887-4d46-8c78-29f42d1a0d26] Using config drive
Nov 06 15:38:50 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-611805bc-0287-433d-a285-14ba3dde83ff tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] [instance: 76ee582b-b887-4d46-8c78-29f42d1a0d26] Creating config drive at /opt/stack/data/nova/instances/76ee582b-b887-4d46-8c78-29f42d1a0d26/disk.config
Nov 06 15:38:50 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-611805bc-0287-433d-a285-14ba3dde83ff tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/76ee582b-b887-4d46-8c78-29f42d1a0d26/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpcc10ncxv {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:38:50 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-611805bc-0287-433d-a285-14ba3dde83ff tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/76ee582b-b887-4d46-8c78-29f42d1a0d26/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpcc10ncxv" returned: 0 in 0.074s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:38:50 user nova-compute[75337]: DEBUG nova.network.neutron [req-9d184114-1932-4ec8-93c0-5380894eea30 req-4664d806-8a35-49fa-b46f-eef84b6e3b5b service nova] [instance: 76ee582b-b887-4d46-8c78-29f42d1a0d26] Updated VIF entry in instance network info cache for port 8d52e5d0-96a2-44ca-9968-9ac564aeff2c. {{(pid=75337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 15:38:50 user nova-compute[75337]: DEBUG nova.network.neutron [req-9d184114-1932-4ec8-93c0-5380894eea30 req-4664d806-8a35-49fa-b46f-eef84b6e3b5b service nova] [instance: 76ee582b-b887-4d46-8c78-29f42d1a0d26] Updating instance_info_cache with network_info: [{"id": "8d52e5d0-96a2-44ca-9968-9ac564aeff2c", "address": "fa:16:3e:0b:83:6f", "network": {"id": "cd11ddce-8aa1-4ad8-8184-317c63f52be7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-265471432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4180b3fb8de74de1ad134fe356b85d6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d52e5d0-96", "ovs_interfaceid": "8d52e5d0-96a2-44ca-9968-9ac564aeff2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:38:50 user nova-compute[75337]: DEBUG nova.network.neutron [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] [instance: 83516ff5-c4e7-4e91-a2f9-8af9b51cf475] Updating instance_info_cache with network_info: [{"id": "452cb189-f59e-42e1-80e1-9eebb0c65bd7", "address": "fa:16:3e:f6:56:c4", "network": {"id": "736be000-ee94-41fd-9de0-f2f885ec9be7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1715443852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb76b5b0f2b24f1c84a92403176bcc00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap452cb189-f5", "ovs_interfaceid": "452cb189-f59e-42e1-80e1-9eebb0c65bd7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:38:50 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-9d184114-1932-4ec8-93c0-5380894eea30 req-4664d806-8a35-49fa-b46f-eef84b6e3b5b service nova] Releasing lock "refresh_cache-76ee582b-b887-4d46-8c78-29f42d1a0d26" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 15:38:50 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Releasing lock "refresh_cache-83516ff5-c4e7-4e91-a2f9-8af9b51cf475" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 15:38:50 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] [instance: 83516ff5-c4e7-4e91-a2f9-8af9b51cf475] Updated the network info_cache for instance {{(pid=75337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 15:38:50 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:38:50 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:38:50 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75337) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 15:38:51 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:38:51 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager.update_available_resource {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:38:51 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:38:51 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:38:51 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:38:51 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Auditing locally available compute resources for user (node: user) {{(pid=75337) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 15:38:51 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:38:51 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:38:51 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:38:51 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:38:51 user nova-compute[75337]: DEBUG nova.compute.manager [req-6b6d4536-6fc8-4260-940a-6de41a140efa req-532a7374-1291-4e74-9942-10f9b5fe5066 service nova] [instance: 76ee582b-b887-4d46-8c78-29f42d1a0d26] Received event network-vif-plugged-8d52e5d0-96a2-44ca-9968-9ac564aeff2c {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:38:51 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-6b6d4536-6fc8-4260-940a-6de41a140efa req-532a7374-1291-4e74-9942-10f9b5fe5066 service nova] Acquiring lock "76ee582b-b887-4d46-8c78-29f42d1a0d26-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:38:51 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-6b6d4536-6fc8-4260-940a-6de41a140efa req-532a7374-1291-4e74-9942-10f9b5fe5066 service nova] Lock "76ee582b-b887-4d46-8c78-29f42d1a0d26-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:38:51 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-6b6d4536-6fc8-4260-940a-6de41a140efa req-532a7374-1291-4e74-9942-10f9b5fe5066 service nova] Lock "76ee582b-b887-4d46-8c78-29f42d1a0d26-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:38:51 user nova-compute[75337]: DEBUG nova.compute.manager [req-6b6d4536-6fc8-4260-940a-6de41a140efa req-532a7374-1291-4e74-9942-10f9b5fe5066 service nova] [instance: 76ee582b-b887-4d46-8c78-29f42d1a0d26] No waiting events found dispatching network-vif-plugged-8d52e5d0-96a2-44ca-9968-9ac564aeff2c {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:38:51 user nova-compute[75337]: WARNING nova.compute.manager [req-6b6d4536-6fc8-4260-940a-6de41a140efa req-532a7374-1291-4e74-9942-10f9b5fe5066 service nova] [instance: 76ee582b-b887-4d46-8c78-29f42d1a0d26] Received unexpected event network-vif-plugged-8d52e5d0-96a2-44ca-9968-9ac564aeff2c for instance with vm_state building and task_state spawning.
Nov 06 15:38:52 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f5fc58d-f946-4df0-b8d0-1aefbf0f8cd6/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:38:52 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:38:52 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:38:52 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f5fc58d-f946-4df0-b8d0-1aefbf0f8cd6/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:38:52 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f5fc58d-f946-4df0-b8d0-1aefbf0f8cd6/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:38:52 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f5fc58d-f946-4df0-b8d0-1aefbf0f8cd6/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:38:52 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/581cf468-65e7-42e5-9250-c3d645577011/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:38:52 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/581cf468-65e7-42e5-9250-c3d645577011/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:38:52 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/581cf468-65e7-42e5-9250-c3d645577011/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:38:53 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/581cf468-65e7-42e5-9250-c3d645577011/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:38:53 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8cf1ead-a87c-459c-b914-a0e976c9e464/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:38:53 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:38:53 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8cf1ead-a87c-459c-b914-a0e976c9e464/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:38:53 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8cf1ead-a87c-459c-b914-a0e976c9e464/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:38:53 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8cf1ead-a87c-459c-b914-a0e976c9e464/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:38:53 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76ee582b-b887-4d46-8c78-29f42d1a0d26/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:38:53 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76ee582b-b887-4d46-8c78-29f42d1a0d26/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:38:53 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76ee582b-b887-4d46-8c78-29f42d1a0d26/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:38:53 user nova-compute[75337]: DEBUG nova.compute.manager [None req-611805bc-0287-433d-a285-14ba3dde83ff tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] [instance: 76ee582b-b887-4d46-8c78-29f42d1a0d26] Instance event wait completed in 0 seconds for  {{(pid=75337) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 15:38:53 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-611805bc-0287-433d-a285-14ba3dde83ff tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] [instance: 76ee582b-b887-4d46-8c78-29f42d1a0d26] Guest created on hypervisor {{(pid=75337) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 15:38:53 user nova-compute[75337]: INFO nova.virt.libvirt.driver [-] [instance: 76ee582b-b887-4d46-8c78-29f42d1a0d26] Instance spawned successfully.
Nov 06 15:38:53 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-611805bc-0287-433d-a285-14ba3dde83ff tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] [instance: 76ee582b-b887-4d46-8c78-29f42d1a0d26] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 15:38:53 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76ee582b-b887-4d46-8c78-29f42d1a0d26/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:38:53 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a600bd8-b94a-4242-a443-c2defb002280/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:38:53 user nova-compute[75337]: DEBUG nova.compute.manager [req-e1d30d89-08a3-4f07-854e-01804d500f6f req-1181153d-7712-4ff9-873c-488c6fe4f64e service nova] [instance: 76ee582b-b887-4d46-8c78-29f42d1a0d26] Received event network-vif-plugged-8d52e5d0-96a2-44ca-9968-9ac564aeff2c {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:38:53 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-e1d30d89-08a3-4f07-854e-01804d500f6f req-1181153d-7712-4ff9-873c-488c6fe4f64e service nova] Acquiring lock "76ee582b-b887-4d46-8c78-29f42d1a0d26-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:38:53 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-e1d30d89-08a3-4f07-854e-01804d500f6f req-1181153d-7712-4ff9-873c-488c6fe4f64e service nova] Lock "76ee582b-b887-4d46-8c78-29f42d1a0d26-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:38:53 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-e1d30d89-08a3-4f07-854e-01804d500f6f req-1181153d-7712-4ff9-873c-488c6fe4f64e service nova] Lock "76ee582b-b887-4d46-8c78-29f42d1a0d26-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:38:53 user nova-compute[75337]: DEBUG nova.compute.manager [req-e1d30d89-08a3-4f07-854e-01804d500f6f req-1181153d-7712-4ff9-873c-488c6fe4f64e service nova] [instance: 76ee582b-b887-4d46-8c78-29f42d1a0d26] No waiting events found dispatching network-vif-plugged-8d52e5d0-96a2-44ca-9968-9ac564aeff2c {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:38:54 user nova-compute[75337]: WARNING nova.compute.manager [req-e1d30d89-08a3-4f07-854e-01804d500f6f req-1181153d-7712-4ff9-873c-488c6fe4f64e service nova] [instance: 76ee582b-b887-4d46-8c78-29f42d1a0d26] Received unexpected event network-vif-plugged-8d52e5d0-96a2-44ca-9968-9ac564aeff2c for instance with vm_state building and task_state spawning.
Nov 06 15:38:54 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-611805bc-0287-433d-a285-14ba3dde83ff tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] [instance: 76ee582b-b887-4d46-8c78-29f42d1a0d26] Found default for hw_cdrom_bus of ide {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:38:54 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-611805bc-0287-433d-a285-14ba3dde83ff tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] [instance: 76ee582b-b887-4d46-8c78-29f42d1a0d26] Found default for hw_disk_bus of virtio {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:38:54 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-611805bc-0287-433d-a285-14ba3dde83ff tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] [instance: 76ee582b-b887-4d46-8c78-29f42d1a0d26] Found default for hw_input_bus of None {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:38:54 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-611805bc-0287-433d-a285-14ba3dde83ff tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] [instance: 76ee582b-b887-4d46-8c78-29f42d1a0d26] Found default for hw_pointer_model of None {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:38:54 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-611805bc-0287-433d-a285-14ba3dde83ff tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] [instance: 76ee582b-b887-4d46-8c78-29f42d1a0d26] Found default for hw_video_model of virtio {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:38:54 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-611805bc-0287-433d-a285-14ba3dde83ff tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] [instance: 76ee582b-b887-4d46-8c78-29f42d1a0d26] Found default for hw_vif_model of virtio {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:38:54 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a600bd8-b94a-4242-a443-c2defb002280/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:38:54 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a600bd8-b94a-4242-a443-c2defb002280/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:38:54 user nova-compute[75337]: INFO nova.compute.manager [None req-611805bc-0287-433d-a285-14ba3dde83ff tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] [instance: 76ee582b-b887-4d46-8c78-29f42d1a0d26] Took 6.30 seconds to spawn the instance on the hypervisor.
Nov 06 15:38:54 user nova-compute[75337]: DEBUG nova.compute.manager [None req-611805bc-0287-433d-a285-14ba3dde83ff tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] [instance: 76ee582b-b887-4d46-8c78-29f42d1a0d26] Checking state {{(pid=75337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 15:38:54 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a600bd8-b94a-4242-a443-c2defb002280/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:38:54 user nova-compute[75337]: INFO nova.compute.manager [None req-611805bc-0287-433d-a285-14ba3dde83ff tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] [instance: 76ee582b-b887-4d46-8c78-29f42d1a0d26] Took 7.52 seconds to build instance.
Nov 06 15:38:54 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfadb21f-5ed1-42f4-956b-95cccf128b6a/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:38:54 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-611805bc-0287-433d-a285-14ba3dde83ff tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] Lock "76ee582b-b887-4d46-8c78-29f42d1a0d26" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.887s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:38:54 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfadb21f-5ed1-42f4-956b-95cccf128b6a/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:38:54 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfadb21f-5ed1-42f4-956b-95cccf128b6a/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:38:54 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfadb21f-5ed1-42f4-956b-95cccf128b6a/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:38:54 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:38:54 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:38:54 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:38:54 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:38:55 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:38:55 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8858d90e-ee14-494b-80da-904cd97cdff0/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:38:55 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8858d90e-ee14-494b-80da-904cd97cdff0/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:38:55 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8858d90e-ee14-494b-80da-904cd97cdff0/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:38:55 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8858d90e-ee14-494b-80da-904cd97cdff0/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:38:55 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83516ff5-c4e7-4e91-a2f9-8af9b51cf475/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:38:55 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83516ff5-c4e7-4e91-a2f9-8af9b51cf475/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:38:55 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83516ff5-c4e7-4e91-a2f9-8af9b51cf475/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:38:55 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83516ff5-c4e7-4e91-a2f9-8af9b51cf475/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:38:56 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 15:38:56 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 15:38:56 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Hypervisor/Node resource view: name=user free_ram=7367MB free_disk=25.535404205322266GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75337) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 15:38:56 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:38:56 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:38:56 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 83516ff5-c4e7-4e91-a2f9-8af9b51cf475 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:38:56 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 5f5fc58d-f946-4df0-b8d0-1aefbf0f8cd6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:38:56 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance c8cf1ead-a87c-459c-b914-a0e976c9e464 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:38:56 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 581cf468-65e7-42e5-9250-c3d645577011 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:38:56 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 8a600bd8-b94a-4242-a443-c2defb002280 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:38:56 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance dfadb21f-5ed1-42f4-956b-95cccf128b6a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:38:56 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 8858d90e-ee14-494b-80da-904cd97cdff0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:38:56 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:38:56 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 76ee582b-b887-4d46-8c78-29f42d1a0d26 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:38:56 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 15:38:56 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 15:38:57 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Refreshing inventories for resource provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 06 15:38:57 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Updating ProviderTree inventory for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 06 15:38:57 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Updating inventory in ProviderTree for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 06 15:38:57 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Refreshing aggregate associations for resource provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7, aggregates: None {{(pid=75337) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 06 15:38:57 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Refreshing trait associations for resource provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7, traits: COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NODE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_IDE,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSSE3,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_USB {{(pid=75337) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 06 15:38:57 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 15:38:57 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 15:38:57 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Compute_service record updated for user:user {{(pid=75337) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 15:38:57 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.010s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:38:58 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:38:59 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:39:03 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:39:04 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:39:08 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:39:09 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:39:13 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:39:14 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:39:18 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:39:19 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:39:23 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:39:24 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:39:29 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:39:31 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:39:34 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:39:39 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:39:45 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:39:45 user nova-compute[75337]: DEBUG nova.compute.manager [None req-898fdc3c-91b1-4e9e-8474-d5896dae747d tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: 83516ff5-c4e7-4e91-a2f9-8af9b51cf475] Checking state {{(pid=75337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 15:39:45 user nova-compute[75337]: INFO nova.compute.manager [None req-898fdc3c-91b1-4e9e-8474-d5896dae747d tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: 83516ff5-c4e7-4e91-a2f9-8af9b51cf475] instance snapshotting
Nov 06 15:39:45 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-898fdc3c-91b1-4e9e-8474-d5896dae747d tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: 83516ff5-c4e7-4e91-a2f9-8af9b51cf475] Beginning live snapshot process
Nov 06 15:39:45 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-898fdc3c-91b1-4e9e-8474-d5896dae747d tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83516ff5-c4e7-4e91-a2f9-8af9b51cf475/disk --force-share --output=json -f qcow2 {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:39:45 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-898fdc3c-91b1-4e9e-8474-d5896dae747d tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83516ff5-c4e7-4e91-a2f9-8af9b51cf475/disk --force-share --output=json -f qcow2" returned: 0 in 0.214s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:39:45 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-898fdc3c-91b1-4e9e-8474-d5896dae747d tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83516ff5-c4e7-4e91-a2f9-8af9b51cf475/disk --force-share --output=json -f qcow2 {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:39:46 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-898fdc3c-91b1-4e9e-8474-d5896dae747d tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83516ff5-c4e7-4e91-a2f9-8af9b51cf475/disk --force-share --output=json -f qcow2" returned: 0 in 0.191s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:39:46 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-898fdc3c-91b1-4e9e-8474-d5896dae747d tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:39:46 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-898fdc3c-91b1-4e9e-8474-d5896dae747d tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json" returned: 0 in 0.225s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:39:46 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-898fdc3c-91b1-4e9e-8474-d5896dae747d tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmplb00iuwa/28e04d635d8b43708e2b39f65c37212d.delta 1073741824 {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:39:46 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-898fdc3c-91b1-4e9e-8474-d5896dae747d tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmplb00iuwa/28e04d635d8b43708e2b39f65c37212d.delta 1073741824" returned: 0 in 0.057s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:39:46 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-898fdc3c-91b1-4e9e-8474-d5896dae747d tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: 83516ff5-c4e7-4e91-a2f9-8af9b51cf475] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 06 15:39:46 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-898fdc3c-91b1-4e9e-8474-d5896dae747d tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Checking UEFI support for host arch (x86_64) {{(pid=75337) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Nov 06 15:39:46 user nova-compute[75337]: INFO nova.virt.libvirt.host [None req-898fdc3c-91b1-4e9e-8474-d5896dae747d tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] UEFI support detected
Nov 06 15:39:47 user nova-compute[75337]: DEBUG nova.virt.libvirt.guest [None req-898fdc3c-91b1-4e9e-8474-d5896dae747d tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75337) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 06 15:39:47 user nova-compute[75337]: DEBUG nova.virt.libvirt.guest [None req-898fdc3c-91b1-4e9e-8474-d5896dae747d tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75337) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 06 15:39:47 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-898fdc3c-91b1-4e9e-8474-d5896dae747d tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: 83516ff5-c4e7-4e91-a2f9-8af9b51cf475] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 06 15:39:47 user nova-compute[75337]: DEBUG nova.privsep.utils [None req-898fdc3c-91b1-4e9e-8474-d5896dae747d tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75337) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 06 15:39:47 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-898fdc3c-91b1-4e9e-8474-d5896dae747d tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmplb00iuwa/28e04d635d8b43708e2b39f65c37212d.delta /opt/stack/data/nova/instances/snapshots/tmplb00iuwa/28e04d635d8b43708e2b39f65c37212d {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:39:48 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-898fdc3c-91b1-4e9e-8474-d5896dae747d tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmplb00iuwa/28e04d635d8b43708e2b39f65c37212d.delta /opt/stack/data/nova/instances/snapshots/tmplb00iuwa/28e04d635d8b43708e2b39f65c37212d" returned: 0 in 0.466s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:39:48 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-898fdc3c-91b1-4e9e-8474-d5896dae747d tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: 83516ff5-c4e7-4e91-a2f9-8af9b51cf475] Snapshot extracted, beginning image upload
Nov 06 15:39:48 user nova-compute[75337]: DEBUG nova.compute.manager [req-e0444102-c5ab-45d1-ae84-4d3d2fe4932c req-998c5653-4f41-402f-8bee-5647a7008b1a service nova] [instance: c8cf1ead-a87c-459c-b914-a0e976c9e464] Received event network-changed-b33373f6-0289-4623-90ac-f5c3db0d3681 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:39:48 user nova-compute[75337]: DEBUG nova.compute.manager [req-e0444102-c5ab-45d1-ae84-4d3d2fe4932c req-998c5653-4f41-402f-8bee-5647a7008b1a service nova] [instance: c8cf1ead-a87c-459c-b914-a0e976c9e464] Refreshing instance network info cache due to event network-changed-b33373f6-0289-4623-90ac-f5c3db0d3681. {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 15:39:48 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-e0444102-c5ab-45d1-ae84-4d3d2fe4932c req-998c5653-4f41-402f-8bee-5647a7008b1a service nova] Acquiring lock "refresh_cache-c8cf1ead-a87c-459c-b914-a0e976c9e464" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 15:39:48 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-e0444102-c5ab-45d1-ae84-4d3d2fe4932c req-998c5653-4f41-402f-8bee-5647a7008b1a service nova] Acquired lock "refresh_cache-c8cf1ead-a87c-459c-b914-a0e976c9e464" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 15:39:48 user nova-compute[75337]: DEBUG nova.network.neutron [req-e0444102-c5ab-45d1-ae84-4d3d2fe4932c req-998c5653-4f41-402f-8bee-5647a7008b1a service nova] [instance: c8cf1ead-a87c-459c-b914-a0e976c9e464] Refreshing network info cache for port b33373f6-0289-4623-90ac-f5c3db0d3681 {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 15:39:50 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:39:50 user nova-compute[75337]: DEBUG nova.network.neutron [req-e0444102-c5ab-45d1-ae84-4d3d2fe4932c req-998c5653-4f41-402f-8bee-5647a7008b1a service nova] [instance: c8cf1ead-a87c-459c-b914-a0e976c9e464] Updated VIF entry in instance network info cache for port b33373f6-0289-4623-90ac-f5c3db0d3681. {{(pid=75337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 15:39:50 user nova-compute[75337]: DEBUG nova.network.neutron [req-e0444102-c5ab-45d1-ae84-4d3d2fe4932c req-998c5653-4f41-402f-8bee-5647a7008b1a service nova] [instance: c8cf1ead-a87c-459c-b914-a0e976c9e464] Updating instance_info_cache with network_info: [{"id": "b33373f6-0289-4623-90ac-f5c3db0d3681", "address": "fa:16:3e:37:16:66", "network": {"id": "a839a9d1-fdf3-4a72-898b-6829ceef2055", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1927950273-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86f4b41336384a53a3fd22caa0fe8e6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb33373f6-02", "ovs_interfaceid": "b33373f6-0289-4623-90ac-f5c3db0d3681", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:39:50 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-e0444102-c5ab-45d1-ae84-4d3d2fe4932c req-998c5653-4f41-402f-8bee-5647a7008b1a service nova] Releasing lock "refresh_cache-c8cf1ead-a87c-459c-b914-a0e976c9e464" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 15:39:50 user nova-compute[75337]: DEBUG nova.compute.manager [req-43ce810c-574b-44f7-8570-e303f94719bd req-d42789df-7be9-4777-866d-41c5ba162668 service nova] [instance: 581cf468-65e7-42e5-9250-c3d645577011] Received event network-changed-d1c68bac-be37-4645-afcb-2b89f47c1793 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:39:50 user nova-compute[75337]: DEBUG nova.compute.manager [req-43ce810c-574b-44f7-8570-e303f94719bd req-d42789df-7be9-4777-866d-41c5ba162668 service nova] [instance: 581cf468-65e7-42e5-9250-c3d645577011] Refreshing instance network info cache due to event network-changed-d1c68bac-be37-4645-afcb-2b89f47c1793. {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 15:39:50 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-43ce810c-574b-44f7-8570-e303f94719bd req-d42789df-7be9-4777-866d-41c5ba162668 service nova] Acquiring lock "refresh_cache-581cf468-65e7-42e5-9250-c3d645577011" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 15:39:50 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-43ce810c-574b-44f7-8570-e303f94719bd req-d42789df-7be9-4777-866d-41c5ba162668 service nova] Acquired lock "refresh_cache-581cf468-65e7-42e5-9250-c3d645577011" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 15:39:50 user nova-compute[75337]: DEBUG nova.network.neutron [req-43ce810c-574b-44f7-8570-e303f94719bd req-d42789df-7be9-4777-866d-41c5ba162668 service nova] [instance: 581cf468-65e7-42e5-9250-c3d645577011] Refreshing network info cache for port d1c68bac-be37-4645-afcb-2b89f47c1793 {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 15:39:50 user nova-compute[75337]: DEBUG nova.compute.manager [None req-9a855b98-e0b9-4468-a5aa-6a8798153484 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] [instance: c8cf1ead-a87c-459c-b914-a0e976c9e464] Checking state {{(pid=75337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 15:39:50 user nova-compute[75337]: INFO nova.compute.manager [None req-9a855b98-e0b9-4468-a5aa-6a8798153484 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] [instance: c8cf1ead-a87c-459c-b914-a0e976c9e464] instance snapshotting
Nov 06 15:39:50 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-9a855b98-e0b9-4468-a5aa-6a8798153484 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] [instance: c8cf1ead-a87c-459c-b914-a0e976c9e464] Beginning live snapshot process
Nov 06 15:39:50 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-9a855b98-e0b9-4468-a5aa-6a8798153484 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8cf1ead-a87c-459c-b914-a0e976c9e464/disk --force-share --output=json -f qcow2 {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:39:50 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-9a855b98-e0b9-4468-a5aa-6a8798153484 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8cf1ead-a87c-459c-b914-a0e976c9e464/disk --force-share --output=json -f qcow2" returned: 0 in 0.216s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:39:50 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-9a855b98-e0b9-4468-a5aa-6a8798153484 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8cf1ead-a87c-459c-b914-a0e976c9e464/disk --force-share --output=json -f qcow2 {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:39:50 user nova-compute[75337]: DEBUG nova.compute.manager [req-207d8993-100e-4ad3-8471-729f60f1540f req-3bd6d7bf-b474-4118-a363-67bbd4edd779 service nova] [instance: 8a600bd8-b94a-4242-a443-c2defb002280] Received event network-changed-01aa7168-78cd-44e6-8496-08d468f62cfe {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:39:50 user nova-compute[75337]: DEBUG nova.compute.manager [req-207d8993-100e-4ad3-8471-729f60f1540f req-3bd6d7bf-b474-4118-a363-67bbd4edd779 service nova] [instance: 8a600bd8-b94a-4242-a443-c2defb002280] Refreshing instance network info cache due to event network-changed-01aa7168-78cd-44e6-8496-08d468f62cfe. {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 15:39:50 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-207d8993-100e-4ad3-8471-729f60f1540f req-3bd6d7bf-b474-4118-a363-67bbd4edd779 service nova] Acquiring lock "refresh_cache-8a600bd8-b94a-4242-a443-c2defb002280" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 15:39:50 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-207d8993-100e-4ad3-8471-729f60f1540f req-3bd6d7bf-b474-4118-a363-67bbd4edd779 service nova] Acquired lock "refresh_cache-8a600bd8-b94a-4242-a443-c2defb002280" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 15:39:50 user nova-compute[75337]: DEBUG nova.network.neutron [req-207d8993-100e-4ad3-8471-729f60f1540f req-3bd6d7bf-b474-4118-a363-67bbd4edd779 service nova] [instance: 8a600bd8-b94a-4242-a443-c2defb002280] Refreshing network info cache for port 01aa7168-78cd-44e6-8496-08d468f62cfe {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 15:39:51 user nova-compute[75337]: DEBUG nova.network.neutron [req-43ce810c-574b-44f7-8570-e303f94719bd req-d42789df-7be9-4777-866d-41c5ba162668 service nova] [instance: 581cf468-65e7-42e5-9250-c3d645577011] Updated VIF entry in instance network info cache for port d1c68bac-be37-4645-afcb-2b89f47c1793. {{(pid=75337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 15:39:51 user nova-compute[75337]: DEBUG nova.network.neutron [req-43ce810c-574b-44f7-8570-e303f94719bd req-d42789df-7be9-4777-866d-41c5ba162668 service nova] [instance: 581cf468-65e7-42e5-9250-c3d645577011] Updating instance_info_cache with network_info: [{"id": "d1c68bac-be37-4645-afcb-2b89f47c1793", "address": "fa:16:3e:00:1c:74", "network": {"id": "2623bcbf-c77c-47b4-abd5-ab538f9a2814", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1497688706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f40165c076e341bba42fb537ce98bbe2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1c68bac-be", "ovs_interfaceid": "d1c68bac-be37-4645-afcb-2b89f47c1793", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:39:51 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-9a855b98-e0b9-4468-a5aa-6a8798153484 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8cf1ead-a87c-459c-b914-a0e976c9e464/disk --force-share --output=json -f qcow2" returned: 0 in 0.220s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:39:51 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-9a855b98-e0b9-4468-a5aa-6a8798153484 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:39:51 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-43ce810c-574b-44f7-8570-e303f94719bd req-d42789df-7be9-4777-866d-41c5ba162668 service nova] Releasing lock "refresh_cache-581cf468-65e7-42e5-9250-c3d645577011" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 15:39:51 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-9a855b98-e0b9-4468-a5aa-6a8798153484 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json" returned: 0 in 0.264s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:39:51 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-9a855b98-e0b9-4468-a5aa-6a8798153484 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpx0bc4o22/642bc04b6ec7458682c8adb8ab998cb4.delta 1073741824 {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:39:51 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-9a855b98-e0b9-4468-a5aa-6a8798153484 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpx0bc4o22/642bc04b6ec7458682c8adb8ab998cb4.delta 1073741824" returned: 0 in 0.404s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:39:51 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-9a855b98-e0b9-4468-a5aa-6a8798153484 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] [instance: c8cf1ead-a87c-459c-b914-a0e976c9e464] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 06 15:39:51 user nova-compute[75337]: DEBUG nova.network.neutron [req-207d8993-100e-4ad3-8471-729f60f1540f req-3bd6d7bf-b474-4118-a363-67bbd4edd779 service nova] [instance: 8a600bd8-b94a-4242-a443-c2defb002280] Updated VIF entry in instance network info cache for port 01aa7168-78cd-44e6-8496-08d468f62cfe. {{(pid=75337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 15:39:51 user nova-compute[75337]: DEBUG nova.network.neutron [req-207d8993-100e-4ad3-8471-729f60f1540f req-3bd6d7bf-b474-4118-a363-67bbd4edd779 service nova] [instance: 8a600bd8-b94a-4242-a443-c2defb002280] Updating instance_info_cache with network_info: [{"id": "01aa7168-78cd-44e6-8496-08d468f62cfe", "address": "fa:16:3e:f1:25:3e", "network": {"id": "f24470c2-ff6f-49fd-b28f-16b8a87ed3b4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-217486733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed09a1def6f0477796404d9bd3357dd0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01aa7168-78", "ovs_interfaceid": "01aa7168-78cd-44e6-8496-08d468f62cfe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:39:51 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-207d8993-100e-4ad3-8471-729f60f1540f req-3bd6d7bf-b474-4118-a363-67bbd4edd779 service nova] Releasing lock "refresh_cache-8a600bd8-b94a-4242-a443-c2defb002280" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 15:39:52 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-898fdc3c-91b1-4e9e-8474-d5896dae747d tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: 83516ff5-c4e7-4e91-a2f9-8af9b51cf475] Snapshot image upload complete
Nov 06 15:39:52 user nova-compute[75337]: INFO nova.compute.manager [None req-898fdc3c-91b1-4e9e-8474-d5896dae747d tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: 83516ff5-c4e7-4e91-a2f9-8af9b51cf475] Took 7.22 seconds to snapshot the instance on the hypervisor.
Nov 06 15:39:52 user nova-compute[75337]: DEBUG nova.compute.manager [req-d4bbf695-d6b4-4644-8efc-14e32e8339b7 req-05a158a3-5891-4eff-a1ee-dc0b74bd4699 service nova] [instance: dfadb21f-5ed1-42f4-956b-95cccf128b6a] Received event network-changed-8592b366-9f21-4d92-b297-8872d9a7110f {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:39:52 user nova-compute[75337]: DEBUG nova.compute.manager [req-d4bbf695-d6b4-4644-8efc-14e32e8339b7 req-05a158a3-5891-4eff-a1ee-dc0b74bd4699 service nova] [instance: dfadb21f-5ed1-42f4-956b-95cccf128b6a] Refreshing instance network info cache due to event network-changed-8592b366-9f21-4d92-b297-8872d9a7110f. {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 15:39:52 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-d4bbf695-d6b4-4644-8efc-14e32e8339b7 req-05a158a3-5891-4eff-a1ee-dc0b74bd4699 service nova] Acquiring lock "refresh_cache-dfadb21f-5ed1-42f4-956b-95cccf128b6a" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 15:39:52 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-d4bbf695-d6b4-4644-8efc-14e32e8339b7 req-05a158a3-5891-4eff-a1ee-dc0b74bd4699 service nova] Acquired lock "refresh_cache-dfadb21f-5ed1-42f4-956b-95cccf128b6a" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 15:39:52 user nova-compute[75337]: DEBUG nova.network.neutron [req-d4bbf695-d6b4-4644-8efc-14e32e8339b7 req-05a158a3-5891-4eff-a1ee-dc0b74bd4699 service nova] [instance: dfadb21f-5ed1-42f4-956b-95cccf128b6a] Refreshing network info cache for port 8592b366-9f21-4d92-b297-8872d9a7110f {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 15:39:52 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Acquiring lock "67d9ceff-c1fc-48ad-85c8-3aa37ebabf11" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:39:52 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Lock "67d9ceff-c1fc-48ad-85c8-3aa37ebabf11" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:39:52 user nova-compute[75337]: DEBUG nova.compute.manager [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Starting instance... {{(pid=75337) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 15:39:52 user nova-compute[75337]: DEBUG nova.virt.libvirt.guest [None req-9a855b98-e0b9-4468-a5aa-6a8798153484 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75337) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 06 15:39:52 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:39:52 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:39:52 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75337) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 15:39:52 user nova-compute[75337]: INFO nova.compute.claims [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Claim successful on node user
Nov 06 15:39:53 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:39:53 user nova-compute[75337]: DEBUG nova.virt.libvirt.guest [None req-9a855b98-e0b9-4468-a5aa-6a8798153484 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] COPY block job progress, current cursor: 75235328 final cursor: 75497472 {{(pid=75337) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 06 15:39:53 user nova-compute[75337]: DEBUG nova.network.neutron [req-d4bbf695-d6b4-4644-8efc-14e32e8339b7 req-05a158a3-5891-4eff-a1ee-dc0b74bd4699 service nova] [instance: dfadb21f-5ed1-42f4-956b-95cccf128b6a] Updated VIF entry in instance network info cache for port 8592b366-9f21-4d92-b297-8872d9a7110f. {{(pid=75337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 15:39:53 user nova-compute[75337]: DEBUG nova.network.neutron [req-d4bbf695-d6b4-4644-8efc-14e32e8339b7 req-05a158a3-5891-4eff-a1ee-dc0b74bd4699 service nova] [instance: dfadb21f-5ed1-42f4-956b-95cccf128b6a] Updating instance_info_cache with network_info: [{"id": "8592b366-9f21-4d92-b297-8872d9a7110f", "address": "fa:16:3e:f8:26:1d", "network": {"id": "48f1545d-7e80-462f-9dbf-f1102ddcda9a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1210368397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1013e7afbefd4146a3be04587710b1de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8592b366-9f", "ovs_interfaceid": "8592b366-9f21-4d92-b297-8872d9a7110f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:39:53 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-d4bbf695-d6b4-4644-8efc-14e32e8339b7 req-05a158a3-5891-4eff-a1ee-dc0b74bd4699 service nova] Releasing lock "refresh_cache-dfadb21f-5ed1-42f4-956b-95cccf128b6a" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 15:39:53 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 15:39:53 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 15:39:53 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.719s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:39:53 user nova-compute[75337]: DEBUG nova.compute.manager [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Start building networks asynchronously for instance. {{(pid=75337) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 15:39:53 user nova-compute[75337]: DEBUG nova.compute.manager [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Allocating IP information in the background. {{(pid=75337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 15:39:53 user nova-compute[75337]: DEBUG nova.network.neutron [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] allocate_for_instance() {{(pid=75337) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 15:39:53 user nova-compute[75337]: DEBUG nova.virt.libvirt.guest [None req-9a855b98-e0b9-4468-a5aa-6a8798153484 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75337) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 06 15:39:53 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-9a855b98-e0b9-4468-a5aa-6a8798153484 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] [instance: c8cf1ead-a87c-459c-b914-a0e976c9e464] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 06 15:39:53 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 15:39:53 user nova-compute[75337]: DEBUG nova.privsep.utils [None req-9a855b98-e0b9-4468-a5aa-6a8798153484 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75337) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 06 15:39:53 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-9a855b98-e0b9-4468-a5aa-6a8798153484 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpx0bc4o22/642bc04b6ec7458682c8adb8ab998cb4.delta /opt/stack/data/nova/instances/snapshots/tmpx0bc4o22/642bc04b6ec7458682c8adb8ab998cb4 {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:39:53 user nova-compute[75337]: DEBUG nova.compute.manager [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Start building block device mappings for instance. {{(pid=75337) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 15:39:54 user nova-compute[75337]: INFO nova.virt.block_device [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Booting with volume 4367fb98-2ae9-40c3-a2d0-6e9b0f70dc7c at /dev/vda
Nov 06 15:39:54 user nova-compute[75337]: DEBUG nova.policy [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8a81cde9102743438dd8b84183048cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '664f419c1b904bb3bdd7aff9e621e2e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75337) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 15:39:54 user nova-compute[75337]: DEBUG os_brick.utils [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 15:39:54 user nova-compute[75337]: INFO oslo.privsep.daemon [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpmkvfmfiy/privsep.sock']
Nov 06 15:39:54 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-9a855b98-e0b9-4468-a5aa-6a8798153484 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpx0bc4o22/642bc04b6ec7458682c8adb8ab998cb4.delta /opt/stack/data/nova/instances/snapshots/tmpx0bc4o22/642bc04b6ec7458682c8adb8ab998cb4" returned: 0 in 0.267s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:39:54 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-9a855b98-e0b9-4468-a5aa-6a8798153484 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] [instance: c8cf1ead-a87c-459c-b914-a0e976c9e464] Snapshot extracted, beginning image upload
Nov 06 15:39:54 user sudo[86677]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpmkvfmfiy/privsep.sock
Nov 06 15:39:54 user sudo[86677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 06 15:39:54 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-73be7bda-70dc-4eac-ac84-57f09df3de16 tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] Acquiring lock "5f5fc58d-f946-4df0-b8d0-1aefbf0f8cd6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:39:54 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-73be7bda-70dc-4eac-ac84-57f09df3de16 tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] Lock "5f5fc58d-f946-4df0-b8d0-1aefbf0f8cd6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:39:54 user nova-compute[75337]: DEBUG nova.objects.instance [None req-73be7bda-70dc-4eac-ac84-57f09df3de16 tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] Lazy-loading 'flavor' on Instance uuid 5f5fc58d-f946-4df0-b8d0-1aefbf0f8cd6 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 15:39:54 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-73be7bda-70dc-4eac-ac84-57f09df3de16 tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] Lock "5f5fc58d-f946-4df0-b8d0-1aefbf0f8cd6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.133s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:39:54 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:39:54 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:39:54 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:39:54 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Starting heal instance info cache {{(pid=75337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 15:39:54 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "refresh_cache-5f5fc58d-f946-4df0-b8d0-1aefbf0f8cd6" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 15:39:54 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquired lock "refresh_cache-5f5fc58d-f946-4df0-b8d0-1aefbf0f8cd6" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 15:39:54 user nova-compute[75337]: DEBUG nova.network.neutron [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] [instance: 5f5fc58d-f946-4df0-b8d0-1aefbf0f8cd6] Forcefully refreshing network info cache for instance {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 15:39:54 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-73be7bda-70dc-4eac-ac84-57f09df3de16 tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] Acquiring lock "5f5fc58d-f946-4df0-b8d0-1aefbf0f8cd6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:39:54 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-73be7bda-70dc-4eac-ac84-57f09df3de16 tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] Lock "5f5fc58d-f946-4df0-b8d0-1aefbf0f8cd6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:39:54 user nova-compute[75337]: INFO nova.compute.manager [None req-73be7bda-70dc-4eac-ac84-57f09df3de16 tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] [instance: 5f5fc58d-f946-4df0-b8d0-1aefbf0f8cd6] Attaching volume af7490be-28c7-4ef3-917c-d05cd66f2acb to /dev/vdb
Nov 06 15:39:54 user nova-compute[75337]: DEBUG nova.network.neutron [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Successfully created port: 5d25f565-70a5-427c-a198-4f88dd8b7338 {{(pid=75337) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 15:39:54 user nova-compute[75337]: DEBUG os_brick.utils [None req-73be7bda-70dc-4eac-ac84-57f09df3de16 tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 15:39:55 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:39:55 user nova-compute[75337]: DEBUG nova.network.neutron [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] [instance: 5f5fc58d-f946-4df0-b8d0-1aefbf0f8cd6] Updating instance_info_cache with network_info: [{"id": "9e5c665f-7b51-497e-b9b7-a0f652321a96", "address": "fa:16:3e:f7:8a:4e", "network": {"id": "fa9a4651-99aa-40d8-9010-136c5b9f4c02", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-501845579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b38d5a3287447a580dbd965f44e042c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e5c665f-7b", "ovs_interfaceid": "9e5c665f-7b51-497e-b9b7-a0f652321a96", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:39:55 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Releasing lock "refresh_cache-5f5fc58d-f946-4df0-b8d0-1aefbf0f8cd6" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 15:39:55 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] [instance: 5f5fc58d-f946-4df0-b8d0-1aefbf0f8cd6] Updated the network info_cache for instance {{(pid=75337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 15:39:55 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:39:55 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:39:55 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:39:55 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:39:55 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:39:55 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:39:55 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75337) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 15:39:55 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager.update_available_resource {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:39:55 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:39:55 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:39:55 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:39:55 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Auditing locally available compute resources for user (node: user) {{(pid=75337) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 15:39:55 user nova-compute[75337]: DEBUG nova.network.neutron [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Successfully created port: e87c0766-dd71-4aca-b5f0-32888c7437f5 {{(pid=75337) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 15:39:55 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f5fc58d-f946-4df0-b8d0-1aefbf0f8cd6/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:39:55 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f5fc58d-f946-4df0-b8d0-1aefbf0f8cd6/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:39:55 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f5fc58d-f946-4df0-b8d0-1aefbf0f8cd6/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:39:55 user nova-compute[75337]: DEBUG nova.network.neutron [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Successfully created port: ba50db67-9fb0-49ef-9ea2-db9014b66b17 {{(pid=75337) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 15:39:55 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f5fc58d-f946-4df0-b8d0-1aefbf0f8cd6/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:39:55 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/581cf468-65e7-42e5-9250-c3d645577011/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:39:56 user sudo[86677]: pam_unix(sudo:session): session closed for user root
Nov 06 15:39:56 user nova-compute[75337]: INFO oslo.privsep.daemon [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Spawned new privsep daemon via rootwrap
Nov 06 15:39:56 user nova-compute[75337]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 06 15:39:56 user nova-compute[75337]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 06 15:39:56 user nova-compute[75337]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Nov 06 15:39:56 user nova-compute[75337]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 86696
Nov 06 15:39:56 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[74959dbb-73ac-4cb5-a020-d339dbb988df]: (2,) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:39:56 user nova-compute[75337]: WARNING oslo_privsep.priv_context [None req-73be7bda-70dc-4eac-ac84-57f09df3de16 tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] privsep daemon already running
Nov 06 15:39:56 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/581cf468-65e7-42e5-9250-c3d645577011/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:39:56 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/581cf468-65e7-42e5-9250-c3d645577011/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:39:56 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:39:56 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:39:56 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:39:56 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ad55c3b-822c-441f-9289-aa81741caf91]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4ff6411e45b8\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:39:56 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:39:56 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[aac49964-1ec2-4cb3-b0f1-fa2a3cfb6611]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4ff6411e45b8\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:39:56 user nova-compute[75337]: WARNING os_brick.initiator.connectors.nvmeof [None req-73be7bda-70dc-4eac-ac84-57f09df3de16 tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Nov 06 15:39:56 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:39:56 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:39:56 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:39:56 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[42ee66bc-470d-4037-ab90-8fc33c136498]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:39:56 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:39:56 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.023s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:39:56 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[b38a9c7c-891a-48fd-8849-7a858922458d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:39:56 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:39:56 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:39:56 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb845bc3-5f9f-431c-bff6-67f8aeedf8bd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:39:56 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9d253d6-4316-403b-a9ad-6e5903cc04e6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:39:56 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:39:56 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d8d3d73-f4b4-4888-b7e8-a855eda4c453]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:39:56 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-73be7bda-70dc-4eac-ac84-57f09df3de16 tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] Running cmd (subprocess): nvme version {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:39:56 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-73be7bda-70dc-4eac-ac84-57f09df3de16 tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] 'nvme version' failed. Not Retrying. {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 15:39:56 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.nvmeof [None req-73be7bda-70dc-4eac-ac84-57f09df3de16 tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] nvme not present on system {{(pid=75337) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 15:39:56 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[26e81c8d-9167-4706-8ede-851d76bb2fc0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:39:56 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:39:56 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Running cmd (subprocess): nvme version {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:39:56 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] 'nvme version' failed. Not Retrying. {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 15:39:56 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 15:39:56 user nova-compute[75337]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 15:39:56 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae07d910-df89-492b-940e-619cfec4b0bb]: (4, '') {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:39:56 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] nvme not present on system {{(pid=75337) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 15:39:56 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/581cf468-65e7-42e5-9250-c3d645577011/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:39:56 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:39:56 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.lightos [None req-73be7bda-70dc-4eac-ac84-57f09df3de16 tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75337) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 15:39:56 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.lightos [None req-73be7bda-70dc-4eac-ac84-57f09df3de16 tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 15:39:56 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.lightos [None req-73be7bda-70dc-4eac-ac84-57f09df3de16 tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] LIGHTOS: no hostnqn found. {{(pid=75337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 15:39:56 user nova-compute[75337]: DEBUG os_brick.utils [None req-73be7bda-70dc-4eac-ac84-57f09df3de16 tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] <== get_connector_properties: return (1528ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4ff6411e45b8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 15:39:56 user nova-compute[75337]: DEBUG nova.virt.block_device [None req-73be7bda-70dc-4eac-ac84-57f09df3de16 tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] [instance: 5f5fc58d-f946-4df0-b8d0-1aefbf0f8cd6] Updating existing volume attachment record: 0a222990-040c-43d9-8c6a-dc2498d7fe24 {{(pid=75337) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 15:39:56 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 15:39:56 user nova-compute[75337]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 15:39:56 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbf4dc41-2617-431e-936a-d297368f9269]: (4, '') {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:39:56 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.lightos [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75337) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 15:39:56 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.lightos [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 15:39:56 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.lightos [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] LIGHTOS: no hostnqn found. {{(pid=75337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 15:39:56 user nova-compute[75337]: DEBUG os_brick.utils [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] <== get_connector_properties: return (2281ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4ff6411e45b8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 15:39:56 user nova-compute[75337]: DEBUG nova.virt.block_device [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Updating existing volume attachment record: 6239d0e4-fd56-4c97-aae8-64f7c2bd5315 {{(pid=75337) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 15:39:56 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8cf1ead-a87c-459c-b914-a0e976c9e464/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:39:56 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8cf1ead-a87c-459c-b914-a0e976c9e464/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:39:56 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8cf1ead-a87c-459c-b914-a0e976c9e464/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:39:56 user nova-compute[75337]: DEBUG nova.network.neutron [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Successfully created port: e6be4a87-8794-4e4f-91c1-3c417e0c8d62 {{(pid=75337) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 15:39:56 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8cf1ead-a87c-459c-b914-a0e976c9e464/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:39:56 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76ee582b-b887-4d46-8c78-29f42d1a0d26/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:39:57 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76ee582b-b887-4d46-8c78-29f42d1a0d26/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:39:57 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76ee582b-b887-4d46-8c78-29f42d1a0d26/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:39:57 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-9a855b98-e0b9-4468-a5aa-6a8798153484 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] [instance: c8cf1ead-a87c-459c-b914-a0e976c9e464] Snapshot image upload complete
Nov 06 15:39:57 user nova-compute[75337]: INFO nova.compute.manager [None req-9a855b98-e0b9-4468-a5aa-6a8798153484 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] [instance: c8cf1ead-a87c-459c-b914-a0e976c9e464] Took 7.01 seconds to snapshot the instance on the hypervisor.
Nov 06 15:39:57 user nova-compute[75337]: DEBUG nova.network.neutron [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Successfully created port: 94df5f62-239e-4b8e-a91d-5223c1585f6f {{(pid=75337) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 15:39:57 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76ee582b-b887-4d46-8c78-29f42d1a0d26/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:39:57 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a600bd8-b94a-4242-a443-c2defb002280/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:39:57 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a600bd8-b94a-4242-a443-c2defb002280/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:39:57 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a600bd8-b94a-4242-a443-c2defb002280/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:39:57 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a600bd8-b94a-4242-a443-c2defb002280/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:39:57 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfadb21f-5ed1-42f4-956b-95cccf128b6a/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:39:57 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-4a16fb70-6573-4492-88ac-8e2f38e91528 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Acquiring lock "8a600bd8-b94a-4242-a443-c2defb002280" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:39:57 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-4a16fb70-6573-4492-88ac-8e2f38e91528 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Lock "8a600bd8-b94a-4242-a443-c2defb002280" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.002s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:39:57 user nova-compute[75337]: INFO nova.compute.manager [None req-4a16fb70-6573-4492-88ac-8e2f38e91528 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] [instance: 8a600bd8-b94a-4242-a443-c2defb002280] Shelving
Nov 06 15:39:57 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:39:57 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:39:57 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfadb21f-5ed1-42f4-956b-95cccf128b6a/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:39:57 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfadb21f-5ed1-42f4-956b-95cccf128b6a/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:39:58 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:39:58 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:39:58 user nova-compute[75337]: DEBUG nova.network.neutron [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Successfully updated port: 5d25f565-70a5-427c-a198-4f88dd8b7338 {{(pid=75337) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 15:39:58 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:39:58 user nova-compute[75337]: DEBUG nova.compute.manager [req-f74225c4-6c41-4944-80dc-5e3739467e34 req-e0523fbe-df87-40cc-9973-88cdd241b544 service nova] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Received event network-changed-5d25f565-70a5-427c-a198-4f88dd8b7338 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:39:58 user nova-compute[75337]: DEBUG nova.compute.manager [req-f74225c4-6c41-4944-80dc-5e3739467e34 req-e0523fbe-df87-40cc-9973-88cdd241b544 service nova] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Refreshing instance network info cache due to event network-changed-5d25f565-70a5-427c-a198-4f88dd8b7338. {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 15:39:58 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-f74225c4-6c41-4944-80dc-5e3739467e34 req-e0523fbe-df87-40cc-9973-88cdd241b544 service nova] Acquiring lock "refresh_cache-67d9ceff-c1fc-48ad-85c8-3aa37ebabf11" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 15:39:58 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-f74225c4-6c41-4944-80dc-5e3739467e34 req-e0523fbe-df87-40cc-9973-88cdd241b544 service nova] Acquired lock "refresh_cache-67d9ceff-c1fc-48ad-85c8-3aa37ebabf11" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 15:39:58 user nova-compute[75337]: DEBUG nova.network.neutron [req-f74225c4-6c41-4944-80dc-5e3739467e34 req-e0523fbe-df87-40cc-9973-88cdd241b544 service nova] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Refreshing network info cache for port 5d25f565-70a5-427c-a198-4f88dd8b7338 {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 15:39:58 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfadb21f-5ed1-42f4-956b-95cccf128b6a/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:39:58 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:39:58 user nova-compute[75337]: DEBUG nova.network.neutron [req-f74225c4-6c41-4944-80dc-5e3739467e34 req-e0523fbe-df87-40cc-9973-88cdd241b544 service nova] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Instance cache missing network info. {{(pid=75337) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 15:39:58 user nova-compute[75337]: DEBUG nova.compute.manager [req-1d2fb247-d8db-4a6f-adda-ff23d966b4f2 req-1ca83954-7909-4c6a-b44b-992d31768a43 service nova] [instance: 8a600bd8-b94a-4242-a443-c2defb002280] Received event network-vif-unplugged-01aa7168-78cd-44e6-8496-08d468f62cfe {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:39:58 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-1d2fb247-d8db-4a6f-adda-ff23d966b4f2 req-1ca83954-7909-4c6a-b44b-992d31768a43 service nova] Acquiring lock "8a600bd8-b94a-4242-a443-c2defb002280-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:39:58 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-1d2fb247-d8db-4a6f-adda-ff23d966b4f2 req-1ca83954-7909-4c6a-b44b-992d31768a43 service nova] Lock "8a600bd8-b94a-4242-a443-c2defb002280-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:39:58 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-1d2fb247-d8db-4a6f-adda-ff23d966b4f2 req-1ca83954-7909-4c6a-b44b-992d31768a43 service nova] Lock "8a600bd8-b94a-4242-a443-c2defb002280-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:39:58 user nova-compute[75337]: DEBUG nova.compute.manager [req-1d2fb247-d8db-4a6f-adda-ff23d966b4f2 req-1ca83954-7909-4c6a-b44b-992d31768a43 service nova] [instance: 8a600bd8-b94a-4242-a443-c2defb002280] No waiting events found dispatching network-vif-unplugged-01aa7168-78cd-44e6-8496-08d468f62cfe {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:39:58 user nova-compute[75337]: WARNING nova.compute.manager [req-1d2fb247-d8db-4a6f-adda-ff23d966b4f2 req-1ca83954-7909-4c6a-b44b-992d31768a43 service nova] [instance: 8a600bd8-b94a-4242-a443-c2defb002280] Received unexpected event network-vif-unplugged-01aa7168-78cd-44e6-8496-08d468f62cfe for instance with vm_state active and task_state shelving.
Nov 06 15:39:58 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:39:58 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:39:58 user nova-compute[75337]: INFO nova.virt.libvirt.driver [-] [instance: 8a600bd8-b94a-4242-a443-c2defb002280] Instance destroyed successfully.
Nov 06 15:39:58 user nova-compute[75337]: DEBUG nova.network.neutron [req-f74225c4-6c41-4944-80dc-5e3739467e34 req-e0523fbe-df87-40cc-9973-88cdd241b544 service nova] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Updating instance_info_cache with network_info: [] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:39:58 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-f74225c4-6c41-4944-80dc-5e3739467e34 req-e0523fbe-df87-40cc-9973-88cdd241b544 service nova] Releasing lock "refresh_cache-67d9ceff-c1fc-48ad-85c8-3aa37ebabf11" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 15:39:58 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:39:58 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8858d90e-ee14-494b-80da-904cd97cdff0/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:39:58 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8858d90e-ee14-494b-80da-904cd97cdff0/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:39:58 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8858d90e-ee14-494b-80da-904cd97cdff0/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:39:59 user nova-compute[75337]: DEBUG nova.network.neutron [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Successfully updated port: ac99553f-c5d8-46df-8357-f1f7f189fa22 {{(pid=75337) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 15:39:59 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-4a16fb70-6573-4492-88ac-8e2f38e91528 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] [instance: 8a600bd8-b94a-4242-a443-c2defb002280] Beginning cold snapshot process
Nov 06 15:39:59 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8858d90e-ee14-494b-80da-904cd97cdff0/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:39:59 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83516ff5-c4e7-4e91-a2f9-8af9b51cf475/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:39:59 user nova-compute[75337]: DEBUG nova.privsep.utils [None req-4a16fb70-6573-4492-88ac-8e2f38e91528 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75337) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 06 15:39:59 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-4a16fb70-6573-4492-88ac-8e2f38e91528 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/8a600bd8-b94a-4242-a443-c2defb002280/disk /opt/stack/data/nova/instances/snapshots/tmpygcfjrj8/2cb74d7a3a0844d288a286020966dcb2 {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:39:59 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83516ff5-c4e7-4e91-a2f9-8af9b51cf475/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:39:59 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83516ff5-c4e7-4e91-a2f9-8af9b51cf475/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:39:59 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83516ff5-c4e7-4e91-a2f9-8af9b51cf475/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:40:00 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:40:00 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-4a16fb70-6573-4492-88ac-8e2f38e91528 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/8a600bd8-b94a-4242-a443-c2defb002280/disk /opt/stack/data/nova/instances/snapshots/tmpygcfjrj8/2cb74d7a3a0844d288a286020966dcb2" returned: 0 in 0.943s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:40:00 user nova-compute[75337]: DEBUG nova.network.neutron [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Successfully updated port: abf73a6f-c3c7-46b5-8a9b-0fce5677fa27 {{(pid=75337) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 15:40:00 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-4a16fb70-6573-4492-88ac-8e2f38e91528 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] [instance: 8a600bd8-b94a-4242-a443-c2defb002280] Snapshot extracted, beginning image upload
Nov 06 15:40:00 user nova-compute[75337]: DEBUG nova.compute.manager [req-6273c15c-dd71-40c0-92cb-1e79d12e420d req-bf01c872-ecd7-4a17-b504-c215a4a9a228 service nova] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Received event network-changed-ac99553f-c5d8-46df-8357-f1f7f189fa22 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:40:00 user nova-compute[75337]: DEBUG nova.compute.manager [req-6273c15c-dd71-40c0-92cb-1e79d12e420d req-bf01c872-ecd7-4a17-b504-c215a4a9a228 service nova] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Refreshing instance network info cache due to event network-changed-ac99553f-c5d8-46df-8357-f1f7f189fa22. {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 15:40:00 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-6273c15c-dd71-40c0-92cb-1e79d12e420d req-bf01c872-ecd7-4a17-b504-c215a4a9a228 service nova] Acquiring lock "refresh_cache-67d9ceff-c1fc-48ad-85c8-3aa37ebabf11" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 15:40:00 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-6273c15c-dd71-40c0-92cb-1e79d12e420d req-bf01c872-ecd7-4a17-b504-c215a4a9a228 service nova] Acquired lock "refresh_cache-67d9ceff-c1fc-48ad-85c8-3aa37ebabf11" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 15:40:00 user nova-compute[75337]: DEBUG nova.network.neutron [req-6273c15c-dd71-40c0-92cb-1e79d12e420d req-bf01c872-ecd7-4a17-b504-c215a4a9a228 service nova] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Refreshing network info cache for port ac99553f-c5d8-46df-8357-f1f7f189fa22 {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 15:40:00 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-2dfb6a54-dbaa-4104-8d3e-e3b1b254ca3e tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Acquiring lock "dfadb21f-5ed1-42f4-956b-95cccf128b6a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:40:00 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-2dfb6a54-dbaa-4104-8d3e-e3b1b254ca3e tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Lock "dfadb21f-5ed1-42f4-956b-95cccf128b6a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:40:00 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 15:40:00 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 15:40:00 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Hypervisor/Node resource view: name=user free_ram=7191MB free_disk=25.38813018798828GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75337) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 15:40:00 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:40:00 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:40:00 user nova-compute[75337]: DEBUG nova.objects.instance [None req-2dfb6a54-dbaa-4104-8d3e-e3b1b254ca3e tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Lazy-loading 'flavor' on Instance uuid dfadb21f-5ed1-42f4-956b-95cccf128b6a {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 15:40:00 user nova-compute[75337]: DEBUG nova.compute.manager [req-cfcdf6bc-57df-441f-8d59-68cfb200f773 req-67951dbd-ceea-4e61-bec5-aa311a6cf3df service nova] [instance: 8a600bd8-b94a-4242-a443-c2defb002280] Received event network-vif-plugged-01aa7168-78cd-44e6-8496-08d468f62cfe {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:40:00 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-cfcdf6bc-57df-441f-8d59-68cfb200f773 req-67951dbd-ceea-4e61-bec5-aa311a6cf3df service nova] Acquiring lock "8a600bd8-b94a-4242-a443-c2defb002280-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:40:00 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-cfcdf6bc-57df-441f-8d59-68cfb200f773 req-67951dbd-ceea-4e61-bec5-aa311a6cf3df service nova] Lock "8a600bd8-b94a-4242-a443-c2defb002280-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:40:00 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-cfcdf6bc-57df-441f-8d59-68cfb200f773 req-67951dbd-ceea-4e61-bec5-aa311a6cf3df service nova] Lock "8a600bd8-b94a-4242-a443-c2defb002280-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:40:00 user nova-compute[75337]: DEBUG nova.compute.manager [req-cfcdf6bc-57df-441f-8d59-68cfb200f773 req-67951dbd-ceea-4e61-bec5-aa311a6cf3df service nova] [instance: 8a600bd8-b94a-4242-a443-c2defb002280] No waiting events found dispatching network-vif-plugged-01aa7168-78cd-44e6-8496-08d468f62cfe {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:40:00 user nova-compute[75337]: WARNING nova.compute.manager [req-cfcdf6bc-57df-441f-8d59-68cfb200f773 req-67951dbd-ceea-4e61-bec5-aa311a6cf3df service nova] [instance: 8a600bd8-b94a-4242-a443-c2defb002280] Received unexpected event network-vif-plugged-01aa7168-78cd-44e6-8496-08d468f62cfe for instance with vm_state active and task_state shelving_image_pending_upload.
Nov 06 15:40:00 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-2dfb6a54-dbaa-4104-8d3e-e3b1b254ca3e tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Lock "dfadb21f-5ed1-42f4-956b-95cccf128b6a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.104s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:40:00 user nova-compute[75337]: DEBUG nova.network.neutron [req-6273c15c-dd71-40c0-92cb-1e79d12e420d req-bf01c872-ecd7-4a17-b504-c215a4a9a228 service nova] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Instance cache missing network info. {{(pid=75337) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 15:40:00 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 83516ff5-c4e7-4e91-a2f9-8af9b51cf475 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:40:00 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 5f5fc58d-f946-4df0-b8d0-1aefbf0f8cd6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:40:00 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance c8cf1ead-a87c-459c-b914-a0e976c9e464 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:40:00 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 581cf468-65e7-42e5-9250-c3d645577011 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:40:00 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 8a600bd8-b94a-4242-a443-c2defb002280 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:40:00 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance dfadb21f-5ed1-42f4-956b-95cccf128b6a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:40:00 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 8858d90e-ee14-494b-80da-904cd97cdff0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:40:00 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:40:00 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 76ee582b-b887-4d46-8c78-29f42d1a0d26 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:40:00 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:40:00 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 15:40:00 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 15:40:00 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-2dfb6a54-dbaa-4104-8d3e-e3b1b254ca3e tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Acquiring lock "dfadb21f-5ed1-42f4-956b-95cccf128b6a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:40:00 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-2dfb6a54-dbaa-4104-8d3e-e3b1b254ca3e tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Lock "dfadb21f-5ed1-42f4-956b-95cccf128b6a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:40:00 user nova-compute[75337]: INFO nova.compute.manager [None req-2dfb6a54-dbaa-4104-8d3e-e3b1b254ca3e tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] [instance: dfadb21f-5ed1-42f4-956b-95cccf128b6a] Attaching volume 466b6a4a-f809-4194-abc2-cb0148279759 to /dev/vdb
Nov 06 15:40:00 user nova-compute[75337]: DEBUG nova.network.neutron [req-6273c15c-dd71-40c0-92cb-1e79d12e420d req-bf01c872-ecd7-4a17-b504-c215a4a9a228 service nova] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Updating instance_info_cache with network_info: [] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:40:00 user nova-compute[75337]: DEBUG os_brick.utils [None req-2dfb6a54-dbaa-4104-8d3e-e3b1b254ca3e tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 15:40:00 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:40:00 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-6273c15c-dd71-40c0-92cb-1e79d12e420d req-bf01c872-ecd7-4a17-b504-c215a4a9a228 service nova] Releasing lock "refresh_cache-67d9ceff-c1fc-48ad-85c8-3aa37ebabf11" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 15:40:00 user nova-compute[75337]: DEBUG nova.compute.manager [req-6273c15c-dd71-40c0-92cb-1e79d12e420d req-bf01c872-ecd7-4a17-b504-c215a4a9a228 service nova] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Received event network-changed-abf73a6f-c3c7-46b5-8a9b-0fce5677fa27 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:40:00 user nova-compute[75337]: DEBUG nova.compute.manager [req-6273c15c-dd71-40c0-92cb-1e79d12e420d req-bf01c872-ecd7-4a17-b504-c215a4a9a228 service nova] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Refreshing instance network info cache due to event network-changed-abf73a6f-c3c7-46b5-8a9b-0fce5677fa27. {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 15:40:00 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-6273c15c-dd71-40c0-92cb-1e79d12e420d req-bf01c872-ecd7-4a17-b504-c215a4a9a228 service nova] Acquiring lock "refresh_cache-67d9ceff-c1fc-48ad-85c8-3aa37ebabf11" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 15:40:00 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-6273c15c-dd71-40c0-92cb-1e79d12e420d req-bf01c872-ecd7-4a17-b504-c215a4a9a228 service nova] Acquired lock "refresh_cache-67d9ceff-c1fc-48ad-85c8-3aa37ebabf11" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 15:40:00 user nova-compute[75337]: DEBUG nova.network.neutron [req-6273c15c-dd71-40c0-92cb-1e79d12e420d req-bf01c872-ecd7-4a17-b504-c215a4a9a228 service nova] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Refreshing network info cache for port abf73a6f-c3c7-46b5-8a9b-0fce5677fa27 {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 15:40:00 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:40:00 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[94618d39-766a-481a-a4c6-e6836fb79824]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4ff6411e45b8\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:40:00 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:40:00 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:40:00 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccf64af7-4120-49dc-b86b-c267719f81ff]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:40:00 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:40:00 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:40:00 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[80d3cecf-5afe-42af-9cc8-c267cb587dd6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:40:00 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ea82e5e-9563-4cbd-b779-d19853fcb635]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:40:00 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-2dfb6a54-dbaa-4104-8d3e-e3b1b254ca3e tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Running cmd (subprocess): nvme version {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:40:00 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-2dfb6a54-dbaa-4104-8d3e-e3b1b254ca3e tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] 'nvme version' failed. Not Retrying. {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 15:40:00 user nova-compute[75337]: DEBUG nova.network.neutron [req-6273c15c-dd71-40c0-92cb-1e79d12e420d req-bf01c872-ecd7-4a17-b504-c215a4a9a228 service nova] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Instance cache missing network info. {{(pid=75337) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 15:40:00 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2dfb6a54-dbaa-4104-8d3e-e3b1b254ca3e tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] nvme not present on system {{(pid=75337) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 15:40:00 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:40:00 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 15:40:00 user nova-compute[75337]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 15:40:00 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6e83ae0-efa7-4821-a7d8-ee9383d49cc2]: (4, '') {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:40:00 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.lightos [None req-2dfb6a54-dbaa-4104-8d3e-e3b1b254ca3e tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75337) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 15:40:00 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.lightos [None req-2dfb6a54-dbaa-4104-8d3e-e3b1b254ca3e tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 15:40:00 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.lightos [None req-2dfb6a54-dbaa-4104-8d3e-e3b1b254ca3e tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] LIGHTOS: no hostnqn found. {{(pid=75337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 15:40:00 user nova-compute[75337]: DEBUG os_brick.utils [None req-2dfb6a54-dbaa-4104-8d3e-e3b1b254ca3e tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] <== get_connector_properties: return (185ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4ff6411e45b8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 15:40:00 user nova-compute[75337]: DEBUG nova.virt.block_device [None req-2dfb6a54-dbaa-4104-8d3e-e3b1b254ca3e tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] [instance: dfadb21f-5ed1-42f4-956b-95cccf128b6a] Updating existing volume attachment record: 31ce2719-7733-405f-ab30-f166cff0ff54 {{(pid=75337) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 15:40:00 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 15:40:00 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 15:40:00 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Compute_service record updated for user:user {{(pid=75337) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 15:40:00 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.718s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:40:01 user nova-compute[75337]: DEBUG nova.network.neutron [req-6273c15c-dd71-40c0-92cb-1e79d12e420d req-bf01c872-ecd7-4a17-b504-c215a4a9a228 service nova] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Updating instance_info_cache with network_info: [] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:40:01 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-6273c15c-dd71-40c0-92cb-1e79d12e420d req-bf01c872-ecd7-4a17-b504-c215a4a9a228 service nova] Releasing lock "refresh_cache-67d9ceff-c1fc-48ad-85c8-3aa37ebabf11" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 15:40:01 user nova-compute[75337]: DEBUG nova.network.neutron [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Successfully updated port: e87c0766-dd71-4aca-b5f0-32888c7437f5 {{(pid=75337) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 15:40:01 user nova-compute[75337]: DEBUG nova.network.neutron [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Successfully updated port: ba50db67-9fb0-49ef-9ea2-db9014b66b17 {{(pid=75337) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 15:40:02 user nova-compute[75337]: DEBUG nova.compute.manager [req-a0b34598-b878-418a-bfdc-4909083e0421 req-2dd46341-a06a-47c1-865b-a235557adcc4 service nova] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Received event network-changed-e87c0766-dd71-4aca-b5f0-32888c7437f5 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:40:02 user nova-compute[75337]: DEBUG nova.compute.manager [req-a0b34598-b878-418a-bfdc-4909083e0421 req-2dd46341-a06a-47c1-865b-a235557adcc4 service nova] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Refreshing instance network info cache due to event network-changed-e87c0766-dd71-4aca-b5f0-32888c7437f5. {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 15:40:02 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-a0b34598-b878-418a-bfdc-4909083e0421 req-2dd46341-a06a-47c1-865b-a235557adcc4 service nova] Acquiring lock "refresh_cache-67d9ceff-c1fc-48ad-85c8-3aa37ebabf11" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 15:40:02 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-a0b34598-b878-418a-bfdc-4909083e0421 req-2dd46341-a06a-47c1-865b-a235557adcc4 service nova] Acquired lock "refresh_cache-67d9ceff-c1fc-48ad-85c8-3aa37ebabf11" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 15:40:02 user nova-compute[75337]: DEBUG nova.network.neutron [req-a0b34598-b878-418a-bfdc-4909083e0421 req-2dd46341-a06a-47c1-865b-a235557adcc4 service nova] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Refreshing network info cache for port e87c0766-dd71-4aca-b5f0-32888c7437f5 {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 15:40:02 user nova-compute[75337]: DEBUG nova.network.neutron [req-a0b34598-b878-418a-bfdc-4909083e0421 req-2dd46341-a06a-47c1-865b-a235557adcc4 service nova] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Instance cache missing network info. {{(pid=75337) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 15:40:02 user nova-compute[75337]: DEBUG nova.network.neutron [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Successfully updated port: e6be4a87-8794-4e4f-91c1-3c417e0c8d62 {{(pid=75337) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 15:40:02 user nova-compute[75337]: DEBUG nova.network.neutron [req-a0b34598-b878-418a-bfdc-4909083e0421 req-2dd46341-a06a-47c1-865b-a235557adcc4 service nova] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Updating instance_info_cache with network_info: [] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:40:02 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-a0b34598-b878-418a-bfdc-4909083e0421 req-2dd46341-a06a-47c1-865b-a235557adcc4 service nova] Releasing lock "refresh_cache-67d9ceff-c1fc-48ad-85c8-3aa37ebabf11" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 15:40:02 user nova-compute[75337]: DEBUG nova.compute.manager [req-a0b34598-b878-418a-bfdc-4909083e0421 req-2dd46341-a06a-47c1-865b-a235557adcc4 service nova] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Received event network-changed-ba50db67-9fb0-49ef-9ea2-db9014b66b17 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:40:02 user nova-compute[75337]: DEBUG nova.compute.manager [req-a0b34598-b878-418a-bfdc-4909083e0421 req-2dd46341-a06a-47c1-865b-a235557adcc4 service nova] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Refreshing instance network info cache due to event network-changed-ba50db67-9fb0-49ef-9ea2-db9014b66b17. {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 15:40:02 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-a0b34598-b878-418a-bfdc-4909083e0421 req-2dd46341-a06a-47c1-865b-a235557adcc4 service nova] Acquiring lock "refresh_cache-67d9ceff-c1fc-48ad-85c8-3aa37ebabf11" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 15:40:02 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-a0b34598-b878-418a-bfdc-4909083e0421 req-2dd46341-a06a-47c1-865b-a235557adcc4 service nova] Acquired lock "refresh_cache-67d9ceff-c1fc-48ad-85c8-3aa37ebabf11" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 15:40:02 user nova-compute[75337]: DEBUG nova.network.neutron [req-a0b34598-b878-418a-bfdc-4909083e0421 req-2dd46341-a06a-47c1-865b-a235557adcc4 service nova] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Refreshing network info cache for port ba50db67-9fb0-49ef-9ea2-db9014b66b17 {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 15:40:02 user nova-compute[75337]: DEBUG nova.network.neutron [req-a0b34598-b878-418a-bfdc-4909083e0421 req-2dd46341-a06a-47c1-865b-a235557adcc4 service nova] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Instance cache missing network info. {{(pid=75337) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 15:40:02 user nova-compute[75337]: DEBUG nova.network.neutron [req-a0b34598-b878-418a-bfdc-4909083e0421 req-2dd46341-a06a-47c1-865b-a235557adcc4 service nova] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Updating instance_info_cache with network_info: [] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:40:02 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-a0b34598-b878-418a-bfdc-4909083e0421 req-2dd46341-a06a-47c1-865b-a235557adcc4 service nova] Releasing lock "refresh_cache-67d9ceff-c1fc-48ad-85c8-3aa37ebabf11" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 15:40:03 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:40:03 user nova-compute[75337]: DEBUG nova.network.neutron [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Successfully updated port: 94df5f62-239e-4b8e-a91d-5223c1585f6f {{(pid=75337) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 15:40:03 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Acquiring lock "refresh_cache-67d9ceff-c1fc-48ad-85c8-3aa37ebabf11" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 15:40:03 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Acquired lock "refresh_cache-67d9ceff-c1fc-48ad-85c8-3aa37ebabf11" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 15:40:03 user nova-compute[75337]: DEBUG nova.network.neutron [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Building network info cache for instance {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 15:40:03 user nova-compute[75337]: DEBUG nova.network.neutron [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Instance cache missing network info. {{(pid=75337) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 15:40:03 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-4a16fb70-6573-4492-88ac-8e2f38e91528 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] [instance: 8a600bd8-b94a-4242-a443-c2defb002280] Snapshot image upload complete
Nov 06 15:40:03 user nova-compute[75337]: DEBUG nova.compute.manager [None req-4a16fb70-6573-4492-88ac-8e2f38e91528 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] [instance: 8a600bd8-b94a-4242-a443-c2defb002280] Checking state {{(pid=75337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 15:40:03 user nova-compute[75337]: INFO nova.compute.manager [None req-4a16fb70-6573-4492-88ac-8e2f38e91528 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] [instance: 8a600bd8-b94a-4242-a443-c2defb002280] Shelve offloading
Nov 06 15:40:03 user nova-compute[75337]: INFO nova.virt.libvirt.driver [-] [instance: 8a600bd8-b94a-4242-a443-c2defb002280] Instance destroyed successfully.
Nov 06 15:40:03 user nova-compute[75337]: DEBUG nova.compute.manager [None req-4a16fb70-6573-4492-88ac-8e2f38e91528 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] [instance: 8a600bd8-b94a-4242-a443-c2defb002280] Checking state {{(pid=75337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 15:40:03 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-4a16fb70-6573-4492-88ac-8e2f38e91528 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Acquiring lock "refresh_cache-8a600bd8-b94a-4242-a443-c2defb002280" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 15:40:03 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-4a16fb70-6573-4492-88ac-8e2f38e91528 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Acquired lock "refresh_cache-8a600bd8-b94a-4242-a443-c2defb002280" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 15:40:03 user nova-compute[75337]: DEBUG nova.network.neutron [None req-4a16fb70-6573-4492-88ac-8e2f38e91528 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] [instance: 8a600bd8-b94a-4242-a443-c2defb002280] Building network info cache for instance {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 15:40:04 user nova-compute[75337]: DEBUG nova.compute.manager [req-dd555aeb-74fd-4bb6-b026-cbf2f2779014 req-c72100b2-febe-45f5-8a36-9c6df1d3e2a1 service nova] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Received event network-changed-e6be4a87-8794-4e4f-91c1-3c417e0c8d62 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:40:04 user nova-compute[75337]: DEBUG nova.compute.manager [req-dd555aeb-74fd-4bb6-b026-cbf2f2779014 req-c72100b2-febe-45f5-8a36-9c6df1d3e2a1 service nova] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Refreshing instance network info cache due to event network-changed-e6be4a87-8794-4e4f-91c1-3c417e0c8d62. {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 15:40:04 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-dd555aeb-74fd-4bb6-b026-cbf2f2779014 req-c72100b2-febe-45f5-8a36-9c6df1d3e2a1 service nova] Acquiring lock "refresh_cache-67d9ceff-c1fc-48ad-85c8-3aa37ebabf11" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 15:40:04 user nova-compute[75337]: DEBUG nova.network.neutron [None req-4a16fb70-6573-4492-88ac-8e2f38e91528 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] [instance: 8a600bd8-b94a-4242-a443-c2defb002280] Updating instance_info_cache with network_info: [{"id": "01aa7168-78cd-44e6-8496-08d468f62cfe", "address": "fa:16:3e:f1:25:3e", "network": {"id": "f24470c2-ff6f-49fd-b28f-16b8a87ed3b4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-217486733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed09a1def6f0477796404d9bd3357dd0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01aa7168-78", "ovs_interfaceid": "01aa7168-78cd-44e6-8496-08d468f62cfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:40:04 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-4a16fb70-6573-4492-88ac-8e2f38e91528 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Releasing lock "refresh_cache-8a600bd8-b94a-4242-a443-c2defb002280" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 15:40:05 user nova-compute[75337]: INFO nova.virt.libvirt.driver [-] [instance: 8a600bd8-b94a-4242-a443-c2defb002280] Instance destroyed successfully.
Nov 06 15:40:05 user nova-compute[75337]: DEBUG nova.objects.instance [None req-4a16fb70-6573-4492-88ac-8e2f38e91528 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Lazy-loading 'resources' on Instance uuid 8a600bd8-b94a-4242-a443-c2defb002280 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 15:40:05 user nova-compute[75337]: DEBUG nova.compute.manager [req-2973eedd-f725-44f7-a3e1-bfea0fe74eed req-d2f90402-7665-495e-b910-b3d2fd2be6bf service nova] [instance: 8a600bd8-b94a-4242-a443-c2defb002280] Received event network-changed-01aa7168-78cd-44e6-8496-08d468f62cfe {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:40:05 user nova-compute[75337]: DEBUG nova.compute.manager [req-2973eedd-f725-44f7-a3e1-bfea0fe74eed req-d2f90402-7665-495e-b910-b3d2fd2be6bf service nova] [instance: 8a600bd8-b94a-4242-a443-c2defb002280] Refreshing instance network info cache due to event network-changed-01aa7168-78cd-44e6-8496-08d468f62cfe. {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 15:40:05 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-2973eedd-f725-44f7-a3e1-bfea0fe74eed req-d2f90402-7665-495e-b910-b3d2fd2be6bf service nova] Acquiring lock "refresh_cache-8a600bd8-b94a-4242-a443-c2defb002280" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 15:40:05 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-2973eedd-f725-44f7-a3e1-bfea0fe74eed req-d2f90402-7665-495e-b910-b3d2fd2be6bf service nova] Acquired lock "refresh_cache-8a600bd8-b94a-4242-a443-c2defb002280" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 15:40:05 user nova-compute[75337]: DEBUG nova.network.neutron [req-2973eedd-f725-44f7-a3e1-bfea0fe74eed req-d2f90402-7665-495e-b910-b3d2fd2be6bf service nova] [instance: 8a600bd8-b94a-4242-a443-c2defb002280] Refreshing network info cache for port 01aa7168-78cd-44e6-8496-08d468f62cfe {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 15:40:05 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-4a16fb70-6573-4492-88ac-8e2f38e91528 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T15:37:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1664848086',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1664848086',id=5,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC0FniBLNu9YJVY4Z8IGuBWVqyZPytkJWiSZMci+GzSs1MwK9lb3C3ke0n2MIwR14vwCuigfmGIf66GQZ9tJlOwMOS19unmyr2FElzX/8lOCboMN5SHwokzc4XAnJBg1jA==',key_name='tempest-keypair-1277258187',keypairs=<?>,launch_index=0,launched_at=2023-11-06T15:38:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='ed09a1def6f0477796404d9bd3357dd0',ramdisk_id='',reservation_id='r-4kx37btu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-417383725',owner_user_name='tempest-AttachVolumeShelveTestJSON-417383725-project-member',shelved_at='2023-11-06T15:40:03.727921',shelved_host='user',shelved_image_id='b903ecce-b6cc-4173-97b0-7dcdc01e4622'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T15:40:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9e1c021de4da40518ddc45a57ef79d6f',uuid=8a600bd8-b94a-4242-a443-c2defb002280,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "01aa7168-78cd-44e6-8496-08d468f62cfe", "address": "fa:16:3e:f1:25:3e", "network": {"id": "f24470c2-ff6f-49fd-b28f-16b8a87ed3b4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-217486733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed09a1def6f0477796404d9bd3357dd0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01aa7168-78", "ovs_interfaceid": "01aa7168-78cd-44e6-8496-08d468f62cfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 15:40:05 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-4a16fb70-6573-4492-88ac-8e2f38e91528 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Converting VIF {"id": "01aa7168-78cd-44e6-8496-08d468f62cfe", "address": "fa:16:3e:f1:25:3e", "network": {"id": "f24470c2-ff6f-49fd-b28f-16b8a87ed3b4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-217486733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed09a1def6f0477796404d9bd3357dd0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01aa7168-78", "ovs_interfaceid": "01aa7168-78cd-44e6-8496-08d468f62cfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 15:40:05 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-4a16fb70-6573-4492-88ac-8e2f38e91528 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:25:3e,bridge_name='br-int',has_traffic_filtering=True,id=01aa7168-78cd-44e6-8496-08d468f62cfe,network=Network(f24470c2-ff6f-49fd-b28f-16b8a87ed3b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01aa7168-78') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 15:40:05 user nova-compute[75337]: DEBUG os_vif [None req-4a16fb70-6573-4492-88ac-8e2f38e91528 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:25:3e,bridge_name='br-int',has_traffic_filtering=True,id=01aa7168-78cd-44e6-8496-08d468f62cfe,network=Network(f24470c2-ff6f-49fd-b28f-16b8a87ed3b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01aa7168-78') {{(pid=75337) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 15:40:05 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:40:05 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap01aa7168-78, bridge=br-int, if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:40:05 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:40:05 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:40:05 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:40:05 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=84b68102-6714-48f9-b4e8-c2f4c6d4a192) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:40:05 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:40:05 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:40:05 user nova-compute[75337]: INFO os_vif [None req-4a16fb70-6573-4492-88ac-8e2f38e91528 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:25:3e,bridge_name='br-int',has_traffic_filtering=True,id=01aa7168-78cd-44e6-8496-08d468f62cfe,network=Network(f24470c2-ff6f-49fd-b28f-16b8a87ed3b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01aa7168-78')
Nov 06 15:40:05 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-4a16fb70-6573-4492-88ac-8e2f38e91528 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] [instance: 8a600bd8-b94a-4242-a443-c2defb002280] Deleting instance files /opt/stack/data/nova/instances/8a600bd8-b94a-4242-a443-c2defb002280_del
Nov 06 15:40:05 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-4a16fb70-6573-4492-88ac-8e2f38e91528 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] [instance: 8a600bd8-b94a-4242-a443-c2defb002280] Deletion of /opt/stack/data/nova/instances/8a600bd8-b94a-4242-a443-c2defb002280_del complete
Nov 06 15:40:05 user nova-compute[75337]: INFO nova.scheduler.client.report [None req-4a16fb70-6573-4492-88ac-8e2f38e91528 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Deleted allocations for instance 8a600bd8-b94a-4242-a443-c2defb002280
Nov 06 15:40:05 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-4a16fb70-6573-4492-88ac-8e2f38e91528 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:40:05 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-4a16fb70-6573-4492-88ac-8e2f38e91528 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:40:05 user nova-compute[75337]: DEBUG nova.network.neutron [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Updating instance_info_cache with network_info: [{"id": "5d25f565-70a5-427c-a198-4f88dd8b7338", "address": "fa:16:3e:39:62:9f", "network": {"id": "4b3a9463-7120-499a-bdef-bd2ce9443d88", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1482718546-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "664f419c1b904bb3bdd7aff9e621e2e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d25f565-70", "ovs_interfaceid": "5d25f565-70a5-427c-a198-4f88dd8b7338", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ac99553f-c5d8-46df-8357-f1f7f189fa22", "address": "fa:16:3e:37:11:e5", "network": {"id": "793579d8-5696-4c41-b09e-19e19908b703", "bridge": "br-int", "label": "tempest-device-tagging-net1-1052173633", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.61", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "664f419c1b904bb3bdd7aff9e621e2e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac99553f-c5", "ovs_interfaceid": "ac99553f-c5d8-46df-8357-f1f7f189fa22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "abf73a6f-c3c7-46b5-8a9b-0fce5677fa27", "address": "fa:16:3e:68:66:1c", "network": {"id": "793579d8-5696-4c41-b09e-19e19908b703", "bridge": "br-int", "label": "tempest-device-tagging-net1-1052173633", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.239", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "664f419c1b904bb3bdd7aff9e621e2e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabf73a6f-c3", "ovs_interfaceid": "abf73a6f-c3c7-46b5-8a9b-0fce5677fa27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e87c0766-dd71-4aca-b5f0-32888c7437f5", "address": "fa:16:3e:b5:06:33", "network": {"id": "793579d8-5696-4c41-b09e-19e19908b703", "bridge": "br-int", "label": "tempest-device-tagging-net1-1052173633", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "664f419c1b904bb3bdd7aff9e621e2e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape87c0766-dd", "ovs_interfaceid": "e87c0766-dd71-4aca-b5f0-32888c7437f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ba50db67-9fb0-49ef-9ea2-db9014b66b17", "address": "fa:16:3e:1a:f9:b0", "network": {"id": "793579d8-5696-4c41-b09e-19e19908b703", "bridge": "br-int", "label": "tempest-device-tagging-net1-1052173633", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "664f419c1b904bb3bdd7aff9e621e2e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba50db67-9f", "ovs_interfaceid": "ba50db67-9fb0-49ef-9ea2-db9014b66b17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e6be4a87-8794-4e4f-91c1-3c417e0c8d62", "address": "fa:16:3e:df:a8:14", "network": {"id": "512e1b59-3c5a-4be6-bf3d-2ee51ce2042a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1219094622", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "664f419c1b904bb3bdd7aff9e621e2e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6be4a87-87", "ovs_interfaceid": "e6be4a87-8794-4e4f-91c1-3c417e0c8d62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "94df5f62-239e-4b8e-a91d-5223c1585f6f", "address": "fa:16:3e:03:8e:66", "network": {"id": "512e1b59-3c5a-4be6-bf3d-2ee51ce2042a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1219094622", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "664f419c1b904bb3bdd7aff9e621e2e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94df5f62-23", "ovs_interfaceid": "94df5f62-239e-4b8e-a91d-5223c1585f6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:40:05 user nova-compute[75337]: DEBUG nova.objects.instance [None req-4a16fb70-6573-4492-88ac-8e2f38e91528 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Lazy-loading 'numa_topology' on Instance uuid 8a600bd8-b94a-4242-a443-c2defb002280 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 15:40:05 user nova-compute[75337]: DEBUG nova.objects.base [None req-4a16fb70-6573-4492-88ac-8e2f38e91528 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Object Instance<8a600bd8-b94a-4242-a443-c2defb002280> lazy-loaded attributes: resources,numa_topology {{(pid=75337) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 15:40:05 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Releasing lock "refresh_cache-67d9ceff-c1fc-48ad-85c8-3aa37ebabf11" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 15:40:05 user nova-compute[75337]: DEBUG nova.compute.manager [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Instance network_info: |[{"id": "5d25f565-70a5-427c-a198-4f88dd8b7338", "address": "fa:16:3e:39:62:9f", "network": {"id": "4b3a9463-7120-499a-bdef-bd2ce9443d88", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1482718546-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "664f419c1b904bb3bdd7aff9e621e2e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d25f565-70", "ovs_interfaceid": "5d25f565-70a5-427c-a198-4f88dd8b7338", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ac99553f-c5d8-46df-8357-f1f7f189fa22", "address": "fa:16:3e:37:11:e5", "network": {"id": "793579d8-5696-4c41-b09e-19e19908b703", "bridge": "br-int", "label": "tempest-device-tagging-net1-1052173633", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.61", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "664f419c1b904bb3bdd7aff9e621e2e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac99553f-c5", "ovs_interfaceid": "ac99553f-c5d8-46df-8357-f1f7f189fa22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "abf73a6f-c3c7-46b5-8a9b-0fce5677fa27", "address": "fa:16:3e:68:66:1c", "network": {"id": "793579d8-5696-4c41-b09e-19e19908b703", "bridge": "br-int", "label": "tempest-device-tagging-net1-1052173633", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.239", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "664f419c1b904bb3bdd7aff9e621e2e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabf73a6f-c3", "ovs_interfaceid": "abf73a6f-c3c7-46b5-8a9b-0fce5677fa27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e87c0766-dd71-4aca-b5f0-32888c7437f5", "address": "fa:16:3e:b5:06:33", "network": {"id": "793579d8-5696-4c41-b09e-19e19908b703", "bridge": "br-int", "label": "tempest-device-tagging-net1-1052173633", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "664f419c1b904bb3bdd7aff9e621e2e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape87c0766-dd", "ovs_interfaceid": "e87c0766-dd71-4aca-b5f0-32888c7437f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ba50db67-9fb0-49ef-9ea2-db9014b66b17", "address": "fa:16:3e:1a:f9:b0", "network": {"id": "793579d8-5696-4c41-b09e-19e19908b703", "bridge": "br-int", "label": "tempest-device-tagging-net1-1052173633", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "664f419c1b904bb3bdd7aff9e621e2e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba50db67-9f", "ovs_interfaceid": "ba50db67-9fb0-49ef-9ea2-db9014b66b17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e6be4a87-8794-4e4f-91c1-3c417e0c8d62", "address": "fa:16:3e:df:a8:14", "network": {"id": "512e1b59-3c5a-4be6-bf3d-2ee51ce2042a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1219094622", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "664f419c1b904bb3bdd7aff9e621e2e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6be4a87-87", "ovs_interfaceid": "e6be4a87-8794-4e4f-91c1-3c417e0c8d62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "94df5f62-239e-4b8e-a91d-5223c1585f6f", "address": "fa:16:3e:03:8e:66", "network": {"id": "512e1b59-3c5a-4be6-bf3d-2ee51ce2042a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1219094622", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "664f419c1b904bb3bdd7aff9e621e2e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94df5f62-23", "ovs_interfaceid": "94df5f62-239e-4b8e-a91d-5223c1585f6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 15:40:05 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-dd555aeb-74fd-4bb6-b026-cbf2f2779014 req-c72100b2-febe-45f5-8a36-9c6df1d3e2a1 service nova] Acquired lock "refresh_cache-67d9ceff-c1fc-48ad-85c8-3aa37ebabf11" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 15:40:05 user nova-compute[75337]: DEBUG nova.network.neutron [req-dd555aeb-74fd-4bb6-b026-cbf2f2779014 req-c72100b2-febe-45f5-8a36-9c6df1d3e2a1 service nova] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Refreshing network info cache for port e6be4a87-8794-4e4f-91c1-3c417e0c8d62 {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 15:40:05 user nova-compute[75337]: DEBUG nova.network.neutron [req-2973eedd-f725-44f7-a3e1-bfea0fe74eed req-d2f90402-7665-495e-b910-b3d2fd2be6bf service nova] [instance: 8a600bd8-b94a-4242-a443-c2defb002280] Updated VIF entry in instance network info cache for port 01aa7168-78cd-44e6-8496-08d468f62cfe. {{(pid=75337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 15:40:05 user nova-compute[75337]: DEBUG nova.network.neutron [req-2973eedd-f725-44f7-a3e1-bfea0fe74eed req-d2f90402-7665-495e-b910-b3d2fd2be6bf service nova] [instance: 8a600bd8-b94a-4242-a443-c2defb002280] Updating instance_info_cache with network_info: [{"id": "01aa7168-78cd-44e6-8496-08d468f62cfe", "address": "fa:16:3e:f1:25:3e", "network": {"id": "f24470c2-ff6f-49fd-b28f-16b8a87ed3b4", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-217486733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed09a1def6f0477796404d9bd3357dd0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap01aa7168-78", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:40:05 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-2973eedd-f725-44f7-a3e1-bfea0fe74eed req-d2f90402-7665-495e-b910-b3d2fd2be6bf service nova] Releasing lock "refresh_cache-8a600bd8-b94a-4242-a443-c2defb002280" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 15:40:05 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-4a16fb70-6573-4492-88ac-8e2f38e91528 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 15:40:05 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-4a16fb70-6573-4492-88ac-8e2f38e91528 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 15:40:05 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-4a16fb70-6573-4492-88ac-8e2f38e91528 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.382s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:40:05 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-4a16fb70-6573-4492-88ac-8e2f38e91528 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Lock "8a600bd8-b94a-4242-a443-c2defb002280" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 8.027s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:40:05 user nova-compute[75337]: DEBUG nova.network.neutron [req-dd555aeb-74fd-4bb6-b026-cbf2f2779014 req-c72100b2-febe-45f5-8a36-9c6df1d3e2a1 service nova] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Updated VIF entry in instance network info cache for port e6be4a87-8794-4e4f-91c1-3c417e0c8d62. {{(pid=75337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 15:40:05 user nova-compute[75337]: DEBUG nova.network.neutron [req-dd555aeb-74fd-4bb6-b026-cbf2f2779014 req-c72100b2-febe-45f5-8a36-9c6df1d3e2a1 service nova] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Updating instance_info_cache with network_info: [{"id": "5d25f565-70a5-427c-a198-4f88dd8b7338", "address": "fa:16:3e:39:62:9f", "network": {"id": "4b3a9463-7120-499a-bdef-bd2ce9443d88", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1482718546-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "664f419c1b904bb3bdd7aff9e621e2e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d25f565-70", "ovs_interfaceid": "5d25f565-70a5-427c-a198-4f88dd8b7338", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ac99553f-c5d8-46df-8357-f1f7f189fa22", "address": "fa:16:3e:37:11:e5", "network": {"id": "793579d8-5696-4c41-b09e-19e19908b703", "bridge": "br-int", "label": "tempest-device-tagging-net1-1052173633", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.61", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "664f419c1b904bb3bdd7aff9e621e2e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac99553f-c5", "ovs_interfaceid": "ac99553f-c5d8-46df-8357-f1f7f189fa22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "abf73a6f-c3c7-46b5-8a9b-0fce5677fa27", "address": "fa:16:3e:68:66:1c", "network": {"id": "793579d8-5696-4c41-b09e-19e19908b703", "bridge": "br-int", "label": "tempest-device-tagging-net1-1052173633", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.239", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "664f419c1b904bb3bdd7aff9e621e2e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabf73a6f-c3", "ovs_interfaceid": "abf73a6f-c3c7-46b5-8a9b-0fce5677fa27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e87c0766-dd71-4aca-b5f0-32888c7437f5", "address": "fa:16:3e:b5:06:33", "network": {"id": "793579d8-5696-4c41-b09e-19e19908b703", "bridge": "br-int", "label": "tempest-device-tagging-net1-1052173633", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "664f419c1b904bb3bdd7aff9e621e2e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape87c0766-dd", "ovs_interfaceid": "e87c0766-dd71-4aca-b5f0-32888c7437f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ba50db67-9fb0-49ef-9ea2-db9014b66b17", "address": "fa:16:3e:1a:f9:b0", "network": {"id": "793579d8-5696-4c41-b09e-19e19908b703", "bridge": "br-int", "label": "tempest-device-tagging-net1-1052173633", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "664f419c1b904bb3bdd7aff9e621e2e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba50db67-9f", "ovs_interfaceid": "ba50db67-9fb0-49ef-9ea2-db9014b66b17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e6be4a87-8794-4e4f-91c1-3c417e0c8d62", "address": "fa:16:3e:df:a8:14", "network": {"id": "512e1b59-3c5a-4be6-bf3d-2ee51ce2042a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1219094622", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "664f419c1b904bb3bdd7aff9e621e2e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6be4a87-87", "ovs_interfaceid": "e6be4a87-8794-4e4f-91c1-3c417e0c8d62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "94df5f62-239e-4b8e-a91d-5223c1585f6f", "address": "fa:16:3e:03:8e:66", "network": {"id": "512e1b59-3c5a-4be6-bf3d-2ee51ce2042a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1219094622", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "664f419c1b904bb3bdd7aff9e621e2e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94df5f62-23", "ovs_interfaceid": "94df5f62-239e-4b8e-a91d-5223c1585f6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:40:05 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-dd555aeb-74fd-4bb6-b026-cbf2f2779014 req-c72100b2-febe-45f5-8a36-9c6df1d3e2a1 service nova] Releasing lock "refresh_cache-67d9ceff-c1fc-48ad-85c8-3aa37ebabf11" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 15:40:05 user nova-compute[75337]: DEBUG nova.compute.manager [req-dd555aeb-74fd-4bb6-b026-cbf2f2779014 req-c72100b2-febe-45f5-8a36-9c6df1d3e2a1 service nova] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Received event network-changed-94df5f62-239e-4b8e-a91d-5223c1585f6f {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:40:05 user nova-compute[75337]: DEBUG nova.compute.manager [req-dd555aeb-74fd-4bb6-b026-cbf2f2779014 req-c72100b2-febe-45f5-8a36-9c6df1d3e2a1 service nova] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Refreshing instance network info cache due to event network-changed-94df5f62-239e-4b8e-a91d-5223c1585f6f. {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 15:40:05 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-dd555aeb-74fd-4bb6-b026-cbf2f2779014 req-c72100b2-febe-45f5-8a36-9c6df1d3e2a1 service nova] Acquiring lock "refresh_cache-67d9ceff-c1fc-48ad-85c8-3aa37ebabf11" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 15:40:05 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-dd555aeb-74fd-4bb6-b026-cbf2f2779014 req-c72100b2-febe-45f5-8a36-9c6df1d3e2a1 service nova] Acquired lock "refresh_cache-67d9ceff-c1fc-48ad-85c8-3aa37ebabf11" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 15:40:05 user nova-compute[75337]: DEBUG nova.network.neutron [req-dd555aeb-74fd-4bb6-b026-cbf2f2779014 req-c72100b2-febe-45f5-8a36-9c6df1d3e2a1 service nova] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Refreshing network info cache for port 94df5f62-239e-4b8e-a91d-5223c1585f6f {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 15:40:06 user nova-compute[75337]: DEBUG nova.network.neutron [req-dd555aeb-74fd-4bb6-b026-cbf2f2779014 req-c72100b2-febe-45f5-8a36-9c6df1d3e2a1 service nova] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Updated VIF entry in instance network info cache for port 94df5f62-239e-4b8e-a91d-5223c1585f6f. {{(pid=75337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 15:40:06 user nova-compute[75337]: DEBUG nova.network.neutron [req-dd555aeb-74fd-4bb6-b026-cbf2f2779014 req-c72100b2-febe-45f5-8a36-9c6df1d3e2a1 service nova] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Updating instance_info_cache with network_info: [{"id": "5d25f565-70a5-427c-a198-4f88dd8b7338", "address": "fa:16:3e:39:62:9f", "network": {"id": "4b3a9463-7120-499a-bdef-bd2ce9443d88", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1482718546-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "664f419c1b904bb3bdd7aff9e621e2e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d25f565-70", "ovs_interfaceid": "5d25f565-70a5-427c-a198-4f88dd8b7338", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ac99553f-c5d8-46df-8357-f1f7f189fa22", "address": "fa:16:3e:37:11:e5", "network": {"id": "793579d8-5696-4c41-b09e-19e19908b703", "bridge": "br-int", "label": "tempest-device-tagging-net1-1052173633", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.61", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "664f419c1b904bb3bdd7aff9e621e2e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac99553f-c5", "ovs_interfaceid": "ac99553f-c5d8-46df-8357-f1f7f189fa22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "abf73a6f-c3c7-46b5-8a9b-0fce5677fa27", "address": "fa:16:3e:68:66:1c", "network": {"id": "793579d8-5696-4c41-b09e-19e19908b703", "bridge": "br-int", "label": "tempest-device-tagging-net1-1052173633", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.239", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "664f419c1b904bb3bdd7aff9e621e2e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabf73a6f-c3", "ovs_interfaceid": "abf73a6f-c3c7-46b5-8a9b-0fce5677fa27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e87c0766-dd71-4aca-b5f0-32888c7437f5", "address": "fa:16:3e:b5:06:33", "network": {"id": "793579d8-5696-4c41-b09e-19e19908b703", "bridge": "br-int", "label": "tempest-device-tagging-net1-1052173633", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "664f419c1b904bb3bdd7aff9e621e2e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape87c0766-dd", "ovs_interfaceid": "e87c0766-dd71-4aca-b5f0-32888c7437f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ba50db67-9fb0-49ef-9ea2-db9014b66b17", "address": "fa:16:3e:1a:f9:b0", "network": {"id": "793579d8-5696-4c41-b09e-19e19908b703", "bridge": "br-int", "label": "tempest-device-tagging-net1-1052173633", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "664f419c1b904bb3bdd7aff9e621e2e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba50db67-9f", "ovs_interfaceid": "ba50db67-9fb0-49ef-9ea2-db9014b66b17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e6be4a87-8794-4e4f-91c1-3c417e0c8d62", "address": "fa:16:3e:df:a8:14", "network": {"id": "512e1b59-3c5a-4be6-bf3d-2ee51ce2042a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1219094622", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "664f419c1b904bb3bdd7aff9e621e2e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6be4a87-87", "ovs_interfaceid": "e6be4a87-8794-4e4f-91c1-3c417e0c8d62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "94df5f62-239e-4b8e-a91d-5223c1585f6f", "address": "fa:16:3e:03:8e:66", "network": {"id": "512e1b59-3c5a-4be6-bf3d-2ee51ce2042a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1219094622", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "664f419c1b904bb3bdd7aff9e621e2e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94df5f62-23", "ovs_interfaceid": "94df5f62-239e-4b8e-a91d-5223c1585f6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:40:06 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-dd555aeb-74fd-4bb6-b026-cbf2f2779014 req-c72100b2-febe-45f5-8a36-9c6df1d3e2a1 service nova] Releasing lock "refresh_cache-67d9ceff-c1fc-48ad-85c8-3aa37ebabf11" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 15:40:08 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:40:10 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:40:13 user nova-compute[75337]: DEBUG nova.compute.manager [req-17e9f09b-1a50-47d7-978b-f64df3c45993 req-7f10b52e-eb84-4fef-9912-83027991700d service nova] [instance: 8858d90e-ee14-494b-80da-904cd97cdff0] Received event network-changed-d4c8113e-f11f-442c-bd08-206acb4a0416 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:40:13 user nova-compute[75337]: DEBUG nova.compute.manager [req-17e9f09b-1a50-47d7-978b-f64df3c45993 req-7f10b52e-eb84-4fef-9912-83027991700d service nova] [instance: 8858d90e-ee14-494b-80da-904cd97cdff0] Refreshing instance network info cache due to event network-changed-d4c8113e-f11f-442c-bd08-206acb4a0416. {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 15:40:13 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-17e9f09b-1a50-47d7-978b-f64df3c45993 req-7f10b52e-eb84-4fef-9912-83027991700d service nova] Acquiring lock "refresh_cache-8858d90e-ee14-494b-80da-904cd97cdff0" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 15:40:13 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-17e9f09b-1a50-47d7-978b-f64df3c45993 req-7f10b52e-eb84-4fef-9912-83027991700d service nova] Acquired lock "refresh_cache-8858d90e-ee14-494b-80da-904cd97cdff0" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 15:40:13 user nova-compute[75337]: DEBUG nova.network.neutron [req-17e9f09b-1a50-47d7-978b-f64df3c45993 req-7f10b52e-eb84-4fef-9912-83027991700d service nova] [instance: 8858d90e-ee14-494b-80da-904cd97cdff0] Refreshing network info cache for port d4c8113e-f11f-442c-bd08-206acb4a0416 {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 15:40:13 user nova-compute[75337]: DEBUG nova.network.neutron [req-17e9f09b-1a50-47d7-978b-f64df3c45993 req-7f10b52e-eb84-4fef-9912-83027991700d service nova] [instance: 8858d90e-ee14-494b-80da-904cd97cdff0] Updated VIF entry in instance network info cache for port d4c8113e-f11f-442c-bd08-206acb4a0416. {{(pid=75337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 15:40:13 user nova-compute[75337]: DEBUG nova.network.neutron [req-17e9f09b-1a50-47d7-978b-f64df3c45993 req-7f10b52e-eb84-4fef-9912-83027991700d service nova] [instance: 8858d90e-ee14-494b-80da-904cd97cdff0] Updating instance_info_cache with network_info: [{"id": "d4c8113e-f11f-442c-bd08-206acb4a0416", "address": "fa:16:3e:d5:8c:cf", "network": {"id": "54c79a10-5da3-4de7-b93f-855e966b7101", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-39876549-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc4e4ce6f66541f380a8bbb0671657f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4c8113e-f1", "ovs_interfaceid": "d4c8113e-f11f-442c-bd08-206acb4a0416", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:40:13 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-17e9f09b-1a50-47d7-978b-f64df3c45993 req-7f10b52e-eb84-4fef-9912-83027991700d service nova] Releasing lock "refresh_cache-8858d90e-ee14-494b-80da-904cd97cdff0" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 15:40:15 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:40:18 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:40:19 user nova-compute[75337]: INFO nova.virt.block_device [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Booting with volume 0ad85d1f-7027-4997-96c4-991e3969067d at /dev/vdb
Nov 06 15:40:20 user nova-compute[75337]: DEBUG os_brick.utils [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 15:40:20 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:40:20 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:40:20 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[c64b11db-ed9c-4f17-bde2-cf67cfd598b4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4ff6411e45b8\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:40:20 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:40:20 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:40:20 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e78c8ec-b00b-45e2-9fb2-214250ebb05e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:40:20 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:40:20 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:40:20 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[a034e90f-9642-4633-80f0-844ffa868e5d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:40:20 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[1549b8de-1e14-445a-bede-0f0b423318e2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:40:20 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Running cmd (subprocess): nvme version {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:40:20 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] 'nvme version' failed. Not Retrying. {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 15:40:20 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] nvme not present on system {{(pid=75337) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 15:40:20 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:40:20 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 15:40:20 user nova-compute[75337]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 15:40:20 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[480d4a31-9b00-4348-b84b-98e9f3b25385]: (4, '') {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:40:20 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.lightos [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75337) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 15:40:20 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.lightos [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 15:40:20 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.lightos [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] LIGHTOS: no hostnqn found. {{(pid=75337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 15:40:20 user nova-compute[75337]: DEBUG os_brick.utils [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4ff6411e45b8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 15:40:20 user nova-compute[75337]: DEBUG nova.virt.block_device [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Updating existing volume attachment record: 91806ff4-480a-45f2-98c2-af76ede565e7 {{(pid=75337) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 15:40:20 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:40:23 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:40:23 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-2dfb6a54-dbaa-4104-8d3e-e3b1b254ca3e tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:40:23 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-2dfb6a54-dbaa-4104-8d3e-e3b1b254ca3e tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:40:23 user nova-compute[75337]: DEBUG os_brick.initiator.connector [None req-2dfb6a54-dbaa-4104-8d3e-e3b1b254ca3e tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Factory for ISCSI on None {{(pid=75337) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Nov 06 15:40:23 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-2dfb6a54-dbaa-4104-8d3e-e3b1b254ca3e tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.007s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:40:23 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2dfb6a54-dbaa-4104-8d3e-e3b1b254ca3e tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] [instance: dfadb21f-5ed1-42f4-956b-95cccf128b6a] Calling os-brick to attach iSCSI Volume {{(pid=75337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 15:40:23 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dfb6a54-dbaa-4104-8d3e-e3b1b254ca3e tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2abc33d0c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZArmKPWO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 15:40:23 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-2dfb6a54-dbaa-4104-8d3e-e3b1b254ca3e tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 15:40:23 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-2dfb6a54-dbaa-4104-8d3e-e3b1b254ca3e tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 15:40:23 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-2dfb6a54-dbaa-4104-8d3e-e3b1b254ca3e tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 15:40:23 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-2dfb6a54-dbaa-4104-8d3e-e3b1b254ca3e tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 15:40:23 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-2dfb6a54-dbaa-4104-8d3e-e3b1b254ca3e tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 15:40:23 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-2dfb6a54-dbaa-4104-8d3e-e3b1b254ca3e tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 15:40:23 user nova-compute[75337]: INFO os_brick.initiator.connectors.iscsi [None req-2dfb6a54-dbaa-4104-8d3e-e3b1b254ca3e tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 15:40:23 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759 -p 172.16.0.220:3260 {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:40:23 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:40:23 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[d744fa26-02f9-4065-8e7b-2fac9d448899]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:40:23 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dfb6a54-dbaa-4104-8d3e-e3b1b254ca3e tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 15:40:23 user nova-compute[75337]:  {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:40:23 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759 -p 172.16.0.220:3260 --interface default --op new {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:40:23 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:40:23 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b90aec3-d6ea-44d0-afe3-41548494dae5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759] added\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:40:23 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dfb6a54-dbaa-4104-8d3e-e3b1b254ca3e tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759] added
Nov 06 15:40:23 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:40:23 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:40:23 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:40:23 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f4769df-f542-441c-aedf-628900932785]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:40:23 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dfb6a54-dbaa-4104-8d3e-e3b1b254ca3e tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:40:23 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:40:23 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:40:23 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b34bdc0-d738-4374-872b-ee8ed7dcfcf1]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:40:23 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dfb6a54-dbaa-4104-8d3e-e3b1b254ca3e tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:40:23 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZArmKPWO {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:40:23 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZArmKPWO" returned: 0 in 0.018s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:40:23 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[03d97661-c5c0-450f-9d08-23aada16aa2c]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:40:23 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dfb6a54-dbaa-4104-8d3e-e3b1b254ca3e tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZArmKPWO'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:40:23 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:40:23 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:40:23 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[97b99aa8-d59e-428f-8226-95ae160808c1]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:40:23 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dfb6a54-dbaa-4104-8d3e-e3b1b254ca3e tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:40:23 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:40:23 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:40:23 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[837c6bf1-6207-4ce7-b391-733e0f2960e0]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:40:23 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dfb6a54-dbaa-4104-8d3e-e3b1b254ca3e tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 06 15:40:23 user nova-compute[75337]:  {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 15:40:23 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dfb6a54-dbaa-4104-8d3e-e3b1b254ca3e tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 06 15:40:23 user nova-compute[75337]:  {{(pid=75337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 15:40:23 user nova-compute[75337]: WARNING os_brick.initiator.connectors.iscsi [None req-2dfb6a54-dbaa-4104-8d3e-e3b1b254ca3e tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 06 15:40:23 user nova-compute[75337]: 
Nov 06 15:40:23 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759 -p 172.16.0.220:3260 --login {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:40:23 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:40:23 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[a341c11a-4b3d-4567-9d53-1e5556063b72]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:40:23 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dfb6a54-dbaa-4104-8d3e-e3b1b254ca3e tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759, portal: 172.16.0.220,3260]
Nov 06 15:40:23 user nova-compute[75337]: Login to [iface: default, target: iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759, portal: 172.16.0.220,3260] successful.
Nov 06 15:40:23 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:40:23 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:40:23 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:40:23 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[04cce0ae-0e57-4b44-be58-e1bc94b56692]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:40:23 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dfb6a54-dbaa-4104-8d3e-e3b1b254ca3e tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:40:23 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:40:23 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:40:23 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bb393ac-94d4-483a-b38d-0d2c6de3d3f3]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759 (non-flash)\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:40:23 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dfb6a54-dbaa-4104-8d3e-e3b1b254ca3e tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759 (non-flash)
Nov 06 15:40:23 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 15:40:23 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dfb6a54-dbaa-4104-8d3e-e3b1b254ca3e tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759 (non-flash)
Nov 06 15:40:23 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 15:40:23 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-2dfb6a54-dbaa-4104-8d3e-e3b1b254ca3e tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.266s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 15:40:23 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dfb6a54-dbaa-4104-8d3e-e3b1b254ca3e tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Connected to 172.16.0.220:3260 {{(pid=75337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 15:40:23 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-2dfb6a54-dbaa-4104-8d3e-e3b1b254ca3e tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=75337) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 15:40:23 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-2dfb6a54-dbaa-4104-8d3e-e3b1b254ca3e tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75337) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 15:40:23 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:40:23 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:40:23 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[b54e9b87-3e1d-4908-83b0-1c0954e40d3a]: (4, ('- - 0', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:40:23 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-2dfb6a54-dbaa-4104-8d3e-e3b1b254ca3e tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: None {{(pid=75337) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 15:40:24 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-2dfb6a54-dbaa-4104-8d3e-e3b1b254ca3e tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75337) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 15:40:24 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dfb6a54-dbaa-4104-8d3e-e3b1b254ca3e tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZArmKPWO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 15:40:24 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-2dfb6a54-dbaa-4104-8d3e-e3b1b254ca3e tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.305s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 15:40:24 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dfb6a54-dbaa-4104-8d3e-e3b1b254ca3e tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] <== connect_volume: return (1308ms) {'type': 'block', 'scsi_wwn': '23335373061336531', 'path': '/dev/sdb'} {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 15:40:24 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2dfb6a54-dbaa-4104-8d3e-e3b1b254ca3e tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] [instance: dfadb21f-5ed1-42f4-956b-95cccf128b6a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23335373061336531', 'path': '/dev/sdb'} {{(pid=75337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 15:40:24 user nova-compute[75337]: DEBUG nova.objects.instance [None req-2dfb6a54-dbaa-4104-8d3e-e3b1b254ca3e tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Lazy-loading 'flavor' on Instance uuid dfadb21f-5ed1-42f4-956b-95cccf128b6a {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 15:40:24 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-da2abdc2-9666-4d25-9521-afe912507438 tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] Acquiring lock "8858d90e-ee14-494b-80da-904cd97cdff0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:40:24 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-da2abdc2-9666-4d25-9521-afe912507438 tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] Lock "8858d90e-ee14-494b-80da-904cd97cdff0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:40:24 user nova-compute[75337]: DEBUG nova.objects.instance [None req-da2abdc2-9666-4d25-9521-afe912507438 tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] Lazy-loading 'flavor' on Instance uuid 8858d90e-ee14-494b-80da-904cd97cdff0 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 15:40:24 user nova-compute[75337]: DEBUG nova.virt.libvirt.guest [None req-2dfb6a54-dbaa-4104-8d3e-e3b1b254ca3e tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] attach device xml: <disk type="block" device="disk">
Nov 06 15:40:24 user nova-compute[75337]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 15:40:24 user nova-compute[75337]:   <source dev="/dev/sdb"/>
Nov 06 15:40:24 user nova-compute[75337]:   <target dev="vdb" bus="virtio"/>
Nov 06 15:40:24 user nova-compute[75337]:   <serial>466b6a4a-f809-4194-abc2-cb0148279759</serial>
Nov 06 15:40:24 user nova-compute[75337]: </disk>
Nov 06 15:40:24 user nova-compute[75337]:  {{(pid=75337) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 06 15:40:24 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-da2abdc2-9666-4d25-9521-afe912507438 tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] Lock "8858d90e-ee14-494b-80da-904cd97cdff0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:40:25 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:40:25 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-da2abdc2-9666-4d25-9521-afe912507438 tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] Acquiring lock "8858d90e-ee14-494b-80da-904cd97cdff0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:40:25 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-da2abdc2-9666-4d25-9521-afe912507438 tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] Lock "8858d90e-ee14-494b-80da-904cd97cdff0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:40:25 user nova-compute[75337]: INFO nova.compute.manager [None req-da2abdc2-9666-4d25-9521-afe912507438 tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] [instance: 8858d90e-ee14-494b-80da-904cd97cdff0] Attaching volume fd579072-cd8e-4ac1-8f84-1afda08a11da to /dev/sdc
Nov 06 15:40:25 user nova-compute[75337]: DEBUG os_brick.utils [None req-da2abdc2-9666-4d25-9521-afe912507438 tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 15:40:25 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:40:25 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:40:25 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[da4c683f-2048-4404-8ac5-ed74d1442e67]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4ff6411e45b8\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:40:25 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:40:25 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:40:25 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[945c4984-20da-4cda-a747-b84a5314f9ea]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:40:25 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:40:25 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:40:25 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e0480c8-e731-4100-ab75-c6eb86cc205a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:40:25 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca4a190d-c2b7-4f2f-99f7-a89c9fffc9ac]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:40:25 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-da2abdc2-9666-4d25-9521-afe912507438 tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] Running cmd (subprocess): nvme version {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:40:25 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-da2abdc2-9666-4d25-9521-afe912507438 tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] 'nvme version' failed. Not Retrying. {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 15:40:25 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.nvmeof [None req-da2abdc2-9666-4d25-9521-afe912507438 tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] nvme not present on system {{(pid=75337) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 15:40:25 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:40:25 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 15:40:25 user nova-compute[75337]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 15:40:25 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bd853fb-2a95-4176-88a9-1caeb2a5c937]: (4, '') {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:40:25 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.lightos [None req-da2abdc2-9666-4d25-9521-afe912507438 tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75337) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 15:40:25 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.lightos [None req-da2abdc2-9666-4d25-9521-afe912507438 tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 15:40:25 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.lightos [None req-da2abdc2-9666-4d25-9521-afe912507438 tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] LIGHTOS: no hostnqn found. {{(pid=75337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 15:40:25 user nova-compute[75337]: DEBUG os_brick.utils [None req-da2abdc2-9666-4d25-9521-afe912507438 tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4ff6411e45b8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 15:40:25 user nova-compute[75337]: DEBUG nova.virt.block_device [None req-da2abdc2-9666-4d25-9521-afe912507438 tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] [instance: 8858d90e-ee14-494b-80da-904cd97cdff0] Updating existing volume attachment record: d120e92a-fa69-4df9-80e5-0ae3461ee45b {{(pid=75337) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 15:40:25 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-2dfb6a54-dbaa-4104-8d3e-e3b1b254ca3e tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] No BDM found with device name vda, not building metadata. {{(pid=75337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 15:40:25 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-2dfb6a54-dbaa-4104-8d3e-e3b1b254ca3e tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 15:40:25 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-2dfb6a54-dbaa-4104-8d3e-e3b1b254ca3e tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] No VIF found with MAC fa:16:3e:f8:26:1d, not building metadata {{(pid=75337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 15:40:26 user nova-compute[75337]: DEBUG nova.compute.manager [req-bf0dac77-b291-47d7-8cc7-0a7ce42ab90e req-0e9df464-26fe-4e52-acde-070730823fd2 service nova] [instance: cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1] Received event network-changed-5b01e7c7-929d-4e31-b8d4-e4ba3bba4ea2 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:40:26 user nova-compute[75337]: DEBUG nova.compute.manager [req-bf0dac77-b291-47d7-8cc7-0a7ce42ab90e req-0e9df464-26fe-4e52-acde-070730823fd2 service nova] [instance: cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1] Refreshing instance network info cache due to event network-changed-5b01e7c7-929d-4e31-b8d4-e4ba3bba4ea2. {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 15:40:26 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-bf0dac77-b291-47d7-8cc7-0a7ce42ab90e req-0e9df464-26fe-4e52-acde-070730823fd2 service nova] Acquiring lock "refresh_cache-cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 15:40:26 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-bf0dac77-b291-47d7-8cc7-0a7ce42ab90e req-0e9df464-26fe-4e52-acde-070730823fd2 service nova] Acquired lock "refresh_cache-cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 15:40:26 user nova-compute[75337]: DEBUG nova.network.neutron [req-bf0dac77-b291-47d7-8cc7-0a7ce42ab90e req-0e9df464-26fe-4e52-acde-070730823fd2 service nova] [instance: cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1] Refreshing network info cache for port 5b01e7c7-929d-4e31-b8d4-e4ba3bba4ea2 {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 15:40:27 user nova-compute[75337]: DEBUG nova.network.neutron [req-bf0dac77-b291-47d7-8cc7-0a7ce42ab90e req-0e9df464-26fe-4e52-acde-070730823fd2 service nova] [instance: cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1] Updated VIF entry in instance network info cache for port 5b01e7c7-929d-4e31-b8d4-e4ba3bba4ea2. {{(pid=75337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 15:40:27 user nova-compute[75337]: DEBUG nova.network.neutron [req-bf0dac77-b291-47d7-8cc7-0a7ce42ab90e req-0e9df464-26fe-4e52-acde-070730823fd2 service nova] [instance: cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1] Updating instance_info_cache with network_info: [{"id": "5b01e7c7-929d-4e31-b8d4-e4ba3bba4ea2", "address": "fa:16:3e:67:5c:a5", "network": {"id": "dd669c8a-2e05-46a7-a5e7-4dc06eec4b48", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2014981732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "680aa228c77c472abce167f646caeffd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b01e7c7-92", "ovs_interfaceid": "5b01e7c7-929d-4e31-b8d4-e4ba3bba4ea2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:40:27 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-bf0dac77-b291-47d7-8cc7-0a7ce42ab90e req-0e9df464-26fe-4e52-acde-070730823fd2 service nova] Releasing lock "refresh_cache-cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 15:40:28 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:40:30 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:40:33 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:40:35 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:40:37 user nova-compute[75337]: DEBUG nova.compute.manager [req-9369d763-e48c-4293-8790-7ff1008a169b req-b475b038-39a4-409a-81d2-76237dda851a service nova] [instance: 76ee582b-b887-4d46-8c78-29f42d1a0d26] Received event network-changed-8d52e5d0-96a2-44ca-9968-9ac564aeff2c {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:40:37 user nova-compute[75337]: DEBUG nova.compute.manager [req-9369d763-e48c-4293-8790-7ff1008a169b req-b475b038-39a4-409a-81d2-76237dda851a service nova] [instance: 76ee582b-b887-4d46-8c78-29f42d1a0d26] Refreshing instance network info cache due to event network-changed-8d52e5d0-96a2-44ca-9968-9ac564aeff2c. {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 15:40:37 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-9369d763-e48c-4293-8790-7ff1008a169b req-b475b038-39a4-409a-81d2-76237dda851a service nova] Acquiring lock "refresh_cache-76ee582b-b887-4d46-8c78-29f42d1a0d26" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 15:40:37 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-9369d763-e48c-4293-8790-7ff1008a169b req-b475b038-39a4-409a-81d2-76237dda851a service nova] Acquired lock "refresh_cache-76ee582b-b887-4d46-8c78-29f42d1a0d26" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 15:40:37 user nova-compute[75337]: DEBUG nova.network.neutron [req-9369d763-e48c-4293-8790-7ff1008a169b req-b475b038-39a4-409a-81d2-76237dda851a service nova] [instance: 76ee582b-b887-4d46-8c78-29f42d1a0d26] Refreshing network info cache for port 8d52e5d0-96a2-44ca-9968-9ac564aeff2c {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 15:40:37 user nova-compute[75337]: DEBUG nova.network.neutron [req-9369d763-e48c-4293-8790-7ff1008a169b req-b475b038-39a4-409a-81d2-76237dda851a service nova] [instance: 76ee582b-b887-4d46-8c78-29f42d1a0d26] Updated VIF entry in instance network info cache for port 8d52e5d0-96a2-44ca-9968-9ac564aeff2c. {{(pid=75337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 15:40:37 user nova-compute[75337]: DEBUG nova.network.neutron [req-9369d763-e48c-4293-8790-7ff1008a169b req-b475b038-39a4-409a-81d2-76237dda851a service nova] [instance: 76ee582b-b887-4d46-8c78-29f42d1a0d26] Updating instance_info_cache with network_info: [{"id": "8d52e5d0-96a2-44ca-9968-9ac564aeff2c", "address": "fa:16:3e:0b:83:6f", "network": {"id": "cd11ddce-8aa1-4ad8-8184-317c63f52be7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-265471432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4180b3fb8de74de1ad134fe356b85d6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d52e5d0-96", "ovs_interfaceid": "8d52e5d0-96a2-44ca-9968-9ac564aeff2c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:40:37 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-9369d763-e48c-4293-8790-7ff1008a169b req-b475b038-39a4-409a-81d2-76237dda851a service nova] Releasing lock "refresh_cache-76ee582b-b887-4d46-8c78-29f42d1a0d26" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 15:40:37 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-9f517892-d898-4472-8a4a-3d7582f8fc10 tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] Acquiring lock "interface-76ee582b-b887-4d46-8c78-29f42d1a0d26-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:40:37 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-9f517892-d898-4472-8a4a-3d7582f8fc10 tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] Lock "interface-76ee582b-b887-4d46-8c78-29f42d1a0d26-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:40:37 user nova-compute[75337]: DEBUG nova.objects.instance [None req-9f517892-d898-4472-8a4a-3d7582f8fc10 tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] Lazy-loading 'flavor' on Instance uuid 76ee582b-b887-4d46-8c78-29f42d1a0d26 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 15:40:37 user nova-compute[75337]: DEBUG nova.objects.instance [None req-9f517892-d898-4472-8a4a-3d7582f8fc10 tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] Lazy-loading 'pci_requests' on Instance uuid 76ee582b-b887-4d46-8c78-29f42d1a0d26 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 15:40:37 user nova-compute[75337]: DEBUG nova.objects.base [None req-9f517892-d898-4472-8a4a-3d7582f8fc10 tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] Object Instance<76ee582b-b887-4d46-8c78-29f42d1a0d26> lazy-loaded attributes: flavor,pci_requests {{(pid=75337) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 15:40:37 user nova-compute[75337]: DEBUG nova.network.neutron [None req-9f517892-d898-4472-8a4a-3d7582f8fc10 tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] [instance: 76ee582b-b887-4d46-8c78-29f42d1a0d26] allocate_for_instance() {{(pid=75337) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 15:40:38 user nova-compute[75337]: DEBUG nova.policy [None req-9f517892-d898-4472-8a4a-3d7582f8fc10 tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '587c402e2f0d45ad909ae974a03cd20e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4180b3fb8de74de1ad134fe356b85d6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75337) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 15:40:38 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:40:38 user nova-compute[75337]: DEBUG nova.network.neutron [None req-9f517892-d898-4472-8a4a-3d7582f8fc10 tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] [instance: 76ee582b-b887-4d46-8c78-29f42d1a0d26] Successfully created port: f5a850f4-996a-42df-9243-54ea71cc8eec {{(pid=75337) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 15:40:39 user nova-compute[75337]: DEBUG nova.network.neutron [None req-9f517892-d898-4472-8a4a-3d7582f8fc10 tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] [instance: 76ee582b-b887-4d46-8c78-29f42d1a0d26] Successfully updated port: f5a850f4-996a-42df-9243-54ea71cc8eec {{(pid=75337) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 15:40:39 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-9f517892-d898-4472-8a4a-3d7582f8fc10 tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] Acquiring lock "refresh_cache-76ee582b-b887-4d46-8c78-29f42d1a0d26" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 15:40:39 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-9f517892-d898-4472-8a4a-3d7582f8fc10 tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] Acquired lock "refresh_cache-76ee582b-b887-4d46-8c78-29f42d1a0d26" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 15:40:39 user nova-compute[75337]: DEBUG nova.network.neutron [None req-9f517892-d898-4472-8a4a-3d7582f8fc10 tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] [instance: 76ee582b-b887-4d46-8c78-29f42d1a0d26] Building network info cache for instance {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 15:40:39 user nova-compute[75337]: DEBUG nova.compute.manager [req-b4d94353-42e8-4a96-b585-1cfe3c582efa req-1e1fc0ef-847e-419c-a4c5-171eb1ce5464 service nova] [instance: 76ee582b-b887-4d46-8c78-29f42d1a0d26] Received event network-changed-f5a850f4-996a-42df-9243-54ea71cc8eec {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:40:39 user nova-compute[75337]: DEBUG nova.compute.manager [req-b4d94353-42e8-4a96-b585-1cfe3c582efa req-1e1fc0ef-847e-419c-a4c5-171eb1ce5464 service nova] [instance: 76ee582b-b887-4d46-8c78-29f42d1a0d26] Refreshing instance network info cache due to event network-changed-f5a850f4-996a-42df-9243-54ea71cc8eec. {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 15:40:39 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-b4d94353-42e8-4a96-b585-1cfe3c582efa req-1e1fc0ef-847e-419c-a4c5-171eb1ce5464 service nova] Acquiring lock "refresh_cache-76ee582b-b887-4d46-8c78-29f42d1a0d26" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 15:40:39 user nova-compute[75337]: DEBUG nova.network.neutron [None req-9f517892-d898-4472-8a4a-3d7582f8fc10 tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] [instance: 76ee582b-b887-4d46-8c78-29f42d1a0d26] Updating instance_info_cache with network_info: [{"id": "8d52e5d0-96a2-44ca-9968-9ac564aeff2c", "address": "fa:16:3e:0b:83:6f", "network": {"id": "cd11ddce-8aa1-4ad8-8184-317c63f52be7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-265471432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4180b3fb8de74de1ad134fe356b85d6f", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d52e5d0-96", "ovs_interfaceid": "8d52e5d0-96a2-44ca-9968-9ac564aeff2c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f5a850f4-996a-42df-9243-54ea71cc8eec", "address": "fa:16:3e:4d:c3:29", "network": {"id": "081214fe-5e93-4171-bf5b-63393a14c539", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1591381833", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "4180b3fb8de74de1ad134fe356b85d6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5a850f4-99", "ovs_interfaceid": "f5a850f4-996a-42df-9243-54ea71cc8eec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:40:39 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-9f517892-d898-4472-8a4a-3d7582f8fc10 tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] Releasing lock "refresh_cache-76ee582b-b887-4d46-8c78-29f42d1a0d26" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 15:40:39 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-b4d94353-42e8-4a96-b585-1cfe3c582efa req-1e1fc0ef-847e-419c-a4c5-171eb1ce5464 service nova] Acquired lock "refresh_cache-76ee582b-b887-4d46-8c78-29f42d1a0d26" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 15:40:39 user nova-compute[75337]: DEBUG nova.network.neutron [req-b4d94353-42e8-4a96-b585-1cfe3c582efa req-1e1fc0ef-847e-419c-a4c5-171eb1ce5464 service nova] [instance: 76ee582b-b887-4d46-8c78-29f42d1a0d26] Refreshing network info cache for port f5a850f4-996a-42df-9243-54ea71cc8eec {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 15:40:39 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-9f517892-d898-4472-8a4a-3d7582f8fc10 tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T15:38:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1853414850',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1853414850',id=9,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFGP9zZx8/smrQZVJ9SjwMu8yi65szEQrklWGxwv+DWpP4x/gZJfYN1nhwlTtV8a2EPxv+zU/MdCKD4XLCPbyGN12jTTqoGcbI7kaYL/I7RmSLD+0nDNzAksw3YYfsN9cA==',key_name='tempest-keypair-135606244',keypairs=<?>,launch_index=0,launched_at=2023-11-06T15:38:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4180b3fb8de74de1ad134fe356b85d6f',ramdisk_id='',reservation_id='r-gdmig8v7',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-387682144',owner_user_name='tempest-TaggedAttachmentsTest-387682144-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T15:38:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='587c402e2f0d45ad909ae974a03cd20e',uuid=76ee582b-b887-4d46-8c78-29f42d1a0d26,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f5a850f4-996a-42df-9243-54ea71cc8eec", "address": "fa:16:3e:4d:c3:29", "network": {"id": "081214fe-5e93-4171-bf5b-63393a14c539", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1591381833", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "4180b3fb8de74de1ad134fe356b85d6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5a850f4-99", "ovs_interfaceid": "f5a850f4-996a-42df-9243-54ea71cc8eec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 15:40:39 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-9f517892-d898-4472-8a4a-3d7582f8fc10 tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] Converting VIF {"id": "f5a850f4-996a-42df-9243-54ea71cc8eec", "address": "fa:16:3e:4d:c3:29", "network": {"id": "081214fe-5e93-4171-bf5b-63393a14c539", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1591381833", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "4180b3fb8de74de1ad134fe356b85d6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5a850f4-99", "ovs_interfaceid": "f5a850f4-996a-42df-9243-54ea71cc8eec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 15:40:39 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-9f517892-d898-4472-8a4a-3d7582f8fc10 tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:c3:29,bridge_name='br-int',has_traffic_filtering=True,id=f5a850f4-996a-42df-9243-54ea71cc8eec,network=Network(081214fe-5e93-4171-bf5b-63393a14c539),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5a850f4-99') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 15:40:39 user nova-compute[75337]: DEBUG os_vif [None req-9f517892-d898-4472-8a4a-3d7582f8fc10 tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:c3:29,bridge_name='br-int',has_traffic_filtering=True,id=f5a850f4-996a-42df-9243-54ea71cc8eec,network=Network(081214fe-5e93-4171-bf5b-63393a14c539),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5a850f4-99') {{(pid=75337) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 15:40:39 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:40:39 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:40:39 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 15:40:39 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:40:39 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1aec64eb-1c41-5fd6-ae37-fc99c58ae276', '_type': 'linux-noop'}}, row=False) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:40:39 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:40:39 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:40:39 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:40:39 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf5a850f4-99, may_exist=True, interface_attrs={}) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:40:39 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf5a850f4-99, col_values=(('qos', UUID('9a76f48e-c7ba-4c08-bde2-f8c50b891c72')),), if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:40:39 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf5a850f4-99, col_values=(('external_ids', {'iface-id': 'f5a850f4-996a-42df-9243-54ea71cc8eec', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4d:c3:29', 'vm-uuid': '76ee582b-b887-4d46-8c78-29f42d1a0d26'}),), if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:40:39 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:40:39 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:40:39 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:40:39 user nova-compute[75337]: INFO os_vif [None req-9f517892-d898-4472-8a4a-3d7582f8fc10 tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:c3:29,bridge_name='br-int',has_traffic_filtering=True,id=f5a850f4-996a-42df-9243-54ea71cc8eec,network=Network(081214fe-5e93-4171-bf5b-63393a14c539),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5a850f4-99')
Nov 06 15:40:39 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-9f517892-d898-4472-8a4a-3d7582f8fc10 tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T15:38:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1853414850',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1853414850',id=9,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFGP9zZx8/smrQZVJ9SjwMu8yi65szEQrklWGxwv+DWpP4x/gZJfYN1nhwlTtV8a2EPxv+zU/MdCKD4XLCPbyGN12jTTqoGcbI7kaYL/I7RmSLD+0nDNzAksw3YYfsN9cA==',key_name='tempest-keypair-135606244',keypairs=<?>,launch_index=0,launched_at=2023-11-06T15:38:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4180b3fb8de74de1ad134fe356b85d6f',ramdisk_id='',reservation_id='r-gdmig8v7',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-387682144',owner_user_name='tempest-TaggedAttachmentsTest-387682144-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T15:38:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='587c402e2f0d45ad909ae974a03cd20e',uuid=76ee582b-b887-4d46-8c78-29f42d1a0d26,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f5a850f4-996a-42df-9243-54ea71cc8eec", "address": "fa:16:3e:4d:c3:29", "network": {"id": "081214fe-5e93-4171-bf5b-63393a14c539", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1591381833", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "4180b3fb8de74de1ad134fe356b85d6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5a850f4-99", "ovs_interfaceid": "f5a850f4-996a-42df-9243-54ea71cc8eec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75337) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 15:40:39 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-9f517892-d898-4472-8a4a-3d7582f8fc10 tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] Converting VIF {"id": "f5a850f4-996a-42df-9243-54ea71cc8eec", "address": "fa:16:3e:4d:c3:29", "network": {"id": "081214fe-5e93-4171-bf5b-63393a14c539", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1591381833", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "4180b3fb8de74de1ad134fe356b85d6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5a850f4-99", "ovs_interfaceid": "f5a850f4-996a-42df-9243-54ea71cc8eec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 15:40:39 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-9f517892-d898-4472-8a4a-3d7582f8fc10 tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:c3:29,bridge_name='br-int',has_traffic_filtering=True,id=f5a850f4-996a-42df-9243-54ea71cc8eec,network=Network(081214fe-5e93-4171-bf5b-63393a14c539),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5a850f4-99') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 15:40:39 user nova-compute[75337]: DEBUG nova.virt.libvirt.guest [None req-9f517892-d898-4472-8a4a-3d7582f8fc10 tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] attach device xml: <interface type="ethernet">
Nov 06 15:40:39 user nova-compute[75337]:   <mac address="fa:16:3e:4d:c3:29"/>
Nov 06 15:40:39 user nova-compute[75337]:   <model type="virtio"/>
Nov 06 15:40:39 user nova-compute[75337]:   <mtu size="1442"/>
Nov 06 15:40:39 user nova-compute[75337]:   <target dev="tapf5a850f4-99"/>
Nov 06 15:40:39 user nova-compute[75337]: </interface>
Nov 06 15:40:39 user nova-compute[75337]:  {{(pid=75337) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 06 15:40:39 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:40:39 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:40:39 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:40:40 user nova-compute[75337]: DEBUG nova.compute.manager [req-b5903269-f103-4493-aece-af90b5cfd4ae req-a2d6a0e0-8543-4593-9972-03f003d0d112 service nova] [instance: 76ee582b-b887-4d46-8c78-29f42d1a0d26] Received event network-vif-plugged-f5a850f4-996a-42df-9243-54ea71cc8eec {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:40:40 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-b5903269-f103-4493-aece-af90b5cfd4ae req-a2d6a0e0-8543-4593-9972-03f003d0d112 service nova] Acquiring lock "76ee582b-b887-4d46-8c78-29f42d1a0d26-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:40:40 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-b5903269-f103-4493-aece-af90b5cfd4ae req-a2d6a0e0-8543-4593-9972-03f003d0d112 service nova] Lock "76ee582b-b887-4d46-8c78-29f42d1a0d26-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:40:40 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-b5903269-f103-4493-aece-af90b5cfd4ae req-a2d6a0e0-8543-4593-9972-03f003d0d112 service nova] Lock "76ee582b-b887-4d46-8c78-29f42d1a0d26-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:40:40 user nova-compute[75337]: DEBUG nova.compute.manager [req-b5903269-f103-4493-aece-af90b5cfd4ae req-a2d6a0e0-8543-4593-9972-03f003d0d112 service nova] [instance: 76ee582b-b887-4d46-8c78-29f42d1a0d26] No waiting events found dispatching network-vif-plugged-f5a850f4-996a-42df-9243-54ea71cc8eec {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:40:40 user nova-compute[75337]: WARNING nova.compute.manager [req-b5903269-f103-4493-aece-af90b5cfd4ae req-a2d6a0e0-8543-4593-9972-03f003d0d112 service nova] [instance: 76ee582b-b887-4d46-8c78-29f42d1a0d26] Received unexpected event network-vif-plugged-f5a850f4-996a-42df-9243-54ea71cc8eec for instance with vm_state active and task_state None.
Nov 06 15:40:40 user nova-compute[75337]: DEBUG nova.network.neutron [req-b4d94353-42e8-4a96-b585-1cfe3c582efa req-1e1fc0ef-847e-419c-a4c5-171eb1ce5464 service nova] [instance: 76ee582b-b887-4d46-8c78-29f42d1a0d26] Updated VIF entry in instance network info cache for port f5a850f4-996a-42df-9243-54ea71cc8eec. {{(pid=75337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 15:40:40 user nova-compute[75337]: DEBUG nova.network.neutron [req-b4d94353-42e8-4a96-b585-1cfe3c582efa req-1e1fc0ef-847e-419c-a4c5-171eb1ce5464 service nova] [instance: 76ee582b-b887-4d46-8c78-29f42d1a0d26] Updating instance_info_cache with network_info: [{"id": "8d52e5d0-96a2-44ca-9968-9ac564aeff2c", "address": "fa:16:3e:0b:83:6f", "network": {"id": "cd11ddce-8aa1-4ad8-8184-317c63f52be7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-265471432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4180b3fb8de74de1ad134fe356b85d6f", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d52e5d0-96", "ovs_interfaceid": "8d52e5d0-96a2-44ca-9968-9ac564aeff2c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f5a850f4-996a-42df-9243-54ea71cc8eec", "address": "fa:16:3e:4d:c3:29", "network": {"id": "081214fe-5e93-4171-bf5b-63393a14c539", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1591381833", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "4180b3fb8de74de1ad134fe356b85d6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5a850f4-99", "ovs_interfaceid": "f5a850f4-996a-42df-9243-54ea71cc8eec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:40:40 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-b4d94353-42e8-4a96-b585-1cfe3c582efa req-1e1fc0ef-847e-419c-a4c5-171eb1ce5464 service nova] Releasing lock "refresh_cache-76ee582b-b887-4d46-8c78-29f42d1a0d26" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 15:40:40 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-9f517892-d898-4472-8a4a-3d7582f8fc10 tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] No BDM found with device name vda, not building metadata. {{(pid=75337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 15:40:40 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-9f517892-d898-4472-8a4a-3d7582f8fc10 tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] No BDM found with device name hda, not building metadata. {{(pid=75337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 15:40:40 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-9f517892-d898-4472-8a4a-3d7582f8fc10 tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] No VIF found with MAC fa:16:3e:0b:83:6f, not building metadata {{(pid=75337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 15:40:40 user nova-compute[75337]: DEBUG nova.virt.libvirt.guest [None req-9f517892-d898-4472-8a4a-3d7582f8fc10 tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 15:40:40 user nova-compute[75337]:   <nova:package version="0.0.0"/>
Nov 06 15:40:40 user nova-compute[75337]:   <nova:name>tempest-device-tagging-server-1853414850</nova:name>
Nov 06 15:40:40 user nova-compute[75337]:   <nova:creationTime>2023-11-06 15:40:40</nova:creationTime>
Nov 06 15:40:40 user nova-compute[75337]:   <nova:flavor name="m1.tiny">
Nov 06 15:40:40 user nova-compute[75337]:     <nova:memory>512</nova:memory>
Nov 06 15:40:40 user nova-compute[75337]:     <nova:disk>1</nova:disk>
Nov 06 15:40:40 user nova-compute[75337]:     <nova:swap>0</nova:swap>
Nov 06 15:40:40 user nova-compute[75337]:     <nova:ephemeral>0</nova:ephemeral>
Nov 06 15:40:40 user nova-compute[75337]:     <nova:vcpus>1</nova:vcpus>
Nov 06 15:40:40 user nova-compute[75337]:   </nova:flavor>
Nov 06 15:40:40 user nova-compute[75337]:   <nova:owner>
Nov 06 15:40:40 user nova-compute[75337]:     <nova:user uuid="587c402e2f0d45ad909ae974a03cd20e">tempest-TaggedAttachmentsTest-387682144-project-member</nova:user>
Nov 06 15:40:40 user nova-compute[75337]:     <nova:project uuid="4180b3fb8de74de1ad134fe356b85d6f">tempest-TaggedAttachmentsTest-387682144</nova:project>
Nov 06 15:40:40 user nova-compute[75337]:   </nova:owner>
Nov 06 15:40:40 user nova-compute[75337]:   <nova:root type="image" uuid="16b903ae-a40f-41a7-985b-4804cce92c62"/>
Nov 06 15:40:40 user nova-compute[75337]:   <nova:ports>
Nov 06 15:40:40 user nova-compute[75337]:     <nova:port uuid="8d52e5d0-96a2-44ca-9968-9ac564aeff2c">
Nov 06 15:40:40 user nova-compute[75337]:       <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 06 15:40:40 user nova-compute[75337]:     </nova:port>
Nov 06 15:40:40 user nova-compute[75337]:     <nova:port uuid="f5a850f4-996a-42df-9243-54ea71cc8eec">
Nov 06 15:40:40 user nova-compute[75337]:       <nova:ip type="fixed" address="10.10.10.10" ipVersion="4"/>
Nov 06 15:40:40 user nova-compute[75337]:     </nova:port>
Nov 06 15:40:40 user nova-compute[75337]:   </nova:ports>
Nov 06 15:40:40 user nova-compute[75337]: </nova:instance>
Nov 06 15:40:40 user nova-compute[75337]:  {{(pid=75337) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 06 15:40:40 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:40:40 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:40:40 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:40:40 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:40:40 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-9f517892-d898-4472-8a4a-3d7582f8fc10 tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] Lock "interface-76ee582b-b887-4d46-8c78-29f42d1a0d26-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 2.628s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:40:40 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:40:42 user nova-compute[75337]: DEBUG nova.compute.manager [req-81171ddb-7690-4af0-8b05-c01d0a6062a7 req-89361fda-694f-4458-9929-d4553c5eb4a8 service nova] [instance: 76ee582b-b887-4d46-8c78-29f42d1a0d26] Received event network-vif-plugged-f5a850f4-996a-42df-9243-54ea71cc8eec {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:40:42 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-81171ddb-7690-4af0-8b05-c01d0a6062a7 req-89361fda-694f-4458-9929-d4553c5eb4a8 service nova] Acquiring lock "76ee582b-b887-4d46-8c78-29f42d1a0d26-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:40:42 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-81171ddb-7690-4af0-8b05-c01d0a6062a7 req-89361fda-694f-4458-9929-d4553c5eb4a8 service nova] Lock "76ee582b-b887-4d46-8c78-29f42d1a0d26-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:40:42 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-81171ddb-7690-4af0-8b05-c01d0a6062a7 req-89361fda-694f-4458-9929-d4553c5eb4a8 service nova] Lock "76ee582b-b887-4d46-8c78-29f42d1a0d26-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:40:42 user nova-compute[75337]: DEBUG nova.compute.manager [req-81171ddb-7690-4af0-8b05-c01d0a6062a7 req-89361fda-694f-4458-9929-d4553c5eb4a8 service nova] [instance: 76ee582b-b887-4d46-8c78-29f42d1a0d26] No waiting events found dispatching network-vif-plugged-f5a850f4-996a-42df-9243-54ea71cc8eec {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:40:42 user nova-compute[75337]: WARNING nova.compute.manager [req-81171ddb-7690-4af0-8b05-c01d0a6062a7 req-89361fda-694f-4458-9929-d4553c5eb4a8 service nova] [instance: 76ee582b-b887-4d46-8c78-29f42d1a0d26] Received unexpected event network-vif-plugged-f5a850f4-996a-42df-9243-54ea71cc8eec for instance with vm_state active and task_state None.
Nov 06 15:40:43 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:40:44 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:40:48 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:40:48 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da2abdc2-9666-4d25-9521-afe912507438 tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] [instance: 8858d90e-ee14-494b-80da-904cd97cdff0] Calling os-brick to attach iSCSI Volume {{(pid=75337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 15:40:48 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-da2abdc2-9666-4d25-9521-afe912507438 tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2abc33d0c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fd579072-cd8e-4ac1-8f84-1afda08a11da', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BVQOKdAp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 15:40:48 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-da2abdc2-9666-4d25-9521-afe912507438 tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 15:40:48 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-da2abdc2-9666-4d25-9521-afe912507438 tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 15:40:48 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-da2abdc2-9666-4d25-9521-afe912507438 tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 15:40:48 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-da2abdc2-9666-4d25-9521-afe912507438 tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 15:40:48 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-da2abdc2-9666-4d25-9521-afe912507438 tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fd579072-cd8e-4ac1-8f84-1afda08a11da" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 15:40:48 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-da2abdc2-9666-4d25-9521-afe912507438 tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fd579072-cd8e-4ac1-8f84-1afda08a11da" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 15:40:48 user nova-compute[75337]: INFO os_brick.initiator.connectors.iscsi [None req-da2abdc2-9666-4d25-9521-afe912507438 tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 15:40:48 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd579072-cd8e-4ac1-8f84-1afda08a11da -p 172.16.0.220:3260 {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:40:48 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd579072-cd8e-4ac1-8f84-1afda08a11da -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:40:48 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6bb74d6-5cef-4b82-90ad-d4a60ee6e913]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:40:48 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-da2abdc2-9666-4d25-9521-afe912507438 tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 15:40:48 user nova-compute[75337]:  {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:40:48 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd579072-cd8e-4ac1-8f84-1afda08a11da -p 172.16.0.220:3260 --interface default --op new {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:40:48 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd579072-cd8e-4ac1-8f84-1afda08a11da -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:40:48 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0599ccc-fb7f-4efc-a628-d300484dcd00]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fd579072-cd8e-4ac1-8f84-1afda08a11da] added\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:40:48 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-da2abdc2-9666-4d25-9521-afe912507438 tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fd579072-cd8e-4ac1-8f84-1afda08a11da] added
Nov 06 15:40:48 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:40:48 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd579072-cd8e-4ac1-8f84-1afda08a11da -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:40:48 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd579072-cd8e-4ac1-8f84-1afda08a11da -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:40:48 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f651a26-d7b8-40d4-a927-c1674d952410]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:40:48 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-da2abdc2-9666-4d25-9521-afe912507438 tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:40:48 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd579072-cd8e-4ac1-8f84-1afda08a11da -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:40:48 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-2dfb6a54-dbaa-4104-8d3e-e3b1b254ca3e tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Lock "dfadb21f-5ed1-42f4-956b-95cccf128b6a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 47.738s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:40:48 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd579072-cd8e-4ac1-8f84-1afda08a11da -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:40:48 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[22a02a2b-ec63-4db5-812c-e4ca33e2c459]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:40:48 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-da2abdc2-9666-4d25-9521-afe912507438 tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:40:48 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd579072-cd8e-4ac1-8f84-1afda08a11da -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BVQOKdAp {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:40:48 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd579072-cd8e-4ac1-8f84-1afda08a11da -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BVQOKdAp" returned: 0 in 0.021s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:40:48 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[7379ee62-fc50-4eab-9215-c25969326463]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:40:48 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-da2abdc2-9666-4d25-9521-afe912507438 tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BVQOKdAp'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:40:48 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd579072-cd8e-4ac1-8f84-1afda08a11da -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:40:48 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd579072-cd8e-4ac1-8f84-1afda08a11da -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:40:48 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfc100bf-1fae-45a3-acc9-e2d1f6628f06]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:40:48 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-da2abdc2-9666-4d25-9521-afe912507438 tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:40:48 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:40:48 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:40:48 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed49d7ba-dfe3-4f25-a8ab-24d74ba3768a]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759 (non-flash)\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:40:48 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-da2abdc2-9666-4d25-9521-afe912507438 tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759 (non-flash)
Nov 06 15:40:48 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 15:40:48 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-da2abdc2-9666-4d25-9521-afe912507438 tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759 (non-flash)
Nov 06 15:40:48 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 15:40:48 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd579072-cd8e-4ac1-8f84-1afda08a11da -p 172.16.0.220:3260 --login {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:40:48 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd579072-cd8e-4ac1-8f84-1afda08a11da -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:40:48 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0031fec-e44b-4426-8f7d-26e3637afd42]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fd579072-cd8e-4ac1-8f84-1afda08a11da, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fd579072-cd8e-4ac1-8f84-1afda08a11da, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:40:48 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-da2abdc2-9666-4d25-9521-afe912507438 tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fd579072-cd8e-4ac1-8f84-1afda08a11da, portal: 172.16.0.220,3260]
Nov 06 15:40:48 user nova-compute[75337]: Login to [iface: default, target: iqn.2010-10.org.openstack:fd579072-cd8e-4ac1-8f84-1afda08a11da, portal: 172.16.0.220,3260] successful.
Nov 06 15:40:48 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:40:48 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd579072-cd8e-4ac1-8f84-1afda08a11da -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:40:48 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd579072-cd8e-4ac1-8f84-1afda08a11da -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:40:48 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[33f2fec0-5da7-495d-88ee-117b518e9887]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:40:48 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-da2abdc2-9666-4d25-9521-afe912507438 tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:40:48 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:40:48 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:40:48 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[40292abd-7e3e-4c13-a6de-a35c11b54d88]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd579072-cd8e-4ac1-8f84-1afda08a11da (non-flash)\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:40:48 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-da2abdc2-9666-4d25-9521-afe912507438 tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759 (non-flash)
Nov 06 15:40:48 user nova-compute[75337]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd579072-cd8e-4ac1-8f84-1afda08a11da (non-flash)
Nov 06 15:40:48 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 15:40:48 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-da2abdc2-9666-4d25-9521-afe912507438 tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759 (non-flash)
Nov 06 15:40:48 user nova-compute[75337]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd579072-cd8e-4ac1-8f84-1afda08a11da (non-flash)
Nov 06 15:40:48 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 15:40:48 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-da2abdc2-9666-4d25-9521-afe912507438 tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fd579072-cd8e-4ac1-8f84-1afda08a11da" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.282s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 15:40:48 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-da2abdc2-9666-4d25-9521-afe912507438 tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] Connected to 172.16.0.220:3260 {{(pid=75337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 15:40:48 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-da2abdc2-9666-4d25-9521-afe912507438 tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=75337) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 15:40:48 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-da2abdc2-9666-4d25-9521-afe912507438 tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75337) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 15:40:48 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:40:48 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:40:48 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a1971e7-489f-4672-b72d-9317aa079db2]: (4, ('- - 0', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:40:48 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-da2abdc2-9666-4d25-9521-afe912507438 tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: None {{(pid=75337) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 15:40:48 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-f0f20753-ef20-408e-88c1-e1c136e7c41a tempest-VolumesAssistedSnapshotsTest-123777916 tempest-VolumesAssistedSnapshotsTest-123777916-project-admin] Acquiring lock "cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:40:48 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-f0f20753-ef20-408e-88c1-e1c136e7c41a tempest-VolumesAssistedSnapshotsTest-123777916 tempest-VolumesAssistedSnapshotsTest-123777916-project-admin] Lock "cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:40:48 user nova-compute[75337]: DEBUG nova.objects.instance [None req-f0f20753-ef20-408e-88c1-e1c136e7c41a tempest-VolumesAssistedSnapshotsTest-123777916 tempest-VolumesAssistedSnapshotsTest-123777916-project-admin] Lazy-loading 'flavor' on Instance uuid cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 15:40:48 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-63ebe34e-cad7-4ec6-a330-91445d555772 tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] Acquiring lock "76ee582b-b887-4d46-8c78-29f42d1a0d26" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:40:48 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-63ebe34e-cad7-4ec6-a330-91445d555772 tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] Lock "76ee582b-b887-4d46-8c78-29f42d1a0d26" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:40:48 user nova-compute[75337]: DEBUG nova.objects.instance [None req-63ebe34e-cad7-4ec6-a330-91445d555772 tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] Lazy-loading 'flavor' on Instance uuid 76ee582b-b887-4d46-8c78-29f42d1a0d26 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 15:40:48 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-f0f20753-ef20-408e-88c1-e1c136e7c41a tempest-VolumesAssistedSnapshotsTest-123777916 tempest-VolumesAssistedSnapshotsTest-123777916-project-admin] Lock "cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.110s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:40:48 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-63ebe34e-cad7-4ec6-a330-91445d555772 tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] Lock "76ee582b-b887-4d46-8c78-29f42d1a0d26" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:40:49 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-63ebe34e-cad7-4ec6-a330-91445d555772 tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] Acquiring lock "76ee582b-b887-4d46-8c78-29f42d1a0d26" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:40:49 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-63ebe34e-cad7-4ec6-a330-91445d555772 tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] Lock "76ee582b-b887-4d46-8c78-29f42d1a0d26" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:40:49 user nova-compute[75337]: INFO nova.compute.manager [None req-63ebe34e-cad7-4ec6-a330-91445d555772 tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] [instance: 76ee582b-b887-4d46-8c78-29f42d1a0d26] Attaching volume dccaff76-b907-4a00-b34d-bb5ae7655a02 to /dev/vdb
Nov 06 15:40:49 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-f0f20753-ef20-408e-88c1-e1c136e7c41a tempest-VolumesAssistedSnapshotsTest-123777916 tempest-VolumesAssistedSnapshotsTest-123777916-project-admin] Acquiring lock "cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:40:49 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-f0f20753-ef20-408e-88c1-e1c136e7c41a tempest-VolumesAssistedSnapshotsTest-123777916 tempest-VolumesAssistedSnapshotsTest-123777916-project-admin] Lock "cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:40:49 user nova-compute[75337]: INFO nova.compute.manager [None req-f0f20753-ef20-408e-88c1-e1c136e7c41a tempest-VolumesAssistedSnapshotsTest-123777916 tempest-VolumesAssistedSnapshotsTest-123777916-project-admin] [instance: cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1] Attaching volume 7f11bb9d-a426-4068-9915-1da27b932a82 to /dev/vdb
Nov 06 15:40:49 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-da2abdc2-9666-4d25-9521-afe912507438 tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75337) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 15:40:49 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-da2abdc2-9666-4d25-9521-afe912507438 tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:fd579072-cd8e-4ac1-8f84-1afda08a11da', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BVQOKdAp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 15:40:49 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-da2abdc2-9666-4d25-9521-afe912507438 tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.316s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 15:40:49 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-da2abdc2-9666-4d25-9521-afe912507438 tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] <== connect_volume: return (1317ms) {'type': 'block', 'scsi_wwn': '23836656631613462', 'path': '/dev/sdc'} {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 15:40:49 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da2abdc2-9666-4d25-9521-afe912507438 tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] [instance: 8858d90e-ee14-494b-80da-904cd97cdff0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23836656631613462', 'path': '/dev/sdc'} {{(pid=75337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 15:40:49 user nova-compute[75337]: DEBUG nova.objects.instance [None req-da2abdc2-9666-4d25-9521-afe912507438 tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] Lazy-loading 'flavor' on Instance uuid 8858d90e-ee14-494b-80da-904cd97cdff0 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 15:40:49 user nova-compute[75337]: DEBUG nova.virt.libvirt.guest [None req-da2abdc2-9666-4d25-9521-afe912507438 tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] attach device xml: <disk type="block" device="disk">
Nov 06 15:40:49 user nova-compute[75337]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 15:40:49 user nova-compute[75337]:   <source dev="/dev/sdc"/>
Nov 06 15:40:49 user nova-compute[75337]:   <target dev="sdc" bus="scsi"/>
Nov 06 15:40:49 user nova-compute[75337]:   <serial>fd579072-cd8e-4ac1-8f84-1afda08a11da</serial>
Nov 06 15:40:49 user nova-compute[75337]:   <address type="drive" controller="0" unit="2"/>
Nov 06 15:40:49 user nova-compute[75337]: </disk>
Nov 06 15:40:49 user nova-compute[75337]:  {{(pid=75337) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 06 15:40:49 user nova-compute[75337]: DEBUG os_brick.utils [None req-63ebe34e-cad7-4ec6-a330-91445d555772 tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 15:40:49 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:40:49 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:40:49 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fc03843-045d-4d04-a727-2aac219daab6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4ff6411e45b8\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:40:49 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:40:49 user nova-compute[75337]: DEBUG os_brick.utils [None req-f0f20753-ef20-408e-88c1-e1c136e7c41a tempest-VolumesAssistedSnapshotsTest-123777916 tempest-VolumesAssistedSnapshotsTest-123777916-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 15:40:49 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:40:49 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9f4e051-abbe-430b-a068-b37cc087eac7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:40:49 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:40:49 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:40:49 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:40:49 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca899752-508d-4650-a436-289c587eb3ac]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4ff6411e45b8\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:40:49 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:40:49 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ede0a34-c9c1-42d2-837a-b98d7429107a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:40:49 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:40:49 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[03ef83c0-9487-4411-b88b-b842c8887b10]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:40:49 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-63ebe34e-cad7-4ec6-a330-91445d555772 tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] Running cmd (subprocess): nvme version {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:40:49 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-63ebe34e-cad7-4ec6-a330-91445d555772 tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] 'nvme version' failed. Not Retrying. {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 15:40:49 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:40:49 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:40:49 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[30cfd1cf-6a44-40c3-9adb-70175a66a5c0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:40:49 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.nvmeof [None req-63ebe34e-cad7-4ec6-a330-91445d555772 tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] nvme not present on system {{(pid=75337) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 15:40:49 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:40:49 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:40:49 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 15:40:49 user nova-compute[75337]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 15:40:49 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:40:49 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e476829-3ca4-4059-ad96-da4dbd85bb46]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:40:49 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[55c1efd0-7e7f-44c6-b2c0-fccbc3026826]: (4, '') {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:40:49 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.lightos [None req-63ebe34e-cad7-4ec6-a330-91445d555772 tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75337) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 15:40:49 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.lightos [None req-63ebe34e-cad7-4ec6-a330-91445d555772 tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 15:40:49 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.lightos [None req-63ebe34e-cad7-4ec6-a330-91445d555772 tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] LIGHTOS: no hostnqn found. {{(pid=75337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 15:40:49 user nova-compute[75337]: DEBUG os_brick.utils [None req-63ebe34e-cad7-4ec6-a330-91445d555772 tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] <== get_connector_properties: return (169ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4ff6411e45b8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 15:40:49 user nova-compute[75337]: DEBUG nova.virt.block_device [None req-63ebe34e-cad7-4ec6-a330-91445d555772 tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] [instance: 76ee582b-b887-4d46-8c78-29f42d1a0d26] Updating existing volume attachment record: 83595af1-02aa-4c3e-a715-c410c3a49265 {{(pid=75337) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 15:40:49 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea674a44-ee7e-4ac7-9843-14d741644f50]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:40:49 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-f0f20753-ef20-408e-88c1-e1c136e7c41a tempest-VolumesAssistedSnapshotsTest-123777916 tempest-VolumesAssistedSnapshotsTest-123777916-project-admin] Running cmd (subprocess): nvme version {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:40:49 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-f0f20753-ef20-408e-88c1-e1c136e7c41a tempest-VolumesAssistedSnapshotsTest-123777916 tempest-VolumesAssistedSnapshotsTest-123777916-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 15:40:49 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f0f20753-ef20-408e-88c1-e1c136e7c41a tempest-VolumesAssistedSnapshotsTest-123777916 tempest-VolumesAssistedSnapshotsTest-123777916-project-admin] nvme not present on system {{(pid=75337) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 15:40:49 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:40:49 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 15:40:49 user nova-compute[75337]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 15:40:49 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cc5a09c-d1f0-4cb9-a442-6e86e81446a3]: (4, '') {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:40:49 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.lightos [None req-f0f20753-ef20-408e-88c1-e1c136e7c41a tempest-VolumesAssistedSnapshotsTest-123777916 tempest-VolumesAssistedSnapshotsTest-123777916-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75337) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 15:40:49 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.lightos [None req-f0f20753-ef20-408e-88c1-e1c136e7c41a tempest-VolumesAssistedSnapshotsTest-123777916 tempest-VolumesAssistedSnapshotsTest-123777916-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 15:40:49 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.lightos [None req-f0f20753-ef20-408e-88c1-e1c136e7c41a tempest-VolumesAssistedSnapshotsTest-123777916 tempest-VolumesAssistedSnapshotsTest-123777916-project-admin] LIGHTOS: no hostnqn found. {{(pid=75337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 15:40:49 user nova-compute[75337]: DEBUG os_brick.utils [None req-f0f20753-ef20-408e-88c1-e1c136e7c41a tempest-VolumesAssistedSnapshotsTest-123777916 tempest-VolumesAssistedSnapshotsTest-123777916-project-admin] <== get_connector_properties: return (204ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4ff6411e45b8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 15:40:49 user nova-compute[75337]: DEBUG nova.virt.block_device [None req-f0f20753-ef20-408e-88c1-e1c136e7c41a tempest-VolumesAssistedSnapshotsTest-123777916 tempest-VolumesAssistedSnapshotsTest-123777916-project-admin] [instance: cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1] Updating existing volume attachment record: aea213c1-10f2-49d3-9347-4d059a48ccfe {{(pid=75337) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 15:40:50 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-da2abdc2-9666-4d25-9521-afe912507438 tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] No BDM found with device name sda, not building metadata. {{(pid=75337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 15:40:50 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-da2abdc2-9666-4d25-9521-afe912507438 tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] No BDM found with device name sdb, not building metadata. {{(pid=75337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 15:40:50 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-da2abdc2-9666-4d25-9521-afe912507438 tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] No BDM found with device name sdc, not building metadata. {{(pid=75337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 15:40:50 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-da2abdc2-9666-4d25-9521-afe912507438 tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] No VIF found with MAC fa:16:3e:d5:8c:cf, not building metadata {{(pid=75337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 15:40:51 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-cd149df5-1d51-4d71-b740-a65dae67bbba tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Acquiring lock "d5dc789c-b1ee-4ee8-8e2b-9a6cb56a1361" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:40:51 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-cd149df5-1d51-4d71-b740-a65dae67bbba tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Lock "d5dc789c-b1ee-4ee8-8e2b-9a6cb56a1361" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:40:51 user nova-compute[75337]: DEBUG nova.compute.manager [None req-cd149df5-1d51-4d71-b740-a65dae67bbba tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] [instance: d5dc789c-b1ee-4ee8-8e2b-9a6cb56a1361] Starting instance... {{(pid=75337) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 15:40:51 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-cd149df5-1d51-4d71-b740-a65dae67bbba tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:40:51 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-cd149df5-1d51-4d71-b740-a65dae67bbba tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:40:51 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-cd149df5-1d51-4d71-b740-a65dae67bbba tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75337) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 15:40:51 user nova-compute[75337]: INFO nova.compute.claims [None req-cd149df5-1d51-4d71-b740-a65dae67bbba tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] [instance: d5dc789c-b1ee-4ee8-8e2b-9a6cb56a1361] Claim successful on node user
Nov 06 15:40:52 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-cd149df5-1d51-4d71-b740-a65dae67bbba tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 15:40:52 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-cd149df5-1d51-4d71-b740-a65dae67bbba tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 15:40:52 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-cd149df5-1d51-4d71-b740-a65dae67bbba tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.498s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:40:52 user nova-compute[75337]: DEBUG nova.compute.manager [None req-cd149df5-1d51-4d71-b740-a65dae67bbba tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] [instance: d5dc789c-b1ee-4ee8-8e2b-9a6cb56a1361] Start building networks asynchronously for instance. {{(pid=75337) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 15:40:52 user nova-compute[75337]: DEBUG nova.compute.manager [None req-cd149df5-1d51-4d71-b740-a65dae67bbba tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] [instance: d5dc789c-b1ee-4ee8-8e2b-9a6cb56a1361] Allocating IP information in the background. {{(pid=75337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 15:40:52 user nova-compute[75337]: DEBUG nova.network.neutron [None req-cd149df5-1d51-4d71-b740-a65dae67bbba tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] [instance: d5dc789c-b1ee-4ee8-8e2b-9a6cb56a1361] allocate_for_instance() {{(pid=75337) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 15:40:52 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-cd149df5-1d51-4d71-b740-a65dae67bbba tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] [instance: d5dc789c-b1ee-4ee8-8e2b-9a6cb56a1361] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 15:40:52 user nova-compute[75337]: DEBUG nova.compute.manager [None req-cd149df5-1d51-4d71-b740-a65dae67bbba tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] [instance: d5dc789c-b1ee-4ee8-8e2b-9a6cb56a1361] Start building block device mappings for instance. {{(pid=75337) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 15:40:52 user nova-compute[75337]: DEBUG nova.policy [None req-cd149df5-1d51-4d71-b740-a65dae67bbba tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'aeeea58fcd3e4217a34a4a38be6adf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1013e7afbefd4146a3be04587710b1de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75337) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 15:40:52 user nova-compute[75337]: DEBUG nova.compute.manager [None req-cd149df5-1d51-4d71-b740-a65dae67bbba tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] [instance: d5dc789c-b1ee-4ee8-8e2b-9a6cb56a1361] Start spawning the instance on the hypervisor. {{(pid=75337) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 15:40:52 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-cd149df5-1d51-4d71-b740-a65dae67bbba tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] [instance: d5dc789c-b1ee-4ee8-8e2b-9a6cb56a1361] Creating instance directory {{(pid=75337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 15:40:52 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-cd149df5-1d51-4d71-b740-a65dae67bbba tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] [instance: d5dc789c-b1ee-4ee8-8e2b-9a6cb56a1361] Creating image(s)
Nov 06 15:40:52 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-cd149df5-1d51-4d71-b740-a65dae67bbba tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Acquiring lock "/opt/stack/data/nova/instances/d5dc789c-b1ee-4ee8-8e2b-9a6cb56a1361/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:40:52 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-cd149df5-1d51-4d71-b740-a65dae67bbba tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Lock "/opt/stack/data/nova/instances/d5dc789c-b1ee-4ee8-8e2b-9a6cb56a1361/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:40:52 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-cd149df5-1d51-4d71-b740-a65dae67bbba tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Lock "/opt/stack/data/nova/instances/d5dc789c-b1ee-4ee8-8e2b-9a6cb56a1361/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:40:52 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-cd149df5-1d51-4d71-b740-a65dae67bbba tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:40:52 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-cd149df5-1d51-4d71-b740-a65dae67bbba tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json" returned: 0 in 0.184s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:40:52 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-cd149df5-1d51-4d71-b740-a65dae67bbba tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Acquiring lock "06ba3c914798499e686c5ac75886932347225275" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:40:52 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-cd149df5-1d51-4d71-b740-a65dae67bbba tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Lock "06ba3c914798499e686c5ac75886932347225275" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:40:52 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-cd149df5-1d51-4d71-b740-a65dae67bbba tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:40:53 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-cd149df5-1d51-4d71-b740-a65dae67bbba tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json" returned: 0 in 0.172s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:40:53 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-cd149df5-1d51-4d71-b740-a65dae67bbba tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275,backing_fmt=raw /opt/stack/data/nova/instances/d5dc789c-b1ee-4ee8-8e2b-9a6cb56a1361/disk 1073741824 {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:40:53 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-cd149df5-1d51-4d71-b740-a65dae67bbba tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275,backing_fmt=raw /opt/stack/data/nova/instances/d5dc789c-b1ee-4ee8-8e2b-9a6cb56a1361/disk 1073741824" returned: 0 in 0.059s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:40:53 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-cd149df5-1d51-4d71-b740-a65dae67bbba tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Lock "06ba3c914798499e686c5ac75886932347225275" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:40:53 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-cd149df5-1d51-4d71-b740-a65dae67bbba tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:40:53 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:40:53 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-cd149df5-1d51-4d71-b740-a65dae67bbba tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json" returned: 0 in 0.209s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:40:53 user nova-compute[75337]: DEBUG nova.virt.disk.api [None req-cd149df5-1d51-4d71-b740-a65dae67bbba tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d5dc789c-b1ee-4ee8-8e2b-9a6cb56a1361/disk. size=1073741824 {{(pid=75337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 15:40:53 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-cd149df5-1d51-4d71-b740-a65dae67bbba tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5dc789c-b1ee-4ee8-8e2b-9a6cb56a1361/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:40:53 user nova-compute[75337]: DEBUG nova.network.neutron [None req-cd149df5-1d51-4d71-b740-a65dae67bbba tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] [instance: d5dc789c-b1ee-4ee8-8e2b-9a6cb56a1361] Successfully created port: d4ab286a-0327-4dde-8eda-1c63107a670a {{(pid=75337) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 15:40:53 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-cd149df5-1d51-4d71-b740-a65dae67bbba tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5dc789c-b1ee-4ee8-8e2b-9a6cb56a1361/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:40:53 user nova-compute[75337]: DEBUG nova.virt.disk.api [None req-cd149df5-1d51-4d71-b740-a65dae67bbba tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Cannot resize image /opt/stack/data/nova/instances/d5dc789c-b1ee-4ee8-8e2b-9a6cb56a1361/disk to a smaller size. {{(pid=75337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 06 15:40:53 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-cd149df5-1d51-4d71-b740-a65dae67bbba tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] [instance: d5dc789c-b1ee-4ee8-8e2b-9a6cb56a1361] Created local disks {{(pid=75337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 15:40:53 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-cd149df5-1d51-4d71-b740-a65dae67bbba tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] [instance: d5dc789c-b1ee-4ee8-8e2b-9a6cb56a1361] Ensure instance console log exists: /opt/stack/data/nova/instances/d5dc789c-b1ee-4ee8-8e2b-9a6cb56a1361/console.log {{(pid=75337) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 15:40:53 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-cd149df5-1d51-4d71-b740-a65dae67bbba tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:40:53 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-cd149df5-1d51-4d71-b740-a65dae67bbba tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:40:53 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-cd149df5-1d51-4d71-b740-a65dae67bbba tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:40:53 user nova-compute[75337]: DEBUG nova.network.neutron [None req-cd149df5-1d51-4d71-b740-a65dae67bbba tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] [instance: d5dc789c-b1ee-4ee8-8e2b-9a6cb56a1361] Successfully updated port: d4ab286a-0327-4dde-8eda-1c63107a670a {{(pid=75337) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 15:40:54 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-cd149df5-1d51-4d71-b740-a65dae67bbba tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Acquiring lock "refresh_cache-d5dc789c-b1ee-4ee8-8e2b-9a6cb56a1361" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 15:40:54 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-cd149df5-1d51-4d71-b740-a65dae67bbba tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Acquired lock "refresh_cache-d5dc789c-b1ee-4ee8-8e2b-9a6cb56a1361" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 15:40:54 user nova-compute[75337]: DEBUG nova.network.neutron [None req-cd149df5-1d51-4d71-b740-a65dae67bbba tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] [instance: d5dc789c-b1ee-4ee8-8e2b-9a6cb56a1361] Building network info cache for instance {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 15:40:54 user nova-compute[75337]: DEBUG nova.compute.manager [req-36346232-564e-4687-a430-b30af82135ae req-04bf86b4-477f-45da-8d07-1eff5c8961e6 service nova] [instance: d5dc789c-b1ee-4ee8-8e2b-9a6cb56a1361] Received event network-changed-d4ab286a-0327-4dde-8eda-1c63107a670a {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:40:54 user nova-compute[75337]: DEBUG nova.compute.manager [req-36346232-564e-4687-a430-b30af82135ae req-04bf86b4-477f-45da-8d07-1eff5c8961e6 service nova] [instance: d5dc789c-b1ee-4ee8-8e2b-9a6cb56a1361] Refreshing instance network info cache due to event network-changed-d4ab286a-0327-4dde-8eda-1c63107a670a. {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 15:40:54 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-36346232-564e-4687-a430-b30af82135ae req-04bf86b4-477f-45da-8d07-1eff5c8961e6 service nova] Acquiring lock "refresh_cache-d5dc789c-b1ee-4ee8-8e2b-9a6cb56a1361" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 15:40:54 user nova-compute[75337]: DEBUG nova.network.neutron [None req-cd149df5-1d51-4d71-b740-a65dae67bbba tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] [instance: d5dc789c-b1ee-4ee8-8e2b-9a6cb56a1361] Instance cache missing network info. {{(pid=75337) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 15:40:54 user nova-compute[75337]: DEBUG nova.network.neutron [None req-cd149df5-1d51-4d71-b740-a65dae67bbba tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] [instance: d5dc789c-b1ee-4ee8-8e2b-9a6cb56a1361] Updating instance_info_cache with network_info: [{"id": "d4ab286a-0327-4dde-8eda-1c63107a670a", "address": "fa:16:3e:60:0c:0f", "network": {"id": "48f1545d-7e80-462f-9dbf-f1102ddcda9a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1210368397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1013e7afbefd4146a3be04587710b1de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4ab286a-03", "ovs_interfaceid": "d4ab286a-0327-4dde-8eda-1c63107a670a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:40:54 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-cd149df5-1d51-4d71-b740-a65dae67bbba tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Releasing lock "refresh_cache-d5dc789c-b1ee-4ee8-8e2b-9a6cb56a1361" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 15:40:54 user nova-compute[75337]: DEBUG nova.compute.manager [None req-cd149df5-1d51-4d71-b740-a65dae67bbba tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] [instance: d5dc789c-b1ee-4ee8-8e2b-9a6cb56a1361] Instance network_info: |[{"id": "d4ab286a-0327-4dde-8eda-1c63107a670a", "address": "fa:16:3e:60:0c:0f", "network": {"id": "48f1545d-7e80-462f-9dbf-f1102ddcda9a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1210368397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1013e7afbefd4146a3be04587710b1de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4ab286a-03", "ovs_interfaceid": "d4ab286a-0327-4dde-8eda-1c63107a670a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 15:40:54 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-36346232-564e-4687-a430-b30af82135ae req-04bf86b4-477f-45da-8d07-1eff5c8961e6 service nova] Acquired lock "refresh_cache-d5dc789c-b1ee-4ee8-8e2b-9a6cb56a1361" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 15:40:54 user nova-compute[75337]: DEBUG nova.network.neutron [req-36346232-564e-4687-a430-b30af82135ae req-04bf86b4-477f-45da-8d07-1eff5c8961e6 service nova] [instance: d5dc789c-b1ee-4ee8-8e2b-9a6cb56a1361] Refreshing network info cache for port d4ab286a-0327-4dde-8eda-1c63107a670a {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 15:40:54 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-cd149df5-1d51-4d71-b740-a65dae67bbba tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] [instance: d5dc789c-b1ee-4ee8-8e2b-9a6cb56a1361] Start _get_guest_xml network_info=[{"id": "d4ab286a-0327-4dde-8eda-1c63107a670a", "address": "fa:16:3e:60:0c:0f", "network": {"id": "48f1545d-7e80-462f-9dbf-f1102ddcda9a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1210368397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1013e7afbefd4146a3be04587710b1de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4ab286a-03", "ovs_interfaceid": "d4ab286a-0327-4dde-8eda-1c63107a670a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T15:34:14Z,direct_url=<?>,disk_format='qcow2',id=16b903ae-a40f-41a7-985b-4804cce92c62,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6549a15819f1469bbd5eeae8190e3d44',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T15:34:15Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'guest_format': None, 'size': 0, 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '16b903ae-a40f-41a7-985b-4804cce92c62'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 15:40:54 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-cd149df5-1d51-4d71-b740-a65dae67bbba tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 15:40:54 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-cd149df5-1d51-4d71-b740-a65dae67bbba tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 15:40:54 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-cd149df5-1d51-4d71-b740-a65dae67bbba tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 15:40:54 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-cd149df5-1d51-4d71-b740-a65dae67bbba tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] CPU controller missing on host. {{(pid=75337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 15:40:54 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-cd149df5-1d51-4d71-b740-a65dae67bbba tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 15:40:54 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-cd149df5-1d51-4d71-b740-a65dae67bbba tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] CPU controller found on host. {{(pid=75337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 15:40:54 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-cd149df5-1d51-4d71-b740-a65dae67bbba tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75337) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 15:40:54 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-cd149df5-1d51-4d71-b740-a65dae67bbba tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T15:34:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T15:34:14Z,direct_url=<?>,disk_format='qcow2',id=16b903ae-a40f-41a7-985b-4804cce92c62,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6549a15819f1469bbd5eeae8190e3d44',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T15:34:15Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 15:40:54 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-cd149df5-1d51-4d71-b740-a65dae67bbba tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Flavor limits 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 15:40:54 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-cd149df5-1d51-4d71-b740-a65dae67bbba tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Image limits 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 15:40:54 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-cd149df5-1d51-4d71-b740-a65dae67bbba tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Flavor pref 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 15:40:54 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-cd149df5-1d51-4d71-b740-a65dae67bbba tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Image pref 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 15:40:54 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-cd149df5-1d51-4d71-b740-a65dae67bbba tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 15:40:54 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-cd149df5-1d51-4d71-b740-a65dae67bbba tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 15:40:54 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-cd149df5-1d51-4d71-b740-a65dae67bbba tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 15:40:54 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-cd149df5-1d51-4d71-b740-a65dae67bbba tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Got 1 possible topologies {{(pid=75337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 15:40:54 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-cd149df5-1d51-4d71-b740-a65dae67bbba tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 15:40:54 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-cd149df5-1d51-4d71-b740-a65dae67bbba tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 15:40:54 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-cd149df5-1d51-4d71-b740-a65dae67bbba tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T15:40:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-401455732',display_name='tempest-AttachVolumeNegativeTest-server-401455732',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-401455732',id=11,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFcIoKwOFgiqgppCQHB6MtZX84AO7eVdgMXwhbYTtJQD/x+MPsaRCt/NhtJcrDF+KtGRBOWtAsmO/gAH2wt+7e3soZA3hfcDdB2XLBKT/xRHxN5wjx+ikRaIDb+t3xU57Q==',key_name='tempest-keypair-212361804',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1013e7afbefd4146a3be04587710b1de',ramdisk_id='',reservation_id='r-72hm4gcf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1104237961',owner_user_name='tempest-AttachVolumeNegativeTest-1104237961-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T15:40:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aeeea58fcd3e4217a34a4a38be6adf30',uuid=d5dc789c-b1ee-4ee8-8e2b-9a6cb56a1361,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d4ab286a-0327-4dde-8eda-1c63107a670a", "address": "fa:16:3e:60:0c:0f", "network": {"id": "48f1545d-7e80-462f-9dbf-f1102ddcda9a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1210368397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1013e7afbefd4146a3be04587710b1de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4ab286a-03", "ovs_interfaceid": "d4ab286a-0327-4dde-8eda-1c63107a670a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75337) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 15:40:54 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-cd149df5-1d51-4d71-b740-a65dae67bbba tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Converting VIF {"id": "d4ab286a-0327-4dde-8eda-1c63107a670a", "address": "fa:16:3e:60:0c:0f", "network": {"id": "48f1545d-7e80-462f-9dbf-f1102ddcda9a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1210368397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1013e7afbefd4146a3be04587710b1de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4ab286a-03", "ovs_interfaceid": "d4ab286a-0327-4dde-8eda-1c63107a670a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 15:40:54 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-cd149df5-1d51-4d71-b740-a65dae67bbba tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:0c:0f,bridge_name='br-int',has_traffic_filtering=True,id=d4ab286a-0327-4dde-8eda-1c63107a670a,network=Network(48f1545d-7e80-462f-9dbf-f1102ddcda9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4ab286a-03') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 15:40:54 user nova-compute[75337]: DEBUG nova.objects.instance [None req-cd149df5-1d51-4d71-b740-a65dae67bbba tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Lazy-loading 'pci_devices' on Instance uuid d5dc789c-b1ee-4ee8-8e2b-9a6cb56a1361 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 15:40:54 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-cd149df5-1d51-4d71-b740-a65dae67bbba tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] [instance: d5dc789c-b1ee-4ee8-8e2b-9a6cb56a1361] End _get_guest_xml xml=<domain type="kvm">
Nov 06 15:40:54 user nova-compute[75337]:   <uuid>d5dc789c-b1ee-4ee8-8e2b-9a6cb56a1361</uuid>
Nov 06 15:40:54 user nova-compute[75337]:   <name>instance-0000000b</name>
Nov 06 15:40:54 user nova-compute[75337]:   <memory>524288</memory>
Nov 06 15:40:54 user nova-compute[75337]:   <vcpu>1</vcpu>
Nov 06 15:40:54 user nova-compute[75337]:   <metadata>
Nov 06 15:40:54 user nova-compute[75337]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 15:40:54 user nova-compute[75337]:       <nova:package version="0.0.0"/>
Nov 06 15:40:54 user nova-compute[75337]:       <nova:name>tempest-AttachVolumeNegativeTest-server-401455732</nova:name>
Nov 06 15:40:54 user nova-compute[75337]:       <nova:creationTime>2023-11-06 15:40:54</nova:creationTime>
Nov 06 15:40:54 user nova-compute[75337]:       <nova:flavor name="m1.tiny">
Nov 06 15:40:54 user nova-compute[75337]:         <nova:memory>512</nova:memory>
Nov 06 15:40:54 user nova-compute[75337]:         <nova:disk>1</nova:disk>
Nov 06 15:40:54 user nova-compute[75337]:         <nova:swap>0</nova:swap>
Nov 06 15:40:54 user nova-compute[75337]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 15:40:54 user nova-compute[75337]:         <nova:vcpus>1</nova:vcpus>
Nov 06 15:40:54 user nova-compute[75337]:       </nova:flavor>
Nov 06 15:40:54 user nova-compute[75337]:       <nova:owner>
Nov 06 15:40:54 user nova-compute[75337]:         <nova:user uuid="aeeea58fcd3e4217a34a4a38be6adf30">tempest-AttachVolumeNegativeTest-1104237961-project-member</nova:user>
Nov 06 15:40:54 user nova-compute[75337]:         <nova:project uuid="1013e7afbefd4146a3be04587710b1de">tempest-AttachVolumeNegativeTest-1104237961</nova:project>
Nov 06 15:40:54 user nova-compute[75337]:       </nova:owner>
Nov 06 15:40:54 user nova-compute[75337]:       <nova:root type="image" uuid="16b903ae-a40f-41a7-985b-4804cce92c62"/>
Nov 06 15:40:54 user nova-compute[75337]:       <nova:ports>
Nov 06 15:40:54 user nova-compute[75337]:         <nova:port uuid="d4ab286a-0327-4dde-8eda-1c63107a670a">
Nov 06 15:40:54 user nova-compute[75337]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 06 15:40:54 user nova-compute[75337]:         </nova:port>
Nov 06 15:40:54 user nova-compute[75337]:       </nova:ports>
Nov 06 15:40:54 user nova-compute[75337]:     </nova:instance>
Nov 06 15:40:54 user nova-compute[75337]:   </metadata>
Nov 06 15:40:54 user nova-compute[75337]:   <sysinfo type="smbios">
Nov 06 15:40:54 user nova-compute[75337]:     <system>
Nov 06 15:40:54 user nova-compute[75337]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 15:40:54 user nova-compute[75337]:       <entry name="product">OpenStack Nova</entry>
Nov 06 15:40:54 user nova-compute[75337]:       <entry name="version">0.0.0</entry>
Nov 06 15:40:54 user nova-compute[75337]:       <entry name="serial">d5dc789c-b1ee-4ee8-8e2b-9a6cb56a1361</entry>
Nov 06 15:40:54 user nova-compute[75337]:       <entry name="uuid">d5dc789c-b1ee-4ee8-8e2b-9a6cb56a1361</entry>
Nov 06 15:40:54 user nova-compute[75337]:       <entry name="family">Virtual Machine</entry>
Nov 06 15:40:54 user nova-compute[75337]:     </system>
Nov 06 15:40:54 user nova-compute[75337]:   </sysinfo>
Nov 06 15:40:54 user nova-compute[75337]:   <os>
Nov 06 15:40:54 user nova-compute[75337]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 15:40:54 user nova-compute[75337]:     <boot dev="hd"/>
Nov 06 15:40:54 user nova-compute[75337]:     <smbios mode="sysinfo"/>
Nov 06 15:40:54 user nova-compute[75337]:   </os>
Nov 06 15:40:54 user nova-compute[75337]:   <features>
Nov 06 15:40:54 user nova-compute[75337]:     <acpi/>
Nov 06 15:40:54 user nova-compute[75337]:     <apic/>
Nov 06 15:40:54 user nova-compute[75337]:     <vmcoreinfo/>
Nov 06 15:40:54 user nova-compute[75337]:   </features>
Nov 06 15:40:54 user nova-compute[75337]:   <clock offset="utc">
Nov 06 15:40:54 user nova-compute[75337]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 15:40:54 user nova-compute[75337]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 15:40:54 user nova-compute[75337]:     <timer name="hpet" present="no"/>
Nov 06 15:40:54 user nova-compute[75337]:   </clock>
Nov 06 15:40:54 user nova-compute[75337]:   <cpu mode="custom" match="exact">
Nov 06 15:40:54 user nova-compute[75337]:     <model>Nehalem</model>
Nov 06 15:40:54 user nova-compute[75337]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 15:40:54 user nova-compute[75337]:   </cpu>
Nov 06 15:40:54 user nova-compute[75337]:   <devices>
Nov 06 15:40:54 user nova-compute[75337]:     <disk type="file" device="disk">
Nov 06 15:40:54 user nova-compute[75337]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 15:40:54 user nova-compute[75337]:       <source file="/opt/stack/data/nova/instances/d5dc789c-b1ee-4ee8-8e2b-9a6cb56a1361/disk"/>
Nov 06 15:40:54 user nova-compute[75337]:       <target dev="vda" bus="virtio"/>
Nov 06 15:40:54 user nova-compute[75337]:     </disk>
Nov 06 15:40:54 user nova-compute[75337]:     <interface type="ethernet">
Nov 06 15:40:54 user nova-compute[75337]:       <mac address="fa:16:3e:60:0c:0f"/>
Nov 06 15:40:54 user nova-compute[75337]:       <model type="virtio"/>
Nov 06 15:40:54 user nova-compute[75337]:       <mtu size="1442"/>
Nov 06 15:40:54 user nova-compute[75337]:       <target dev="tapd4ab286a-03"/>
Nov 06 15:40:54 user nova-compute[75337]:     </interface>
Nov 06 15:40:54 user nova-compute[75337]:     <serial type="pty">
Nov 06 15:40:54 user nova-compute[75337]:       <log file="/opt/stack/data/nova/instances/d5dc789c-b1ee-4ee8-8e2b-9a6cb56a1361/console.log" append="off"/>
Nov 06 15:40:54 user nova-compute[75337]:     </serial>
Nov 06 15:40:54 user nova-compute[75337]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 15:40:54 user nova-compute[75337]:     <video>
Nov 06 15:40:54 user nova-compute[75337]:       <model type="virtio"/>
Nov 06 15:40:54 user nova-compute[75337]:     </video>
Nov 06 15:40:54 user nova-compute[75337]:     <rng model="virtio">
Nov 06 15:40:54 user nova-compute[75337]:       <backend model="random">/dev/urandom</backend>
Nov 06 15:40:54 user nova-compute[75337]:     </rng>
Nov 06 15:40:54 user nova-compute[75337]:     <controller type="usb" index="0" model="none"/>
Nov 06 15:40:54 user nova-compute[75337]:     <memballoon model="virtio">
Nov 06 15:40:54 user nova-compute[75337]:       <stats period="10"/>
Nov 06 15:40:54 user nova-compute[75337]:     </memballoon>
Nov 06 15:40:54 user nova-compute[75337]:   </devices>
Nov 06 15:40:54 user nova-compute[75337]: </domain>
Nov 06 15:40:54 user nova-compute[75337]:  {{(pid=75337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 15:40:54 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-cd149df5-1d51-4d71-b740-a65dae67bbba tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T15:40:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-401455732',display_name='tempest-AttachVolumeNegativeTest-server-401455732',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-401455732',id=11,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFcIoKwOFgiqgppCQHB6MtZX84AO7eVdgMXwhbYTtJQD/x+MPsaRCt/NhtJcrDF+KtGRBOWtAsmO/gAH2wt+7e3soZA3hfcDdB2XLBKT/xRHxN5wjx+ikRaIDb+t3xU57Q==',key_name='tempest-keypair-212361804',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1013e7afbefd4146a3be04587710b1de',ramdisk_id='',reservation_id='r-72hm4gcf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1104237961',owner_user_name='tempest-AttachVolumeNegativeTest-1104237961-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T15:40:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aeeea58fcd3e4217a34a4a38be6adf30',uuid=d5dc789c-b1ee-4ee8-8e2b-9a6cb56a1361,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d4ab286a-0327-4dde-8eda-1c63107a670a", "address": "fa:16:3e:60:0c:0f", "network": {"id": "48f1545d-7e80-462f-9dbf-f1102ddcda9a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1210368397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1013e7afbefd4146a3be04587710b1de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4ab286a-03", "ovs_interfaceid": "d4ab286a-0327-4dde-8eda-1c63107a670a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 15:40:54 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-cd149df5-1d51-4d71-b740-a65dae67bbba tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Converting VIF {"id": "d4ab286a-0327-4dde-8eda-1c63107a670a", "address": "fa:16:3e:60:0c:0f", "network": {"id": "48f1545d-7e80-462f-9dbf-f1102ddcda9a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1210368397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1013e7afbefd4146a3be04587710b1de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4ab286a-03", "ovs_interfaceid": "d4ab286a-0327-4dde-8eda-1c63107a670a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 15:40:54 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-cd149df5-1d51-4d71-b740-a65dae67bbba tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:0c:0f,bridge_name='br-int',has_traffic_filtering=True,id=d4ab286a-0327-4dde-8eda-1c63107a670a,network=Network(48f1545d-7e80-462f-9dbf-f1102ddcda9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4ab286a-03') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 15:40:54 user nova-compute[75337]: DEBUG os_vif [None req-cd149df5-1d51-4d71-b740-a65dae67bbba tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:0c:0f,bridge_name='br-int',has_traffic_filtering=True,id=d4ab286a-0327-4dde-8eda-1c63107a670a,network=Network(48f1545d-7e80-462f-9dbf-f1102ddcda9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4ab286a-03') {{(pid=75337) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 15:40:54 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:40:54 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:40:54 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 15:40:54 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:40:54 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2482b152-032e-57ba-a6f0-23c309d6ba94', '_type': 'linux-noop'}}, row=False) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:40:54 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:40:54 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:40:54 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:40:54 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd4ab286a-03, may_exist=True, interface_attrs={}) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:40:54 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd4ab286a-03, col_values=(('qos', UUID('4ee69721-bc90-49fa-8754-64449c83bde8')),), if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:40:54 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd4ab286a-03, col_values=(('external_ids', {'iface-id': 'd4ab286a-0327-4dde-8eda-1c63107a670a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:60:0c:0f', 'vm-uuid': 'd5dc789c-b1ee-4ee8-8e2b-9a6cb56a1361'}),), if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:40:54 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:40:54 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:40:54 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:40:54 user nova-compute[75337]: INFO os_vif [None req-cd149df5-1d51-4d71-b740-a65dae67bbba tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:0c:0f,bridge_name='br-int',has_traffic_filtering=True,id=d4ab286a-0327-4dde-8eda-1c63107a670a,network=Network(48f1545d-7e80-462f-9dbf-f1102ddcda9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4ab286a-03')
Nov 06 15:40:54 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-cd149df5-1d51-4d71-b740-a65dae67bbba tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] No BDM found with device name vda, not building metadata. {{(pid=75337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 15:40:54 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-cd149df5-1d51-4d71-b740-a65dae67bbba tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] No VIF found with MAC fa:16:3e:60:0c:0f, not building metadata {{(pid=75337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 15:40:54 user nova-compute[75337]: DEBUG nova.network.neutron [req-36346232-564e-4687-a430-b30af82135ae req-04bf86b4-477f-45da-8d07-1eff5c8961e6 service nova] [instance: d5dc789c-b1ee-4ee8-8e2b-9a6cb56a1361] Updated VIF entry in instance network info cache for port d4ab286a-0327-4dde-8eda-1c63107a670a. {{(pid=75337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 15:40:54 user nova-compute[75337]: DEBUG nova.network.neutron [req-36346232-564e-4687-a430-b30af82135ae req-04bf86b4-477f-45da-8d07-1eff5c8961e6 service nova] [instance: d5dc789c-b1ee-4ee8-8e2b-9a6cb56a1361] Updating instance_info_cache with network_info: [{"id": "d4ab286a-0327-4dde-8eda-1c63107a670a", "address": "fa:16:3e:60:0c:0f", "network": {"id": "48f1545d-7e80-462f-9dbf-f1102ddcda9a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1210368397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1013e7afbefd4146a3be04587710b1de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4ab286a-03", "ovs_interfaceid": "d4ab286a-0327-4dde-8eda-1c63107a670a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:40:54 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-36346232-564e-4687-a430-b30af82135ae req-04bf86b4-477f-45da-8d07-1eff5c8961e6 service nova] Releasing lock "refresh_cache-d5dc789c-b1ee-4ee8-8e2b-9a6cb56a1361" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 15:40:55 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-e564e478-8eb6-4725-a9bf-772b7b488d30 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Acquiring lock "1fa4c927-7485-4f34-94bd-9e20358904b6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:40:55 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-e564e478-8eb6-4725-a9bf-772b7b488d30 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Lock "1fa4c927-7485-4f34-94bd-9e20358904b6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:40:55 user nova-compute[75337]: DEBUG nova.compute.manager [None req-e564e478-8eb6-4725-a9bf-772b7b488d30 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: 1fa4c927-7485-4f34-94bd-9e20358904b6] Starting instance... {{(pid=75337) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 15:40:55 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-e564e478-8eb6-4725-a9bf-772b7b488d30 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:40:55 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-e564e478-8eb6-4725-a9bf-772b7b488d30 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:40:55 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-e564e478-8eb6-4725-a9bf-772b7b488d30 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75337) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 15:40:55 user nova-compute[75337]: INFO nova.compute.claims [None req-e564e478-8eb6-4725-a9bf-772b7b488d30 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: 1fa4c927-7485-4f34-94bd-9e20358904b6] Claim successful on node user
Nov 06 15:40:55 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-73be7bda-70dc-4eac-ac84-57f09df3de16 tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] [instance: 5f5fc58d-f946-4df0-b8d0-1aefbf0f8cd6] Calling os-brick to attach iSCSI Volume {{(pid=75337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 15:40:55 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-73be7bda-70dc-4eac-ac84-57f09df3de16 tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2abc33d0c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:af7490be-28c7-4ef3-917c-d05cd66f2acb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WnLRUSXv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 15:40:55 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-73be7bda-70dc-4eac-ac84-57f09df3de16 tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 15:40:55 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-73be7bda-70dc-4eac-ac84-57f09df3de16 tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 15:40:55 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-73be7bda-70dc-4eac-ac84-57f09df3de16 tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 15:40:55 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-73be7bda-70dc-4eac-ac84-57f09df3de16 tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 15:40:55 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-73be7bda-70dc-4eac-ac84-57f09df3de16 tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:af7490be-28c7-4ef3-917c-d05cd66f2acb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 15:40:55 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-73be7bda-70dc-4eac-ac84-57f09df3de16 tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:af7490be-28c7-4ef3-917c-d05cd66f2acb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 15:40:55 user nova-compute[75337]: INFO os_brick.initiator.connectors.iscsi [None req-73be7bda-70dc-4eac-ac84-57f09df3de16 tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 15:40:55 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af7490be-28c7-4ef3-917c-d05cd66f2acb -p 172.16.0.220:3260 {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:40:55 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af7490be-28c7-4ef3-917c-d05cd66f2acb -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:40:55 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ffa2b0c-7677-4d7b-96cb-5762527113fb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:40:55 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-73be7bda-70dc-4eac-ac84-57f09df3de16 tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 15:40:55 user nova-compute[75337]:  {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:40:55 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af7490be-28c7-4ef3-917c-d05cd66f2acb -p 172.16.0.220:3260 --interface default --op new {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:40:55 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af7490be-28c7-4ef3-917c-d05cd66f2acb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:40:55 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[4359b5be-ebd3-4983-b6c2-fc8e167b8751]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:af7490be-28c7-4ef3-917c-d05cd66f2acb] added\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:40:55 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-73be7bda-70dc-4eac-ac84-57f09df3de16 tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:af7490be-28c7-4ef3-917c-d05cd66f2acb] added
Nov 06 15:40:55 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:40:55 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af7490be-28c7-4ef3-917c-d05cd66f2acb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:40:55 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-e564e478-8eb6-4725-a9bf-772b7b488d30 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 15:40:55 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af7490be-28c7-4ef3-917c-d05cd66f2acb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:40:55 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[400cb1c9-75aa-47c3-8ea3-5426c2d2640b]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:40:55 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-73be7bda-70dc-4eac-ac84-57f09df3de16 tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:40:55 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af7490be-28c7-4ef3-917c-d05cd66f2acb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:40:55 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-e564e478-8eb6-4725-a9bf-772b7b488d30 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 15:40:55 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af7490be-28c7-4ef3-917c-d05cd66f2acb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:40:55 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[dda5cdd2-98f8-45e1-96a1-d4f1d55376c2]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:40:55 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-73be7bda-70dc-4eac-ac84-57f09df3de16 tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:40:55 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af7490be-28c7-4ef3-917c-d05cd66f2acb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WnLRUSXv {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:40:55 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af7490be-28c7-4ef3-917c-d05cd66f2acb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WnLRUSXv" returned: 0 in 0.017s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:40:55 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[17bbae04-91ad-4c9b-b38c-ac36e51897a9]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:40:55 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-73be7bda-70dc-4eac-ac84-57f09df3de16 tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WnLRUSXv'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:40:55 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af7490be-28c7-4ef3-917c-d05cd66f2acb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:40:55 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-e564e478-8eb6-4725-a9bf-772b7b488d30 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.463s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:40:55 user nova-compute[75337]: DEBUG nova.compute.manager [None req-e564e478-8eb6-4725-a9bf-772b7b488d30 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: 1fa4c927-7485-4f34-94bd-9e20358904b6] Start building networks asynchronously for instance. {{(pid=75337) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 15:40:55 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af7490be-28c7-4ef3-917c-d05cd66f2acb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:40:55 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[33c94523-2655-4f91-a2b2-8a86d875de79]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:40:55 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-73be7bda-70dc-4eac-ac84-57f09df3de16 tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:40:55 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:40:55 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-da2abdc2-9666-4d25-9521-afe912507438 tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] Lock "8858d90e-ee14-494b-80da-904cd97cdff0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 30.392s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:40:55 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:40:55 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[21f2559a-b748-4d2b-863c-6af57f1947f9]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd579072-cd8e-4ac1-8f84-1afda08a11da (non-flash)\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:40:55 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-73be7bda-70dc-4eac-ac84-57f09df3de16 tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759 (non-flash)
Nov 06 15:40:55 user nova-compute[75337]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd579072-cd8e-4ac1-8f84-1afda08a11da (non-flash)
Nov 06 15:40:55 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 15:40:55 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-73be7bda-70dc-4eac-ac84-57f09df3de16 tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759 (non-flash)
Nov 06 15:40:55 user nova-compute[75337]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd579072-cd8e-4ac1-8f84-1afda08a11da (non-flash)
Nov 06 15:40:55 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 15:40:55 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af7490be-28c7-4ef3-917c-d05cd66f2acb -p 172.16.0.220:3260 --login {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:40:55 user nova-compute[75337]: DEBUG nova.compute.manager [None req-e564e478-8eb6-4725-a9bf-772b7b488d30 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: 1fa4c927-7485-4f34-94bd-9e20358904b6] Allocating IP information in the background. {{(pid=75337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 15:40:55 user nova-compute[75337]: DEBUG nova.network.neutron [None req-e564e478-8eb6-4725-a9bf-772b7b488d30 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: 1fa4c927-7485-4f34-94bd-9e20358904b6] allocate_for_instance() {{(pid=75337) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 15:40:55 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-e564e478-8eb6-4725-a9bf-772b7b488d30 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: 1fa4c927-7485-4f34-94bd-9e20358904b6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 15:40:55 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af7490be-28c7-4ef3-917c-d05cd66f2acb -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:40:55 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[72633e7d-2b1d-4997-b804-e07924fbf554]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:af7490be-28c7-4ef3-917c-d05cd66f2acb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:af7490be-28c7-4ef3-917c-d05cd66f2acb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:40:55 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-73be7bda-70dc-4eac-ac84-57f09df3de16 tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:af7490be-28c7-4ef3-917c-d05cd66f2acb, portal: 172.16.0.220,3260]
Nov 06 15:40:55 user nova-compute[75337]: Login to [iface: default, target: iqn.2010-10.org.openstack:af7490be-28c7-4ef3-917c-d05cd66f2acb, portal: 172.16.0.220,3260] successful.
Nov 06 15:40:55 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:40:55 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af7490be-28c7-4ef3-917c-d05cd66f2acb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:40:55 user nova-compute[75337]: DEBUG nova.compute.manager [None req-e564e478-8eb6-4725-a9bf-772b7b488d30 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: 1fa4c927-7485-4f34-94bd-9e20358904b6] Start building block device mappings for instance. {{(pid=75337) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 15:40:55 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af7490be-28c7-4ef3-917c-d05cd66f2acb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:40:55 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd7a65f7-dc35-494e-a69b-89d2fdc3d574]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:40:55 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-73be7bda-70dc-4eac-ac84-57f09df3de16 tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:40:55 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:40:55 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:40:55 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2703ad3-2ef7-4931-b965-dab1e33374ce]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd579072-cd8e-4ac1-8f84-1afda08a11da (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af7490be-28c7-4ef3-917c-d05cd66f2acb (non-flash)\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:40:55 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-73be7bda-70dc-4eac-ac84-57f09df3de16 tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759 (non-flash)
Nov 06 15:40:55 user nova-compute[75337]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd579072-cd8e-4ac1-8f84-1afda08a11da (non-flash)
Nov 06 15:40:55 user nova-compute[75337]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af7490be-28c7-4ef3-917c-d05cd66f2acb (non-flash)
Nov 06 15:40:55 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 15:40:55 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-73be7bda-70dc-4eac-ac84-57f09df3de16 tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759 (non-flash)
Nov 06 15:40:55 user nova-compute[75337]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd579072-cd8e-4ac1-8f84-1afda08a11da (non-flash)
Nov 06 15:40:55 user nova-compute[75337]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af7490be-28c7-4ef3-917c-d05cd66f2acb (non-flash)
Nov 06 15:40:55 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 15:40:55 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-73be7bda-70dc-4eac-ac84-57f09df3de16 tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:af7490be-28c7-4ef3-917c-d05cd66f2acb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.302s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 15:40:55 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-73be7bda-70dc-4eac-ac84-57f09df3de16 tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] Connected to 172.16.0.220:3260 {{(pid=75337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 15:40:55 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-73be7bda-70dc-4eac-ac84-57f09df3de16 tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=75337) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 15:40:55 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-73be7bda-70dc-4eac-ac84-57f09df3de16 tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75337) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 15:40:55 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:40:55 user nova-compute[75337]: INFO nova.virt.block_device [None req-e564e478-8eb6-4725-a9bf-772b7b488d30 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: 1fa4c927-7485-4f34-94bd-9e20358904b6] Booting with blank volume at /dev/vda
Nov 06 15:40:55 user nova-compute[75337]: DEBUG nova.policy [None req-e564e478-8eb6-4725-a9bf-772b7b488d30 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '74090d6e5b354d79bf6ded92e6de56aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb76b5b0f2b24f1c84a92403176bcc00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75337) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 15:40:55 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.031s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:40:55 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fc4536e-dece-423b-bad7-4e3e2457d76e]: (4, ('- - 0', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:40:55 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-73be7bda-70dc-4eac-ac84-57f09df3de16 tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75337) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 15:40:55 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-73be7bda-70dc-4eac-ac84-57f09df3de16 tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:af7490be-28c7-4ef3-917c-d05cd66f2acb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WnLRUSXv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 15:40:55 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:40:55 user nova-compute[75337]: INFO nova.virt.block_device [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Booting with volume eaf5fc54-be7c-4748-9e2f-12a01971e6f4 at /dev/vdc
Nov 06 15:40:56 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:40:56 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:40:56 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:40:56 user nova-compute[75337]: DEBUG nova.compute.manager [req-b08cd04d-8b80-4cae-a1b7-c9d5ed5425c8 req-e6325658-6597-4328-b375-b3ae28bf10c7 service nova] [instance: d5dc789c-b1ee-4ee8-8e2b-9a6cb56a1361] Received event network-vif-plugged-d4ab286a-0327-4dde-8eda-1c63107a670a {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:40:56 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-b08cd04d-8b80-4cae-a1b7-c9d5ed5425c8 req-e6325658-6597-4328-b375-b3ae28bf10c7 service nova] Acquiring lock "d5dc789c-b1ee-4ee8-8e2b-9a6cb56a1361-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:40:56 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-b08cd04d-8b80-4cae-a1b7-c9d5ed5425c8 req-e6325658-6597-4328-b375-b3ae28bf10c7 service nova] Lock "d5dc789c-b1ee-4ee8-8e2b-9a6cb56a1361-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:40:56 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-b08cd04d-8b80-4cae-a1b7-c9d5ed5425c8 req-e6325658-6597-4328-b375-b3ae28bf10c7 service nova] Lock "d5dc789c-b1ee-4ee8-8e2b-9a6cb56a1361-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:40:56 user nova-compute[75337]: DEBUG nova.compute.manager [req-b08cd04d-8b80-4cae-a1b7-c9d5ed5425c8 req-e6325658-6597-4328-b375-b3ae28bf10c7 service nova] [instance: d5dc789c-b1ee-4ee8-8e2b-9a6cb56a1361] No waiting events found dispatching network-vif-plugged-d4ab286a-0327-4dde-8eda-1c63107a670a {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:40:56 user nova-compute[75337]: WARNING nova.compute.manager [req-b08cd04d-8b80-4cae-a1b7-c9d5ed5425c8 req-e6325658-6597-4328-b375-b3ae28bf10c7 service nova] [instance: d5dc789c-b1ee-4ee8-8e2b-9a6cb56a1361] Received unexpected event network-vif-plugged-d4ab286a-0327-4dde-8eda-1c63107a670a for instance with vm_state building and task_state spawning.
Nov 06 15:40:56 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:40:56 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:40:56 user nova-compute[75337]: DEBUG nova.network.neutron [None req-e564e478-8eb6-4725-a9bf-772b7b488d30 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: 1fa4c927-7485-4f34-94bd-9e20358904b6] Successfully created port: 3812cc74-01db-4b2b-815c-770420051e1b {{(pid=75337) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 15:40:56 user nova-compute[75337]: DEBUG os_brick.utils [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 15:40:56 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:40:56 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:40:56 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0223a38-991c-4f72-a9bb-e82d40043255]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4ff6411e45b8\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:40:56 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:40:56 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:40:56 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[99608e92-f2f7-429f-9bf5-fb68094c25fb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:40:56 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:40:56 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:40:56 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa85bde4-32bc-4336-a579-1dc5a8986902]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:40:56 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[3558a717-783c-49b1-8ab3-abd5fc31e86e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:40:56 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Running cmd (subprocess): nvme version {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:40:56 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] 'nvme version' failed. Not Retrying. {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 15:40:56 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] nvme not present on system {{(pid=75337) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 15:40:56 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:40:56 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 15:40:56 user nova-compute[75337]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 15:40:56 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[a547bf8d-c658-416a-9c8a-0d2c428ef491]: (4, '') {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:40:56 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.lightos [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75337) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 15:40:56 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.lightos [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 15:40:56 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.lightos [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] LIGHTOS: no hostnqn found. {{(pid=75337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 15:40:56 user nova-compute[75337]: DEBUG os_brick.utils [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4ff6411e45b8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 15:40:56 user nova-compute[75337]: DEBUG nova.virt.block_device [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Updating existing volume attachment record: 2757d6ff-7f0c-4d70-8eba-66c2b33b1ea2 {{(pid=75337) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 15:40:56 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-73be7bda-70dc-4eac-ac84-57f09df3de16 tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.367s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 15:40:56 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-73be7bda-70dc-4eac-ac84-57f09df3de16 tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] <== connect_volume: return (1369ms) {'type': 'block', 'scsi_wwn': '26665333362333061', 'path': '/dev/sdd'} {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 15:40:56 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-73be7bda-70dc-4eac-ac84-57f09df3de16 tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] [instance: 5f5fc58d-f946-4df0-b8d0-1aefbf0f8cd6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26665333362333061', 'path': '/dev/sdd'} {{(pid=75337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 15:40:56 user nova-compute[75337]: DEBUG nova.objects.instance [None req-73be7bda-70dc-4eac-ac84-57f09df3de16 tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] Lazy-loading 'flavor' on Instance uuid 5f5fc58d-f946-4df0-b8d0-1aefbf0f8cd6 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 15:40:56 user nova-compute[75337]: DEBUG nova.virt.libvirt.guest [None req-73be7bda-70dc-4eac-ac84-57f09df3de16 tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] attach device xml: <disk type="block" device="disk">
Nov 06 15:40:56 user nova-compute[75337]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 15:40:56 user nova-compute[75337]:   <source dev="/dev/sdd"/>
Nov 06 15:40:56 user nova-compute[75337]:   <target dev="vdb" bus="virtio"/>
Nov 06 15:40:56 user nova-compute[75337]:   <serial>af7490be-28c7-4ef3-917c-d05cd66f2acb</serial>
Nov 06 15:40:56 user nova-compute[75337]: </disk>
Nov 06 15:40:56 user nova-compute[75337]:  {{(pid=75337) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 06 15:40:57 user nova-compute[75337]: DEBUG nova.network.neutron [None req-e564e478-8eb6-4725-a9bf-772b7b488d30 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: 1fa4c927-7485-4f34-94bd-9e20358904b6] Successfully updated port: 3812cc74-01db-4b2b-815c-770420051e1b {{(pid=75337) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 15:40:57 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-e564e478-8eb6-4725-a9bf-772b7b488d30 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Acquiring lock "refresh_cache-1fa4c927-7485-4f34-94bd-9e20358904b6" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 15:40:57 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-e564e478-8eb6-4725-a9bf-772b7b488d30 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Acquired lock "refresh_cache-1fa4c927-7485-4f34-94bd-9e20358904b6" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 15:40:57 user nova-compute[75337]: DEBUG nova.network.neutron [None req-e564e478-8eb6-4725-a9bf-772b7b488d30 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: 1fa4c927-7485-4f34-94bd-9e20358904b6] Building network info cache for instance {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 15:40:57 user nova-compute[75337]: DEBUG nova.compute.manager [req-d25fb2a6-defb-485f-8a45-725c72cdb145 req-6b4cd324-8477-48fd-8acd-84218b237656 service nova] [instance: 1fa4c927-7485-4f34-94bd-9e20358904b6] Received event network-changed-3812cc74-01db-4b2b-815c-770420051e1b {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:40:57 user nova-compute[75337]: DEBUG nova.compute.manager [req-d25fb2a6-defb-485f-8a45-725c72cdb145 req-6b4cd324-8477-48fd-8acd-84218b237656 service nova] [instance: 1fa4c927-7485-4f34-94bd-9e20358904b6] Refreshing instance network info cache due to event network-changed-3812cc74-01db-4b2b-815c-770420051e1b. {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 15:40:57 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-d25fb2a6-defb-485f-8a45-725c72cdb145 req-6b4cd324-8477-48fd-8acd-84218b237656 service nova] Acquiring lock "refresh_cache-1fa4c927-7485-4f34-94bd-9e20358904b6" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 15:40:57 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-73be7bda-70dc-4eac-ac84-57f09df3de16 tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] No BDM found with device name vda, not building metadata. {{(pid=75337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 15:40:57 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-73be7bda-70dc-4eac-ac84-57f09df3de16 tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 15:40:57 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-73be7bda-70dc-4eac-ac84-57f09df3de16 tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] No VIF found with MAC fa:16:3e:f7:8a:4e, not building metadata {{(pid=75337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 15:40:57 user nova-compute[75337]: DEBUG nova.network.neutron [None req-e564e478-8eb6-4725-a9bf-772b7b488d30 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: 1fa4c927-7485-4f34-94bd-9e20358904b6] Instance cache missing network info. {{(pid=75337) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 15:40:57 user nova-compute[75337]: DEBUG nova.network.neutron [None req-e564e478-8eb6-4725-a9bf-772b7b488d30 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: 1fa4c927-7485-4f34-94bd-9e20358904b6] Updating instance_info_cache with network_info: [{"id": "3812cc74-01db-4b2b-815c-770420051e1b", "address": "fa:16:3e:f4:aa:7b", "network": {"id": "736be000-ee94-41fd-9de0-f2f885ec9be7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1715443852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb76b5b0f2b24f1c84a92403176bcc00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3812cc74-01", "ovs_interfaceid": "3812cc74-01db-4b2b-815c-770420051e1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:40:57 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-e564e478-8eb6-4725-a9bf-772b7b488d30 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Releasing lock "refresh_cache-1fa4c927-7485-4f34-94bd-9e20358904b6" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 15:40:57 user nova-compute[75337]: DEBUG nova.compute.manager [None req-e564e478-8eb6-4725-a9bf-772b7b488d30 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: 1fa4c927-7485-4f34-94bd-9e20358904b6] Instance network_info: |[{"id": "3812cc74-01db-4b2b-815c-770420051e1b", "address": "fa:16:3e:f4:aa:7b", "network": {"id": "736be000-ee94-41fd-9de0-f2f885ec9be7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1715443852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb76b5b0f2b24f1c84a92403176bcc00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3812cc74-01", "ovs_interfaceid": "3812cc74-01db-4b2b-815c-770420051e1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 15:40:57 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-d25fb2a6-defb-485f-8a45-725c72cdb145 req-6b4cd324-8477-48fd-8acd-84218b237656 service nova] Acquired lock "refresh_cache-1fa4c927-7485-4f34-94bd-9e20358904b6" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 15:40:57 user nova-compute[75337]: DEBUG nova.network.neutron [req-d25fb2a6-defb-485f-8a45-725c72cdb145 req-6b4cd324-8477-48fd-8acd-84218b237656 service nova] [instance: 1fa4c927-7485-4f34-94bd-9e20358904b6] Refreshing network info cache for port 3812cc74-01db-4b2b-815c-770420051e1b {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 15:40:58 user nova-compute[75337]: DEBUG nova.network.neutron [req-d25fb2a6-defb-485f-8a45-725c72cdb145 req-6b4cd324-8477-48fd-8acd-84218b237656 service nova] [instance: 1fa4c927-7485-4f34-94bd-9e20358904b6] Updated VIF entry in instance network info cache for port 3812cc74-01db-4b2b-815c-770420051e1b. {{(pid=75337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 15:40:58 user nova-compute[75337]: DEBUG nova.network.neutron [req-d25fb2a6-defb-485f-8a45-725c72cdb145 req-6b4cd324-8477-48fd-8acd-84218b237656 service nova] [instance: 1fa4c927-7485-4f34-94bd-9e20358904b6] Updating instance_info_cache with network_info: [{"id": "3812cc74-01db-4b2b-815c-770420051e1b", "address": "fa:16:3e:f4:aa:7b", "network": {"id": "736be000-ee94-41fd-9de0-f2f885ec9be7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1715443852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb76b5b0f2b24f1c84a92403176bcc00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3812cc74-01", "ovs_interfaceid": "3812cc74-01db-4b2b-815c-770420051e1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:40:58 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-d25fb2a6-defb-485f-8a45-725c72cdb145 req-6b4cd324-8477-48fd-8acd-84218b237656 service nova] Releasing lock "refresh_cache-1fa4c927-7485-4f34-94bd-9e20358904b6" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 15:40:58 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:40:58 user nova-compute[75337]: DEBUG nova.compute.manager [req-a9f4c50a-e25e-4312-9c4d-a39a3c2dd77a req-1360fe71-cb66-4661-b78c-be6150551499 service nova] [instance: d5dc789c-b1ee-4ee8-8e2b-9a6cb56a1361] Received event network-vif-plugged-d4ab286a-0327-4dde-8eda-1c63107a670a {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:40:58 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-a9f4c50a-e25e-4312-9c4d-a39a3c2dd77a req-1360fe71-cb66-4661-b78c-be6150551499 service nova] Acquiring lock "d5dc789c-b1ee-4ee8-8e2b-9a6cb56a1361-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:40:58 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-a9f4c50a-e25e-4312-9c4d-a39a3c2dd77a req-1360fe71-cb66-4661-b78c-be6150551499 service nova] Lock "d5dc789c-b1ee-4ee8-8e2b-9a6cb56a1361-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:40:58 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-a9f4c50a-e25e-4312-9c4d-a39a3c2dd77a req-1360fe71-cb66-4661-b78c-be6150551499 service nova] Lock "d5dc789c-b1ee-4ee8-8e2b-9a6cb56a1361-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:40:58 user nova-compute[75337]: DEBUG nova.compute.manager [req-a9f4c50a-e25e-4312-9c4d-a39a3c2dd77a req-1360fe71-cb66-4661-b78c-be6150551499 service nova] [instance: d5dc789c-b1ee-4ee8-8e2b-9a6cb56a1361] No waiting events found dispatching network-vif-plugged-d4ab286a-0327-4dde-8eda-1c63107a670a {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:40:58 user nova-compute[75337]: WARNING nova.compute.manager [req-a9f4c50a-e25e-4312-9c4d-a39a3c2dd77a req-1360fe71-cb66-4661-b78c-be6150551499 service nova] [instance: d5dc789c-b1ee-4ee8-8e2b-9a6cb56a1361] Received unexpected event network-vif-plugged-d4ab286a-0327-4dde-8eda-1c63107a670a for instance with vm_state building and task_state spawning.
Nov 06 15:40:58 user nova-compute[75337]: DEBUG nova.compute.manager [None req-cd149df5-1d51-4d71-b740-a65dae67bbba tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] [instance: d5dc789c-b1ee-4ee8-8e2b-9a6cb56a1361] Instance event wait completed in 0 seconds for  {{(pid=75337) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 15:40:58 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-cd149df5-1d51-4d71-b740-a65dae67bbba tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] [instance: d5dc789c-b1ee-4ee8-8e2b-9a6cb56a1361] Guest created on hypervisor {{(pid=75337) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 15:40:58 user nova-compute[75337]: INFO nova.virt.libvirt.driver [-] [instance: d5dc789c-b1ee-4ee8-8e2b-9a6cb56a1361] Instance spawned successfully.
Nov 06 15:40:58 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-cd149df5-1d51-4d71-b740-a65dae67bbba tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] [instance: d5dc789c-b1ee-4ee8-8e2b-9a6cb56a1361] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 15:40:58 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-cd149df5-1d51-4d71-b740-a65dae67bbba tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] [instance: d5dc789c-b1ee-4ee8-8e2b-9a6cb56a1361] Found default for hw_cdrom_bus of ide {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:40:58 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-cd149df5-1d51-4d71-b740-a65dae67bbba tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] [instance: d5dc789c-b1ee-4ee8-8e2b-9a6cb56a1361] Found default for hw_disk_bus of virtio {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:40:58 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-cd149df5-1d51-4d71-b740-a65dae67bbba tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] [instance: d5dc789c-b1ee-4ee8-8e2b-9a6cb56a1361] Found default for hw_input_bus of None {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:40:58 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-cd149df5-1d51-4d71-b740-a65dae67bbba tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] [instance: d5dc789c-b1ee-4ee8-8e2b-9a6cb56a1361] Found default for hw_pointer_model of None {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:40:58 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-cd149df5-1d51-4d71-b740-a65dae67bbba tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] [instance: d5dc789c-b1ee-4ee8-8e2b-9a6cb56a1361] Found default for hw_video_model of virtio {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:40:58 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-cd149df5-1d51-4d71-b740-a65dae67bbba tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] [instance: d5dc789c-b1ee-4ee8-8e2b-9a6cb56a1361] Found default for hw_vif_model of virtio {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:40:58 user nova-compute[75337]: INFO nova.compute.manager [None req-cd149df5-1d51-4d71-b740-a65dae67bbba tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] [instance: d5dc789c-b1ee-4ee8-8e2b-9a6cb56a1361] Took 5.85 seconds to spawn the instance on the hypervisor.
Nov 06 15:40:58 user nova-compute[75337]: DEBUG nova.compute.manager [None req-cd149df5-1d51-4d71-b740-a65dae67bbba tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] [instance: d5dc789c-b1ee-4ee8-8e2b-9a6cb56a1361] Checking state {{(pid=75337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 15:40:58 user nova-compute[75337]: INFO nova.compute.manager [None req-cd149df5-1d51-4d71-b740-a65dae67bbba tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] [instance: d5dc789c-b1ee-4ee8-8e2b-9a6cb56a1361] Took 7.08 seconds to build instance.
Nov 06 15:40:58 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-cd149df5-1d51-4d71-b740-a65dae67bbba tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Lock "d5dc789c-b1ee-4ee8-8e2b-9a6cb56a1361" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.187s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:40:59 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:41:01 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:41:01 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:41:01 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Starting heal instance info cache {{(pid=75337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 15:41:01 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "refresh_cache-c8cf1ead-a87c-459c-b914-a0e976c9e464" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 15:41:01 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquired lock "refresh_cache-c8cf1ead-a87c-459c-b914-a0e976c9e464" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 15:41:01 user nova-compute[75337]: DEBUG nova.network.neutron [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] [instance: c8cf1ead-a87c-459c-b914-a0e976c9e464] Forcefully refreshing network info cache for instance {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 15:41:01 user nova-compute[75337]: DEBUG nova.network.neutron [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] [instance: c8cf1ead-a87c-459c-b914-a0e976c9e464] Updating instance_info_cache with network_info: [{"id": "b33373f6-0289-4623-90ac-f5c3db0d3681", "address": "fa:16:3e:37:16:66", "network": {"id": "a839a9d1-fdf3-4a72-898b-6829ceef2055", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1927950273-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86f4b41336384a53a3fd22caa0fe8e6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb33373f6-02", "ovs_interfaceid": "b33373f6-0289-4623-90ac-f5c3db0d3681", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:41:01 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Releasing lock "refresh_cache-c8cf1ead-a87c-459c-b914-a0e976c9e464" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 15:41:01 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] [instance: c8cf1ead-a87c-459c-b914-a0e976c9e464] Updated the network info_cache for instance {{(pid=75337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 15:41:01 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:41:01 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:41:01 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:41:01 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:41:01 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:41:01 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:41:01 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75337) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 15:41:01 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager.update_available_resource {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:41:01 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:41:01 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:41:01 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:41:01 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Auditing locally available compute resources for user (node: user) {{(pid=75337) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 15:41:01 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f5fc58d-f946-4df0-b8d0-1aefbf0f8cd6/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:41:02 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f5fc58d-f946-4df0-b8d0-1aefbf0f8cd6/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:41:02 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f5fc58d-f946-4df0-b8d0-1aefbf0f8cd6/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:41:02 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f5fc58d-f946-4df0-b8d0-1aefbf0f8cd6/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:41:02 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 15:41:02 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/581cf468-65e7-42e5-9250-c3d645577011/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:41:02 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/581cf468-65e7-42e5-9250-c3d645577011/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:41:02 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/581cf468-65e7-42e5-9250-c3d645577011/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:41:02 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/581cf468-65e7-42e5-9250-c3d645577011/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:41:02 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8cf1ead-a87c-459c-b914-a0e976c9e464/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:41:02 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8cf1ead-a87c-459c-b914-a0e976c9e464/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:41:02 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8cf1ead-a87c-459c-b914-a0e976c9e464/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:41:03 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8cf1ead-a87c-459c-b914-a0e976c9e464/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:41:03 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76ee582b-b887-4d46-8c78-29f42d1a0d26/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:41:03 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76ee582b-b887-4d46-8c78-29f42d1a0d26/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:41:03 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76ee582b-b887-4d46-8c78-29f42d1a0d26/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:41:03 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76ee582b-b887-4d46-8c78-29f42d1a0d26/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:41:03 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfadb21f-5ed1-42f4-956b-95cccf128b6a/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:41:03 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfadb21f-5ed1-42f4-956b-95cccf128b6a/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:41:03 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfadb21f-5ed1-42f4-956b-95cccf128b6a/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:41:03 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfadb21f-5ed1-42f4-956b-95cccf128b6a/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:41:03 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 15:41:03 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:41:04 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:41:04 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:41:04 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:41:04 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8858d90e-ee14-494b-80da-904cd97cdff0/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:41:04 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:41:04 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8858d90e-ee14-494b-80da-904cd97cdff0/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:41:04 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8858d90e-ee14-494b-80da-904cd97cdff0/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:41:04 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8858d90e-ee14-494b-80da-904cd97cdff0/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:41:04 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] skipping disk /dev/sdc (sdc) as it is a volume {{(pid=75337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 15:41:04 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5dc789c-b1ee-4ee8-8e2b-9a6cb56a1361/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:41:04 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5dc789c-b1ee-4ee8-8e2b-9a6cb56a1361/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:41:05 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5dc789c-b1ee-4ee8-8e2b-9a6cb56a1361/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:41:05 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5dc789c-b1ee-4ee8-8e2b-9a6cb56a1361/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:41:05 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83516ff5-c4e7-4e91-a2f9-8af9b51cf475/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:41:05 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83516ff5-c4e7-4e91-a2f9-8af9b51cf475/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:41:05 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83516ff5-c4e7-4e91-a2f9-8af9b51cf475/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:41:05 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83516ff5-c4e7-4e91-a2f9-8af9b51cf475/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:41:06 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 15:41:06 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 15:41:06 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Hypervisor/Node resource view: name=user free_ram=7738MB free_disk=25.35400390625GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75337) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 15:41:06 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:41:06 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:41:06 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 83516ff5-c4e7-4e91-a2f9-8af9b51cf475 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:41:06 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 5f5fc58d-f946-4df0-b8d0-1aefbf0f8cd6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:41:06 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance c8cf1ead-a87c-459c-b914-a0e976c9e464 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:41:06 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 581cf468-65e7-42e5-9250-c3d645577011 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:41:06 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance dfadb21f-5ed1-42f4-956b-95cccf128b6a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:41:06 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 8858d90e-ee14-494b-80da-904cd97cdff0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:41:06 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:41:06 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 76ee582b-b887-4d46-8c78-29f42d1a0d26 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:41:06 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:41:06 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance d5dc789c-b1ee-4ee8-8e2b-9a6cb56a1361 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:41:06 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 1fa4c927-7485-4f34-94bd-9e20358904b6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:41:06 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 15:41:06 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 15:41:06 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 15:41:06 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 15:41:06 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Compute_service record updated for user:user {{(pid=75337) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 15:41:06 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.611s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:41:08 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:41:09 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:41:13 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:41:14 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:41:18 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:41:19 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:41:23 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:41:24 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:41:28 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:41:29 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:41:34 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:41:37 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63ebe34e-cad7-4ec6-a330-91445d555772 tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] [instance: 76ee582b-b887-4d46-8c78-29f42d1a0d26] Calling os-brick to attach iSCSI Volume {{(pid=75337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 15:41:37 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-63ebe34e-cad7-4ec6-a330-91445d555772 tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2abc33d0c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:dccaff76-b907-4a00-b34d-bb5ae7655a02', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HRrhEMiY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 15:41:37 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-63ebe34e-cad7-4ec6-a330-91445d555772 tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 15:41:37 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-63ebe34e-cad7-4ec6-a330-91445d555772 tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 15:41:37 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-63ebe34e-cad7-4ec6-a330-91445d555772 tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 15:41:37 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-63ebe34e-cad7-4ec6-a330-91445d555772 tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 15:41:37 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-63ebe34e-cad7-4ec6-a330-91445d555772 tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dccaff76-b907-4a00-b34d-bb5ae7655a02" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 15:41:37 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-63ebe34e-cad7-4ec6-a330-91445d555772 tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dccaff76-b907-4a00-b34d-bb5ae7655a02" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 15:41:37 user nova-compute[75337]: INFO os_brick.initiator.connectors.iscsi [None req-63ebe34e-cad7-4ec6-a330-91445d555772 tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 15:41:37 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dccaff76-b907-4a00-b34d-bb5ae7655a02 -p 172.16.0.220:3260 {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:41:37 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dccaff76-b907-4a00-b34d-bb5ae7655a02 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:41:37 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[6573b24c-4f22-4066-b829-6e1b4e7eadf2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:41:37 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-63ebe34e-cad7-4ec6-a330-91445d555772 tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 15:41:37 user nova-compute[75337]:  {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:41:37 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dccaff76-b907-4a00-b34d-bb5ae7655a02 -p 172.16.0.220:3260 --interface default --op new {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:41:37 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dccaff76-b907-4a00-b34d-bb5ae7655a02 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:41:37 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[8571c317-d342-4870-898f-9ee541184c51]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dccaff76-b907-4a00-b34d-bb5ae7655a02] added\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:41:37 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-63ebe34e-cad7-4ec6-a330-91445d555772 tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dccaff76-b907-4a00-b34d-bb5ae7655a02] added
Nov 06 15:41:37 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:41:37 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dccaff76-b907-4a00-b34d-bb5ae7655a02 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:41:37 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dccaff76-b907-4a00-b34d-bb5ae7655a02 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:41:37 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[1822c17e-cf3d-4ce7-9e01-69ddf4fa8dbe]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:41:37 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-63ebe34e-cad7-4ec6-a330-91445d555772 tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:41:37 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dccaff76-b907-4a00-b34d-bb5ae7655a02 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:41:37 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dccaff76-b907-4a00-b34d-bb5ae7655a02 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:41:37 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[42ba78f0-fc23-4ecc-b414-8d2b4fb1b54e]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:41:37 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-63ebe34e-cad7-4ec6-a330-91445d555772 tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:41:37 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dccaff76-b907-4a00-b34d-bb5ae7655a02 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HRrhEMiY {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:41:37 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dccaff76-b907-4a00-b34d-bb5ae7655a02 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HRrhEMiY" returned: 0 in 0.019s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:41:37 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd429df7-8555-49b1-9faa-827a1941afcf]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:41:37 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-63ebe34e-cad7-4ec6-a330-91445d555772 tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HRrhEMiY'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:41:37 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dccaff76-b907-4a00-b34d-bb5ae7655a02 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:41:37 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dccaff76-b907-4a00-b34d-bb5ae7655a02 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.030s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:41:37 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9c19a78-70b5-4b4f-a969-ad308d834f87]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:41:37 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-63ebe34e-cad7-4ec6-a330-91445d555772 tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:41:37 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:41:37 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:41:37 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6d1816d-cee5-4a9e-b026-cbed60981f2b]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd579072-cd8e-4ac1-8f84-1afda08a11da (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af7490be-28c7-4ef3-917c-d05cd66f2acb (non-flash)\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:41:37 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-63ebe34e-cad7-4ec6-a330-91445d555772 tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759 (non-flash)
Nov 06 15:41:37 user nova-compute[75337]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd579072-cd8e-4ac1-8f84-1afda08a11da (non-flash)
Nov 06 15:41:37 user nova-compute[75337]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af7490be-28c7-4ef3-917c-d05cd66f2acb (non-flash)
Nov 06 15:41:37 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 15:41:37 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-63ebe34e-cad7-4ec6-a330-91445d555772 tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759 (non-flash)
Nov 06 15:41:37 user nova-compute[75337]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd579072-cd8e-4ac1-8f84-1afda08a11da (non-flash)
Nov 06 15:41:37 user nova-compute[75337]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af7490be-28c7-4ef3-917c-d05cd66f2acb (non-flash)
Nov 06 15:41:37 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 15:41:37 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-73be7bda-70dc-4eac-ac84-57f09df3de16 tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] Lock "5f5fc58d-f946-4df0-b8d0-1aefbf0f8cd6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 103.154s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:41:37 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dccaff76-b907-4a00-b34d-bb5ae7655a02 -p 172.16.0.220:3260 --login {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:41:38 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dccaff76-b907-4a00-b34d-bb5ae7655a02 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:41:38 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[5820798b-c456-4d34-92d3-185d2bb3633e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:dccaff76-b907-4a00-b34d-bb5ae7655a02, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:dccaff76-b907-4a00-b34d-bb5ae7655a02, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:41:38 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-63ebe34e-cad7-4ec6-a330-91445d555772 tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:dccaff76-b907-4a00-b34d-bb5ae7655a02, portal: 172.16.0.220,3260]
Nov 06 15:41:38 user nova-compute[75337]: Login to [iface: default, target: iqn.2010-10.org.openstack:dccaff76-b907-4a00-b34d-bb5ae7655a02, portal: 172.16.0.220,3260] successful.
Nov 06 15:41:38 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:41:38 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dccaff76-b907-4a00-b34d-bb5ae7655a02 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:41:38 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dccaff76-b907-4a00-b34d-bb5ae7655a02 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:41:38 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[67a3ebfe-5267-45c5-8834-0bb102dbb645]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:41:38 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-63ebe34e-cad7-4ec6-a330-91445d555772 tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:41:38 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:41:38 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:41:38 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[4522cf59-ef1d-4016-bd08-dfc80dce05d3]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd579072-cd8e-4ac1-8f84-1afda08a11da (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af7490be-28c7-4ef3-917c-d05cd66f2acb (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dccaff76-b907-4a00-b34d-bb5ae7655a02 (non-flash)\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:41:38 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-63ebe34e-cad7-4ec6-a330-91445d555772 tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759 (non-flash)
Nov 06 15:41:38 user nova-compute[75337]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd579072-cd8e-4ac1-8f84-1afda08a11da (non-flash)
Nov 06 15:41:38 user nova-compute[75337]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af7490be-28c7-4ef3-917c-d05cd66f2acb (non-flash)
Nov 06 15:41:38 user nova-compute[75337]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dccaff76-b907-4a00-b34d-bb5ae7655a02 (non-flash)
Nov 06 15:41:38 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 15:41:38 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-63ebe34e-cad7-4ec6-a330-91445d555772 tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759 (non-flash)
Nov 06 15:41:38 user nova-compute[75337]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd579072-cd8e-4ac1-8f84-1afda08a11da (non-flash)
Nov 06 15:41:38 user nova-compute[75337]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af7490be-28c7-4ef3-917c-d05cd66f2acb (non-flash)
Nov 06 15:41:38 user nova-compute[75337]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dccaff76-b907-4a00-b34d-bb5ae7655a02 (non-flash)
Nov 06 15:41:38 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 15:41:38 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-63ebe34e-cad7-4ec6-a330-91445d555772 tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dccaff76-b907-4a00-b34d-bb5ae7655a02" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.327s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 15:41:38 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-63ebe34e-cad7-4ec6-a330-91445d555772 tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] Connected to 172.16.0.220:3260 {{(pid=75337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 15:41:38 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-63ebe34e-cad7-4ec6-a330-91445d555772 tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=75337) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 15:41:38 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-63ebe34e-cad7-4ec6-a330-91445d555772 tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75337) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 15:41:38 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:41:38 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.021s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:41:38 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[11b87741-6279-4a3b-b8e2-4515472e9063]: (4, ('- - 0', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:41:38 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-63ebe34e-cad7-4ec6-a330-91445d555772 tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75337) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 15:41:38 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-63ebe34e-cad7-4ec6-a330-91445d555772 tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:dccaff76-b907-4a00-b34d-bb5ae7655a02', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HRrhEMiY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 15:41:38 user nova-compute[75337]: DEBUG nova.compute.manager [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Start spawning the instance on the hypervisor. {{(pid=75337) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 15:41:38 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Creating instance directory {{(pid=75337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 15:41:38 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Creating image(s)
Nov 06 15:41:38 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Did not create local disks {{(pid=75337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 06 15:41:38 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Ensure instance console log exists: /opt/stack/data/nova/instances/67d9ceff-c1fc-48ad-85c8-3aa37ebabf11/console.log {{(pid=75337) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 15:41:38 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:41:38 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:41:38 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:41:38 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Start _get_guest_xml network_info=[{"id": "5d25f565-70a5-427c-a198-4f88dd8b7338", "address": "fa:16:3e:39:62:9f", "network": {"id": "4b3a9463-7120-499a-bdef-bd2ce9443d88", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1482718546-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "664f419c1b904bb3bdd7aff9e621e2e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d25f565-70", "ovs_interfaceid": "5d25f565-70a5-427c-a198-4f88dd8b7338", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ac99553f-c5d8-46df-8357-f1f7f189fa22", "address": "fa:16:3e:37:11:e5", "network": {"id": "793579d8-5696-4c41-b09e-19e19908b703", "bridge": "br-int", "label": "tempest-device-tagging-net1-1052173633", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.61", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "664f419c1b904bb3bdd7aff9e621e2e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac99553f-c5", "ovs_interfaceid": "ac99553f-c5d8-46df-8357-f1f7f189fa22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "abf73a6f-c3c7-46b5-8a9b-0fce5677fa27", "address": "fa:16:3e:68:66:1c", "network": {"id": "793579d8-5696-4c41-b09e-19e19908b703", "bridge": "br-int", "label": "tempest-device-tagging-net1-1052173633", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.239", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "664f419c1b904bb3bdd7aff9e621e2e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabf73a6f-c3", "ovs_interfaceid": "abf73a6f-c3c7-46b5-8a9b-0fce5677fa27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e87c0766-dd71-4aca-b5f0-32888c7437f5", "address": "fa:16:3e:b5:06:33", "network": {"id": "793579d8-5696-4c41-b09e-19e19908b703", "bridge": "br-int", "label": "tempest-device-tagging-net1-1052173633", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "664f419c1b904bb3bdd7aff9e621e2e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape87c0766-dd", "ovs_interfaceid": "e87c0766-dd71-4aca-b5f0-32888c7437f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ba50db67-9fb0-49ef-9ea2-db9014b66b17", "address": "fa:16:3e:1a:f9:b0", "network": {"id": "793579d8-5696-4c41-b09e-19e19908b703", "bridge": "br-int", "label": "tempest-device-tagging-net1-1052173633", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "664f419c1b904bb3bdd7aff9e621e2e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba50db67-9f", "ovs_interfaceid": "ba50db67-9fb0-49ef-9ea2-db9014b66b17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e6be4a87-8794-4e4f-91c1-3c417e0c8d62", "address": "fa:16:3e:df:a8:14", "network": {"id": "512e1b59-3c5a-4be6-bf3d-2ee51ce2042a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1219094622", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "664f419c1b904bb3bdd7aff9e621e2e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6be4a87-87", "ovs_interfaceid": "e6be4a87-8794-4e4f-91c1-3c417e0c8d62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "94df5f62-239e-4b8e-a91d-5223c1585f6f", "address": "fa:16:3e:03:8e:66", "network": {"id": "512e1b59-3c5a-4be6-bf3d-2ee51ce2042a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1219094622", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "664f419c1b904bb3bdd7aff9e621e2e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94df5f62-23", "ovs_interfaceid": "94df5f62-239e-4b8e-a91d-5223c1585f6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T15:34:14Z,direct_url=<?>,disk_format='qcow2',id=16b903ae-a40f-41a7-985b-4804cce92c62,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6549a15819f1469bbd5eeae8190e3d44',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T15:34:15Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'attachment_id': '6239d0e4-fd56-4c97-aae8-64f7c2bd5315', 'guest_format': None, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4367fb98-2ae9-40c3-a2d0-6e9b0f70dc7c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QAxLaeTs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '67d9ceff-c1fc-48ad-85c8-3aa37ebabf11', 'attached_at': '', 'detached_at': '', 'volume_id': '4367fb98-2ae9-40c3-a2d0-6e9b0f70dc7c', 'serial': '4367fb98-2ae9-40c3-a2d0-6e9b0f70dc7c'}, 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vda', 'volume_type': None}, {'delete_on_termination': False, 'attachment_id': '91806ff4-480a-45f2-98c2-af76ede565e7', 'guest_format': None, 'boot_index': 1, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0ad85d1f-7027-4997-96c4-991e3969067d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pJrvRwbO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '67d9ceff-c1fc-48ad-85c8-3aa37ebabf11', 'attached_at': '', 'detached_at': '', 'volume_id': '0ad85d1f-7027-4997-96c4-991e3969067d', 'serial': '0ad85d1f-7027-4997-96c4-991e3969067d'}, 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vdb', 'volume_type': None}, {'delete_on_termination': False, 'attachment_id': '2757d6ff-7f0c-4d70-8eba-66c2b33b1ea2', 'guest_format': None, 'boot_index': 2, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:eaf5fc54-be7c-4748-9e2f-12a01971e6f4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vqFapLyg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '67d9ceff-c1fc-48ad-85c8-3aa37ebabf11', 'attached_at': '', 'detached_at': '', 'volume_id': 'eaf5fc54-be7c-4748-9e2f-12a01971e6f4', 'serial': 'eaf5fc54-be7c-4748-9e2f-12a01971e6f4'}, 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vdc', 'volume_type': None} {{(pid=75337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 15:41:38 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-aaf7c305-0247-4921-9cd0-1c5a665fb183 tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] Acquiring lock "8858d90e-ee14-494b-80da-904cd97cdff0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:41:38 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-aaf7c305-0247-4921-9cd0-1c5a665fb183 tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] Lock "8858d90e-ee14-494b-80da-904cd97cdff0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:41:38 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 15:41:38 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 15:41:38 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 15:41:38 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] CPU controller missing on host. {{(pid=75337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 15:41:38 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 15:41:38 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] CPU controller found on host. {{(pid=75337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 15:41:38 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75337) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 15:41:38 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T15:34:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T15:34:14Z,direct_url=<?>,disk_format='qcow2',id=16b903ae-a40f-41a7-985b-4804cce92c62,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6549a15819f1469bbd5eeae8190e3d44',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T15:34:15Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 15:41:38 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Flavor limits 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 15:41:38 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Image limits 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 15:41:38 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Flavor pref 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 15:41:38 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Image pref 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 15:41:38 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 15:41:38 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 15:41:38 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 15:41:38 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Got 1 possible topologies {{(pid=75337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 15:41:38 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 15:41:38 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 15:41:38 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Calling os-brick to attach iSCSI Volume {{(pid=75337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 15:41:38 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2abc33d0c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4367fb98-2ae9-40c3-a2d0-6e9b0f70dc7c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QAxLaeTs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 15:41:38 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 15:41:38 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 15:41:38 user nova-compute[75337]: INFO nova.compute.manager [None req-aaf7c305-0247-4921-9cd0-1c5a665fb183 tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] [instance: 8858d90e-ee14-494b-80da-904cd97cdff0] Detaching volume fd579072-cd8e-4ac1-8f84-1afda08a11da
Nov 06 15:41:38 user nova-compute[75337]: DEBUG os_brick.utils [None req-e564e478-8eb6-4725-a9bf-772b7b488d30 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 15:41:38 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:41:38 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:41:38 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[54fe9cc3-521f-4da7-a324-60cc94be93a5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4ff6411e45b8\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:41:38 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:41:38 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:41:38 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[a22042d5-fb04-4030-bbb8-9bec0b6e3681]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:41:38 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:41:38 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:41:38 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[54bd7ead-3557-431c-bd6a-67d33d0a3534]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:41:38 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[204ea688-91f1-4535-ad04-6c1e4386e003]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:41:38 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-e564e478-8eb6-4725-a9bf-772b7b488d30 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Running cmd (subprocess): nvme version {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:41:38 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-e564e478-8eb6-4725-a9bf-772b7b488d30 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] 'nvme version' failed. Not Retrying. {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 15:41:38 user nova-compute[75337]: INFO nova.virt.block_device [None req-aaf7c305-0247-4921-9cd0-1c5a665fb183 tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] [instance: 8858d90e-ee14-494b-80da-904cd97cdff0] Attempting to driver detach volume fd579072-cd8e-4ac1-8f84-1afda08a11da from mountpoint /dev/sdc
Nov 06 15:41:38 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e564e478-8eb6-4725-a9bf-772b7b488d30 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] nvme not present on system {{(pid=75337) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 15:41:38 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:41:38 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 15:41:38 user nova-compute[75337]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 15:41:38 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfa74484-6804-4c87-9732-f361583590f7]: (4, '') {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:41:38 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.lightos [None req-e564e478-8eb6-4725-a9bf-772b7b488d30 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75337) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 15:41:38 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.lightos [None req-e564e478-8eb6-4725-a9bf-772b7b488d30 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 15:41:38 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.lightos [None req-e564e478-8eb6-4725-a9bf-772b7b488d30 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] LIGHTOS: no hostnqn found. {{(pid=75337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 15:41:38 user nova-compute[75337]: DEBUG os_brick.utils [None req-e564e478-8eb6-4725-a9bf-772b7b488d30 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4ff6411e45b8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 15:41:38 user nova-compute[75337]: DEBUG nova.virt.block_device [None req-e564e478-8eb6-4725-a9bf-772b7b488d30 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: 1fa4c927-7485-4f34-94bd-9e20358904b6] Updating existing volume attachment record: 558ab0eb-f864-4606-b5a8-2d7f980cbea6 {{(pid=75337) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 15:41:38 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-aaf7c305-0247-4921-9cd0-1c5a665fb183 tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] Attempting to detach device sdc from instance 8858d90e-ee14-494b-80da-904cd97cdff0 from the persistent domain config. {{(pid=75337) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 06 15:41:38 user nova-compute[75337]: DEBUG nova.virt.libvirt.guest [None req-aaf7c305-0247-4921-9cd0-1c5a665fb183 tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 15:41:38 user nova-compute[75337]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 15:41:38 user nova-compute[75337]:   <source dev="/dev/sdc"/>
Nov 06 15:41:38 user nova-compute[75337]:   <target dev="sdc" bus="scsi"/>
Nov 06 15:41:38 user nova-compute[75337]:   <serial>fd579072-cd8e-4ac1-8f84-1afda08a11da</serial>
Nov 06 15:41:38 user nova-compute[75337]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 06 15:41:38 user nova-compute[75337]: </disk>
Nov 06 15:41:38 user nova-compute[75337]:  {{(pid=75337) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 15:41:38 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-aaf7c305-0247-4921-9cd0-1c5a665fb183 tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] Successfully detached device sdc from instance 8858d90e-ee14-494b-80da-904cd97cdff0 from the persistent domain config.
Nov 06 15:41:38 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-aaf7c305-0247-4921-9cd0-1c5a665fb183 tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance 8858d90e-ee14-494b-80da-904cd97cdff0 from the live domain config. {{(pid=75337) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 06 15:41:38 user nova-compute[75337]: DEBUG nova.virt.libvirt.guest [None req-aaf7c305-0247-4921-9cd0-1c5a665fb183 tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 15:41:38 user nova-compute[75337]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 15:41:38 user nova-compute[75337]:   <source dev="/dev/sdc"/>
Nov 06 15:41:38 user nova-compute[75337]:   <target dev="sdc" bus="scsi"/>
Nov 06 15:41:38 user nova-compute[75337]:   <serial>fd579072-cd8e-4ac1-8f84-1afda08a11da</serial>
Nov 06 15:41:38 user nova-compute[75337]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 06 15:41:38 user nova-compute[75337]: </disk>
Nov 06 15:41:38 user nova-compute[75337]:  {{(pid=75337) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 15:41:38 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-aaf7c305-0247-4921-9cd0-1c5a665fb183 tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance 8858d90e-ee14-494b-80da-904cd97cdff0 {{(pid=75337) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 06 15:41:39 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-63ebe34e-cad7-4ec6-a330-91445d555772 tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.376s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 15:41:39 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-63ebe34e-cad7-4ec6-a330-91445d555772 tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] <== connect_volume: return (1378ms) {'type': 'block', 'scsi_wwn': '26632363432396338', 'path': '/dev/sde'} {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 15:41:39 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63ebe34e-cad7-4ec6-a330-91445d555772 tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] [instance: 76ee582b-b887-4d46-8c78-29f42d1a0d26] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26632363432396338', 'path': '/dev/sde'} {{(pid=75337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 15:41:39 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.884s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 15:41:39 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 15:41:39 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4367fb98-2ae9-40c3-a2d0-6e9b0f70dc7c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 15:41:39 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4367fb98-2ae9-40c3-a2d0-6e9b0f70dc7c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 15:41:39 user nova-compute[75337]: INFO os_brick.initiator.connectors.iscsi [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 15:41:39 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4367fb98-2ae9-40c3-a2d0-6e9b0f70dc7c -p 172.16.0.220:3260 {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:41:39 user nova-compute[75337]: DEBUG nova.objects.instance [None req-63ebe34e-cad7-4ec6-a330-91445d555772 tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] Lazy-loading 'flavor' on Instance uuid 76ee582b-b887-4d46-8c78-29f42d1a0d26 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 15:41:39 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4367fb98-2ae9-40c3-a2d0-6e9b0f70dc7c -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:41:39 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[be496695-1ecf-4bd7-92a3-5987a56d435e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:41:39 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 15:41:39 user nova-compute[75337]:  {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:41:39 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-1e2c260a-42ae-44a2-9ecc-e9d2d6917eae tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] Acquiring lock "5f5fc58d-f946-4df0-b8d0-1aefbf0f8cd6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:41:39 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-1e2c260a-42ae-44a2-9ecc-e9d2d6917eae tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] Lock "5f5fc58d-f946-4df0-b8d0-1aefbf0f8cd6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:41:39 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-1e2c260a-42ae-44a2-9ecc-e9d2d6917eae tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] Acquiring lock "5f5fc58d-f946-4df0-b8d0-1aefbf0f8cd6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:41:39 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-1e2c260a-42ae-44a2-9ecc-e9d2d6917eae tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] Lock "5f5fc58d-f946-4df0-b8d0-1aefbf0f8cd6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:41:39 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-1e2c260a-42ae-44a2-9ecc-e9d2d6917eae tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] Lock "5f5fc58d-f946-4df0-b8d0-1aefbf0f8cd6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:41:39 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4367fb98-2ae9-40c3-a2d0-6e9b0f70dc7c -p 172.16.0.220:3260 --interface default --op new {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:41:39 user nova-compute[75337]: INFO nova.compute.manager [None req-1e2c260a-42ae-44a2-9ecc-e9d2d6917eae tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] [instance: 5f5fc58d-f946-4df0-b8d0-1aefbf0f8cd6] Terminating instance
Nov 06 15:41:39 user nova-compute[75337]: DEBUG nova.compute.manager [None req-1e2c260a-42ae-44a2-9ecc-e9d2d6917eae tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] [instance: 5f5fc58d-f946-4df0-b8d0-1aefbf0f8cd6] Start destroying the instance on the hypervisor. {{(pid=75337) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 15:41:39 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4367fb98-2ae9-40c3-a2d0-6e9b0f70dc7c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:41:39 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffb50312-fc6a-4df0-baa5-b0a585004524]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4367fb98-2ae9-40c3-a2d0-6e9b0f70dc7c] added\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:41:39 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4367fb98-2ae9-40c3-a2d0-6e9b0f70dc7c] added
Nov 06 15:41:39 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:41:39 user nova-compute[75337]: DEBUG nova.virt.libvirt.guest [None req-63ebe34e-cad7-4ec6-a330-91445d555772 tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] attach device xml: <disk type="block" device="disk">
Nov 06 15:41:39 user nova-compute[75337]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 15:41:39 user nova-compute[75337]:   <source dev="/dev/sde"/>
Nov 06 15:41:39 user nova-compute[75337]:   <target dev="vdb" bus="virtio"/>
Nov 06 15:41:39 user nova-compute[75337]:   <serial>dccaff76-b907-4a00-b34d-bb5ae7655a02</serial>
Nov 06 15:41:39 user nova-compute[75337]: </disk>
Nov 06 15:41:39 user nova-compute[75337]:  {{(pid=75337) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 06 15:41:39 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4367fb98-2ae9-40c3-a2d0-6e9b0f70dc7c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:41:39 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4367fb98-2ae9-40c3-a2d0-6e9b0f70dc7c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:41:39 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[8171d2b9-eeac-4506-b6bc-2033aa9972f6]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:41:39 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:41:39 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4367fb98-2ae9-40c3-a2d0-6e9b0f70dc7c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:41:39 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4367fb98-2ae9-40c3-a2d0-6e9b0f70dc7c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:41:39 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[85018d83-895b-4ec5-b72f-1d546db3b063]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:41:39 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:41:39 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:41:39 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4367fb98-2ae9-40c3-a2d0-6e9b0f70dc7c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QAxLaeTs {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:41:39 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4367fb98-2ae9-40c3-a2d0-6e9b0f70dc7c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QAxLaeTs" returned: 0 in 0.029s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:41:39 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[27267650-661e-48b7-ad79-ea72c1c93ba7]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:41:39 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QAxLaeTs'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:41:39 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:41:39 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4367fb98-2ae9-40c3-a2d0-6e9b0f70dc7c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:41:39 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:41:39 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4367fb98-2ae9-40c3-a2d0-6e9b0f70dc7c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:41:39 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fd4bff1-540b-4f9f-a643-59b2ff3d0f58]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:41:39 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:41:39 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:41:39 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:41:39 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:41:39 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3871a2a-867f-4ae3-be44-05eb9de097a9]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd579072-cd8e-4ac1-8f84-1afda08a11da (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af7490be-28c7-4ef3-917c-d05cd66f2acb (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dccaff76-b907-4a00-b34d-bb5ae7655a02 (non-flash)\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:41:39 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759 (non-flash)
Nov 06 15:41:39 user nova-compute[75337]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd579072-cd8e-4ac1-8f84-1afda08a11da (non-flash)
Nov 06 15:41:39 user nova-compute[75337]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af7490be-28c7-4ef3-917c-d05cd66f2acb (non-flash)
Nov 06 15:41:39 user nova-compute[75337]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dccaff76-b907-4a00-b34d-bb5ae7655a02 (non-flash)
Nov 06 15:41:39 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 15:41:39 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759 (non-flash)
Nov 06 15:41:39 user nova-compute[75337]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd579072-cd8e-4ac1-8f84-1afda08a11da (non-flash)
Nov 06 15:41:39 user nova-compute[75337]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af7490be-28c7-4ef3-917c-d05cd66f2acb (non-flash)
Nov 06 15:41:39 user nova-compute[75337]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dccaff76-b907-4a00-b34d-bb5ae7655a02 (non-flash)
Nov 06 15:41:39 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 15:41:39 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4367fb98-2ae9-40c3-a2d0-6e9b0f70dc7c -p 172.16.0.220:3260 --login {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:41:39 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4367fb98-2ae9-40c3-a2d0-6e9b0f70dc7c -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:41:39 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb72c049-9eb3-42d3-8dcb-a7d3c4fcf9b9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4367fb98-2ae9-40c3-a2d0-6e9b0f70dc7c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4367fb98-2ae9-40c3-a2d0-6e9b0f70dc7c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:41:39 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4367fb98-2ae9-40c3-a2d0-6e9b0f70dc7c, portal: 172.16.0.220,3260]
Nov 06 15:41:39 user nova-compute[75337]: Login to [iface: default, target: iqn.2010-10.org.openstack:4367fb98-2ae9-40c3-a2d0-6e9b0f70dc7c, portal: 172.16.0.220,3260] successful.
Nov 06 15:41:39 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:41:39 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4367fb98-2ae9-40c3-a2d0-6e9b0f70dc7c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:41:39 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4367fb98-2ae9-40c3-a2d0-6e9b0f70dc7c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.031s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:41:39 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[2639652d-7ef6-441d-bacc-ca140548e190]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:41:39 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:41:39 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:41:39 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:41:39 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbe50e3f-b2ce-446e-9599-c35a716c3355]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd579072-cd8e-4ac1-8f84-1afda08a11da (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af7490be-28c7-4ef3-917c-d05cd66f2acb (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dccaff76-b907-4a00-b34d-bb5ae7655a02 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4367fb98-2ae9-40c3-a2d0-6e9b0f70dc7c (non-flash)\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:41:39 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759 (non-flash)
Nov 06 15:41:39 user nova-compute[75337]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd579072-cd8e-4ac1-8f84-1afda08a11da (non-flash)
Nov 06 15:41:39 user nova-compute[75337]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af7490be-28c7-4ef3-917c-d05cd66f2acb (non-flash)
Nov 06 15:41:39 user nova-compute[75337]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dccaff76-b907-4a00-b34d-bb5ae7655a02 (non-flash)
Nov 06 15:41:39 user nova-compute[75337]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4367fb98-2ae9-40c3-a2d0-6e9b0f70dc7c (non-flash)
Nov 06 15:41:39 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 15:41:39 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759 (non-flash)
Nov 06 15:41:39 user nova-compute[75337]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd579072-cd8e-4ac1-8f84-1afda08a11da (non-flash)
Nov 06 15:41:39 user nova-compute[75337]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af7490be-28c7-4ef3-917c-d05cd66f2acb (non-flash)
Nov 06 15:41:39 user nova-compute[75337]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dccaff76-b907-4a00-b34d-bb5ae7655a02 (non-flash)
Nov 06 15:41:39 user nova-compute[75337]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4367fb98-2ae9-40c3-a2d0-6e9b0f70dc7c (non-flash)
Nov 06 15:41:39 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 15:41:39 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4367fb98-2ae9-40c3-a2d0-6e9b0f70dc7c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.376s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 15:41:39 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Connected to 172.16.0.220:3260 {{(pid=75337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 15:41:39 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] HCTL ('37', '-', '-', 0) found on session 6 with lun 0 {{(pid=75337) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 15:41:39 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75337) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 15:41:39 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:41:39 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:41:39 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.019s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:41:39 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[af9b2e19-9966-4d9e-a616-74e17018de8e]: (4, ('- - 0', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:41:39 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: None {{(pid=75337) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 15:41:39 user nova-compute[75337]: DEBUG nova.compute.manager [req-15a5bff3-432c-4308-9dd2-153ac610661b req-bcf73d12-23d3-4151-82c6-5a39dc5291af service nova] [instance: 5f5fc58d-f946-4df0-b8d0-1aefbf0f8cd6] Received event network-vif-unplugged-9e5c665f-7b51-497e-b9b7-a0f652321a96 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:41:39 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-15a5bff3-432c-4308-9dd2-153ac610661b req-bcf73d12-23d3-4151-82c6-5a39dc5291af service nova] Acquiring lock "5f5fc58d-f946-4df0-b8d0-1aefbf0f8cd6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:41:39 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-15a5bff3-432c-4308-9dd2-153ac610661b req-bcf73d12-23d3-4151-82c6-5a39dc5291af service nova] Lock "5f5fc58d-f946-4df0-b8d0-1aefbf0f8cd6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:41:39 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-15a5bff3-432c-4308-9dd2-153ac610661b req-bcf73d12-23d3-4151-82c6-5a39dc5291af service nova] Lock "5f5fc58d-f946-4df0-b8d0-1aefbf0f8cd6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:41:39 user nova-compute[75337]: DEBUG nova.compute.manager [req-15a5bff3-432c-4308-9dd2-153ac610661b req-bcf73d12-23d3-4151-82c6-5a39dc5291af service nova] [instance: 5f5fc58d-f946-4df0-b8d0-1aefbf0f8cd6] No waiting events found dispatching network-vif-unplugged-9e5c665f-7b51-497e-b9b7-a0f652321a96 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:41:39 user nova-compute[75337]: DEBUG nova.compute.manager [req-15a5bff3-432c-4308-9dd2-153ac610661b req-bcf73d12-23d3-4151-82c6-5a39dc5291af service nova] [instance: 5f5fc58d-f946-4df0-b8d0-1aefbf0f8cd6] Received event network-vif-unplugged-9e5c665f-7b51-497e-b9b7-a0f652321a96 for instance with task_state deleting. {{(pid=75337) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 15:41:39 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-63ebe34e-cad7-4ec6-a330-91445d555772 tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] No BDM found with device name vda, not building metadata. {{(pid=75337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 15:41:39 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-63ebe34e-cad7-4ec6-a330-91445d555772 tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] No BDM found with device name hda, not building metadata. {{(pid=75337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 15:41:39 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-63ebe34e-cad7-4ec6-a330-91445d555772 tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] No VIF found with MAC fa:16:3e:0b:83:6f, not building metadata {{(pid=75337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 15:41:39 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-63ebe34e-cad7-4ec6-a330-91445d555772 tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] Lock "76ee582b-b887-4d46-8c78-29f42d1a0d26" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 50.632s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:41:39 user nova-compute[75337]: INFO nova.virt.libvirt.driver [-] [instance: 5f5fc58d-f946-4df0-b8d0-1aefbf0f8cd6] Instance destroyed successfully.
Nov 06 15:41:39 user nova-compute[75337]: DEBUG nova.objects.instance [None req-1e2c260a-42ae-44a2-9ecc-e9d2d6917eae tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] Lazy-loading 'resources' on Instance uuid 5f5fc58d-f946-4df0-b8d0-1aefbf0f8cd6 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 15:41:40 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-1e2c260a-42ae-44a2-9ecc-e9d2d6917eae tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T15:37:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1150753702',display_name='tempest-DeleteServersTestJSON-server-1150753702',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1150753702',id=2,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-06T15:38:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0b38d5a3287447a580dbd965f44e042c',ramdisk_id='',reservation_id='r-kfcfq5qs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-706109674',owner_user_name='tempest-DeleteServersTestJSON-706109674-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T15:38:14Z,user_data=None,user_id='92b6d879877241fa9372d76e52d41c6b',uuid=5f5fc58d-f946-4df0-b8d0-1aefbf0f8cd6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9e5c665f-7b51-497e-b9b7-a0f652321a96", "address": "fa:16:3e:f7:8a:4e", "network": {"id": "fa9a4651-99aa-40d8-9010-136c5b9f4c02", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-501845579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b38d5a3287447a580dbd965f44e042c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e5c665f-7b", "ovs_interfaceid": "9e5c665f-7b51-497e-b9b7-a0f652321a96", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 15:41:40 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-1e2c260a-42ae-44a2-9ecc-e9d2d6917eae tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] Converting VIF {"id": "9e5c665f-7b51-497e-b9b7-a0f652321a96", "address": "fa:16:3e:f7:8a:4e", "network": {"id": "fa9a4651-99aa-40d8-9010-136c5b9f4c02", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-501845579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b38d5a3287447a580dbd965f44e042c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e5c665f-7b", "ovs_interfaceid": "9e5c665f-7b51-497e-b9b7-a0f652321a96", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 15:41:40 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-1e2c260a-42ae-44a2-9ecc-e9d2d6917eae tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f7:8a:4e,bridge_name='br-int',has_traffic_filtering=True,id=9e5c665f-7b51-497e-b9b7-a0f652321a96,network=Network(fa9a4651-99aa-40d8-9010-136c5b9f4c02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e5c665f-7b') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 15:41:40 user nova-compute[75337]: DEBUG os_vif [None req-1e2c260a-42ae-44a2-9ecc-e9d2d6917eae tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f7:8a:4e,bridge_name='br-int',has_traffic_filtering=True,id=9e5c665f-7b51-497e-b9b7-a0f652321a96,network=Network(fa9a4651-99aa-40d8-9010-136c5b9f4c02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e5c665f-7b') {{(pid=75337) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 15:41:40 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:41:40 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9e5c665f-7b, bridge=br-int, if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:41:40 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:41:40 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:41:40 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:41:40 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fefd5627-c3b0-466b-a7dd-15cd9ae439f2) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:41:40 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:41:40 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:41:40 user nova-compute[75337]: INFO os_vif [None req-1e2c260a-42ae-44a2-9ecc-e9d2d6917eae tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f7:8a:4e,bridge_name='br-int',has_traffic_filtering=True,id=9e5c665f-7b51-497e-b9b7-a0f652321a96,network=Network(fa9a4651-99aa-40d8-9010-136c5b9f4c02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e5c665f-7b')
Nov 06 15:41:40 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1e2c260a-42ae-44a2-9ecc-e9d2d6917eae tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] [instance: 5f5fc58d-f946-4df0-b8d0-1aefbf0f8cd6] calling os-brick to detach iSCSI Volume {{(pid=75337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 15:41:40 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e2c260a-42ae-44a2-9ecc-e9d2d6917eae tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2abc33d0c0>, {'target_iqn': 'iqn.2010-10.org.openstack:af7490be-28c7-4ef3-917c-d05cd66f2acb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WnLRUSXv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 15:41:40 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-1e2c260a-42ae-44a2-9ecc-e9d2d6917eae tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 15:41:40 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-1e2c260a-42ae-44a2-9ecc-e9d2d6917eae tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 15:41:40 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75337) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 15:41:40 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:4367fb98-2ae9-40c3-a2d0-6e9b0f70dc7c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QAxLaeTs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 15:41:40 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.414s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 15:41:40 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] <== connect_volume: return (2298ms) {'type': 'block', 'scsi_wwn': '23837653562336231', 'path': '/dev/sdf'} {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 15:41:40 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23837653562336231', 'path': '/dev/sdf'} {{(pid=75337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 15:41:40 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-1e2c260a-42ae-44a2-9ecc-e9d2d6917eae tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.523s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 15:41:40 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:41:40 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:41:40 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[efc84832-13c5-4557-95c4-1c107a2c068f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:af7490be-28c7-4ef3-917c-d05cd66f2acb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fd579072-cd8e-4ac1-8f84-1afda08a11da\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dccaff76-b907-4a00-b34d-bb5ae7655a02\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4367fb98-2ae9-40c3-a2d0-6e9b0f70dc7c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:41:40 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Calling os-brick to attach iSCSI Volume {{(pid=75337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 15:41:40 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2abc33d0c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0ad85d1f-7027-4997-96c4-991e3969067d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pJrvRwbO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 15:41:40 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 15:41:40 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 15:41:40 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e2c260a-42ae-44a2-9ecc-e9d2d6917eae tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 15:41:40 user nova-compute[75337]: No targets found.
Nov 06 15:41:40 user nova-compute[75337]: iSNS:
Nov 06 15:41:40 user nova-compute[75337]: No targets found.
Nov 06 15:41:40 user nova-compute[75337]: STATIC:
Nov 06 15:41:40 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:af7490be-28c7-4ef3-917c-d05cd66f2acb
Nov 06 15:41:40 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 15:41:40 user nova-compute[75337]:                 Iface Name: default
Nov 06 15:41:40 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:fd579072-cd8e-4ac1-8f84-1afda08a11da
Nov 06 15:41:40 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 15:41:40 user nova-compute[75337]:                 Iface Name: default
Nov 06 15:41:40 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:dccaff76-b907-4a00-b34d-bb5ae7655a02
Nov 06 15:41:40 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 15:41:40 user nova-compute[75337]:                 Iface Name: default
Nov 06 15:41:40 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759
Nov 06 15:41:40 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 15:41:40 user nova-compute[75337]:                 Iface Name: default
Nov 06 15:41:40 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:4367fb98-2ae9-40c3-a2d0-6e9b0f70dc7c
Nov 06 15:41:40 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 15:41:40 user nova-compute[75337]:                 Iface Name: default
Nov 06 15:41:40 user nova-compute[75337]: FIRMWARE:
Nov 06 15:41:40 user nova-compute[75337]: No targets found.
Nov 06 15:41:40 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 15:41:40 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e2c260a-42ae-44a2-9ecc-e9d2d6917eae tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 15:41:40 user nova-compute[75337]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 15:41:40 user nova-compute[75337]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75337) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 15:41:40 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e2c260a-42ae-44a2-9ecc-e9d2d6917eae tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:af7490be-28c7-4ef3-917c-d05cd66f2acb', 0)] {{(pid=75337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 15:41:40 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:41:40 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:41:40 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[d24937b6-b9da-4887-9bea-44a3b3223e3e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4367fb98-2ae9-40c3-a2d0-6e9b0f70dc7c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af7490be-28c7-4ef3-917c-d05cd66f2acb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dccaff76-b907-4a00-b34d-bb5ae7655a02\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fd579072-cd8e-4ac1-8f84-1afda08a11da\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:41:40 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:41:40 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:41:40 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[467386b7-6c42-4c39-8bc5-f0e029d66141]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd579072-cd8e-4ac1-8f84-1afda08a11da (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af7490be-28c7-4ef3-917c-d05cd66f2acb (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dccaff76-b907-4a00-b34d-bb5ae7655a02 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4367fb98-2ae9-40c3-a2d0-6e9b0f70dc7c (non-flash)\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:41:40 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e2c260a-42ae-44a2-9ecc-e9d2d6917eae tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759 (non-flash)
Nov 06 15:41:40 user nova-compute[75337]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd579072-cd8e-4ac1-8f84-1afda08a11da (non-flash)
Nov 06 15:41:40 user nova-compute[75337]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af7490be-28c7-4ef3-917c-d05cd66f2acb (non-flash)
Nov 06 15:41:40 user nova-compute[75337]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dccaff76-b907-4a00-b34d-bb5ae7655a02 (non-flash)
Nov 06 15:41:40 user nova-compute[75337]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4367fb98-2ae9-40c3-a2d0-6e9b0f70dc7c (non-flash)
Nov 06 15:41:40 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 15:41:40 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e2c260a-42ae-44a2-9ecc-e9d2d6917eae tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759 (non-flash)
Nov 06 15:41:40 user nova-compute[75337]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd579072-cd8e-4ac1-8f84-1afda08a11da (non-flash)
Nov 06 15:41:40 user nova-compute[75337]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af7490be-28c7-4ef3-917c-d05cd66f2acb (non-flash)
Nov 06 15:41:40 user nova-compute[75337]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dccaff76-b907-4a00-b34d-bb5ae7655a02 (non-flash)
Nov 06 15:41:40 user nova-compute[75337]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4367fb98-2ae9-40c3-a2d0-6e9b0f70dc7c (non-flash)
Nov 06 15:41:40 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 15:41:40 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e2c260a-42ae-44a2-9ecc-e9d2d6917eae tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2acd6d7e20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:af7490be-28c7-4ef3-917c-d05cd66f2acb'): ({'sdd'}, set())}) {{(pid=75337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 15:41:40 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-1e2c260a-42ae-44a2-9ecc-e9d2d6917eae tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] Removing single pathed devices sdd {{(pid=75337) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 15:41:40 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:41:40 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:41:40 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[7175fbb7-7103-4384-8e8f-a8afc222deb1]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:41:40 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:41:40 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:41:40 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[8df2fd76-80c2-4868-992d-915021fc18d5]: (4, ('ok\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:41:40 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-1e2c260a-42ae-44a2-9ecc-e9d2d6917eae tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] Flushing IO for device /dev/sdd {{(pid=75337) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 15:41:40 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:41:40 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:41:40 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[c645ef82-992f-4b41-9312-ca7f85ec1959]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:41:40 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-1e2c260a-42ae-44a2-9ecc-e9d2d6917eae tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75337) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 15:41:40 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:41:40 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.045s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:41:40 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[388b5eff-85e1-4fa2-acc9-6278861c61ae]: (4, ('1', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:41:40 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-1e2c260a-42ae-44a2-9ecc-e9d2d6917eae tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 15:41:40 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-1e2c260a-42ae-44a2-9ecc-e9d2d6917eae tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] SCSI volumes sdd have been removed. {{(pid=75337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 15:41:40 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e2c260a-42ae-44a2-9ecc-e9d2d6917eae tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:af7490be-28c7-4ef3-917c-d05cd66f2acb')] {{(pid=75337) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 15:41:40 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af7490be-28c7-4ef3-917c-d05cd66f2acb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:41:40 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af7490be-28c7-4ef3-917c-d05cd66f2acb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.077s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:41:40 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[7710998b-a1fe-43fb-aae4-4500b53b5fc3]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:41:40 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e2c260a-42ae-44a2-9ecc-e9d2d6917eae tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:41:40 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af7490be-28c7-4ef3-917c-d05cd66f2acb -p 172.16.0.220:3260 --logout {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:41:40 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af7490be-28c7-4ef3-917c-d05cd66f2acb -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:41:40 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[03c6b45d-4dbf-4bcd-ad65-5ef53276f7df]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:af7490be-28c7-4ef3-917c-d05cd66f2acb, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:af7490be-28c7-4ef3-917c-d05cd66f2acb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:41:40 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e2c260a-42ae-44a2-9ecc-e9d2d6917eae tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:af7490be-28c7-4ef3-917c-d05cd66f2acb, portal: 172.16.0.220,3260]
Nov 06 15:41:40 user nova-compute[75337]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:af7490be-28c7-4ef3-917c-d05cd66f2acb, portal: 172.16.0.220,3260] successful.
Nov 06 15:41:40 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:41:40 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af7490be-28c7-4ef3-917c-d05cd66f2acb -p 172.16.0.220:3260 --op delete {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:41:40 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af7490be-28c7-4ef3-917c-d05cd66f2acb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:41:40 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[0315065c-0be9-447f-969e-e9006c078aaf]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:41:40 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e2c260a-42ae-44a2-9ecc-e9d2d6917eae tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:41:40 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-1e2c260a-42ae-44a2-9ecc-e9d2d6917eae tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.431s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 15:41:40 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e2c260a-42ae-44a2-9ecc-e9d2d6917eae tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] <== disconnect_volume: return (953ms) None {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 15:41:40 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1e2c260a-42ae-44a2-9ecc-e9d2d6917eae tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] [instance: 5f5fc58d-f946-4df0-b8d0-1aefbf0f8cd6] Disconnected iSCSI Volume {{(pid=75337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 15:41:40 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-1e2c260a-42ae-44a2-9ecc-e9d2d6917eae tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] [instance: 5f5fc58d-f946-4df0-b8d0-1aefbf0f8cd6] Deleting instance files /opt/stack/data/nova/instances/5f5fc58d-f946-4df0-b8d0-1aefbf0f8cd6_del
Nov 06 15:41:40 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-1e2c260a-42ae-44a2-9ecc-e9d2d6917eae tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] [instance: 5f5fc58d-f946-4df0-b8d0-1aefbf0f8cd6] Deletion of /opt/stack/data/nova/instances/5f5fc58d-f946-4df0-b8d0-1aefbf0f8cd6_del complete
Nov 06 15:41:41 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.411s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 15:41:41 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 15:41:41 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0ad85d1f-7027-4997-96c4-991e3969067d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 15:41:41 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0ad85d1f-7027-4997-96c4-991e3969067d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 15:41:41 user nova-compute[75337]: INFO os_brick.initiator.connectors.iscsi [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 15:41:41 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ad85d1f-7027-4997-96c4-991e3969067d -p 172.16.0.220:3260 {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:41:41 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ad85d1f-7027-4997-96c4-991e3969067d -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:41:41 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7ae36dd-50df-450e-a5cb-f3fe3d056824]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:41:41 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 15:41:41 user nova-compute[75337]:  {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:41:41 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ad85d1f-7027-4997-96c4-991e3969067d -p 172.16.0.220:3260 --interface default --op new {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:41:41 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ad85d1f-7027-4997-96c4-991e3969067d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:41:41 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[344752cd-1064-46da-8741-93ba8d95d68b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0ad85d1f-7027-4997-96c4-991e3969067d] added\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:41:41 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0ad85d1f-7027-4997-96c4-991e3969067d] added
Nov 06 15:41:41 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:41:41 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ad85d1f-7027-4997-96c4-991e3969067d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:41:41 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-b924cfc8-c700-41b5-af96-ffef03d1f6d5 tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] Acquiring lock "76ee582b-b887-4d46-8c78-29f42d1a0d26" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:41:41 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-b924cfc8-c700-41b5-af96-ffef03d1f6d5 tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] Lock "76ee582b-b887-4d46-8c78-29f42d1a0d26" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:41:41 user nova-compute[75337]: INFO nova.compute.manager [None req-1e2c260a-42ae-44a2-9ecc-e9d2d6917eae tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] [instance: 5f5fc58d-f946-4df0-b8d0-1aefbf0f8cd6] Took 1.88 seconds to destroy the instance on the hypervisor.
Nov 06 15:41:41 user nova-compute[75337]: DEBUG oslo.service.loopingcall [None req-1e2c260a-42ae-44a2-9ecc-e9d2d6917eae tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75337) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 15:41:41 user nova-compute[75337]: DEBUG nova.compute.manager [-] [instance: 5f5fc58d-f946-4df0-b8d0-1aefbf0f8cd6] Deallocating network for instance {{(pid=75337) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 15:41:41 user nova-compute[75337]: DEBUG nova.network.neutron [-] [instance: 5f5fc58d-f946-4df0-b8d0-1aefbf0f8cd6] deallocate_for_instance() {{(pid=75337) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 15:41:41 user nova-compute[75337]: INFO nova.compute.manager [None req-b924cfc8-c700-41b5-af96-ffef03d1f6d5 tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] [instance: 76ee582b-b887-4d46-8c78-29f42d1a0d26] Detaching volume dccaff76-b907-4a00-b34d-bb5ae7655a02
Nov 06 15:41:41 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ad85d1f-7027-4997-96c4-991e3969067d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:41:41 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac515a06-cb2f-4643-aa93-6947b3b0ab5f]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:41:41 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:41:41 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ad85d1f-7027-4997-96c4-991e3969067d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:41:41 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ad85d1f-7027-4997-96c4-991e3969067d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:41:41 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[574d5253-440b-47fd-9d72-e2c59dd0f666]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:41:41 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:41:41 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ad85d1f-7027-4997-96c4-991e3969067d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pJrvRwbO {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:41:41 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ad85d1f-7027-4997-96c4-991e3969067d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pJrvRwbO" returned: 0 in 0.022s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:41:41 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[a20306e9-4355-4a45-9359-b4502803c404]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:41:41 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pJrvRwbO'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:41:41 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ad85d1f-7027-4997-96c4-991e3969067d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:41:41 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ad85d1f-7027-4997-96c4-991e3969067d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:41:41 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb7a179f-f1b9-4c08-ad78-9f43758fd040]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:41:41 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:41:41 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:41:41 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:41:41 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa242040-482b-4f19-be2e-abecc229e1c9]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd579072-cd8e-4ac1-8f84-1afda08a11da (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dccaff76-b907-4a00-b34d-bb5ae7655a02 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4367fb98-2ae9-40c3-a2d0-6e9b0f70dc7c (non-flash)\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:41:41 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759 (non-flash)
Nov 06 15:41:41 user nova-compute[75337]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd579072-cd8e-4ac1-8f84-1afda08a11da (non-flash)
Nov 06 15:41:41 user nova-compute[75337]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dccaff76-b907-4a00-b34d-bb5ae7655a02 (non-flash)
Nov 06 15:41:41 user nova-compute[75337]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4367fb98-2ae9-40c3-a2d0-6e9b0f70dc7c (non-flash)
Nov 06 15:41:41 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 15:41:41 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759 (non-flash)
Nov 06 15:41:41 user nova-compute[75337]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd579072-cd8e-4ac1-8f84-1afda08a11da (non-flash)
Nov 06 15:41:41 user nova-compute[75337]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dccaff76-b907-4a00-b34d-bb5ae7655a02 (non-flash)
Nov 06 15:41:41 user nova-compute[75337]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4367fb98-2ae9-40c3-a2d0-6e9b0f70dc7c (non-flash)
Nov 06 15:41:41 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 15:41:41 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ad85d1f-7027-4997-96c4-991e3969067d -p 172.16.0.220:3260 --login {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:41:41 user nova-compute[75337]: INFO nova.virt.block_device [None req-b924cfc8-c700-41b5-af96-ffef03d1f6d5 tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] [instance: 76ee582b-b887-4d46-8c78-29f42d1a0d26] Attempting to driver detach volume dccaff76-b907-4a00-b34d-bb5ae7655a02 from mountpoint /dev/vdb
Nov 06 15:41:41 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-b924cfc8-c700-41b5-af96-ffef03d1f6d5 tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] Attempting to detach device vdb from instance 76ee582b-b887-4d46-8c78-29f42d1a0d26 from the persistent domain config. {{(pid=75337) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 06 15:41:41 user nova-compute[75337]: DEBUG nova.virt.libvirt.guest [None req-b924cfc8-c700-41b5-af96-ffef03d1f6d5 tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 15:41:41 user nova-compute[75337]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 15:41:41 user nova-compute[75337]:   <source dev="/dev/sde"/>
Nov 06 15:41:41 user nova-compute[75337]:   <target dev="vdb" bus="virtio"/>
Nov 06 15:41:41 user nova-compute[75337]:   <serial>dccaff76-b907-4a00-b34d-bb5ae7655a02</serial>
Nov 06 15:41:41 user nova-compute[75337]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 06 15:41:41 user nova-compute[75337]: </disk>
Nov 06 15:41:41 user nova-compute[75337]:  {{(pid=75337) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 15:41:41 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-b924cfc8-c700-41b5-af96-ffef03d1f6d5 tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] Successfully detached device vdb from instance 76ee582b-b887-4d46-8c78-29f42d1a0d26 from the persistent domain config.
Nov 06 15:41:41 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-b924cfc8-c700-41b5-af96-ffef03d1f6d5 tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 76ee582b-b887-4d46-8c78-29f42d1a0d26 from the live domain config. {{(pid=75337) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 06 15:41:41 user nova-compute[75337]: DEBUG nova.virt.libvirt.guest [None req-b924cfc8-c700-41b5-af96-ffef03d1f6d5 tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 15:41:41 user nova-compute[75337]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 15:41:41 user nova-compute[75337]:   <source dev="/dev/sde"/>
Nov 06 15:41:41 user nova-compute[75337]:   <target dev="vdb" bus="virtio"/>
Nov 06 15:41:41 user nova-compute[75337]:   <serial>dccaff76-b907-4a00-b34d-bb5ae7655a02</serial>
Nov 06 15:41:41 user nova-compute[75337]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 06 15:41:41 user nova-compute[75337]: </disk>
Nov 06 15:41:41 user nova-compute[75337]:  {{(pid=75337) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 15:41:41 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ad85d1f-7027-4997-96c4-991e3969067d -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:41:41 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[5014639e-713c-4255-bf2d-f00119f5fb12]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0ad85d1f-7027-4997-96c4-991e3969067d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0ad85d1f-7027-4997-96c4-991e3969067d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:41:41 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0ad85d1f-7027-4997-96c4-991e3969067d, portal: 172.16.0.220,3260]
Nov 06 15:41:41 user nova-compute[75337]: Login to [iface: default, target: iqn.2010-10.org.openstack:0ad85d1f-7027-4997-96c4-991e3969067d, portal: 172.16.0.220,3260] successful.
Nov 06 15:41:41 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:41:41 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ad85d1f-7027-4997-96c4-991e3969067d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:41:41 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ad85d1f-7027-4997-96c4-991e3969067d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:41:41 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2cb6475-0dbe-4c85-9d6a-36a75b95e1db]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:41:41 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:41:41 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:41:41 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:41:41 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[b90f65a7-b231-4622-8bc9-7185693cba11]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd579072-cd8e-4ac1-8f84-1afda08a11da (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dccaff76-b907-4a00-b34d-bb5ae7655a02 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4367fb98-2ae9-40c3-a2d0-6e9b0f70dc7c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ad85d1f-7027-4997-96c4-991e3969067d (non-flash)\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:41:41 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759 (non-flash)
Nov 06 15:41:41 user nova-compute[75337]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd579072-cd8e-4ac1-8f84-1afda08a11da (non-flash)
Nov 06 15:41:41 user nova-compute[75337]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dccaff76-b907-4a00-b34d-bb5ae7655a02 (non-flash)
Nov 06 15:41:41 user nova-compute[75337]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4367fb98-2ae9-40c3-a2d0-6e9b0f70dc7c (non-flash)
Nov 06 15:41:41 user nova-compute[75337]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ad85d1f-7027-4997-96c4-991e3969067d (non-flash)
Nov 06 15:41:41 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 15:41:41 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759 (non-flash)
Nov 06 15:41:41 user nova-compute[75337]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd579072-cd8e-4ac1-8f84-1afda08a11da (non-flash)
Nov 06 15:41:41 user nova-compute[75337]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dccaff76-b907-4a00-b34d-bb5ae7655a02 (non-flash)
Nov 06 15:41:41 user nova-compute[75337]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4367fb98-2ae9-40c3-a2d0-6e9b0f70dc7c (non-flash)
Nov 06 15:41:41 user nova-compute[75337]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ad85d1f-7027-4997-96c4-991e3969067d (non-flash)
Nov 06 15:41:41 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 15:41:41 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0ad85d1f-7027-4997-96c4-991e3969067d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.321s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 15:41:41 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Connected to 172.16.0.220:3260 {{(pid=75337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 15:41:41 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] HCTL ('35', '-', '-', 0) found on session 7 with lun 0 {{(pid=75337) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 15:41:41 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75337) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 15:41:41 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:41:41 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:41:41 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[83af3bd4-885f-47ef-a4c7-ed44fc873db9]: (4, ('- - 0', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:41:41 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Searching for a device in session 7 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75337) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 15:41:41 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:0ad85d1f-7027-4997-96c4-991e3969067d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pJrvRwbO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 15:41:41 user nova-compute[75337]: DEBUG nova.compute.manager [req-474d9a59-9dd5-4a73-ba15-c15d993a22ce req-e842691a-8d20-4647-8ec4-6da5bed58fe4 service nova] [instance: 5f5fc58d-f946-4df0-b8d0-1aefbf0f8cd6] Received event network-vif-plugged-9e5c665f-7b51-497e-b9b7-a0f652321a96 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:41:41 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-474d9a59-9dd5-4a73-ba15-c15d993a22ce req-e842691a-8d20-4647-8ec4-6da5bed58fe4 service nova] Acquiring lock "5f5fc58d-f946-4df0-b8d0-1aefbf0f8cd6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:41:41 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-474d9a59-9dd5-4a73-ba15-c15d993a22ce req-e842691a-8d20-4647-8ec4-6da5bed58fe4 service nova] Lock "5f5fc58d-f946-4df0-b8d0-1aefbf0f8cd6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:41:41 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-474d9a59-9dd5-4a73-ba15-c15d993a22ce req-e842691a-8d20-4647-8ec4-6da5bed58fe4 service nova] Lock "5f5fc58d-f946-4df0-b8d0-1aefbf0f8cd6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:41:41 user nova-compute[75337]: DEBUG nova.compute.manager [req-474d9a59-9dd5-4a73-ba15-c15d993a22ce req-e842691a-8d20-4647-8ec4-6da5bed58fe4 service nova] [instance: 5f5fc58d-f946-4df0-b8d0-1aefbf0f8cd6] No waiting events found dispatching network-vif-plugged-9e5c665f-7b51-497e-b9b7-a0f652321a96 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:41:41 user nova-compute[75337]: WARNING nova.compute.manager [req-474d9a59-9dd5-4a73-ba15-c15d993a22ce req-e842691a-8d20-4647-8ec4-6da5bed58fe4 service nova] [instance: 5f5fc58d-f946-4df0-b8d0-1aefbf0f8cd6] Received unexpected event network-vif-plugged-9e5c665f-7b51-497e-b9b7-a0f652321a96 for instance with vm_state active and task_state deleting.
Nov 06 15:41:41 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-b924cfc8-c700-41b5-af96-ffef03d1f6d5 tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 76ee582b-b887-4d46-8c78-29f42d1a0d26 {{(pid=75337) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 06 15:41:41 user nova-compute[75337]: DEBUG nova.network.neutron [-] [instance: 5f5fc58d-f946-4df0-b8d0-1aefbf0f8cd6] Updating instance_info_cache with network_info: [] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:41:41 user nova-compute[75337]: INFO nova.compute.manager [-] [instance: 5f5fc58d-f946-4df0-b8d0-1aefbf0f8cd6] Took 0.74 seconds to deallocate network for instance.
Nov 06 15:41:42 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.363s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 15:41:42 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] <== connect_volume: return (1775ms) {'type': 'block', 'scsi_wwn': '26462633933656265', 'path': '/dev/sdd'} {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 15:41:42 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26462633933656265', 'path': '/dev/sdd'} {{(pid=75337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 15:41:42 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Calling os-brick to attach iSCSI Volume {{(pid=75337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 15:41:42 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2abc33d0c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:eaf5fc54-be7c-4748-9e2f-12a01971e6f4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vqFapLyg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 15:41:42 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 15:41:42 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 15:41:42 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 15:41:42 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 15:41:42 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eaf5fc54-be7c-4748-9e2f-12a01971e6f4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 15:41:42 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eaf5fc54-be7c-4748-9e2f-12a01971e6f4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 15:41:42 user nova-compute[75337]: INFO os_brick.initiator.connectors.iscsi [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 15:41:42 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eaf5fc54-be7c-4748-9e2f-12a01971e6f4 -p 172.16.0.220:3260 {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:41:42 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eaf5fc54-be7c-4748-9e2f-12a01971e6f4 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:41:42 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[df216d83-628d-472d-9003-d87c67342dfe]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:41:42 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 15:41:42 user nova-compute[75337]:  {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:41:42 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eaf5fc54-be7c-4748-9e2f-12a01971e6f4 -p 172.16.0.220:3260 --interface default --op new {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:41:42 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eaf5fc54-be7c-4748-9e2f-12a01971e6f4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:41:42 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f2c5169-c3b0-4401-9f64-d439d77d2317]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:eaf5fc54-be7c-4748-9e2f-12a01971e6f4] added\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:41:42 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:eaf5fc54-be7c-4748-9e2f-12a01971e6f4] added
Nov 06 15:41:42 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:41:42 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eaf5fc54-be7c-4748-9e2f-12a01971e6f4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:41:42 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eaf5fc54-be7c-4748-9e2f-12a01971e6f4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:41:42 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[59c09f5d-19d5-4017-8afe-0dc5eeec2dba]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:41:42 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:41:42 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eaf5fc54-be7c-4748-9e2f-12a01971e6f4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:41:42 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eaf5fc54-be7c-4748-9e2f-12a01971e6f4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:41:42 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd9964f8-6ebd-43cc-b46f-0d4366a10fa0]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:41:42 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:41:42 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eaf5fc54-be7c-4748-9e2f-12a01971e6f4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vqFapLyg {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:41:42 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eaf5fc54-be7c-4748-9e2f-12a01971e6f4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vqFapLyg" returned: 0 in 0.018s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:41:42 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a70889e-f24d-45cd-a7cc-564e3c06cd59]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:41:42 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vqFapLyg'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:41:42 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eaf5fc54-be7c-4748-9e2f-12a01971e6f4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:41:42 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eaf5fc54-be7c-4748-9e2f-12a01971e6f4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:41:42 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2ea4077-f790-49dc-9b26-31fd5833282a]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:41:42 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:41:42 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:41:42 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:41:42 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[63cc57f6-7eb7-4b90-ae73-e68884fab997]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd579072-cd8e-4ac1-8f84-1afda08a11da (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dccaff76-b907-4a00-b34d-bb5ae7655a02 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4367fb98-2ae9-40c3-a2d0-6e9b0f70dc7c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ad85d1f-7027-4997-96c4-991e3969067d (non-flash)\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:41:42 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759 (non-flash)
Nov 06 15:41:42 user nova-compute[75337]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd579072-cd8e-4ac1-8f84-1afda08a11da (non-flash)
Nov 06 15:41:42 user nova-compute[75337]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dccaff76-b907-4a00-b34d-bb5ae7655a02 (non-flash)
Nov 06 15:41:42 user nova-compute[75337]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4367fb98-2ae9-40c3-a2d0-6e9b0f70dc7c (non-flash)
Nov 06 15:41:42 user nova-compute[75337]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ad85d1f-7027-4997-96c4-991e3969067d (non-flash)
Nov 06 15:41:42 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 15:41:42 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759 (non-flash)
Nov 06 15:41:42 user nova-compute[75337]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd579072-cd8e-4ac1-8f84-1afda08a11da (non-flash)
Nov 06 15:41:42 user nova-compute[75337]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dccaff76-b907-4a00-b34d-bb5ae7655a02 (non-flash)
Nov 06 15:41:42 user nova-compute[75337]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4367fb98-2ae9-40c3-a2d0-6e9b0f70dc7c (non-flash)
Nov 06 15:41:42 user nova-compute[75337]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ad85d1f-7027-4997-96c4-991e3969067d (non-flash)
Nov 06 15:41:42 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 15:41:42 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eaf5fc54-be7c-4748-9e2f-12a01971e6f4 -p 172.16.0.220:3260 --login {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:41:42 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eaf5fc54-be7c-4748-9e2f-12a01971e6f4 -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:41:42 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff826b8a-235b-47a2-a2eb-b223dd4ee5fe]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:eaf5fc54-be7c-4748-9e2f-12a01971e6f4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:eaf5fc54-be7c-4748-9e2f-12a01971e6f4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:41:42 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:eaf5fc54-be7c-4748-9e2f-12a01971e6f4, portal: 172.16.0.220,3260]
Nov 06 15:41:42 user nova-compute[75337]: Login to [iface: default, target: iqn.2010-10.org.openstack:eaf5fc54-be7c-4748-9e2f-12a01971e6f4, portal: 172.16.0.220,3260] successful.
Nov 06 15:41:42 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:41:42 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eaf5fc54-be7c-4748-9e2f-12a01971e6f4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:41:42 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eaf5fc54-be7c-4748-9e2f-12a01971e6f4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:41:42 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[10adf65a-9f09-46fa-a37a-7a93df389f18]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:41:42 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:41:42 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:41:42 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:41:42 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[f60b67ab-cf5c-481b-89a9-4a4ca4c3ac48]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd579072-cd8e-4ac1-8f84-1afda08a11da (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dccaff76-b907-4a00-b34d-bb5ae7655a02 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4367fb98-2ae9-40c3-a2d0-6e9b0f70dc7c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ad85d1f-7027-4997-96c4-991e3969067d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaf5fc54-be7c-4748-9e2f-12a01971e6f4 (non-flash)\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:41:42 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759 (non-flash)
Nov 06 15:41:42 user nova-compute[75337]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd579072-cd8e-4ac1-8f84-1afda08a11da (non-flash)
Nov 06 15:41:42 user nova-compute[75337]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dccaff76-b907-4a00-b34d-bb5ae7655a02 (non-flash)
Nov 06 15:41:42 user nova-compute[75337]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4367fb98-2ae9-40c3-a2d0-6e9b0f70dc7c (non-flash)
Nov 06 15:41:42 user nova-compute[75337]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ad85d1f-7027-4997-96c4-991e3969067d (non-flash)
Nov 06 15:41:42 user nova-compute[75337]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaf5fc54-be7c-4748-9e2f-12a01971e6f4 (non-flash)
Nov 06 15:41:42 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 15:41:42 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759 (non-flash)
Nov 06 15:41:42 user nova-compute[75337]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd579072-cd8e-4ac1-8f84-1afda08a11da (non-flash)
Nov 06 15:41:42 user nova-compute[75337]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dccaff76-b907-4a00-b34d-bb5ae7655a02 (non-flash)
Nov 06 15:41:42 user nova-compute[75337]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4367fb98-2ae9-40c3-a2d0-6e9b0f70dc7c (non-flash)
Nov 06 15:41:42 user nova-compute[75337]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ad85d1f-7027-4997-96c4-991e3969067d (non-flash)
Nov 06 15:41:42 user nova-compute[75337]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaf5fc54-be7c-4748-9e2f-12a01971e6f4 (non-flash)
Nov 06 15:41:42 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 15:41:42 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eaf5fc54-be7c-4748-9e2f-12a01971e6f4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.302s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 15:41:42 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Connected to 172.16.0.220:3260 {{(pid=75337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 15:41:42 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] HCTL ('38', '-', '-', 0) found on session 8 with lun 0 {{(pid=75337) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 15:41:42 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75337) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 15:41:42 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:41:42 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.018s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:41:42 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[01f51875-345b-4076-a5c0-750dd24ece80]: (4, ('- - 0', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:41:42 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Searching for a device in session 8 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75337) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 15:41:42 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:eaf5fc54-be7c-4748-9e2f-12a01971e6f4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vqFapLyg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 15:41:43 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:41:43 user nova-compute[75337]: DEBUG nova.compute.manager [req-008783ba-e394-449e-833c-b0927859d578 req-e1971a90-2ee5-4220-8d57-e1fc84179201 service nova] [instance: 5f5fc58d-f946-4df0-b8d0-1aefbf0f8cd6] Received event network-vif-deleted-9e5c665f-7b51-497e-b9b7-a0f652321a96 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:41:43 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.335s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 15:41:43 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] <== connect_volume: return (1336ms) {'type': 'block', 'scsi_wwn': '23936666435333434', 'path': '/dev/sdg'} {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 15:41:43 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23936666435333434', 'path': '/dev/sdg'} {{(pid=75337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 15:41:43 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T15:39:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-33947962',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-33947962',id=10,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIdCNKzLiAn2Q13xbOCD8ZPlD+eO//YVXoFIvGbsPKz6uIG05Zl46YzdZNVppAESHBJ5c7x504UoPOi2h4C/rReLxZIefNMfs782HxaAMxatIuv5bfUOf4RFetVf3rDbPw==',key_name='tempest-keypair-2077757082',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='664f419c1b904bb3bdd7aff9e621e2e4',ramdisk_id='',reservation_id='r-inl405pu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1790653325',owner_user_name='tempest-TaggedBootDevicesTest-1790653325-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T15:39:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8a81cde9102743438dd8b84183048cae',uuid=67d9ceff-c1fc-48ad-85c8-3aa37ebabf11,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5d25f565-70a5-427c-a198-4f88dd8b7338", "address": "fa:16:3e:39:62:9f", "network": {"id": "4b3a9463-7120-499a-bdef-bd2ce9443d88", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1482718546-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "664f419c1b904bb3bdd7aff9e621e2e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d25f565-70", "ovs_interfaceid": "5d25f565-70a5-427c-a198-4f88dd8b7338", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75337) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 15:41:43 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Converting VIF {"id": "5d25f565-70a5-427c-a198-4f88dd8b7338", "address": "fa:16:3e:39:62:9f", "network": {"id": "4b3a9463-7120-499a-bdef-bd2ce9443d88", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1482718546-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "664f419c1b904bb3bdd7aff9e621e2e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d25f565-70", "ovs_interfaceid": "5d25f565-70a5-427c-a198-4f88dd8b7338", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 15:41:43 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:62:9f,bridge_name='br-int',has_traffic_filtering=True,id=5d25f565-70a5-427c-a198-4f88dd8b7338,network=Network(4b3a9463-7120-499a-bdef-bd2ce9443d88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d25f565-70') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 15:41:43 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T15:39:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-33947962',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-33947962',id=10,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIdCNKzLiAn2Q13xbOCD8ZPlD+eO//YVXoFIvGbsPKz6uIG05Zl46YzdZNVppAESHBJ5c7x504UoPOi2h4C/rReLxZIefNMfs782HxaAMxatIuv5bfUOf4RFetVf3rDbPw==',key_name='tempest-keypair-2077757082',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='664f419c1b904bb3bdd7aff9e621e2e4',ramdisk_id='',reservation_id='r-inl405pu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1790653325',owner_user_name='tempest-TaggedBootDevicesTest-1790653325-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T15:39:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8a81cde9102743438dd8b84183048cae',uuid=67d9ceff-c1fc-48ad-85c8-3aa37ebabf11,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ac99553f-c5d8-46df-8357-f1f7f189fa22", "address": "fa:16:3e:37:11:e5", "network": {"id": "793579d8-5696-4c41-b09e-19e19908b703", "bridge": "br-int", "label": "tempest-device-tagging-net1-1052173633", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.61", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "664f419c1b904bb3bdd7aff9e621e2e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac99553f-c5", "ovs_interfaceid": "ac99553f-c5d8-46df-8357-f1f7f189fa22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75337) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 15:41:43 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Converting VIF {"id": "ac99553f-c5d8-46df-8357-f1f7f189fa22", "address": "fa:16:3e:37:11:e5", "network": {"id": "793579d8-5696-4c41-b09e-19e19908b703", "bridge": "br-int", "label": "tempest-device-tagging-net1-1052173633", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.61", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "664f419c1b904bb3bdd7aff9e621e2e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac99553f-c5", "ovs_interfaceid": "ac99553f-c5d8-46df-8357-f1f7f189fa22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 15:41:43 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:11:e5,bridge_name='br-int',has_traffic_filtering=True,id=ac99553f-c5d8-46df-8357-f1f7f189fa22,network=Network(793579d8-5696-4c41-b09e-19e19908b703),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapac99553f-c5') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 15:41:43 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T15:39:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-33947962',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-33947962',id=10,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIdCNKzLiAn2Q13xbOCD8ZPlD+eO//YVXoFIvGbsPKz6uIG05Zl46YzdZNVppAESHBJ5c7x504UoPOi2h4C/rReLxZIefNMfs782HxaAMxatIuv5bfUOf4RFetVf3rDbPw==',key_name='tempest-keypair-2077757082',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='664f419c1b904bb3bdd7aff9e621e2e4',ramdisk_id='',reservation_id='r-inl405pu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1790653325',owner_user_name='tempest-TaggedBootDevicesTest-1790653325-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T15:39:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8a81cde9102743438dd8b84183048cae',uuid=67d9ceff-c1fc-48ad-85c8-3aa37ebabf11,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "abf73a6f-c3c7-46b5-8a9b-0fce5677fa27", "address": "fa:16:3e:68:66:1c", "network": {"id": "793579d8-5696-4c41-b09e-19e19908b703", "bridge": "br-int", "label": "tempest-device-tagging-net1-1052173633", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.239", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "664f419c1b904bb3bdd7aff9e621e2e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabf73a6f-c3", "ovs_interfaceid": "abf73a6f-c3c7-46b5-8a9b-0fce5677fa27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75337) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 15:41:43 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Converting VIF {"id": "abf73a6f-c3c7-46b5-8a9b-0fce5677fa27", "address": "fa:16:3e:68:66:1c", "network": {"id": "793579d8-5696-4c41-b09e-19e19908b703", "bridge": "br-int", "label": "tempest-device-tagging-net1-1052173633", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.239", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "664f419c1b904bb3bdd7aff9e621e2e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabf73a6f-c3", "ovs_interfaceid": "abf73a6f-c3c7-46b5-8a9b-0fce5677fa27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 15:41:43 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:66:1c,bridge_name='br-int',has_traffic_filtering=True,id=abf73a6f-c3c7-46b5-8a9b-0fce5677fa27,network=Network(793579d8-5696-4c41-b09e-19e19908b703),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapabf73a6f-c3') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 15:41:43 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T15:39:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-33947962',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-33947962',id=10,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIdCNKzLiAn2Q13xbOCD8ZPlD+eO//YVXoFIvGbsPKz6uIG05Zl46YzdZNVppAESHBJ5c7x504UoPOi2h4C/rReLxZIefNMfs782HxaAMxatIuv5bfUOf4RFetVf3rDbPw==',key_name='tempest-keypair-2077757082',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='664f419c1b904bb3bdd7aff9e621e2e4',ramdisk_id='',reservation_id='r-inl405pu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1790653325',owner_user_name='tempest-TaggedBootDevicesTest-1790653325-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T15:39:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8a81cde9102743438dd8b84183048cae',uuid=67d9ceff-c1fc-48ad-85c8-3aa37ebabf11,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e87c0766-dd71-4aca-b5f0-32888c7437f5", "address": "fa:16:3e:b5:06:33", "network": {"id": "793579d8-5696-4c41-b09e-19e19908b703", "bridge": "br-int", "label": "tempest-device-tagging-net1-1052173633", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "664f419c1b904bb3bdd7aff9e621e2e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape87c0766-dd", "ovs_interfaceid": "e87c0766-dd71-4aca-b5f0-32888c7437f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75337) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 15:41:43 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Converting VIF {"id": "e87c0766-dd71-4aca-b5f0-32888c7437f5", "address": "fa:16:3e:b5:06:33", "network": {"id": "793579d8-5696-4c41-b09e-19e19908b703", "bridge": "br-int", "label": "tempest-device-tagging-net1-1052173633", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "664f419c1b904bb3bdd7aff9e621e2e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape87c0766-dd", "ovs_interfaceid": "e87c0766-dd71-4aca-b5f0-32888c7437f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 15:41:43 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:06:33,bridge_name='br-int',has_traffic_filtering=True,id=e87c0766-dd71-4aca-b5f0-32888c7437f5,network=Network(793579d8-5696-4c41-b09e-19e19908b703),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape87c0766-dd') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 15:41:43 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T15:39:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-33947962',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-33947962',id=10,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIdCNKzLiAn2Q13xbOCD8ZPlD+eO//YVXoFIvGbsPKz6uIG05Zl46YzdZNVppAESHBJ5c7x504UoPOi2h4C/rReLxZIefNMfs782HxaAMxatIuv5bfUOf4RFetVf3rDbPw==',key_name='tempest-keypair-2077757082',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='664f419c1b904bb3bdd7aff9e621e2e4',ramdisk_id='',reservation_id='r-inl405pu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1790653325',owner_user_name='tempest-TaggedBootDevicesTest-1790653325-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T15:39:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8a81cde9102743438dd8b84183048cae',uuid=67d9ceff-c1fc-48ad-85c8-3aa37ebabf11,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ba50db67-9fb0-49ef-9ea2-db9014b66b17", "address": "fa:16:3e:1a:f9:b0", "network": {"id": "793579d8-5696-4c41-b09e-19e19908b703", "bridge": "br-int", "label": "tempest-device-tagging-net1-1052173633", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "664f419c1b904bb3bdd7aff9e621e2e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba50db67-9f", "ovs_interfaceid": "ba50db67-9fb0-49ef-9ea2-db9014b66b17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75337) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 15:41:43 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Converting VIF {"id": "ba50db67-9fb0-49ef-9ea2-db9014b66b17", "address": "fa:16:3e:1a:f9:b0", "network": {"id": "793579d8-5696-4c41-b09e-19e19908b703", "bridge": "br-int", "label": "tempest-device-tagging-net1-1052173633", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "664f419c1b904bb3bdd7aff9e621e2e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba50db67-9f", "ovs_interfaceid": "ba50db67-9fb0-49ef-9ea2-db9014b66b17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 15:41:43 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:f9:b0,bridge_name='br-int',has_traffic_filtering=True,id=ba50db67-9fb0-49ef-9ea2-db9014b66b17,network=Network(793579d8-5696-4c41-b09e-19e19908b703),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba50db67-9f') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 15:41:43 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T15:39:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-33947962',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-33947962',id=10,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIdCNKzLiAn2Q13xbOCD8ZPlD+eO//YVXoFIvGbsPKz6uIG05Zl46YzdZNVppAESHBJ5c7x504UoPOi2h4C/rReLxZIefNMfs782HxaAMxatIuv5bfUOf4RFetVf3rDbPw==',key_name='tempest-keypair-2077757082',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='664f419c1b904bb3bdd7aff9e621e2e4',ramdisk_id='',reservation_id='r-inl405pu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1790653325',owner_user_name='tempest-TaggedBootDevicesTest-1790653325-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T15:39:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8a81cde9102743438dd8b84183048cae',uuid=67d9ceff-c1fc-48ad-85c8-3aa37ebabf11,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e6be4a87-8794-4e4f-91c1-3c417e0c8d62", "address": "fa:16:3e:df:a8:14", "network": {"id": "512e1b59-3c5a-4be6-bf3d-2ee51ce2042a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1219094622", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "664f419c1b904bb3bdd7aff9e621e2e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6be4a87-87", "ovs_interfaceid": "e6be4a87-8794-4e4f-91c1-3c417e0c8d62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75337) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 15:41:43 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Converting VIF {"id": "e6be4a87-8794-4e4f-91c1-3c417e0c8d62", "address": "fa:16:3e:df:a8:14", "network": {"id": "512e1b59-3c5a-4be6-bf3d-2ee51ce2042a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1219094622", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "664f419c1b904bb3bdd7aff9e621e2e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6be4a87-87", "ovs_interfaceid": "e6be4a87-8794-4e4f-91c1-3c417e0c8d62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 15:41:43 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:a8:14,bridge_name='br-int',has_traffic_filtering=True,id=e6be4a87-8794-4e4f-91c1-3c417e0c8d62,network=Network(512e1b59-3c5a-4be6-bf3d-2ee51ce2042a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6be4a87-87') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 15:41:43 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T15:39:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-33947962',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-33947962',id=10,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIdCNKzLiAn2Q13xbOCD8ZPlD+eO//YVXoFIvGbsPKz6uIG05Zl46YzdZNVppAESHBJ5c7x504UoPOi2h4C/rReLxZIefNMfs782HxaAMxatIuv5bfUOf4RFetVf3rDbPw==',key_name='tempest-keypair-2077757082',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='664f419c1b904bb3bdd7aff9e621e2e4',ramdisk_id='',reservation_id='r-inl405pu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1790653325',owner_user_name='tempest-TaggedBootDevicesTest-1790653325-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T15:39:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8a81cde9102743438dd8b84183048cae',uuid=67d9ceff-c1fc-48ad-85c8-3aa37ebabf11,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "94df5f62-239e-4b8e-a91d-5223c1585f6f", "address": "fa:16:3e:03:8e:66", "network": {"id": "512e1b59-3c5a-4be6-bf3d-2ee51ce2042a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1219094622", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "664f419c1b904bb3bdd7aff9e621e2e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94df5f62-23", "ovs_interfaceid": "94df5f62-239e-4b8e-a91d-5223c1585f6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75337) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 15:41:43 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Converting VIF {"id": "94df5f62-239e-4b8e-a91d-5223c1585f6f", "address": "fa:16:3e:03:8e:66", "network": {"id": "512e1b59-3c5a-4be6-bf3d-2ee51ce2042a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1219094622", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "664f419c1b904bb3bdd7aff9e621e2e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94df5f62-23", "ovs_interfaceid": "94df5f62-239e-4b8e-a91d-5223c1585f6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 15:41:43 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:8e:66,bridge_name='br-int',has_traffic_filtering=True,id=94df5f62-239e-4b8e-a91d-5223c1585f6f,network=Network(512e1b59-3c5a-4be6-bf3d-2ee51ce2042a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94df5f62-23') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 15:41:43 user nova-compute[75337]: DEBUG nova.objects.instance [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Lazy-loading 'pci_devices' on Instance uuid 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 15:41:43 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] End _get_guest_xml xml=<domain type="kvm">
Nov 06 15:41:43 user nova-compute[75337]:   <uuid>67d9ceff-c1fc-48ad-85c8-3aa37ebabf11</uuid>
Nov 06 15:41:43 user nova-compute[75337]:   <name>instance-0000000a</name>
Nov 06 15:41:43 user nova-compute[75337]:   <memory>524288</memory>
Nov 06 15:41:43 user nova-compute[75337]:   <vcpu>1</vcpu>
Nov 06 15:41:43 user nova-compute[75337]:   <metadata>
Nov 06 15:41:43 user nova-compute[75337]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 15:41:43 user nova-compute[75337]:       <nova:package version="0.0.0"/>
Nov 06 15:41:43 user nova-compute[75337]:       <nova:name>tempest-device-tagging-server-33947962</nova:name>
Nov 06 15:41:43 user nova-compute[75337]:       <nova:creationTime>2023-11-06 15:41:38</nova:creationTime>
Nov 06 15:41:43 user nova-compute[75337]:       <nova:flavor name="m1.tiny">
Nov 06 15:41:43 user nova-compute[75337]:         <nova:memory>512</nova:memory>
Nov 06 15:41:43 user nova-compute[75337]:         <nova:disk>1</nova:disk>
Nov 06 15:41:43 user nova-compute[75337]:         <nova:swap>0</nova:swap>
Nov 06 15:41:43 user nova-compute[75337]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 15:41:43 user nova-compute[75337]:         <nova:vcpus>1</nova:vcpus>
Nov 06 15:41:43 user nova-compute[75337]:       </nova:flavor>
Nov 06 15:41:43 user nova-compute[75337]:       <nova:owner>
Nov 06 15:41:43 user nova-compute[75337]:         <nova:user uuid="8a81cde9102743438dd8b84183048cae">tempest-TaggedBootDevicesTest-1790653325-project-member</nova:user>
Nov 06 15:41:43 user nova-compute[75337]:         <nova:project uuid="664f419c1b904bb3bdd7aff9e621e2e4">tempest-TaggedBootDevicesTest-1790653325</nova:project>
Nov 06 15:41:43 user nova-compute[75337]:       </nova:owner>
Nov 06 15:41:43 user nova-compute[75337]:       <nova:root type="image" uuid="16b903ae-a40f-41a7-985b-4804cce92c62"/>
Nov 06 15:41:43 user nova-compute[75337]:       <nova:ports>
Nov 06 15:41:43 user nova-compute[75337]:         <nova:port uuid="5d25f565-70a5-427c-a198-4f88dd8b7338">
Nov 06 15:41:43 user nova-compute[75337]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 06 15:41:43 user nova-compute[75337]:         </nova:port>
Nov 06 15:41:43 user nova-compute[75337]:         <nova:port uuid="ac99553f-c5d8-46df-8357-f1f7f189fa22">
Nov 06 15:41:43 user nova-compute[75337]:           <nova:ip type="fixed" address="10.1.1.61" ipVersion="4"/>
Nov 06 15:41:43 user nova-compute[75337]:         </nova:port>
Nov 06 15:41:43 user nova-compute[75337]:         <nova:port uuid="abf73a6f-c3c7-46b5-8a9b-0fce5677fa27">
Nov 06 15:41:43 user nova-compute[75337]:           <nova:ip type="fixed" address="10.1.1.239" ipVersion="4"/>
Nov 06 15:41:43 user nova-compute[75337]:         </nova:port>
Nov 06 15:41:43 user nova-compute[75337]:         <nova:port uuid="e87c0766-dd71-4aca-b5f0-32888c7437f5">
Nov 06 15:41:43 user nova-compute[75337]:           <nova:ip type="fixed" address="10.1.1.244" ipVersion="4"/>
Nov 06 15:41:43 user nova-compute[75337]:         </nova:port>
Nov 06 15:41:43 user nova-compute[75337]:         <nova:port uuid="ba50db67-9fb0-49ef-9ea2-db9014b66b17">
Nov 06 15:41:43 user nova-compute[75337]:           <nova:ip type="fixed" address="10.1.1.193" ipVersion="4"/>
Nov 06 15:41:43 user nova-compute[75337]:         </nova:port>
Nov 06 15:41:43 user nova-compute[75337]:         <nova:port uuid="e6be4a87-8794-4e4f-91c1-3c417e0c8d62">
Nov 06 15:41:43 user nova-compute[75337]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 06 15:41:43 user nova-compute[75337]:         </nova:port>
Nov 06 15:41:43 user nova-compute[75337]:         <nova:port uuid="94df5f62-239e-4b8e-a91d-5223c1585f6f">
Nov 06 15:41:43 user nova-compute[75337]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 06 15:41:43 user nova-compute[75337]:         </nova:port>
Nov 06 15:41:43 user nova-compute[75337]:       </nova:ports>
Nov 06 15:41:43 user nova-compute[75337]:     </nova:instance>
Nov 06 15:41:43 user nova-compute[75337]:   </metadata>
Nov 06 15:41:43 user nova-compute[75337]:   <sysinfo type="smbios">
Nov 06 15:41:43 user nova-compute[75337]:     <system>
Nov 06 15:41:43 user nova-compute[75337]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 15:41:43 user nova-compute[75337]:       <entry name="product">OpenStack Nova</entry>
Nov 06 15:41:43 user nova-compute[75337]:       <entry name="version">0.0.0</entry>
Nov 06 15:41:43 user nova-compute[75337]:       <entry name="serial">67d9ceff-c1fc-48ad-85c8-3aa37ebabf11</entry>
Nov 06 15:41:43 user nova-compute[75337]:       <entry name="uuid">67d9ceff-c1fc-48ad-85c8-3aa37ebabf11</entry>
Nov 06 15:41:43 user nova-compute[75337]:       <entry name="family">Virtual Machine</entry>
Nov 06 15:41:43 user nova-compute[75337]:     </system>
Nov 06 15:41:43 user nova-compute[75337]:   </sysinfo>
Nov 06 15:41:43 user nova-compute[75337]:   <os>
Nov 06 15:41:43 user nova-compute[75337]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 15:41:43 user nova-compute[75337]:     <boot dev="hd"/>
Nov 06 15:41:43 user nova-compute[75337]:     <smbios mode="sysinfo"/>
Nov 06 15:41:43 user nova-compute[75337]:   </os>
Nov 06 15:41:43 user nova-compute[75337]:   <features>
Nov 06 15:41:43 user nova-compute[75337]:     <acpi/>
Nov 06 15:41:43 user nova-compute[75337]:     <apic/>
Nov 06 15:41:43 user nova-compute[75337]:     <vmcoreinfo/>
Nov 06 15:41:43 user nova-compute[75337]:   </features>
Nov 06 15:41:43 user nova-compute[75337]:   <clock offset="utc">
Nov 06 15:41:43 user nova-compute[75337]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 15:41:43 user nova-compute[75337]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 15:41:43 user nova-compute[75337]:     <timer name="hpet" present="no"/>
Nov 06 15:41:43 user nova-compute[75337]:   </clock>
Nov 06 15:41:43 user nova-compute[75337]:   <cpu mode="custom" match="exact">
Nov 06 15:41:43 user nova-compute[75337]:     <model>Nehalem</model>
Nov 06 15:41:43 user nova-compute[75337]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 15:41:43 user nova-compute[75337]:   </cpu>
Nov 06 15:41:43 user nova-compute[75337]:   <devices>
Nov 06 15:41:43 user nova-compute[75337]:     <disk type="file" device="cdrom">
Nov 06 15:41:43 user nova-compute[75337]:       <driver name="qemu" type="raw" cache="none"/>
Nov 06 15:41:43 user nova-compute[75337]:       <source file="/opt/stack/data/nova/instances/67d9ceff-c1fc-48ad-85c8-3aa37ebabf11/disk.config"/>
Nov 06 15:41:43 user nova-compute[75337]:       <target dev="hda" bus="ide"/>
Nov 06 15:41:43 user nova-compute[75337]:     </disk>
Nov 06 15:41:43 user nova-compute[75337]:     <disk type="block" device="disk">
Nov 06 15:41:43 user nova-compute[75337]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 15:41:43 user nova-compute[75337]:       <source dev="/dev/sdf"/>
Nov 06 15:41:43 user nova-compute[75337]:       <target dev="vda" bus="virtio"/>
Nov 06 15:41:43 user nova-compute[75337]:       <serial>4367fb98-2ae9-40c3-a2d0-6e9b0f70dc7c</serial>
Nov 06 15:41:43 user nova-compute[75337]:     </disk>
Nov 06 15:41:43 user nova-compute[75337]:     <disk type="block" device="disk">
Nov 06 15:41:43 user nova-compute[75337]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 15:41:43 user nova-compute[75337]:       <source dev="/dev/sdd"/>
Nov 06 15:41:43 user nova-compute[75337]:       <target dev="vdb" bus="virtio"/>
Nov 06 15:41:43 user nova-compute[75337]:       <serial>0ad85d1f-7027-4997-96c4-991e3969067d</serial>
Nov 06 15:41:43 user nova-compute[75337]:     </disk>
Nov 06 15:41:43 user nova-compute[75337]:     <disk type="block" device="disk">
Nov 06 15:41:43 user nova-compute[75337]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 15:41:43 user nova-compute[75337]:       <source dev="/dev/sdg"/>
Nov 06 15:41:43 user nova-compute[75337]:       <target dev="vdc" bus="virtio"/>
Nov 06 15:41:43 user nova-compute[75337]:       <serial>eaf5fc54-be7c-4748-9e2f-12a01971e6f4</serial>
Nov 06 15:41:43 user nova-compute[75337]:     </disk>
Nov 06 15:41:43 user nova-compute[75337]:     <interface type="ethernet">
Nov 06 15:41:43 user nova-compute[75337]:       <mac address="fa:16:3e:39:62:9f"/>
Nov 06 15:41:43 user nova-compute[75337]:       <model type="virtio"/>
Nov 06 15:41:43 user nova-compute[75337]:       <mtu size="1442"/>
Nov 06 15:41:43 user nova-compute[75337]:       <target dev="tap5d25f565-70"/>
Nov 06 15:41:43 user nova-compute[75337]:     </interface>
Nov 06 15:41:43 user nova-compute[75337]:     <interface type="ethernet">
Nov 06 15:41:43 user nova-compute[75337]:       <mac address="fa:16:3e:37:11:e5"/>
Nov 06 15:41:43 user nova-compute[75337]:       <model type="virtio"/>
Nov 06 15:41:43 user nova-compute[75337]:       <mtu size="1442"/>
Nov 06 15:41:43 user nova-compute[75337]:       <target dev="tapac99553f-c5"/>
Nov 06 15:41:43 user nova-compute[75337]:     </interface>
Nov 06 15:41:43 user nova-compute[75337]:     <interface type="ethernet">
Nov 06 15:41:43 user nova-compute[75337]:       <mac address="fa:16:3e:68:66:1c"/>
Nov 06 15:41:43 user nova-compute[75337]:       <model type="virtio"/>
Nov 06 15:41:43 user nova-compute[75337]:       <mtu size="1442"/>
Nov 06 15:41:43 user nova-compute[75337]:       <target dev="tapabf73a6f-c3"/>
Nov 06 15:41:43 user nova-compute[75337]:     </interface>
Nov 06 15:41:43 user nova-compute[75337]:     <interface type="ethernet">
Nov 06 15:41:43 user nova-compute[75337]:       <mac address="fa:16:3e:b5:06:33"/>
Nov 06 15:41:43 user nova-compute[75337]:       <model type="virtio"/>
Nov 06 15:41:43 user nova-compute[75337]:       <mtu size="1442"/>
Nov 06 15:41:43 user nova-compute[75337]:       <target dev="tape87c0766-dd"/>
Nov 06 15:41:43 user nova-compute[75337]:     </interface>
Nov 06 15:41:43 user nova-compute[75337]:     <interface type="ethernet">
Nov 06 15:41:43 user nova-compute[75337]:       <mac address="fa:16:3e:1a:f9:b0"/>
Nov 06 15:41:43 user nova-compute[75337]:       <model type="virtio"/>
Nov 06 15:41:43 user nova-compute[75337]:       <mtu size="1442"/>
Nov 06 15:41:43 user nova-compute[75337]:       <target dev="tapba50db67-9f"/>
Nov 06 15:41:43 user nova-compute[75337]:     </interface>
Nov 06 15:41:43 user nova-compute[75337]:     <interface type="ethernet">
Nov 06 15:41:43 user nova-compute[75337]:       <mac address="fa:16:3e:df:a8:14"/>
Nov 06 15:41:43 user nova-compute[75337]:       <model type="virtio"/>
Nov 06 15:41:43 user nova-compute[75337]:       <mtu size="1442"/>
Nov 06 15:41:43 user nova-compute[75337]:       <target dev="tape6be4a87-87"/>
Nov 06 15:41:43 user nova-compute[75337]:     </interface>
Nov 06 15:41:43 user nova-compute[75337]:     <interface type="ethernet">
Nov 06 15:41:43 user nova-compute[75337]:       <mac address="fa:16:3e:03:8e:66"/>
Nov 06 15:41:43 user nova-compute[75337]:       <model type="virtio"/>
Nov 06 15:41:43 user nova-compute[75337]:       <mtu size="1442"/>
Nov 06 15:41:43 user nova-compute[75337]:       <target dev="tap94df5f62-23"/>
Nov 06 15:41:43 user nova-compute[75337]:     </interface>
Nov 06 15:41:43 user nova-compute[75337]:     <serial type="pty">
Nov 06 15:41:43 user nova-compute[75337]:       <log file="/opt/stack/data/nova/instances/67d9ceff-c1fc-48ad-85c8-3aa37ebabf11/console.log" append="off"/>
Nov 06 15:41:43 user nova-compute[75337]:     </serial>
Nov 06 15:41:43 user nova-compute[75337]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 15:41:43 user nova-compute[75337]:     <video>
Nov 06 15:41:43 user nova-compute[75337]:       <model type="virtio"/>
Nov 06 15:41:43 user nova-compute[75337]:     </video>
Nov 06 15:41:43 user nova-compute[75337]:     <rng model="virtio">
Nov 06 15:41:43 user nova-compute[75337]:       <backend model="random">/dev/urandom</backend>
Nov 06 15:41:43 user nova-compute[75337]:     </rng>
Nov 06 15:41:43 user nova-compute[75337]:     <controller type="usb" index="0" model="none"/>
Nov 06 15:41:43 user nova-compute[75337]:     <memballoon model="virtio">
Nov 06 15:41:43 user nova-compute[75337]:       <stats period="10"/>
Nov 06 15:41:43 user nova-compute[75337]:     </memballoon>
Nov 06 15:41:43 user nova-compute[75337]:   </devices>
Nov 06 15:41:43 user nova-compute[75337]: </domain>
Nov 06 15:41:43 user nova-compute[75337]:  {{(pid=75337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 15:41:43 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T15:39:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-33947962',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-33947962',id=10,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIdCNKzLiAn2Q13xbOCD8ZPlD+eO//YVXoFIvGbsPKz6uIG05Zl46YzdZNVppAESHBJ5c7x504UoPOi2h4C/rReLxZIefNMfs782HxaAMxatIuv5bfUOf4RFetVf3rDbPw==',key_name='tempest-keypair-2077757082',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='664f419c1b904bb3bdd7aff9e621e2e4',ramdisk_id='',reservation_id='r-inl405pu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1790653325',owner_user_name='tempest-TaggedBootDevicesTest-1790653325-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T15:39:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8a81cde9102743438dd8b84183048cae',uuid=67d9ceff-c1fc-48ad-85c8-3aa37ebabf11,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5d25f565-70a5-427c-a198-4f88dd8b7338", "address": "fa:16:3e:39:62:9f", "network": {"id": "4b3a9463-7120-499a-bdef-bd2ce9443d88", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1482718546-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "664f419c1b904bb3bdd7aff9e621e2e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d25f565-70", "ovs_interfaceid": "5d25f565-70a5-427c-a198-4f88dd8b7338", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 15:41:43 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Converting VIF {"id": "5d25f565-70a5-427c-a198-4f88dd8b7338", "address": "fa:16:3e:39:62:9f", "network": {"id": "4b3a9463-7120-499a-bdef-bd2ce9443d88", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1482718546-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "664f419c1b904bb3bdd7aff9e621e2e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d25f565-70", "ovs_interfaceid": "5d25f565-70a5-427c-a198-4f88dd8b7338", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 15:41:43 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:62:9f,bridge_name='br-int',has_traffic_filtering=True,id=5d25f565-70a5-427c-a198-4f88dd8b7338,network=Network(4b3a9463-7120-499a-bdef-bd2ce9443d88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d25f565-70') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 15:41:43 user nova-compute[75337]: DEBUG os_vif [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:62:9f,bridge_name='br-int',has_traffic_filtering=True,id=5d25f565-70a5-427c-a198-4f88dd8b7338,network=Network(4b3a9463-7120-499a-bdef-bd2ce9443d88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d25f565-70') {{(pid=75337) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 15:41:43 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:41:43 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:41:43 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 15:41:43 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:41:43 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd0ec1725-5dcb-530f-bd6e-4c96277fee4f', '_type': 'linux-noop'}}, row=False) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:41:43 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:41:43 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:41:43 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:41:43 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5d25f565-70, may_exist=True, interface_attrs={}) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:41:43 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5d25f565-70, col_values=(('qos', UUID('4c5224b9-1d28-4d07-872f-899aa3a27b11')),), if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:41:43 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5d25f565-70, col_values=(('external_ids', {'iface-id': '5d25f565-70a5-427c-a198-4f88dd8b7338', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:39:62:9f', 'vm-uuid': '67d9ceff-c1fc-48ad-85c8-3aa37ebabf11'}),), if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:41:43 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:41:43 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:41:43 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:41:43 user nova-compute[75337]: INFO os_vif [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:62:9f,bridge_name='br-int',has_traffic_filtering=True,id=5d25f565-70a5-427c-a198-4f88dd8b7338,network=Network(4b3a9463-7120-499a-bdef-bd2ce9443d88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d25f565-70')
Nov 06 15:41:43 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T15:39:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-33947962',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-33947962',id=10,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIdCNKzLiAn2Q13xbOCD8ZPlD+eO//YVXoFIvGbsPKz6uIG05Zl46YzdZNVppAESHBJ5c7x504UoPOi2h4C/rReLxZIefNMfs782HxaAMxatIuv5bfUOf4RFetVf3rDbPw==',key_name='tempest-keypair-2077757082',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='664f419c1b904bb3bdd7aff9e621e2e4',ramdisk_id='',reservation_id='r-inl405pu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1790653325',owner_user_name='tempest-TaggedBootDevicesTest-1790653325-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T15:39:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8a81cde9102743438dd8b84183048cae',uuid=67d9ceff-c1fc-48ad-85c8-3aa37ebabf11,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ac99553f-c5d8-46df-8357-f1f7f189fa22", "address": "fa:16:3e:37:11:e5", "network": {"id": "793579d8-5696-4c41-b09e-19e19908b703", "bridge": "br-int", "label": "tempest-device-tagging-net1-1052173633", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.61", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "664f419c1b904bb3bdd7aff9e621e2e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac99553f-c5", "ovs_interfaceid": "ac99553f-c5d8-46df-8357-f1f7f189fa22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75337) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 15:41:43 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Converting VIF {"id": "ac99553f-c5d8-46df-8357-f1f7f189fa22", "address": "fa:16:3e:37:11:e5", "network": {"id": "793579d8-5696-4c41-b09e-19e19908b703", "bridge": "br-int", "label": "tempest-device-tagging-net1-1052173633", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.61", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "664f419c1b904bb3bdd7aff9e621e2e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac99553f-c5", "ovs_interfaceid": "ac99553f-c5d8-46df-8357-f1f7f189fa22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 15:41:43 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:11:e5,bridge_name='br-int',has_traffic_filtering=True,id=ac99553f-c5d8-46df-8357-f1f7f189fa22,network=Network(793579d8-5696-4c41-b09e-19e19908b703),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapac99553f-c5') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 15:41:43 user nova-compute[75337]: DEBUG os_vif [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:11:e5,bridge_name='br-int',has_traffic_filtering=True,id=ac99553f-c5d8-46df-8357-f1f7f189fa22,network=Network(793579d8-5696-4c41-b09e-19e19908b703),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapac99553f-c5') {{(pid=75337) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 15:41:43 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:41:43 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:41:43 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 15:41:43 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:41:43 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2d540eb4-0fc4-543a-97da-88fb7a8aef95', '_type': 'linux-noop'}}, row=False) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:41:43 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:41:43 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:41:43 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:41:43 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:41:43 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapac99553f-c5, may_exist=True, interface_attrs={}) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:41:43 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapac99553f-c5, col_values=(('qos', UUID('d2a2e8e6-14a8-49f2-88f7-eea2e9388ef5')),), if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:41:43 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapac99553f-c5, col_values=(('external_ids', {'iface-id': 'ac99553f-c5d8-46df-8357-f1f7f189fa22', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:37:11:e5', 'vm-uuid': '67d9ceff-c1fc-48ad-85c8-3aa37ebabf11'}),), if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:41:43 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:41:43 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:41:43 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:41:43 user nova-compute[75337]: INFO os_vif [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:11:e5,bridge_name='br-int',has_traffic_filtering=True,id=ac99553f-c5d8-46df-8357-f1f7f189fa22,network=Network(793579d8-5696-4c41-b09e-19e19908b703),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapac99553f-c5')
Nov 06 15:41:43 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T15:39:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-33947962',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-33947962',id=10,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIdCNKzLiAn2Q13xbOCD8ZPlD+eO//YVXoFIvGbsPKz6uIG05Zl46YzdZNVppAESHBJ5c7x504UoPOi2h4C/rReLxZIefNMfs782HxaAMxatIuv5bfUOf4RFetVf3rDbPw==',key_name='tempest-keypair-2077757082',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='664f419c1b904bb3bdd7aff9e621e2e4',ramdisk_id='',reservation_id='r-inl405pu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1790653325',owner_user_name='tempest-TaggedBootDevicesTest-1790653325-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T15:39:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8a81cde9102743438dd8b84183048cae',uuid=67d9ceff-c1fc-48ad-85c8-3aa37ebabf11,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "abf73a6f-c3c7-46b5-8a9b-0fce5677fa27", "address": "fa:16:3e:68:66:1c", "network": {"id": "793579d8-5696-4c41-b09e-19e19908b703", "bridge": "br-int", "label": "tempest-device-tagging-net1-1052173633", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.239", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "664f419c1b904bb3bdd7aff9e621e2e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabf73a6f-c3", "ovs_interfaceid": "abf73a6f-c3c7-46b5-8a9b-0fce5677fa27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75337) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 15:41:43 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Converting VIF {"id": "abf73a6f-c3c7-46b5-8a9b-0fce5677fa27", "address": "fa:16:3e:68:66:1c", "network": {"id": "793579d8-5696-4c41-b09e-19e19908b703", "bridge": "br-int", "label": "tempest-device-tagging-net1-1052173633", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.239", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "664f419c1b904bb3bdd7aff9e621e2e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabf73a6f-c3", "ovs_interfaceid": "abf73a6f-c3c7-46b5-8a9b-0fce5677fa27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 15:41:43 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:66:1c,bridge_name='br-int',has_traffic_filtering=True,id=abf73a6f-c3c7-46b5-8a9b-0fce5677fa27,network=Network(793579d8-5696-4c41-b09e-19e19908b703),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapabf73a6f-c3') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 15:41:43 user nova-compute[75337]: DEBUG os_vif [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:66:1c,bridge_name='br-int',has_traffic_filtering=True,id=abf73a6f-c3c7-46b5-8a9b-0fce5677fa27,network=Network(793579d8-5696-4c41-b09e-19e19908b703),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapabf73a6f-c3') {{(pid=75337) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 15:41:43 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:41:43 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:41:43 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 15:41:43 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:41:43 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5cb71d94-b120-52c8-89cd-e3d4eb110174', '_type': 'linux-noop'}}, row=False) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:41:43 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:41:43 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:41:43 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:41:43 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:41:43 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapabf73a6f-c3, may_exist=True, interface_attrs={}) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:41:43 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapabf73a6f-c3, col_values=(('qos', UUID('c9e41bd1-1fcc-4717-b62f-1c6f85082a59')),), if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:41:43 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapabf73a6f-c3, col_values=(('external_ids', {'iface-id': 'abf73a6f-c3c7-46b5-8a9b-0fce5677fa27', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:68:66:1c', 'vm-uuid': '67d9ceff-c1fc-48ad-85c8-3aa37ebabf11'}),), if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:41:43 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:41:43 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:41:43 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:41:43 user nova-compute[75337]: INFO os_vif [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:66:1c,bridge_name='br-int',has_traffic_filtering=True,id=abf73a6f-c3c7-46b5-8a9b-0fce5677fa27,network=Network(793579d8-5696-4c41-b09e-19e19908b703),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapabf73a6f-c3')
Nov 06 15:41:43 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T15:39:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-33947962',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-33947962',id=10,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIdCNKzLiAn2Q13xbOCD8ZPlD+eO//YVXoFIvGbsPKz6uIG05Zl46YzdZNVppAESHBJ5c7x504UoPOi2h4C/rReLxZIefNMfs782HxaAMxatIuv5bfUOf4RFetVf3rDbPw==',key_name='tempest-keypair-2077757082',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='664f419c1b904bb3bdd7aff9e621e2e4',ramdisk_id='',reservation_id='r-inl405pu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1790653325',owner_user_name='tempest-TaggedBootDevicesTest-1790653325-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T15:39:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8a81cde9102743438dd8b84183048cae',uuid=67d9ceff-c1fc-48ad-85c8-3aa37ebabf11,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e87c0766-dd71-4aca-b5f0-32888c7437f5", "address": "fa:16:3e:b5:06:33", "network": {"id": "793579d8-5696-4c41-b09e-19e19908b703", "bridge": "br-int", "label": "tempest-device-tagging-net1-1052173633", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "664f419c1b904bb3bdd7aff9e621e2e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape87c0766-dd", "ovs_interfaceid": "e87c0766-dd71-4aca-b5f0-32888c7437f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 15:41:43 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Converting VIF {"id": "e87c0766-dd71-4aca-b5f0-32888c7437f5", "address": "fa:16:3e:b5:06:33", "network": {"id": "793579d8-5696-4c41-b09e-19e19908b703", "bridge": "br-int", "label": "tempest-device-tagging-net1-1052173633", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "664f419c1b904bb3bdd7aff9e621e2e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape87c0766-dd", "ovs_interfaceid": "e87c0766-dd71-4aca-b5f0-32888c7437f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 15:41:43 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:06:33,bridge_name='br-int',has_traffic_filtering=True,id=e87c0766-dd71-4aca-b5f0-32888c7437f5,network=Network(793579d8-5696-4c41-b09e-19e19908b703),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape87c0766-dd') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 15:41:43 user nova-compute[75337]: DEBUG os_vif [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:06:33,bridge_name='br-int',has_traffic_filtering=True,id=e87c0766-dd71-4aca-b5f0-32888c7437f5,network=Network(793579d8-5696-4c41-b09e-19e19908b703),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape87c0766-dd') {{(pid=75337) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 15:41:43 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:41:43 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:41:43 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 15:41:43 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:41:43 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'afa9665e-a266-504b-861b-4a64aee3615a', '_type': 'linux-noop'}}, row=False) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:41:43 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:41:43 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:41:43 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:41:43 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:41:43 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape87c0766-dd, may_exist=True, interface_attrs={}) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:41:43 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape87c0766-dd, col_values=(('qos', UUID('f469b7fc-c522-4c88-babc-e58b0826d9e0')),), if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:41:43 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape87c0766-dd, col_values=(('external_ids', {'iface-id': 'e87c0766-dd71-4aca-b5f0-32888c7437f5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b5:06:33', 'vm-uuid': '67d9ceff-c1fc-48ad-85c8-3aa37ebabf11'}),), if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:41:43 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:41:43 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:41:44 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:41:44 user nova-compute[75337]: INFO os_vif [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:06:33,bridge_name='br-int',has_traffic_filtering=True,id=e87c0766-dd71-4aca-b5f0-32888c7437f5,network=Network(793579d8-5696-4c41-b09e-19e19908b703),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape87c0766-dd')
Nov 06 15:41:44 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T15:39:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-33947962',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-33947962',id=10,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIdCNKzLiAn2Q13xbOCD8ZPlD+eO//YVXoFIvGbsPKz6uIG05Zl46YzdZNVppAESHBJ5c7x504UoPOi2h4C/rReLxZIefNMfs782HxaAMxatIuv5bfUOf4RFetVf3rDbPw==',key_name='tempest-keypair-2077757082',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='664f419c1b904bb3bdd7aff9e621e2e4',ramdisk_id='',reservation_id='r-inl405pu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1790653325',owner_user_name='tempest-TaggedBootDevicesTest-1790653325-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T15:39:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8a81cde9102743438dd8b84183048cae',uuid=67d9ceff-c1fc-48ad-85c8-3aa37ebabf11,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ba50db67-9fb0-49ef-9ea2-db9014b66b17", "address": "fa:16:3e:1a:f9:b0", "network": {"id": "793579d8-5696-4c41-b09e-19e19908b703", "bridge": "br-int", "label": "tempest-device-tagging-net1-1052173633", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "664f419c1b904bb3bdd7aff9e621e2e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba50db67-9f", "ovs_interfaceid": "ba50db67-9fb0-49ef-9ea2-db9014b66b17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 15:41:44 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Converting VIF {"id": "ba50db67-9fb0-49ef-9ea2-db9014b66b17", "address": "fa:16:3e:1a:f9:b0", "network": {"id": "793579d8-5696-4c41-b09e-19e19908b703", "bridge": "br-int", "label": "tempest-device-tagging-net1-1052173633", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "664f419c1b904bb3bdd7aff9e621e2e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba50db67-9f", "ovs_interfaceid": "ba50db67-9fb0-49ef-9ea2-db9014b66b17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 15:41:44 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:f9:b0,bridge_name='br-int',has_traffic_filtering=True,id=ba50db67-9fb0-49ef-9ea2-db9014b66b17,network=Network(793579d8-5696-4c41-b09e-19e19908b703),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba50db67-9f') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 15:41:44 user nova-compute[75337]: DEBUG os_vif [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:f9:b0,bridge_name='br-int',has_traffic_filtering=True,id=ba50db67-9fb0-49ef-9ea2-db9014b66b17,network=Network(793579d8-5696-4c41-b09e-19e19908b703),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba50db67-9f') {{(pid=75337) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 15:41:44 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:41:44 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:41:44 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 15:41:44 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:41:44 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd8c8f17b-1751-521a-8739-32330fbc08c0', '_type': 'linux-noop'}}, row=False) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:41:44 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:41:44 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:41:44 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:41:44 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:41:44 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapba50db67-9f, may_exist=True, interface_attrs={}) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:41:44 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapba50db67-9f, col_values=(('qos', UUID('37af5355-180a-46d5-b652-e5b5e69af4eb')),), if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:41:44 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapba50db67-9f, col_values=(('external_ids', {'iface-id': 'ba50db67-9fb0-49ef-9ea2-db9014b66b17', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1a:f9:b0', 'vm-uuid': '67d9ceff-c1fc-48ad-85c8-3aa37ebabf11'}),), if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:41:44 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:41:44 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:41:44 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:41:44 user nova-compute[75337]: INFO os_vif [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:f9:b0,bridge_name='br-int',has_traffic_filtering=True,id=ba50db67-9fb0-49ef-9ea2-db9014b66b17,network=Network(793579d8-5696-4c41-b09e-19e19908b703),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba50db67-9f')
Nov 06 15:41:44 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T15:39:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-33947962',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-33947962',id=10,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIdCNKzLiAn2Q13xbOCD8ZPlD+eO//YVXoFIvGbsPKz6uIG05Zl46YzdZNVppAESHBJ5c7x504UoPOi2h4C/rReLxZIefNMfs782HxaAMxatIuv5bfUOf4RFetVf3rDbPw==',key_name='tempest-keypair-2077757082',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='664f419c1b904bb3bdd7aff9e621e2e4',ramdisk_id='',reservation_id='r-inl405pu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1790653325',owner_user_name='tempest-TaggedBootDevicesTest-1790653325-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T15:39:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8a81cde9102743438dd8b84183048cae',uuid=67d9ceff-c1fc-48ad-85c8-3aa37ebabf11,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e6be4a87-8794-4e4f-91c1-3c417e0c8d62", "address": "fa:16:3e:df:a8:14", "network": {"id": "512e1b59-3c5a-4be6-bf3d-2ee51ce2042a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1219094622", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "664f419c1b904bb3bdd7aff9e621e2e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6be4a87-87", "ovs_interfaceid": "e6be4a87-8794-4e4f-91c1-3c417e0c8d62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 15:41:44 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Converting VIF {"id": "e6be4a87-8794-4e4f-91c1-3c417e0c8d62", "address": "fa:16:3e:df:a8:14", "network": {"id": "512e1b59-3c5a-4be6-bf3d-2ee51ce2042a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1219094622", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "664f419c1b904bb3bdd7aff9e621e2e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6be4a87-87", "ovs_interfaceid": "e6be4a87-8794-4e4f-91c1-3c417e0c8d62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 15:41:44 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:a8:14,bridge_name='br-int',has_traffic_filtering=True,id=e6be4a87-8794-4e4f-91c1-3c417e0c8d62,network=Network(512e1b59-3c5a-4be6-bf3d-2ee51ce2042a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6be4a87-87') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 15:41:44 user nova-compute[75337]: DEBUG os_vif [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:a8:14,bridge_name='br-int',has_traffic_filtering=True,id=e6be4a87-8794-4e4f-91c1-3c417e0c8d62,network=Network(512e1b59-3c5a-4be6-bf3d-2ee51ce2042a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6be4a87-87') {{(pid=75337) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 15:41:44 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:41:44 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:41:44 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 15:41:44 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:41:44 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cb79c11d-91ac-56e0-a218-54a78678e89d', '_type': 'linux-noop'}}, row=False) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:41:44 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:41:44 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:41:44 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:41:44 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:41:44 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape6be4a87-87, may_exist=True, interface_attrs={}) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:41:44 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape6be4a87-87, col_values=(('qos', UUID('9bb95b9c-cdb8-42a8-881d-789cfc9a9c03')),), if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:41:44 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape6be4a87-87, col_values=(('external_ids', {'iface-id': 'e6be4a87-8794-4e4f-91c1-3c417e0c8d62', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:df:a8:14', 'vm-uuid': '67d9ceff-c1fc-48ad-85c8-3aa37ebabf11'}),), if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:41:44 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:41:44 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:41:44 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:41:44 user nova-compute[75337]: INFO os_vif [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:a8:14,bridge_name='br-int',has_traffic_filtering=True,id=e6be4a87-8794-4e4f-91c1-3c417e0c8d62,network=Network(512e1b59-3c5a-4be6-bf3d-2ee51ce2042a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6be4a87-87')
Nov 06 15:41:44 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T15:39:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-33947962',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-33947962',id=10,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIdCNKzLiAn2Q13xbOCD8ZPlD+eO//YVXoFIvGbsPKz6uIG05Zl46YzdZNVppAESHBJ5c7x504UoPOi2h4C/rReLxZIefNMfs782HxaAMxatIuv5bfUOf4RFetVf3rDbPw==',key_name='tempest-keypair-2077757082',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='664f419c1b904bb3bdd7aff9e621e2e4',ramdisk_id='',reservation_id='r-inl405pu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1790653325',owner_user_name='tempest-TaggedBootDevicesTest-1790653325-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T15:39:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8a81cde9102743438dd8b84183048cae',uuid=67d9ceff-c1fc-48ad-85c8-3aa37ebabf11,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "94df5f62-239e-4b8e-a91d-5223c1585f6f", "address": "fa:16:3e:03:8e:66", "network": {"id": "512e1b59-3c5a-4be6-bf3d-2ee51ce2042a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1219094622", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "664f419c1b904bb3bdd7aff9e621e2e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94df5f62-23", "ovs_interfaceid": "94df5f62-239e-4b8e-a91d-5223c1585f6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 15:41:44 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Converting VIF {"id": "94df5f62-239e-4b8e-a91d-5223c1585f6f", "address": "fa:16:3e:03:8e:66", "network": {"id": "512e1b59-3c5a-4be6-bf3d-2ee51ce2042a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1219094622", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "664f419c1b904bb3bdd7aff9e621e2e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94df5f62-23", "ovs_interfaceid": "94df5f62-239e-4b8e-a91d-5223c1585f6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 15:41:44 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:8e:66,bridge_name='br-int',has_traffic_filtering=True,id=94df5f62-239e-4b8e-a91d-5223c1585f6f,network=Network(512e1b59-3c5a-4be6-bf3d-2ee51ce2042a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94df5f62-23') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 15:41:44 user nova-compute[75337]: DEBUG os_vif [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:8e:66,bridge_name='br-int',has_traffic_filtering=True,id=94df5f62-239e-4b8e-a91d-5223c1585f6f,network=Network(512e1b59-3c5a-4be6-bf3d-2ee51ce2042a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94df5f62-23') {{(pid=75337) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 15:41:44 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:41:44 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:41:44 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 15:41:44 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:41:44 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a2d6e177-915b-516b-bd34-fa85c2605bf2', '_type': 'linux-noop'}}, row=False) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:41:44 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:41:44 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:41:44 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:41:44 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:41:44 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap94df5f62-23, may_exist=True, interface_attrs={}) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:41:44 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap94df5f62-23, col_values=(('qos', UUID('fe134bad-f592-4ef1-9aaf-7a99085492f0')),), if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:41:44 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap94df5f62-23, col_values=(('external_ids', {'iface-id': '94df5f62-239e-4b8e-a91d-5223c1585f6f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:03:8e:66', 'vm-uuid': '67d9ceff-c1fc-48ad-85c8-3aa37ebabf11'}),), if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:41:44 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:41:44 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:41:44 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:41:44 user nova-compute[75337]: INFO os_vif [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:8e:66,bridge_name='br-int',has_traffic_filtering=True,id=94df5f62-239e-4b8e-a91d-5223c1585f6f,network=Network(512e1b59-3c5a-4be6-bf3d-2ee51ce2042a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94df5f62-23')
Nov 06 15:41:44 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] No BDM found with device name hda, not building metadata. {{(pid=75337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 15:41:44 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 15:41:44 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] No VIF found with MAC fa:16:3e:39:62:9f, not building metadata {{(pid=75337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 15:41:44 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] No VIF found with MAC fa:16:3e:1a:f9:b0, not building metadata {{(pid=75337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 15:41:44 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Using config drive
Nov 06 15:41:44 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Creating config drive at /opt/stack/data/nova/instances/67d9ceff-c1fc-48ad-85c8-3aa37ebabf11/disk.config
Nov 06 15:41:44 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/67d9ceff-c1fc-48ad-85c8-3aa37ebabf11/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpzfa9e6f6 {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:41:44 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/67d9ceff-c1fc-48ad-85c8-3aa37ebabf11/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpzfa9e6f6" returned: 0 in 0.071s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:41:46 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:41:46 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:41:46 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:41:46 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:41:46 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:41:46 user nova-compute[75337]: DEBUG nova.compute.manager [req-bca95a59-062b-4980-b376-f1315ae44325 req-b556cfab-7ae7-4b9c-aeea-fcf3592edf3e service nova] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Received event network-vif-plugged-5d25f565-70a5-427c-a198-4f88dd8b7338 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:41:46 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-bca95a59-062b-4980-b376-f1315ae44325 req-b556cfab-7ae7-4b9c-aeea-fcf3592edf3e service nova] Acquiring lock "67d9ceff-c1fc-48ad-85c8-3aa37ebabf11-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:41:46 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-bca95a59-062b-4980-b376-f1315ae44325 req-b556cfab-7ae7-4b9c-aeea-fcf3592edf3e service nova] Lock "67d9ceff-c1fc-48ad-85c8-3aa37ebabf11-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:41:46 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-bca95a59-062b-4980-b376-f1315ae44325 req-b556cfab-7ae7-4b9c-aeea-fcf3592edf3e service nova] Lock "67d9ceff-c1fc-48ad-85c8-3aa37ebabf11-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:41:46 user nova-compute[75337]: DEBUG nova.compute.manager [req-bca95a59-062b-4980-b376-f1315ae44325 req-b556cfab-7ae7-4b9c-aeea-fcf3592edf3e service nova] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] No waiting events found dispatching network-vif-plugged-5d25f565-70a5-427c-a198-4f88dd8b7338 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:41:46 user nova-compute[75337]: WARNING nova.compute.manager [req-bca95a59-062b-4980-b376-f1315ae44325 req-b556cfab-7ae7-4b9c-aeea-fcf3592edf3e service nova] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Received unexpected event network-vif-plugged-5d25f565-70a5-427c-a198-4f88dd8b7338 for instance with vm_state building and task_state spawning.
Nov 06 15:41:46 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0f20753-ef20-408e-88c1-e1c136e7c41a tempest-VolumesAssistedSnapshotsTest-123777916 tempest-VolumesAssistedSnapshotsTest-123777916-project-admin] [instance: cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1] Calling os-brick to attach iSCSI Volume {{(pid=75337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 15:41:46 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0f20753-ef20-408e-88c1-e1c136e7c41a tempest-VolumesAssistedSnapshotsTest-123777916 tempest-VolumesAssistedSnapshotsTest-123777916-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2abc33d0c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7f11bb9d-a426-4068-9915-1da27b932a82', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cVkziOoa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 15:41:46 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-f0f20753-ef20-408e-88c1-e1c136e7c41a tempest-VolumesAssistedSnapshotsTest-123777916 tempest-VolumesAssistedSnapshotsTest-123777916-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 15:41:46 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-f0f20753-ef20-408e-88c1-e1c136e7c41a tempest-VolumesAssistedSnapshotsTest-123777916 tempest-VolumesAssistedSnapshotsTest-123777916-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 15:41:46 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-f0f20753-ef20-408e-88c1-e1c136e7c41a tempest-VolumesAssistedSnapshotsTest-123777916 tempest-VolumesAssistedSnapshotsTest-123777916-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.007s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 15:41:46 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-f0f20753-ef20-408e-88c1-e1c136e7c41a tempest-VolumesAssistedSnapshotsTest-123777916 tempest-VolumesAssistedSnapshotsTest-123777916-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 15:41:46 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-f0f20753-ef20-408e-88c1-e1c136e7c41a tempest-VolumesAssistedSnapshotsTest-123777916 tempest-VolumesAssistedSnapshotsTest-123777916-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7f11bb9d-a426-4068-9915-1da27b932a82" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 15:41:46 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-f0f20753-ef20-408e-88c1-e1c136e7c41a tempest-VolumesAssistedSnapshotsTest-123777916 tempest-VolumesAssistedSnapshotsTest-123777916-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7f11bb9d-a426-4068-9915-1da27b932a82" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 15:41:46 user nova-compute[75337]: INFO os_brick.initiator.connectors.iscsi [None req-f0f20753-ef20-408e-88c1-e1c136e7c41a tempest-VolumesAssistedSnapshotsTest-123777916 tempest-VolumesAssistedSnapshotsTest-123777916-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 15:41:46 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f11bb9d-a426-4068-9915-1da27b932a82 -p 172.16.0.220:3260 {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:41:46 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f11bb9d-a426-4068-9915-1da27b932a82 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:41:46 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[d73fe6df-fb5d-4a2a-a569-9bf10b55880f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:41:46 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0f20753-ef20-408e-88c1-e1c136e7c41a tempest-VolumesAssistedSnapshotsTest-123777916 tempest-VolumesAssistedSnapshotsTest-123777916-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 15:41:46 user nova-compute[75337]:  {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:41:46 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f11bb9d-a426-4068-9915-1da27b932a82 -p 172.16.0.220:3260 --interface default --op new {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:41:46 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-5bbc7a93-b7ae-4bbf-b337-b04a3f7edfaf tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Acquiring lock "c8cf1ead-a87c-459c-b914-a0e976c9e464" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:41:46 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-5bbc7a93-b7ae-4bbf-b337-b04a3f7edfaf tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Lock "c8cf1ead-a87c-459c-b914-a0e976c9e464" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:41:46 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f11bb9d-a426-4068-9915-1da27b932a82 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:41:46 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9bba38a-3308-4091-a24a-68b1112818cc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7f11bb9d-a426-4068-9915-1da27b932a82] added\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:41:46 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0f20753-ef20-408e-88c1-e1c136e7c41a tempest-VolumesAssistedSnapshotsTest-123777916 tempest-VolumesAssistedSnapshotsTest-123777916-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7f11bb9d-a426-4068-9915-1da27b932a82] added
Nov 06 15:41:46 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:41:46 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f11bb9d-a426-4068-9915-1da27b932a82 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:41:46 user nova-compute[75337]: DEBUG nova.objects.instance [None req-5bbc7a93-b7ae-4bbf-b337-b04a3f7edfaf tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Lazy-loading 'flavor' on Instance uuid c8cf1ead-a87c-459c-b914-a0e976c9e464 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 15:41:46 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:41:46 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f11bb9d-a426-4068-9915-1da27b932a82 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.031s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:41:46 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba29f5aa-47f4-4328-acf0-4b9f617d8ac6]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:41:46 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0f20753-ef20-408e-88c1-e1c136e7c41a tempest-VolumesAssistedSnapshotsTest-123777916 tempest-VolumesAssistedSnapshotsTest-123777916-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:41:46 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f11bb9d-a426-4068-9915-1da27b932a82 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:41:46 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f11bb9d-a426-4068-9915-1da27b932a82 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:41:46 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9c5eef8-b674-447b-bdcb-519b356d54f4]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:41:46 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0f20753-ef20-408e-88c1-e1c136e7c41a tempest-VolumesAssistedSnapshotsTest-123777916 tempest-VolumesAssistedSnapshotsTest-123777916-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:41:46 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f11bb9d-a426-4068-9915-1da27b932a82 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cVkziOoa {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:41:46 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-5bbc7a93-b7ae-4bbf-b337-b04a3f7edfaf tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Lock "c8cf1ead-a87c-459c-b914-a0e976c9e464" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.092s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:41:46 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f11bb9d-a426-4068-9915-1da27b932a82 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cVkziOoa" returned: 0 in 0.020s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:41:46 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[08d37630-8108-4f7e-9767-2e1eb14383b1]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:41:46 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0f20753-ef20-408e-88c1-e1c136e7c41a tempest-VolumesAssistedSnapshotsTest-123777916 tempest-VolumesAssistedSnapshotsTest-123777916-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cVkziOoa'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:41:46 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f11bb9d-a426-4068-9915-1da27b932a82 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:41:46 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f11bb9d-a426-4068-9915-1da27b932a82 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:41:46 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[84085574-16b1-4c41-a2df-827db1cc8627]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:41:46 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0f20753-ef20-408e-88c1-e1c136e7c41a tempest-VolumesAssistedSnapshotsTest-123777916 tempest-VolumesAssistedSnapshotsTest-123777916-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:41:46 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:41:46 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:41:46 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c81fcb6-c3dd-4fd2-a9bb-3c2c604945df]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd579072-cd8e-4ac1-8f84-1afda08a11da (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dccaff76-b907-4a00-b34d-bb5ae7655a02 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4367fb98-2ae9-40c3-a2d0-6e9b0f70dc7c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ad85d1f-7027-4997-96c4-991e3969067d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaf5fc54-be7c-4748-9e2f-12a01971e6f4 (non-flash)\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:41:46 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0f20753-ef20-408e-88c1-e1c136e7c41a tempest-VolumesAssistedSnapshotsTest-123777916 tempest-VolumesAssistedSnapshotsTest-123777916-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759 (non-flash)
Nov 06 15:41:46 user nova-compute[75337]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd579072-cd8e-4ac1-8f84-1afda08a11da (non-flash)
Nov 06 15:41:46 user nova-compute[75337]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dccaff76-b907-4a00-b34d-bb5ae7655a02 (non-flash)
Nov 06 15:41:46 user nova-compute[75337]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4367fb98-2ae9-40c3-a2d0-6e9b0f70dc7c (non-flash)
Nov 06 15:41:46 user nova-compute[75337]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ad85d1f-7027-4997-96c4-991e3969067d (non-flash)
Nov 06 15:41:46 user nova-compute[75337]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaf5fc54-be7c-4748-9e2f-12a01971e6f4 (non-flash)
Nov 06 15:41:46 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 15:41:46 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0f20753-ef20-408e-88c1-e1c136e7c41a tempest-VolumesAssistedSnapshotsTest-123777916 tempest-VolumesAssistedSnapshotsTest-123777916-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759 (non-flash)
Nov 06 15:41:46 user nova-compute[75337]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd579072-cd8e-4ac1-8f84-1afda08a11da (non-flash)
Nov 06 15:41:46 user nova-compute[75337]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dccaff76-b907-4a00-b34d-bb5ae7655a02 (non-flash)
Nov 06 15:41:46 user nova-compute[75337]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4367fb98-2ae9-40c3-a2d0-6e9b0f70dc7c (non-flash)
Nov 06 15:41:46 user nova-compute[75337]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ad85d1f-7027-4997-96c4-991e3969067d (non-flash)
Nov 06 15:41:46 user nova-compute[75337]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaf5fc54-be7c-4748-9e2f-12a01971e6f4 (non-flash)
Nov 06 15:41:46 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 15:41:46 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f11bb9d-a426-4068-9915-1da27b932a82 -p 172.16.0.220:3260 --login {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:41:47 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:41:47 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:41:47 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f11bb9d-a426-4068-9915-1da27b932a82 -p 172.16.0.220:3260 --login" returned: 0 in 0.110s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:41:47 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f81a403-ec45-4303-a879-c19091cb50dc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7f11bb9d-a426-4068-9915-1da27b932a82, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7f11bb9d-a426-4068-9915-1da27b932a82, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:41:47 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0f20753-ef20-408e-88c1-e1c136e7c41a tempest-VolumesAssistedSnapshotsTest-123777916 tempest-VolumesAssistedSnapshotsTest-123777916-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7f11bb9d-a426-4068-9915-1da27b932a82, portal: 172.16.0.220,3260]
Nov 06 15:41:47 user nova-compute[75337]: Login to [iface: default, target: iqn.2010-10.org.openstack:7f11bb9d-a426-4068-9915-1da27b932a82, portal: 172.16.0.220,3260] successful.
Nov 06 15:41:47 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:41:47 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f11bb9d-a426-4068-9915-1da27b932a82 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:41:47 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f11bb9d-a426-4068-9915-1da27b932a82 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:41:47 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[41cae246-688b-4d64-84bc-ee6321e55996]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:41:47 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0f20753-ef20-408e-88c1-e1c136e7c41a tempest-VolumesAssistedSnapshotsTest-123777916 tempest-VolumesAssistedSnapshotsTest-123777916-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:41:47 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:41:47 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:41:47 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:41:47 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:41:47 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:41:47 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f8e123f-8b1e-4583-a4ed-39eb74482770]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd579072-cd8e-4ac1-8f84-1afda08a11da (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dccaff76-b907-4a00-b34d-bb5ae7655a02 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4367fb98-2ae9-40c3-a2d0-6e9b0f70dc7c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ad85d1f-7027-4997-96c4-991e3969067d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaf5fc54-be7c-4748-9e2f-12a01971e6f4 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f11bb9d-a426-4068-9915-1da27b932a82 (non-flash)\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:41:47 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0f20753-ef20-408e-88c1-e1c136e7c41a tempest-VolumesAssistedSnapshotsTest-123777916 tempest-VolumesAssistedSnapshotsTest-123777916-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759 (non-flash)
Nov 06 15:41:47 user nova-compute[75337]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd579072-cd8e-4ac1-8f84-1afda08a11da (non-flash)
Nov 06 15:41:47 user nova-compute[75337]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dccaff76-b907-4a00-b34d-bb5ae7655a02 (non-flash)
Nov 06 15:41:47 user nova-compute[75337]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4367fb98-2ae9-40c3-a2d0-6e9b0f70dc7c (non-flash)
Nov 06 15:41:47 user nova-compute[75337]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ad85d1f-7027-4997-96c4-991e3969067d (non-flash)
Nov 06 15:41:47 user nova-compute[75337]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaf5fc54-be7c-4748-9e2f-12a01971e6f4 (non-flash)
Nov 06 15:41:47 user nova-compute[75337]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f11bb9d-a426-4068-9915-1da27b932a82 (non-flash)
Nov 06 15:41:47 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 15:41:47 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0f20753-ef20-408e-88c1-e1c136e7c41a tempest-VolumesAssistedSnapshotsTest-123777916 tempest-VolumesAssistedSnapshotsTest-123777916-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759 (non-flash)
Nov 06 15:41:47 user nova-compute[75337]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd579072-cd8e-4ac1-8f84-1afda08a11da (non-flash)
Nov 06 15:41:47 user nova-compute[75337]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dccaff76-b907-4a00-b34d-bb5ae7655a02 (non-flash)
Nov 06 15:41:47 user nova-compute[75337]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4367fb98-2ae9-40c3-a2d0-6e9b0f70dc7c (non-flash)
Nov 06 15:41:47 user nova-compute[75337]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ad85d1f-7027-4997-96c4-991e3969067d (non-flash)
Nov 06 15:41:47 user nova-compute[75337]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaf5fc54-be7c-4748-9e2f-12a01971e6f4 (non-flash)
Nov 06 15:41:47 user nova-compute[75337]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f11bb9d-a426-4068-9915-1da27b932a82 (non-flash)
Nov 06 15:41:47 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 15:41:47 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-f0f20753-ef20-408e-88c1-e1c136e7c41a tempest-VolumesAssistedSnapshotsTest-123777916 tempest-VolumesAssistedSnapshotsTest-123777916-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7f11bb9d-a426-4068-9915-1da27b932a82" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.427s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 15:41:47 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0f20753-ef20-408e-88c1-e1c136e7c41a tempest-VolumesAssistedSnapshotsTest-123777916 tempest-VolumesAssistedSnapshotsTest-123777916-project-admin] Connected to 172.16.0.220:3260 {{(pid=75337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 15:41:47 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-f0f20753-ef20-408e-88c1-e1c136e7c41a tempest-VolumesAssistedSnapshotsTest-123777916 tempest-VolumesAssistedSnapshotsTest-123777916-project-admin] HCTL ('39', '-', '-', 0) found on session 9 with lun 0 {{(pid=75337) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 15:41:47 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-f0f20753-ef20-408e-88c1-e1c136e7c41a tempest-VolumesAssistedSnapshotsTest-123777916 tempest-VolumesAssistedSnapshotsTest-123777916-project-admin] Scanning host 39 c: -, t: -, l: 0) {{(pid=75337) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 15:41:47 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:41:47 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:41:47 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.035s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:41:47 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[eab00e6a-7219-4f5f-9646-378d5d809a1a]: (4, ('- - 0', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:41:47 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-f0f20753-ef20-408e-88c1-e1c136e7c41a tempest-VolumesAssistedSnapshotsTest-123777916 tempest-VolumesAssistedSnapshotsTest-123777916-project-admin] Searching for a device in session 9 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=75337) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 15:41:47 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0f20753-ef20-408e-88c1-e1c136e7c41a tempest-VolumesAssistedSnapshotsTest-123777916 tempest-VolumesAssistedSnapshotsTest-123777916-project-admin] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:7f11bb9d-a426-4068-9915-1da27b932a82', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cVkziOoa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 15:41:47 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:41:47 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:41:47 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:41:47 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:41:47 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:41:47 user nova-compute[75337]: DEBUG nova.compute.manager [req-0224f44d-1ede-4d63-b654-a31c5516bedf req-e3db4262-ab39-45dc-a104-1cf7490e1f64 service nova] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Received event network-vif-plugged-e87c0766-dd71-4aca-b5f0-32888c7437f5 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:41:47 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-0224f44d-1ede-4d63-b654-a31c5516bedf req-e3db4262-ab39-45dc-a104-1cf7490e1f64 service nova] Acquiring lock "67d9ceff-c1fc-48ad-85c8-3aa37ebabf11-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:41:47 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-0224f44d-1ede-4d63-b654-a31c5516bedf req-e3db4262-ab39-45dc-a104-1cf7490e1f64 service nova] Lock "67d9ceff-c1fc-48ad-85c8-3aa37ebabf11-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:41:47 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-0224f44d-1ede-4d63-b654-a31c5516bedf req-e3db4262-ab39-45dc-a104-1cf7490e1f64 service nova] Lock "67d9ceff-c1fc-48ad-85c8-3aa37ebabf11-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:41:47 user nova-compute[75337]: DEBUG nova.compute.manager [req-0224f44d-1ede-4d63-b654-a31c5516bedf req-e3db4262-ab39-45dc-a104-1cf7490e1f64 service nova] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] No waiting events found dispatching network-vif-plugged-e87c0766-dd71-4aca-b5f0-32888c7437f5 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:41:47 user nova-compute[75337]: WARNING nova.compute.manager [req-0224f44d-1ede-4d63-b654-a31c5516bedf req-e3db4262-ab39-45dc-a104-1cf7490e1f64 service nova] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Received unexpected event network-vif-plugged-e87c0766-dd71-4aca-b5f0-32888c7437f5 for instance with vm_state building and task_state spawning.
Nov 06 15:41:47 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:41:47 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-5bbc7a93-b7ae-4bbf-b337-b04a3f7edfaf tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Acquiring lock "c8cf1ead-a87c-459c-b914-a0e976c9e464" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:41:47 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-5bbc7a93-b7ae-4bbf-b337-b04a3f7edfaf tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Lock "c8cf1ead-a87c-459c-b914-a0e976c9e464" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:41:47 user nova-compute[75337]: INFO nova.compute.manager [None req-5bbc7a93-b7ae-4bbf-b337-b04a3f7edfaf tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] [instance: c8cf1ead-a87c-459c-b914-a0e976c9e464] Attaching volume 6f5503fc-8cc8-46fa-8450-d967f769a947 to /dev/vdb
Nov 06 15:41:47 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:41:47 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:41:47 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:41:47 user nova-compute[75337]: DEBUG os_brick.utils [None req-5bbc7a93-b7ae-4bbf-b337-b04a3f7edfaf tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 15:41:47 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:41:47 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:41:47 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[8945a129-8496-4495-abe6-cadf6d3acd47]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4ff6411e45b8\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:41:47 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:41:47 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:41:47 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[79717565-87c3-4d78-9c68-8405871eeb42]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:41:47 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:41:47 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:41:47 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:41:47 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[3561cd27-f62e-4c14-9ce7-3897d649926d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:41:47 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[238e2b88-2afb-4f91-9b64-6b13c6199b67]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:41:47 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-5bbc7a93-b7ae-4bbf-b337-b04a3f7edfaf tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Running cmd (subprocess): nvme version {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:41:48 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-5bbc7a93-b7ae-4bbf-b337-b04a3f7edfaf tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] 'nvme version' failed. Not Retrying. {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 15:41:48 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5bbc7a93-b7ae-4bbf-b337-b04a3f7edfaf tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] nvme not present on system {{(pid=75337) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 15:41:48 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:41:48 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:41:48 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 15:41:48 user nova-compute[75337]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 15:41:48 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[da4c3325-7007-4c2b-b652-afa5139b2d53]: (4, '') {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:41:48 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.lightos [None req-5bbc7a93-b7ae-4bbf-b337-b04a3f7edfaf tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75337) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 15:41:48 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.lightos [None req-5bbc7a93-b7ae-4bbf-b337-b04a3f7edfaf tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 15:41:48 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.lightos [None req-5bbc7a93-b7ae-4bbf-b337-b04a3f7edfaf tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] LIGHTOS: no hostnqn found. {{(pid=75337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 15:41:48 user nova-compute[75337]: DEBUG os_brick.utils [None req-5bbc7a93-b7ae-4bbf-b337-b04a3f7edfaf tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] <== get_connector_properties: return (153ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4ff6411e45b8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 15:41:48 user nova-compute[75337]: DEBUG nova.virt.block_device [None req-5bbc7a93-b7ae-4bbf-b337-b04a3f7edfaf tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] [instance: c8cf1ead-a87c-459c-b914-a0e976c9e464] Updating existing volume attachment record: 26b29488-49fb-4e1c-9082-9b36bb478f8b {{(pid=75337) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 15:41:48 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:41:48 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:41:48 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:41:48 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:41:48 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-f0f20753-ef20-408e-88c1-e1c136e7c41a tempest-VolumesAssistedSnapshotsTest-123777916 tempest-VolumesAssistedSnapshotsTest-123777916-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.521s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 15:41:48 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0f20753-ef20-408e-88c1-e1c136e7c41a tempest-VolumesAssistedSnapshotsTest-123777916 tempest-VolumesAssistedSnapshotsTest-123777916-project-admin] <== connect_volume: return (1528ms) {'type': 'block', 'scsi_wwn': '23434666137326631', 'path': '/dev/sdh'} {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 15:41:48 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0f20753-ef20-408e-88c1-e1c136e7c41a tempest-VolumesAssistedSnapshotsTest-123777916 tempest-VolumesAssistedSnapshotsTest-123777916-project-admin] [instance: cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23434666137326631', 'path': '/dev/sdh'} {{(pid=75337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 15:41:48 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:41:48 user nova-compute[75337]: DEBUG nova.objects.instance [None req-f0f20753-ef20-408e-88c1-e1c136e7c41a tempest-VolumesAssistedSnapshotsTest-123777916 tempest-VolumesAssistedSnapshotsTest-123777916-project-admin] Lazy-loading 'flavor' on Instance uuid cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 15:41:48 user nova-compute[75337]: DEBUG nova.virt.libvirt.guest [None req-f0f20753-ef20-408e-88c1-e1c136e7c41a tempest-VolumesAssistedSnapshotsTest-123777916 tempest-VolumesAssistedSnapshotsTest-123777916-project-admin] attach device xml: <disk type="block" device="disk">
Nov 06 15:41:48 user nova-compute[75337]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 15:41:48 user nova-compute[75337]:   <source dev="/dev/sdh"/>
Nov 06 15:41:48 user nova-compute[75337]:   <target dev="vdb" bus="virtio"/>
Nov 06 15:41:48 user nova-compute[75337]:   <serial>7f11bb9d-a426-4068-9915-1da27b932a82</serial>
Nov 06 15:41:48 user nova-compute[75337]: </disk>
Nov 06 15:41:48 user nova-compute[75337]:  {{(pid=75337) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 06 15:41:48 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:41:48 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:41:48 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:41:48 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:41:48 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:41:48 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:41:48 user nova-compute[75337]: DEBUG nova.compute.manager [req-1583d77f-4d8d-4667-a29f-9e74b77c8e90 req-8de5e5d9-cc82-4e6e-b0cc-64cf1edebeab service nova] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Received event network-vif-plugged-5d25f565-70a5-427c-a198-4f88dd8b7338 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:41:48 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-1583d77f-4d8d-4667-a29f-9e74b77c8e90 req-8de5e5d9-cc82-4e6e-b0cc-64cf1edebeab service nova] Acquiring lock "67d9ceff-c1fc-48ad-85c8-3aa37ebabf11-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:41:48 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-1583d77f-4d8d-4667-a29f-9e74b77c8e90 req-8de5e5d9-cc82-4e6e-b0cc-64cf1edebeab service nova] Lock "67d9ceff-c1fc-48ad-85c8-3aa37ebabf11-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:41:48 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-1583d77f-4d8d-4667-a29f-9e74b77c8e90 req-8de5e5d9-cc82-4e6e-b0cc-64cf1edebeab service nova] Lock "67d9ceff-c1fc-48ad-85c8-3aa37ebabf11-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:41:48 user nova-compute[75337]: DEBUG nova.compute.manager [req-1583d77f-4d8d-4667-a29f-9e74b77c8e90 req-8de5e5d9-cc82-4e6e-b0cc-64cf1edebeab service nova] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] No waiting events found dispatching network-vif-plugged-5d25f565-70a5-427c-a198-4f88dd8b7338 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:41:48 user nova-compute[75337]: WARNING nova.compute.manager [req-1583d77f-4d8d-4667-a29f-9e74b77c8e90 req-8de5e5d9-cc82-4e6e-b0cc-64cf1edebeab service nova] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Received unexpected event network-vif-plugged-5d25f565-70a5-427c-a198-4f88dd8b7338 for instance with vm_state building and task_state spawning.
Nov 06 15:41:48 user nova-compute[75337]: DEBUG nova.compute.manager [req-1583d77f-4d8d-4667-a29f-9e74b77c8e90 req-8de5e5d9-cc82-4e6e-b0cc-64cf1edebeab service nova] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Received event network-vif-plugged-ac99553f-c5d8-46df-8357-f1f7f189fa22 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:41:48 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-1583d77f-4d8d-4667-a29f-9e74b77c8e90 req-8de5e5d9-cc82-4e6e-b0cc-64cf1edebeab service nova] Acquiring lock "67d9ceff-c1fc-48ad-85c8-3aa37ebabf11-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:41:48 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-1583d77f-4d8d-4667-a29f-9e74b77c8e90 req-8de5e5d9-cc82-4e6e-b0cc-64cf1edebeab service nova] Lock "67d9ceff-c1fc-48ad-85c8-3aa37ebabf11-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:41:48 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-1583d77f-4d8d-4667-a29f-9e74b77c8e90 req-8de5e5d9-cc82-4e6e-b0cc-64cf1edebeab service nova] Lock "67d9ceff-c1fc-48ad-85c8-3aa37ebabf11-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:41:48 user nova-compute[75337]: DEBUG nova.compute.manager [req-1583d77f-4d8d-4667-a29f-9e74b77c8e90 req-8de5e5d9-cc82-4e6e-b0cc-64cf1edebeab service nova] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] No waiting events found dispatching network-vif-plugged-ac99553f-c5d8-46df-8357-f1f7f189fa22 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:41:48 user nova-compute[75337]: WARNING nova.compute.manager [req-1583d77f-4d8d-4667-a29f-9e74b77c8e90 req-8de5e5d9-cc82-4e6e-b0cc-64cf1edebeab service nova] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Received unexpected event network-vif-plugged-ac99553f-c5d8-46df-8357-f1f7f189fa22 for instance with vm_state building and task_state spawning.
Nov 06 15:41:48 user nova-compute[75337]: DEBUG nova.compute.manager [req-1583d77f-4d8d-4667-a29f-9e74b77c8e90 req-8de5e5d9-cc82-4e6e-b0cc-64cf1edebeab service nova] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Received event network-vif-plugged-ac99553f-c5d8-46df-8357-f1f7f189fa22 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:41:48 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-1583d77f-4d8d-4667-a29f-9e74b77c8e90 req-8de5e5d9-cc82-4e6e-b0cc-64cf1edebeab service nova] Acquiring lock "67d9ceff-c1fc-48ad-85c8-3aa37ebabf11-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:41:48 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-1583d77f-4d8d-4667-a29f-9e74b77c8e90 req-8de5e5d9-cc82-4e6e-b0cc-64cf1edebeab service nova] Lock "67d9ceff-c1fc-48ad-85c8-3aa37ebabf11-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:41:48 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-1583d77f-4d8d-4667-a29f-9e74b77c8e90 req-8de5e5d9-cc82-4e6e-b0cc-64cf1edebeab service nova] Lock "67d9ceff-c1fc-48ad-85c8-3aa37ebabf11-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:41:48 user nova-compute[75337]: DEBUG nova.compute.manager [req-1583d77f-4d8d-4667-a29f-9e74b77c8e90 req-8de5e5d9-cc82-4e6e-b0cc-64cf1edebeab service nova] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] No waiting events found dispatching network-vif-plugged-ac99553f-c5d8-46df-8357-f1f7f189fa22 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:41:48 user nova-compute[75337]: WARNING nova.compute.manager [req-1583d77f-4d8d-4667-a29f-9e74b77c8e90 req-8de5e5d9-cc82-4e6e-b0cc-64cf1edebeab service nova] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Received unexpected event network-vif-plugged-ac99553f-c5d8-46df-8357-f1f7f189fa22 for instance with vm_state building and task_state spawning.
Nov 06 15:41:48 user nova-compute[75337]: DEBUG nova.compute.manager [req-1583d77f-4d8d-4667-a29f-9e74b77c8e90 req-8de5e5d9-cc82-4e6e-b0cc-64cf1edebeab service nova] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Received event network-vif-plugged-abf73a6f-c3c7-46b5-8a9b-0fce5677fa27 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:41:48 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-1583d77f-4d8d-4667-a29f-9e74b77c8e90 req-8de5e5d9-cc82-4e6e-b0cc-64cf1edebeab service nova] Acquiring lock "67d9ceff-c1fc-48ad-85c8-3aa37ebabf11-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:41:48 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-1583d77f-4d8d-4667-a29f-9e74b77c8e90 req-8de5e5d9-cc82-4e6e-b0cc-64cf1edebeab service nova] Lock "67d9ceff-c1fc-48ad-85c8-3aa37ebabf11-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:41:48 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-1583d77f-4d8d-4667-a29f-9e74b77c8e90 req-8de5e5d9-cc82-4e6e-b0cc-64cf1edebeab service nova] Lock "67d9ceff-c1fc-48ad-85c8-3aa37ebabf11-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:41:48 user nova-compute[75337]: DEBUG nova.compute.manager [req-1583d77f-4d8d-4667-a29f-9e74b77c8e90 req-8de5e5d9-cc82-4e6e-b0cc-64cf1edebeab service nova] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] No waiting events found dispatching network-vif-plugged-abf73a6f-c3c7-46b5-8a9b-0fce5677fa27 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:41:48 user nova-compute[75337]: WARNING nova.compute.manager [req-1583d77f-4d8d-4667-a29f-9e74b77c8e90 req-8de5e5d9-cc82-4e6e-b0cc-64cf1edebeab service nova] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Received unexpected event network-vif-plugged-abf73a6f-c3c7-46b5-8a9b-0fce5677fa27 for instance with vm_state building and task_state spawning.
Nov 06 15:41:48 user nova-compute[75337]: DEBUG nova.compute.manager [req-1583d77f-4d8d-4667-a29f-9e74b77c8e90 req-8de5e5d9-cc82-4e6e-b0cc-64cf1edebeab service nova] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Received event network-vif-plugged-abf73a6f-c3c7-46b5-8a9b-0fce5677fa27 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:41:48 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-1583d77f-4d8d-4667-a29f-9e74b77c8e90 req-8de5e5d9-cc82-4e6e-b0cc-64cf1edebeab service nova] Acquiring lock "67d9ceff-c1fc-48ad-85c8-3aa37ebabf11-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:41:48 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-1583d77f-4d8d-4667-a29f-9e74b77c8e90 req-8de5e5d9-cc82-4e6e-b0cc-64cf1edebeab service nova] Lock "67d9ceff-c1fc-48ad-85c8-3aa37ebabf11-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:41:48 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-1583d77f-4d8d-4667-a29f-9e74b77c8e90 req-8de5e5d9-cc82-4e6e-b0cc-64cf1edebeab service nova] Lock "67d9ceff-c1fc-48ad-85c8-3aa37ebabf11-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:41:48 user nova-compute[75337]: DEBUG nova.compute.manager [req-1583d77f-4d8d-4667-a29f-9e74b77c8e90 req-8de5e5d9-cc82-4e6e-b0cc-64cf1edebeab service nova] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] No waiting events found dispatching network-vif-plugged-abf73a6f-c3c7-46b5-8a9b-0fce5677fa27 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:41:48 user nova-compute[75337]: WARNING nova.compute.manager [req-1583d77f-4d8d-4667-a29f-9e74b77c8e90 req-8de5e5d9-cc82-4e6e-b0cc-64cf1edebeab service nova] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Received unexpected event network-vif-plugged-abf73a6f-c3c7-46b5-8a9b-0fce5677fa27 for instance with vm_state building and task_state spawning.
Nov 06 15:41:48 user nova-compute[75337]: DEBUG nova.compute.manager [req-1583d77f-4d8d-4667-a29f-9e74b77c8e90 req-8de5e5d9-cc82-4e6e-b0cc-64cf1edebeab service nova] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Received event network-vif-plugged-ba50db67-9fb0-49ef-9ea2-db9014b66b17 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:41:48 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-1583d77f-4d8d-4667-a29f-9e74b77c8e90 req-8de5e5d9-cc82-4e6e-b0cc-64cf1edebeab service nova] Acquiring lock "67d9ceff-c1fc-48ad-85c8-3aa37ebabf11-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:41:48 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-1583d77f-4d8d-4667-a29f-9e74b77c8e90 req-8de5e5d9-cc82-4e6e-b0cc-64cf1edebeab service nova] Lock "67d9ceff-c1fc-48ad-85c8-3aa37ebabf11-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:41:48 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-1583d77f-4d8d-4667-a29f-9e74b77c8e90 req-8de5e5d9-cc82-4e6e-b0cc-64cf1edebeab service nova] Lock "67d9ceff-c1fc-48ad-85c8-3aa37ebabf11-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:41:48 user nova-compute[75337]: DEBUG nova.compute.manager [req-1583d77f-4d8d-4667-a29f-9e74b77c8e90 req-8de5e5d9-cc82-4e6e-b0cc-64cf1edebeab service nova] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] No waiting events found dispatching network-vif-plugged-ba50db67-9fb0-49ef-9ea2-db9014b66b17 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:41:48 user nova-compute[75337]: WARNING nova.compute.manager [req-1583d77f-4d8d-4667-a29f-9e74b77c8e90 req-8de5e5d9-cc82-4e6e-b0cc-64cf1edebeab service nova] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Received unexpected event network-vif-plugged-ba50db67-9fb0-49ef-9ea2-db9014b66b17 for instance with vm_state building and task_state spawning.
Nov 06 15:41:48 user nova-compute[75337]: DEBUG nova.compute.manager [req-1583d77f-4d8d-4667-a29f-9e74b77c8e90 req-8de5e5d9-cc82-4e6e-b0cc-64cf1edebeab service nova] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Received event network-vif-plugged-ba50db67-9fb0-49ef-9ea2-db9014b66b17 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:41:48 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-1583d77f-4d8d-4667-a29f-9e74b77c8e90 req-8de5e5d9-cc82-4e6e-b0cc-64cf1edebeab service nova] Acquiring lock "67d9ceff-c1fc-48ad-85c8-3aa37ebabf11-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:41:48 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-1583d77f-4d8d-4667-a29f-9e74b77c8e90 req-8de5e5d9-cc82-4e6e-b0cc-64cf1edebeab service nova] Lock "67d9ceff-c1fc-48ad-85c8-3aa37ebabf11-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:41:48 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-1583d77f-4d8d-4667-a29f-9e74b77c8e90 req-8de5e5d9-cc82-4e6e-b0cc-64cf1edebeab service nova] Lock "67d9ceff-c1fc-48ad-85c8-3aa37ebabf11-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:41:48 user nova-compute[75337]: DEBUG nova.compute.manager [req-1583d77f-4d8d-4667-a29f-9e74b77c8e90 req-8de5e5d9-cc82-4e6e-b0cc-64cf1edebeab service nova] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] No waiting events found dispatching network-vif-plugged-ba50db67-9fb0-49ef-9ea2-db9014b66b17 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:41:48 user nova-compute[75337]: WARNING nova.compute.manager [req-1583d77f-4d8d-4667-a29f-9e74b77c8e90 req-8de5e5d9-cc82-4e6e-b0cc-64cf1edebeab service nova] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Received unexpected event network-vif-plugged-ba50db67-9fb0-49ef-9ea2-db9014b66b17 for instance with vm_state building and task_state spawning.
Nov 06 15:41:48 user nova-compute[75337]: DEBUG nova.compute.manager [req-1583d77f-4d8d-4667-a29f-9e74b77c8e90 req-8de5e5d9-cc82-4e6e-b0cc-64cf1edebeab service nova] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Received event network-vif-plugged-e6be4a87-8794-4e4f-91c1-3c417e0c8d62 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:41:48 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-1583d77f-4d8d-4667-a29f-9e74b77c8e90 req-8de5e5d9-cc82-4e6e-b0cc-64cf1edebeab service nova] Acquiring lock "67d9ceff-c1fc-48ad-85c8-3aa37ebabf11-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:41:48 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-1583d77f-4d8d-4667-a29f-9e74b77c8e90 req-8de5e5d9-cc82-4e6e-b0cc-64cf1edebeab service nova] Lock "67d9ceff-c1fc-48ad-85c8-3aa37ebabf11-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:41:48 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-1583d77f-4d8d-4667-a29f-9e74b77c8e90 req-8de5e5d9-cc82-4e6e-b0cc-64cf1edebeab service nova] Lock "67d9ceff-c1fc-48ad-85c8-3aa37ebabf11-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:41:48 user nova-compute[75337]: DEBUG nova.compute.manager [req-1583d77f-4d8d-4667-a29f-9e74b77c8e90 req-8de5e5d9-cc82-4e6e-b0cc-64cf1edebeab service nova] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] No waiting events found dispatching network-vif-plugged-e6be4a87-8794-4e4f-91c1-3c417e0c8d62 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:41:48 user nova-compute[75337]: WARNING nova.compute.manager [req-1583d77f-4d8d-4667-a29f-9e74b77c8e90 req-8de5e5d9-cc82-4e6e-b0cc-64cf1edebeab service nova] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Received unexpected event network-vif-plugged-e6be4a87-8794-4e4f-91c1-3c417e0c8d62 for instance with vm_state building and task_state spawning.
Nov 06 15:41:48 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:41:48 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:41:48 user nova-compute[75337]: DEBUG nova.compute.manager [req-b0e21453-58a7-40c0-8bd6-668b99e3f16f req-67a7859b-2895-44b1-bfba-3ee50482098c service nova] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Received event network-vif-plugged-94df5f62-239e-4b8e-a91d-5223c1585f6f {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:41:48 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-b0e21453-58a7-40c0-8bd6-668b99e3f16f req-67a7859b-2895-44b1-bfba-3ee50482098c service nova] Acquiring lock "67d9ceff-c1fc-48ad-85c8-3aa37ebabf11-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:41:48 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-b0e21453-58a7-40c0-8bd6-668b99e3f16f req-67a7859b-2895-44b1-bfba-3ee50482098c service nova] Lock "67d9ceff-c1fc-48ad-85c8-3aa37ebabf11-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:41:48 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-b0e21453-58a7-40c0-8bd6-668b99e3f16f req-67a7859b-2895-44b1-bfba-3ee50482098c service nova] Lock "67d9ceff-c1fc-48ad-85c8-3aa37ebabf11-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:41:48 user nova-compute[75337]: DEBUG nova.compute.manager [req-b0e21453-58a7-40c0-8bd6-668b99e3f16f req-67a7859b-2895-44b1-bfba-3ee50482098c service nova] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] No waiting events found dispatching network-vif-plugged-94df5f62-239e-4b8e-a91d-5223c1585f6f {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:41:48 user nova-compute[75337]: WARNING nova.compute.manager [req-b0e21453-58a7-40c0-8bd6-668b99e3f16f req-67a7859b-2895-44b1-bfba-3ee50482098c service nova] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Received unexpected event network-vif-plugged-94df5f62-239e-4b8e-a91d-5223c1585f6f for instance with vm_state building and task_state spawning.
Nov 06 15:41:48 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-f0f20753-ef20-408e-88c1-e1c136e7c41a tempest-VolumesAssistedSnapshotsTest-123777916 tempest-VolumesAssistedSnapshotsTest-123777916-project-admin] No BDM found with device name vda, not building metadata. {{(pid=75337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 15:41:48 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-f0f20753-ef20-408e-88c1-e1c136e7c41a tempest-VolumesAssistedSnapshotsTest-123777916 tempest-VolumesAssistedSnapshotsTest-123777916-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=75337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 15:41:48 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-f0f20753-ef20-408e-88c1-e1c136e7c41a tempest-VolumesAssistedSnapshotsTest-123777916 tempest-VolumesAssistedSnapshotsTest-123777916-project-admin] No VIF found with MAC fa:16:3e:67:5c:a5, not building metadata {{(pid=75337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 15:41:49 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:41:49 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:41:49 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:41:49 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:41:49 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:41:49 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:41:49 user nova-compute[75337]: DEBUG nova.compute.manager [req-1c32a5eb-f1e8-45f1-aaac-75545c456bd5 req-53597f09-3f5b-4276-aa7f-c0a2fee0178c service nova] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Received event network-vif-plugged-e87c0766-dd71-4aca-b5f0-32888c7437f5 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:41:49 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-1c32a5eb-f1e8-45f1-aaac-75545c456bd5 req-53597f09-3f5b-4276-aa7f-c0a2fee0178c service nova] Acquiring lock "67d9ceff-c1fc-48ad-85c8-3aa37ebabf11-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:41:49 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-1c32a5eb-f1e8-45f1-aaac-75545c456bd5 req-53597f09-3f5b-4276-aa7f-c0a2fee0178c service nova] Lock "67d9ceff-c1fc-48ad-85c8-3aa37ebabf11-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:41:49 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-1c32a5eb-f1e8-45f1-aaac-75545c456bd5 req-53597f09-3f5b-4276-aa7f-c0a2fee0178c service nova] Lock "67d9ceff-c1fc-48ad-85c8-3aa37ebabf11-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:41:49 user nova-compute[75337]: DEBUG nova.compute.manager [req-1c32a5eb-f1e8-45f1-aaac-75545c456bd5 req-53597f09-3f5b-4276-aa7f-c0a2fee0178c service nova] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] No waiting events found dispatching network-vif-plugged-e87c0766-dd71-4aca-b5f0-32888c7437f5 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:41:49 user nova-compute[75337]: WARNING nova.compute.manager [req-1c32a5eb-f1e8-45f1-aaac-75545c456bd5 req-53597f09-3f5b-4276-aa7f-c0a2fee0178c service nova] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Received unexpected event network-vif-plugged-e87c0766-dd71-4aca-b5f0-32888c7437f5 for instance with vm_state building and task_state spawning.
Nov 06 15:41:49 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:41:49 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:41:50 user nova-compute[75337]: DEBUG nova.compute.manager [req-700341c6-aa49-41e1-8be0-965e2e512947 req-712a774b-2bac-4694-9c0e-6531c3226fee service nova] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Received event network-vif-plugged-e6be4a87-8794-4e4f-91c1-3c417e0c8d62 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:41:50 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-700341c6-aa49-41e1-8be0-965e2e512947 req-712a774b-2bac-4694-9c0e-6531c3226fee service nova] Acquiring lock "67d9ceff-c1fc-48ad-85c8-3aa37ebabf11-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:41:50 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-700341c6-aa49-41e1-8be0-965e2e512947 req-712a774b-2bac-4694-9c0e-6531c3226fee service nova] Lock "67d9ceff-c1fc-48ad-85c8-3aa37ebabf11-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:41:50 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-700341c6-aa49-41e1-8be0-965e2e512947 req-712a774b-2bac-4694-9c0e-6531c3226fee service nova] Lock "67d9ceff-c1fc-48ad-85c8-3aa37ebabf11-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:41:50 user nova-compute[75337]: DEBUG nova.compute.manager [req-700341c6-aa49-41e1-8be0-965e2e512947 req-712a774b-2bac-4694-9c0e-6531c3226fee service nova] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] No waiting events found dispatching network-vif-plugged-e6be4a87-8794-4e4f-91c1-3c417e0c8d62 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:41:50 user nova-compute[75337]: WARNING nova.compute.manager [req-700341c6-aa49-41e1-8be0-965e2e512947 req-712a774b-2bac-4694-9c0e-6531c3226fee service nova] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Received unexpected event network-vif-plugged-e6be4a87-8794-4e4f-91c1-3c417e0c8d62 for instance with vm_state building and task_state spawning.
Nov 06 15:41:50 user nova-compute[75337]: DEBUG nova.compute.manager [req-ed2a6a84-a274-4db7-a8bf-750eab84ba74 req-cf1aa64c-c833-4037-aadc-a6261475b14d service nova] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Received event network-vif-plugged-94df5f62-239e-4b8e-a91d-5223c1585f6f {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:41:50 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-ed2a6a84-a274-4db7-a8bf-750eab84ba74 req-cf1aa64c-c833-4037-aadc-a6261475b14d service nova] Acquiring lock "67d9ceff-c1fc-48ad-85c8-3aa37ebabf11-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:41:50 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-ed2a6a84-a274-4db7-a8bf-750eab84ba74 req-cf1aa64c-c833-4037-aadc-a6261475b14d service nova] Lock "67d9ceff-c1fc-48ad-85c8-3aa37ebabf11-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:41:50 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-ed2a6a84-a274-4db7-a8bf-750eab84ba74 req-cf1aa64c-c833-4037-aadc-a6261475b14d service nova] Lock "67d9ceff-c1fc-48ad-85c8-3aa37ebabf11-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:41:50 user nova-compute[75337]: DEBUG nova.compute.manager [req-ed2a6a84-a274-4db7-a8bf-750eab84ba74 req-cf1aa64c-c833-4037-aadc-a6261475b14d service nova] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] No waiting events found dispatching network-vif-plugged-94df5f62-239e-4b8e-a91d-5223c1585f6f {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:41:50 user nova-compute[75337]: WARNING nova.compute.manager [req-ed2a6a84-a274-4db7-a8bf-750eab84ba74 req-cf1aa64c-c833-4037-aadc-a6261475b14d service nova] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Received unexpected event network-vif-plugged-94df5f62-239e-4b8e-a91d-5223c1585f6f for instance with vm_state building and task_state spawning.
Nov 06 15:41:51 user nova-compute[75337]: DEBUG nova.compute.manager [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Instance event wait completed in 0 seconds for  {{(pid=75337) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 15:41:51 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Guest created on hypervisor {{(pid=75337) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 15:41:51 user nova-compute[75337]: INFO nova.virt.libvirt.driver [-] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Instance spawned successfully.
Nov 06 15:41:51 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 15:41:51 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Found default for hw_cdrom_bus of ide {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:41:51 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Found default for hw_disk_bus of virtio {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:41:51 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Found default for hw_input_bus of None {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:41:51 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Found default for hw_pointer_model of None {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:41:51 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Found default for hw_video_model of virtio {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:41:51 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Found default for hw_vif_model of virtio {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:41:51 user nova-compute[75337]: INFO nova.compute.manager [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Took 13.13 seconds to spawn the instance on the hypervisor.
Nov 06 15:41:51 user nova-compute[75337]: DEBUG nova.compute.manager [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Checking state {{(pid=75337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 15:41:51 user nova-compute[75337]: INFO nova.compute.manager [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Took 118.65 seconds to build instance.
Nov 06 15:41:51 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-c1a3e884-ebc9-45ac-84c0-8d0a1272c7df tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Lock "67d9ceff-c1fc-48ad-85c8-3aa37ebabf11" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 118.902s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:41:53 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:41:54 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:41:58 user nova-compute[75337]: INFO nova.compute.manager [None req-1e2c260a-42ae-44a2-9ecc-e9d2d6917eae tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] [instance: 5f5fc58d-f946-4df0-b8d0-1aefbf0f8cd6] Took 16.85 seconds to detach 1 volumes for instance.
Nov 06 15:41:58 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-1e2c260a-42ae-44a2-9ecc-e9d2d6917eae tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:41:58 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-1e2c260a-42ae-44a2-9ecc-e9d2d6917eae tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:41:58 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-aaf7c305-0247-4921-9cd0-1c5a665fb183 tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] Waiting for libvirt event about the detach of device sdc with device alias scsi0-0-0-2 from instance 8858d90e-ee14-494b-80da-904cd97cdff0 is timed out.
Nov 06 15:41:58 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-aaf7c305-0247-4921-9cd0-1c5a665fb183 tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] Successfully detached device sdc from instance 8858d90e-ee14-494b-80da-904cd97cdff0 from the live domain config.
Nov 06 15:41:58 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aaf7c305-0247-4921-9cd0-1c5a665fb183 tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] [instance: 8858d90e-ee14-494b-80da-904cd97cdff0] calling os-brick to detach iSCSI Volume {{(pid=75337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 15:41:58 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaf7c305-0247-4921-9cd0-1c5a665fb183 tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2abc33d0c0>, {'target_iqn': 'iqn.2010-10.org.openstack:fd579072-cd8e-4ac1-8f84-1afda08a11da', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BVQOKdAp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 15:41:58 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-aaf7c305-0247-4921-9cd0-1c5a665fb183 tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 15:41:58 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-aaf7c305-0247-4921-9cd0-1c5a665fb183 tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 15:41:58 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-aaf7c305-0247-4921-9cd0-1c5a665fb183 tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 15:41:58 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:41:58 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:41:58 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcfc7a0b-a020-41aa-94bd-c9eca0b36c61]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:eaf5fc54-be7c-4748-9e2f-12a01971e6f4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0ad85d1f-7027-4997-96c4-991e3969067d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fd579072-cd8e-4ac1-8f84-1afda08a11da\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dccaff76-b907-4a00-b34d-bb5ae7655a02\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7f11bb9d-a426-4068-9915-1da27b932a82\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4367fb98-2ae9-40c3-a2d0-6e9b0f70dc7c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:41:58 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaf7c305-0247-4921-9cd0-1c5a665fb183 tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 15:41:58 user nova-compute[75337]: No targets found.
Nov 06 15:41:58 user nova-compute[75337]: iSNS:
Nov 06 15:41:58 user nova-compute[75337]: No targets found.
Nov 06 15:41:58 user nova-compute[75337]: STATIC:
Nov 06 15:41:58 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:eaf5fc54-be7c-4748-9e2f-12a01971e6f4
Nov 06 15:41:58 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 15:41:58 user nova-compute[75337]:                 Iface Name: default
Nov 06 15:41:58 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:0ad85d1f-7027-4997-96c4-991e3969067d
Nov 06 15:41:58 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 15:41:58 user nova-compute[75337]:                 Iface Name: default
Nov 06 15:41:58 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:fd579072-cd8e-4ac1-8f84-1afda08a11da
Nov 06 15:41:58 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 15:41:58 user nova-compute[75337]:                 Iface Name: default
Nov 06 15:41:58 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:dccaff76-b907-4a00-b34d-bb5ae7655a02
Nov 06 15:41:58 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 15:41:58 user nova-compute[75337]:                 Iface Name: default
Nov 06 15:41:58 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759
Nov 06 15:41:58 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 15:41:58 user nova-compute[75337]:                 Iface Name: default
Nov 06 15:41:58 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:7f11bb9d-a426-4068-9915-1da27b932a82
Nov 06 15:41:58 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 15:41:58 user nova-compute[75337]:                 Iface Name: default
Nov 06 15:41:58 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:4367fb98-2ae9-40c3-a2d0-6e9b0f70dc7c
Nov 06 15:41:58 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 15:41:58 user nova-compute[75337]:                 Iface Name: default
Nov 06 15:41:58 user nova-compute[75337]: FIRMWARE:
Nov 06 15:41:58 user nova-compute[75337]: No targets found.
Nov 06 15:41:58 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 15:41:58 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaf7c305-0247-4921-9cd0-1c5a665fb183 tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 15:41:58 user nova-compute[75337]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 15:41:58 user nova-compute[75337]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75337) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 15:41:58 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaf7c305-0247-4921-9cd0-1c5a665fb183 tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fd579072-cd8e-4ac1-8f84-1afda08a11da', 0)] {{(pid=75337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 15:41:58 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:41:58 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:41:58 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8985a26-7f72-4b96-b3d6-235edfda68b8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ad85d1f-7027-4997-96c4-991e3969067d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4367fb98-2ae9-40c3-a2d0-6e9b0f70dc7c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f11bb9d-a426-4068-9915-1da27b932a82\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dccaff76-b907-4a00-b34d-bb5ae7655a02\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eaf5fc54-be7c-4748-9e2f-12a01971e6f4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fd579072-cd8e-4ac1-8f84-1afda08a11da\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:41:58 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:41:59 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:41:59 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f35dfa6-a018-4fbf-9be7-c5cb4aff0b19]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd579072-cd8e-4ac1-8f84-1afda08a11da (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dccaff76-b907-4a00-b34d-bb5ae7655a02 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4367fb98-2ae9-40c3-a2d0-6e9b0f70dc7c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ad85d1f-7027-4997-96c4-991e3969067d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaf5fc54-be7c-4748-9e2f-12a01971e6f4 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f11bb9d-a426-4068-9915-1da27b932a82 (non-flash)\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:41:59 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaf7c305-0247-4921-9cd0-1c5a665fb183 tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759 (non-flash)
Nov 06 15:41:59 user nova-compute[75337]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd579072-cd8e-4ac1-8f84-1afda08a11da (non-flash)
Nov 06 15:41:59 user nova-compute[75337]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dccaff76-b907-4a00-b34d-bb5ae7655a02 (non-flash)
Nov 06 15:41:59 user nova-compute[75337]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4367fb98-2ae9-40c3-a2d0-6e9b0f70dc7c (non-flash)
Nov 06 15:41:59 user nova-compute[75337]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ad85d1f-7027-4997-96c4-991e3969067d (non-flash)
Nov 06 15:41:59 user nova-compute[75337]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaf5fc54-be7c-4748-9e2f-12a01971e6f4 (non-flash)
Nov 06 15:41:59 user nova-compute[75337]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f11bb9d-a426-4068-9915-1da27b932a82 (non-flash)
Nov 06 15:41:59 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 15:41:59 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaf7c305-0247-4921-9cd0-1c5a665fb183 tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759 (non-flash)
Nov 06 15:41:59 user nova-compute[75337]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd579072-cd8e-4ac1-8f84-1afda08a11da (non-flash)
Nov 06 15:41:59 user nova-compute[75337]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dccaff76-b907-4a00-b34d-bb5ae7655a02 (non-flash)
Nov 06 15:41:59 user nova-compute[75337]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4367fb98-2ae9-40c3-a2d0-6e9b0f70dc7c (non-flash)
Nov 06 15:41:59 user nova-compute[75337]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ad85d1f-7027-4997-96c4-991e3969067d (non-flash)
Nov 06 15:41:59 user nova-compute[75337]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaf5fc54-be7c-4748-9e2f-12a01971e6f4 (non-flash)
Nov 06 15:41:59 user nova-compute[75337]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f11bb9d-a426-4068-9915-1da27b932a82 (non-flash)
Nov 06 15:41:59 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 15:41:59 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaf7c305-0247-4921-9cd0-1c5a665fb183 tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2abc55caf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fd579072-cd8e-4ac1-8f84-1afda08a11da'): ({'sdc'}, set())}) {{(pid=75337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 15:41:59 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-aaf7c305-0247-4921-9cd0-1c5a665fb183 tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] Removing single pathed devices sdc {{(pid=75337) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 15:41:59 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:41:59 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:41:59 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[72c0426b-6555-4c8f-8368-b878e5667ecc]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:41:59 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:41:59 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-f0f20753-ef20-408e-88c1-e1c136e7c41a tempest-VolumesAssistedSnapshotsTest-123777916 tempest-VolumesAssistedSnapshotsTest-123777916-project-admin] Lock "cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 69.728s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:41:59 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.024s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:41:59 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d54f84a-2250-4e27-a0a2-ad1975429827]: (4, ('ok\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:41:59 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-aaf7c305-0247-4921-9cd0-1c5a665fb183 tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] Flushing IO for device /dev/sdc {{(pid=75337) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 15:41:59 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:41:59 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.018s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:41:59 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa5520dc-5728-46a9-bb0e-67fcb9c234f7]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:41:59 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-aaf7c305-0247-4921-9cd0-1c5a665fb183 tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75337) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 15:41:59 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:41:59 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-1e2c260a-42ae-44a2-9ecc-e9d2d6917eae tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 15:41:59 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-1e2c260a-42ae-44a2-9ecc-e9d2d6917eae tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 15:41:59 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:41:59 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f4d7e0d-ed8b-4725-9584-4c22b6405689]: (4, ('1', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:41:59 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-aaf7c305-0247-4921-9cd0-1c5a665fb183 tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 15:41:59 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-aaf7c305-0247-4921-9cd0-1c5a665fb183 tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] SCSI volumes sdc have been removed. {{(pid=75337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 15:41:59 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaf7c305-0247-4921-9cd0-1c5a665fb183 tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fd579072-cd8e-4ac1-8f84-1afda08a11da')] {{(pid=75337) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 15:41:59 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd579072-cd8e-4ac1-8f84-1afda08a11da -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:41:59 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-1e2c260a-42ae-44a2-9ecc-e9d2d6917eae tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.444s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:41:59 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd579072-cd8e-4ac1-8f84-1afda08a11da -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.032s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:41:59 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[1853fae0-dbed-4df1-8570-96248f6d7154]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:41:59 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaf7c305-0247-4921-9cd0-1c5a665fb183 tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:41:59 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd579072-cd8e-4ac1-8f84-1afda08a11da -p 172.16.0.220:3260 --logout {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:41:59 user nova-compute[75337]: INFO nova.scheduler.client.report [None req-1e2c260a-42ae-44a2-9ecc-e9d2d6917eae tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] Deleted allocations for instance 5f5fc58d-f946-4df0-b8d0-1aefbf0f8cd6
Nov 06 15:41:59 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd579072-cd8e-4ac1-8f84-1afda08a11da -p 172.16.0.220:3260 --logout" returned: 0 in 0.083s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:41:59 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[95216313-5c0b-4c2a-bedd-e17ea9374c22]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:fd579072-cd8e-4ac1-8f84-1afda08a11da, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:fd579072-cd8e-4ac1-8f84-1afda08a11da, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:41:59 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaf7c305-0247-4921-9cd0-1c5a665fb183 tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:fd579072-cd8e-4ac1-8f84-1afda08a11da, portal: 172.16.0.220,3260]
Nov 06 15:41:59 user nova-compute[75337]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:fd579072-cd8e-4ac1-8f84-1afda08a11da, portal: 172.16.0.220,3260] successful.
Nov 06 15:41:59 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:41:59 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd579072-cd8e-4ac1-8f84-1afda08a11da -p 172.16.0.220:3260 --op delete {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:41:59 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd579072-cd8e-4ac1-8f84-1afda08a11da -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:41:59 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[b77e06ff-fe64-4b81-84fd-60f10760695c]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:41:59 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaf7c305-0247-4921-9cd0-1c5a665fb183 tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:41:59 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-aaf7c305-0247-4921-9cd0-1c5a665fb183 tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.426s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 15:41:59 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaf7c305-0247-4921-9cd0-1c5a665fb183 tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] <== disconnect_volume: return (428ms) None {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 15:41:59 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aaf7c305-0247-4921-9cd0-1c5a665fb183 tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] [instance: 8858d90e-ee14-494b-80da-904cd97cdff0] Disconnected iSCSI Volume {{(pid=75337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 15:41:59 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:41:59 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-1e2c260a-42ae-44a2-9ecc-e9d2d6917eae tempest-DeleteServersTestJSON-706109674 tempest-DeleteServersTestJSON-706109674-project-member] Lock "5f5fc58d-f946-4df0-b8d0-1aefbf0f8cd6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 20.268s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:42:00 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:42:00 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:42:00 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:42:00 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Starting heal instance info cache {{(pid=75337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 15:42:00 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "refresh_cache-581cf468-65e7-42e5-9250-c3d645577011" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 15:42:00 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquired lock "refresh_cache-581cf468-65e7-42e5-9250-c3d645577011" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 15:42:00 user nova-compute[75337]: DEBUG nova.network.neutron [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] [instance: 581cf468-65e7-42e5-9250-c3d645577011] Forcefully refreshing network info cache for instance {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 15:42:00 user nova-compute[75337]: DEBUG nova.network.neutron [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] [instance: 581cf468-65e7-42e5-9250-c3d645577011] Updating instance_info_cache with network_info: [{"id": "d1c68bac-be37-4645-afcb-2b89f47c1793", "address": "fa:16:3e:00:1c:74", "network": {"id": "2623bcbf-c77c-47b4-abd5-ab538f9a2814", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1497688706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f40165c076e341bba42fb537ce98bbe2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1c68bac-be", "ovs_interfaceid": "d1c68bac-be37-4645-afcb-2b89f47c1793", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:42:00 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Releasing lock "refresh_cache-581cf468-65e7-42e5-9250-c3d645577011" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 15:42:00 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] [instance: 581cf468-65e7-42e5-9250-c3d645577011] Updated the network info_cache for instance {{(pid=75337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 15:42:00 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:42:00 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:42:00 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:42:00 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:42:00 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:42:00 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:42:00 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75337) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 15:42:00 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager.update_available_resource {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:42:00 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:42:00 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:42:00 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:42:00 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Auditing locally available compute resources for user (node: user) {{(pid=75337) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 15:42:01 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/581cf468-65e7-42e5-9250-c3d645577011/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:42:01 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/581cf468-65e7-42e5-9250-c3d645577011/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:42:01 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/581cf468-65e7-42e5-9250-c3d645577011/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:42:01 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/581cf468-65e7-42e5-9250-c3d645577011/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:42:01 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8cf1ead-a87c-459c-b914-a0e976c9e464/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:42:01 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8cf1ead-a87c-459c-b914-a0e976c9e464/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:42:01 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8cf1ead-a87c-459c-b914-a0e976c9e464/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:42:01 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-b924cfc8-c700-41b5-af96-ffef03d1f6d5 tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 76ee582b-b887-4d46-8c78-29f42d1a0d26 is timed out.
Nov 06 15:42:01 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-b924cfc8-c700-41b5-af96-ffef03d1f6d5 tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] Successfully detached device vdb from instance 76ee582b-b887-4d46-8c78-29f42d1a0d26 from the live domain config.
Nov 06 15:42:01 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b924cfc8-c700-41b5-af96-ffef03d1f6d5 tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] [instance: 76ee582b-b887-4d46-8c78-29f42d1a0d26] calling os-brick to detach iSCSI Volume {{(pid=75337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 15:42:01 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b924cfc8-c700-41b5-af96-ffef03d1f6d5 tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2abc33d0c0>, {'target_iqn': 'iqn.2010-10.org.openstack:dccaff76-b907-4a00-b34d-bb5ae7655a02', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HRrhEMiY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 15:42:01 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-b924cfc8-c700-41b5-af96-ffef03d1f6d5 tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 15:42:01 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-b924cfc8-c700-41b5-af96-ffef03d1f6d5 tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 15:42:01 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-b924cfc8-c700-41b5-af96-ffef03d1f6d5 tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 15:42:01 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:42:01 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:42:01 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[63f057a5-a383-4207-b7e0-8431d6fff396]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:eaf5fc54-be7c-4748-9e2f-12a01971e6f4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0ad85d1f-7027-4997-96c4-991e3969067d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dccaff76-b907-4a00-b34d-bb5ae7655a02\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7f11bb9d-a426-4068-9915-1da27b932a82\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4367fb98-2ae9-40c3-a2d0-6e9b0f70dc7c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:42:01 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b924cfc8-c700-41b5-af96-ffef03d1f6d5 tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 15:42:01 user nova-compute[75337]: No targets found.
Nov 06 15:42:01 user nova-compute[75337]: iSNS:
Nov 06 15:42:01 user nova-compute[75337]: No targets found.
Nov 06 15:42:01 user nova-compute[75337]: STATIC:
Nov 06 15:42:01 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:eaf5fc54-be7c-4748-9e2f-12a01971e6f4
Nov 06 15:42:01 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 15:42:01 user nova-compute[75337]:                 Iface Name: default
Nov 06 15:42:01 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:0ad85d1f-7027-4997-96c4-991e3969067d
Nov 06 15:42:01 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 15:42:01 user nova-compute[75337]:                 Iface Name: default
Nov 06 15:42:01 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:dccaff76-b907-4a00-b34d-bb5ae7655a02
Nov 06 15:42:01 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 15:42:01 user nova-compute[75337]:                 Iface Name: default
Nov 06 15:42:01 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759
Nov 06 15:42:01 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 15:42:01 user nova-compute[75337]:                 Iface Name: default
Nov 06 15:42:01 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:7f11bb9d-a426-4068-9915-1da27b932a82
Nov 06 15:42:01 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 15:42:01 user nova-compute[75337]:                 Iface Name: default
Nov 06 15:42:01 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:4367fb98-2ae9-40c3-a2d0-6e9b0f70dc7c
Nov 06 15:42:01 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 15:42:01 user nova-compute[75337]:                 Iface Name: default
Nov 06 15:42:01 user nova-compute[75337]: FIRMWARE:
Nov 06 15:42:01 user nova-compute[75337]: No targets found.
Nov 06 15:42:01 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 15:42:01 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b924cfc8-c700-41b5-af96-ffef03d1f6d5 tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 15:42:01 user nova-compute[75337]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 15:42:01 user nova-compute[75337]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75337) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 15:42:01 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b924cfc8-c700-41b5-af96-ffef03d1f6d5 tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dccaff76-b907-4a00-b34d-bb5ae7655a02', 0)] {{(pid=75337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 15:42:01 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:42:01 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8cf1ead-a87c-459c-b914-a0e976c9e464/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:42:01 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:42:01 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2332f9d-7a7c-4dd5-9a98-996534b93b31]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ad85d1f-7027-4997-96c4-991e3969067d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4367fb98-2ae9-40c3-a2d0-6e9b0f70dc7c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f11bb9d-a426-4068-9915-1da27b932a82\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dccaff76-b907-4a00-b34d-bb5ae7655a02\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eaf5fc54-be7c-4748-9e2f-12a01971e6f4\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:42:01 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:42:01 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76ee582b-b887-4d46-8c78-29f42d1a0d26/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:42:01 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:42:01 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[908dbd1a-4d79-4a9c-95ca-28da1afcf479]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dccaff76-b907-4a00-b34d-bb5ae7655a02 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4367fb98-2ae9-40c3-a2d0-6e9b0f70dc7c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ad85d1f-7027-4997-96c4-991e3969067d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaf5fc54-be7c-4748-9e2f-12a01971e6f4 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f11bb9d-a426-4068-9915-1da27b932a82 (non-flash)\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:42:01 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b924cfc8-c700-41b5-af96-ffef03d1f6d5 tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759 (non-flash)
Nov 06 15:42:01 user nova-compute[75337]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dccaff76-b907-4a00-b34d-bb5ae7655a02 (non-flash)
Nov 06 15:42:01 user nova-compute[75337]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4367fb98-2ae9-40c3-a2d0-6e9b0f70dc7c (non-flash)
Nov 06 15:42:01 user nova-compute[75337]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ad85d1f-7027-4997-96c4-991e3969067d (non-flash)
Nov 06 15:42:01 user nova-compute[75337]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaf5fc54-be7c-4748-9e2f-12a01971e6f4 (non-flash)
Nov 06 15:42:01 user nova-compute[75337]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f11bb9d-a426-4068-9915-1da27b932a82 (non-flash)
Nov 06 15:42:01 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 15:42:01 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b924cfc8-c700-41b5-af96-ffef03d1f6d5 tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759 (non-flash)
Nov 06 15:42:01 user nova-compute[75337]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dccaff76-b907-4a00-b34d-bb5ae7655a02 (non-flash)
Nov 06 15:42:01 user nova-compute[75337]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4367fb98-2ae9-40c3-a2d0-6e9b0f70dc7c (non-flash)
Nov 06 15:42:01 user nova-compute[75337]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ad85d1f-7027-4997-96c4-991e3969067d (non-flash)
Nov 06 15:42:01 user nova-compute[75337]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaf5fc54-be7c-4748-9e2f-12a01971e6f4 (non-flash)
Nov 06 15:42:01 user nova-compute[75337]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f11bb9d-a426-4068-9915-1da27b932a82 (non-flash)
Nov 06 15:42:01 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 15:42:01 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b924cfc8-c700-41b5-af96-ffef03d1f6d5 tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2acd685d80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dccaff76-b907-4a00-b34d-bb5ae7655a02'): ({'sde'}, set())}) {{(pid=75337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 15:42:01 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-b924cfc8-c700-41b5-af96-ffef03d1f6d5 tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] Removing single pathed devices sde {{(pid=75337) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 15:42:01 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:42:01 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:42:01 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[05563acc-4ee6-45e5-aad6-cd19a74f334e]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:42:01 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:42:01 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:42:01 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[c338e43c-3c57-4190-8bba-e2c68d9546e7]: (4, ('ok\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:42:01 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-b924cfc8-c700-41b5-af96-ffef03d1f6d5 tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] Flushing IO for device /dev/sde {{(pid=75337) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 15:42:01 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:42:01 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:42:01 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[08f5bfd6-0fd1-4d58-aedc-769fbff3f9ee]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:42:01 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-b924cfc8-c700-41b5-af96-ffef03d1f6d5 tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75337) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 15:42:01 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:42:01 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.048s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:42:01 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[20ba0d54-3057-4769-8c34-3a110861087b]: (4, ('1', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:42:01 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-b924cfc8-c700-41b5-af96-ffef03d1f6d5 tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 15:42:01 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-b924cfc8-c700-41b5-af96-ffef03d1f6d5 tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] SCSI volumes sde have been removed. {{(pid=75337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 15:42:01 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b924cfc8-c700-41b5-af96-ffef03d1f6d5 tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dccaff76-b907-4a00-b34d-bb5ae7655a02')] {{(pid=75337) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 15:42:01 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dccaff76-b907-4a00-b34d-bb5ae7655a02 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:42:02 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dccaff76-b907-4a00-b34d-bb5ae7655a02 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:42:02 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[1df2ef54-f226-414f-aafa-b2e4a5fcca5d]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:42:02 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b924cfc8-c700-41b5-af96-ffef03d1f6d5 tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:42:02 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dccaff76-b907-4a00-b34d-bb5ae7655a02 -p 172.16.0.220:3260 --logout {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:42:02 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76ee582b-b887-4d46-8c78-29f42d1a0d26/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:42:02 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76ee582b-b887-4d46-8c78-29f42d1a0d26/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:42:02 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dccaff76-b907-4a00-b34d-bb5ae7655a02 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:42:02 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd3ffe14-2929-4276-b5ec-7406137bccaa]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:dccaff76-b907-4a00-b34d-bb5ae7655a02, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:dccaff76-b907-4a00-b34d-bb5ae7655a02, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:42:02 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b924cfc8-c700-41b5-af96-ffef03d1f6d5 tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:dccaff76-b907-4a00-b34d-bb5ae7655a02, portal: 172.16.0.220,3260]
Nov 06 15:42:02 user nova-compute[75337]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:dccaff76-b907-4a00-b34d-bb5ae7655a02, portal: 172.16.0.220,3260] successful.
Nov 06 15:42:02 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:42:02 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dccaff76-b907-4a00-b34d-bb5ae7655a02 -p 172.16.0.220:3260 --op delete {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:42:02 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dccaff76-b907-4a00-b34d-bb5ae7655a02 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:42:02 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[da5af60d-d664-4c27-89a9-378b8300589a]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:42:02 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b924cfc8-c700-41b5-af96-ffef03d1f6d5 tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:42:02 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-b924cfc8-c700-41b5-af96-ffef03d1f6d5 tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.337s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 15:42:02 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b924cfc8-c700-41b5-af96-ffef03d1f6d5 tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] <== disconnect_volume: return (339ms) None {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 15:42:02 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b924cfc8-c700-41b5-af96-ffef03d1f6d5 tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] [instance: 76ee582b-b887-4d46-8c78-29f42d1a0d26] Disconnected iSCSI Volume {{(pid=75337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 15:42:02 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76ee582b-b887-4d46-8c78-29f42d1a0d26/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:42:02 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfadb21f-5ed1-42f4-956b-95cccf128b6a/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:42:02 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfadb21f-5ed1-42f4-956b-95cccf128b6a/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:42:02 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfadb21f-5ed1-42f4-956b-95cccf128b6a/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:42:02 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfadb21f-5ed1-42f4-956b-95cccf128b6a/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:42:02 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 15:42:02 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 15:42:02 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 15:42:02 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=75337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 15:42:02 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:42:02 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:42:02 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:42:02 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:42:02 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=75337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 15:42:02 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8858d90e-ee14-494b-80da-904cd97cdff0/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:42:03 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8858d90e-ee14-494b-80da-904cd97cdff0/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:42:03 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8858d90e-ee14-494b-80da-904cd97cdff0/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:42:03 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8858d90e-ee14-494b-80da-904cd97cdff0/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:42:03 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5dc789c-b1ee-4ee8-8e2b-9a6cb56a1361/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:42:03 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5dc789c-b1ee-4ee8-8e2b-9a6cb56a1361/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:42:03 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5dc789c-b1ee-4ee8-8e2b-9a6cb56a1361/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:42:03 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5dc789c-b1ee-4ee8-8e2b-9a6cb56a1361/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:42:03 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83516ff5-c4e7-4e91-a2f9-8af9b51cf475/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:42:03 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83516ff5-c4e7-4e91-a2f9-8af9b51cf475/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:42:03 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83516ff5-c4e7-4e91-a2f9-8af9b51cf475/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:42:04 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83516ff5-c4e7-4e91-a2f9-8af9b51cf475/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:42:04 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:42:04 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 15:42:04 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 15:42:04 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Hypervisor/Node resource view: name=user free_ram=7746MB free_disk=25.350189208984375GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75337) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 15:42:04 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:42:04 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:42:04 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 83516ff5-c4e7-4e91-a2f9-8af9b51cf475 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:42:04 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance c8cf1ead-a87c-459c-b914-a0e976c9e464 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:42:04 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 581cf468-65e7-42e5-9250-c3d645577011 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:42:04 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance dfadb21f-5ed1-42f4-956b-95cccf128b6a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:42:04 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 8858d90e-ee14-494b-80da-904cd97cdff0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:42:04 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:42:04 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 76ee582b-b887-4d46-8c78-29f42d1a0d26 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:42:04 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:42:04 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance d5dc789c-b1ee-4ee8-8e2b-9a6cb56a1361 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:42:04 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 1fa4c927-7485-4f34-94bd-9e20358904b6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:42:04 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 15:42:04 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 15:42:05 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 15:42:05 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 15:42:05 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Compute_service record updated for user:user {{(pid=75337) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 15:42:05 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.466s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:42:09 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:42:13 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:42:14 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:42:15 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-1742b26e-22f7-4005-a190-354af68c53aa tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Acquiring lock "8a600bd8-b94a-4242-a443-c2defb002280" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:42:15 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-1742b26e-22f7-4005-a190-354af68c53aa tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Lock "8a600bd8-b94a-4242-a443-c2defb002280" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:42:15 user nova-compute[75337]: INFO nova.compute.manager [None req-1742b26e-22f7-4005-a190-354af68c53aa tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] [instance: 8a600bd8-b94a-4242-a443-c2defb002280] Unshelving
Nov 06 15:42:15 user nova-compute[75337]: INFO nova.virt.block_device [None req-1742b26e-22f7-4005-a190-354af68c53aa tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] [instance: 8a600bd8-b94a-4242-a443-c2defb002280] Booting with volume bc0578f4-b30e-45b3-8cac-26620e7c3e96 at /dev/vdc
Nov 06 15:42:15 user nova-compute[75337]: DEBUG nova.objects.instance [None req-b924cfc8-c700-41b5-af96-ffef03d1f6d5 tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] Lazy-loading 'flavor' on Instance uuid 76ee582b-b887-4d46-8c78-29f42d1a0d26 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 15:42:15 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-b924cfc8-c700-41b5-af96-ffef03d1f6d5 tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] Lock "76ee582b-b887-4d46-8c78-29f42d1a0d26" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 34.769s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:42:15 user nova-compute[75337]: DEBUG nova.compute.manager [None req-e564e478-8eb6-4725-a9bf-772b7b488d30 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: 1fa4c927-7485-4f34-94bd-9e20358904b6] Start spawning the instance on the hypervisor. {{(pid=75337) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 15:42:15 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-e564e478-8eb6-4725-a9bf-772b7b488d30 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: 1fa4c927-7485-4f34-94bd-9e20358904b6] Creating instance directory {{(pid=75337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 15:42:15 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-e564e478-8eb6-4725-a9bf-772b7b488d30 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: 1fa4c927-7485-4f34-94bd-9e20358904b6] Creating image(s)
Nov 06 15:42:15 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-e564e478-8eb6-4725-a9bf-772b7b488d30 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: 1fa4c927-7485-4f34-94bd-9e20358904b6] Did not create local disks {{(pid=75337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 06 15:42:15 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-e564e478-8eb6-4725-a9bf-772b7b488d30 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: 1fa4c927-7485-4f34-94bd-9e20358904b6] Ensure instance console log exists: /opt/stack/data/nova/instances/1fa4c927-7485-4f34-94bd-9e20358904b6/console.log {{(pid=75337) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 15:42:15 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-e564e478-8eb6-4725-a9bf-772b7b488d30 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:42:15 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-e564e478-8eb6-4725-a9bf-772b7b488d30 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:42:15 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-e564e478-8eb6-4725-a9bf-772b7b488d30 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:42:15 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-e564e478-8eb6-4725-a9bf-772b7b488d30 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: 1fa4c927-7485-4f34-94bd-9e20358904b6] Start _get_guest_xml network_info=[{"id": "3812cc74-01db-4b2b-815c-770420051e1b", "address": "fa:16:3e:f4:aa:7b", "network": {"id": "736be000-ee94-41fd-9de0-f2f885ec9be7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1715443852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb76b5b0f2b24f1c84a92403176bcc00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3812cc74-01", "ovs_interfaceid": "3812cc74-01db-4b2b-815c-770420051e1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T15:34:14Z,direct_url=<?>,disk_format='qcow2',id=16b903ae-a40f-41a7-985b-4804cce92c62,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6549a15819f1469bbd5eeae8190e3d44',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T15:34:15Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'attachment_id': '558ab0eb-f864-4606-b5a8-2d7f980cbea6', 'guest_format': None, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WUOuHYhT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1fa4c927-7485-4f34-94bd-9e20358904b6', 'attached_at': '', 'detached_at': '', 'volume_id': '2e08ef35-543e-4718-beed-36e2ed8dd158', 'serial': '2e08ef35-543e-4718-beed-36e2ed8dd158'}, 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=75337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 15:42:15 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-e564e478-8eb6-4725-a9bf-772b7b488d30 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 15:42:15 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-e564e478-8eb6-4725-a9bf-772b7b488d30 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 15:42:15 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-e564e478-8eb6-4725-a9bf-772b7b488d30 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 15:42:15 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-e564e478-8eb6-4725-a9bf-772b7b488d30 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] CPU controller missing on host. {{(pid=75337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 15:42:15 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-e564e478-8eb6-4725-a9bf-772b7b488d30 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 15:42:15 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-e564e478-8eb6-4725-a9bf-772b7b488d30 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] CPU controller found on host. {{(pid=75337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 15:42:15 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-e564e478-8eb6-4725-a9bf-772b7b488d30 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75337) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 15:42:15 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-e564e478-8eb6-4725-a9bf-772b7b488d30 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T15:34:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T15:34:14Z,direct_url=<?>,disk_format='qcow2',id=16b903ae-a40f-41a7-985b-4804cce92c62,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6549a15819f1469bbd5eeae8190e3d44',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T15:34:15Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 15:42:15 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-e564e478-8eb6-4725-a9bf-772b7b488d30 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Flavor limits 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 15:42:15 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-e564e478-8eb6-4725-a9bf-772b7b488d30 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Image limits 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 15:42:15 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-e564e478-8eb6-4725-a9bf-772b7b488d30 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Flavor pref 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 15:42:15 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-e564e478-8eb6-4725-a9bf-772b7b488d30 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Image pref 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 15:42:15 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-e564e478-8eb6-4725-a9bf-772b7b488d30 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 15:42:15 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-e564e478-8eb6-4725-a9bf-772b7b488d30 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 15:42:15 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-e564e478-8eb6-4725-a9bf-772b7b488d30 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 15:42:15 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-e564e478-8eb6-4725-a9bf-772b7b488d30 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Got 1 possible topologies {{(pid=75337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 15:42:15 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-e564e478-8eb6-4725-a9bf-772b7b488d30 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 15:42:15 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-e564e478-8eb6-4725-a9bf-772b7b488d30 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 15:42:15 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e564e478-8eb6-4725-a9bf-772b7b488d30 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: 1fa4c927-7485-4f34-94bd-9e20358904b6] Calling os-brick to attach iSCSI Volume {{(pid=75337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 15:42:15 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e564e478-8eb6-4725-a9bf-772b7b488d30 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2abc33d0c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WUOuHYhT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 15:42:15 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-e564e478-8eb6-4725-a9bf-772b7b488d30 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 15:42:15 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-e564e478-8eb6-4725-a9bf-772b7b488d30 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 15:42:15 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-e564e478-8eb6-4725-a9bf-772b7b488d30 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 15:42:15 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-e564e478-8eb6-4725-a9bf-772b7b488d30 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 15:42:15 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-e564e478-8eb6-4725-a9bf-772b7b488d30 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 15:42:15 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-e564e478-8eb6-4725-a9bf-772b7b488d30 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 15:42:15 user nova-compute[75337]: INFO os_brick.initiator.connectors.iscsi [None req-e564e478-8eb6-4725-a9bf-772b7b488d30 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 15:42:15 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 -p 172.16.0.220:3260 {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:42:15 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:42:15 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[3edf5b9d-8329-42e2-a2e9-df2baccfef2a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:42:15 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e564e478-8eb6-4725-a9bf-772b7b488d30 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 15:42:15 user nova-compute[75337]:  {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:42:15 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 -p 172.16.0.220:3260 --interface default --op new {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:42:15 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:42:15 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[1581a649-c3f9-4196-aca5-1072305d4889]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158] added\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:42:15 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e564e478-8eb6-4725-a9bf-772b7b488d30 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158] added
Nov 06 15:42:15 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:42:15 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:42:16 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:42:16 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[53adbe20-5a72-464d-a7ba-02165265f7f6]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:42:16 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e564e478-8eb6-4725-a9bf-772b7b488d30 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:42:16 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:42:16 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:42:16 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc6524e0-4b72-4bfe-bb10-069ef04f9a20]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:42:16 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e564e478-8eb6-4725-a9bf-772b7b488d30 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:42:16 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WUOuHYhT {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:42:16 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-fc327c94-a342-4f84-8a32-2f8d6f01953c tempest-VolumesAssistedSnapshotsTest-1848331343 tempest-VolumesAssistedSnapshotsTest-1848331343-project] [instance: cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1] volume_snapshot_create: create_info: {'snapshot_id': 'c8f68296-cc73-4c4c-9740-2d6a3ef29dc7', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=75337) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3576}}
Nov 06 15:42:16 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-fc327c94-a342-4f84-8a32-2f8d6f01953c tempest-VolumesAssistedSnapshotsTest-1848331343 tempest-VolumesAssistedSnapshotsTest-1848331343-project] [instance: cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1] snap xml: <domainsnapshot>
Nov 06 15:42:16 user nova-compute[75337]:   <disks>
Nov 06 15:42:16 user nova-compute[75337]:     <disk name="/dev/sdh" snapshot="external" type="file">
Nov 06 15:42:16 user nova-compute[75337]:       <source file="/dev/new_file"/>
Nov 06 15:42:16 user nova-compute[75337]:     </disk>
Nov 06 15:42:16 user nova-compute[75337]:     <disk name="vda" snapshot="no"/>
Nov 06 15:42:16 user nova-compute[75337]:   </disks>
Nov 06 15:42:16 user nova-compute[75337]: </domainsnapshot>
Nov 06 15:42:16 user nova-compute[75337]:  {{(pid=75337) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3517}}
Nov 06 15:42:16 user nova-compute[75337]: DEBUG nova.objects.instance [None req-fc327c94-a342-4f84-8a32-2f8d6f01953c tempest-VolumesAssistedSnapshotsTest-1848331343 tempest-VolumesAssistedSnapshotsTest-1848331343-project] Lazy-loading 'system_metadata' on Instance uuid cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 15:42:16 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WUOuHYhT" returned: 0 in 0.028s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:42:16 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[550ff3e7-5c5f-4d72-abd0-8174dfc95162]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:42:16 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e564e478-8eb6-4725-a9bf-772b7b488d30 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WUOuHYhT'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:42:16 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:42:16 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:42:16 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee63aa4c-366f-4a7b-8cae-5eec980971e0]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:42:16 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e564e478-8eb6-4725-a9bf-772b7b488d30 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:42:16 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:42:16 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-fc327c94-a342-4f84-8a32-2f8d6f01953c tempest-VolumesAssistedSnapshotsTest-1848331343 tempest-VolumesAssistedSnapshotsTest-1848331343-project] [instance: cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 06 15:42:16 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:42:16 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bf3e6b0-776f-4c33-ae66-5a3a62204341]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4367fb98-2ae9-40c3-a2d0-6e9b0f70dc7c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ad85d1f-7027-4997-96c4-991e3969067d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaf5fc54-be7c-4748-9e2f-12a01971e6f4 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f11bb9d-a426-4068-9915-1da27b932a82 (non-flash)\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:42:16 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e564e478-8eb6-4725-a9bf-772b7b488d30 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759 (non-flash)
Nov 06 15:42:16 user nova-compute[75337]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4367fb98-2ae9-40c3-a2d0-6e9b0f70dc7c (non-flash)
Nov 06 15:42:16 user nova-compute[75337]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ad85d1f-7027-4997-96c4-991e3969067d (non-flash)
Nov 06 15:42:16 user nova-compute[75337]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaf5fc54-be7c-4748-9e2f-12a01971e6f4 (non-flash)
Nov 06 15:42:16 user nova-compute[75337]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f11bb9d-a426-4068-9915-1da27b932a82 (non-flash)
Nov 06 15:42:16 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 15:42:16 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e564e478-8eb6-4725-a9bf-772b7b488d30 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759 (non-flash)
Nov 06 15:42:16 user nova-compute[75337]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4367fb98-2ae9-40c3-a2d0-6e9b0f70dc7c (non-flash)
Nov 06 15:42:16 user nova-compute[75337]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ad85d1f-7027-4997-96c4-991e3969067d (non-flash)
Nov 06 15:42:16 user nova-compute[75337]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaf5fc54-be7c-4748-9e2f-12a01971e6f4 (non-flash)
Nov 06 15:42:16 user nova-compute[75337]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f11bb9d-a426-4068-9915-1da27b932a82 (non-flash)
Nov 06 15:42:16 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 15:42:16 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 -p 172.16.0.220:3260 --login {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver [None req-fc327c94-a342-4f84-8a32-2f8d6f01953c tempest-VolumesAssistedSnapshotsTest-1848331343 tempest-VolumesAssistedSnapshotsTest-1848331343-project] [instance: cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver [instance: cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1] Traceback (most recent call last):
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver [instance: cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver [instance: cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver [instance: cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver [instance: cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver [instance: cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver [instance: cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver [instance: cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver [instance: cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1]     rv = execute(f, *args, **kwargs)
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver [instance: cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver [instance: cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1]     six.reraise(c, e, tb)
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver [instance: cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver [instance: cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1]     raise value
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver [instance: cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver [instance: cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1]     rv = meth(*args, **kwargs)
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver [instance: cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver [instance: cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver [instance: cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver [instance: cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1] 
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver [None req-fc327c94-a342-4f84-8a32-2f8d6f01953c tempest-VolumesAssistedSnapshotsTest-1848331343 tempest-VolumesAssistedSnapshotsTest-1848331343-project] [instance: cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver [instance: cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1] Traceback (most recent call last):
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver [instance: cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver [instance: cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1]     self._volume_snapshot_create(context, instance, guest,
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver [instance: cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver [instance: cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver [instance: cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver [instance: cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver [instance: cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver [instance: cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver [instance: cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver [instance: cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1]     rv = execute(f, *args, **kwargs)
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver [instance: cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver [instance: cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1]     six.reraise(c, e, tb)
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver [instance: cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver [instance: cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1]     raise value
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver [instance: cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver [instance: cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1]     rv = meth(*args, **kwargs)
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver [instance: cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver [instance: cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver [instance: cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver [instance: cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1] 
Nov 06 15:42:16 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-5a7f3c5b-81a3-456b-bac5-fd83fd5861a5 tempest-VolumesAssistedSnapshotsTest-1848331343 tempest-VolumesAssistedSnapshotsTest-1848331343-project] [instance: cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1] volume_snapshot_delete: delete_info: {'volume_id': '7f11bb9d-a426-4068-9915-1da27b932a82'} {{(pid=75337) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3677}}
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver [None req-5a7f3c5b-81a3-456b-bac5-fd83fd5861a5 tempest-VolumesAssistedSnapshotsTest-1848331343 tempest-VolumesAssistedSnapshotsTest-1848331343-project] [instance: cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver [instance: cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1] Traceback (most recent call last):
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver [instance: cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver [instance: cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1]     self._volume_snapshot_delete(context, instance, volume_id,
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver [instance: cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver [instance: cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1]     if delete_info['type'] != 'qcow2':
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver [instance: cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1] KeyError: 'type'
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver [instance: cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1] 
Nov 06 15:42:16 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-42b0e143-63ae-45cb-83ee-a5a9fc18a14a tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Acquiring lock "581cf468-65e7-42e5-9250-c3d645577011" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:42:16 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-42b0e143-63ae-45cb-83ee-a5a9fc18a14a tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Lock "581cf468-65e7-42e5-9250-c3d645577011" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:42:16 user nova-compute[75337]: DEBUG nova.objects.instance [None req-42b0e143-63ae-45cb-83ee-a5a9fc18a14a tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Lazy-loading 'flavor' on Instance uuid 581cf468-65e7-42e5-9250-c3d645577011 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 15:42:16 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 -p 172.16.0.220:3260 --login" returned: 0 in 0.085s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:42:16 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[41bb39ab-a16f-44c6-94d8-517e0c3c7511]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:42:16 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e564e478-8eb6-4725-a9bf-772b7b488d30 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158, portal: 172.16.0.220,3260]
Nov 06 15:42:16 user nova-compute[75337]: Login to [iface: default, target: iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158, portal: 172.16.0.220,3260] successful.
Nov 06 15:42:16 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:42:16 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:42:16 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-42b0e143-63ae-45cb-83ee-a5a9fc18a14a tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Lock "581cf468-65e7-42e5-9250-c3d645577011" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:42:16 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:42:16 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[683bf8ba-a896-46a8-b721-5cbaed0e7b72]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:42:16 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e564e478-8eb6-4725-a9bf-772b7b488d30 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:42:16 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:42:16 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-165b27f3-21f2-4e45-a1b3-7f69b978e7b4 tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] Acquiring lock "interface-76ee582b-b887-4d46-8c78-29f42d1a0d26-f5a850f4-996a-42df-9243-54ea71cc8eec" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:42:16 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-165b27f3-21f2-4e45-a1b3-7f69b978e7b4 tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] Lock "interface-76ee582b-b887-4d46-8c78-29f42d1a0d26-f5a850f4-996a-42df-9243-54ea71cc8eec" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:42:16 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:42:16 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[46f73299-672e-4429-b685-79d4a8a5c4de]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4367fb98-2ae9-40c3-a2d0-6e9b0f70dc7c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ad85d1f-7027-4997-96c4-991e3969067d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaf5fc54-be7c-4748-9e2f-12a01971e6f4 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f11bb9d-a426-4068-9915-1da27b932a82 (non-flash)\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:42:16 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e564e478-8eb6-4725-a9bf-772b7b488d30 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)
Nov 06 15:42:16 user nova-compute[75337]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759 (non-flash)
Nov 06 15:42:16 user nova-compute[75337]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4367fb98-2ae9-40c3-a2d0-6e9b0f70dc7c (non-flash)
Nov 06 15:42:16 user nova-compute[75337]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ad85d1f-7027-4997-96c4-991e3969067d (non-flash)
Nov 06 15:42:16 user nova-compute[75337]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaf5fc54-be7c-4748-9e2f-12a01971e6f4 (non-flash)
Nov 06 15:42:16 user nova-compute[75337]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f11bb9d-a426-4068-9915-1da27b932a82 (non-flash)
Nov 06 15:42:16 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 15:42:16 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e564e478-8eb6-4725-a9bf-772b7b488d30 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)
Nov 06 15:42:16 user nova-compute[75337]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759 (non-flash)
Nov 06 15:42:16 user nova-compute[75337]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4367fb98-2ae9-40c3-a2d0-6e9b0f70dc7c (non-flash)
Nov 06 15:42:16 user nova-compute[75337]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ad85d1f-7027-4997-96c4-991e3969067d (non-flash)
Nov 06 15:42:16 user nova-compute[75337]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaf5fc54-be7c-4748-9e2f-12a01971e6f4 (non-flash)
Nov 06 15:42:16 user nova-compute[75337]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f11bb9d-a426-4068-9915-1da27b932a82 (non-flash)
Nov 06 15:42:16 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 15:42:16 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-e564e478-8eb6-4725-a9bf-772b7b488d30 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.340s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 15:42:16 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e564e478-8eb6-4725-a9bf-772b7b488d30 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Connected to 172.16.0.220:3260 {{(pid=75337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 15:42:16 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-e564e478-8eb6-4725-a9bf-772b7b488d30 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] HCTL ('34', '-', '-', 0) found on session 10 with lun 0 {{(pid=75337) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 15:42:16 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-e564e478-8eb6-4725-a9bf-772b7b488d30 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75337) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 15:42:16 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:42:16 user nova-compute[75337]: DEBUG nova.objects.instance [None req-165b27f3-21f2-4e45-a1b3-7f69b978e7b4 tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] Lazy-loading 'flavor' on Instance uuid 76ee582b-b887-4d46-8c78-29f42d1a0d26 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 15:42:16 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:42:16 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a88c6e6-7333-4c72-9b5d-0b67c7f75a0b]: (4, ('- - 0', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:42:16 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-e564e478-8eb6-4725-a9bf-772b7b488d30 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Searching for a device in session 10 and hctl ['34', '*', '*', 0] yield: None {{(pid=75337) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 15:42:16 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-165b27f3-21f2-4e45-a1b3-7f69b978e7b4 tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T15:38:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1853414850',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1853414850',id=9,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFGP9zZx8/smrQZVJ9SjwMu8yi65szEQrklWGxwv+DWpP4x/gZJfYN1nhwlTtV8a2EPxv+zU/MdCKD4XLCPbyGN12jTTqoGcbI7kaYL/I7RmSLD+0nDNzAksw3YYfsN9cA==',key_name='tempest-keypair-135606244',keypairs=<?>,launch_index=0,launched_at=2023-11-06T15:38:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4180b3fb8de74de1ad134fe356b85d6f',ramdisk_id='',reservation_id='r-gdmig8v7',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-387682144',owner_user_name='tempest-TaggedAttachmentsTest-387682144-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T15:38:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='587c402e2f0d45ad909ae974a03cd20e',uuid=76ee582b-b887-4d46-8c78-29f42d1a0d26,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f5a850f4-996a-42df-9243-54ea71cc8eec", "address": "fa:16:3e:4d:c3:29", "network": {"id": "081214fe-5e93-4171-bf5b-63393a14c539", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1591381833", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "4180b3fb8de74de1ad134fe356b85d6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5a850f4-99", "ovs_interfaceid": "f5a850f4-996a-42df-9243-54ea71cc8eec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75337) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 15:42:16 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-165b27f3-21f2-4e45-a1b3-7f69b978e7b4 tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] Converting VIF {"id": "f5a850f4-996a-42df-9243-54ea71cc8eec", "address": "fa:16:3e:4d:c3:29", "network": {"id": "081214fe-5e93-4171-bf5b-63393a14c539", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1591381833", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "4180b3fb8de74de1ad134fe356b85d6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5a850f4-99", "ovs_interfaceid": "f5a850f4-996a-42df-9243-54ea71cc8eec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 15:42:16 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-165b27f3-21f2-4e45-a1b3-7f69b978e7b4 tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:c3:29,bridge_name='br-int',has_traffic_filtering=True,id=f5a850f4-996a-42df-9243-54ea71cc8eec,network=Network(081214fe-5e93-4171-bf5b-63393a14c539),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5a850f4-99') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 15:42:16 user nova-compute[75337]: DEBUG nova.virt.libvirt.guest [None req-165b27f3-21f2-4e45-a1b3-7f69b978e7b4 tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:4d:c3:29"/><model type="virtio"/><mtu size="1442"/><target dev="tapf5a850f4-99"/></interface> {{(pid=75337) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 06 15:42:16 user nova-compute[75337]: DEBUG nova.virt.libvirt.guest [None req-165b27f3-21f2-4e45-a1b3-7f69b978e7b4 tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:4d:c3:29"/><model type="virtio"/><mtu size="1442"/><target dev="tapf5a850f4-99"/></interface> {{(pid=75337) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 06 15:42:16 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-165b27f3-21f2-4e45-a1b3-7f69b978e7b4 tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] Attempting to detach device tapf5a850f4-99 from instance 76ee582b-b887-4d46-8c78-29f42d1a0d26 from the persistent domain config. {{(pid=75337) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 06 15:42:16 user nova-compute[75337]: DEBUG nova.virt.libvirt.guest [None req-165b27f3-21f2-4e45-a1b3-7f69b978e7b4 tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] detach device xml: <interface type="ethernet">
Nov 06 15:42:16 user nova-compute[75337]:   <mac address="fa:16:3e:4d:c3:29"/>
Nov 06 15:42:16 user nova-compute[75337]:   <model type="virtio"/>
Nov 06 15:42:16 user nova-compute[75337]:   <mtu size="1442"/>
Nov 06 15:42:16 user nova-compute[75337]:   <target dev="tapf5a850f4-99"/>
Nov 06 15:42:16 user nova-compute[75337]: </interface>
Nov 06 15:42:16 user nova-compute[75337]:  {{(pid=75337) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 15:42:16 user nova-compute[75337]: DEBUG nova.virt.libvirt.guest [None req-165b27f3-21f2-4e45-a1b3-7f69b978e7b4 tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:4d:c3:29"/><model type="virtio"/><mtu size="1442"/><target dev="tapf5a850f4-99"/></interface> {{(pid=75337) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 06 15:42:16 user nova-compute[75337]: DEBUG nova.virt.libvirt.guest [None req-165b27f3-21f2-4e45-a1b3-7f69b978e7b4 tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:4d:c3:29"/><model type="virtio"/><mtu size="1442"/><target dev="tapf5a850f4-99"/></interface>not found in domain: <domain type='kvm' id='9'>
Nov 06 15:42:16 user nova-compute[75337]:   <name>instance-00000009</name>
Nov 06 15:42:16 user nova-compute[75337]:   <uuid>76ee582b-b887-4d46-8c78-29f42d1a0d26</uuid>
Nov 06 15:42:16 user nova-compute[75337]:   <metadata>
Nov 06 15:42:16 user nova-compute[75337]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 15:42:16 user nova-compute[75337]:   <nova:package version="0.0.0"/>
Nov 06 15:42:16 user nova-compute[75337]:   <nova:name>tempest-device-tagging-server-1853414850</nova:name>
Nov 06 15:42:16 user nova-compute[75337]:   <nova:creationTime>2023-11-06 15:40:40</nova:creationTime>
Nov 06 15:42:16 user nova-compute[75337]:   <nova:flavor name="m1.tiny">
Nov 06 15:42:16 user nova-compute[75337]:     <nova:memory>512</nova:memory>
Nov 06 15:42:16 user nova-compute[75337]:     <nova:disk>1</nova:disk>
Nov 06 15:42:16 user nova-compute[75337]:     <nova:swap>0</nova:swap>
Nov 06 15:42:16 user nova-compute[75337]:     <nova:ephemeral>0</nova:ephemeral>
Nov 06 15:42:16 user nova-compute[75337]:     <nova:vcpus>1</nova:vcpus>
Nov 06 15:42:16 user nova-compute[75337]:   </nova:flavor>
Nov 06 15:42:16 user nova-compute[75337]:   <nova:owner>
Nov 06 15:42:16 user nova-compute[75337]:     <nova:user uuid="587c402e2f0d45ad909ae974a03cd20e">tempest-TaggedAttachmentsTest-387682144-project-member</nova:user>
Nov 06 15:42:16 user nova-compute[75337]:     <nova:project uuid="4180b3fb8de74de1ad134fe356b85d6f">tempest-TaggedAttachmentsTest-387682144</nova:project>
Nov 06 15:42:16 user nova-compute[75337]:   </nova:owner>
Nov 06 15:42:16 user nova-compute[75337]:   <nova:root type="image" uuid="16b903ae-a40f-41a7-985b-4804cce92c62"/>
Nov 06 15:42:16 user nova-compute[75337]:   <nova:ports>
Nov 06 15:42:16 user nova-compute[75337]:     <nova:port uuid="8d52e5d0-96a2-44ca-9968-9ac564aeff2c">
Nov 06 15:42:16 user nova-compute[75337]:       <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 06 15:42:16 user nova-compute[75337]:     </nova:port>
Nov 06 15:42:16 user nova-compute[75337]:     <nova:port uuid="f5a850f4-996a-42df-9243-54ea71cc8eec">
Nov 06 15:42:16 user nova-compute[75337]:       <nova:ip type="fixed" address="10.10.10.10" ipVersion="4"/>
Nov 06 15:42:16 user nova-compute[75337]:     </nova:port>
Nov 06 15:42:16 user nova-compute[75337]:   </nova:ports>
Nov 06 15:42:16 user nova-compute[75337]: </nova:instance>
Nov 06 15:42:16 user nova-compute[75337]:   </metadata>
Nov 06 15:42:16 user nova-compute[75337]:   <memory unit='KiB'>524288</memory>
Nov 06 15:42:16 user nova-compute[75337]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 06 15:42:16 user nova-compute[75337]:   <vcpu placement='static'>1</vcpu>
Nov 06 15:42:16 user nova-compute[75337]:   <resource>
Nov 06 15:42:16 user nova-compute[75337]:     <partition>/machine</partition>
Nov 06 15:42:16 user nova-compute[75337]:   </resource>
Nov 06 15:42:16 user nova-compute[75337]:   <sysinfo type='smbios'>
Nov 06 15:42:16 user nova-compute[75337]:     <system>
Nov 06 15:42:16 user nova-compute[75337]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 06 15:42:16 user nova-compute[75337]:       <entry name='product'>OpenStack Nova</entry>
Nov 06 15:42:16 user nova-compute[75337]:       <entry name='version'>0.0.0</entry>
Nov 06 15:42:16 user nova-compute[75337]:       <entry name='serial'>76ee582b-b887-4d46-8c78-29f42d1a0d26</entry>
Nov 06 15:42:16 user nova-compute[75337]:       <entry name='uuid'>76ee582b-b887-4d46-8c78-29f42d1a0d26</entry>
Nov 06 15:42:16 user nova-compute[75337]:       <entry name='family'>Virtual Machine</entry>
Nov 06 15:42:16 user nova-compute[75337]:     </system>
Nov 06 15:42:16 user nova-compute[75337]:   </sysinfo>
Nov 06 15:42:16 user nova-compute[75337]:   <os>
Nov 06 15:42:16 user nova-compute[75337]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 06 15:42:16 user nova-compute[75337]:     <boot dev='hd'/>
Nov 06 15:42:16 user nova-compute[75337]:     <smbios mode='sysinfo'/>
Nov 06 15:42:16 user nova-compute[75337]:   </os>
Nov 06 15:42:16 user nova-compute[75337]:   <features>
Nov 06 15:42:16 user nova-compute[75337]:     <acpi/>
Nov 06 15:42:16 user nova-compute[75337]:     <apic/>
Nov 06 15:42:16 user nova-compute[75337]:     <vmcoreinfo state='on'/>
Nov 06 15:42:16 user nova-compute[75337]:   </features>
Nov 06 15:42:16 user nova-compute[75337]:   <cpu mode='custom' match='exact' check='full'>
Nov 06 15:42:16 user nova-compute[75337]:     <model fallback='forbid'>Nehalem</model>
Nov 06 15:42:16 user nova-compute[75337]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 06 15:42:16 user nova-compute[75337]:     <feature policy='require' name='vme'/>
Nov 06 15:42:16 user nova-compute[75337]:     <feature policy='require' name='x2apic'/>
Nov 06 15:42:16 user nova-compute[75337]:     <feature policy='require' name='hypervisor'/>
Nov 06 15:42:16 user nova-compute[75337]:   </cpu>
Nov 06 15:42:16 user nova-compute[75337]:   <clock offset='utc'>
Nov 06 15:42:16 user nova-compute[75337]:     <timer name='pit' tickpolicy='delay'/>
Nov 06 15:42:16 user nova-compute[75337]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 06 15:42:16 user nova-compute[75337]:     <timer name='hpet' present='no'/>
Nov 06 15:42:16 user nova-compute[75337]:   </clock>
Nov 06 15:42:16 user nova-compute[75337]:   <on_poweroff>destroy</on_poweroff>
Nov 06 15:42:16 user nova-compute[75337]:   <on_reboot>restart</on_reboot>
Nov 06 15:42:16 user nova-compute[75337]:   <on_crash>destroy</on_crash>
Nov 06 15:42:16 user nova-compute[75337]:   <devices>
Nov 06 15:42:16 user nova-compute[75337]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 06 15:42:16 user nova-compute[75337]:     <disk type='file' device='disk'>
Nov 06 15:42:16 user nova-compute[75337]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 06 15:42:16 user nova-compute[75337]:       <source file='/opt/stack/data/nova/instances/76ee582b-b887-4d46-8c78-29f42d1a0d26/disk' index='2'/>
Nov 06 15:42:16 user nova-compute[75337]:       <backingStore type='file' index='3'>
Nov 06 15:42:16 user nova-compute[75337]:         <format type='raw'/>
Nov 06 15:42:16 user nova-compute[75337]:         <source file='/opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275'/>
Nov 06 15:42:16 user nova-compute[75337]:         <backingStore/>
Nov 06 15:42:16 user nova-compute[75337]:       </backingStore>
Nov 06 15:42:16 user nova-compute[75337]:       <target dev='vda' bus='virtio'/>
Nov 06 15:42:16 user nova-compute[75337]:       <alias name='virtio-disk0'/>
Nov 06 15:42:16 user nova-compute[75337]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 06 15:42:16 user nova-compute[75337]:     </disk>
Nov 06 15:42:16 user nova-compute[75337]:     <disk type='file' device='cdrom'>
Nov 06 15:42:16 user nova-compute[75337]:       <driver name='qemu' type='raw' cache='none'/>
Nov 06 15:42:16 user nova-compute[75337]:       <source file='/opt/stack/data/nova/instances/76ee582b-b887-4d46-8c78-29f42d1a0d26/disk.config' index='1'/>
Nov 06 15:42:16 user nova-compute[75337]:       <backingStore/>
Nov 06 15:42:16 user nova-compute[75337]:       <target dev='hda' bus='ide'/>
Nov 06 15:42:16 user nova-compute[75337]:       <readonly/>
Nov 06 15:42:16 user nova-compute[75337]:       <alias name='ide0-0-0'/>
Nov 06 15:42:16 user nova-compute[75337]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 06 15:42:16 user nova-compute[75337]:     </disk>
Nov 06 15:42:16 user nova-compute[75337]:     <controller type='usb' index='0' model='none'>
Nov 06 15:42:16 user nova-compute[75337]:       <alias name='usb'/>
Nov 06 15:42:16 user nova-compute[75337]:     </controller>
Nov 06 15:42:16 user nova-compute[75337]:     <controller type='pci' index='0' model='pci-root'>
Nov 06 15:42:16 user nova-compute[75337]:       <alias name='pci.0'/>
Nov 06 15:42:16 user nova-compute[75337]:     </controller>
Nov 06 15:42:16 user nova-compute[75337]:     <controller type='ide' index='0'>
Nov 06 15:42:16 user nova-compute[75337]:       <alias name='ide'/>
Nov 06 15:42:16 user nova-compute[75337]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 06 15:42:16 user nova-compute[75337]:     </controller>
Nov 06 15:42:16 user nova-compute[75337]:     <interface type='ethernet'>
Nov 06 15:42:16 user nova-compute[75337]:       <mac address='fa:16:3e:0b:83:6f'/>
Nov 06 15:42:16 user nova-compute[75337]:       <target dev='tap8d52e5d0-96'/>
Nov 06 15:42:16 user nova-compute[75337]:       <model type='virtio'/>
Nov 06 15:42:16 user nova-compute[75337]:       <mtu size='1442'/>
Nov 06 15:42:16 user nova-compute[75337]:       <alias name='net0'/>
Nov 06 15:42:16 user nova-compute[75337]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 06 15:42:16 user nova-compute[75337]:     </interface>
Nov 06 15:42:16 user nova-compute[75337]:     <interface type='ethernet'>
Nov 06 15:42:16 user nova-compute[75337]:       <mac address='fa:16:3e:4d:c3:29'/>
Nov 06 15:42:16 user nova-compute[75337]:       <target dev='tapf5a850f4-99'/>
Nov 06 15:42:16 user nova-compute[75337]:       <model type='virtio'/>
Nov 06 15:42:16 user nova-compute[75337]:       <mtu size='1442'/>
Nov 06 15:42:16 user nova-compute[75337]:       <alias name='net1'/>
Nov 06 15:42:16 user nova-compute[75337]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Nov 06 15:42:16 user nova-compute[75337]:     </interface>
Nov 06 15:42:16 user nova-compute[75337]:     <serial type='pty'>
Nov 06 15:42:16 user nova-compute[75337]:       <source path='/dev/pts/8'/>
Nov 06 15:42:16 user nova-compute[75337]:       <log file='/opt/stack/data/nova/instances/76ee582b-b887-4d46-8c78-29f42d1a0d26/console.log' append='off'/>
Nov 06 15:42:16 user nova-compute[75337]:       <target type='isa-serial' port='0'>
Nov 06 15:42:16 user nova-compute[75337]:         <model name='isa-serial'/>
Nov 06 15:42:16 user nova-compute[75337]:       </target>
Nov 06 15:42:16 user nova-compute[75337]:       <alias name='serial0'/>
Nov 06 15:42:16 user nova-compute[75337]:     </serial>
Nov 06 15:42:16 user nova-compute[75337]:     <console type='pty' tty='/dev/pts/8'>
Nov 06 15:42:16 user nova-compute[75337]:       <source path='/dev/pts/8'/>
Nov 06 15:42:16 user nova-compute[75337]:       <log file='/opt/stack/data/nova/instances/76ee582b-b887-4d46-8c78-29f42d1a0d26/console.log' append='off'/>
Nov 06 15:42:16 user nova-compute[75337]:       <target type='serial' port='0'/>
Nov 06 15:42:16 user nova-compute[75337]:       <alias name='serial0'/>
Nov 06 15:42:16 user nova-compute[75337]:     </console>
Nov 06 15:42:16 user nova-compute[75337]:     <input type='mouse' bus='ps2'>
Nov 06 15:42:16 user nova-compute[75337]:       <alias name='input0'/>
Nov 06 15:42:16 user nova-compute[75337]:     </input>
Nov 06 15:42:16 user nova-compute[75337]:     <input type='keyboard' bus='ps2'>
Nov 06 15:42:16 user nova-compute[75337]:       <alias name='input1'/>
Nov 06 15:42:16 user nova-compute[75337]:     </input>
Nov 06 15:42:16 user nova-compute[75337]:     <graphics type='vnc' port='5908' autoport='yes' listen='0.0.0.0'>
Nov 06 15:42:16 user nova-compute[75337]:       <listen type='address' address='0.0.0.0'/>
Nov 06 15:42:16 user nova-compute[75337]:     </graphics>
Nov 06 15:42:16 user nova-compute[75337]:     <audio id='1' type='none'/>
Nov 06 15:42:16 user nova-compute[75337]:     <video>
Nov 06 15:42:16 user nova-compute[75337]:       <model type='virtio' heads='1' primary='yes'/>
Nov 06 15:42:16 user nova-compute[75337]:       <alias name='video0'/>
Nov 06 15:42:16 user nova-compute[75337]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 06 15:42:16 user nova-compute[75337]:     </video>
Nov 06 15:42:16 user nova-compute[75337]:     <memballoon model='virtio'>
Nov 06 15:42:16 user nova-compute[75337]:       <stats period='10'/>
Nov 06 15:42:16 user nova-compute[75337]:       <alias name='balloon0'/>
Nov 06 15:42:16 user nova-compute[75337]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 06 15:42:16 user nova-compute[75337]:     </memballoon>
Nov 06 15:42:16 user nova-compute[75337]:     <rng model='virtio'>
Nov 06 15:42:16 user nova-compute[75337]:       <backend model='random'>/dev/urandom</backend>
Nov 06 15:42:16 user nova-compute[75337]:       <alias name='rng0'/>
Nov 06 15:42:16 user nova-compute[75337]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 06 15:42:16 user nova-compute[75337]:     </rng>
Nov 06 15:42:16 user nova-compute[75337]:   </devices>
Nov 06 15:42:16 user nova-compute[75337]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 06 15:42:16 user nova-compute[75337]:     <label>libvirt-76ee582b-b887-4d46-8c78-29f42d1a0d26</label>
Nov 06 15:42:16 user nova-compute[75337]:     <imagelabel>libvirt-76ee582b-b887-4d46-8c78-29f42d1a0d26</imagelabel>
Nov 06 15:42:16 user nova-compute[75337]:   </seclabel>
Nov 06 15:42:16 user nova-compute[75337]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 06 15:42:16 user nova-compute[75337]:     <label>+64055:+108</label>
Nov 06 15:42:16 user nova-compute[75337]:     <imagelabel>+64055:+108</imagelabel>
Nov 06 15:42:16 user nova-compute[75337]:   </seclabel>
Nov 06 15:42:16 user nova-compute[75337]: </domain>
Nov 06 15:42:16 user nova-compute[75337]:  {{(pid=75337) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 06 15:42:16 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-165b27f3-21f2-4e45-a1b3-7f69b978e7b4 tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] Successfully detached device tapf5a850f4-99 from instance 76ee582b-b887-4d46-8c78-29f42d1a0d26 from the persistent domain config.
Nov 06 15:42:16 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-165b27f3-21f2-4e45-a1b3-7f69b978e7b4 tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] (1/8): Attempting to detach device tapf5a850f4-99 with device alias net1 from instance 76ee582b-b887-4d46-8c78-29f42d1a0d26 from the live domain config. {{(pid=75337) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 06 15:42:16 user nova-compute[75337]: DEBUG nova.virt.libvirt.guest [None req-165b27f3-21f2-4e45-a1b3-7f69b978e7b4 tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] detach device xml: <interface type="ethernet">
Nov 06 15:42:16 user nova-compute[75337]:   <mac address="fa:16:3e:4d:c3:29"/>
Nov 06 15:42:16 user nova-compute[75337]:   <model type="virtio"/>
Nov 06 15:42:16 user nova-compute[75337]:   <mtu size="1442"/>
Nov 06 15:42:16 user nova-compute[75337]:   <target dev="tapf5a850f4-99"/>
Nov 06 15:42:16 user nova-compute[75337]: </interface>
Nov 06 15:42:16 user nova-compute[75337]:  {{(pid=75337) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver [None req-fc327c94-a342-4f84-8a32-2f8d6f01953c tempest-VolumesAssistedSnapshotsTest-1848331343 tempest-VolumesAssistedSnapshotsTest-1848331343-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot c8f68296-cc73-4c4c-9740-2d6a3ef29dc7 could not be found.
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver     raise value
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver 
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver 
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot c8f68296-cc73-4c4c-9740-2d6a3ef29dc7 could not be found. (HTTP 404) (Request-ID: req-b400ae97-b375-46de-9958-847500a3a57c)
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver 
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver 
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot c8f68296-cc73-4c4c-9740-2d6a3ef29dc7 could not be found.
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver 
Nov 06 15:42:16 user nova-compute[75337]: ERROR oslo_messaging.rpc.server [None req-fc327c94-a342-4f84-8a32-2f8d6f01953c tempest-VolumesAssistedSnapshotsTest-1848331343 tempest-VolumesAssistedSnapshotsTest-1848331343-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 06 15:42:16 user nova-compute[75337]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 06 15:42:16 user nova-compute[75337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 06 15:42:16 user nova-compute[75337]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 06 15:42:16 user nova-compute[75337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 06 15:42:16 user nova-compute[75337]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 06 15:42:16 user nova-compute[75337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 06 15:42:16 user nova-compute[75337]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 06 15:42:16 user nova-compute[75337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 06 15:42:16 user nova-compute[75337]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 06 15:42:16 user nova-compute[75337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 06 15:42:16 user nova-compute[75337]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 06 15:42:16 user nova-compute[75337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 06 15:42:16 user nova-compute[75337]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 06 15:42:16 user nova-compute[75337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 06 15:42:16 user nova-compute[75337]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 06 15:42:16 user nova-compute[75337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 06 15:42:16 user nova-compute[75337]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 06 15:42:16 user nova-compute[75337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4505, in volume_snapshot_create
Nov 06 15:42:16 user nova-compute[75337]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Nov 06 15:42:16 user nova-compute[75337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3597, in volume_snapshot_create
Nov 06 15:42:16 user nova-compute[75337]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 06 15:42:16 user nova-compute[75337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 06 15:42:16 user nova-compute[75337]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 06 15:42:16 user nova-compute[75337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 06 15:42:16 user nova-compute[75337]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 06 15:42:16 user nova-compute[75337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 06 15:42:16 user nova-compute[75337]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Nov 06 15:42:16 user nova-compute[75337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 06 15:42:16 user nova-compute[75337]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 06 15:42:16 user nova-compute[75337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 06 15:42:16 user nova-compute[75337]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 06 15:42:16 user nova-compute[75337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 06 15:42:16 user nova-compute[75337]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 06 15:42:16 user nova-compute[75337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 06 15:42:16 user nova-compute[75337]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Nov 06 15:42:16 user nova-compute[75337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 06 15:42:16 user nova-compute[75337]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Nov 06 15:42:16 user nova-compute[75337]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 06 15:42:16 user nova-compute[75337]: ERROR oslo_messaging.rpc.server     raise value
Nov 06 15:42:16 user nova-compute[75337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 06 15:42:16 user nova-compute[75337]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Nov 06 15:42:16 user nova-compute[75337]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 06 15:42:16 user nova-compute[75337]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 06 15:42:16 user nova-compute[75337]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 06 15:42:16 user nova-compute[75337]: ERROR oslo_messaging.rpc.server 
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver [None req-5a7f3c5b-81a3-456b-bac5-fd83fd5861a5 tempest-VolumesAssistedSnapshotsTest-1848331343 tempest-VolumesAssistedSnapshotsTest-1848331343-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver 
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver 
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-76a146e6-cba9-4416-978f-317b9ce36c67)
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver 
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver 
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 06 15:42:16 user nova-compute[75337]: ERROR nova.virt.libvirt.driver 
Nov 06 15:42:16 user nova-compute[75337]: ERROR oslo_messaging.rpc.server [None req-5a7f3c5b-81a3-456b-bac5-fd83fd5861a5 tempest-VolumesAssistedSnapshotsTest-1848331343 tempest-VolumesAssistedSnapshotsTest-1848331343-project] Exception during message handling: KeyError: 'type'
Nov 06 15:42:16 user nova-compute[75337]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 06 15:42:16 user nova-compute[75337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 06 15:42:16 user nova-compute[75337]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 06 15:42:16 user nova-compute[75337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 06 15:42:16 user nova-compute[75337]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 06 15:42:16 user nova-compute[75337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 06 15:42:16 user nova-compute[75337]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 06 15:42:16 user nova-compute[75337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 06 15:42:16 user nova-compute[75337]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 06 15:42:16 user nova-compute[75337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 06 15:42:16 user nova-compute[75337]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 06 15:42:16 user nova-compute[75337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 06 15:42:16 user nova-compute[75337]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 06 15:42:16 user nova-compute[75337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 06 15:42:16 user nova-compute[75337]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 06 15:42:16 user nova-compute[75337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 06 15:42:16 user nova-compute[75337]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 06 15:42:16 user nova-compute[75337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4517, in volume_snapshot_delete
Nov 06 15:42:16 user nova-compute[75337]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Nov 06 15:42:16 user nova-compute[75337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3853, in volume_snapshot_delete
Nov 06 15:42:16 user nova-compute[75337]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 06 15:42:16 user nova-compute[75337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 06 15:42:16 user nova-compute[75337]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 06 15:42:16 user nova-compute[75337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 06 15:42:16 user nova-compute[75337]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 06 15:42:16 user nova-compute[75337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 06 15:42:16 user nova-compute[75337]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Nov 06 15:42:16 user nova-compute[75337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 06 15:42:16 user nova-compute[75337]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Nov 06 15:42:16 user nova-compute[75337]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Nov 06 15:42:16 user nova-compute[75337]: ERROR oslo_messaging.rpc.server 
Nov 06 15:42:16 user nova-compute[75337]: DEBUG nova.objects.instance [None req-aaf7c305-0247-4921-9cd0-1c5a665fb183 tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] Lazy-loading 'flavor' on Instance uuid 8858d90e-ee14-494b-80da-904cd97cdff0 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 15:42:16 user nova-compute[75337]: DEBUG os_brick.utils [None req-1742b26e-22f7-4005-a190-354af68c53aa tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 15:42:16 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:42:16 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:42:16 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5a219cf-ae1c-492c-b1f5-34207c1109e6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4ff6411e45b8\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:42:16 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:42:16 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:42:16 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[09a01cf9-7b7c-462a-b415-6eebba7fceed]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:42:16 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:42:16 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-aaf7c305-0247-4921-9cd0-1c5a665fb183 tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] Lock "8858d90e-ee14-494b-80da-904cd97cdff0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 38.448s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:42:16 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:42:16 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:42:16 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fec3fa8-8cc2-4f1d-8fdc-4669e8bd9bc7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:42:16 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[a532910a-f35a-4100-8ec3-4c0daf7508de]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:42:16 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-1742b26e-22f7-4005-a190-354af68c53aa tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Running cmd (subprocess): nvme version {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:42:16 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-1742b26e-22f7-4005-a190-354af68c53aa tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] 'nvme version' failed. Not Retrying. {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 15:42:16 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:42:16 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1742b26e-22f7-4005-a190-354af68c53aa tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] nvme not present on system {{(pid=75337) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 15:42:16 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:42:16 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-165b27f3-21f2-4e45-a1b3-7f69b978e7b4 tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] Start waiting for the detach event from libvirt for device tapf5a850f4-99 with device alias net1 for instance 76ee582b-b887-4d46-8c78-29f42d1a0d26 {{(pid=75337) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 06 15:42:16 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:42:16 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 15:42:16 user nova-compute[75337]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 15:42:16 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd569cd4-5b40-48e2-a265-31062baa5ab6]: (4, '') {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:42:16 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.lightos [None req-1742b26e-22f7-4005-a190-354af68c53aa tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75337) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 15:42:16 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.lightos [None req-1742b26e-22f7-4005-a190-354af68c53aa tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 15:42:16 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.lightos [None req-1742b26e-22f7-4005-a190-354af68c53aa tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] LIGHTOS: no hostnqn found. {{(pid=75337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 15:42:16 user nova-compute[75337]: DEBUG os_brick.utils [None req-1742b26e-22f7-4005-a190-354af68c53aa tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] <== get_connector_properties: return (169ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4ff6411e45b8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 15:42:16 user nova-compute[75337]: DEBUG nova.virt.block_device [None req-1742b26e-22f7-4005-a190-354af68c53aa tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] [instance: 8a600bd8-b94a-4242-a443-c2defb002280] Updating existing volume attachment record: bcfeed58-3fbb-4703-8603-777bae6ec64a {{(pid=75337) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 15:42:16 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-42b0e143-63ae-45cb-83ee-a5a9fc18a14a tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Acquiring lock "581cf468-65e7-42e5-9250-c3d645577011" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:42:16 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-42b0e143-63ae-45cb-83ee-a5a9fc18a14a tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Lock "581cf468-65e7-42e5-9250-c3d645577011" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:42:16 user nova-compute[75337]: INFO nova.compute.manager [None req-42b0e143-63ae-45cb-83ee-a5a9fc18a14a tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] [instance: 581cf468-65e7-42e5-9250-c3d645577011] Attaching volume 84119968-a048-41d8-9688-39c01b5f860e to /dev/vdb
Nov 06 15:42:16 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-0198afa5-acb1-4b45-ba5f-30b0d756b4c7 tempest-VolumesAssistedSnapshotsTest-123777916 tempest-VolumesAssistedSnapshotsTest-123777916-project-admin] Acquiring lock "cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:42:16 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-0198afa5-acb1-4b45-ba5f-30b0d756b4c7 tempest-VolumesAssistedSnapshotsTest-123777916 tempest-VolumesAssistedSnapshotsTest-123777916-project-admin] Lock "cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:42:16 user nova-compute[75337]: INFO nova.compute.manager [None req-0198afa5-acb1-4b45-ba5f-30b0d756b4c7 tempest-VolumesAssistedSnapshotsTest-123777916 tempest-VolumesAssistedSnapshotsTest-123777916-project-admin] [instance: cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1] Detaching volume 7f11bb9d-a426-4068-9915-1da27b932a82
Nov 06 15:42:16 user nova-compute[75337]: DEBUG nova.compute.manager [req-bb55ed0d-05b5-496f-9318-c9236df76f70 req-adde985b-d914-464b-b5c9-bdfb34910a83 service nova] [instance: 76ee582b-b887-4d46-8c78-29f42d1a0d26] Received event network-vif-unplugged-f5a850f4-996a-42df-9243-54ea71cc8eec {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:42:16 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-bb55ed0d-05b5-496f-9318-c9236df76f70 req-adde985b-d914-464b-b5c9-bdfb34910a83 service nova] Acquiring lock "76ee582b-b887-4d46-8c78-29f42d1a0d26-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:42:16 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-bb55ed0d-05b5-496f-9318-c9236df76f70 req-adde985b-d914-464b-b5c9-bdfb34910a83 service nova] Lock "76ee582b-b887-4d46-8c78-29f42d1a0d26-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:42:16 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-bb55ed0d-05b5-496f-9318-c9236df76f70 req-adde985b-d914-464b-b5c9-bdfb34910a83 service nova] Lock "76ee582b-b887-4d46-8c78-29f42d1a0d26-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:42:16 user nova-compute[75337]: DEBUG nova.compute.manager [req-bb55ed0d-05b5-496f-9318-c9236df76f70 req-adde985b-d914-464b-b5c9-bdfb34910a83 service nova] [instance: 76ee582b-b887-4d46-8c78-29f42d1a0d26] No waiting events found dispatching network-vif-unplugged-f5a850f4-996a-42df-9243-54ea71cc8eec {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:42:16 user nova-compute[75337]: WARNING nova.compute.manager [req-bb55ed0d-05b5-496f-9318-c9236df76f70 req-adde985b-d914-464b-b5c9-bdfb34910a83 service nova] [instance: 76ee582b-b887-4d46-8c78-29f42d1a0d26] Received unexpected event network-vif-unplugged-f5a850f4-996a-42df-9243-54ea71cc8eec for instance with vm_state active and task_state None.
Nov 06 15:42:17 user nova-compute[75337]: DEBUG os_brick.utils [None req-42b0e143-63ae-45cb-83ee-a5a9fc18a14a tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 15:42:17 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:42:17 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:42:17 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[21090487-39db-4405-96f6-997c38adb592]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4ff6411e45b8\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:42:17 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:42:17 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:42:17 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[f849bc65-8237-4ec2-a1e7-f072c8c9101d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:42:17 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:42:17 user nova-compute[75337]: INFO nova.virt.block_device [None req-0198afa5-acb1-4b45-ba5f-30b0d756b4c7 tempest-VolumesAssistedSnapshotsTest-123777916 tempest-VolumesAssistedSnapshotsTest-123777916-project-admin] [instance: cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1] Attempting to driver detach volume 7f11bb9d-a426-4068-9915-1da27b932a82 from mountpoint /dev/vdb
Nov 06 15:42:17 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:42:17 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc442f44-d599-4905-bd41-0e4bee288906]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:42:17 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a8393eb-9ef6-4614-bb45-cd75c9fc3fab]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:42:17 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-42b0e143-63ae-45cb-83ee-a5a9fc18a14a tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Running cmd (subprocess): nvme version {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:42:17 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-42b0e143-63ae-45cb-83ee-a5a9fc18a14a tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] 'nvme version' failed. Not Retrying. {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 15:42:17 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.nvmeof [None req-42b0e143-63ae-45cb-83ee-a5a9fc18a14a tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] nvme not present on system {{(pid=75337) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 15:42:17 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:42:17 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-0198afa5-acb1-4b45-ba5f-30b0d756b4c7 tempest-VolumesAssistedSnapshotsTest-123777916 tempest-VolumesAssistedSnapshotsTest-123777916-project-admin] Attempting to detach device vdb from instance cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1 from the persistent domain config. {{(pid=75337) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 06 15:42:17 user nova-compute[75337]: DEBUG nova.virt.libvirt.guest [None req-0198afa5-acb1-4b45-ba5f-30b0d756b4c7 tempest-VolumesAssistedSnapshotsTest-123777916 tempest-VolumesAssistedSnapshotsTest-123777916-project-admin] detach device xml: <disk type="block" device="disk">
Nov 06 15:42:17 user nova-compute[75337]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 15:42:17 user nova-compute[75337]:   <source dev="/dev/sdh"/>
Nov 06 15:42:17 user nova-compute[75337]:   <target dev="vdb" bus="virtio"/>
Nov 06 15:42:17 user nova-compute[75337]:   <serial>7f11bb9d-a426-4068-9915-1da27b932a82</serial>
Nov 06 15:42:17 user nova-compute[75337]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 06 15:42:17 user nova-compute[75337]: </disk>
Nov 06 15:42:17 user nova-compute[75337]:  {{(pid=75337) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 15:42:17 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 15:42:17 user nova-compute[75337]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 15:42:17 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ea0dc64-a19b-4376-962d-65126f473971]: (4, '') {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:42:17 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.lightos [None req-42b0e143-63ae-45cb-83ee-a5a9fc18a14a tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75337) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 15:42:17 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.lightos [None req-42b0e143-63ae-45cb-83ee-a5a9fc18a14a tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 15:42:17 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.lightos [None req-42b0e143-63ae-45cb-83ee-a5a9fc18a14a tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] LIGHTOS: no hostnqn found. {{(pid=75337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 15:42:17 user nova-compute[75337]: DEBUG os_brick.utils [None req-42b0e143-63ae-45cb-83ee-a5a9fc18a14a tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4ff6411e45b8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 15:42:17 user nova-compute[75337]: DEBUG nova.virt.block_device [None req-42b0e143-63ae-45cb-83ee-a5a9fc18a14a tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] [instance: 581cf468-65e7-42e5-9250-c3d645577011] Updating existing volume attachment record: 9cb8b494-658d-4f88-9aec-3667b8934730 {{(pid=75337) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 15:42:17 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-0198afa5-acb1-4b45-ba5f-30b0d756b4c7 tempest-VolumesAssistedSnapshotsTest-123777916 tempest-VolumesAssistedSnapshotsTest-123777916-project-admin] Successfully detached device vdb from instance cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1 from the persistent domain config.
Nov 06 15:42:17 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-0198afa5-acb1-4b45-ba5f-30b0d756b4c7 tempest-VolumesAssistedSnapshotsTest-123777916 tempest-VolumesAssistedSnapshotsTest-123777916-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1 from the live domain config. {{(pid=75337) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 06 15:42:17 user nova-compute[75337]: DEBUG nova.virt.libvirt.guest [None req-0198afa5-acb1-4b45-ba5f-30b0d756b4c7 tempest-VolumesAssistedSnapshotsTest-123777916 tempest-VolumesAssistedSnapshotsTest-123777916-project-admin] detach device xml: <disk type="block" device="disk">
Nov 06 15:42:17 user nova-compute[75337]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 15:42:17 user nova-compute[75337]:   <source dev="/dev/sdh"/>
Nov 06 15:42:17 user nova-compute[75337]:   <target dev="vdb" bus="virtio"/>
Nov 06 15:42:17 user nova-compute[75337]:   <serial>7f11bb9d-a426-4068-9915-1da27b932a82</serial>
Nov 06 15:42:17 user nova-compute[75337]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 06 15:42:17 user nova-compute[75337]: </disk>
Nov 06 15:42:17 user nova-compute[75337]:  {{(pid=75337) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 15:42:17 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-e564e478-8eb6-4725-a9bf-772b7b488d30 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Searching for a device in session 10 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75337) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 15:42:17 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e564e478-8eb6-4725-a9bf-772b7b488d30 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WUOuHYhT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 15:42:17 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-e564e478-8eb6-4725-a9bf-772b7b488d30 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.375s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 15:42:17 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e564e478-8eb6-4725-a9bf-772b7b488d30 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] <== connect_volume: return (1375ms) {'type': 'block', 'scsi_wwn': '26661646130616538', 'path': '/dev/sdc'} {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 15:42:17 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e564e478-8eb6-4725-a9bf-772b7b488d30 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: 1fa4c927-7485-4f34-94bd-9e20358904b6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26661646130616538', 'path': '/dev/sdc'} {{(pid=75337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 15:42:17 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-e564e478-8eb6-4725-a9bf-772b7b488d30 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T15:40:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-777586837',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-777586837',id=12,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eb76b5b0f2b24f1c84a92403176bcc00',ramdisk_id='',reservation_id='r-hsqdw3vy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2044295020',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T15:40:56Z,user_data=None,user_id='74090d6e5b354d79bf6ded92e6de56aa',uuid=1fa4c927-7485-4f34-94bd-9e20358904b6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3812cc74-01db-4b2b-815c-770420051e1b", "address": "fa:16:3e:f4:aa:7b", "network": {"id": "736be000-ee94-41fd-9de0-f2f885ec9be7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1715443852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb76b5b0f2b24f1c84a92403176bcc00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3812cc74-01", "ovs_interfaceid": "3812cc74-01db-4b2b-815c-770420051e1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75337) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 15:42:17 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-e564e478-8eb6-4725-a9bf-772b7b488d30 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Converting VIF {"id": "3812cc74-01db-4b2b-815c-770420051e1b", "address": "fa:16:3e:f4:aa:7b", "network": {"id": "736be000-ee94-41fd-9de0-f2f885ec9be7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1715443852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb76b5b0f2b24f1c84a92403176bcc00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3812cc74-01", "ovs_interfaceid": "3812cc74-01db-4b2b-815c-770420051e1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 15:42:17 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-e564e478-8eb6-4725-a9bf-772b7b488d30 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:aa:7b,bridge_name='br-int',has_traffic_filtering=True,id=3812cc74-01db-4b2b-815c-770420051e1b,network=Network(736be000-ee94-41fd-9de0-f2f885ec9be7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3812cc74-01') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 15:42:17 user nova-compute[75337]: DEBUG nova.objects.instance [None req-e564e478-8eb6-4725-a9bf-772b7b488d30 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Lazy-loading 'pci_devices' on Instance uuid 1fa4c927-7485-4f34-94bd-9e20358904b6 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 15:42:17 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-e564e478-8eb6-4725-a9bf-772b7b488d30 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: 1fa4c927-7485-4f34-94bd-9e20358904b6] End _get_guest_xml xml=<domain type="kvm">
Nov 06 15:42:17 user nova-compute[75337]:   <uuid>1fa4c927-7485-4f34-94bd-9e20358904b6</uuid>
Nov 06 15:42:17 user nova-compute[75337]:   <name>instance-0000000c</name>
Nov 06 15:42:17 user nova-compute[75337]:   <memory>524288</memory>
Nov 06 15:42:17 user nova-compute[75337]:   <vcpu>1</vcpu>
Nov 06 15:42:17 user nova-compute[75337]:   <metadata>
Nov 06 15:42:17 user nova-compute[75337]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 15:42:17 user nova-compute[75337]:       <nova:package version="0.0.0"/>
Nov 06 15:42:17 user nova-compute[75337]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-777586837</nova:name>
Nov 06 15:42:17 user nova-compute[75337]:       <nova:creationTime>2023-11-06 15:42:15</nova:creationTime>
Nov 06 15:42:17 user nova-compute[75337]:       <nova:flavor name="m1.tiny">
Nov 06 15:42:17 user nova-compute[75337]:         <nova:memory>512</nova:memory>
Nov 06 15:42:17 user nova-compute[75337]:         <nova:disk>1</nova:disk>
Nov 06 15:42:17 user nova-compute[75337]:         <nova:swap>0</nova:swap>
Nov 06 15:42:17 user nova-compute[75337]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 15:42:17 user nova-compute[75337]:         <nova:vcpus>1</nova:vcpus>
Nov 06 15:42:17 user nova-compute[75337]:       </nova:flavor>
Nov 06 15:42:17 user nova-compute[75337]:       <nova:owner>
Nov 06 15:42:17 user nova-compute[75337]:         <nova:user uuid="74090d6e5b354d79bf6ded92e6de56aa">tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member</nova:user>
Nov 06 15:42:17 user nova-compute[75337]:         <nova:project uuid="eb76b5b0f2b24f1c84a92403176bcc00">tempest-ServerBootFromVolumeStableRescueTest-2044295020</nova:project>
Nov 06 15:42:17 user nova-compute[75337]:       </nova:owner>
Nov 06 15:42:17 user nova-compute[75337]:       <nova:root type="image" uuid="16b903ae-a40f-41a7-985b-4804cce92c62"/>
Nov 06 15:42:17 user nova-compute[75337]:       <nova:ports>
Nov 06 15:42:17 user nova-compute[75337]:         <nova:port uuid="3812cc74-01db-4b2b-815c-770420051e1b">
Nov 06 15:42:17 user nova-compute[75337]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 06 15:42:17 user nova-compute[75337]:         </nova:port>
Nov 06 15:42:17 user nova-compute[75337]:       </nova:ports>
Nov 06 15:42:17 user nova-compute[75337]:     </nova:instance>
Nov 06 15:42:17 user nova-compute[75337]:   </metadata>
Nov 06 15:42:17 user nova-compute[75337]:   <sysinfo type="smbios">
Nov 06 15:42:17 user nova-compute[75337]:     <system>
Nov 06 15:42:17 user nova-compute[75337]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 15:42:17 user nova-compute[75337]:       <entry name="product">OpenStack Nova</entry>
Nov 06 15:42:17 user nova-compute[75337]:       <entry name="version">0.0.0</entry>
Nov 06 15:42:17 user nova-compute[75337]:       <entry name="serial">1fa4c927-7485-4f34-94bd-9e20358904b6</entry>
Nov 06 15:42:17 user nova-compute[75337]:       <entry name="uuid">1fa4c927-7485-4f34-94bd-9e20358904b6</entry>
Nov 06 15:42:17 user nova-compute[75337]:       <entry name="family">Virtual Machine</entry>
Nov 06 15:42:17 user nova-compute[75337]:     </system>
Nov 06 15:42:17 user nova-compute[75337]:   </sysinfo>
Nov 06 15:42:17 user nova-compute[75337]:   <os>
Nov 06 15:42:17 user nova-compute[75337]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 15:42:17 user nova-compute[75337]:     <boot dev="hd"/>
Nov 06 15:42:17 user nova-compute[75337]:     <smbios mode="sysinfo"/>
Nov 06 15:42:17 user nova-compute[75337]:   </os>
Nov 06 15:42:17 user nova-compute[75337]:   <features>
Nov 06 15:42:17 user nova-compute[75337]:     <acpi/>
Nov 06 15:42:17 user nova-compute[75337]:     <apic/>
Nov 06 15:42:17 user nova-compute[75337]:     <vmcoreinfo/>
Nov 06 15:42:17 user nova-compute[75337]:   </features>
Nov 06 15:42:17 user nova-compute[75337]:   <clock offset="utc">
Nov 06 15:42:17 user nova-compute[75337]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 15:42:17 user nova-compute[75337]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 15:42:17 user nova-compute[75337]:     <timer name="hpet" present="no"/>
Nov 06 15:42:17 user nova-compute[75337]:   </clock>
Nov 06 15:42:17 user nova-compute[75337]:   <cpu mode="custom" match="exact">
Nov 06 15:42:17 user nova-compute[75337]:     <model>Nehalem</model>
Nov 06 15:42:17 user nova-compute[75337]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 15:42:17 user nova-compute[75337]:   </cpu>
Nov 06 15:42:17 user nova-compute[75337]:   <devices>
Nov 06 15:42:17 user nova-compute[75337]:     <disk type="block" device="disk">
Nov 06 15:42:17 user nova-compute[75337]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 15:42:17 user nova-compute[75337]:       <source dev="/dev/sdc"/>
Nov 06 15:42:17 user nova-compute[75337]:       <target dev="vda" bus="virtio"/>
Nov 06 15:42:17 user nova-compute[75337]:       <serial>2e08ef35-543e-4718-beed-36e2ed8dd158</serial>
Nov 06 15:42:17 user nova-compute[75337]:     </disk>
Nov 06 15:42:17 user nova-compute[75337]:     <interface type="ethernet">
Nov 06 15:42:17 user nova-compute[75337]:       <mac address="fa:16:3e:f4:aa:7b"/>
Nov 06 15:42:17 user nova-compute[75337]:       <model type="virtio"/>
Nov 06 15:42:17 user nova-compute[75337]:       <mtu size="1442"/>
Nov 06 15:42:17 user nova-compute[75337]:       <target dev="tap3812cc74-01"/>
Nov 06 15:42:17 user nova-compute[75337]:     </interface>
Nov 06 15:42:17 user nova-compute[75337]:     <serial type="pty">
Nov 06 15:42:17 user nova-compute[75337]:       <log file="/opt/stack/data/nova/instances/1fa4c927-7485-4f34-94bd-9e20358904b6/console.log" append="off"/>
Nov 06 15:42:17 user nova-compute[75337]:     </serial>
Nov 06 15:42:17 user nova-compute[75337]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 15:42:17 user nova-compute[75337]:     <video>
Nov 06 15:42:17 user nova-compute[75337]:       <model type="virtio"/>
Nov 06 15:42:17 user nova-compute[75337]:     </video>
Nov 06 15:42:17 user nova-compute[75337]:     <rng model="virtio">
Nov 06 15:42:17 user nova-compute[75337]:       <backend model="random">/dev/urandom</backend>
Nov 06 15:42:17 user nova-compute[75337]:     </rng>
Nov 06 15:42:17 user nova-compute[75337]:     <controller type="usb" index="0" model="none"/>
Nov 06 15:42:17 user nova-compute[75337]:     <memballoon model="virtio">
Nov 06 15:42:17 user nova-compute[75337]:       <stats period="10"/>
Nov 06 15:42:17 user nova-compute[75337]:     </memballoon>
Nov 06 15:42:17 user nova-compute[75337]:   </devices>
Nov 06 15:42:17 user nova-compute[75337]: </domain>
Nov 06 15:42:17 user nova-compute[75337]:  {{(pid=75337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 15:42:17 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-e564e478-8eb6-4725-a9bf-772b7b488d30 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T15:40:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-777586837',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-777586837',id=12,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eb76b5b0f2b24f1c84a92403176bcc00',ramdisk_id='',reservation_id='r-hsqdw3vy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2044295020',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T15:40:56Z,user_data=None,user_id='74090d6e5b354d79bf6ded92e6de56aa',uuid=1fa4c927-7485-4f34-94bd-9e20358904b6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3812cc74-01db-4b2b-815c-770420051e1b", "address": "fa:16:3e:f4:aa:7b", "network": {"id": "736be000-ee94-41fd-9de0-f2f885ec9be7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1715443852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb76b5b0f2b24f1c84a92403176bcc00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3812cc74-01", "ovs_interfaceid": "3812cc74-01db-4b2b-815c-770420051e1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 15:42:17 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-e564e478-8eb6-4725-a9bf-772b7b488d30 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Converting VIF {"id": "3812cc74-01db-4b2b-815c-770420051e1b", "address": "fa:16:3e:f4:aa:7b", "network": {"id": "736be000-ee94-41fd-9de0-f2f885ec9be7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1715443852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb76b5b0f2b24f1c84a92403176bcc00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3812cc74-01", "ovs_interfaceid": "3812cc74-01db-4b2b-815c-770420051e1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 15:42:17 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-e564e478-8eb6-4725-a9bf-772b7b488d30 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:aa:7b,bridge_name='br-int',has_traffic_filtering=True,id=3812cc74-01db-4b2b-815c-770420051e1b,network=Network(736be000-ee94-41fd-9de0-f2f885ec9be7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3812cc74-01') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 15:42:17 user nova-compute[75337]: DEBUG os_vif [None req-e564e478-8eb6-4725-a9bf-772b7b488d30 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:aa:7b,bridge_name='br-int',has_traffic_filtering=True,id=3812cc74-01db-4b2b-815c-770420051e1b,network=Network(736be000-ee94-41fd-9de0-f2f885ec9be7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3812cc74-01') {{(pid=75337) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 15:42:17 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:42:17 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:42:17 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 15:42:17 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:42:17 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '081a21d8-0e99-5cc1-9097-e13bd0630bf6', '_type': 'linux-noop'}}, row=False) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:42:17 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:42:17 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:42:17 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:42:17 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:42:17 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3812cc74-01, may_exist=True, interface_attrs={}) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:42:17 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3812cc74-01, col_values=(('qos', UUID('a9942ea8-3a87-4bf1-a442-502486bdcef4')),), if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:42:17 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3812cc74-01, col_values=(('external_ids', {'iface-id': '3812cc74-01db-4b2b-815c-770420051e1b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f4:aa:7b', 'vm-uuid': '1fa4c927-7485-4f34-94bd-9e20358904b6'}),), if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:42:17 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:42:17 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:42:17 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:42:17 user nova-compute[75337]: INFO os_vif [None req-e564e478-8eb6-4725-a9bf-772b7b488d30 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:aa:7b,bridge_name='br-int',has_traffic_filtering=True,id=3812cc74-01db-4b2b-815c-770420051e1b,network=Network(736be000-ee94-41fd-9de0-f2f885ec9be7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3812cc74-01')
Nov 06 15:42:17 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-e564e478-8eb6-4725-a9bf-772b7b488d30 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] No BDM found with device name vda, not building metadata. {{(pid=75337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 15:42:17 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-e564e478-8eb6-4725-a9bf-772b7b488d30 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] No VIF found with MAC fa:16:3e:f4:aa:7b, not building metadata {{(pid=75337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 15:42:17 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-0198afa5-acb1-4b45-ba5f-30b0d756b4c7 tempest-VolumesAssistedSnapshotsTest-123777916 tempest-VolumesAssistedSnapshotsTest-123777916-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1 {{(pid=75337) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 06 15:42:18 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:42:18 user nova-compute[75337]: DEBUG nova.compute.manager [req-ac0564f1-3dfc-4a86-9ca5-e542cc196fd1 req-6f5d7872-3bed-4839-a249-43dadec18809 service nova] [instance: 76ee582b-b887-4d46-8c78-29f42d1a0d26] Received event network-vif-plugged-f5a850f4-996a-42df-9243-54ea71cc8eec {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:42:18 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-ac0564f1-3dfc-4a86-9ca5-e542cc196fd1 req-6f5d7872-3bed-4839-a249-43dadec18809 service nova] Acquiring lock "76ee582b-b887-4d46-8c78-29f42d1a0d26-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:42:18 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-ac0564f1-3dfc-4a86-9ca5-e542cc196fd1 req-6f5d7872-3bed-4839-a249-43dadec18809 service nova] Lock "76ee582b-b887-4d46-8c78-29f42d1a0d26-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:42:18 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-ac0564f1-3dfc-4a86-9ca5-e542cc196fd1 req-6f5d7872-3bed-4839-a249-43dadec18809 service nova] Lock "76ee582b-b887-4d46-8c78-29f42d1a0d26-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:42:18 user nova-compute[75337]: DEBUG nova.compute.manager [req-ac0564f1-3dfc-4a86-9ca5-e542cc196fd1 req-6f5d7872-3bed-4839-a249-43dadec18809 service nova] [instance: 76ee582b-b887-4d46-8c78-29f42d1a0d26] No waiting events found dispatching network-vif-plugged-f5a850f4-996a-42df-9243-54ea71cc8eec {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:42:18 user nova-compute[75337]: WARNING nova.compute.manager [req-ac0564f1-3dfc-4a86-9ca5-e542cc196fd1 req-6f5d7872-3bed-4839-a249-43dadec18809 service nova] [instance: 76ee582b-b887-4d46-8c78-29f42d1a0d26] Received unexpected event network-vif-plugged-f5a850f4-996a-42df-9243-54ea71cc8eec for instance with vm_state active and task_state None.
Nov 06 15:42:18 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:42:18 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:42:19 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:42:19 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:42:19 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:42:20 user nova-compute[75337]: DEBUG nova.compute.manager [req-16fd5d6c-3358-4034-92b5-82a65c47712d req-d2692622-daeb-4320-b0df-2fd8d14a67c8 service nova] [instance: 1fa4c927-7485-4f34-94bd-9e20358904b6] Received event network-vif-plugged-3812cc74-01db-4b2b-815c-770420051e1b {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:42:20 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-16fd5d6c-3358-4034-92b5-82a65c47712d req-d2692622-daeb-4320-b0df-2fd8d14a67c8 service nova] Acquiring lock "1fa4c927-7485-4f34-94bd-9e20358904b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:42:20 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-16fd5d6c-3358-4034-92b5-82a65c47712d req-d2692622-daeb-4320-b0df-2fd8d14a67c8 service nova] Lock "1fa4c927-7485-4f34-94bd-9e20358904b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:42:20 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-16fd5d6c-3358-4034-92b5-82a65c47712d req-d2692622-daeb-4320-b0df-2fd8d14a67c8 service nova] Lock "1fa4c927-7485-4f34-94bd-9e20358904b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:42:20 user nova-compute[75337]: DEBUG nova.compute.manager [req-16fd5d6c-3358-4034-92b5-82a65c47712d req-d2692622-daeb-4320-b0df-2fd8d14a67c8 service nova] [instance: 1fa4c927-7485-4f34-94bd-9e20358904b6] No waiting events found dispatching network-vif-plugged-3812cc74-01db-4b2b-815c-770420051e1b {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:42:20 user nova-compute[75337]: WARNING nova.compute.manager [req-16fd5d6c-3358-4034-92b5-82a65c47712d req-d2692622-daeb-4320-b0df-2fd8d14a67c8 service nova] [instance: 1fa4c927-7485-4f34-94bd-9e20358904b6] Received unexpected event network-vif-plugged-3812cc74-01db-4b2b-815c-770420051e1b for instance with vm_state building and task_state spawning.
Nov 06 15:42:20 user nova-compute[75337]: DEBUG nova.compute.manager [req-16fd5d6c-3358-4034-92b5-82a65c47712d req-d2692622-daeb-4320-b0df-2fd8d14a67c8 service nova] [instance: 1fa4c927-7485-4f34-94bd-9e20358904b6] Received event network-vif-plugged-3812cc74-01db-4b2b-815c-770420051e1b {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:42:20 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-16fd5d6c-3358-4034-92b5-82a65c47712d req-d2692622-daeb-4320-b0df-2fd8d14a67c8 service nova] Acquiring lock "1fa4c927-7485-4f34-94bd-9e20358904b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:42:20 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-16fd5d6c-3358-4034-92b5-82a65c47712d req-d2692622-daeb-4320-b0df-2fd8d14a67c8 service nova] Lock "1fa4c927-7485-4f34-94bd-9e20358904b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:42:20 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-16fd5d6c-3358-4034-92b5-82a65c47712d req-d2692622-daeb-4320-b0df-2fd8d14a67c8 service nova] Lock "1fa4c927-7485-4f34-94bd-9e20358904b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:42:20 user nova-compute[75337]: DEBUG nova.compute.manager [req-16fd5d6c-3358-4034-92b5-82a65c47712d req-d2692622-daeb-4320-b0df-2fd8d14a67c8 service nova] [instance: 1fa4c927-7485-4f34-94bd-9e20358904b6] No waiting events found dispatching network-vif-plugged-3812cc74-01db-4b2b-815c-770420051e1b {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:42:20 user nova-compute[75337]: WARNING nova.compute.manager [req-16fd5d6c-3358-4034-92b5-82a65c47712d req-d2692622-daeb-4320-b0df-2fd8d14a67c8 service nova] [instance: 1fa4c927-7485-4f34-94bd-9e20358904b6] Received unexpected event network-vif-plugged-3812cc74-01db-4b2b-815c-770420051e1b for instance with vm_state building and task_state spawning.
Nov 06 15:42:21 user nova-compute[75337]: DEBUG nova.compute.manager [None req-e564e478-8eb6-4725-a9bf-772b7b488d30 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: 1fa4c927-7485-4f34-94bd-9e20358904b6] Instance event wait completed in 0 seconds for  {{(pid=75337) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 15:42:21 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-e564e478-8eb6-4725-a9bf-772b7b488d30 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: 1fa4c927-7485-4f34-94bd-9e20358904b6] Guest created on hypervisor {{(pid=75337) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 15:42:21 user nova-compute[75337]: INFO nova.virt.libvirt.driver [-] [instance: 1fa4c927-7485-4f34-94bd-9e20358904b6] Instance spawned successfully.
Nov 06 15:42:21 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-e564e478-8eb6-4725-a9bf-772b7b488d30 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: 1fa4c927-7485-4f34-94bd-9e20358904b6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 15:42:21 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-e564e478-8eb6-4725-a9bf-772b7b488d30 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: 1fa4c927-7485-4f34-94bd-9e20358904b6] Found default for hw_cdrom_bus of ide {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:42:21 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-e564e478-8eb6-4725-a9bf-772b7b488d30 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: 1fa4c927-7485-4f34-94bd-9e20358904b6] Found default for hw_disk_bus of virtio {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:42:21 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-e564e478-8eb6-4725-a9bf-772b7b488d30 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: 1fa4c927-7485-4f34-94bd-9e20358904b6] Found default for hw_input_bus of None {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:42:21 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-e564e478-8eb6-4725-a9bf-772b7b488d30 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: 1fa4c927-7485-4f34-94bd-9e20358904b6] Found default for hw_pointer_model of None {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:42:21 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-e564e478-8eb6-4725-a9bf-772b7b488d30 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: 1fa4c927-7485-4f34-94bd-9e20358904b6] Found default for hw_video_model of virtio {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:42:21 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-e564e478-8eb6-4725-a9bf-772b7b488d30 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: 1fa4c927-7485-4f34-94bd-9e20358904b6] Found default for hw_vif_model of virtio {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:42:21 user nova-compute[75337]: INFO nova.compute.manager [None req-e564e478-8eb6-4725-a9bf-772b7b488d30 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: 1fa4c927-7485-4f34-94bd-9e20358904b6] Took 5.39 seconds to spawn the instance on the hypervisor.
Nov 06 15:42:21 user nova-compute[75337]: DEBUG nova.compute.manager [None req-e564e478-8eb6-4725-a9bf-772b7b488d30 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: 1fa4c927-7485-4f34-94bd-9e20358904b6] Checking state {{(pid=75337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 15:42:21 user nova-compute[75337]: INFO nova.compute.manager [None req-e564e478-8eb6-4725-a9bf-772b7b488d30 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: 1fa4c927-7485-4f34-94bd-9e20358904b6] Took 86.25 seconds to build instance.
Nov 06 15:42:21 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-e564e478-8eb6-4725-a9bf-772b7b488d30 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Lock "1fa4c927-7485-4f34-94bd-9e20358904b6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 86.349s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:42:22 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:42:23 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:42:27 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:42:28 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:42:32 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:42:36 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-165b27f3-21f2-4e45-a1b3-7f69b978e7b4 tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] Waiting for libvirt event about the detach of device tapf5a850f4-99 with device alias net1 from instance 76ee582b-b887-4d46-8c78-29f42d1a0d26 is timed out.
Nov 06 15:42:36 user nova-compute[75337]: DEBUG nova.virt.libvirt.guest [None req-165b27f3-21f2-4e45-a1b3-7f69b978e7b4 tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:4d:c3:29"/><model type="virtio"/><mtu size="1442"/><target dev="tapf5a850f4-99"/></interface> {{(pid=75337) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 06 15:42:36 user nova-compute[75337]: DEBUG nova.virt.libvirt.guest [None req-165b27f3-21f2-4e45-a1b3-7f69b978e7b4 tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:4d:c3:29"/><model type="virtio"/><mtu size="1442"/><target dev="tapf5a850f4-99"/></interface>not found in domain: <domain type='kvm' id='9'>
Nov 06 15:42:36 user nova-compute[75337]:   <name>instance-00000009</name>
Nov 06 15:42:36 user nova-compute[75337]:   <uuid>76ee582b-b887-4d46-8c78-29f42d1a0d26</uuid>
Nov 06 15:42:36 user nova-compute[75337]:   <metadata>
Nov 06 15:42:36 user nova-compute[75337]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 15:42:36 user nova-compute[75337]:   <nova:package version="0.0.0"/>
Nov 06 15:42:36 user nova-compute[75337]:   <nova:name>tempest-device-tagging-server-1853414850</nova:name>
Nov 06 15:42:36 user nova-compute[75337]:   <nova:creationTime>2023-11-06 15:40:40</nova:creationTime>
Nov 06 15:42:36 user nova-compute[75337]:   <nova:flavor name="m1.tiny">
Nov 06 15:42:36 user nova-compute[75337]:     <nova:memory>512</nova:memory>
Nov 06 15:42:36 user nova-compute[75337]:     <nova:disk>1</nova:disk>
Nov 06 15:42:36 user nova-compute[75337]:     <nova:swap>0</nova:swap>
Nov 06 15:42:36 user nova-compute[75337]:     <nova:ephemeral>0</nova:ephemeral>
Nov 06 15:42:36 user nova-compute[75337]:     <nova:vcpus>1</nova:vcpus>
Nov 06 15:42:36 user nova-compute[75337]:   </nova:flavor>
Nov 06 15:42:36 user nova-compute[75337]:   <nova:owner>
Nov 06 15:42:36 user nova-compute[75337]:     <nova:user uuid="587c402e2f0d45ad909ae974a03cd20e">tempest-TaggedAttachmentsTest-387682144-project-member</nova:user>
Nov 06 15:42:36 user nova-compute[75337]:     <nova:project uuid="4180b3fb8de74de1ad134fe356b85d6f">tempest-TaggedAttachmentsTest-387682144</nova:project>
Nov 06 15:42:36 user nova-compute[75337]:   </nova:owner>
Nov 06 15:42:36 user nova-compute[75337]:   <nova:root type="image" uuid="16b903ae-a40f-41a7-985b-4804cce92c62"/>
Nov 06 15:42:36 user nova-compute[75337]:   <nova:ports>
Nov 06 15:42:36 user nova-compute[75337]:     <nova:port uuid="8d52e5d0-96a2-44ca-9968-9ac564aeff2c">
Nov 06 15:42:36 user nova-compute[75337]:       <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 06 15:42:36 user nova-compute[75337]:     </nova:port>
Nov 06 15:42:36 user nova-compute[75337]:     <nova:port uuid="f5a850f4-996a-42df-9243-54ea71cc8eec">
Nov 06 15:42:36 user nova-compute[75337]:       <nova:ip type="fixed" address="10.10.10.10" ipVersion="4"/>
Nov 06 15:42:36 user nova-compute[75337]:     </nova:port>
Nov 06 15:42:36 user nova-compute[75337]:   </nova:ports>
Nov 06 15:42:36 user nova-compute[75337]: </nova:instance>
Nov 06 15:42:36 user nova-compute[75337]:   </metadata>
Nov 06 15:42:36 user nova-compute[75337]:   <memory unit='KiB'>524288</memory>
Nov 06 15:42:36 user nova-compute[75337]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 06 15:42:36 user nova-compute[75337]:   <vcpu placement='static'>1</vcpu>
Nov 06 15:42:36 user nova-compute[75337]:   <resource>
Nov 06 15:42:36 user nova-compute[75337]:     <partition>/machine</partition>
Nov 06 15:42:36 user nova-compute[75337]:   </resource>
Nov 06 15:42:36 user nova-compute[75337]:   <sysinfo type='smbios'>
Nov 06 15:42:36 user nova-compute[75337]:     <system>
Nov 06 15:42:36 user nova-compute[75337]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 06 15:42:36 user nova-compute[75337]:       <entry name='product'>OpenStack Nova</entry>
Nov 06 15:42:36 user nova-compute[75337]:       <entry name='version'>0.0.0</entry>
Nov 06 15:42:36 user nova-compute[75337]:       <entry name='serial'>76ee582b-b887-4d46-8c78-29f42d1a0d26</entry>
Nov 06 15:42:36 user nova-compute[75337]:       <entry name='uuid'>76ee582b-b887-4d46-8c78-29f42d1a0d26</entry>
Nov 06 15:42:36 user nova-compute[75337]:       <entry name='family'>Virtual Machine</entry>
Nov 06 15:42:36 user nova-compute[75337]:     </system>
Nov 06 15:42:36 user nova-compute[75337]:   </sysinfo>
Nov 06 15:42:36 user nova-compute[75337]:   <os>
Nov 06 15:42:36 user nova-compute[75337]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 06 15:42:36 user nova-compute[75337]:     <boot dev='hd'/>
Nov 06 15:42:36 user nova-compute[75337]:     <smbios mode='sysinfo'/>
Nov 06 15:42:36 user nova-compute[75337]:   </os>
Nov 06 15:42:36 user nova-compute[75337]:   <features>
Nov 06 15:42:36 user nova-compute[75337]:     <acpi/>
Nov 06 15:42:36 user nova-compute[75337]:     <apic/>
Nov 06 15:42:36 user nova-compute[75337]:     <vmcoreinfo state='on'/>
Nov 06 15:42:36 user nova-compute[75337]:   </features>
Nov 06 15:42:36 user nova-compute[75337]:   <cpu mode='custom' match='exact' check='full'>
Nov 06 15:42:36 user nova-compute[75337]:     <model fallback='forbid'>Nehalem</model>
Nov 06 15:42:36 user nova-compute[75337]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 06 15:42:36 user nova-compute[75337]:     <feature policy='require' name='vme'/>
Nov 06 15:42:36 user nova-compute[75337]:     <feature policy='require' name='x2apic'/>
Nov 06 15:42:36 user nova-compute[75337]:     <feature policy='require' name='hypervisor'/>
Nov 06 15:42:36 user nova-compute[75337]:   </cpu>
Nov 06 15:42:36 user nova-compute[75337]:   <clock offset='utc'>
Nov 06 15:42:36 user nova-compute[75337]:     <timer name='pit' tickpolicy='delay'/>
Nov 06 15:42:36 user nova-compute[75337]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 06 15:42:36 user nova-compute[75337]:     <timer name='hpet' present='no'/>
Nov 06 15:42:36 user nova-compute[75337]:   </clock>
Nov 06 15:42:36 user nova-compute[75337]:   <on_poweroff>destroy</on_poweroff>
Nov 06 15:42:36 user nova-compute[75337]:   <on_reboot>restart</on_reboot>
Nov 06 15:42:36 user nova-compute[75337]:   <on_crash>destroy</on_crash>
Nov 06 15:42:36 user nova-compute[75337]:   <devices>
Nov 06 15:42:36 user nova-compute[75337]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 06 15:42:36 user nova-compute[75337]:     <disk type='file' device='disk'>
Nov 06 15:42:36 user nova-compute[75337]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 06 15:42:36 user nova-compute[75337]:       <source file='/opt/stack/data/nova/instances/76ee582b-b887-4d46-8c78-29f42d1a0d26/disk' index='2'/>
Nov 06 15:42:36 user nova-compute[75337]:       <backingStore type='file' index='3'>
Nov 06 15:42:36 user nova-compute[75337]:         <format type='raw'/>
Nov 06 15:42:36 user nova-compute[75337]:         <source file='/opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275'/>
Nov 06 15:42:36 user nova-compute[75337]:         <backingStore/>
Nov 06 15:42:36 user nova-compute[75337]:       </backingStore>
Nov 06 15:42:36 user nova-compute[75337]:       <target dev='vda' bus='virtio'/>
Nov 06 15:42:36 user nova-compute[75337]:       <alias name='virtio-disk0'/>
Nov 06 15:42:36 user nova-compute[75337]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 06 15:42:36 user nova-compute[75337]:     </disk>
Nov 06 15:42:36 user nova-compute[75337]:     <disk type='file' device='cdrom'>
Nov 06 15:42:36 user nova-compute[75337]:       <driver name='qemu' type='raw' cache='none'/>
Nov 06 15:42:36 user nova-compute[75337]:       <source file='/opt/stack/data/nova/instances/76ee582b-b887-4d46-8c78-29f42d1a0d26/disk.config' index='1'/>
Nov 06 15:42:36 user nova-compute[75337]:       <backingStore/>
Nov 06 15:42:36 user nova-compute[75337]:       <target dev='hda' bus='ide'/>
Nov 06 15:42:36 user nova-compute[75337]:       <readonly/>
Nov 06 15:42:36 user nova-compute[75337]:       <alias name='ide0-0-0'/>
Nov 06 15:42:36 user nova-compute[75337]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 06 15:42:36 user nova-compute[75337]:     </disk>
Nov 06 15:42:36 user nova-compute[75337]:     <controller type='usb' index='0' model='none'>
Nov 06 15:42:36 user nova-compute[75337]:       <alias name='usb'/>
Nov 06 15:42:36 user nova-compute[75337]:     </controller>
Nov 06 15:42:36 user nova-compute[75337]:     <controller type='pci' index='0' model='pci-root'>
Nov 06 15:42:36 user nova-compute[75337]:       <alias name='pci.0'/>
Nov 06 15:42:36 user nova-compute[75337]:     </controller>
Nov 06 15:42:36 user nova-compute[75337]:     <controller type='ide' index='0'>
Nov 06 15:42:36 user nova-compute[75337]:       <alias name='ide'/>
Nov 06 15:42:36 user nova-compute[75337]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 06 15:42:36 user nova-compute[75337]:     </controller>
Nov 06 15:42:36 user nova-compute[75337]:     <interface type='ethernet'>
Nov 06 15:42:36 user nova-compute[75337]:       <mac address='fa:16:3e:0b:83:6f'/>
Nov 06 15:42:36 user nova-compute[75337]:       <target dev='tap8d52e5d0-96'/>
Nov 06 15:42:36 user nova-compute[75337]:       <model type='virtio'/>
Nov 06 15:42:36 user nova-compute[75337]:       <mtu size='1442'/>
Nov 06 15:42:36 user nova-compute[75337]:       <alias name='net0'/>
Nov 06 15:42:36 user nova-compute[75337]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 06 15:42:36 user nova-compute[75337]:     </interface>
Nov 06 15:42:36 user nova-compute[75337]:     <serial type='pty'>
Nov 06 15:42:36 user nova-compute[75337]:       <source path='/dev/pts/8'/>
Nov 06 15:42:36 user nova-compute[75337]:       <log file='/opt/stack/data/nova/instances/76ee582b-b887-4d46-8c78-29f42d1a0d26/console.log' append='off'/>
Nov 06 15:42:36 user nova-compute[75337]:       <target type='isa-serial' port='0'>
Nov 06 15:42:36 user nova-compute[75337]:         <model name='isa-serial'/>
Nov 06 15:42:36 user nova-compute[75337]:       </target>
Nov 06 15:42:36 user nova-compute[75337]:       <alias name='serial0'/>
Nov 06 15:42:36 user nova-compute[75337]:     </serial>
Nov 06 15:42:36 user nova-compute[75337]:     <console type='pty' tty='/dev/pts/8'>
Nov 06 15:42:36 user nova-compute[75337]:       <source path='/dev/pts/8'/>
Nov 06 15:42:36 user nova-compute[75337]:       <log file='/opt/stack/data/nova/instances/76ee582b-b887-4d46-8c78-29f42d1a0d26/console.log' append='off'/>
Nov 06 15:42:36 user nova-compute[75337]:       <target type='serial' port='0'/>
Nov 06 15:42:36 user nova-compute[75337]:       <alias name='serial0'/>
Nov 06 15:42:36 user nova-compute[75337]:     </console>
Nov 06 15:42:36 user nova-compute[75337]:     <input type='mouse' bus='ps2'>
Nov 06 15:42:36 user nova-compute[75337]:       <alias name='input0'/>
Nov 06 15:42:36 user nova-compute[75337]:     </input>
Nov 06 15:42:36 user nova-compute[75337]:     <input type='keyboard' bus='ps2'>
Nov 06 15:42:36 user nova-compute[75337]:       <alias name='input1'/>
Nov 06 15:42:36 user nova-compute[75337]:     </input>
Nov 06 15:42:36 user nova-compute[75337]:     <graphics type='vnc' port='5908' autoport='yes' listen='0.0.0.0'>
Nov 06 15:42:36 user nova-compute[75337]:       <listen type='address' address='0.0.0.0'/>
Nov 06 15:42:36 user nova-compute[75337]:     </graphics>
Nov 06 15:42:36 user nova-compute[75337]:     <audio id='1' type='none'/>
Nov 06 15:42:36 user nova-compute[75337]:     <video>
Nov 06 15:42:36 user nova-compute[75337]:       <model type='virtio' heads='1' primary='yes'/>
Nov 06 15:42:36 user nova-compute[75337]:       <alias name='video0'/>
Nov 06 15:42:36 user nova-compute[75337]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 06 15:42:36 user nova-compute[75337]:     </video>
Nov 06 15:42:36 user nova-compute[75337]:     <memballoon model='virtio'>
Nov 06 15:42:36 user nova-compute[75337]:       <stats period='10'/>
Nov 06 15:42:36 user nova-compute[75337]:       <alias name='balloon0'/>
Nov 06 15:42:36 user nova-compute[75337]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 06 15:42:36 user nova-compute[75337]:     </memballoon>
Nov 06 15:42:36 user nova-compute[75337]:     <rng model='virtio'>
Nov 06 15:42:36 user nova-compute[75337]:       <backend model='random'>/dev/urandom</backend>
Nov 06 15:42:36 user nova-compute[75337]:       <alias name='rng0'/>
Nov 06 15:42:36 user nova-compute[75337]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 06 15:42:36 user nova-compute[75337]:     </rng>
Nov 06 15:42:36 user nova-compute[75337]:   </devices>
Nov 06 15:42:36 user nova-compute[75337]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 06 15:42:36 user nova-compute[75337]:     <label>libvirt-76ee582b-b887-4d46-8c78-29f42d1a0d26</label>
Nov 06 15:42:36 user nova-compute[75337]:     <imagelabel>libvirt-76ee582b-b887-4d46-8c78-29f42d1a0d26</imagelabel>
Nov 06 15:42:36 user nova-compute[75337]:   </seclabel>
Nov 06 15:42:36 user nova-compute[75337]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 06 15:42:36 user nova-compute[75337]:     <label>+64055:+108</label>
Nov 06 15:42:36 user nova-compute[75337]:     <imagelabel>+64055:+108</imagelabel>
Nov 06 15:42:36 user nova-compute[75337]:   </seclabel>
Nov 06 15:42:36 user nova-compute[75337]: </domain>
Nov 06 15:42:36 user nova-compute[75337]:  {{(pid=75337) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 06 15:42:36 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-165b27f3-21f2-4e45-a1b3-7f69b978e7b4 tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] Successfully detached device tapf5a850f4-99 from instance 76ee582b-b887-4d46-8c78-29f42d1a0d26 from the live domain config.
Nov 06 15:42:36 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-165b27f3-21f2-4e45-a1b3-7f69b978e7b4 tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T15:38:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1853414850',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1853414850',id=9,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFGP9zZx8/smrQZVJ9SjwMu8yi65szEQrklWGxwv+DWpP4x/gZJfYN1nhwlTtV8a2EPxv+zU/MdCKD4XLCPbyGN12jTTqoGcbI7kaYL/I7RmSLD+0nDNzAksw3YYfsN9cA==',key_name='tempest-keypair-135606244',keypairs=<?>,launch_index=0,launched_at=2023-11-06T15:38:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4180b3fb8de74de1ad134fe356b85d6f',ramdisk_id='',reservation_id='r-gdmig8v7',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-387682144',owner_user_name='tempest-TaggedAttachmentsTest-387682144-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T15:38:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='587c402e2f0d45ad909ae974a03cd20e',uuid=76ee582b-b887-4d46-8c78-29f42d1a0d26,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f5a850f4-996a-42df-9243-54ea71cc8eec", "address": "fa:16:3e:4d:c3:29", "network": {"id": "081214fe-5e93-4171-bf5b-63393a14c539", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1591381833", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "4180b3fb8de74de1ad134fe356b85d6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5a850f4-99", "ovs_interfaceid": "f5a850f4-996a-42df-9243-54ea71cc8eec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 15:42:36 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-165b27f3-21f2-4e45-a1b3-7f69b978e7b4 tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] Converting VIF {"id": "f5a850f4-996a-42df-9243-54ea71cc8eec", "address": "fa:16:3e:4d:c3:29", "network": {"id": "081214fe-5e93-4171-bf5b-63393a14c539", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1591381833", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "4180b3fb8de74de1ad134fe356b85d6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5a850f4-99", "ovs_interfaceid": "f5a850f4-996a-42df-9243-54ea71cc8eec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 15:42:36 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-165b27f3-21f2-4e45-a1b3-7f69b978e7b4 tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:c3:29,bridge_name='br-int',has_traffic_filtering=True,id=f5a850f4-996a-42df-9243-54ea71cc8eec,network=Network(081214fe-5e93-4171-bf5b-63393a14c539),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5a850f4-99') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 15:42:36 user nova-compute[75337]: DEBUG os_vif [None req-165b27f3-21f2-4e45-a1b3-7f69b978e7b4 tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:c3:29,bridge_name='br-int',has_traffic_filtering=True,id=f5a850f4-996a-42df-9243-54ea71cc8eec,network=Network(081214fe-5e93-4171-bf5b-63393a14c539),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5a850f4-99') {{(pid=75337) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 15:42:36 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:42:36 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf5a850f4-99, bridge=br-int, if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:42:36 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:42:36 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:42:36 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:42:36 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9a76f48e-c7ba-4c08-bde2-f8c50b891c72) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:42:36 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:42:36 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:42:36 user nova-compute[75337]: INFO os_vif [None req-165b27f3-21f2-4e45-a1b3-7f69b978e7b4 tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:c3:29,bridge_name='br-int',has_traffic_filtering=True,id=f5a850f4-996a-42df-9243-54ea71cc8eec,network=Network(081214fe-5e93-4171-bf5b-63393a14c539),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5a850f4-99')
Nov 06 15:42:36 user nova-compute[75337]: DEBUG nova.virt.libvirt.guest [None req-165b27f3-21f2-4e45-a1b3-7f69b978e7b4 tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 15:42:36 user nova-compute[75337]:   <nova:package version="0.0.0"/>
Nov 06 15:42:36 user nova-compute[75337]:   <nova:name>tempest-device-tagging-server-1853414850</nova:name>
Nov 06 15:42:36 user nova-compute[75337]:   <nova:creationTime>2023-11-06 15:42:36</nova:creationTime>
Nov 06 15:42:36 user nova-compute[75337]:   <nova:flavor name="m1.tiny">
Nov 06 15:42:36 user nova-compute[75337]:     <nova:memory>512</nova:memory>
Nov 06 15:42:36 user nova-compute[75337]:     <nova:disk>1</nova:disk>
Nov 06 15:42:36 user nova-compute[75337]:     <nova:swap>0</nova:swap>
Nov 06 15:42:36 user nova-compute[75337]:     <nova:ephemeral>0</nova:ephemeral>
Nov 06 15:42:36 user nova-compute[75337]:     <nova:vcpus>1</nova:vcpus>
Nov 06 15:42:36 user nova-compute[75337]:   </nova:flavor>
Nov 06 15:42:36 user nova-compute[75337]:   <nova:owner>
Nov 06 15:42:36 user nova-compute[75337]:     <nova:user uuid="587c402e2f0d45ad909ae974a03cd20e">tempest-TaggedAttachmentsTest-387682144-project-member</nova:user>
Nov 06 15:42:36 user nova-compute[75337]:     <nova:project uuid="4180b3fb8de74de1ad134fe356b85d6f">tempest-TaggedAttachmentsTest-387682144</nova:project>
Nov 06 15:42:36 user nova-compute[75337]:   </nova:owner>
Nov 06 15:42:36 user nova-compute[75337]:   <nova:root type="image" uuid="16b903ae-a40f-41a7-985b-4804cce92c62"/>
Nov 06 15:42:36 user nova-compute[75337]:   <nova:ports>
Nov 06 15:42:36 user nova-compute[75337]:     <nova:port uuid="8d52e5d0-96a2-44ca-9968-9ac564aeff2c">
Nov 06 15:42:36 user nova-compute[75337]:       <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 06 15:42:36 user nova-compute[75337]:     </nova:port>
Nov 06 15:42:36 user nova-compute[75337]:   </nova:ports>
Nov 06 15:42:36 user nova-compute[75337]: </nova:instance>
Nov 06 15:42:36 user nova-compute[75337]:  {{(pid=75337) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 06 15:42:37 user nova-compute[75337]: DEBUG nova.compute.manager [req-13db70a5-635e-46c2-9b79-1c337ac15e7b req-453f1c39-2dbd-457b-bee5-0d724b4cfc70 service nova] [instance: 76ee582b-b887-4d46-8c78-29f42d1a0d26] Received event network-vif-deleted-f5a850f4-996a-42df-9243-54ea71cc8eec {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:42:37 user nova-compute[75337]: INFO nova.compute.manager [req-13db70a5-635e-46c2-9b79-1c337ac15e7b req-453f1c39-2dbd-457b-bee5-0d724b4cfc70 service nova] [instance: 76ee582b-b887-4d46-8c78-29f42d1a0d26] Neutron deleted interface f5a850f4-996a-42df-9243-54ea71cc8eec; detaching it from the instance and deleting it from the info cache
Nov 06 15:42:37 user nova-compute[75337]: DEBUG nova.network.neutron [req-13db70a5-635e-46c2-9b79-1c337ac15e7b req-453f1c39-2dbd-457b-bee5-0d724b4cfc70 service nova] [instance: 76ee582b-b887-4d46-8c78-29f42d1a0d26] Updating instance_info_cache with network_info: [{"id": "8d52e5d0-96a2-44ca-9968-9ac564aeff2c", "address": "fa:16:3e:0b:83:6f", "network": {"id": "cd11ddce-8aa1-4ad8-8184-317c63f52be7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-265471432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4180b3fb8de74de1ad134fe356b85d6f", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d52e5d0-96", "ovs_interfaceid": "8d52e5d0-96a2-44ca-9968-9ac564aeff2c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:42:37 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-165b27f3-21f2-4e45-a1b3-7f69b978e7b4 tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] Acquiring lock "refresh_cache-76ee582b-b887-4d46-8c78-29f42d1a0d26" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 15:42:37 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-165b27f3-21f2-4e45-a1b3-7f69b978e7b4 tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] Acquired lock "refresh_cache-76ee582b-b887-4d46-8c78-29f42d1a0d26" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 15:42:37 user nova-compute[75337]: DEBUG nova.network.neutron [None req-165b27f3-21f2-4e45-a1b3-7f69b978e7b4 tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] [instance: 76ee582b-b887-4d46-8c78-29f42d1a0d26] Building network info cache for instance {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 15:42:37 user nova-compute[75337]: DEBUG nova.objects.instance [req-13db70a5-635e-46c2-9b79-1c337ac15e7b req-453f1c39-2dbd-457b-bee5-0d724b4cfc70 service nova] Lazy-loading 'system_metadata' on Instance uuid 76ee582b-b887-4d46-8c78-29f42d1a0d26 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 15:42:37 user nova-compute[75337]: DEBUG nova.objects.instance [req-13db70a5-635e-46c2-9b79-1c337ac15e7b req-453f1c39-2dbd-457b-bee5-0d724b4cfc70 service nova] Lazy-loading 'flavor' on Instance uuid 76ee582b-b887-4d46-8c78-29f42d1a0d26 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 15:42:37 user nova-compute[75337]: DEBUG nova.objects.base [req-13db70a5-635e-46c2-9b79-1c337ac15e7b req-453f1c39-2dbd-457b-bee5-0d724b4cfc70 service nova] Object Instance<76ee582b-b887-4d46-8c78-29f42d1a0d26> lazy-loaded attributes: system_metadata,flavor {{(pid=75337) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 15:42:37 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [req-13db70a5-635e-46c2-9b79-1c337ac15e7b req-453f1c39-2dbd-457b-bee5-0d724b4cfc70 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T15:38:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1853414850',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1853414850',id=9,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFGP9zZx8/smrQZVJ9SjwMu8yi65szEQrklWGxwv+DWpP4x/gZJfYN1nhwlTtV8a2EPxv+zU/MdCKD4XLCPbyGN12jTTqoGcbI7kaYL/I7RmSLD+0nDNzAksw3YYfsN9cA==',key_name='tempest-keypair-135606244',keypairs=<?>,launch_index=0,launched_at=2023-11-06T15:38:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4180b3fb8de74de1ad134fe356b85d6f',ramdisk_id='',reservation_id='r-gdmig8v7',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-387682144',owner_user_name='tempest-TaggedAttachmentsTest-387682144-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T15:38:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='587c402e2f0d45ad909ae974a03cd20e',uuid=76ee582b-b887-4d46-8c78-29f42d1a0d26,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f5a850f4-996a-42df-9243-54ea71cc8eec", "address": "fa:16:3e:4d:c3:29", "network": {"id": "081214fe-5e93-4171-bf5b-63393a14c539", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1591381833", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "4180b3fb8de74de1ad134fe356b85d6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5a850f4-99", "ovs_interfaceid": "f5a850f4-996a-42df-9243-54ea71cc8eec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75337) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 15:42:37 user nova-compute[75337]: DEBUG nova.network.os_vif_util [req-13db70a5-635e-46c2-9b79-1c337ac15e7b req-453f1c39-2dbd-457b-bee5-0d724b4cfc70 service nova] Converting VIF {"id": "f5a850f4-996a-42df-9243-54ea71cc8eec", "address": "fa:16:3e:4d:c3:29", "network": {"id": "081214fe-5e93-4171-bf5b-63393a14c539", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1591381833", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "4180b3fb8de74de1ad134fe356b85d6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5a850f4-99", "ovs_interfaceid": "f5a850f4-996a-42df-9243-54ea71cc8eec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 15:42:37 user nova-compute[75337]: DEBUG nova.network.os_vif_util [req-13db70a5-635e-46c2-9b79-1c337ac15e7b req-453f1c39-2dbd-457b-bee5-0d724b4cfc70 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:c3:29,bridge_name='br-int',has_traffic_filtering=True,id=f5a850f4-996a-42df-9243-54ea71cc8eec,network=Network(081214fe-5e93-4171-bf5b-63393a14c539),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5a850f4-99') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 15:42:37 user nova-compute[75337]: DEBUG nova.virt.libvirt.guest [req-13db70a5-635e-46c2-9b79-1c337ac15e7b req-453f1c39-2dbd-457b-bee5-0d724b4cfc70 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:4d:c3:29"/><model type="virtio"/><mtu size="1442"/><target dev="tapf5a850f4-99"/></interface> {{(pid=75337) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 06 15:42:37 user nova-compute[75337]: DEBUG nova.virt.libvirt.guest [req-13db70a5-635e-46c2-9b79-1c337ac15e7b req-453f1c39-2dbd-457b-bee5-0d724b4cfc70 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:4d:c3:29"/><model type="virtio"/><mtu size="1442"/><target dev="tapf5a850f4-99"/></interface>not found in domain: <domain type='kvm' id='9'>
Nov 06 15:42:37 user nova-compute[75337]:   <name>instance-00000009</name>
Nov 06 15:42:37 user nova-compute[75337]:   <uuid>76ee582b-b887-4d46-8c78-29f42d1a0d26</uuid>
Nov 06 15:42:37 user nova-compute[75337]:   <metadata>
Nov 06 15:42:37 user nova-compute[75337]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 15:42:37 user nova-compute[75337]:   <nova:package version="0.0.0"/>
Nov 06 15:42:37 user nova-compute[75337]:   <nova:name>tempest-device-tagging-server-1853414850</nova:name>
Nov 06 15:42:37 user nova-compute[75337]:   <nova:creationTime>2023-11-06 15:42:36</nova:creationTime>
Nov 06 15:42:37 user nova-compute[75337]:   <nova:flavor name="m1.tiny">
Nov 06 15:42:37 user nova-compute[75337]:     <nova:memory>512</nova:memory>
Nov 06 15:42:37 user nova-compute[75337]:     <nova:disk>1</nova:disk>
Nov 06 15:42:37 user nova-compute[75337]:     <nova:swap>0</nova:swap>
Nov 06 15:42:37 user nova-compute[75337]:     <nova:ephemeral>0</nova:ephemeral>
Nov 06 15:42:37 user nova-compute[75337]:     <nova:vcpus>1</nova:vcpus>
Nov 06 15:42:37 user nova-compute[75337]:   </nova:flavor>
Nov 06 15:42:37 user nova-compute[75337]:   <nova:owner>
Nov 06 15:42:37 user nova-compute[75337]:     <nova:user uuid="587c402e2f0d45ad909ae974a03cd20e">tempest-TaggedAttachmentsTest-387682144-project-member</nova:user>
Nov 06 15:42:37 user nova-compute[75337]:     <nova:project uuid="4180b3fb8de74de1ad134fe356b85d6f">tempest-TaggedAttachmentsTest-387682144</nova:project>
Nov 06 15:42:37 user nova-compute[75337]:   </nova:owner>
Nov 06 15:42:37 user nova-compute[75337]:   <nova:root type="image" uuid="16b903ae-a40f-41a7-985b-4804cce92c62"/>
Nov 06 15:42:37 user nova-compute[75337]:   <nova:ports>
Nov 06 15:42:37 user nova-compute[75337]:     <nova:port uuid="8d52e5d0-96a2-44ca-9968-9ac564aeff2c">
Nov 06 15:42:37 user nova-compute[75337]:       <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 06 15:42:37 user nova-compute[75337]:     </nova:port>
Nov 06 15:42:37 user nova-compute[75337]:   </nova:ports>
Nov 06 15:42:37 user nova-compute[75337]: </nova:instance>
Nov 06 15:42:37 user nova-compute[75337]:   </metadata>
Nov 06 15:42:37 user nova-compute[75337]:   <memory unit='KiB'>524288</memory>
Nov 06 15:42:37 user nova-compute[75337]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 06 15:42:37 user nova-compute[75337]:   <vcpu placement='static'>1</vcpu>
Nov 06 15:42:37 user nova-compute[75337]:   <resource>
Nov 06 15:42:37 user nova-compute[75337]:     <partition>/machine</partition>
Nov 06 15:42:37 user nova-compute[75337]:   </resource>
Nov 06 15:42:37 user nova-compute[75337]:   <sysinfo type='smbios'>
Nov 06 15:42:37 user nova-compute[75337]:     <system>
Nov 06 15:42:37 user nova-compute[75337]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 06 15:42:37 user nova-compute[75337]:       <entry name='product'>OpenStack Nova</entry>
Nov 06 15:42:37 user nova-compute[75337]:       <entry name='version'>0.0.0</entry>
Nov 06 15:42:37 user nova-compute[75337]:       <entry name='serial'>76ee582b-b887-4d46-8c78-29f42d1a0d26</entry>
Nov 06 15:42:37 user nova-compute[75337]:       <entry name='uuid'>76ee582b-b887-4d46-8c78-29f42d1a0d26</entry>
Nov 06 15:42:37 user nova-compute[75337]:       <entry name='family'>Virtual Machine</entry>
Nov 06 15:42:37 user nova-compute[75337]:     </system>
Nov 06 15:42:37 user nova-compute[75337]:   </sysinfo>
Nov 06 15:42:37 user nova-compute[75337]:   <os>
Nov 06 15:42:37 user nova-compute[75337]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 06 15:42:37 user nova-compute[75337]:     <boot dev='hd'/>
Nov 06 15:42:37 user nova-compute[75337]:     <smbios mode='sysinfo'/>
Nov 06 15:42:37 user nova-compute[75337]:   </os>
Nov 06 15:42:37 user nova-compute[75337]:   <features>
Nov 06 15:42:37 user nova-compute[75337]:     <acpi/>
Nov 06 15:42:37 user nova-compute[75337]:     <apic/>
Nov 06 15:42:37 user nova-compute[75337]:     <vmcoreinfo state='on'/>
Nov 06 15:42:37 user nova-compute[75337]:   </features>
Nov 06 15:42:37 user nova-compute[75337]:   <cpu mode='custom' match='exact' check='full'>
Nov 06 15:42:37 user nova-compute[75337]:     <model fallback='forbid'>Nehalem</model>
Nov 06 15:42:37 user nova-compute[75337]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 06 15:42:37 user nova-compute[75337]:     <feature policy='require' name='vme'/>
Nov 06 15:42:37 user nova-compute[75337]:     <feature policy='require' name='x2apic'/>
Nov 06 15:42:37 user nova-compute[75337]:     <feature policy='require' name='hypervisor'/>
Nov 06 15:42:37 user nova-compute[75337]:   </cpu>
Nov 06 15:42:37 user nova-compute[75337]:   <clock offset='utc'>
Nov 06 15:42:37 user nova-compute[75337]:     <timer name='pit' tickpolicy='delay'/>
Nov 06 15:42:37 user nova-compute[75337]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 06 15:42:37 user nova-compute[75337]:     <timer name='hpet' present='no'/>
Nov 06 15:42:37 user nova-compute[75337]:   </clock>
Nov 06 15:42:37 user nova-compute[75337]:   <on_poweroff>destroy</on_poweroff>
Nov 06 15:42:37 user nova-compute[75337]:   <on_reboot>restart</on_reboot>
Nov 06 15:42:37 user nova-compute[75337]:   <on_crash>destroy</on_crash>
Nov 06 15:42:37 user nova-compute[75337]:   <devices>
Nov 06 15:42:37 user nova-compute[75337]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 06 15:42:37 user nova-compute[75337]:     <disk type='file' device='disk'>
Nov 06 15:42:37 user nova-compute[75337]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 06 15:42:37 user nova-compute[75337]:       <source file='/opt/stack/data/nova/instances/76ee582b-b887-4d46-8c78-29f42d1a0d26/disk' index='2'/>
Nov 06 15:42:37 user nova-compute[75337]:       <backingStore type='file' index='3'>
Nov 06 15:42:37 user nova-compute[75337]:         <format type='raw'/>
Nov 06 15:42:37 user nova-compute[75337]:         <source file='/opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275'/>
Nov 06 15:42:37 user nova-compute[75337]:         <backingStore/>
Nov 06 15:42:37 user nova-compute[75337]:       </backingStore>
Nov 06 15:42:37 user nova-compute[75337]:       <target dev='vda' bus='virtio'/>
Nov 06 15:42:37 user nova-compute[75337]:       <alias name='virtio-disk0'/>
Nov 06 15:42:37 user nova-compute[75337]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 06 15:42:37 user nova-compute[75337]:     </disk>
Nov 06 15:42:37 user nova-compute[75337]:     <disk type='file' device='cdrom'>
Nov 06 15:42:37 user nova-compute[75337]:       <driver name='qemu' type='raw' cache='none'/>
Nov 06 15:42:37 user nova-compute[75337]:       <source file='/opt/stack/data/nova/instances/76ee582b-b887-4d46-8c78-29f42d1a0d26/disk.config' index='1'/>
Nov 06 15:42:37 user nova-compute[75337]:       <backingStore/>
Nov 06 15:42:37 user nova-compute[75337]:       <target dev='hda' bus='ide'/>
Nov 06 15:42:37 user nova-compute[75337]:       <readonly/>
Nov 06 15:42:37 user nova-compute[75337]:       <alias name='ide0-0-0'/>
Nov 06 15:42:37 user nova-compute[75337]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 06 15:42:37 user nova-compute[75337]:     </disk>
Nov 06 15:42:37 user nova-compute[75337]:     <controller type='usb' index='0' model='none'>
Nov 06 15:42:37 user nova-compute[75337]:       <alias name='usb'/>
Nov 06 15:42:37 user nova-compute[75337]:     </controller>
Nov 06 15:42:37 user nova-compute[75337]:     <controller type='pci' index='0' model='pci-root'>
Nov 06 15:42:37 user nova-compute[75337]:       <alias name='pci.0'/>
Nov 06 15:42:37 user nova-compute[75337]:     </controller>
Nov 06 15:42:37 user nova-compute[75337]:     <controller type='ide' index='0'>
Nov 06 15:42:37 user nova-compute[75337]:       <alias name='ide'/>
Nov 06 15:42:37 user nova-compute[75337]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 06 15:42:37 user nova-compute[75337]:     </controller>
Nov 06 15:42:37 user nova-compute[75337]:     <interface type='ethernet'>
Nov 06 15:42:37 user nova-compute[75337]:       <mac address='fa:16:3e:0b:83:6f'/>
Nov 06 15:42:37 user nova-compute[75337]:       <target dev='tap8d52e5d0-96'/>
Nov 06 15:42:37 user nova-compute[75337]:       <model type='virtio'/>
Nov 06 15:42:37 user nova-compute[75337]:       <mtu size='1442'/>
Nov 06 15:42:37 user nova-compute[75337]:       <alias name='net0'/>
Nov 06 15:42:37 user nova-compute[75337]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 06 15:42:37 user nova-compute[75337]:     </interface>
Nov 06 15:42:37 user nova-compute[75337]:     <serial type='pty'>
Nov 06 15:42:37 user nova-compute[75337]:       <source path='/dev/pts/8'/>
Nov 06 15:42:37 user nova-compute[75337]:       <log file='/opt/stack/data/nova/instances/76ee582b-b887-4d46-8c78-29f42d1a0d26/console.log' append='off'/>
Nov 06 15:42:37 user nova-compute[75337]:       <target type='isa-serial' port='0'>
Nov 06 15:42:37 user nova-compute[75337]:         <model name='isa-serial'/>
Nov 06 15:42:37 user nova-compute[75337]:       </target>
Nov 06 15:42:37 user nova-compute[75337]:       <alias name='serial0'/>
Nov 06 15:42:37 user nova-compute[75337]:     </serial>
Nov 06 15:42:37 user nova-compute[75337]:     <console type='pty' tty='/dev/pts/8'>
Nov 06 15:42:37 user nova-compute[75337]:       <source path='/dev/pts/8'/>
Nov 06 15:42:37 user nova-compute[75337]:       <log file='/opt/stack/data/nova/instances/76ee582b-b887-4d46-8c78-29f42d1a0d26/console.log' append='off'/>
Nov 06 15:42:37 user nova-compute[75337]:       <target type='serial' port='0'/>
Nov 06 15:42:37 user nova-compute[75337]:       <alias name='serial0'/>
Nov 06 15:42:37 user nova-compute[75337]:     </console>
Nov 06 15:42:37 user nova-compute[75337]:     <input type='mouse' bus='ps2'>
Nov 06 15:42:37 user nova-compute[75337]:       <alias name='input0'/>
Nov 06 15:42:37 user nova-compute[75337]:     </input>
Nov 06 15:42:37 user nova-compute[75337]:     <input type='keyboard' bus='ps2'>
Nov 06 15:42:37 user nova-compute[75337]:       <alias name='input1'/>
Nov 06 15:42:37 user nova-compute[75337]:     </input>
Nov 06 15:42:37 user nova-compute[75337]:     <graphics type='vnc' port='5908' autoport='yes' listen='0.0.0.0'>
Nov 06 15:42:37 user nova-compute[75337]:       <listen type='address' address='0.0.0.0'/>
Nov 06 15:42:37 user nova-compute[75337]:     </graphics>
Nov 06 15:42:37 user nova-compute[75337]:     <audio id='1' type='none'/>
Nov 06 15:42:37 user nova-compute[75337]:     <video>
Nov 06 15:42:37 user nova-compute[75337]:       <model type='virtio' heads='1' primary='yes'/>
Nov 06 15:42:37 user nova-compute[75337]:       <alias name='video0'/>
Nov 06 15:42:37 user nova-compute[75337]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 06 15:42:37 user nova-compute[75337]:     </video>
Nov 06 15:42:37 user nova-compute[75337]:     <memballoon model='virtio'>
Nov 06 15:42:37 user nova-compute[75337]:       <stats period='10'/>
Nov 06 15:42:37 user nova-compute[75337]:       <alias name='balloon0'/>
Nov 06 15:42:37 user nova-compute[75337]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 06 15:42:37 user nova-compute[75337]:     </memballoon>
Nov 06 15:42:37 user nova-compute[75337]:     <rng model='virtio'>
Nov 06 15:42:37 user nova-compute[75337]:       <backend model='random'>/dev/urandom</backend>
Nov 06 15:42:37 user nova-compute[75337]:       <alias name='rng0'/>
Nov 06 15:42:37 user nova-compute[75337]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 06 15:42:37 user nova-compute[75337]:     </rng>
Nov 06 15:42:37 user nova-compute[75337]:   </devices>
Nov 06 15:42:37 user nova-compute[75337]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 06 15:42:37 user nova-compute[75337]:     <label>libvirt-76ee582b-b887-4d46-8c78-29f42d1a0d26</label>
Nov 06 15:42:37 user nova-compute[75337]:     <imagelabel>libvirt-76ee582b-b887-4d46-8c78-29f42d1a0d26</imagelabel>
Nov 06 15:42:37 user nova-compute[75337]:   </seclabel>
Nov 06 15:42:37 user nova-compute[75337]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 06 15:42:37 user nova-compute[75337]:     <label>+64055:+108</label>
Nov 06 15:42:37 user nova-compute[75337]:     <imagelabel>+64055:+108</imagelabel>
Nov 06 15:42:37 user nova-compute[75337]:   </seclabel>
Nov 06 15:42:37 user nova-compute[75337]: </domain>
Nov 06 15:42:37 user nova-compute[75337]:  {{(pid=75337) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 06 15:42:37 user nova-compute[75337]: DEBUG nova.virt.libvirt.guest [req-13db70a5-635e-46c2-9b79-1c337ac15e7b req-453f1c39-2dbd-457b-bee5-0d724b4cfc70 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:4d:c3:29"/><model type="virtio"/><mtu size="1442"/><target dev="tapf5a850f4-99"/></interface> {{(pid=75337) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 06 15:42:37 user nova-compute[75337]: DEBUG nova.virt.libvirt.guest [req-13db70a5-635e-46c2-9b79-1c337ac15e7b req-453f1c39-2dbd-457b-bee5-0d724b4cfc70 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:4d:c3:29"/><model type="virtio"/><mtu size="1442"/><target dev="tapf5a850f4-99"/></interface>not found in domain: <domain type='kvm' id='9'>
Nov 06 15:42:37 user nova-compute[75337]:   <name>instance-00000009</name>
Nov 06 15:42:37 user nova-compute[75337]:   <uuid>76ee582b-b887-4d46-8c78-29f42d1a0d26</uuid>
Nov 06 15:42:37 user nova-compute[75337]:   <metadata>
Nov 06 15:42:37 user nova-compute[75337]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 15:42:37 user nova-compute[75337]:   <nova:package version="0.0.0"/>
Nov 06 15:42:37 user nova-compute[75337]:   <nova:name>tempest-device-tagging-server-1853414850</nova:name>
Nov 06 15:42:37 user nova-compute[75337]:   <nova:creationTime>2023-11-06 15:42:36</nova:creationTime>
Nov 06 15:42:37 user nova-compute[75337]:   <nova:flavor name="m1.tiny">
Nov 06 15:42:37 user nova-compute[75337]:     <nova:memory>512</nova:memory>
Nov 06 15:42:37 user nova-compute[75337]:     <nova:disk>1</nova:disk>
Nov 06 15:42:37 user nova-compute[75337]:     <nova:swap>0</nova:swap>
Nov 06 15:42:37 user nova-compute[75337]:     <nova:ephemeral>0</nova:ephemeral>
Nov 06 15:42:37 user nova-compute[75337]:     <nova:vcpus>1</nova:vcpus>
Nov 06 15:42:37 user nova-compute[75337]:   </nova:flavor>
Nov 06 15:42:37 user nova-compute[75337]:   <nova:owner>
Nov 06 15:42:37 user nova-compute[75337]:     <nova:user uuid="587c402e2f0d45ad909ae974a03cd20e">tempest-TaggedAttachmentsTest-387682144-project-member</nova:user>
Nov 06 15:42:37 user nova-compute[75337]:     <nova:project uuid="4180b3fb8de74de1ad134fe356b85d6f">tempest-TaggedAttachmentsTest-387682144</nova:project>
Nov 06 15:42:37 user nova-compute[75337]:   </nova:owner>
Nov 06 15:42:37 user nova-compute[75337]:   <nova:root type="image" uuid="16b903ae-a40f-41a7-985b-4804cce92c62"/>
Nov 06 15:42:37 user nova-compute[75337]:   <nova:ports>
Nov 06 15:42:37 user nova-compute[75337]:     <nova:port uuid="8d52e5d0-96a2-44ca-9968-9ac564aeff2c">
Nov 06 15:42:37 user nova-compute[75337]:       <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 06 15:42:37 user nova-compute[75337]:     </nova:port>
Nov 06 15:42:37 user nova-compute[75337]:   </nova:ports>
Nov 06 15:42:37 user nova-compute[75337]: </nova:instance>
Nov 06 15:42:37 user nova-compute[75337]:   </metadata>
Nov 06 15:42:37 user nova-compute[75337]:   <memory unit='KiB'>524288</memory>
Nov 06 15:42:37 user nova-compute[75337]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 06 15:42:37 user nova-compute[75337]:   <vcpu placement='static'>1</vcpu>
Nov 06 15:42:37 user nova-compute[75337]:   <resource>
Nov 06 15:42:37 user nova-compute[75337]:     <partition>/machine</partition>
Nov 06 15:42:37 user nova-compute[75337]:   </resource>
Nov 06 15:42:37 user nova-compute[75337]:   <sysinfo type='smbios'>
Nov 06 15:42:37 user nova-compute[75337]:     <system>
Nov 06 15:42:37 user nova-compute[75337]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 06 15:42:37 user nova-compute[75337]:       <entry name='product'>OpenStack Nova</entry>
Nov 06 15:42:37 user nova-compute[75337]:       <entry name='version'>0.0.0</entry>
Nov 06 15:42:37 user nova-compute[75337]:       <entry name='serial'>76ee582b-b887-4d46-8c78-29f42d1a0d26</entry>
Nov 06 15:42:37 user nova-compute[75337]:       <entry name='uuid'>76ee582b-b887-4d46-8c78-29f42d1a0d26</entry>
Nov 06 15:42:37 user nova-compute[75337]:       <entry name='family'>Virtual Machine</entry>
Nov 06 15:42:37 user nova-compute[75337]:     </system>
Nov 06 15:42:37 user nova-compute[75337]:   </sysinfo>
Nov 06 15:42:37 user nova-compute[75337]:   <os>
Nov 06 15:42:37 user nova-compute[75337]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 06 15:42:37 user nova-compute[75337]:     <boot dev='hd'/>
Nov 06 15:42:37 user nova-compute[75337]:     <smbios mode='sysinfo'/>
Nov 06 15:42:37 user nova-compute[75337]:   </os>
Nov 06 15:42:37 user nova-compute[75337]:   <features>
Nov 06 15:42:37 user nova-compute[75337]:     <acpi/>
Nov 06 15:42:37 user nova-compute[75337]:     <apic/>
Nov 06 15:42:37 user nova-compute[75337]:     <vmcoreinfo state='on'/>
Nov 06 15:42:37 user nova-compute[75337]:   </features>
Nov 06 15:42:37 user nova-compute[75337]:   <cpu mode='custom' match='exact' check='full'>
Nov 06 15:42:37 user nova-compute[75337]:     <model fallback='forbid'>Nehalem</model>
Nov 06 15:42:37 user nova-compute[75337]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 06 15:42:37 user nova-compute[75337]:     <feature policy='require' name='vme'/>
Nov 06 15:42:37 user nova-compute[75337]:     <feature policy='require' name='x2apic'/>
Nov 06 15:42:37 user nova-compute[75337]:     <feature policy='require' name='hypervisor'/>
Nov 06 15:42:37 user nova-compute[75337]:   </cpu>
Nov 06 15:42:37 user nova-compute[75337]:   <clock offset='utc'>
Nov 06 15:42:37 user nova-compute[75337]:     <timer name='pit' tickpolicy='delay'/>
Nov 06 15:42:37 user nova-compute[75337]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 06 15:42:37 user nova-compute[75337]:     <timer name='hpet' present='no'/>
Nov 06 15:42:37 user nova-compute[75337]:   </clock>
Nov 06 15:42:37 user nova-compute[75337]:   <on_poweroff>destroy</on_poweroff>
Nov 06 15:42:37 user nova-compute[75337]:   <on_reboot>restart</on_reboot>
Nov 06 15:42:37 user nova-compute[75337]:   <on_crash>destroy</on_crash>
Nov 06 15:42:37 user nova-compute[75337]:   <devices>
Nov 06 15:42:37 user nova-compute[75337]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 06 15:42:37 user nova-compute[75337]:     <disk type='file' device='disk'>
Nov 06 15:42:37 user nova-compute[75337]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 06 15:42:37 user nova-compute[75337]:       <source file='/opt/stack/data/nova/instances/76ee582b-b887-4d46-8c78-29f42d1a0d26/disk' index='2'/>
Nov 06 15:42:37 user nova-compute[75337]:       <backingStore type='file' index='3'>
Nov 06 15:42:37 user nova-compute[75337]:         <format type='raw'/>
Nov 06 15:42:37 user nova-compute[75337]:         <source file='/opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275'/>
Nov 06 15:42:37 user nova-compute[75337]:         <backingStore/>
Nov 06 15:42:37 user nova-compute[75337]:       </backingStore>
Nov 06 15:42:37 user nova-compute[75337]:       <target dev='vda' bus='virtio'/>
Nov 06 15:42:37 user nova-compute[75337]:       <alias name='virtio-disk0'/>
Nov 06 15:42:37 user nova-compute[75337]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 06 15:42:37 user nova-compute[75337]:     </disk>
Nov 06 15:42:37 user nova-compute[75337]:     <disk type='file' device='cdrom'>
Nov 06 15:42:37 user nova-compute[75337]:       <driver name='qemu' type='raw' cache='none'/>
Nov 06 15:42:37 user nova-compute[75337]:       <source file='/opt/stack/data/nova/instances/76ee582b-b887-4d46-8c78-29f42d1a0d26/disk.config' index='1'/>
Nov 06 15:42:37 user nova-compute[75337]:       <backingStore/>
Nov 06 15:42:37 user nova-compute[75337]:       <target dev='hda' bus='ide'/>
Nov 06 15:42:37 user nova-compute[75337]:       <readonly/>
Nov 06 15:42:37 user nova-compute[75337]:       <alias name='ide0-0-0'/>
Nov 06 15:42:37 user nova-compute[75337]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 06 15:42:37 user nova-compute[75337]:     </disk>
Nov 06 15:42:37 user nova-compute[75337]:     <controller type='usb' index='0' model='none'>
Nov 06 15:42:37 user nova-compute[75337]:       <alias name='usb'/>
Nov 06 15:42:37 user nova-compute[75337]:     </controller>
Nov 06 15:42:37 user nova-compute[75337]:     <controller type='pci' index='0' model='pci-root'>
Nov 06 15:42:37 user nova-compute[75337]:       <alias name='pci.0'/>
Nov 06 15:42:37 user nova-compute[75337]:     </controller>
Nov 06 15:42:37 user nova-compute[75337]:     <controller type='ide' index='0'>
Nov 06 15:42:37 user nova-compute[75337]:       <alias name='ide'/>
Nov 06 15:42:37 user nova-compute[75337]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 06 15:42:37 user nova-compute[75337]:     </controller>
Nov 06 15:42:37 user nova-compute[75337]:     <interface type='ethernet'>
Nov 06 15:42:37 user nova-compute[75337]:       <mac address='fa:16:3e:0b:83:6f'/>
Nov 06 15:42:37 user nova-compute[75337]:       <target dev='tap8d52e5d0-96'/>
Nov 06 15:42:37 user nova-compute[75337]:       <model type='virtio'/>
Nov 06 15:42:37 user nova-compute[75337]:       <mtu size='1442'/>
Nov 06 15:42:37 user nova-compute[75337]:       <alias name='net0'/>
Nov 06 15:42:37 user nova-compute[75337]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 06 15:42:37 user nova-compute[75337]:     </interface>
Nov 06 15:42:37 user nova-compute[75337]:     <serial type='pty'>
Nov 06 15:42:37 user nova-compute[75337]:       <source path='/dev/pts/8'/>
Nov 06 15:42:37 user nova-compute[75337]:       <log file='/opt/stack/data/nova/instances/76ee582b-b887-4d46-8c78-29f42d1a0d26/console.log' append='off'/>
Nov 06 15:42:37 user nova-compute[75337]:       <target type='isa-serial' port='0'>
Nov 06 15:42:37 user nova-compute[75337]:         <model name='isa-serial'/>
Nov 06 15:42:37 user nova-compute[75337]:       </target>
Nov 06 15:42:37 user nova-compute[75337]:       <alias name='serial0'/>
Nov 06 15:42:37 user nova-compute[75337]:     </serial>
Nov 06 15:42:37 user nova-compute[75337]:     <console type='pty' tty='/dev/pts/8'>
Nov 06 15:42:37 user nova-compute[75337]:       <source path='/dev/pts/8'/>
Nov 06 15:42:37 user nova-compute[75337]:       <log file='/opt/stack/data/nova/instances/76ee582b-b887-4d46-8c78-29f42d1a0d26/console.log' append='off'/>
Nov 06 15:42:37 user nova-compute[75337]:       <target type='serial' port='0'/>
Nov 06 15:42:37 user nova-compute[75337]:       <alias name='serial0'/>
Nov 06 15:42:37 user nova-compute[75337]:     </console>
Nov 06 15:42:37 user nova-compute[75337]:     <input type='mouse' bus='ps2'>
Nov 06 15:42:37 user nova-compute[75337]:       <alias name='input0'/>
Nov 06 15:42:37 user nova-compute[75337]:     </input>
Nov 06 15:42:37 user nova-compute[75337]:     <input type='keyboard' bus='ps2'>
Nov 06 15:42:37 user nova-compute[75337]:       <alias name='input1'/>
Nov 06 15:42:37 user nova-compute[75337]:     </input>
Nov 06 15:42:37 user nova-compute[75337]:     <graphics type='vnc' port='5908' autoport='yes' listen='0.0.0.0'>
Nov 06 15:42:37 user nova-compute[75337]:       <listen type='address' address='0.0.0.0'/>
Nov 06 15:42:37 user nova-compute[75337]:     </graphics>
Nov 06 15:42:37 user nova-compute[75337]:     <audio id='1' type='none'/>
Nov 06 15:42:37 user nova-compute[75337]:     <video>
Nov 06 15:42:37 user nova-compute[75337]:       <model type='virtio' heads='1' primary='yes'/>
Nov 06 15:42:37 user nova-compute[75337]:       <alias name='video0'/>
Nov 06 15:42:37 user nova-compute[75337]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 06 15:42:37 user nova-compute[75337]:     </video>
Nov 06 15:42:37 user nova-compute[75337]:     <memballoon model='virtio'>
Nov 06 15:42:37 user nova-compute[75337]:       <stats period='10'/>
Nov 06 15:42:37 user nova-compute[75337]:       <alias name='balloon0'/>
Nov 06 15:42:37 user nova-compute[75337]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 06 15:42:37 user nova-compute[75337]:     </memballoon>
Nov 06 15:42:37 user nova-compute[75337]:     <rng model='virtio'>
Nov 06 15:42:37 user nova-compute[75337]:       <backend model='random'>/dev/urandom</backend>
Nov 06 15:42:37 user nova-compute[75337]:       <alias name='rng0'/>
Nov 06 15:42:37 user nova-compute[75337]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 06 15:42:37 user nova-compute[75337]:     </rng>
Nov 06 15:42:37 user nova-compute[75337]:   </devices>
Nov 06 15:42:37 user nova-compute[75337]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 06 15:42:37 user nova-compute[75337]:     <label>libvirt-76ee582b-b887-4d46-8c78-29f42d1a0d26</label>
Nov 06 15:42:37 user nova-compute[75337]:     <imagelabel>libvirt-76ee582b-b887-4d46-8c78-29f42d1a0d26</imagelabel>
Nov 06 15:42:37 user nova-compute[75337]:   </seclabel>
Nov 06 15:42:37 user nova-compute[75337]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 06 15:42:37 user nova-compute[75337]:     <label>+64055:+108</label>
Nov 06 15:42:37 user nova-compute[75337]:     <imagelabel>+64055:+108</imagelabel>
Nov 06 15:42:37 user nova-compute[75337]:   </seclabel>
Nov 06 15:42:37 user nova-compute[75337]: </domain>
Nov 06 15:42:37 user nova-compute[75337]:  {{(pid=75337) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 06 15:42:37 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [req-13db70a5-635e-46c2-9b79-1c337ac15e7b req-453f1c39-2dbd-457b-bee5-0d724b4cfc70 service nova] [instance: 76ee582b-b887-4d46-8c78-29f42d1a0d26] Detaching interface fa:16:3e:4d:c3:29 failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tapf5a850f4-99' not found.
Nov 06 15:42:37 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [req-13db70a5-635e-46c2-9b79-1c337ac15e7b req-453f1c39-2dbd-457b-bee5-0d724b4cfc70 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T15:38:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1853414850',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1853414850',id=9,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFGP9zZx8/smrQZVJ9SjwMu8yi65szEQrklWGxwv+DWpP4x/gZJfYN1nhwlTtV8a2EPxv+zU/MdCKD4XLCPbyGN12jTTqoGcbI7kaYL/I7RmSLD+0nDNzAksw3YYfsN9cA==',key_name='tempest-keypair-135606244',keypairs=<?>,launch_index=0,launched_at=2023-11-06T15:38:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4180b3fb8de74de1ad134fe356b85d6f',ramdisk_id='',reservation_id='r-gdmig8v7',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-387682144',owner_user_name='tempest-TaggedAttachmentsTest-387682144-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T15:38:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='587c402e2f0d45ad909ae974a03cd20e',uuid=76ee582b-b887-4d46-8c78-29f42d1a0d26,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f5a850f4-996a-42df-9243-54ea71cc8eec", "address": "fa:16:3e:4d:c3:29", "network": {"id": "081214fe-5e93-4171-bf5b-63393a14c539", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1591381833", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "4180b3fb8de74de1ad134fe356b85d6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5a850f4-99", "ovs_interfaceid": "f5a850f4-996a-42df-9243-54ea71cc8eec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 15:42:37 user nova-compute[75337]: DEBUG nova.network.os_vif_util [req-13db70a5-635e-46c2-9b79-1c337ac15e7b req-453f1c39-2dbd-457b-bee5-0d724b4cfc70 service nova] Converting VIF {"id": "f5a850f4-996a-42df-9243-54ea71cc8eec", "address": "fa:16:3e:4d:c3:29", "network": {"id": "081214fe-5e93-4171-bf5b-63393a14c539", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1591381833", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "4180b3fb8de74de1ad134fe356b85d6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5a850f4-99", "ovs_interfaceid": "f5a850f4-996a-42df-9243-54ea71cc8eec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 15:42:37 user nova-compute[75337]: DEBUG nova.network.os_vif_util [req-13db70a5-635e-46c2-9b79-1c337ac15e7b req-453f1c39-2dbd-457b-bee5-0d724b4cfc70 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:c3:29,bridge_name='br-int',has_traffic_filtering=True,id=f5a850f4-996a-42df-9243-54ea71cc8eec,network=Network(081214fe-5e93-4171-bf5b-63393a14c539),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5a850f4-99') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 15:42:37 user nova-compute[75337]: DEBUG os_vif [req-13db70a5-635e-46c2-9b79-1c337ac15e7b req-453f1c39-2dbd-457b-bee5-0d724b4cfc70 service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:c3:29,bridge_name='br-int',has_traffic_filtering=True,id=f5a850f4-996a-42df-9243-54ea71cc8eec,network=Network(081214fe-5e93-4171-bf5b-63393a14c539),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5a850f4-99') {{(pid=75337) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 15:42:37 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:42:37 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf5a850f4-99, bridge=br-int, if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:42:37 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 15:42:37 user nova-compute[75337]: INFO os_vif [req-13db70a5-635e-46c2-9b79-1c337ac15e7b req-453f1c39-2dbd-457b-bee5-0d724b4cfc70 service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:c3:29,bridge_name='br-int',has_traffic_filtering=True,id=f5a850f4-996a-42df-9243-54ea71cc8eec,network=Network(081214fe-5e93-4171-bf5b-63393a14c539),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5a850f4-99')
Nov 06 15:42:37 user nova-compute[75337]: DEBUG nova.virt.libvirt.guest [req-13db70a5-635e-46c2-9b79-1c337ac15e7b req-453f1c39-2dbd-457b-bee5-0d724b4cfc70 service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 15:42:37 user nova-compute[75337]:   <nova:package version="0.0.0"/>
Nov 06 15:42:37 user nova-compute[75337]:   <nova:name>tempest-device-tagging-server-1853414850</nova:name>
Nov 06 15:42:37 user nova-compute[75337]:   <nova:creationTime>2023-11-06 15:42:37</nova:creationTime>
Nov 06 15:42:37 user nova-compute[75337]:   <nova:flavor name="m1.tiny">
Nov 06 15:42:37 user nova-compute[75337]:     <nova:memory>512</nova:memory>
Nov 06 15:42:37 user nova-compute[75337]:     <nova:disk>1</nova:disk>
Nov 06 15:42:37 user nova-compute[75337]:     <nova:swap>0</nova:swap>
Nov 06 15:42:37 user nova-compute[75337]:     <nova:ephemeral>0</nova:ephemeral>
Nov 06 15:42:37 user nova-compute[75337]:     <nova:vcpus>1</nova:vcpus>
Nov 06 15:42:37 user nova-compute[75337]:   </nova:flavor>
Nov 06 15:42:37 user nova-compute[75337]:   <nova:owner>
Nov 06 15:42:37 user nova-compute[75337]:     <nova:user uuid="587c402e2f0d45ad909ae974a03cd20e">tempest-TaggedAttachmentsTest-387682144-project-member</nova:user>
Nov 06 15:42:37 user nova-compute[75337]:     <nova:project uuid="4180b3fb8de74de1ad134fe356b85d6f">tempest-TaggedAttachmentsTest-387682144</nova:project>
Nov 06 15:42:37 user nova-compute[75337]:   </nova:owner>
Nov 06 15:42:37 user nova-compute[75337]:   <nova:root type="image" uuid="16b903ae-a40f-41a7-985b-4804cce92c62"/>
Nov 06 15:42:37 user nova-compute[75337]:   <nova:ports>
Nov 06 15:42:37 user nova-compute[75337]:     <nova:port uuid="8d52e5d0-96a2-44ca-9968-9ac564aeff2c">
Nov 06 15:42:37 user nova-compute[75337]:       <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 06 15:42:37 user nova-compute[75337]:     </nova:port>
Nov 06 15:42:37 user nova-compute[75337]:   </nova:ports>
Nov 06 15:42:37 user nova-compute[75337]: </nova:instance>
Nov 06 15:42:37 user nova-compute[75337]:  {{(pid=75337) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 06 15:42:37 user nova-compute[75337]: DEBUG nova.network.neutron [None req-165b27f3-21f2-4e45-a1b3-7f69b978e7b4 tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] [instance: 76ee582b-b887-4d46-8c78-29f42d1a0d26] Updating instance_info_cache with network_info: [{"id": "8d52e5d0-96a2-44ca-9968-9ac564aeff2c", "address": "fa:16:3e:0b:83:6f", "network": {"id": "cd11ddce-8aa1-4ad8-8184-317c63f52be7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-265471432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4180b3fb8de74de1ad134fe356b85d6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d52e5d0-96", "ovs_interfaceid": "8d52e5d0-96a2-44ca-9968-9ac564aeff2c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:42:37 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-0198afa5-acb1-4b45-ba5f-30b0d756b4c7 tempest-VolumesAssistedSnapshotsTest-123777916 tempest-VolumesAssistedSnapshotsTest-123777916-project-admin] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1 is timed out.
Nov 06 15:42:37 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-0198afa5-acb1-4b45-ba5f-30b0d756b4c7 tempest-VolumesAssistedSnapshotsTest-123777916 tempest-VolumesAssistedSnapshotsTest-123777916-project-admin] Successfully detached device vdb from instance cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1 from the live domain config.
Nov 06 15:42:37 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0198afa5-acb1-4b45-ba5f-30b0d756b4c7 tempest-VolumesAssistedSnapshotsTest-123777916 tempest-VolumesAssistedSnapshotsTest-123777916-project-admin] [instance: cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1] calling os-brick to detach iSCSI Volume {{(pid=75337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 15:42:37 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-0198afa5-acb1-4b45-ba5f-30b0d756b4c7 tempest-VolumesAssistedSnapshotsTest-123777916 tempest-VolumesAssistedSnapshotsTest-123777916-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2abc33d0c0>, {'target_iqn': 'iqn.2010-10.org.openstack:7f11bb9d-a426-4068-9915-1da27b932a82', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cVkziOoa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 15:42:37 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-0198afa5-acb1-4b45-ba5f-30b0d756b4c7 tempest-VolumesAssistedSnapshotsTest-123777916 tempest-VolumesAssistedSnapshotsTest-123777916-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 15:42:37 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-0198afa5-acb1-4b45-ba5f-30b0d756b4c7 tempest-VolumesAssistedSnapshotsTest-123777916 tempest-VolumesAssistedSnapshotsTest-123777916-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 15:42:37 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-0198afa5-acb1-4b45-ba5f-30b0d756b4c7 tempest-VolumesAssistedSnapshotsTest-123777916 tempest-VolumesAssistedSnapshotsTest-123777916-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 15:42:37 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-165b27f3-21f2-4e45-a1b3-7f69b978e7b4 tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] Releasing lock "refresh_cache-76ee582b-b887-4d46-8c78-29f42d1a0d26" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 15:42:37 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:42:37 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:42:37 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[1254444d-a8f8-47c4-8f8f-755dd389f7d2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:eaf5fc54-be7c-4748-9e2f-12a01971e6f4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0ad85d1f-7027-4997-96c4-991e3969067d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7f11bb9d-a426-4068-9915-1da27b932a82\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4367fb98-2ae9-40c3-a2d0-6e9b0f70dc7c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:42:37 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-0198afa5-acb1-4b45-ba5f-30b0d756b4c7 tempest-VolumesAssistedSnapshotsTest-123777916 tempest-VolumesAssistedSnapshotsTest-123777916-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 15:42:37 user nova-compute[75337]: No targets found.
Nov 06 15:42:37 user nova-compute[75337]: iSNS:
Nov 06 15:42:37 user nova-compute[75337]: No targets found.
Nov 06 15:42:37 user nova-compute[75337]: STATIC:
Nov 06 15:42:37 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:eaf5fc54-be7c-4748-9e2f-12a01971e6f4
Nov 06 15:42:37 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 15:42:37 user nova-compute[75337]:                 Iface Name: default
Nov 06 15:42:37 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:0ad85d1f-7027-4997-96c4-991e3969067d
Nov 06 15:42:37 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 15:42:37 user nova-compute[75337]:                 Iface Name: default
Nov 06 15:42:37 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158
Nov 06 15:42:37 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 15:42:37 user nova-compute[75337]:                 Iface Name: default
Nov 06 15:42:37 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759
Nov 06 15:42:37 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 15:42:37 user nova-compute[75337]:                 Iface Name: default
Nov 06 15:42:37 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:7f11bb9d-a426-4068-9915-1da27b932a82
Nov 06 15:42:37 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 15:42:37 user nova-compute[75337]:                 Iface Name: default
Nov 06 15:42:37 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:4367fb98-2ae9-40c3-a2d0-6e9b0f70dc7c
Nov 06 15:42:37 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 15:42:37 user nova-compute[75337]:                 Iface Name: default
Nov 06 15:42:37 user nova-compute[75337]: FIRMWARE:
Nov 06 15:42:37 user nova-compute[75337]: No targets found.
Nov 06 15:42:37 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 15:42:37 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-0198afa5-acb1-4b45-ba5f-30b0d756b4c7 tempest-VolumesAssistedSnapshotsTest-123777916 tempest-VolumesAssistedSnapshotsTest-123777916-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 15:42:37 user nova-compute[75337]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 15:42:37 user nova-compute[75337]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75337) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 15:42:37 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-0198afa5-acb1-4b45-ba5f-30b0d756b4c7 tempest-VolumesAssistedSnapshotsTest-123777916 tempest-VolumesAssistedSnapshotsTest-123777916-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7f11bb9d-a426-4068-9915-1da27b932a82', 0)] {{(pid=75337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 15:42:37 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-165b27f3-21f2-4e45-a1b3-7f69b978e7b4 tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] Lock "interface-76ee582b-b887-4d46-8c78-29f42d1a0d26-f5a850f4-996a-42df-9243-54ea71cc8eec" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 21.483s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:42:37 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:42:37 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:42:37 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8fdc7e3-c9cb-482c-ae63-ffae2f8a53f1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ad85d1f-7027-4997-96c4-991e3969067d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4367fb98-2ae9-40c3-a2d0-6e9b0f70dc7c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f11bb9d-a426-4068-9915-1da27b932a82\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eaf5fc54-be7c-4748-9e2f-12a01971e6f4\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:42:37 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:42:37 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:42:37 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[da2dd3f8-21bd-4aa3-bcd8-36b0ad004e4c]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4367fb98-2ae9-40c3-a2d0-6e9b0f70dc7c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ad85d1f-7027-4997-96c4-991e3969067d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaf5fc54-be7c-4748-9e2f-12a01971e6f4 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f11bb9d-a426-4068-9915-1da27b932a82 (non-flash)\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:42:37 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-0198afa5-acb1-4b45-ba5f-30b0d756b4c7 tempest-VolumesAssistedSnapshotsTest-123777916 tempest-VolumesAssistedSnapshotsTest-123777916-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)
Nov 06 15:42:37 user nova-compute[75337]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759 (non-flash)
Nov 06 15:42:37 user nova-compute[75337]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4367fb98-2ae9-40c3-a2d0-6e9b0f70dc7c (non-flash)
Nov 06 15:42:37 user nova-compute[75337]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ad85d1f-7027-4997-96c4-991e3969067d (non-flash)
Nov 06 15:42:37 user nova-compute[75337]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaf5fc54-be7c-4748-9e2f-12a01971e6f4 (non-flash)
Nov 06 15:42:37 user nova-compute[75337]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f11bb9d-a426-4068-9915-1da27b932a82 (non-flash)
Nov 06 15:42:37 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 15:42:37 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-0198afa5-acb1-4b45-ba5f-30b0d756b4c7 tempest-VolumesAssistedSnapshotsTest-123777916 tempest-VolumesAssistedSnapshotsTest-123777916-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)
Nov 06 15:42:37 user nova-compute[75337]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759 (non-flash)
Nov 06 15:42:37 user nova-compute[75337]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4367fb98-2ae9-40c3-a2d0-6e9b0f70dc7c (non-flash)
Nov 06 15:42:37 user nova-compute[75337]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ad85d1f-7027-4997-96c4-991e3969067d (non-flash)
Nov 06 15:42:37 user nova-compute[75337]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaf5fc54-be7c-4748-9e2f-12a01971e6f4 (non-flash)
Nov 06 15:42:37 user nova-compute[75337]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f11bb9d-a426-4068-9915-1da27b932a82 (non-flash)
Nov 06 15:42:37 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 15:42:37 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-0198afa5-acb1-4b45-ba5f-30b0d756b4c7 tempest-VolumesAssistedSnapshotsTest-123777916 tempest-VolumesAssistedSnapshotsTest-123777916-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2ac499db40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7f11bb9d-a426-4068-9915-1da27b932a82'): ({'sdh'}, set())}) {{(pid=75337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 15:42:37 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-0198afa5-acb1-4b45-ba5f-30b0d756b4c7 tempest-VolumesAssistedSnapshotsTest-123777916 tempest-VolumesAssistedSnapshotsTest-123777916-project-admin] Removing single pathed devices sdh {{(pid=75337) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 15:42:37 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:42:37 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:42:37 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[55f5b220-00e4-45b8-9a33-48e0bf05844e]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:42:37 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:42:37 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.022s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:42:37 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e0f2fba-4dd3-41c2-a318-0a6d52477055]: (4, ('ok\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:42:37 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-0198afa5-acb1-4b45-ba5f-30b0d756b4c7 tempest-VolumesAssistedSnapshotsTest-123777916 tempest-VolumesAssistedSnapshotsTest-123777916-project-admin] Flushing IO for device /dev/sdh {{(pid=75337) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 15:42:37 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:42:37 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.013s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:42:37 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7f70a80-5f1a-4cf2-b4f0-9d0fdd7d91af]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:42:37 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-0198afa5-acb1-4b45-ba5f-30b0d756b4c7 tempest-VolumesAssistedSnapshotsTest-123777916 tempest-VolumesAssistedSnapshotsTest-123777916-project-admin] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=75337) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 15:42:37 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:42:37 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.040s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:42:37 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4d92707-371b-4a2a-8246-e71f518cd16b]: (4, ('1', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:42:37 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-0198afa5-acb1-4b45-ba5f-30b0d756b4c7 tempest-VolumesAssistedSnapshotsTest-123777916 tempest-VolumesAssistedSnapshotsTest-123777916-project-admin] Checking to see if SCSI volumes sdh have been removed. {{(pid=75337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 15:42:37 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-0198afa5-acb1-4b45-ba5f-30b0d756b4c7 tempest-VolumesAssistedSnapshotsTest-123777916 tempest-VolumesAssistedSnapshotsTest-123777916-project-admin] SCSI volumes sdh have been removed. {{(pid=75337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 15:42:37 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-0198afa5-acb1-4b45-ba5f-30b0d756b4c7 tempest-VolumesAssistedSnapshotsTest-123777916 tempest-VolumesAssistedSnapshotsTest-123777916-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7f11bb9d-a426-4068-9915-1da27b932a82')] {{(pid=75337) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 15:42:37 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f11bb9d-a426-4068-9915-1da27b932a82 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:42:37 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f11bb9d-a426-4068-9915-1da27b932a82 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:42:37 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a7a7240-8983-4d36-95f0-6943626c92f0]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:42:37 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-0198afa5-acb1-4b45-ba5f-30b0d756b4c7 tempest-VolumesAssistedSnapshotsTest-123777916 tempest-VolumesAssistedSnapshotsTest-123777916-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:42:37 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f11bb9d-a426-4068-9915-1da27b932a82 -p 172.16.0.220:3260 --logout {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:42:38 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f11bb9d-a426-4068-9915-1da27b932a82 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:42:38 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[a75ad3f8-54ad-4e17-b192-44d73bd4ed68]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:7f11bb9d-a426-4068-9915-1da27b932a82, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:7f11bb9d-a426-4068-9915-1da27b932a82, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:42:38 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-0198afa5-acb1-4b45-ba5f-30b0d756b4c7 tempest-VolumesAssistedSnapshotsTest-123777916 tempest-VolumesAssistedSnapshotsTest-123777916-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:7f11bb9d-a426-4068-9915-1da27b932a82, portal: 172.16.0.220,3260]
Nov 06 15:42:38 user nova-compute[75337]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:7f11bb9d-a426-4068-9915-1da27b932a82, portal: 172.16.0.220,3260] successful.
Nov 06 15:42:38 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:42:38 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f11bb9d-a426-4068-9915-1da27b932a82 -p 172.16.0.220:3260 --op delete {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:42:38 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f11bb9d-a426-4068-9915-1da27b932a82 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.041s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:42:38 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff699a2f-f985-4544-835b-df206249ff57]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:42:38 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-0198afa5-acb1-4b45-ba5f-30b0d756b4c7 tempest-VolumesAssistedSnapshotsTest-123777916 tempest-VolumesAssistedSnapshotsTest-123777916-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:42:38 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-0198afa5-acb1-4b45-ba5f-30b0d756b4c7 tempest-VolumesAssistedSnapshotsTest-123777916 tempest-VolumesAssistedSnapshotsTest-123777916-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.338s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 15:42:38 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-0198afa5-acb1-4b45-ba5f-30b0d756b4c7 tempest-VolumesAssistedSnapshotsTest-123777916 tempest-VolumesAssistedSnapshotsTest-123777916-project-admin] <== disconnect_volume: return (339ms) None {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 15:42:38 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0198afa5-acb1-4b45-ba5f-30b0d756b4c7 tempest-VolumesAssistedSnapshotsTest-123777916 tempest-VolumesAssistedSnapshotsTest-123777916-project-admin] [instance: cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1] Disconnected iSCSI Volume {{(pid=75337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 15:42:41 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-42b0e143-63ae-45cb-83ee-a5a9fc18a14a tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] [instance: 581cf468-65e7-42e5-9250-c3d645577011] Calling os-brick to attach iSCSI Volume {{(pid=75337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 15:42:41 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-42b0e143-63ae-45cb-83ee-a5a9fc18a14a tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2abc33d0c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XMEQSsAU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 15:42:41 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-42b0e143-63ae-45cb-83ee-a5a9fc18a14a tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 15:42:41 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-42b0e143-63ae-45cb-83ee-a5a9fc18a14a tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 15:42:41 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-42b0e143-63ae-45cb-83ee-a5a9fc18a14a tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 15:42:41 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-42b0e143-63ae-45cb-83ee-a5a9fc18a14a tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 15:42:41 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-42b0e143-63ae-45cb-83ee-a5a9fc18a14a tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 15:42:41 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-42b0e143-63ae-45cb-83ee-a5a9fc18a14a tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 15:42:41 user nova-compute[75337]: INFO os_brick.initiator.connectors.iscsi [None req-42b0e143-63ae-45cb-83ee-a5a9fc18a14a tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 15:42:41 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e -p 172.16.0.220:3260 {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:42:41 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:42:41 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6afafde-1550-4e7e-86e9-2a805905e492]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:42:41 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-42b0e143-63ae-45cb-83ee-a5a9fc18a14a tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 15:42:41 user nova-compute[75337]:  {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:42:41 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e -p 172.16.0.220:3260 --interface default --op new {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:42:41 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:42:41 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d05831c-de29-4526-a47c-082d8553dd55]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e] added\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:42:41 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-42b0e143-63ae-45cb-83ee-a5a9fc18a14a tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e] added
Nov 06 15:42:41 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:42:41 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:42:41 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.056s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:42:41 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c85acd7-31da-4374-a447-4a754a991a0b]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:42:41 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-42b0e143-63ae-45cb-83ee-a5a9fc18a14a tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:42:41 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:42:41 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:42:41 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[ead15023-99c5-4414-81aa-b11de78f51ff]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:42:41 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-42b0e143-63ae-45cb-83ee-a5a9fc18a14a tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:42:41 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XMEQSsAU {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:42:41 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XMEQSsAU" returned: 0 in 0.017s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:42:41 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[7db6e08d-9c42-4eb5-af05-c8e182d431ff]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:42:41 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-42b0e143-63ae-45cb-83ee-a5a9fc18a14a tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XMEQSsAU'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:42:41 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:42:41 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:42:41 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[41e0f5d7-4dae-4414-aa54-a010e81aa9b8]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:42:41 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-42b0e143-63ae-45cb-83ee-a5a9fc18a14a tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:42:41 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:42:41 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:42:41 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[70828197-04fb-4c00-a95b-743b2c392065]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4367fb98-2ae9-40c3-a2d0-6e9b0f70dc7c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ad85d1f-7027-4997-96c4-991e3969067d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaf5fc54-be7c-4748-9e2f-12a01971e6f4 (non-flash)\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:42:41 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-42b0e143-63ae-45cb-83ee-a5a9fc18a14a tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)
Nov 06 15:42:41 user nova-compute[75337]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759 (non-flash)
Nov 06 15:42:41 user nova-compute[75337]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4367fb98-2ae9-40c3-a2d0-6e9b0f70dc7c (non-flash)
Nov 06 15:42:41 user nova-compute[75337]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ad85d1f-7027-4997-96c4-991e3969067d (non-flash)
Nov 06 15:42:41 user nova-compute[75337]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaf5fc54-be7c-4748-9e2f-12a01971e6f4 (non-flash)
Nov 06 15:42:41 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 15:42:41 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-42b0e143-63ae-45cb-83ee-a5a9fc18a14a tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)
Nov 06 15:42:41 user nova-compute[75337]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759 (non-flash)
Nov 06 15:42:41 user nova-compute[75337]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4367fb98-2ae9-40c3-a2d0-6e9b0f70dc7c (non-flash)
Nov 06 15:42:41 user nova-compute[75337]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ad85d1f-7027-4997-96c4-991e3969067d (non-flash)
Nov 06 15:42:41 user nova-compute[75337]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaf5fc54-be7c-4748-9e2f-12a01971e6f4 (non-flash)
Nov 06 15:42:41 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 15:42:41 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e -p 172.16.0.220:3260 --login {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:42:41 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:42:41 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[f21ff67d-a210-4425-b273-0aa58e05c521]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:42:41 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-42b0e143-63ae-45cb-83ee-a5a9fc18a14a tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e, portal: 172.16.0.220,3260]
Nov 06 15:42:41 user nova-compute[75337]: Login to [iface: default, target: iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e, portal: 172.16.0.220,3260] successful.
Nov 06 15:42:41 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:42:41 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:42:41 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:42:41 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b709ca4-c980-4f27-a3ea-3bb8f95eec65]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:42:41 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-42b0e143-63ae-45cb-83ee-a5a9fc18a14a tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:42:41 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:42:41 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:42:41 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[19c36993-7b8a-45be-9a57-04c1823611df]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4367fb98-2ae9-40c3-a2d0-6e9b0f70dc7c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ad85d1f-7027-4997-96c4-991e3969067d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaf5fc54-be7c-4748-9e2f-12a01971e6f4 (non-flash)\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:42:41 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-42b0e143-63ae-45cb-83ee-a5a9fc18a14a tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)
Nov 06 15:42:41 user nova-compute[75337]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e (non-flash)
Nov 06 15:42:41 user nova-compute[75337]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759 (non-flash)
Nov 06 15:42:41 user nova-compute[75337]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4367fb98-2ae9-40c3-a2d0-6e9b0f70dc7c (non-flash)
Nov 06 15:42:41 user nova-compute[75337]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ad85d1f-7027-4997-96c4-991e3969067d (non-flash)
Nov 06 15:42:41 user nova-compute[75337]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaf5fc54-be7c-4748-9e2f-12a01971e6f4 (non-flash)
Nov 06 15:42:41 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 15:42:41 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-42b0e143-63ae-45cb-83ee-a5a9fc18a14a tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)
Nov 06 15:42:41 user nova-compute[75337]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e (non-flash)
Nov 06 15:42:41 user nova-compute[75337]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759 (non-flash)
Nov 06 15:42:41 user nova-compute[75337]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4367fb98-2ae9-40c3-a2d0-6e9b0f70dc7c (non-flash)
Nov 06 15:42:41 user nova-compute[75337]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ad85d1f-7027-4997-96c4-991e3969067d (non-flash)
Nov 06 15:42:41 user nova-compute[75337]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaf5fc54-be7c-4748-9e2f-12a01971e6f4 (non-flash)
Nov 06 15:42:41 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 15:42:41 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-42b0e143-63ae-45cb-83ee-a5a9fc18a14a tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.325s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 15:42:41 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-42b0e143-63ae-45cb-83ee-a5a9fc18a14a tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Connected to 172.16.0.220:3260 {{(pid=75337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 15:42:41 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-42b0e143-63ae-45cb-83ee-a5a9fc18a14a tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] HCTL ('36', '-', '-', 0) found on session 11 with lun 0 {{(pid=75337) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 15:42:41 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-42b0e143-63ae-45cb-83ee-a5a9fc18a14a tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75337) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 15:42:41 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:42:41 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:42:41 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab99f940-a94a-4eaa-8277-216c7d54bc5b]: (4, ('- - 0', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:42:41 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-42b0e143-63ae-45cb-83ee-a5a9fc18a14a tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Searching for a device in session 11 and hctl ['36', '*', '*', 0] yield: None {{(pid=75337) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 15:42:41 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:42:42 user nova-compute[75337]: DEBUG nova.objects.instance [None req-0198afa5-acb1-4b45-ba5f-30b0d756b4c7 tempest-VolumesAssistedSnapshotsTest-123777916 tempest-VolumesAssistedSnapshotsTest-123777916-project-admin] Lazy-loading 'flavor' on Instance uuid cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 15:42:42 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-0198afa5-acb1-4b45-ba5f-30b0d756b4c7 tempest-VolumesAssistedSnapshotsTest-123777916 tempest-VolumesAssistedSnapshotsTest-123777916-project-admin] Lock "cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 25.397s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:42:42 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-42b0e143-63ae-45cb-83ee-a5a9fc18a14a tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Searching for a device in session 11 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75337) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 15:42:42 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-42b0e143-63ae-45cb-83ee-a5a9fc18a14a tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XMEQSsAU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 15:42:42 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-42b0e143-63ae-45cb-83ee-a5a9fc18a14a tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.357s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 15:42:42 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-42b0e143-63ae-45cb-83ee-a5a9fc18a14a tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] <== connect_volume: return (1358ms) {'type': 'block', 'scsi_wwn': '23635626366623136', 'path': '/dev/sde'} {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 15:42:42 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-42b0e143-63ae-45cb-83ee-a5a9fc18a14a tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] [instance: 581cf468-65e7-42e5-9250-c3d645577011] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23635626366623136', 'path': '/dev/sde'} {{(pid=75337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 15:42:42 user nova-compute[75337]: DEBUG nova.objects.instance [None req-42b0e143-63ae-45cb-83ee-a5a9fc18a14a tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Lazy-loading 'flavor' on Instance uuid 581cf468-65e7-42e5-9250-c3d645577011 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 15:42:42 user nova-compute[75337]: DEBUG nova.virt.libvirt.guest [None req-42b0e143-63ae-45cb-83ee-a5a9fc18a14a tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] attach device xml: <disk type="block" device="disk">
Nov 06 15:42:42 user nova-compute[75337]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 15:42:42 user nova-compute[75337]:   <source dev="/dev/sde"/>
Nov 06 15:42:42 user nova-compute[75337]:   <target dev="vdb" bus="virtio"/>
Nov 06 15:42:42 user nova-compute[75337]:   <serial>84119968-a048-41d8-9688-39c01b5f860e</serial>
Nov 06 15:42:42 user nova-compute[75337]: </disk>
Nov 06 15:42:42 user nova-compute[75337]:  {{(pid=75337) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 06 15:42:42 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-c512ac3b-84c4-4a4b-ae48-83e94b9b89b4 tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] Acquiring lock "8858d90e-ee14-494b-80da-904cd97cdff0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:42:42 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-c512ac3b-84c4-4a4b-ae48-83e94b9b89b4 tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] Lock "8858d90e-ee14-494b-80da-904cd97cdff0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:42:42 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-c512ac3b-84c4-4a4b-ae48-83e94b9b89b4 tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] Acquiring lock "8858d90e-ee14-494b-80da-904cd97cdff0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:42:42 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-c512ac3b-84c4-4a4b-ae48-83e94b9b89b4 tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] Lock "8858d90e-ee14-494b-80da-904cd97cdff0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:42:42 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-c512ac3b-84c4-4a4b-ae48-83e94b9b89b4 tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] Lock "8858d90e-ee14-494b-80da-904cd97cdff0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.002s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:42:42 user nova-compute[75337]: INFO nova.compute.manager [None req-c512ac3b-84c4-4a4b-ae48-83e94b9b89b4 tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] [instance: 8858d90e-ee14-494b-80da-904cd97cdff0] Terminating instance
Nov 06 15:42:42 user nova-compute[75337]: DEBUG nova.compute.manager [None req-c512ac3b-84c4-4a4b-ae48-83e94b9b89b4 tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] [instance: 8858d90e-ee14-494b-80da-904cd97cdff0] Start destroying the instance on the hypervisor. {{(pid=75337) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 15:42:42 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-42b0e143-63ae-45cb-83ee-a5a9fc18a14a tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] No BDM found with device name vda, not building metadata. {{(pid=75337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 15:42:42 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-42b0e143-63ae-45cb-83ee-a5a9fc18a14a tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 15:42:42 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-42b0e143-63ae-45cb-83ee-a5a9fc18a14a tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] No VIF found with MAC fa:16:3e:00:1c:74, not building metadata {{(pid=75337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 15:42:42 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:42:42 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:42:43 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:42:43 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:42:43 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-42b0e143-63ae-45cb-83ee-a5a9fc18a14a tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Lock "581cf468-65e7-42e5-9250-c3d645577011" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 26.226s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:42:43 user nova-compute[75337]: DEBUG nova.compute.manager [req-f461488f-18b0-4c3d-a006-2997e88b072b req-93139e68-96b2-4b7c-980c-136b474f827c service nova] [instance: 8858d90e-ee14-494b-80da-904cd97cdff0] Received event network-vif-unplugged-d4c8113e-f11f-442c-bd08-206acb4a0416 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:42:43 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-f461488f-18b0-4c3d-a006-2997e88b072b req-93139e68-96b2-4b7c-980c-136b474f827c service nova] Acquiring lock "8858d90e-ee14-494b-80da-904cd97cdff0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:42:43 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-f461488f-18b0-4c3d-a006-2997e88b072b req-93139e68-96b2-4b7c-980c-136b474f827c service nova] Lock "8858d90e-ee14-494b-80da-904cd97cdff0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:42:43 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-f461488f-18b0-4c3d-a006-2997e88b072b req-93139e68-96b2-4b7c-980c-136b474f827c service nova] Lock "8858d90e-ee14-494b-80da-904cd97cdff0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:42:43 user nova-compute[75337]: DEBUG nova.compute.manager [req-f461488f-18b0-4c3d-a006-2997e88b072b req-93139e68-96b2-4b7c-980c-136b474f827c service nova] [instance: 8858d90e-ee14-494b-80da-904cd97cdff0] No waiting events found dispatching network-vif-unplugged-d4c8113e-f11f-442c-bd08-206acb4a0416 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:42:43 user nova-compute[75337]: DEBUG nova.compute.manager [req-f461488f-18b0-4c3d-a006-2997e88b072b req-93139e68-96b2-4b7c-980c-136b474f827c service nova] [instance: 8858d90e-ee14-494b-80da-904cd97cdff0] Received event network-vif-unplugged-d4c8113e-f11f-442c-bd08-206acb4a0416 for instance with task_state deleting. {{(pid=75337) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 15:42:43 user nova-compute[75337]: DEBUG nova.compute.manager [req-b2ec3517-3ef0-447e-881d-5860fae74d6f req-792f4714-5191-4738-9606-122843c74103 service nova] [instance: d5dc789c-b1ee-4ee8-8e2b-9a6cb56a1361] Received event network-changed-d4ab286a-0327-4dde-8eda-1c63107a670a {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:42:43 user nova-compute[75337]: DEBUG nova.compute.manager [req-b2ec3517-3ef0-447e-881d-5860fae74d6f req-792f4714-5191-4738-9606-122843c74103 service nova] [instance: d5dc789c-b1ee-4ee8-8e2b-9a6cb56a1361] Refreshing instance network info cache due to event network-changed-d4ab286a-0327-4dde-8eda-1c63107a670a. {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 15:42:43 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-b2ec3517-3ef0-447e-881d-5860fae74d6f req-792f4714-5191-4738-9606-122843c74103 service nova] Acquiring lock "refresh_cache-d5dc789c-b1ee-4ee8-8e2b-9a6cb56a1361" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 15:42:43 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-b2ec3517-3ef0-447e-881d-5860fae74d6f req-792f4714-5191-4738-9606-122843c74103 service nova] Acquired lock "refresh_cache-d5dc789c-b1ee-4ee8-8e2b-9a6cb56a1361" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 15:42:43 user nova-compute[75337]: DEBUG nova.network.neutron [req-b2ec3517-3ef0-447e-881d-5860fae74d6f req-792f4714-5191-4738-9606-122843c74103 service nova] [instance: d5dc789c-b1ee-4ee8-8e2b-9a6cb56a1361] Refreshing network info cache for port d4ab286a-0327-4dde-8eda-1c63107a670a {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 15:42:43 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:42:43 user nova-compute[75337]: INFO nova.virt.libvirt.driver [-] [instance: 8858d90e-ee14-494b-80da-904cd97cdff0] Instance destroyed successfully.
Nov 06 15:42:43 user nova-compute[75337]: DEBUG nova.objects.instance [None req-c512ac3b-84c4-4a4b-ae48-83e94b9b89b4 tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] Lazy-loading 'resources' on Instance uuid 8858d90e-ee14-494b-80da-904cd97cdff0 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 15:42:43 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-c512ac3b-84c4-4a4b-ae48-83e94b9b89b4 tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T15:38:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-201329404',display_name='tempest-AttachSCSIVolumeTestJSON-server-201329404',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-201329404',id=7,image_ref='f8a9eaef-bb42-42c2-8a3f-18ae9a3e629b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCc9GjtpgedV1+fm3enhgtH75uDO4F0PRkthdweNfH+DjinweR/KsJr5LkNKl4WEwMAL8dd/5Pvlm0dpc330PZuZxpKPkllX2DeUgzAxJpScFt3H3rso5vDvEICm7GRZ5g==',key_name='tempest-keypair-512953345',keypairs=<?>,launch_index=0,launched_at=2023-11-06T15:38:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dc4e4ce6f66541f380a8bbb0671657f3',ramdisk_id='',reservation_id='r-rjbc7q98',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f8a9eaef-bb42-42c2-8a3f-18ae9a3e629b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-2089763587',owner_user_name='tempest-AttachSCSIVolumeTestJSON-2089763587-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T15:38:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4eb5c53de9ed4929aa60551a1cd99d3d',uuid=8858d90e-ee14-494b-80da-904cd97cdff0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d4c8113e-f11f-442c-bd08-206acb4a0416", "address": "fa:16:3e:d5:8c:cf", "network": {"id": "54c79a10-5da3-4de7-b93f-855e966b7101", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-39876549-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc4e4ce6f66541f380a8bbb0671657f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4c8113e-f1", "ovs_interfaceid": "d4c8113e-f11f-442c-bd08-206acb4a0416", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 15:42:43 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-c512ac3b-84c4-4a4b-ae48-83e94b9b89b4 tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] Converting VIF {"id": "d4c8113e-f11f-442c-bd08-206acb4a0416", "address": "fa:16:3e:d5:8c:cf", "network": {"id": "54c79a10-5da3-4de7-b93f-855e966b7101", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-39876549-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc4e4ce6f66541f380a8bbb0671657f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4c8113e-f1", "ovs_interfaceid": "d4c8113e-f11f-442c-bd08-206acb4a0416", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 15:42:43 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-c512ac3b-84c4-4a4b-ae48-83e94b9b89b4 tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d5:8c:cf,bridge_name='br-int',has_traffic_filtering=True,id=d4c8113e-f11f-442c-bd08-206acb4a0416,network=Network(54c79a10-5da3-4de7-b93f-855e966b7101),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4c8113e-f1') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 15:42:43 user nova-compute[75337]: DEBUG os_vif [None req-c512ac3b-84c4-4a4b-ae48-83e94b9b89b4 tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d5:8c:cf,bridge_name='br-int',has_traffic_filtering=True,id=d4c8113e-f11f-442c-bd08-206acb4a0416,network=Network(54c79a10-5da3-4de7-b93f-855e966b7101),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4c8113e-f1') {{(pid=75337) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 15:42:43 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:42:43 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd4c8113e-f1, bridge=br-int, if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:42:43 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:42:43 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-a76ce9a5-c542-4515-ac13-d37418b87df6 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Acquiring lock "d5dc789c-b1ee-4ee8-8e2b-9a6cb56a1361" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:42:43 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-a76ce9a5-c542-4515-ac13-d37418b87df6 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Lock "d5dc789c-b1ee-4ee8-8e2b-9a6cb56a1361" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:42:43 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-a76ce9a5-c542-4515-ac13-d37418b87df6 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Acquiring lock "d5dc789c-b1ee-4ee8-8e2b-9a6cb56a1361-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:42:43 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-a76ce9a5-c542-4515-ac13-d37418b87df6 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Lock "d5dc789c-b1ee-4ee8-8e2b-9a6cb56a1361-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:42:43 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-a76ce9a5-c542-4515-ac13-d37418b87df6 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Lock "d5dc789c-b1ee-4ee8-8e2b-9a6cb56a1361-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:42:43 user nova-compute[75337]: INFO nova.compute.manager [None req-a76ce9a5-c542-4515-ac13-d37418b87df6 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] [instance: d5dc789c-b1ee-4ee8-8e2b-9a6cb56a1361] Terminating instance
Nov 06 15:42:43 user nova-compute[75337]: DEBUG nova.compute.manager [None req-a76ce9a5-c542-4515-ac13-d37418b87df6 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] [instance: d5dc789c-b1ee-4ee8-8e2b-9a6cb56a1361] Start destroying the instance on the hypervisor. {{(pid=75337) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 15:42:43 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:42:43 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:42:43 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bd2fc06b-1ccb-45c8-be0f-f17993644027) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:42:43 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:42:43 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:42:43 user nova-compute[75337]: INFO os_vif [None req-c512ac3b-84c4-4a4b-ae48-83e94b9b89b4 tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d5:8c:cf,bridge_name='br-int',has_traffic_filtering=True,id=d4c8113e-f11f-442c-bd08-206acb4a0416,network=Network(54c79a10-5da3-4de7-b93f-855e966b7101),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4c8113e-f1')
Nov 06 15:42:43 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-c512ac3b-84c4-4a4b-ae48-83e94b9b89b4 tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] [instance: 8858d90e-ee14-494b-80da-904cd97cdff0] Deleting instance files /opt/stack/data/nova/instances/8858d90e-ee14-494b-80da-904cd97cdff0_del
Nov 06 15:42:43 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-c512ac3b-84c4-4a4b-ae48-83e94b9b89b4 tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] [instance: 8858d90e-ee14-494b-80da-904cd97cdff0] Deletion of /opt/stack/data/nova/instances/8858d90e-ee14-494b-80da-904cd97cdff0_del complete
Nov 06 15:42:43 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:42:43 user nova-compute[75337]: INFO nova.compute.manager [None req-c512ac3b-84c4-4a4b-ae48-83e94b9b89b4 tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] [instance: 8858d90e-ee14-494b-80da-904cd97cdff0] Took 1.11 seconds to destroy the instance on the hypervisor.
Nov 06 15:42:43 user nova-compute[75337]: DEBUG oslo.service.loopingcall [None req-c512ac3b-84c4-4a4b-ae48-83e94b9b89b4 tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75337) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 15:42:43 user nova-compute[75337]: DEBUG nova.compute.manager [-] [instance: 8858d90e-ee14-494b-80da-904cd97cdff0] Deallocating network for instance {{(pid=75337) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 15:42:43 user nova-compute[75337]: DEBUG nova.network.neutron [-] [instance: 8858d90e-ee14-494b-80da-904cd97cdff0] deallocate_for_instance() {{(pid=75337) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 15:42:43 user nova-compute[75337]: DEBUG nova.network.neutron [req-b2ec3517-3ef0-447e-881d-5860fae74d6f req-792f4714-5191-4738-9606-122843c74103 service nova] [instance: d5dc789c-b1ee-4ee8-8e2b-9a6cb56a1361] Updated VIF entry in instance network info cache for port d4ab286a-0327-4dde-8eda-1c63107a670a. {{(pid=75337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 15:42:43 user nova-compute[75337]: DEBUG nova.network.neutron [req-b2ec3517-3ef0-447e-881d-5860fae74d6f req-792f4714-5191-4738-9606-122843c74103 service nova] [instance: d5dc789c-b1ee-4ee8-8e2b-9a6cb56a1361] Updating instance_info_cache with network_info: [{"id": "d4ab286a-0327-4dde-8eda-1c63107a670a", "address": "fa:16:3e:60:0c:0f", "network": {"id": "48f1545d-7e80-462f-9dbf-f1102ddcda9a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1210368397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1013e7afbefd4146a3be04587710b1de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4ab286a-03", "ovs_interfaceid": "d4ab286a-0327-4dde-8eda-1c63107a670a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:42:43 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:42:44 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-b2ec3517-3ef0-447e-881d-5860fae74d6f req-792f4714-5191-4738-9606-122843c74103 service nova] Releasing lock "refresh_cache-d5dc789c-b1ee-4ee8-8e2b-9a6cb56a1361" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 15:42:44 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:42:44 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:42:44 user nova-compute[75337]: INFO nova.virt.libvirt.driver [-] [instance: d5dc789c-b1ee-4ee8-8e2b-9a6cb56a1361] Instance destroyed successfully.
Nov 06 15:42:44 user nova-compute[75337]: DEBUG nova.objects.instance [None req-a76ce9a5-c542-4515-ac13-d37418b87df6 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Lazy-loading 'resources' on Instance uuid d5dc789c-b1ee-4ee8-8e2b-9a6cb56a1361 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 15:42:44 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-a76ce9a5-c542-4515-ac13-d37418b87df6 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T15:40:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-401455732',display_name='tempest-AttachVolumeNegativeTest-server-401455732',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-401455732',id=11,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFcIoKwOFgiqgppCQHB6MtZX84AO7eVdgMXwhbYTtJQD/x+MPsaRCt/NhtJcrDF+KtGRBOWtAsmO/gAH2wt+7e3soZA3hfcDdB2XLBKT/xRHxN5wjx+ikRaIDb+t3xU57Q==',key_name='tempest-keypair-212361804',keypairs=<?>,launch_index=0,launched_at=2023-11-06T15:40:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1013e7afbefd4146a3be04587710b1de',ramdisk_id='',reservation_id='r-72hm4gcf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1104237961',owner_user_name='tempest-AttachVolumeNegativeTest-1104237961-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T15:40:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aeeea58fcd3e4217a34a4a38be6adf30',uuid=d5dc789c-b1ee-4ee8-8e2b-9a6cb56a1361,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d4ab286a-0327-4dde-8eda-1c63107a670a", "address": "fa:16:3e:60:0c:0f", "network": {"id": "48f1545d-7e80-462f-9dbf-f1102ddcda9a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1210368397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1013e7afbefd4146a3be04587710b1de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4ab286a-03", "ovs_interfaceid": "d4ab286a-0327-4dde-8eda-1c63107a670a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 15:42:44 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-a76ce9a5-c542-4515-ac13-d37418b87df6 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Converting VIF {"id": "d4ab286a-0327-4dde-8eda-1c63107a670a", "address": "fa:16:3e:60:0c:0f", "network": {"id": "48f1545d-7e80-462f-9dbf-f1102ddcda9a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1210368397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1013e7afbefd4146a3be04587710b1de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4ab286a-03", "ovs_interfaceid": "d4ab286a-0327-4dde-8eda-1c63107a670a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 15:42:44 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-a76ce9a5-c542-4515-ac13-d37418b87df6 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:0c:0f,bridge_name='br-int',has_traffic_filtering=True,id=d4ab286a-0327-4dde-8eda-1c63107a670a,network=Network(48f1545d-7e80-462f-9dbf-f1102ddcda9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4ab286a-03') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 15:42:44 user nova-compute[75337]: DEBUG os_vif [None req-a76ce9a5-c542-4515-ac13-d37418b87df6 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:0c:0f,bridge_name='br-int',has_traffic_filtering=True,id=d4ab286a-0327-4dde-8eda-1c63107a670a,network=Network(48f1545d-7e80-462f-9dbf-f1102ddcda9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4ab286a-03') {{(pid=75337) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 15:42:44 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:42:44 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd4ab286a-03, bridge=br-int, if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:42:44 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:42:44 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:42:44 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:42:44 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4ee69721-bc90-49fa-8754-64449c83bde8) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:42:44 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:42:44 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:42:44 user nova-compute[75337]: INFO os_vif [None req-a76ce9a5-c542-4515-ac13-d37418b87df6 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:0c:0f,bridge_name='br-int',has_traffic_filtering=True,id=d4ab286a-0327-4dde-8eda-1c63107a670a,network=Network(48f1545d-7e80-462f-9dbf-f1102ddcda9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4ab286a-03')
Nov 06 15:42:44 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-a76ce9a5-c542-4515-ac13-d37418b87df6 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] [instance: d5dc789c-b1ee-4ee8-8e2b-9a6cb56a1361] Deleting instance files /opt/stack/data/nova/instances/d5dc789c-b1ee-4ee8-8e2b-9a6cb56a1361_del
Nov 06 15:42:44 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-a76ce9a5-c542-4515-ac13-d37418b87df6 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] [instance: d5dc789c-b1ee-4ee8-8e2b-9a6cb56a1361] Deletion of /opt/stack/data/nova/instances/d5dc789c-b1ee-4ee8-8e2b-9a6cb56a1361_del complete
Nov 06 15:42:44 user nova-compute[75337]: INFO nova.compute.manager [None req-a76ce9a5-c542-4515-ac13-d37418b87df6 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] [instance: d5dc789c-b1ee-4ee8-8e2b-9a6cb56a1361] Took 1.12 seconds to destroy the instance on the hypervisor.
Nov 06 15:42:44 user nova-compute[75337]: DEBUG oslo.service.loopingcall [None req-a76ce9a5-c542-4515-ac13-d37418b87df6 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75337) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 15:42:44 user nova-compute[75337]: DEBUG nova.compute.manager [-] [instance: d5dc789c-b1ee-4ee8-8e2b-9a6cb56a1361] Deallocating network for instance {{(pid=75337) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 15:42:44 user nova-compute[75337]: DEBUG nova.network.neutron [-] [instance: d5dc789c-b1ee-4ee8-8e2b-9a6cb56a1361] deallocate_for_instance() {{(pid=75337) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 15:42:45 user nova-compute[75337]: DEBUG nova.compute.manager [req-bf179c85-1f99-4ee8-ae34-3d296e1f647f req-ccefbbc9-bfc3-429c-9ad7-b8b78639ff61 service nova] [instance: d5dc789c-b1ee-4ee8-8e2b-9a6cb56a1361] Received event network-vif-unplugged-d4ab286a-0327-4dde-8eda-1c63107a670a {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:42:45 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-bf179c85-1f99-4ee8-ae34-3d296e1f647f req-ccefbbc9-bfc3-429c-9ad7-b8b78639ff61 service nova] Acquiring lock "d5dc789c-b1ee-4ee8-8e2b-9a6cb56a1361-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:42:45 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-bf179c85-1f99-4ee8-ae34-3d296e1f647f req-ccefbbc9-bfc3-429c-9ad7-b8b78639ff61 service nova] Lock "d5dc789c-b1ee-4ee8-8e2b-9a6cb56a1361-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:42:45 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-bf179c85-1f99-4ee8-ae34-3d296e1f647f req-ccefbbc9-bfc3-429c-9ad7-b8b78639ff61 service nova] Lock "d5dc789c-b1ee-4ee8-8e2b-9a6cb56a1361-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:42:45 user nova-compute[75337]: DEBUG nova.compute.manager [req-bf179c85-1f99-4ee8-ae34-3d296e1f647f req-ccefbbc9-bfc3-429c-9ad7-b8b78639ff61 service nova] [instance: d5dc789c-b1ee-4ee8-8e2b-9a6cb56a1361] No waiting events found dispatching network-vif-unplugged-d4ab286a-0327-4dde-8eda-1c63107a670a {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:42:45 user nova-compute[75337]: DEBUG nova.compute.manager [req-bf179c85-1f99-4ee8-ae34-3d296e1f647f req-ccefbbc9-bfc3-429c-9ad7-b8b78639ff61 service nova] [instance: d5dc789c-b1ee-4ee8-8e2b-9a6cb56a1361] Received event network-vif-unplugged-d4ab286a-0327-4dde-8eda-1c63107a670a for instance with task_state deleting. {{(pid=75337) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 15:42:45 user nova-compute[75337]: DEBUG nova.compute.manager [req-bf179c85-1f99-4ee8-ae34-3d296e1f647f req-ccefbbc9-bfc3-429c-9ad7-b8b78639ff61 service nova] [instance: d5dc789c-b1ee-4ee8-8e2b-9a6cb56a1361] Received event network-vif-plugged-d4ab286a-0327-4dde-8eda-1c63107a670a {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:42:45 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-bf179c85-1f99-4ee8-ae34-3d296e1f647f req-ccefbbc9-bfc3-429c-9ad7-b8b78639ff61 service nova] Acquiring lock "d5dc789c-b1ee-4ee8-8e2b-9a6cb56a1361-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:42:45 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-bf179c85-1f99-4ee8-ae34-3d296e1f647f req-ccefbbc9-bfc3-429c-9ad7-b8b78639ff61 service nova] Lock "d5dc789c-b1ee-4ee8-8e2b-9a6cb56a1361-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:42:45 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-bf179c85-1f99-4ee8-ae34-3d296e1f647f req-ccefbbc9-bfc3-429c-9ad7-b8b78639ff61 service nova] Lock "d5dc789c-b1ee-4ee8-8e2b-9a6cb56a1361-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:42:45 user nova-compute[75337]: DEBUG nova.compute.manager [req-bf179c85-1f99-4ee8-ae34-3d296e1f647f req-ccefbbc9-bfc3-429c-9ad7-b8b78639ff61 service nova] [instance: d5dc789c-b1ee-4ee8-8e2b-9a6cb56a1361] No waiting events found dispatching network-vif-plugged-d4ab286a-0327-4dde-8eda-1c63107a670a {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:42:45 user nova-compute[75337]: WARNING nova.compute.manager [req-bf179c85-1f99-4ee8-ae34-3d296e1f647f req-ccefbbc9-bfc3-429c-9ad7-b8b78639ff61 service nova] [instance: d5dc789c-b1ee-4ee8-8e2b-9a6cb56a1361] Received unexpected event network-vif-plugged-d4ab286a-0327-4dde-8eda-1c63107a670a for instance with vm_state active and task_state deleting.
Nov 06 15:42:45 user nova-compute[75337]: DEBUG nova.compute.manager [req-5110828c-99d8-4cc1-ad80-0ca18ea2c1cc req-da7cd19a-48cb-4aa8-9d46-dcc7d1f5d1b0 service nova] [instance: 8858d90e-ee14-494b-80da-904cd97cdff0] Received event network-vif-plugged-d4c8113e-f11f-442c-bd08-206acb4a0416 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:42:45 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-5110828c-99d8-4cc1-ad80-0ca18ea2c1cc req-da7cd19a-48cb-4aa8-9d46-dcc7d1f5d1b0 service nova] Acquiring lock "8858d90e-ee14-494b-80da-904cd97cdff0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:42:45 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-5110828c-99d8-4cc1-ad80-0ca18ea2c1cc req-da7cd19a-48cb-4aa8-9d46-dcc7d1f5d1b0 service nova] Lock "8858d90e-ee14-494b-80da-904cd97cdff0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:42:45 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-5110828c-99d8-4cc1-ad80-0ca18ea2c1cc req-da7cd19a-48cb-4aa8-9d46-dcc7d1f5d1b0 service nova] Lock "8858d90e-ee14-494b-80da-904cd97cdff0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:42:45 user nova-compute[75337]: DEBUG nova.compute.manager [req-5110828c-99d8-4cc1-ad80-0ca18ea2c1cc req-da7cd19a-48cb-4aa8-9d46-dcc7d1f5d1b0 service nova] [instance: 8858d90e-ee14-494b-80da-904cd97cdff0] No waiting events found dispatching network-vif-plugged-d4c8113e-f11f-442c-bd08-206acb4a0416 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:42:45 user nova-compute[75337]: WARNING nova.compute.manager [req-5110828c-99d8-4cc1-ad80-0ca18ea2c1cc req-da7cd19a-48cb-4aa8-9d46-dcc7d1f5d1b0 service nova] [instance: 8858d90e-ee14-494b-80da-904cd97cdff0] Received unexpected event network-vif-plugged-d4c8113e-f11f-442c-bd08-206acb4a0416 for instance with vm_state active and task_state deleting.
Nov 06 15:42:45 user nova-compute[75337]: DEBUG nova.network.neutron [-] [instance: 8858d90e-ee14-494b-80da-904cd97cdff0] Updating instance_info_cache with network_info: [] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:42:45 user nova-compute[75337]: INFO nova.compute.manager [-] [instance: 8858d90e-ee14-494b-80da-904cd97cdff0] Took 1.67 seconds to deallocate network for instance.
Nov 06 15:42:45 user nova-compute[75337]: DEBUG nova.compute.manager [req-e7447bef-e3b6-4d7d-b3bf-5e9301ce7e7a req-c67fa153-6483-42f3-86bd-e219840001bb service nova] [instance: 8858d90e-ee14-494b-80da-904cd97cdff0] Received event network-vif-deleted-d4c8113e-f11f-442c-bd08-206acb4a0416 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:42:45 user nova-compute[75337]: INFO nova.compute.manager [req-e7447bef-e3b6-4d7d-b3bf-5e9301ce7e7a req-c67fa153-6483-42f3-86bd-e219840001bb service nova] [instance: 8858d90e-ee14-494b-80da-904cd97cdff0] Neutron deleted interface d4c8113e-f11f-442c-bd08-206acb4a0416; detaching it from the instance and deleting it from the info cache
Nov 06 15:42:45 user nova-compute[75337]: DEBUG nova.network.neutron [req-e7447bef-e3b6-4d7d-b3bf-5e9301ce7e7a req-c67fa153-6483-42f3-86bd-e219840001bb service nova] [instance: 8858d90e-ee14-494b-80da-904cd97cdff0] Updating instance_info_cache with network_info: [] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:42:45 user nova-compute[75337]: DEBUG nova.compute.manager [req-e7447bef-e3b6-4d7d-b3bf-5e9301ce7e7a req-c67fa153-6483-42f3-86bd-e219840001bb service nova] [instance: 8858d90e-ee14-494b-80da-904cd97cdff0] Detach interface failed, port_id=d4c8113e-f11f-442c-bd08-206acb4a0416, reason: Instance 8858d90e-ee14-494b-80da-904cd97cdff0 could not be found. {{(pid=75337) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 06 15:42:45 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-c512ac3b-84c4-4a4b-ae48-83e94b9b89b4 tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:42:45 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-c512ac3b-84c4-4a4b-ae48-83e94b9b89b4 tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:42:46 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-c512ac3b-84c4-4a4b-ae48-83e94b9b89b4 tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 15:42:46 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-c512ac3b-84c4-4a4b-ae48-83e94b9b89b4 tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 15:42:46 user nova-compute[75337]: DEBUG nova.network.neutron [-] [instance: d5dc789c-b1ee-4ee8-8e2b-9a6cb56a1361] Updating instance_info_cache with network_info: [] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:42:46 user nova-compute[75337]: DEBUG nova.compute.manager [None req-a28a969b-7c2f-461c-88d0-416acdc664ae tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] [instance: 581cf468-65e7-42e5-9250-c3d645577011] Stashing vm_state: active {{(pid=75337) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 06 15:42:46 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-c512ac3b-84c4-4a4b-ae48-83e94b9b89b4 tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.498s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:42:46 user nova-compute[75337]: INFO nova.compute.manager [-] [instance: d5dc789c-b1ee-4ee8-8e2b-9a6cb56a1361] Took 1.41 seconds to deallocate network for instance.
Nov 06 15:42:46 user nova-compute[75337]: INFO nova.scheduler.client.report [None req-c512ac3b-84c4-4a4b-ae48-83e94b9b89b4 tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] Deleted allocations for instance 8858d90e-ee14-494b-80da-904cd97cdff0
Nov 06 15:42:46 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-a76ce9a5-c542-4515-ac13-d37418b87df6 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:42:46 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-a76ce9a5-c542-4515-ac13-d37418b87df6 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:42:46 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-a28a969b-7c2f-461c-88d0-416acdc664ae tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:42:46 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-c512ac3b-84c4-4a4b-ae48-83e94b9b89b4 tempest-AttachSCSIVolumeTestJSON-2089763587 tempest-AttachSCSIVolumeTestJSON-2089763587-project-member] Lock "8858d90e-ee14-494b-80da-904cd97cdff0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.621s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:42:46 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-a76ce9a5-c542-4515-ac13-d37418b87df6 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 15:42:46 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-a76ce9a5-c542-4515-ac13-d37418b87df6 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 15:42:46 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-a76ce9a5-c542-4515-ac13-d37418b87df6 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.371s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:42:46 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-a28a969b-7c2f-461c-88d0-416acdc664ae tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.330s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:42:46 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-a28a969b-7c2f-461c-88d0-416acdc664ae tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75337) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 15:42:46 user nova-compute[75337]: INFO nova.compute.claims [None req-a28a969b-7c2f-461c-88d0-416acdc664ae tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] [instance: 581cf468-65e7-42e5-9250-c3d645577011] Claim successful on node user
Nov 06 15:42:46 user nova-compute[75337]: INFO nova.scheduler.client.report [None req-a76ce9a5-c542-4515-ac13-d37418b87df6 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Deleted allocations for instance d5dc789c-b1ee-4ee8-8e2b-9a6cb56a1361
Nov 06 15:42:46 user nova-compute[75337]: INFO nova.compute.resource_tracker [None req-a28a969b-7c2f-461c-88d0-416acdc664ae tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] [instance: 581cf468-65e7-42e5-9250-c3d645577011] Updating resource usage from migration bc81b8ec-ec83-4c9d-aa18-aa0e339c5fec
Nov 06 15:42:47 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-a76ce9a5-c542-4515-ac13-d37418b87df6 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Lock "d5dc789c-b1ee-4ee8-8e2b-9a6cb56a1361" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.268s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:42:47 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-a28a969b-7c2f-461c-88d0-416acdc664ae tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 15:42:47 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-a28a969b-7c2f-461c-88d0-416acdc664ae tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 15:42:47 user nova-compute[75337]: DEBUG nova.compute.manager [req-75983cde-0be3-480b-b6c6-2e6e3e2171e2 req-ad8185e2-f75e-4302-a463-066729dd22f2 service nova] [instance: d5dc789c-b1ee-4ee8-8e2b-9a6cb56a1361] Received event network-vif-deleted-d4ab286a-0327-4dde-8eda-1c63107a670a {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:42:47 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-a28a969b-7c2f-461c-88d0-416acdc664ae tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.598s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:42:47 user nova-compute[75337]: INFO nova.compute.manager [None req-a28a969b-7c2f-461c-88d0-416acdc664ae tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] [instance: 581cf468-65e7-42e5-9250-c3d645577011] Migrating
Nov 06 15:42:47 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-a28a969b-7c2f-461c-88d0-416acdc664ae tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 15:42:47 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-a28a969b-7c2f-461c-88d0-416acdc664ae tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Acquired lock "compute-rpcapi-router" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 15:42:47 user nova-compute[75337]: INFO nova.compute.rpcapi [None req-a28a969b-7c2f-461c-88d0-416acdc664ae tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Nov 06 15:42:47 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-a28a969b-7c2f-461c-88d0-416acdc664ae tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Releasing lock "compute-rpcapi-router" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 15:42:47 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-a28a969b-7c2f-461c-88d0-416acdc664ae tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Acquiring lock "refresh_cache-581cf468-65e7-42e5-9250-c3d645577011" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 15:42:47 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-a28a969b-7c2f-461c-88d0-416acdc664ae tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Acquired lock "refresh_cache-581cf468-65e7-42e5-9250-c3d645577011" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 15:42:47 user nova-compute[75337]: DEBUG nova.network.neutron [None req-a28a969b-7c2f-461c-88d0-416acdc664ae tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] [instance: 581cf468-65e7-42e5-9250-c3d645577011] Building network info cache for instance {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 15:42:47 user nova-compute[75337]: DEBUG nova.network.neutron [None req-a28a969b-7c2f-461c-88d0-416acdc664ae tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] [instance: 581cf468-65e7-42e5-9250-c3d645577011] Updating instance_info_cache with network_info: [{"id": "d1c68bac-be37-4645-afcb-2b89f47c1793", "address": "fa:16:3e:00:1c:74", "network": {"id": "2623bcbf-c77c-47b4-abd5-ab538f9a2814", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1497688706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f40165c076e341bba42fb537ce98bbe2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1c68bac-be", "ovs_interfaceid": "d1c68bac-be37-4645-afcb-2b89f47c1793", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:42:47 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-a28a969b-7c2f-461c-88d0-416acdc664ae tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Releasing lock "refresh_cache-581cf468-65e7-42e5-9250-c3d645577011" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 15:42:48 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-a28a969b-7c2f-461c-88d0-416acdc664ae tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] [instance: 581cf468-65e7-42e5-9250-c3d645577011] Starting migrate_disk_and_power_off {{(pid=75337) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 06 15:42:48 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:42:48 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:42:48 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:42:48 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:42:48 user nova-compute[75337]: INFO nova.virt.libvirt.driver [-] [instance: 581cf468-65e7-42e5-9250-c3d645577011] Instance destroyed successfully.
Nov 06 15:42:48 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-a28a969b-7c2f-461c-88d0-416acdc664ae tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T15:37:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-143035342',display_name='tempest-ServerActionsTestOtherB-server-143035342',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-143035342',id=4,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGvgawdpwOKUFbYuIfCQHAYAwMkYeyGp/mWnvHMxoikCW6rq7Lc9iVzhCxfsvGYfdcuDE3wf7kwN77XNEdHIhKuYJC28UJSD4qJahdz/1x3pQWmM3jC4aksXmnaw21FVfw==',key_name='tempest-keypair-1619039595',keypairs=<?>,launch_index=0,launched_at=2023-11-06T15:38:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f40165c076e341bba42fb537ce98bbe2',ramdisk_id='',reservation_id='r-w3wq64j4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-464439480',owner_user_name='tempest-ServerActionsTestOtherB-464439480-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T15:42:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2810a15c1608465aa7465eae455eb5c6',uuid=581cf468-65e7-42e5-9250-c3d645577011,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d1c68bac-be37-4645-afcb-2b89f47c1793", "address": "fa:16:3e:00:1c:74", "network": {"id": "2623bcbf-c77c-47b4-abd5-ab538f9a2814", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1497688706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1497688706-network", "vif_mac": "fa:16:3e:00:1c:74"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f40165c076e341bba42fb537ce98bbe2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1c68bac-be", "ovs_interfaceid": "d1c68bac-be37-4645-afcb-2b89f47c1793", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 15:42:48 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-a28a969b-7c2f-461c-88d0-416acdc664ae tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Converting VIF {"id": "d1c68bac-be37-4645-afcb-2b89f47c1793", "address": "fa:16:3e:00:1c:74", "network": {"id": "2623bcbf-c77c-47b4-abd5-ab538f9a2814", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1497688706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1497688706-network", "vif_mac": "fa:16:3e:00:1c:74"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f40165c076e341bba42fb537ce98bbe2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1c68bac-be", "ovs_interfaceid": "d1c68bac-be37-4645-afcb-2b89f47c1793", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 15:42:48 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-a28a969b-7c2f-461c-88d0-416acdc664ae tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:00:1c:74,bridge_name='br-int',has_traffic_filtering=True,id=d1c68bac-be37-4645-afcb-2b89f47c1793,network=Network(2623bcbf-c77c-47b4-abd5-ab538f9a2814),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1c68bac-be') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 15:42:48 user nova-compute[75337]: DEBUG os_vif [None req-a28a969b-7c2f-461c-88d0-416acdc664ae tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:00:1c:74,bridge_name='br-int',has_traffic_filtering=True,id=d1c68bac-be37-4645-afcb-2b89f47c1793,network=Network(2623bcbf-c77c-47b4-abd5-ab538f9a2814),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1c68bac-be') {{(pid=75337) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 15:42:48 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:42:48 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd1c68bac-be, bridge=br-int, if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:42:48 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:42:48 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:42:48 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:42:48 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:42:48 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b6f956a3-6706-444c-9205-9ac10f27677b) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:42:48 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:42:48 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:42:48 user nova-compute[75337]: INFO os_vif [None req-a28a969b-7c2f-461c-88d0-416acdc664ae tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:00:1c:74,bridge_name='br-int',has_traffic_filtering=True,id=d1c68bac-be37-4645-afcb-2b89f47c1793,network=Network(2623bcbf-c77c-47b4-abd5-ab538f9a2814),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1c68bac-be')
Nov 06 15:42:48 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a28a969b-7c2f-461c-88d0-416acdc664ae tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] [instance: 581cf468-65e7-42e5-9250-c3d645577011] calling os-brick to detach iSCSI Volume {{(pid=75337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 15:42:48 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-a28a969b-7c2f-461c-88d0-416acdc664ae tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2abc33d0c0>, {'target_iqn': 'iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XMEQSsAU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 15:42:48 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-a28a969b-7c2f-461c-88d0-416acdc664ae tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 15:42:48 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-a28a969b-7c2f-461c-88d0-416acdc664ae tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 15:42:48 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-a28a969b-7c2f-461c-88d0-416acdc664ae tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 15:42:48 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:42:48 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:42:48 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[3000a4ec-3ba8-4ac5-8e56-12e3d7e24c40]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:eaf5fc54-be7c-4748-9e2f-12a01971e6f4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0ad85d1f-7027-4997-96c4-991e3969067d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4367fb98-2ae9-40c3-a2d0-6e9b0f70dc7c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:42:48 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-a28a969b-7c2f-461c-88d0-416acdc664ae tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 15:42:48 user nova-compute[75337]: No targets found.
Nov 06 15:42:48 user nova-compute[75337]: iSNS:
Nov 06 15:42:48 user nova-compute[75337]: No targets found.
Nov 06 15:42:48 user nova-compute[75337]: STATIC:
Nov 06 15:42:48 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e
Nov 06 15:42:48 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 15:42:48 user nova-compute[75337]:                 Iface Name: default
Nov 06 15:42:48 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:eaf5fc54-be7c-4748-9e2f-12a01971e6f4
Nov 06 15:42:48 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 15:42:48 user nova-compute[75337]:                 Iface Name: default
Nov 06 15:42:48 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:0ad85d1f-7027-4997-96c4-991e3969067d
Nov 06 15:42:48 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 15:42:48 user nova-compute[75337]:                 Iface Name: default
Nov 06 15:42:48 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158
Nov 06 15:42:48 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 15:42:48 user nova-compute[75337]:                 Iface Name: default
Nov 06 15:42:48 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759
Nov 06 15:42:48 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 15:42:48 user nova-compute[75337]:                 Iface Name: default
Nov 06 15:42:48 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:4367fb98-2ae9-40c3-a2d0-6e9b0f70dc7c
Nov 06 15:42:48 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 15:42:48 user nova-compute[75337]:                 Iface Name: default
Nov 06 15:42:48 user nova-compute[75337]: FIRMWARE:
Nov 06 15:42:48 user nova-compute[75337]: No targets found.
Nov 06 15:42:48 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 15:42:48 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-a28a969b-7c2f-461c-88d0-416acdc664ae tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 15:42:48 user nova-compute[75337]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 15:42:48 user nova-compute[75337]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75337) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 15:42:48 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-a28a969b-7c2f-461c-88d0-416acdc664ae tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e', 0)] {{(pid=75337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 15:42:48 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:42:48 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:42:48 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5f41347-3295-434e-b16b-6bf99ac4b1b3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ad85d1f-7027-4997-96c4-991e3969067d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4367fb98-2ae9-40c3-a2d0-6e9b0f70dc7c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eaf5fc54-be7c-4748-9e2f-12a01971e6f4\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:42:48 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:42:48 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:42:48 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e5f7e36-4966-4fba-9223-08446936d9f7]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4367fb98-2ae9-40c3-a2d0-6e9b0f70dc7c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ad85d1f-7027-4997-96c4-991e3969067d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaf5fc54-be7c-4748-9e2f-12a01971e6f4 (non-flash)\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:42:48 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-a28a969b-7c2f-461c-88d0-416acdc664ae tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)
Nov 06 15:42:48 user nova-compute[75337]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e (non-flash)
Nov 06 15:42:48 user nova-compute[75337]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759 (non-flash)
Nov 06 15:42:48 user nova-compute[75337]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4367fb98-2ae9-40c3-a2d0-6e9b0f70dc7c (non-flash)
Nov 06 15:42:48 user nova-compute[75337]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ad85d1f-7027-4997-96c4-991e3969067d (non-flash)
Nov 06 15:42:48 user nova-compute[75337]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaf5fc54-be7c-4748-9e2f-12a01971e6f4 (non-flash)
Nov 06 15:42:48 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 15:42:48 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-a28a969b-7c2f-461c-88d0-416acdc664ae tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)
Nov 06 15:42:48 user nova-compute[75337]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e (non-flash)
Nov 06 15:42:48 user nova-compute[75337]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759 (non-flash)
Nov 06 15:42:48 user nova-compute[75337]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4367fb98-2ae9-40c3-a2d0-6e9b0f70dc7c (non-flash)
Nov 06 15:42:48 user nova-compute[75337]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ad85d1f-7027-4997-96c4-991e3969067d (non-flash)
Nov 06 15:42:48 user nova-compute[75337]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaf5fc54-be7c-4748-9e2f-12a01971e6f4 (non-flash)
Nov 06 15:42:48 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 15:42:48 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-a28a969b-7c2f-461c-88d0-416acdc664ae tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2abc533760>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e'): ({'sde'}, set())}) {{(pid=75337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 15:42:48 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-a28a969b-7c2f-461c-88d0-416acdc664ae tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Removing single pathed devices sde {{(pid=75337) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 15:42:48 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:42:49 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:42:49 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d3fb419-d7d7-407d-be7b-1cddf55f53ce]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:42:49 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:42:49 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:42:49 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2b10daa-ef38-46a7-abfa-b884a78f45c6]: (4, ('ok\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:42:49 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-a28a969b-7c2f-461c-88d0-416acdc664ae tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Flushing IO for device /dev/sde {{(pid=75337) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 15:42:49 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:42:49 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:42:49 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[120349d0-8c52-4fe1-9480-a7926a9d6b8e]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:42:49 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-a28a969b-7c2f-461c-88d0-416acdc664ae tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75337) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 15:42:49 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:42:49 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.046s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:42:49 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec0da715-1ce6-40e5-b01d-90d417a75b30]: (4, ('1', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:42:49 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-a28a969b-7c2f-461c-88d0-416acdc664ae tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 15:42:49 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-a28a969b-7c2f-461c-88d0-416acdc664ae tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] SCSI volumes sde have been removed. {{(pid=75337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 15:42:49 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-a28a969b-7c2f-461c-88d0-416acdc664ae tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e')] {{(pid=75337) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 15:42:49 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:42:49 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:42:49 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[e944b05f-c2d0-401b-b217-847a0fd23efe]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:42:49 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-a28a969b-7c2f-461c-88d0-416acdc664ae tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:42:49 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e -p 172.16.0.220:3260 --logout {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:42:49 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:42:49 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[39be4d81-eb05-4cee-b782-2f9564f7783c]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:42:49 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-a28a969b-7c2f-461c-88d0-416acdc664ae tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e, portal: 172.16.0.220,3260]
Nov 06 15:42:49 user nova-compute[75337]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e, portal: 172.16.0.220,3260] successful.
Nov 06 15:42:49 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:42:49 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e -p 172.16.0.220:3260 --op delete {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:42:49 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:42:49 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[4588500d-1cba-4e90-b7d7-d6c47673ac39]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:42:49 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-a28a969b-7c2f-461c-88d0-416acdc664ae tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:42:49 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-a28a969b-7c2f-461c-88d0-416acdc664ae tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.344s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 15:42:49 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-a28a969b-7c2f-461c-88d0-416acdc664ae tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] <== disconnect_volume: return (345ms) None {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 15:42:49 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a28a969b-7c2f-461c-88d0-416acdc664ae tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] [instance: 581cf468-65e7-42e5-9250-c3d645577011] Disconnected iSCSI Volume {{(pid=75337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 15:42:49 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-a28a969b-7c2f-461c-88d0-416acdc664ae tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/581cf468-65e7-42e5-9250-c3d645577011/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:42:49 user nova-compute[75337]: DEBUG nova.compute.manager [req-0d2342e5-afa6-49b2-8193-8dd41215e9e9 req-22bf29d8-660a-4383-8db4-29c4cbab561c service nova] [instance: 581cf468-65e7-42e5-9250-c3d645577011] Received event network-vif-unplugged-d1c68bac-be37-4645-afcb-2b89f47c1793 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:42:49 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-0d2342e5-afa6-49b2-8193-8dd41215e9e9 req-22bf29d8-660a-4383-8db4-29c4cbab561c service nova] Acquiring lock "581cf468-65e7-42e5-9250-c3d645577011-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:42:49 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-0d2342e5-afa6-49b2-8193-8dd41215e9e9 req-22bf29d8-660a-4383-8db4-29c4cbab561c service nova] Lock "581cf468-65e7-42e5-9250-c3d645577011-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:42:49 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-0d2342e5-afa6-49b2-8193-8dd41215e9e9 req-22bf29d8-660a-4383-8db4-29c4cbab561c service nova] Lock "581cf468-65e7-42e5-9250-c3d645577011-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:42:49 user nova-compute[75337]: DEBUG nova.compute.manager [req-0d2342e5-afa6-49b2-8193-8dd41215e9e9 req-22bf29d8-660a-4383-8db4-29c4cbab561c service nova] [instance: 581cf468-65e7-42e5-9250-c3d645577011] No waiting events found dispatching network-vif-unplugged-d1c68bac-be37-4645-afcb-2b89f47c1793 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:42:49 user nova-compute[75337]: WARNING nova.compute.manager [req-0d2342e5-afa6-49b2-8193-8dd41215e9e9 req-22bf29d8-660a-4383-8db4-29c4cbab561c service nova] [instance: 581cf468-65e7-42e5-9250-c3d645577011] Received unexpected event network-vif-unplugged-d1c68bac-be37-4645-afcb-2b89f47c1793 for instance with vm_state active and task_state resize_migrating.
Nov 06 15:42:49 user nova-compute[75337]: DEBUG nova.compute.manager [req-0d2342e5-afa6-49b2-8193-8dd41215e9e9 req-22bf29d8-660a-4383-8db4-29c4cbab561c service nova] [instance: 581cf468-65e7-42e5-9250-c3d645577011] Received event network-vif-plugged-d1c68bac-be37-4645-afcb-2b89f47c1793 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:42:49 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-0d2342e5-afa6-49b2-8193-8dd41215e9e9 req-22bf29d8-660a-4383-8db4-29c4cbab561c service nova] Acquiring lock "581cf468-65e7-42e5-9250-c3d645577011-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:42:49 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-0d2342e5-afa6-49b2-8193-8dd41215e9e9 req-22bf29d8-660a-4383-8db4-29c4cbab561c service nova] Lock "581cf468-65e7-42e5-9250-c3d645577011-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:42:49 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-0d2342e5-afa6-49b2-8193-8dd41215e9e9 req-22bf29d8-660a-4383-8db4-29c4cbab561c service nova] Lock "581cf468-65e7-42e5-9250-c3d645577011-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:42:49 user nova-compute[75337]: DEBUG nova.compute.manager [req-0d2342e5-afa6-49b2-8193-8dd41215e9e9 req-22bf29d8-660a-4383-8db4-29c4cbab561c service nova] [instance: 581cf468-65e7-42e5-9250-c3d645577011] No waiting events found dispatching network-vif-plugged-d1c68bac-be37-4645-afcb-2b89f47c1793 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:42:49 user nova-compute[75337]: WARNING nova.compute.manager [req-0d2342e5-afa6-49b2-8193-8dd41215e9e9 req-22bf29d8-660a-4383-8db4-29c4cbab561c service nova] [instance: 581cf468-65e7-42e5-9250-c3d645577011] Received unexpected event network-vif-plugged-d1c68bac-be37-4645-afcb-2b89f47c1793 for instance with vm_state active and task_state resize_migrating.
Nov 06 15:42:49 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-a28a969b-7c2f-461c-88d0-416acdc664ae tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/581cf468-65e7-42e5-9250-c3d645577011/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:42:49 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-a28a969b-7c2f-461c-88d0-416acdc664ae tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/581cf468-65e7-42e5-9250-c3d645577011/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:42:49 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-a28a969b-7c2f-461c-88d0-416acdc664ae tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/581cf468-65e7-42e5-9250-c3d645577011/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:42:49 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-a28a969b-7c2f-461c-88d0-416acdc664ae tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 15:42:49 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-a28a969b-7c2f-461c-88d0-416acdc664ae tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/581cf468-65e7-42e5-9250-c3d645577011_resize/disk /opt/stack/data/nova/instances/581cf468-65e7-42e5-9250-c3d645577011/disk {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:42:50 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-a28a969b-7c2f-461c-88d0-416acdc664ae tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] CMD "cp -r /opt/stack/data/nova/instances/581cf468-65e7-42e5-9250-c3d645577011_resize/disk /opt/stack/data/nova/instances/581cf468-65e7-42e5-9250-c3d645577011/disk" returned: 0 in 0.522s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:42:50 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-a28a969b-7c2f-461c-88d0-416acdc664ae tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/581cf468-65e7-42e5-9250-c3d645577011_resize/disk.info /opt/stack/data/nova/instances/581cf468-65e7-42e5-9250-c3d645577011/disk.info {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:42:50 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-a28a969b-7c2f-461c-88d0-416acdc664ae tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] CMD "cp -r /opt/stack/data/nova/instances/581cf468-65e7-42e5-9250-c3d645577011_resize/disk.info /opt/stack/data/nova/instances/581cf468-65e7-42e5-9250-c3d645577011/disk.info" returned: 0 in 0.039s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:42:51 user nova-compute[75337]: DEBUG nova.network.neutron [None req-a28a969b-7c2f-461c-88d0-416acdc664ae tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] [instance: 581cf468-65e7-42e5-9250-c3d645577011] Port d1c68bac-be37-4645-afcb-2b89f47c1793 binding to destination host user is already ACTIVE {{(pid=75337) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 06 15:42:51 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-a28a969b-7c2f-461c-88d0-416acdc664ae tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Acquiring lock "581cf468-65e7-42e5-9250-c3d645577011-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:42:51 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-a28a969b-7c2f-461c-88d0-416acdc664ae tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Lock "581cf468-65e7-42e5-9250-c3d645577011-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:42:51 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-a28a969b-7c2f-461c-88d0-416acdc664ae tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Lock "581cf468-65e7-42e5-9250-c3d645577011-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:42:51 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-a28a969b-7c2f-461c-88d0-416acdc664ae tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Acquiring lock "refresh_cache-581cf468-65e7-42e5-9250-c3d645577011" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 15:42:51 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-a28a969b-7c2f-461c-88d0-416acdc664ae tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Acquired lock "refresh_cache-581cf468-65e7-42e5-9250-c3d645577011" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 15:42:51 user nova-compute[75337]: DEBUG nova.network.neutron [None req-a28a969b-7c2f-461c-88d0-416acdc664ae tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] [instance: 581cf468-65e7-42e5-9250-c3d645577011] Building network info cache for instance {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 15:42:51 user nova-compute[75337]: DEBUG nova.network.neutron [None req-a28a969b-7c2f-461c-88d0-416acdc664ae tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] [instance: 581cf468-65e7-42e5-9250-c3d645577011] Updating instance_info_cache with network_info: [{"id": "d1c68bac-be37-4645-afcb-2b89f47c1793", "address": "fa:16:3e:00:1c:74", "network": {"id": "2623bcbf-c77c-47b4-abd5-ab538f9a2814", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1497688706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f40165c076e341bba42fb537ce98bbe2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1c68bac-be", "ovs_interfaceid": "d1c68bac-be37-4645-afcb-2b89f47c1793", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:42:51 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-a28a969b-7c2f-461c-88d0-416acdc664ae tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Releasing lock "refresh_cache-581cf468-65e7-42e5-9250-c3d645577011" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 15:42:52 user nova-compute[75337]: DEBUG os_brick.utils [None req-a28a969b-7c2f-461c-88d0-416acdc664ae tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 15:42:52 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:42:52 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:42:52 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f0a59ea-0305-4471-90a3-0610fc699195]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4ff6411e45b8\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:42:52 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:42:52 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:42:52 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd2ed6df-a7f0-441e-ab7d-66329587d519]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:42:52 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:42:52 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:42:52 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3f99e1a-eb9c-461c-bc94-6e887b02791b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:42:52 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d961afd-40e4-43cf-b1c5-77546970d00c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:42:52 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-a28a969b-7c2f-461c-88d0-416acdc664ae tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Running cmd (subprocess): nvme version {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:42:52 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-a28a969b-7c2f-461c-88d0-416acdc664ae tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] 'nvme version' failed. Not Retrying. {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 15:42:52 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a28a969b-7c2f-461c-88d0-416acdc664ae tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] nvme not present on system {{(pid=75337) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 15:42:52 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:42:52 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 15:42:52 user nova-compute[75337]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 15:42:52 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b53d830-5e37-4cce-aa32-352da267fbb2]: (4, '') {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:42:52 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.lightos [None req-a28a969b-7c2f-461c-88d0-416acdc664ae tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75337) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 15:42:52 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.lightos [None req-a28a969b-7c2f-461c-88d0-416acdc664ae tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 15:42:52 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.lightos [None req-a28a969b-7c2f-461c-88d0-416acdc664ae tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] LIGHTOS: no hostnqn found. {{(pid=75337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 15:42:52 user nova-compute[75337]: DEBUG os_brick.utils [None req-a28a969b-7c2f-461c-88d0-416acdc664ae tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4ff6411e45b8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 15:42:53 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:42:58 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:43:03 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:43:05 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:43:05 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:43:05 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Starting heal instance info cache {{(pid=75337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 15:43:05 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] [instance: 8a600bd8-b94a-4242-a443-c2defb002280] Skipping network cache update for instance because it has been migrated to another host. {{(pid=75337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9966}}
Nov 06 15:43:05 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "refresh_cache-dfadb21f-5ed1-42f4-956b-95cccf128b6a" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 15:43:05 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquired lock "refresh_cache-dfadb21f-5ed1-42f4-956b-95cccf128b6a" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 15:43:05 user nova-compute[75337]: DEBUG nova.network.neutron [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] [instance: dfadb21f-5ed1-42f4-956b-95cccf128b6a] Forcefully refreshing network info cache for instance {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 15:43:05 user nova-compute[75337]: DEBUG nova.network.neutron [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] [instance: dfadb21f-5ed1-42f4-956b-95cccf128b6a] Updating instance_info_cache with network_info: [{"id": "8592b366-9f21-4d92-b297-8872d9a7110f", "address": "fa:16:3e:f8:26:1d", "network": {"id": "48f1545d-7e80-462f-9dbf-f1102ddcda9a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1210368397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1013e7afbefd4146a3be04587710b1de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8592b366-9f", "ovs_interfaceid": "8592b366-9f21-4d92-b297-8872d9a7110f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:43:05 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Releasing lock "refresh_cache-dfadb21f-5ed1-42f4-956b-95cccf128b6a" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 15:43:05 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] [instance: dfadb21f-5ed1-42f4-956b-95cccf128b6a] Updated the network info_cache for instance {{(pid=75337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 15:43:05 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:43:05 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:43:05 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:43:05 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:43:05 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:43:05 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:43:05 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75337) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 15:43:05 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager.update_available_resource {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:43:05 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:43:05 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:43:05 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:43:05 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Auditing locally available compute resources for user (node: user) {{(pid=75337) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 15:43:05 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/581cf468-65e7-42e5-9250-c3d645577011/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:43:06 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/581cf468-65e7-42e5-9250-c3d645577011/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:43:06 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/581cf468-65e7-42e5-9250-c3d645577011/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:43:06 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/581cf468-65e7-42e5-9250-c3d645577011/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:43:06 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 15:43:06 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8cf1ead-a87c-459c-b914-a0e976c9e464/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:43:06 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8cf1ead-a87c-459c-b914-a0e976c9e464/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:43:06 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8cf1ead-a87c-459c-b914-a0e976c9e464/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:43:06 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8cf1ead-a87c-459c-b914-a0e976c9e464/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:43:06 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76ee582b-b887-4d46-8c78-29f42d1a0d26/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:43:06 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76ee582b-b887-4d46-8c78-29f42d1a0d26/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:43:06 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76ee582b-b887-4d46-8c78-29f42d1a0d26/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:43:07 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76ee582b-b887-4d46-8c78-29f42d1a0d26/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:43:07 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfadb21f-5ed1-42f4-956b-95cccf128b6a/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:43:07 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfadb21f-5ed1-42f4-956b-95cccf128b6a/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:43:07 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfadb21f-5ed1-42f4-956b-95cccf128b6a/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:43:07 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfadb21f-5ed1-42f4-956b-95cccf128b6a/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:43:07 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 15:43:07 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 15:43:07 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 15:43:07 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=75337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 15:43:07 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:43:07 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:43:07 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:43:07 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:43:07 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83516ff5-c4e7-4e91-a2f9-8af9b51cf475/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:43:07 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83516ff5-c4e7-4e91-a2f9-8af9b51cf475/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:43:07 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83516ff5-c4e7-4e91-a2f9-8af9b51cf475/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:43:08 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83516ff5-c4e7-4e91-a2f9-8af9b51cf475/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:43:08 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 15:43:08 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 15:43:08 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 15:43:08 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Hypervisor/Node resource view: name=user free_ram=8073MB free_disk=25.35892105102539GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75337) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 15:43:08 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:43:08 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:43:08 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Applying migration context for instance 581cf468-65e7-42e5-9250-c3d645577011 as it has an incoming, in-progress migration bc81b8ec-ec83-4c9d-aa18-aa0e339c5fec. Migration status is post-migrating {{(pid=75337) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 06 15:43:08 user nova-compute[75337]: INFO nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] [instance: 581cf468-65e7-42e5-9250-c3d645577011] Updating resource usage from migration bc81b8ec-ec83-4c9d-aa18-aa0e339c5fec
Nov 06 15:43:08 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 83516ff5-c4e7-4e91-a2f9-8af9b51cf475 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:43:08 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance c8cf1ead-a87c-459c-b914-a0e976c9e464 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:43:08 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance dfadb21f-5ed1-42f4-956b-95cccf128b6a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:43:08 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:43:08 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 76ee582b-b887-4d46-8c78-29f42d1a0d26 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:43:08 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:43:08 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 1fa4c927-7485-4f34-94bd-9e20358904b6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:43:08 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 8a600bd8-b94a-4242-a443-c2defb002280 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 06 15:43:08 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Migration bc81b8ec-ec83-4c9d-aa18-aa0e339c5fec is active on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 06 15:43:08 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 581cf468-65e7-42e5-9250-c3d645577011 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:43:08 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 15:43:08 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=26GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 15:43:08 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:43:09 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 15:43:09 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 15:43:09 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Compute_service record updated for user:user {{(pid=75337) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 15:43:09 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.545s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:43:13 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:43:13 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:43:13 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75337) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 15:43:13 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 15:43:13 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 15:43:13 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:43:15 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-a28a969b-7c2f-461c-88d0-416acdc664ae tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] [instance: 581cf468-65e7-42e5-9250-c3d645577011] Starting finish_migration {{(pid=75337) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Nov 06 15:43:15 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-a28a969b-7c2f-461c-88d0-416acdc664ae tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] [instance: 581cf468-65e7-42e5-9250-c3d645577011] Instance directory exists: not creating {{(pid=75337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 06 15:43:15 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-a28a969b-7c2f-461c-88d0-416acdc664ae tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] [instance: 581cf468-65e7-42e5-9250-c3d645577011] Creating image(s)
Nov 06 15:43:15 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-a28a969b-7c2f-461c-88d0-416acdc664ae tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:43:15 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-a28a969b-7c2f-461c-88d0-416acdc664ae tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json" returned: 0 in 0.177s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:43:15 user nova-compute[75337]: DEBUG nova.virt.disk.api [None req-a28a969b-7c2f-461c-88d0-416acdc664ae tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Checking if we can resize image /opt/stack/data/nova/instances/581cf468-65e7-42e5-9250-c3d645577011/disk. size=21474836480 {{(pid=75337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 15:43:15 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-a28a969b-7c2f-461c-88d0-416acdc664ae tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/581cf468-65e7-42e5-9250-c3d645577011/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:43:15 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-e256cf44-82d9-46b3-9516-a7f36a8f2eef tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] Acquiring lock "76ee582b-b887-4d46-8c78-29f42d1a0d26" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:43:15 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-e256cf44-82d9-46b3-9516-a7f36a8f2eef tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] Lock "76ee582b-b887-4d46-8c78-29f42d1a0d26" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:43:15 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-e256cf44-82d9-46b3-9516-a7f36a8f2eef tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] Acquiring lock "76ee582b-b887-4d46-8c78-29f42d1a0d26-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:43:15 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-e256cf44-82d9-46b3-9516-a7f36a8f2eef tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] Lock "76ee582b-b887-4d46-8c78-29f42d1a0d26-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:43:15 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-e256cf44-82d9-46b3-9516-a7f36a8f2eef tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] Lock "76ee582b-b887-4d46-8c78-29f42d1a0d26-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:43:15 user nova-compute[75337]: INFO nova.compute.manager [None req-e256cf44-82d9-46b3-9516-a7f36a8f2eef tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] [instance: 76ee582b-b887-4d46-8c78-29f42d1a0d26] Terminating instance
Nov 06 15:43:15 user nova-compute[75337]: DEBUG nova.compute.manager [None req-e256cf44-82d9-46b3-9516-a7f36a8f2eef tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] [instance: 76ee582b-b887-4d46-8c78-29f42d1a0d26] Start destroying the instance on the hypervisor. {{(pid=75337) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 15:43:15 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-a28a969b-7c2f-461c-88d0-416acdc664ae tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/581cf468-65e7-42e5-9250-c3d645577011/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:43:15 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-a28a969b-7c2f-461c-88d0-416acdc664ae tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/581cf468-65e7-42e5-9250-c3d645577011/disk 21474836480 {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:43:15 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:43:15 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-a28a969b-7c2f-461c-88d0-416acdc664ae tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/581cf468-65e7-42e5-9250-c3d645577011/disk 21474836480" returned: 0 in 0.059s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:43:15 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:43:15 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-a28a969b-7c2f-461c-88d0-416acdc664ae tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] [instance: 581cf468-65e7-42e5-9250-c3d645577011] Did not create local disks {{(pid=75337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 06 15:43:15 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-a28a969b-7c2f-461c-88d0-416acdc664ae tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] [instance: 581cf468-65e7-42e5-9250-c3d645577011] Ensure instance console log exists: /opt/stack/data/nova/instances/581cf468-65e7-42e5-9250-c3d645577011/console.log {{(pid=75337) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 15:43:15 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-a28a969b-7c2f-461c-88d0-416acdc664ae tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:43:15 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-a28a969b-7c2f-461c-88d0-416acdc664ae tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:43:15 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-a28a969b-7c2f-461c-88d0-416acdc664ae tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:43:15 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-a28a969b-7c2f-461c-88d0-416acdc664ae tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] [instance: 581cf468-65e7-42e5-9250-c3d645577011] Start _get_guest_xml network_info=[{"id": "d1c68bac-be37-4645-afcb-2b89f47c1793", "address": "fa:16:3e:00:1c:74", "network": {"id": "2623bcbf-c77c-47b4-abd5-ab538f9a2814", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1497688706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1497688706-network", "vif_mac": "fa:16:3e:00:1c:74"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f40165c076e341bba42fb537ce98bbe2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1c68bac-be", "ovs_interfaceid": "d1c68bac-be37-4645-afcb-2b89f47c1793", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T15:34:14Z,direct_url=<?>,disk_format='qcow2',id=16b903ae-a40f-41a7-985b-4804cce92c62,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6549a15819f1469bbd5eeae8190e3d44',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T15:34:15Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'guest_format': None, 'size': 0, 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '16b903ae-a40f-41a7-985b-4804cce92c62'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'attachment_id': 'e57685f9-df04-4eea-8074-098d6b24b122', 'guest_format': None, 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XMEQSsAU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '581cf468-65e7-42e5-9250-c3d645577011', 'attached_at': '2023-11-06T15:43:15.000000', 'detached_at': '', 'volume_id': '84119968-a048-41d8-9688-39c01b5f860e', 'serial': '84119968-a048-41d8-9688-39c01b5f860e'}, 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=75337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 15:43:15 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:43:15 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-a28a969b-7c2f-461c-88d0-416acdc664ae tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 15:43:15 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-a28a969b-7c2f-461c-88d0-416acdc664ae tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 15:43:16 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-a28a969b-7c2f-461c-88d0-416acdc664ae tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 15:43:16 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-a28a969b-7c2f-461c-88d0-416acdc664ae tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] CPU controller missing on host. {{(pid=75337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 15:43:16 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-a28a969b-7c2f-461c-88d0-416acdc664ae tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 15:43:16 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-a28a969b-7c2f-461c-88d0-416acdc664ae tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] CPU controller found on host. {{(pid=75337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 15:43:16 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-a28a969b-7c2f-461c-88d0-416acdc664ae tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75337) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 15:43:16 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-a28a969b-7c2f-461c-88d0-416acdc664ae tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T15:34:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T15:34:14Z,direct_url=<?>,disk_format='qcow2',id=16b903ae-a40f-41a7-985b-4804cce92c62,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6549a15819f1469bbd5eeae8190e3d44',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T15:34:15Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 15:43:16 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-a28a969b-7c2f-461c-88d0-416acdc664ae tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Flavor limits 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 15:43:16 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-a28a969b-7c2f-461c-88d0-416acdc664ae tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Image limits 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 15:43:16 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-a28a969b-7c2f-461c-88d0-416acdc664ae tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Flavor pref 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 15:43:16 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-a28a969b-7c2f-461c-88d0-416acdc664ae tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Image pref 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 15:43:16 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-a28a969b-7c2f-461c-88d0-416acdc664ae tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 15:43:16 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-a28a969b-7c2f-461c-88d0-416acdc664ae tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 15:43:16 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-a28a969b-7c2f-461c-88d0-416acdc664ae tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 15:43:16 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-a28a969b-7c2f-461c-88d0-416acdc664ae tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Got 1 possible topologies {{(pid=75337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 15:43:16 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-a28a969b-7c2f-461c-88d0-416acdc664ae tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 15:43:16 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-a28a969b-7c2f-461c-88d0-416acdc664ae tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 15:43:16 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a28a969b-7c2f-461c-88d0-416acdc664ae tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] [instance: 581cf468-65e7-42e5-9250-c3d645577011] Calling os-brick to attach iSCSI Volume {{(pid=75337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 15:43:16 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-a28a969b-7c2f-461c-88d0-416acdc664ae tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2abc33d0c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XMEQSsAU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 15:43:16 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-a28a969b-7c2f-461c-88d0-416acdc664ae tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 15:43:16 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-a28a969b-7c2f-461c-88d0-416acdc664ae tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 15:43:16 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-a28a969b-7c2f-461c-88d0-416acdc664ae tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 15:43:16 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-a28a969b-7c2f-461c-88d0-416acdc664ae tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 15:43:16 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-a28a969b-7c2f-461c-88d0-416acdc664ae tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 15:43:16 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-a28a969b-7c2f-461c-88d0-416acdc664ae tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 15:43:16 user nova-compute[75337]: INFO os_brick.initiator.connectors.iscsi [None req-a28a969b-7c2f-461c-88d0-416acdc664ae tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 15:43:16 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e -p 172.16.0.220:3260 {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:43:16 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:43:16 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[af99a131-c348-4231-ac83-2d25d74fa3e3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:43:16 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-a28a969b-7c2f-461c-88d0-416acdc664ae tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 15:43:16 user nova-compute[75337]:  {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:43:16 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e -p 172.16.0.220:3260 --interface default --op new {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:43:16 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:43:16 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[364b1cc5-676e-4de1-bcaa-90956e7428f7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e] added\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:43:16 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-a28a969b-7c2f-461c-88d0-416acdc664ae tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e] added
Nov 06 15:43:16 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:43:16 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:43:16 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:43:16 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[81d38629-5268-4337-9f91-10c43e36295d]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:43:16 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-a28a969b-7c2f-461c-88d0-416acdc664ae tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:43:16 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:43:16 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:43:16 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[19ee1aed-4e15-4c77-9469-d8a4c4f0a133]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:43:16 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-a28a969b-7c2f-461c-88d0-416acdc664ae tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:43:16 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XMEQSsAU {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:43:16 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XMEQSsAU" returned: 0 in 0.031s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:43:16 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[a871d713-b06e-4372-b67a-92add47e59b9]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:43:16 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-a28a969b-7c2f-461c-88d0-416acdc664ae tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XMEQSsAU'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:43:16 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:43:16 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.030s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:43:16 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb1ef8cb-415b-4d74-9d40-4a49de103c0f]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:43:16 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-a28a969b-7c2f-461c-88d0-416acdc664ae tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:43:16 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:43:16 user nova-compute[75337]: DEBUG nova.compute.manager [req-4e51ace7-3b36-4e5c-b883-56e9079f2ee0 req-d0c4f91b-a1da-481c-ac70-cdbaf344dc20 service nova] [instance: 76ee582b-b887-4d46-8c78-29f42d1a0d26] Received event network-vif-unplugged-8d52e5d0-96a2-44ca-9968-9ac564aeff2c {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:43:16 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-4e51ace7-3b36-4e5c-b883-56e9079f2ee0 req-d0c4f91b-a1da-481c-ac70-cdbaf344dc20 service nova] Acquiring lock "76ee582b-b887-4d46-8c78-29f42d1a0d26-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:43:16 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-4e51ace7-3b36-4e5c-b883-56e9079f2ee0 req-d0c4f91b-a1da-481c-ac70-cdbaf344dc20 service nova] Lock "76ee582b-b887-4d46-8c78-29f42d1a0d26-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:43:16 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-4e51ace7-3b36-4e5c-b883-56e9079f2ee0 req-d0c4f91b-a1da-481c-ac70-cdbaf344dc20 service nova] Lock "76ee582b-b887-4d46-8c78-29f42d1a0d26-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:43:16 user nova-compute[75337]: DEBUG nova.compute.manager [req-4e51ace7-3b36-4e5c-b883-56e9079f2ee0 req-d0c4f91b-a1da-481c-ac70-cdbaf344dc20 service nova] [instance: 76ee582b-b887-4d46-8c78-29f42d1a0d26] No waiting events found dispatching network-vif-unplugged-8d52e5d0-96a2-44ca-9968-9ac564aeff2c {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:43:16 user nova-compute[75337]: DEBUG nova.compute.manager [req-4e51ace7-3b36-4e5c-b883-56e9079f2ee0 req-d0c4f91b-a1da-481c-ac70-cdbaf344dc20 service nova] [instance: 76ee582b-b887-4d46-8c78-29f42d1a0d26] Received event network-vif-unplugged-8d52e5d0-96a2-44ca-9968-9ac564aeff2c for instance with task_state deleting. {{(pid=75337) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 15:43:16 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:43:16 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e126718-170d-410f-9a2c-355f06a6cda7]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4367fb98-2ae9-40c3-a2d0-6e9b0f70dc7c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ad85d1f-7027-4997-96c4-991e3969067d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaf5fc54-be7c-4748-9e2f-12a01971e6f4 (non-flash)\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:43:16 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-a28a969b-7c2f-461c-88d0-416acdc664ae tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)
Nov 06 15:43:16 user nova-compute[75337]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759 (non-flash)
Nov 06 15:43:16 user nova-compute[75337]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4367fb98-2ae9-40c3-a2d0-6e9b0f70dc7c (non-flash)
Nov 06 15:43:16 user nova-compute[75337]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ad85d1f-7027-4997-96c4-991e3969067d (non-flash)
Nov 06 15:43:16 user nova-compute[75337]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaf5fc54-be7c-4748-9e2f-12a01971e6f4 (non-flash)
Nov 06 15:43:16 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 15:43:16 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-a28a969b-7c2f-461c-88d0-416acdc664ae tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)
Nov 06 15:43:16 user nova-compute[75337]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759 (non-flash)
Nov 06 15:43:16 user nova-compute[75337]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4367fb98-2ae9-40c3-a2d0-6e9b0f70dc7c (non-flash)
Nov 06 15:43:16 user nova-compute[75337]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ad85d1f-7027-4997-96c4-991e3969067d (non-flash)
Nov 06 15:43:16 user nova-compute[75337]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaf5fc54-be7c-4748-9e2f-12a01971e6f4 (non-flash)
Nov 06 15:43:16 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 15:43:16 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e -p 172.16.0.220:3260 --login {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:43:16 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:43:16 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7a54da5-bdb6-47a3-8e95-d6215922d295]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:43:16 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-a28a969b-7c2f-461c-88d0-416acdc664ae tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e, portal: 172.16.0.220,3260]
Nov 06 15:43:16 user nova-compute[75337]: Login to [iface: default, target: iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e, portal: 172.16.0.220,3260] successful.
Nov 06 15:43:16 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:43:16 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:43:16 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:43:16 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[70d24c63-c1eb-4793-a6cf-7605ef3b4d84]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:43:16 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-a28a969b-7c2f-461c-88d0-416acdc664ae tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:43:16 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:43:16 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:43:16 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef628958-2723-4494-b378-4562b540ea92]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4367fb98-2ae9-40c3-a2d0-6e9b0f70dc7c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ad85d1f-7027-4997-96c4-991e3969067d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaf5fc54-be7c-4748-9e2f-12a01971e6f4 (non-flash)\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:43:16 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-a28a969b-7c2f-461c-88d0-416acdc664ae tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)
Nov 06 15:43:16 user nova-compute[75337]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e (non-flash)
Nov 06 15:43:16 user nova-compute[75337]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759 (non-flash)
Nov 06 15:43:16 user nova-compute[75337]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4367fb98-2ae9-40c3-a2d0-6e9b0f70dc7c (non-flash)
Nov 06 15:43:16 user nova-compute[75337]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ad85d1f-7027-4997-96c4-991e3969067d (non-flash)
Nov 06 15:43:16 user nova-compute[75337]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaf5fc54-be7c-4748-9e2f-12a01971e6f4 (non-flash)
Nov 06 15:43:16 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 15:43:16 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-a28a969b-7c2f-461c-88d0-416acdc664ae tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)
Nov 06 15:43:16 user nova-compute[75337]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e (non-flash)
Nov 06 15:43:16 user nova-compute[75337]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759 (non-flash)
Nov 06 15:43:16 user nova-compute[75337]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4367fb98-2ae9-40c3-a2d0-6e9b0f70dc7c (non-flash)
Nov 06 15:43:16 user nova-compute[75337]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ad85d1f-7027-4997-96c4-991e3969067d (non-flash)
Nov 06 15:43:16 user nova-compute[75337]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaf5fc54-be7c-4748-9e2f-12a01971e6f4 (non-flash)
Nov 06 15:43:16 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 15:43:16 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-a28a969b-7c2f-461c-88d0-416acdc664ae tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.355s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 15:43:16 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-a28a969b-7c2f-461c-88d0-416acdc664ae tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Connected to 172.16.0.220:3260 {{(pid=75337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 15:43:16 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-a28a969b-7c2f-461c-88d0-416acdc664ae tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] HCTL ('36', '-', '-', 0) found on session 12 with lun 0 {{(pid=75337) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 15:43:16 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-a28a969b-7c2f-461c-88d0-416acdc664ae tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75337) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 15:43:16 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:43:16 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:43:16 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f6efe10-b924-4130-a007-c294b55f2979]: (4, ('- - 0', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:43:16 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-a28a969b-7c2f-461c-88d0-416acdc664ae tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Searching for a device in session 12 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75337) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 15:43:16 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-a28a969b-7c2f-461c-88d0-416acdc664ae tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XMEQSsAU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 15:43:16 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:43:16 user nova-compute[75337]: INFO nova.virt.libvirt.driver [-] [instance: 76ee582b-b887-4d46-8c78-29f42d1a0d26] Instance destroyed successfully.
Nov 06 15:43:16 user nova-compute[75337]: DEBUG nova.objects.instance [None req-e256cf44-82d9-46b3-9516-a7f36a8f2eef tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] Lazy-loading 'resources' on Instance uuid 76ee582b-b887-4d46-8c78-29f42d1a0d26 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 15:43:16 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-e256cf44-82d9-46b3-9516-a7f36a8f2eef tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T15:38:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1853414850',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1853414850',id=9,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFGP9zZx8/smrQZVJ9SjwMu8yi65szEQrklWGxwv+DWpP4x/gZJfYN1nhwlTtV8a2EPxv+zU/MdCKD4XLCPbyGN12jTTqoGcbI7kaYL/I7RmSLD+0nDNzAksw3YYfsN9cA==',key_name='tempest-keypair-135606244',keypairs=<?>,launch_index=0,launched_at=2023-11-06T15:38:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4180b3fb8de74de1ad134fe356b85d6f',ramdisk_id='',reservation_id='r-gdmig8v7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-387682144',owner_user_name='tempest-TaggedAttachmentsTest-387682144-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T15:38:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='587c402e2f0d45ad909ae974a03cd20e',uuid=76ee582b-b887-4d46-8c78-29f42d1a0d26,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8d52e5d0-96a2-44ca-9968-9ac564aeff2c", "address": "fa:16:3e:0b:83:6f", "network": {"id": "cd11ddce-8aa1-4ad8-8184-317c63f52be7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-265471432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4180b3fb8de74de1ad134fe356b85d6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d52e5d0-96", "ovs_interfaceid": "8d52e5d0-96a2-44ca-9968-9ac564aeff2c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 15:43:16 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-e256cf44-82d9-46b3-9516-a7f36a8f2eef tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] Converting VIF {"id": "8d52e5d0-96a2-44ca-9968-9ac564aeff2c", "address": "fa:16:3e:0b:83:6f", "network": {"id": "cd11ddce-8aa1-4ad8-8184-317c63f52be7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-265471432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4180b3fb8de74de1ad134fe356b85d6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d52e5d0-96", "ovs_interfaceid": "8d52e5d0-96a2-44ca-9968-9ac564aeff2c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 15:43:16 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-e256cf44-82d9-46b3-9516-a7f36a8f2eef tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0b:83:6f,bridge_name='br-int',has_traffic_filtering=True,id=8d52e5d0-96a2-44ca-9968-9ac564aeff2c,network=Network(cd11ddce-8aa1-4ad8-8184-317c63f52be7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d52e5d0-96') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 15:43:16 user nova-compute[75337]: DEBUG os_vif [None req-e256cf44-82d9-46b3-9516-a7f36a8f2eef tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0b:83:6f,bridge_name='br-int',has_traffic_filtering=True,id=8d52e5d0-96a2-44ca-9968-9ac564aeff2c,network=Network(cd11ddce-8aa1-4ad8-8184-317c63f52be7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d52e5d0-96') {{(pid=75337) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 15:43:16 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:43:16 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8d52e5d0-96, bridge=br-int, if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:43:16 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:43:16 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:43:16 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:43:16 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=838490b2-45a3-4801-aec4-c013c1845b43) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:43:16 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:43:16 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:43:16 user nova-compute[75337]: INFO os_vif [None req-e256cf44-82d9-46b3-9516-a7f36a8f2eef tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0b:83:6f,bridge_name='br-int',has_traffic_filtering=True,id=8d52e5d0-96a2-44ca-9968-9ac564aeff2c,network=Network(cd11ddce-8aa1-4ad8-8184-317c63f52be7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d52e5d0-96')
Nov 06 15:43:16 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-e256cf44-82d9-46b3-9516-a7f36a8f2eef tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] [instance: 76ee582b-b887-4d46-8c78-29f42d1a0d26] Deleting instance files /opt/stack/data/nova/instances/76ee582b-b887-4d46-8c78-29f42d1a0d26_del
Nov 06 15:43:16 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-e256cf44-82d9-46b3-9516-a7f36a8f2eef tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] [instance: 76ee582b-b887-4d46-8c78-29f42d1a0d26] Deletion of /opt/stack/data/nova/instances/76ee582b-b887-4d46-8c78-29f42d1a0d26_del complete
Nov 06 15:43:16 user nova-compute[75337]: INFO nova.compute.manager [None req-e256cf44-82d9-46b3-9516-a7f36a8f2eef tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] [instance: 76ee582b-b887-4d46-8c78-29f42d1a0d26] Took 0.92 seconds to destroy the instance on the hypervisor.
Nov 06 15:43:16 user nova-compute[75337]: DEBUG oslo.service.loopingcall [None req-e256cf44-82d9-46b3-9516-a7f36a8f2eef tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75337) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 15:43:16 user nova-compute[75337]: DEBUG nova.compute.manager [-] [instance: 76ee582b-b887-4d46-8c78-29f42d1a0d26] Deallocating network for instance {{(pid=75337) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 15:43:16 user nova-compute[75337]: DEBUG nova.network.neutron [-] [instance: 76ee582b-b887-4d46-8c78-29f42d1a0d26] deallocate_for_instance() {{(pid=75337) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 15:43:17 user nova-compute[75337]: DEBUG nova.network.neutron [-] [instance: 76ee582b-b887-4d46-8c78-29f42d1a0d26] Updating instance_info_cache with network_info: [] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:43:17 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-a28a969b-7c2f-461c-88d0-416acdc664ae tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.404s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 15:43:17 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-a28a969b-7c2f-461c-88d0-416acdc664ae tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] <== connect_volume: return (1407ms) {'type': 'block', 'scsi_wwn': '23635626366623136', 'path': '/dev/sde'} {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 15:43:17 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a28a969b-7c2f-461c-88d0-416acdc664ae tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] [instance: 581cf468-65e7-42e5-9250-c3d645577011] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23635626366623136', 'path': '/dev/sde'} {{(pid=75337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 15:43:17 user nova-compute[75337]: INFO nova.compute.manager [-] [instance: 76ee582b-b887-4d46-8c78-29f42d1a0d26] Took 0.78 seconds to deallocate network for instance.
Nov 06 15:43:17 user nova-compute[75337]: DEBUG nova.compute.manager [req-51da6f6b-891b-4278-973a-ff827dcb4310 req-2106ae8d-2bef-4d60-b064-637350ecc1a9 service nova] [instance: 76ee582b-b887-4d46-8c78-29f42d1a0d26] Received event network-vif-deleted-8d52e5d0-96a2-44ca-9968-9ac564aeff2c {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:43:17 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-a28a969b-7c2f-461c-88d0-416acdc664ae tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T15:37:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-143035342',display_name='tempest-ServerActionsTestOtherB-server-143035342',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-143035342',id=4,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGvgawdpwOKUFbYuIfCQHAYAwMkYeyGp/mWnvHMxoikCW6rq7Lc9iVzhCxfsvGYfdcuDE3wf7kwN77XNEdHIhKuYJC28UJSD4qJahdz/1x3pQWmM3jC4aksXmnaw21FVfw==',key_name='tempest-keypair-1619039595',keypairs=<?>,launch_index=0,launched_at=2023-11-06T15:38:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f40165c076e341bba42fb537ce98bbe2',ramdisk_id='',reservation_id='r-w3wq64j4',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-464439480',owner_user_name='tempest-ServerActionsTestOtherB-464439480-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T15:42:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2810a15c1608465aa7465eae455eb5c6',uuid=581cf468-65e7-42e5-9250-c3d645577011,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d1c68bac-be37-4645-afcb-2b89f47c1793", "address": "fa:16:3e:00:1c:74", "network": {"id": "2623bcbf-c77c-47b4-abd5-ab538f9a2814", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1497688706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1497688706-network", "vif_mac": "fa:16:3e:00:1c:74"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f40165c076e341bba42fb537ce98bbe2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1c68bac-be", "ovs_interfaceid": "d1c68bac-be37-4645-afcb-2b89f47c1793", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75337) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 15:43:17 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-a28a969b-7c2f-461c-88d0-416acdc664ae tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Converting VIF {"id": "d1c68bac-be37-4645-afcb-2b89f47c1793", "address": "fa:16:3e:00:1c:74", "network": {"id": "2623bcbf-c77c-47b4-abd5-ab538f9a2814", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1497688706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1497688706-network", "vif_mac": "fa:16:3e:00:1c:74"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f40165c076e341bba42fb537ce98bbe2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1c68bac-be", "ovs_interfaceid": "d1c68bac-be37-4645-afcb-2b89f47c1793", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 15:43:17 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-a28a969b-7c2f-461c-88d0-416acdc664ae tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:1c:74,bridge_name='br-int',has_traffic_filtering=True,id=d1c68bac-be37-4645-afcb-2b89f47c1793,network=Network(2623bcbf-c77c-47b4-abd5-ab538f9a2814),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1c68bac-be') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 15:43:17 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-a28a969b-7c2f-461c-88d0-416acdc664ae tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] [instance: 581cf468-65e7-42e5-9250-c3d645577011] End _get_guest_xml xml=<domain type="kvm">
Nov 06 15:43:17 user nova-compute[75337]:   <uuid>581cf468-65e7-42e5-9250-c3d645577011</uuid>
Nov 06 15:43:17 user nova-compute[75337]:   <name>instance-00000004</name>
Nov 06 15:43:17 user nova-compute[75337]:   <memory>2097152</memory>
Nov 06 15:43:17 user nova-compute[75337]:   <vcpu>1</vcpu>
Nov 06 15:43:17 user nova-compute[75337]:   <metadata>
Nov 06 15:43:17 user nova-compute[75337]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 15:43:17 user nova-compute[75337]:       <nova:package version="0.0.0"/>
Nov 06 15:43:17 user nova-compute[75337]:       <nova:name>tempest-ServerActionsTestOtherB-server-143035342</nova:name>
Nov 06 15:43:17 user nova-compute[75337]:       <nova:creationTime>2023-11-06 15:43:15</nova:creationTime>
Nov 06 15:43:17 user nova-compute[75337]:       <nova:flavor name="m1.small">
Nov 06 15:43:17 user nova-compute[75337]:         <nova:memory>2048</nova:memory>
Nov 06 15:43:17 user nova-compute[75337]:         <nova:disk>20</nova:disk>
Nov 06 15:43:17 user nova-compute[75337]:         <nova:swap>0</nova:swap>
Nov 06 15:43:17 user nova-compute[75337]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 15:43:17 user nova-compute[75337]:         <nova:vcpus>1</nova:vcpus>
Nov 06 15:43:17 user nova-compute[75337]:       </nova:flavor>
Nov 06 15:43:17 user nova-compute[75337]:       <nova:owner>
Nov 06 15:43:17 user nova-compute[75337]:         <nova:user uuid="2810a15c1608465aa7465eae455eb5c6">tempest-ServerActionsTestOtherB-464439480-project-member</nova:user>
Nov 06 15:43:17 user nova-compute[75337]:         <nova:project uuid="f40165c076e341bba42fb537ce98bbe2">tempest-ServerActionsTestOtherB-464439480</nova:project>
Nov 06 15:43:17 user nova-compute[75337]:       </nova:owner>
Nov 06 15:43:17 user nova-compute[75337]:       <nova:root type="image" uuid="16b903ae-a40f-41a7-985b-4804cce92c62"/>
Nov 06 15:43:17 user nova-compute[75337]:       <nova:ports>
Nov 06 15:43:17 user nova-compute[75337]:         <nova:port uuid="d1c68bac-be37-4645-afcb-2b89f47c1793">
Nov 06 15:43:17 user nova-compute[75337]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 06 15:43:17 user nova-compute[75337]:         </nova:port>
Nov 06 15:43:17 user nova-compute[75337]:       </nova:ports>
Nov 06 15:43:17 user nova-compute[75337]:     </nova:instance>
Nov 06 15:43:17 user nova-compute[75337]:   </metadata>
Nov 06 15:43:17 user nova-compute[75337]:   <sysinfo type="smbios">
Nov 06 15:43:17 user nova-compute[75337]:     <system>
Nov 06 15:43:17 user nova-compute[75337]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 15:43:17 user nova-compute[75337]:       <entry name="product">OpenStack Nova</entry>
Nov 06 15:43:17 user nova-compute[75337]:       <entry name="version">0.0.0</entry>
Nov 06 15:43:17 user nova-compute[75337]:       <entry name="serial">581cf468-65e7-42e5-9250-c3d645577011</entry>
Nov 06 15:43:17 user nova-compute[75337]:       <entry name="uuid">581cf468-65e7-42e5-9250-c3d645577011</entry>
Nov 06 15:43:17 user nova-compute[75337]:       <entry name="family">Virtual Machine</entry>
Nov 06 15:43:17 user nova-compute[75337]:     </system>
Nov 06 15:43:17 user nova-compute[75337]:   </sysinfo>
Nov 06 15:43:17 user nova-compute[75337]:   <os>
Nov 06 15:43:17 user nova-compute[75337]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 15:43:17 user nova-compute[75337]:     <boot dev="hd"/>
Nov 06 15:43:17 user nova-compute[75337]:     <smbios mode="sysinfo"/>
Nov 06 15:43:17 user nova-compute[75337]:   </os>
Nov 06 15:43:17 user nova-compute[75337]:   <features>
Nov 06 15:43:17 user nova-compute[75337]:     <acpi/>
Nov 06 15:43:17 user nova-compute[75337]:     <apic/>
Nov 06 15:43:17 user nova-compute[75337]:     <vmcoreinfo/>
Nov 06 15:43:17 user nova-compute[75337]:   </features>
Nov 06 15:43:17 user nova-compute[75337]:   <clock offset="utc">
Nov 06 15:43:17 user nova-compute[75337]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 15:43:17 user nova-compute[75337]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 15:43:17 user nova-compute[75337]:     <timer name="hpet" present="no"/>
Nov 06 15:43:17 user nova-compute[75337]:   </clock>
Nov 06 15:43:17 user nova-compute[75337]:   <cpu mode="custom" match="exact">
Nov 06 15:43:17 user nova-compute[75337]:     <model>Nehalem</model>
Nov 06 15:43:17 user nova-compute[75337]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 15:43:17 user nova-compute[75337]:   </cpu>
Nov 06 15:43:17 user nova-compute[75337]:   <devices>
Nov 06 15:43:17 user nova-compute[75337]:     <disk type="file" device="disk">
Nov 06 15:43:17 user nova-compute[75337]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 15:43:17 user nova-compute[75337]:       <source file="/opt/stack/data/nova/instances/581cf468-65e7-42e5-9250-c3d645577011/disk"/>
Nov 06 15:43:17 user nova-compute[75337]:       <target dev="vda" bus="virtio"/>
Nov 06 15:43:17 user nova-compute[75337]:     </disk>
Nov 06 15:43:17 user nova-compute[75337]:     <disk type="block" device="disk">
Nov 06 15:43:17 user nova-compute[75337]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 15:43:17 user nova-compute[75337]:       <source dev="/dev/sde"/>
Nov 06 15:43:17 user nova-compute[75337]:       <target dev="vdb" bus="virtio"/>
Nov 06 15:43:17 user nova-compute[75337]:       <serial>84119968-a048-41d8-9688-39c01b5f860e</serial>
Nov 06 15:43:17 user nova-compute[75337]:     </disk>
Nov 06 15:43:17 user nova-compute[75337]:     <interface type="ethernet">
Nov 06 15:43:17 user nova-compute[75337]:       <mac address="fa:16:3e:00:1c:74"/>
Nov 06 15:43:17 user nova-compute[75337]:       <model type="virtio"/>
Nov 06 15:43:17 user nova-compute[75337]:       <mtu size="1442"/>
Nov 06 15:43:17 user nova-compute[75337]:       <target dev="tapd1c68bac-be"/>
Nov 06 15:43:17 user nova-compute[75337]:     </interface>
Nov 06 15:43:17 user nova-compute[75337]:     <serial type="pty">
Nov 06 15:43:17 user nova-compute[75337]:       <log file="/opt/stack/data/nova/instances/581cf468-65e7-42e5-9250-c3d645577011/console.log" append="off"/>
Nov 06 15:43:17 user nova-compute[75337]:     </serial>
Nov 06 15:43:17 user nova-compute[75337]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 15:43:17 user nova-compute[75337]:     <video>
Nov 06 15:43:17 user nova-compute[75337]:       <model type="virtio"/>
Nov 06 15:43:17 user nova-compute[75337]:     </video>
Nov 06 15:43:17 user nova-compute[75337]:     <rng model="virtio">
Nov 06 15:43:17 user nova-compute[75337]:       <backend model="random">/dev/urandom</backend>
Nov 06 15:43:17 user nova-compute[75337]:     </rng>
Nov 06 15:43:17 user nova-compute[75337]:     <controller type="usb" index="0" model="none"/>
Nov 06 15:43:17 user nova-compute[75337]:     <memballoon model="virtio">
Nov 06 15:43:17 user nova-compute[75337]:       <stats period="10"/>
Nov 06 15:43:17 user nova-compute[75337]:     </memballoon>
Nov 06 15:43:17 user nova-compute[75337]:   </devices>
Nov 06 15:43:17 user nova-compute[75337]: </domain>
Nov 06 15:43:17 user nova-compute[75337]:  {{(pid=75337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 15:43:17 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-a28a969b-7c2f-461c-88d0-416acdc664ae tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T15:37:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-143035342',display_name='tempest-ServerActionsTestOtherB-server-143035342',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-143035342',id=4,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGvgawdpwOKUFbYuIfCQHAYAwMkYeyGp/mWnvHMxoikCW6rq7Lc9iVzhCxfsvGYfdcuDE3wf7kwN77XNEdHIhKuYJC28UJSD4qJahdz/1x3pQWmM3jC4aksXmnaw21FVfw==',key_name='tempest-keypair-1619039595',keypairs=<?>,launch_index=0,launched_at=2023-11-06T15:38:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f40165c076e341bba42fb537ce98bbe2',ramdisk_id='',reservation_id='r-w3wq64j4',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-464439480',owner_user_name='tempest-ServerActionsTestOtherB-464439480-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T15:42:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2810a15c1608465aa7465eae455eb5c6',uuid=581cf468-65e7-42e5-9250-c3d645577011,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d1c68bac-be37-4645-afcb-2b89f47c1793", "address": "fa:16:3e:00:1c:74", "network": {"id": "2623bcbf-c77c-47b4-abd5-ab538f9a2814", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1497688706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1497688706-network", "vif_mac": "fa:16:3e:00:1c:74"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f40165c076e341bba42fb537ce98bbe2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1c68bac-be", "ovs_interfaceid": "d1c68bac-be37-4645-afcb-2b89f47c1793", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 15:43:17 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-a28a969b-7c2f-461c-88d0-416acdc664ae tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Converting VIF {"id": "d1c68bac-be37-4645-afcb-2b89f47c1793", "address": "fa:16:3e:00:1c:74", "network": {"id": "2623bcbf-c77c-47b4-abd5-ab538f9a2814", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1497688706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1497688706-network", "vif_mac": "fa:16:3e:00:1c:74"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f40165c076e341bba42fb537ce98bbe2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1c68bac-be", "ovs_interfaceid": "d1c68bac-be37-4645-afcb-2b89f47c1793", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 15:43:17 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-a28a969b-7c2f-461c-88d0-416acdc664ae tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:1c:74,bridge_name='br-int',has_traffic_filtering=True,id=d1c68bac-be37-4645-afcb-2b89f47c1793,network=Network(2623bcbf-c77c-47b4-abd5-ab538f9a2814),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1c68bac-be') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 15:43:17 user nova-compute[75337]: DEBUG os_vif [None req-a28a969b-7c2f-461c-88d0-416acdc664ae tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:1c:74,bridge_name='br-int',has_traffic_filtering=True,id=d1c68bac-be37-4645-afcb-2b89f47c1793,network=Network(2623bcbf-c77c-47b4-abd5-ab538f9a2814),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1c68bac-be') {{(pid=75337) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 15:43:17 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:43:17 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:43:17 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 15:43:17 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:43:17 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c7c8f7f7-a966-5f35-8c9b-6076307a23c7', '_type': 'linux-noop'}}, row=False) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:43:17 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:43:17 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:43:17 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:43:17 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd1c68bac-be, may_exist=True, interface_attrs={}) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:43:17 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd1c68bac-be, col_values=(('qos', UUID('054abe9b-decb-4f61-aac8-d24879f68a45')),), if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:43:17 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd1c68bac-be, col_values=(('external_ids', {'iface-id': 'd1c68bac-be37-4645-afcb-2b89f47c1793', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:00:1c:74', 'vm-uuid': '581cf468-65e7-42e5-9250-c3d645577011'}),), if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:43:17 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:43:17 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-e256cf44-82d9-46b3-9516-a7f36a8f2eef tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:43:17 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-e256cf44-82d9-46b3-9516-a7f36a8f2eef tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:43:17 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:43:17 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:43:17 user nova-compute[75337]: INFO os_vif [None req-a28a969b-7c2f-461c-88d0-416acdc664ae tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:1c:74,bridge_name='br-int',has_traffic_filtering=True,id=d1c68bac-be37-4645-afcb-2b89f47c1793,network=Network(2623bcbf-c77c-47b4-abd5-ab538f9a2814),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1c68bac-be')
Nov 06 15:43:17 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-a28a969b-7c2f-461c-88d0-416acdc664ae tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] No BDM found with device name vda, not building metadata. {{(pid=75337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 15:43:17 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-a28a969b-7c2f-461c-88d0-416acdc664ae tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 15:43:17 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-a28a969b-7c2f-461c-88d0-416acdc664ae tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] No VIF found with MAC fa:16:3e:00:1c:74, not building metadata {{(pid=75337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 15:43:17 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-e256cf44-82d9-46b3-9516-a7f36a8f2eef tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 15:43:17 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-e256cf44-82d9-46b3-9516-a7f36a8f2eef tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 15:43:17 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-e256cf44-82d9-46b3-9516-a7f36a8f2eef tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.361s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:43:17 user nova-compute[75337]: INFO nova.scheduler.client.report [None req-e256cf44-82d9-46b3-9516-a7f36a8f2eef tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] Deleted allocations for instance 76ee582b-b887-4d46-8c78-29f42d1a0d26
Nov 06 15:43:18 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-e256cf44-82d9-46b3-9516-a7f36a8f2eef tempest-TaggedAttachmentsTest-387682144 tempest-TaggedAttachmentsTest-387682144-project-member] Lock "76ee582b-b887-4d46-8c78-29f42d1a0d26" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.309s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:43:18 user nova-compute[75337]: DEBUG nova.compute.manager [req-0c335a25-a3f5-4cc2-af3e-bd56b906e64e req-5efe627e-8a18-4856-bbab-6b6b419f3106 service nova] [instance: 76ee582b-b887-4d46-8c78-29f42d1a0d26] Received event network-vif-plugged-8d52e5d0-96a2-44ca-9968-9ac564aeff2c {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:43:18 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-0c335a25-a3f5-4cc2-af3e-bd56b906e64e req-5efe627e-8a18-4856-bbab-6b6b419f3106 service nova] Acquiring lock "76ee582b-b887-4d46-8c78-29f42d1a0d26-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:43:18 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-0c335a25-a3f5-4cc2-af3e-bd56b906e64e req-5efe627e-8a18-4856-bbab-6b6b419f3106 service nova] Lock "76ee582b-b887-4d46-8c78-29f42d1a0d26-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:43:18 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-0c335a25-a3f5-4cc2-af3e-bd56b906e64e req-5efe627e-8a18-4856-bbab-6b6b419f3106 service nova] Lock "76ee582b-b887-4d46-8c78-29f42d1a0d26-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:43:18 user nova-compute[75337]: DEBUG nova.compute.manager [req-0c335a25-a3f5-4cc2-af3e-bd56b906e64e req-5efe627e-8a18-4856-bbab-6b6b419f3106 service nova] [instance: 76ee582b-b887-4d46-8c78-29f42d1a0d26] No waiting events found dispatching network-vif-plugged-8d52e5d0-96a2-44ca-9968-9ac564aeff2c {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:43:18 user nova-compute[75337]: WARNING nova.compute.manager [req-0c335a25-a3f5-4cc2-af3e-bd56b906e64e req-5efe627e-8a18-4856-bbab-6b6b419f3106 service nova] [instance: 76ee582b-b887-4d46-8c78-29f42d1a0d26] Received unexpected event network-vif-plugged-8d52e5d0-96a2-44ca-9968-9ac564aeff2c for instance with vm_state deleted and task_state None.
Nov 06 15:43:19 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:43:19 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:43:19 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:43:19 user nova-compute[75337]: DEBUG nova.compute.manager [req-620fb463-814f-4695-b041-61308823ce2b req-dfe52c35-cbae-406c-af46-8d5cc2fc3e4b service nova] [instance: 581cf468-65e7-42e5-9250-c3d645577011] Received event network-vif-plugged-d1c68bac-be37-4645-afcb-2b89f47c1793 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:43:19 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-620fb463-814f-4695-b041-61308823ce2b req-dfe52c35-cbae-406c-af46-8d5cc2fc3e4b service nova] Acquiring lock "581cf468-65e7-42e5-9250-c3d645577011-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:43:19 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-620fb463-814f-4695-b041-61308823ce2b req-dfe52c35-cbae-406c-af46-8d5cc2fc3e4b service nova] Lock "581cf468-65e7-42e5-9250-c3d645577011-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:43:19 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-620fb463-814f-4695-b041-61308823ce2b req-dfe52c35-cbae-406c-af46-8d5cc2fc3e4b service nova] Lock "581cf468-65e7-42e5-9250-c3d645577011-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:43:19 user nova-compute[75337]: DEBUG nova.compute.manager [req-620fb463-814f-4695-b041-61308823ce2b req-dfe52c35-cbae-406c-af46-8d5cc2fc3e4b service nova] [instance: 581cf468-65e7-42e5-9250-c3d645577011] No waiting events found dispatching network-vif-plugged-d1c68bac-be37-4645-afcb-2b89f47c1793 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:43:19 user nova-compute[75337]: WARNING nova.compute.manager [req-620fb463-814f-4695-b041-61308823ce2b req-dfe52c35-cbae-406c-af46-8d5cc2fc3e4b service nova] [instance: 581cf468-65e7-42e5-9250-c3d645577011] Received unexpected event network-vif-plugged-d1c68bac-be37-4645-afcb-2b89f47c1793 for instance with vm_state active and task_state resize_finish.
Nov 06 15:43:19 user nova-compute[75337]: DEBUG nova.compute.manager [req-620fb463-814f-4695-b041-61308823ce2b req-dfe52c35-cbae-406c-af46-8d5cc2fc3e4b service nova] [instance: 581cf468-65e7-42e5-9250-c3d645577011] Received event network-vif-plugged-d1c68bac-be37-4645-afcb-2b89f47c1793 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:43:19 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-620fb463-814f-4695-b041-61308823ce2b req-dfe52c35-cbae-406c-af46-8d5cc2fc3e4b service nova] Acquiring lock "581cf468-65e7-42e5-9250-c3d645577011-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:43:19 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-620fb463-814f-4695-b041-61308823ce2b req-dfe52c35-cbae-406c-af46-8d5cc2fc3e4b service nova] Lock "581cf468-65e7-42e5-9250-c3d645577011-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:43:19 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-620fb463-814f-4695-b041-61308823ce2b req-dfe52c35-cbae-406c-af46-8d5cc2fc3e4b service nova] Lock "581cf468-65e7-42e5-9250-c3d645577011-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:43:19 user nova-compute[75337]: DEBUG nova.compute.manager [req-620fb463-814f-4695-b041-61308823ce2b req-dfe52c35-cbae-406c-af46-8d5cc2fc3e4b service nova] [instance: 581cf468-65e7-42e5-9250-c3d645577011] No waiting events found dispatching network-vif-plugged-d1c68bac-be37-4645-afcb-2b89f47c1793 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:43:19 user nova-compute[75337]: WARNING nova.compute.manager [req-620fb463-814f-4695-b041-61308823ce2b req-dfe52c35-cbae-406c-af46-8d5cc2fc3e4b service nova] [instance: 581cf468-65e7-42e5-9250-c3d645577011] Received unexpected event network-vif-plugged-d1c68bac-be37-4645-afcb-2b89f47c1793 for instance with vm_state active and task_state resize_finish.
Nov 06 15:43:19 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:43:19 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:43:19 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:43:21 user nova-compute[75337]: DEBUG nova.compute.manager [None req-a28a969b-7c2f-461c-88d0-416acdc664ae tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] [instance: 581cf468-65e7-42e5-9250-c3d645577011] Instance event wait completed in 0 seconds for  {{(pid=75337) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 15:43:21 user nova-compute[75337]: INFO nova.virt.libvirt.driver [-] [instance: 581cf468-65e7-42e5-9250-c3d645577011] Instance running successfully.
Nov 06 15:43:21 user nova-compute[75337]: DEBUG nova.virt.libvirt.guest [None req-a28a969b-7c2f-461c-88d0-416acdc664ae tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] [instance: 581cf468-65e7-42e5-9250-c3d645577011] Failed to set time: agent not configured {{(pid=75337) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 06 15:43:21 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-a28a969b-7c2f-461c-88d0-416acdc664ae tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] [instance: 581cf468-65e7-42e5-9250-c3d645577011] finish_migration finished successfully. {{(pid=75337) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Nov 06 15:43:22 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:43:23 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:43:23 user nova-compute[75337]: DEBUG nova.compute.manager [req-a50a5c53-4925-4f0c-869e-1db15e9e7707 req-b8781107-8321-46b1-9ad7-d88ef8fa8ff4 service nova] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Received event network-changed-5d25f565-70a5-427c-a198-4f88dd8b7338 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:43:23 user nova-compute[75337]: DEBUG nova.compute.manager [req-a50a5c53-4925-4f0c-869e-1db15e9e7707 req-b8781107-8321-46b1-9ad7-d88ef8fa8ff4 service nova] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Refreshing instance network info cache due to event network-changed-5d25f565-70a5-427c-a198-4f88dd8b7338. {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 15:43:23 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-a50a5c53-4925-4f0c-869e-1db15e9e7707 req-b8781107-8321-46b1-9ad7-d88ef8fa8ff4 service nova] Acquiring lock "refresh_cache-67d9ceff-c1fc-48ad-85c8-3aa37ebabf11" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 15:43:23 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-a50a5c53-4925-4f0c-869e-1db15e9e7707 req-b8781107-8321-46b1-9ad7-d88ef8fa8ff4 service nova] Acquired lock "refresh_cache-67d9ceff-c1fc-48ad-85c8-3aa37ebabf11" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 15:43:23 user nova-compute[75337]: DEBUG nova.network.neutron [req-a50a5c53-4925-4f0c-869e-1db15e9e7707 req-b8781107-8321-46b1-9ad7-d88ef8fa8ff4 service nova] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Refreshing network info cache for port 5d25f565-70a5-427c-a198-4f88dd8b7338 {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 15:43:24 user nova-compute[75337]: DEBUG nova.network.neutron [req-a50a5c53-4925-4f0c-869e-1db15e9e7707 req-b8781107-8321-46b1-9ad7-d88ef8fa8ff4 service nova] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Updated VIF entry in instance network info cache for port 5d25f565-70a5-427c-a198-4f88dd8b7338. {{(pid=75337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 15:43:24 user nova-compute[75337]: DEBUG nova.network.neutron [req-a50a5c53-4925-4f0c-869e-1db15e9e7707 req-b8781107-8321-46b1-9ad7-d88ef8fa8ff4 service nova] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Updating instance_info_cache with network_info: [{"id": "5d25f565-70a5-427c-a198-4f88dd8b7338", "address": "fa:16:3e:39:62:9f", "network": {"id": "4b3a9463-7120-499a-bdef-bd2ce9443d88", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1482718546-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "664f419c1b904bb3bdd7aff9e621e2e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d25f565-70", "ovs_interfaceid": "5d25f565-70a5-427c-a198-4f88dd8b7338", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ac99553f-c5d8-46df-8357-f1f7f189fa22", "address": "fa:16:3e:37:11:e5", "network": {"id": "793579d8-5696-4c41-b09e-19e19908b703", "bridge": "br-int", "label": "tempest-device-tagging-net1-1052173633", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.61", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "664f419c1b904bb3bdd7aff9e621e2e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac99553f-c5", "ovs_interfaceid": "ac99553f-c5d8-46df-8357-f1f7f189fa22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "abf73a6f-c3c7-46b5-8a9b-0fce5677fa27", "address": "fa:16:3e:68:66:1c", "network": {"id": "793579d8-5696-4c41-b09e-19e19908b703", "bridge": "br-int", "label": "tempest-device-tagging-net1-1052173633", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.239", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "664f419c1b904bb3bdd7aff9e621e2e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabf73a6f-c3", "ovs_interfaceid": "abf73a6f-c3c7-46b5-8a9b-0fce5677fa27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e87c0766-dd71-4aca-b5f0-32888c7437f5", "address": "fa:16:3e:b5:06:33", "network": {"id": "793579d8-5696-4c41-b09e-19e19908b703", "bridge": "br-int", "label": "tempest-device-tagging-net1-1052173633", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "664f419c1b904bb3bdd7aff9e621e2e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape87c0766-dd", "ovs_interfaceid": "e87c0766-dd71-4aca-b5f0-32888c7437f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ba50db67-9fb0-49ef-9ea2-db9014b66b17", "address": "fa:16:3e:1a:f9:b0", "network": {"id": "793579d8-5696-4c41-b09e-19e19908b703", "bridge": "br-int", "label": "tempest-device-tagging-net1-1052173633", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "664f419c1b904bb3bdd7aff9e621e2e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba50db67-9f", "ovs_interfaceid": "ba50db67-9fb0-49ef-9ea2-db9014b66b17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e6be4a87-8794-4e4f-91c1-3c417e0c8d62", "address": "fa:16:3e:df:a8:14", "network": {"id": "512e1b59-3c5a-4be6-bf3d-2ee51ce2042a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1219094622", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "664f419c1b904bb3bdd7aff9e621e2e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6be4a87-87", "ovs_interfaceid": "e6be4a87-8794-4e4f-91c1-3c417e0c8d62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "94df5f62-239e-4b8e-a91d-5223c1585f6f", "address": "fa:16:3e:03:8e:66", "network": {"id": "512e1b59-3c5a-4be6-bf3d-2ee51ce2042a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1219094622", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "664f419c1b904bb3bdd7aff9e621e2e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94df5f62-23", "ovs_interfaceid": "94df5f62-239e-4b8e-a91d-5223c1585f6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:43:24 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-a50a5c53-4925-4f0c-869e-1db15e9e7707 req-b8781107-8321-46b1-9ad7-d88ef8fa8ff4 service nova] Releasing lock "refresh_cache-67d9ceff-c1fc-48ad-85c8-3aa37ebabf11" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 15:43:26 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-1827f735-7849-46b7-94a4-a93a1fdfc874 tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Acquiring lock "67d9ceff-c1fc-48ad-85c8-3aa37ebabf11" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:43:26 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-1827f735-7849-46b7-94a4-a93a1fdfc874 tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Lock "67d9ceff-c1fc-48ad-85c8-3aa37ebabf11" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:43:26 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-1827f735-7849-46b7-94a4-a93a1fdfc874 tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Acquiring lock "67d9ceff-c1fc-48ad-85c8-3aa37ebabf11-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:43:26 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-1827f735-7849-46b7-94a4-a93a1fdfc874 tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Lock "67d9ceff-c1fc-48ad-85c8-3aa37ebabf11-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:43:26 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-1827f735-7849-46b7-94a4-a93a1fdfc874 tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Lock "67d9ceff-c1fc-48ad-85c8-3aa37ebabf11-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:43:26 user nova-compute[75337]: INFO nova.compute.manager [None req-1827f735-7849-46b7-94a4-a93a1fdfc874 tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Terminating instance
Nov 06 15:43:26 user nova-compute[75337]: DEBUG nova.compute.manager [None req-1827f735-7849-46b7-94a4-a93a1fdfc874 tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Start destroying the instance on the hypervisor. {{(pid=75337) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 15:43:26 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:43:26 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:43:26 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:43:26 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:43:26 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:43:27 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:43:27 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:43:27 user nova-compute[75337]: DEBUG nova.compute.manager [req-473bcb20-50c1-453a-80e2-28dc232de12e req-89ec720c-7d3c-413d-a00c-96cea208ac9b service nova] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Received event network-vif-unplugged-5d25f565-70a5-427c-a198-4f88dd8b7338 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:43:27 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-473bcb20-50c1-453a-80e2-28dc232de12e req-89ec720c-7d3c-413d-a00c-96cea208ac9b service nova] Acquiring lock "67d9ceff-c1fc-48ad-85c8-3aa37ebabf11-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:43:27 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-473bcb20-50c1-453a-80e2-28dc232de12e req-89ec720c-7d3c-413d-a00c-96cea208ac9b service nova] Lock "67d9ceff-c1fc-48ad-85c8-3aa37ebabf11-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:43:27 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-473bcb20-50c1-453a-80e2-28dc232de12e req-89ec720c-7d3c-413d-a00c-96cea208ac9b service nova] Lock "67d9ceff-c1fc-48ad-85c8-3aa37ebabf11-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:43:27 user nova-compute[75337]: DEBUG nova.compute.manager [req-473bcb20-50c1-453a-80e2-28dc232de12e req-89ec720c-7d3c-413d-a00c-96cea208ac9b service nova] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] No waiting events found dispatching network-vif-unplugged-5d25f565-70a5-427c-a198-4f88dd8b7338 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:43:27 user nova-compute[75337]: DEBUG nova.compute.manager [req-473bcb20-50c1-453a-80e2-28dc232de12e req-89ec720c-7d3c-413d-a00c-96cea208ac9b service nova] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Received event network-vif-unplugged-5d25f565-70a5-427c-a198-4f88dd8b7338 for instance with task_state deleting. {{(pid=75337) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 15:43:27 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:43:27 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:43:27 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:43:27 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:43:27 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:43:27 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:43:27 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:43:27 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:43:27 user nova-compute[75337]: DEBUG nova.compute.manager [req-ab91707b-b707-4565-8a2e-ebd138942d01 req-3ee70454-a601-474c-ab68-95f4849a7e34 service nova] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Received event network-vif-unplugged-e87c0766-dd71-4aca-b5f0-32888c7437f5 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:43:27 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-ab91707b-b707-4565-8a2e-ebd138942d01 req-3ee70454-a601-474c-ab68-95f4849a7e34 service nova] Acquiring lock "67d9ceff-c1fc-48ad-85c8-3aa37ebabf11-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:43:27 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-ab91707b-b707-4565-8a2e-ebd138942d01 req-3ee70454-a601-474c-ab68-95f4849a7e34 service nova] Lock "67d9ceff-c1fc-48ad-85c8-3aa37ebabf11-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:43:27 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-ab91707b-b707-4565-8a2e-ebd138942d01 req-3ee70454-a601-474c-ab68-95f4849a7e34 service nova] Lock "67d9ceff-c1fc-48ad-85c8-3aa37ebabf11-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:43:27 user nova-compute[75337]: DEBUG nova.compute.manager [req-ab91707b-b707-4565-8a2e-ebd138942d01 req-3ee70454-a601-474c-ab68-95f4849a7e34 service nova] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] No waiting events found dispatching network-vif-unplugged-e87c0766-dd71-4aca-b5f0-32888c7437f5 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:43:27 user nova-compute[75337]: DEBUG nova.compute.manager [req-ab91707b-b707-4565-8a2e-ebd138942d01 req-3ee70454-a601-474c-ab68-95f4849a7e34 service nova] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Received event network-vif-unplugged-e87c0766-dd71-4aca-b5f0-32888c7437f5 for instance with task_state deleting. {{(pid=75337) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 15:43:27 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:43:27 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:43:27 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:43:27 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:43:27 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:43:27 user nova-compute[75337]: DEBUG nova.compute.manager [req-a02c917a-5335-4366-95ad-a2e21b1517ea req-4cb5ae60-33a5-4b0d-8e83-06184c8012d8 service nova] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Received event network-vif-unplugged-94df5f62-239e-4b8e-a91d-5223c1585f6f {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:43:27 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-a02c917a-5335-4366-95ad-a2e21b1517ea req-4cb5ae60-33a5-4b0d-8e83-06184c8012d8 service nova] Acquiring lock "67d9ceff-c1fc-48ad-85c8-3aa37ebabf11-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:43:27 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-a02c917a-5335-4366-95ad-a2e21b1517ea req-4cb5ae60-33a5-4b0d-8e83-06184c8012d8 service nova] Lock "67d9ceff-c1fc-48ad-85c8-3aa37ebabf11-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:43:27 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-a02c917a-5335-4366-95ad-a2e21b1517ea req-4cb5ae60-33a5-4b0d-8e83-06184c8012d8 service nova] Lock "67d9ceff-c1fc-48ad-85c8-3aa37ebabf11-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:43:27 user nova-compute[75337]: DEBUG nova.compute.manager [req-a02c917a-5335-4366-95ad-a2e21b1517ea req-4cb5ae60-33a5-4b0d-8e83-06184c8012d8 service nova] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] No waiting events found dispatching network-vif-unplugged-94df5f62-239e-4b8e-a91d-5223c1585f6f {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:43:27 user nova-compute[75337]: DEBUG nova.compute.manager [req-a02c917a-5335-4366-95ad-a2e21b1517ea req-4cb5ae60-33a5-4b0d-8e83-06184c8012d8 service nova] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Received event network-vif-unplugged-94df5f62-239e-4b8e-a91d-5223c1585f6f for instance with task_state deleting. {{(pid=75337) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 15:43:27 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:43:27 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-e8d88afe-1e71-427a-9e65-056efe2cf3d9 tempest-VolumesAssistedSnapshotsTest-618385559 tempest-VolumesAssistedSnapshotsTest-618385559-project-member] Acquiring lock "cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:43:27 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-e8d88afe-1e71-427a-9e65-056efe2cf3d9 tempest-VolumesAssistedSnapshotsTest-618385559 tempest-VolumesAssistedSnapshotsTest-618385559-project-member] Lock "cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:43:27 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-e8d88afe-1e71-427a-9e65-056efe2cf3d9 tempest-VolumesAssistedSnapshotsTest-618385559 tempest-VolumesAssistedSnapshotsTest-618385559-project-member] Acquiring lock "cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:43:27 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-e8d88afe-1e71-427a-9e65-056efe2cf3d9 tempest-VolumesAssistedSnapshotsTest-618385559 tempest-VolumesAssistedSnapshotsTest-618385559-project-member] Lock "cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:43:27 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-e8d88afe-1e71-427a-9e65-056efe2cf3d9 tempest-VolumesAssistedSnapshotsTest-618385559 tempest-VolumesAssistedSnapshotsTest-618385559-project-member] Lock "cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:43:27 user nova-compute[75337]: INFO nova.compute.manager [None req-e8d88afe-1e71-427a-9e65-056efe2cf3d9 tempest-VolumesAssistedSnapshotsTest-618385559 tempest-VolumesAssistedSnapshotsTest-618385559-project-member] [instance: cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1] Terminating instance
Nov 06 15:43:27 user nova-compute[75337]: DEBUG nova.compute.manager [None req-e8d88afe-1e71-427a-9e65-056efe2cf3d9 tempest-VolumesAssistedSnapshotsTest-618385559 tempest-VolumesAssistedSnapshotsTest-618385559-project-member] [instance: cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1] Start destroying the instance on the hypervisor. {{(pid=75337) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 15:43:28 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:43:28 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:43:28 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:43:28 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:43:28 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:43:28 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:43:29 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:43:29 user nova-compute[75337]: DEBUG nova.compute.manager [req-a157d16a-fe0a-45a6-be01-bd7cf8607a37 req-cd75fc65-d074-473a-a94c-279ee10c7e2b service nova] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Received event network-vif-plugged-5d25f565-70a5-427c-a198-4f88dd8b7338 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:43:29 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-a157d16a-fe0a-45a6-be01-bd7cf8607a37 req-cd75fc65-d074-473a-a94c-279ee10c7e2b service nova] Acquiring lock "67d9ceff-c1fc-48ad-85c8-3aa37ebabf11-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:43:29 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-a157d16a-fe0a-45a6-be01-bd7cf8607a37 req-cd75fc65-d074-473a-a94c-279ee10c7e2b service nova] Lock "67d9ceff-c1fc-48ad-85c8-3aa37ebabf11-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:43:29 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-a157d16a-fe0a-45a6-be01-bd7cf8607a37 req-cd75fc65-d074-473a-a94c-279ee10c7e2b service nova] Lock "67d9ceff-c1fc-48ad-85c8-3aa37ebabf11-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:43:29 user nova-compute[75337]: DEBUG nova.compute.manager [req-a157d16a-fe0a-45a6-be01-bd7cf8607a37 req-cd75fc65-d074-473a-a94c-279ee10c7e2b service nova] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] No waiting events found dispatching network-vif-plugged-5d25f565-70a5-427c-a198-4f88dd8b7338 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:43:29 user nova-compute[75337]: WARNING nova.compute.manager [req-a157d16a-fe0a-45a6-be01-bd7cf8607a37 req-cd75fc65-d074-473a-a94c-279ee10c7e2b service nova] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Received unexpected event network-vif-plugged-5d25f565-70a5-427c-a198-4f88dd8b7338 for instance with vm_state active and task_state deleting.
Nov 06 15:43:29 user nova-compute[75337]: DEBUG nova.compute.manager [req-a157d16a-fe0a-45a6-be01-bd7cf8607a37 req-cd75fc65-d074-473a-a94c-279ee10c7e2b service nova] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Received event network-vif-unplugged-ac99553f-c5d8-46df-8357-f1f7f189fa22 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:43:29 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-a157d16a-fe0a-45a6-be01-bd7cf8607a37 req-cd75fc65-d074-473a-a94c-279ee10c7e2b service nova] Acquiring lock "67d9ceff-c1fc-48ad-85c8-3aa37ebabf11-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:43:29 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-a157d16a-fe0a-45a6-be01-bd7cf8607a37 req-cd75fc65-d074-473a-a94c-279ee10c7e2b service nova] Lock "67d9ceff-c1fc-48ad-85c8-3aa37ebabf11-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:43:29 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-a157d16a-fe0a-45a6-be01-bd7cf8607a37 req-cd75fc65-d074-473a-a94c-279ee10c7e2b service nova] Lock "67d9ceff-c1fc-48ad-85c8-3aa37ebabf11-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:43:29 user nova-compute[75337]: DEBUG nova.compute.manager [req-a157d16a-fe0a-45a6-be01-bd7cf8607a37 req-cd75fc65-d074-473a-a94c-279ee10c7e2b service nova] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] No waiting events found dispatching network-vif-unplugged-ac99553f-c5d8-46df-8357-f1f7f189fa22 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:43:29 user nova-compute[75337]: DEBUG nova.compute.manager [req-a157d16a-fe0a-45a6-be01-bd7cf8607a37 req-cd75fc65-d074-473a-a94c-279ee10c7e2b service nova] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Received event network-vif-unplugged-ac99553f-c5d8-46df-8357-f1f7f189fa22 for instance with task_state deleting. {{(pid=75337) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 15:43:29 user nova-compute[75337]: DEBUG nova.compute.manager [req-a157d16a-fe0a-45a6-be01-bd7cf8607a37 req-cd75fc65-d074-473a-a94c-279ee10c7e2b service nova] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Received event network-vif-plugged-ac99553f-c5d8-46df-8357-f1f7f189fa22 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:43:29 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-a157d16a-fe0a-45a6-be01-bd7cf8607a37 req-cd75fc65-d074-473a-a94c-279ee10c7e2b service nova] Acquiring lock "67d9ceff-c1fc-48ad-85c8-3aa37ebabf11-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:43:29 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-a157d16a-fe0a-45a6-be01-bd7cf8607a37 req-cd75fc65-d074-473a-a94c-279ee10c7e2b service nova] Lock "67d9ceff-c1fc-48ad-85c8-3aa37ebabf11-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:43:29 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-a157d16a-fe0a-45a6-be01-bd7cf8607a37 req-cd75fc65-d074-473a-a94c-279ee10c7e2b service nova] Lock "67d9ceff-c1fc-48ad-85c8-3aa37ebabf11-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.009s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:43:29 user nova-compute[75337]: DEBUG nova.compute.manager [req-a157d16a-fe0a-45a6-be01-bd7cf8607a37 req-cd75fc65-d074-473a-a94c-279ee10c7e2b service nova] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] No waiting events found dispatching network-vif-plugged-ac99553f-c5d8-46df-8357-f1f7f189fa22 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:43:29 user nova-compute[75337]: WARNING nova.compute.manager [req-a157d16a-fe0a-45a6-be01-bd7cf8607a37 req-cd75fc65-d074-473a-a94c-279ee10c7e2b service nova] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Received unexpected event network-vif-plugged-ac99553f-c5d8-46df-8357-f1f7f189fa22 for instance with vm_state active and task_state deleting.
Nov 06 15:43:29 user nova-compute[75337]: DEBUG nova.compute.manager [req-a157d16a-fe0a-45a6-be01-bd7cf8607a37 req-cd75fc65-d074-473a-a94c-279ee10c7e2b service nova] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Received event network-vif-unplugged-abf73a6f-c3c7-46b5-8a9b-0fce5677fa27 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:43:29 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-a157d16a-fe0a-45a6-be01-bd7cf8607a37 req-cd75fc65-d074-473a-a94c-279ee10c7e2b service nova] Acquiring lock "67d9ceff-c1fc-48ad-85c8-3aa37ebabf11-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:43:29 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-a157d16a-fe0a-45a6-be01-bd7cf8607a37 req-cd75fc65-d074-473a-a94c-279ee10c7e2b service nova] Lock "67d9ceff-c1fc-48ad-85c8-3aa37ebabf11-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:43:29 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-a157d16a-fe0a-45a6-be01-bd7cf8607a37 req-cd75fc65-d074-473a-a94c-279ee10c7e2b service nova] Lock "67d9ceff-c1fc-48ad-85c8-3aa37ebabf11-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:43:29 user nova-compute[75337]: DEBUG nova.compute.manager [req-a157d16a-fe0a-45a6-be01-bd7cf8607a37 req-cd75fc65-d074-473a-a94c-279ee10c7e2b service nova] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] No waiting events found dispatching network-vif-unplugged-abf73a6f-c3c7-46b5-8a9b-0fce5677fa27 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:43:29 user nova-compute[75337]: DEBUG nova.compute.manager [req-a157d16a-fe0a-45a6-be01-bd7cf8607a37 req-cd75fc65-d074-473a-a94c-279ee10c7e2b service nova] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Received event network-vif-unplugged-abf73a6f-c3c7-46b5-8a9b-0fce5677fa27 for instance with task_state deleting. {{(pid=75337) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 15:43:29 user nova-compute[75337]: DEBUG nova.compute.manager [req-a157d16a-fe0a-45a6-be01-bd7cf8607a37 req-cd75fc65-d074-473a-a94c-279ee10c7e2b service nova] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Received event network-vif-plugged-abf73a6f-c3c7-46b5-8a9b-0fce5677fa27 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:43:29 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-a157d16a-fe0a-45a6-be01-bd7cf8607a37 req-cd75fc65-d074-473a-a94c-279ee10c7e2b service nova] Acquiring lock "67d9ceff-c1fc-48ad-85c8-3aa37ebabf11-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:43:29 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-a157d16a-fe0a-45a6-be01-bd7cf8607a37 req-cd75fc65-d074-473a-a94c-279ee10c7e2b service nova] Lock "67d9ceff-c1fc-48ad-85c8-3aa37ebabf11-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:43:29 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-a157d16a-fe0a-45a6-be01-bd7cf8607a37 req-cd75fc65-d074-473a-a94c-279ee10c7e2b service nova] Lock "67d9ceff-c1fc-48ad-85c8-3aa37ebabf11-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:43:29 user nova-compute[75337]: DEBUG nova.compute.manager [req-a157d16a-fe0a-45a6-be01-bd7cf8607a37 req-cd75fc65-d074-473a-a94c-279ee10c7e2b service nova] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] No waiting events found dispatching network-vif-plugged-abf73a6f-c3c7-46b5-8a9b-0fce5677fa27 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:43:29 user nova-compute[75337]: WARNING nova.compute.manager [req-a157d16a-fe0a-45a6-be01-bd7cf8607a37 req-cd75fc65-d074-473a-a94c-279ee10c7e2b service nova] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Received unexpected event network-vif-plugged-abf73a6f-c3c7-46b5-8a9b-0fce5677fa27 for instance with vm_state active and task_state deleting.
Nov 06 15:43:29 user nova-compute[75337]: DEBUG nova.compute.manager [req-a157d16a-fe0a-45a6-be01-bd7cf8607a37 req-cd75fc65-d074-473a-a94c-279ee10c7e2b service nova] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Received event network-vif-unplugged-ba50db67-9fb0-49ef-9ea2-db9014b66b17 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:43:29 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-a157d16a-fe0a-45a6-be01-bd7cf8607a37 req-cd75fc65-d074-473a-a94c-279ee10c7e2b service nova] Acquiring lock "67d9ceff-c1fc-48ad-85c8-3aa37ebabf11-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:43:29 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-a157d16a-fe0a-45a6-be01-bd7cf8607a37 req-cd75fc65-d074-473a-a94c-279ee10c7e2b service nova] Lock "67d9ceff-c1fc-48ad-85c8-3aa37ebabf11-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:43:29 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-a157d16a-fe0a-45a6-be01-bd7cf8607a37 req-cd75fc65-d074-473a-a94c-279ee10c7e2b service nova] Lock "67d9ceff-c1fc-48ad-85c8-3aa37ebabf11-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:43:29 user nova-compute[75337]: DEBUG nova.compute.manager [req-a157d16a-fe0a-45a6-be01-bd7cf8607a37 req-cd75fc65-d074-473a-a94c-279ee10c7e2b service nova] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] No waiting events found dispatching network-vif-unplugged-ba50db67-9fb0-49ef-9ea2-db9014b66b17 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:43:29 user nova-compute[75337]: DEBUG nova.compute.manager [req-a157d16a-fe0a-45a6-be01-bd7cf8607a37 req-cd75fc65-d074-473a-a94c-279ee10c7e2b service nova] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Received event network-vif-unplugged-ba50db67-9fb0-49ef-9ea2-db9014b66b17 for instance with task_state deleting. {{(pid=75337) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 15:43:29 user nova-compute[75337]: INFO nova.virt.libvirt.driver [-] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Instance destroyed successfully.
Nov 06 15:43:29 user nova-compute[75337]: DEBUG nova.objects.instance [None req-1827f735-7849-46b7-94a4-a93a1fdfc874 tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Lazy-loading 'resources' on Instance uuid 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 15:43:29 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-1827f735-7849-46b7-94a4-a93a1fdfc874 tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T15:39:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-33947962',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-33947962',id=10,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIdCNKzLiAn2Q13xbOCD8ZPlD+eO//YVXoFIvGbsPKz6uIG05Zl46YzdZNVppAESHBJ5c7x504UoPOi2h4C/rReLxZIefNMfs782HxaAMxatIuv5bfUOf4RFetVf3rDbPw==',key_name='tempest-keypair-2077757082',keypairs=<?>,launch_index=0,launched_at=2023-11-06T15:41:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='664f419c1b904bb3bdd7aff9e621e2e4',ramdisk_id='',reservation_id='r-inl405pu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1790653325',owner_user_name='tempest-TaggedBootDevicesTest-1790653325-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T15:41:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8a81cde9102743438dd8b84183048cae',uuid=67d9ceff-c1fc-48ad-85c8-3aa37ebabf11,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5d25f565-70a5-427c-a198-4f88dd8b7338", "address": "fa:16:3e:39:62:9f", "network": {"id": "4b3a9463-7120-499a-bdef-bd2ce9443d88", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1482718546-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "664f419c1b904bb3bdd7aff9e621e2e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d25f565-70", "ovs_interfaceid": "5d25f565-70a5-427c-a198-4f88dd8b7338", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 15:43:29 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-1827f735-7849-46b7-94a4-a93a1fdfc874 tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Converting VIF {"id": "5d25f565-70a5-427c-a198-4f88dd8b7338", "address": "fa:16:3e:39:62:9f", "network": {"id": "4b3a9463-7120-499a-bdef-bd2ce9443d88", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1482718546-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "664f419c1b904bb3bdd7aff9e621e2e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d25f565-70", "ovs_interfaceid": "5d25f565-70a5-427c-a198-4f88dd8b7338", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 15:43:29 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-1827f735-7849-46b7-94a4-a93a1fdfc874 tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:39:62:9f,bridge_name='br-int',has_traffic_filtering=True,id=5d25f565-70a5-427c-a198-4f88dd8b7338,network=Network(4b3a9463-7120-499a-bdef-bd2ce9443d88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d25f565-70') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 15:43:29 user nova-compute[75337]: DEBUG os_vif [None req-1827f735-7849-46b7-94a4-a93a1fdfc874 tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:39:62:9f,bridge_name='br-int',has_traffic_filtering=True,id=5d25f565-70a5-427c-a198-4f88dd8b7338,network=Network(4b3a9463-7120-499a-bdef-bd2ce9443d88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d25f565-70') {{(pid=75337) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 15:43:29 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:43:29 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5d25f565-70, bridge=br-int, if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:43:29 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:43:29 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:43:29 user nova-compute[75337]: INFO nova.virt.libvirt.driver [-] [instance: cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1] Instance destroyed successfully.
Nov 06 15:43:29 user nova-compute[75337]: DEBUG nova.objects.instance [None req-e8d88afe-1e71-427a-9e65-056efe2cf3d9 tempest-VolumesAssistedSnapshotsTest-618385559 tempest-VolumesAssistedSnapshotsTest-618385559-project-member] Lazy-loading 'resources' on Instance uuid cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 15:43:29 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-e8d88afe-1e71-427a-9e65-056efe2cf3d9 tempest-VolumesAssistedSnapshotsTest-618385559 tempest-VolumesAssistedSnapshotsTest-618385559-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T15:38:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1302777858',display_name='tempest-VolumesAssistedSnapshotsTest-server-1302777858',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1302777858',id=8,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIhsWHqDTODuLcBxiRUSQheX7d86sMhaM965PgzxoYCmGvOCnp3yCsCa+wanUUhhGedZ+08YfH+0isFE7PuB7qhSLyignpBOtvy6G/pBgvG8dRo87M+p5bgGHRyEayA+oQ==',key_name='tempest-keypair-160800368',keypairs=<?>,launch_index=0,launched_at=2023-11-06T15:38:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='680aa228c77c472abce167f646caeffd',ramdisk_id='',reservation_id='r-2tji0rxr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-618385559',owner_user_name='tempest-VolumesAssistedSnapshotsTest-618385559-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T15:38:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='68419640fdfc49f2a7f25fabecba9b42',uuid=cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5b01e7c7-929d-4e31-b8d4-e4ba3bba4ea2", "address": "fa:16:3e:67:5c:a5", "network": {"id": "dd669c8a-2e05-46a7-a5e7-4dc06eec4b48", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2014981732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "680aa228c77c472abce167f646caeffd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b01e7c7-92", "ovs_interfaceid": "5b01e7c7-929d-4e31-b8d4-e4ba3bba4ea2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 15:43:29 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-e8d88afe-1e71-427a-9e65-056efe2cf3d9 tempest-VolumesAssistedSnapshotsTest-618385559 tempest-VolumesAssistedSnapshotsTest-618385559-project-member] Converting VIF {"id": "5b01e7c7-929d-4e31-b8d4-e4ba3bba4ea2", "address": "fa:16:3e:67:5c:a5", "network": {"id": "dd669c8a-2e05-46a7-a5e7-4dc06eec4b48", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2014981732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "680aa228c77c472abce167f646caeffd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b01e7c7-92", "ovs_interfaceid": "5b01e7c7-929d-4e31-b8d4-e4ba3bba4ea2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 15:43:29 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-e8d88afe-1e71-427a-9e65-056efe2cf3d9 tempest-VolumesAssistedSnapshotsTest-618385559 tempest-VolumesAssistedSnapshotsTest-618385559-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:67:5c:a5,bridge_name='br-int',has_traffic_filtering=True,id=5b01e7c7-929d-4e31-b8d4-e4ba3bba4ea2,network=Network(dd669c8a-2e05-46a7-a5e7-4dc06eec4b48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b01e7c7-92') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 15:43:29 user nova-compute[75337]: DEBUG os_vif [None req-e8d88afe-1e71-427a-9e65-056efe2cf3d9 tempest-VolumesAssistedSnapshotsTest-618385559 tempest-VolumesAssistedSnapshotsTest-618385559-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:67:5c:a5,bridge_name='br-int',has_traffic_filtering=True,id=5b01e7c7-929d-4e31-b8d4-e4ba3bba4ea2,network=Network(dd669c8a-2e05-46a7-a5e7-4dc06eec4b48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b01e7c7-92') {{(pid=75337) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 15:43:29 user nova-compute[75337]: DEBUG nova.compute.manager [req-695d09b7-a724-43df-aec4-18af934ec98d req-6ba4ace6-b71f-4d1b-9a50-525c8b38d093 service nova] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Received event network-vif-plugged-e87c0766-dd71-4aca-b5f0-32888c7437f5 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:43:29 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-695d09b7-a724-43df-aec4-18af934ec98d req-6ba4ace6-b71f-4d1b-9a50-525c8b38d093 service nova] Acquiring lock "67d9ceff-c1fc-48ad-85c8-3aa37ebabf11-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:43:29 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-695d09b7-a724-43df-aec4-18af934ec98d req-6ba4ace6-b71f-4d1b-9a50-525c8b38d093 service nova] Lock "67d9ceff-c1fc-48ad-85c8-3aa37ebabf11-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:43:29 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-695d09b7-a724-43df-aec4-18af934ec98d req-6ba4ace6-b71f-4d1b-9a50-525c8b38d093 service nova] Lock "67d9ceff-c1fc-48ad-85c8-3aa37ebabf11-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:43:29 user nova-compute[75337]: DEBUG nova.compute.manager [req-695d09b7-a724-43df-aec4-18af934ec98d req-6ba4ace6-b71f-4d1b-9a50-525c8b38d093 service nova] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] No waiting events found dispatching network-vif-plugged-e87c0766-dd71-4aca-b5f0-32888c7437f5 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:43:29 user nova-compute[75337]: WARNING nova.compute.manager [req-695d09b7-a724-43df-aec4-18af934ec98d req-6ba4ace6-b71f-4d1b-9a50-525c8b38d093 service nova] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Received unexpected event network-vif-plugged-e87c0766-dd71-4aca-b5f0-32888c7437f5 for instance with vm_state active and task_state deleting.
Nov 06 15:43:29 user nova-compute[75337]: DEBUG nova.compute.manager [req-695d09b7-a724-43df-aec4-18af934ec98d req-6ba4ace6-b71f-4d1b-9a50-525c8b38d093 service nova] [instance: cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1] Received event network-vif-unplugged-5b01e7c7-929d-4e31-b8d4-e4ba3bba4ea2 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:43:29 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-695d09b7-a724-43df-aec4-18af934ec98d req-6ba4ace6-b71f-4d1b-9a50-525c8b38d093 service nova] Acquiring lock "cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:43:29 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-695d09b7-a724-43df-aec4-18af934ec98d req-6ba4ace6-b71f-4d1b-9a50-525c8b38d093 service nova] Lock "cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:43:29 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-695d09b7-a724-43df-aec4-18af934ec98d req-6ba4ace6-b71f-4d1b-9a50-525c8b38d093 service nova] Lock "cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:43:29 user nova-compute[75337]: DEBUG nova.compute.manager [req-695d09b7-a724-43df-aec4-18af934ec98d req-6ba4ace6-b71f-4d1b-9a50-525c8b38d093 service nova] [instance: cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1] No waiting events found dispatching network-vif-unplugged-5b01e7c7-929d-4e31-b8d4-e4ba3bba4ea2 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:43:29 user nova-compute[75337]: DEBUG nova.compute.manager [req-695d09b7-a724-43df-aec4-18af934ec98d req-6ba4ace6-b71f-4d1b-9a50-525c8b38d093 service nova] [instance: cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1] Received event network-vif-unplugged-5b01e7c7-929d-4e31-b8d4-e4ba3bba4ea2 for instance with task_state deleting. {{(pid=75337) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 15:43:29 user nova-compute[75337]: DEBUG nova.compute.manager [req-695d09b7-a724-43df-aec4-18af934ec98d req-6ba4ace6-b71f-4d1b-9a50-525c8b38d093 service nova] [instance: cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1] Received event network-vif-plugged-5b01e7c7-929d-4e31-b8d4-e4ba3bba4ea2 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:43:29 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-695d09b7-a724-43df-aec4-18af934ec98d req-6ba4ace6-b71f-4d1b-9a50-525c8b38d093 service nova] Acquiring lock "cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:43:29 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-695d09b7-a724-43df-aec4-18af934ec98d req-6ba4ace6-b71f-4d1b-9a50-525c8b38d093 service nova] Lock "cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:43:29 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-695d09b7-a724-43df-aec4-18af934ec98d req-6ba4ace6-b71f-4d1b-9a50-525c8b38d093 service nova] Lock "cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:43:29 user nova-compute[75337]: DEBUG nova.compute.manager [req-695d09b7-a724-43df-aec4-18af934ec98d req-6ba4ace6-b71f-4d1b-9a50-525c8b38d093 service nova] [instance: cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1] No waiting events found dispatching network-vif-plugged-5b01e7c7-929d-4e31-b8d4-e4ba3bba4ea2 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:43:29 user nova-compute[75337]: WARNING nova.compute.manager [req-695d09b7-a724-43df-aec4-18af934ec98d req-6ba4ace6-b71f-4d1b-9a50-525c8b38d093 service nova] [instance: cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1] Received unexpected event network-vif-plugged-5b01e7c7-929d-4e31-b8d4-e4ba3bba4ea2 for instance with vm_state active and task_state deleting.
Nov 06 15:43:29 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:43:29 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:43:29 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5b01e7c7-92, bridge=br-int, if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:43:29 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:43:29 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:43:29 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:43:29 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:43:29 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4c5224b9-1d28-4d07-872f-899aa3a27b11) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:43:29 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:43:29 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:43:29 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:43:29 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:43:29 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=016244cb-42d5-4b3d-b9b5-980253f9b056) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:43:29 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:43:29 user nova-compute[75337]: INFO os_vif [None req-1827f735-7849-46b7-94a4-a93a1fdfc874 tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:39:62:9f,bridge_name='br-int',has_traffic_filtering=True,id=5d25f565-70a5-427c-a198-4f88dd8b7338,network=Network(4b3a9463-7120-499a-bdef-bd2ce9443d88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d25f565-70')
Nov 06 15:43:29 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-1827f735-7849-46b7-94a4-a93a1fdfc874 tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T15:39:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-33947962',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-33947962',id=10,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIdCNKzLiAn2Q13xbOCD8ZPlD+eO//YVXoFIvGbsPKz6uIG05Zl46YzdZNVppAESHBJ5c7x504UoPOi2h4C/rReLxZIefNMfs782HxaAMxatIuv5bfUOf4RFetVf3rDbPw==',key_name='tempest-keypair-2077757082',keypairs=<?>,launch_index=0,launched_at=2023-11-06T15:41:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='664f419c1b904bb3bdd7aff9e621e2e4',ramdisk_id='',reservation_id='r-inl405pu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1790653325',owner_user_name='tempest-TaggedBootDevicesTest-1790653325-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T15:41:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8a81cde9102743438dd8b84183048cae',uuid=67d9ceff-c1fc-48ad-85c8-3aa37ebabf11,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ac99553f-c5d8-46df-8357-f1f7f189fa22", "address": "fa:16:3e:37:11:e5", "network": {"id": "793579d8-5696-4c41-b09e-19e19908b703", "bridge": "br-int", "label": "tempest-device-tagging-net1-1052173633", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.61", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "664f419c1b904bb3bdd7aff9e621e2e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac99553f-c5", "ovs_interfaceid": "ac99553f-c5d8-46df-8357-f1f7f189fa22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75337) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 15:43:29 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-1827f735-7849-46b7-94a4-a93a1fdfc874 tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Converting VIF {"id": "ac99553f-c5d8-46df-8357-f1f7f189fa22", "address": "fa:16:3e:37:11:e5", "network": {"id": "793579d8-5696-4c41-b09e-19e19908b703", "bridge": "br-int", "label": "tempest-device-tagging-net1-1052173633", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.61", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "664f419c1b904bb3bdd7aff9e621e2e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac99553f-c5", "ovs_interfaceid": "ac99553f-c5d8-46df-8357-f1f7f189fa22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 15:43:29 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-1827f735-7849-46b7-94a4-a93a1fdfc874 tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:11:e5,bridge_name='br-int',has_traffic_filtering=True,id=ac99553f-c5d8-46df-8357-f1f7f189fa22,network=Network(793579d8-5696-4c41-b09e-19e19908b703),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapac99553f-c5') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 15:43:29 user nova-compute[75337]: DEBUG os_vif [None req-1827f735-7849-46b7-94a4-a93a1fdfc874 tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:11:e5,bridge_name='br-int',has_traffic_filtering=True,id=ac99553f-c5d8-46df-8357-f1f7f189fa22,network=Network(793579d8-5696-4c41-b09e-19e19908b703),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapac99553f-c5') {{(pid=75337) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 15:43:29 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:43:29 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:43:29 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:43:29 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapac99553f-c5, bridge=br-int, if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:43:29 user nova-compute[75337]: INFO os_vif [None req-e8d88afe-1e71-427a-9e65-056efe2cf3d9 tempest-VolumesAssistedSnapshotsTest-618385559 tempest-VolumesAssistedSnapshotsTest-618385559-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:67:5c:a5,bridge_name='br-int',has_traffic_filtering=True,id=5b01e7c7-929d-4e31-b8d4-e4ba3bba4ea2,network=Network(dd669c8a-2e05-46a7-a5e7-4dc06eec4b48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b01e7c7-92')
Nov 06 15:43:29 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-e8d88afe-1e71-427a-9e65-056efe2cf3d9 tempest-VolumesAssistedSnapshotsTest-618385559 tempest-VolumesAssistedSnapshotsTest-618385559-project-member] [instance: cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1] Deleting instance files /opt/stack/data/nova/instances/cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1_del
Nov 06 15:43:29 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-e8d88afe-1e71-427a-9e65-056efe2cf3d9 tempest-VolumesAssistedSnapshotsTest-618385559 tempest-VolumesAssistedSnapshotsTest-618385559-project-member] [instance: cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1] Deletion of /opt/stack/data/nova/instances/cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1_del complete
Nov 06 15:43:29 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:43:29 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:43:29 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:43:29 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:43:29 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d2a2e8e6-14a8-49f2-88f7-eea2e9388ef5) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:43:29 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:43:29 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:43:29 user nova-compute[75337]: INFO nova.compute.manager [None req-e8d88afe-1e71-427a-9e65-056efe2cf3d9 tempest-VolumesAssistedSnapshotsTest-618385559 tempest-VolumesAssistedSnapshotsTest-618385559-project-member] [instance: cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1] Took 1.99 seconds to destroy the instance on the hypervisor.
Nov 06 15:43:29 user nova-compute[75337]: DEBUG oslo.service.loopingcall [None req-e8d88afe-1e71-427a-9e65-056efe2cf3d9 tempest-VolumesAssistedSnapshotsTest-618385559 tempest-VolumesAssistedSnapshotsTest-618385559-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75337) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 15:43:29 user nova-compute[75337]: DEBUG nova.compute.manager [-] [instance: cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1] Deallocating network for instance {{(pid=75337) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 15:43:29 user nova-compute[75337]: DEBUG nova.network.neutron [-] [instance: cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1] deallocate_for_instance() {{(pid=75337) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 15:43:29 user nova-compute[75337]: DEBUG nova.compute.manager [req-2a7bcdb1-d640-408b-a248-ad2851894bd2 req-d0c73dfa-b023-4cc3-b4f8-f5d1c61bd44a service nova] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Received event network-vif-plugged-94df5f62-239e-4b8e-a91d-5223c1585f6f {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:43:29 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-2a7bcdb1-d640-408b-a248-ad2851894bd2 req-d0c73dfa-b023-4cc3-b4f8-f5d1c61bd44a service nova] Acquiring lock "67d9ceff-c1fc-48ad-85c8-3aa37ebabf11-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:43:29 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-2a7bcdb1-d640-408b-a248-ad2851894bd2 req-d0c73dfa-b023-4cc3-b4f8-f5d1c61bd44a service nova] Lock "67d9ceff-c1fc-48ad-85c8-3aa37ebabf11-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:43:29 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-2a7bcdb1-d640-408b-a248-ad2851894bd2 req-d0c73dfa-b023-4cc3-b4f8-f5d1c61bd44a service nova] Lock "67d9ceff-c1fc-48ad-85c8-3aa37ebabf11-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:43:29 user nova-compute[75337]: DEBUG nova.compute.manager [req-2a7bcdb1-d640-408b-a248-ad2851894bd2 req-d0c73dfa-b023-4cc3-b4f8-f5d1c61bd44a service nova] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] No waiting events found dispatching network-vif-plugged-94df5f62-239e-4b8e-a91d-5223c1585f6f {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:43:29 user nova-compute[75337]: WARNING nova.compute.manager [req-2a7bcdb1-d640-408b-a248-ad2851894bd2 req-d0c73dfa-b023-4cc3-b4f8-f5d1c61bd44a service nova] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Received unexpected event network-vif-plugged-94df5f62-239e-4b8e-a91d-5223c1585f6f for instance with vm_state active and task_state deleting.
Nov 06 15:43:29 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:43:30 user nova-compute[75337]: INFO os_vif [None req-1827f735-7849-46b7-94a4-a93a1fdfc874 tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:11:e5,bridge_name='br-int',has_traffic_filtering=True,id=ac99553f-c5d8-46df-8357-f1f7f189fa22,network=Network(793579d8-5696-4c41-b09e-19e19908b703),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapac99553f-c5')
Nov 06 15:43:30 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-1827f735-7849-46b7-94a4-a93a1fdfc874 tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T15:39:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-33947962',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-33947962',id=10,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIdCNKzLiAn2Q13xbOCD8ZPlD+eO//YVXoFIvGbsPKz6uIG05Zl46YzdZNVppAESHBJ5c7x504UoPOi2h4C/rReLxZIefNMfs782HxaAMxatIuv5bfUOf4RFetVf3rDbPw==',key_name='tempest-keypair-2077757082',keypairs=<?>,launch_index=0,launched_at=2023-11-06T15:41:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='664f419c1b904bb3bdd7aff9e621e2e4',ramdisk_id='',reservation_id='r-inl405pu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1790653325',owner_user_name='tempest-TaggedBootDevicesTest-1790653325-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T15:41:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8a81cde9102743438dd8b84183048cae',uuid=67d9ceff-c1fc-48ad-85c8-3aa37ebabf11,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "abf73a6f-c3c7-46b5-8a9b-0fce5677fa27", "address": "fa:16:3e:68:66:1c", "network": {"id": "793579d8-5696-4c41-b09e-19e19908b703", "bridge": "br-int", "label": "tempest-device-tagging-net1-1052173633", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.239", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "664f419c1b904bb3bdd7aff9e621e2e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabf73a6f-c3", "ovs_interfaceid": "abf73a6f-c3c7-46b5-8a9b-0fce5677fa27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75337) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 15:43:30 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-1827f735-7849-46b7-94a4-a93a1fdfc874 tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Converting VIF {"id": "abf73a6f-c3c7-46b5-8a9b-0fce5677fa27", "address": "fa:16:3e:68:66:1c", "network": {"id": "793579d8-5696-4c41-b09e-19e19908b703", "bridge": "br-int", "label": "tempest-device-tagging-net1-1052173633", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.239", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "664f419c1b904bb3bdd7aff9e621e2e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabf73a6f-c3", "ovs_interfaceid": "abf73a6f-c3c7-46b5-8a9b-0fce5677fa27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 15:43:30 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-1827f735-7849-46b7-94a4-a93a1fdfc874 tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:66:1c,bridge_name='br-int',has_traffic_filtering=True,id=abf73a6f-c3c7-46b5-8a9b-0fce5677fa27,network=Network(793579d8-5696-4c41-b09e-19e19908b703),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapabf73a6f-c3') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 15:43:30 user nova-compute[75337]: DEBUG os_vif [None req-1827f735-7849-46b7-94a4-a93a1fdfc874 tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:66:1c,bridge_name='br-int',has_traffic_filtering=True,id=abf73a6f-c3c7-46b5-8a9b-0fce5677fa27,network=Network(793579d8-5696-4c41-b09e-19e19908b703),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapabf73a6f-c3') {{(pid=75337) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 15:43:30 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:43:30 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapabf73a6f-c3, bridge=br-int, if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:43:30 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:43:30 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:43:30 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:43:30 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:43:30 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c9e41bd1-1fcc-4717-b62f-1c6f85082a59) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:43:30 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:43:30 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:43:30 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:43:30 user nova-compute[75337]: INFO os_vif [None req-1827f735-7849-46b7-94a4-a93a1fdfc874 tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:66:1c,bridge_name='br-int',has_traffic_filtering=True,id=abf73a6f-c3c7-46b5-8a9b-0fce5677fa27,network=Network(793579d8-5696-4c41-b09e-19e19908b703),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapabf73a6f-c3')
Nov 06 15:43:30 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-1827f735-7849-46b7-94a4-a93a1fdfc874 tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T15:39:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-33947962',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-33947962',id=10,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIdCNKzLiAn2Q13xbOCD8ZPlD+eO//YVXoFIvGbsPKz6uIG05Zl46YzdZNVppAESHBJ5c7x504UoPOi2h4C/rReLxZIefNMfs782HxaAMxatIuv5bfUOf4RFetVf3rDbPw==',key_name='tempest-keypair-2077757082',keypairs=<?>,launch_index=0,launched_at=2023-11-06T15:41:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='664f419c1b904bb3bdd7aff9e621e2e4',ramdisk_id='',reservation_id='r-inl405pu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1790653325',owner_user_name='tempest-TaggedBootDevicesTest-1790653325-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T15:41:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8a81cde9102743438dd8b84183048cae',uuid=67d9ceff-c1fc-48ad-85c8-3aa37ebabf11,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e87c0766-dd71-4aca-b5f0-32888c7437f5", "address": "fa:16:3e:b5:06:33", "network": {"id": "793579d8-5696-4c41-b09e-19e19908b703", "bridge": "br-int", "label": "tempest-device-tagging-net1-1052173633", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "664f419c1b904bb3bdd7aff9e621e2e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape87c0766-dd", "ovs_interfaceid": "e87c0766-dd71-4aca-b5f0-32888c7437f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 15:43:30 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-1827f735-7849-46b7-94a4-a93a1fdfc874 tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Converting VIF {"id": "e87c0766-dd71-4aca-b5f0-32888c7437f5", "address": "fa:16:3e:b5:06:33", "network": {"id": "793579d8-5696-4c41-b09e-19e19908b703", "bridge": "br-int", "label": "tempest-device-tagging-net1-1052173633", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "664f419c1b904bb3bdd7aff9e621e2e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape87c0766-dd", "ovs_interfaceid": "e87c0766-dd71-4aca-b5f0-32888c7437f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 15:43:30 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-1827f735-7849-46b7-94a4-a93a1fdfc874 tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:06:33,bridge_name='br-int',has_traffic_filtering=True,id=e87c0766-dd71-4aca-b5f0-32888c7437f5,network=Network(793579d8-5696-4c41-b09e-19e19908b703),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape87c0766-dd') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 15:43:30 user nova-compute[75337]: DEBUG os_vif [None req-1827f735-7849-46b7-94a4-a93a1fdfc874 tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:06:33,bridge_name='br-int',has_traffic_filtering=True,id=e87c0766-dd71-4aca-b5f0-32888c7437f5,network=Network(793579d8-5696-4c41-b09e-19e19908b703),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape87c0766-dd') {{(pid=75337) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 15:43:30 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:43:30 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape87c0766-dd, bridge=br-int, if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:43:30 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:43:30 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:43:30 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:43:30 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:43:30 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f469b7fc-c522-4c88-babc-e58b0826d9e0) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:43:30 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:43:30 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:43:30 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:43:30 user nova-compute[75337]: INFO os_vif [None req-1827f735-7849-46b7-94a4-a93a1fdfc874 tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:06:33,bridge_name='br-int',has_traffic_filtering=True,id=e87c0766-dd71-4aca-b5f0-32888c7437f5,network=Network(793579d8-5696-4c41-b09e-19e19908b703),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape87c0766-dd')
Nov 06 15:43:30 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-1827f735-7849-46b7-94a4-a93a1fdfc874 tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T15:39:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-33947962',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-33947962',id=10,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIdCNKzLiAn2Q13xbOCD8ZPlD+eO//YVXoFIvGbsPKz6uIG05Zl46YzdZNVppAESHBJ5c7x504UoPOi2h4C/rReLxZIefNMfs782HxaAMxatIuv5bfUOf4RFetVf3rDbPw==',key_name='tempest-keypair-2077757082',keypairs=<?>,launch_index=0,launched_at=2023-11-06T15:41:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='664f419c1b904bb3bdd7aff9e621e2e4',ramdisk_id='',reservation_id='r-inl405pu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1790653325',owner_user_name='tempest-TaggedBootDevicesTest-1790653325-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T15:41:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8a81cde9102743438dd8b84183048cae',uuid=67d9ceff-c1fc-48ad-85c8-3aa37ebabf11,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ba50db67-9fb0-49ef-9ea2-db9014b66b17", "address": "fa:16:3e:1a:f9:b0", "network": {"id": "793579d8-5696-4c41-b09e-19e19908b703", "bridge": "br-int", "label": "tempest-device-tagging-net1-1052173633", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "664f419c1b904bb3bdd7aff9e621e2e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba50db67-9f", "ovs_interfaceid": "ba50db67-9fb0-49ef-9ea2-db9014b66b17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 15:43:30 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-1827f735-7849-46b7-94a4-a93a1fdfc874 tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Converting VIF {"id": "ba50db67-9fb0-49ef-9ea2-db9014b66b17", "address": "fa:16:3e:1a:f9:b0", "network": {"id": "793579d8-5696-4c41-b09e-19e19908b703", "bridge": "br-int", "label": "tempest-device-tagging-net1-1052173633", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "664f419c1b904bb3bdd7aff9e621e2e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba50db67-9f", "ovs_interfaceid": "ba50db67-9fb0-49ef-9ea2-db9014b66b17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 15:43:30 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-1827f735-7849-46b7-94a4-a93a1fdfc874 tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:f9:b0,bridge_name='br-int',has_traffic_filtering=True,id=ba50db67-9fb0-49ef-9ea2-db9014b66b17,network=Network(793579d8-5696-4c41-b09e-19e19908b703),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba50db67-9f') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 15:43:30 user nova-compute[75337]: DEBUG os_vif [None req-1827f735-7849-46b7-94a4-a93a1fdfc874 tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:f9:b0,bridge_name='br-int',has_traffic_filtering=True,id=ba50db67-9fb0-49ef-9ea2-db9014b66b17,network=Network(793579d8-5696-4c41-b09e-19e19908b703),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba50db67-9f') {{(pid=75337) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 15:43:30 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:43:30 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapba50db67-9f, bridge=br-int, if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:43:30 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:43:30 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:43:30 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:43:30 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:43:30 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=37af5355-180a-46d5-b652-e5b5e69af4eb) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:43:30 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:43:30 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:43:30 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:43:30 user nova-compute[75337]: INFO os_vif [None req-1827f735-7849-46b7-94a4-a93a1fdfc874 tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:f9:b0,bridge_name='br-int',has_traffic_filtering=True,id=ba50db67-9fb0-49ef-9ea2-db9014b66b17,network=Network(793579d8-5696-4c41-b09e-19e19908b703),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba50db67-9f')
Nov 06 15:43:30 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-1827f735-7849-46b7-94a4-a93a1fdfc874 tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T15:39:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-33947962',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-33947962',id=10,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIdCNKzLiAn2Q13xbOCD8ZPlD+eO//YVXoFIvGbsPKz6uIG05Zl46YzdZNVppAESHBJ5c7x504UoPOi2h4C/rReLxZIefNMfs782HxaAMxatIuv5bfUOf4RFetVf3rDbPw==',key_name='tempest-keypair-2077757082',keypairs=<?>,launch_index=0,launched_at=2023-11-06T15:41:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='664f419c1b904bb3bdd7aff9e621e2e4',ramdisk_id='',reservation_id='r-inl405pu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1790653325',owner_user_name='tempest-TaggedBootDevicesTest-1790653325-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T15:41:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8a81cde9102743438dd8b84183048cae',uuid=67d9ceff-c1fc-48ad-85c8-3aa37ebabf11,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e6be4a87-8794-4e4f-91c1-3c417e0c8d62", "address": "fa:16:3e:df:a8:14", "network": {"id": "512e1b59-3c5a-4be6-bf3d-2ee51ce2042a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1219094622", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "664f419c1b904bb3bdd7aff9e621e2e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6be4a87-87", "ovs_interfaceid": "e6be4a87-8794-4e4f-91c1-3c417e0c8d62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 15:43:30 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-1827f735-7849-46b7-94a4-a93a1fdfc874 tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Converting VIF {"id": "e6be4a87-8794-4e4f-91c1-3c417e0c8d62", "address": "fa:16:3e:df:a8:14", "network": {"id": "512e1b59-3c5a-4be6-bf3d-2ee51ce2042a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1219094622", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "664f419c1b904bb3bdd7aff9e621e2e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6be4a87-87", "ovs_interfaceid": "e6be4a87-8794-4e4f-91c1-3c417e0c8d62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 15:43:30 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-1827f735-7849-46b7-94a4-a93a1fdfc874 tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:a8:14,bridge_name='br-int',has_traffic_filtering=True,id=e6be4a87-8794-4e4f-91c1-3c417e0c8d62,network=Network(512e1b59-3c5a-4be6-bf3d-2ee51ce2042a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6be4a87-87') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 15:43:30 user nova-compute[75337]: DEBUG os_vif [None req-1827f735-7849-46b7-94a4-a93a1fdfc874 tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:a8:14,bridge_name='br-int',has_traffic_filtering=True,id=e6be4a87-8794-4e4f-91c1-3c417e0c8d62,network=Network(512e1b59-3c5a-4be6-bf3d-2ee51ce2042a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6be4a87-87') {{(pid=75337) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 15:43:30 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:43:30 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape6be4a87-87, bridge=br-int, if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:43:30 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:43:30 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:43:30 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:43:30 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:43:30 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9bb95b9c-cdb8-42a8-881d-789cfc9a9c03) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:43:30 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:43:30 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:43:30 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:43:30 user nova-compute[75337]: INFO os_vif [None req-1827f735-7849-46b7-94a4-a93a1fdfc874 tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:a8:14,bridge_name='br-int',has_traffic_filtering=True,id=e6be4a87-8794-4e4f-91c1-3c417e0c8d62,network=Network(512e1b59-3c5a-4be6-bf3d-2ee51ce2042a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6be4a87-87')
Nov 06 15:43:30 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-1827f735-7849-46b7-94a4-a93a1fdfc874 tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T15:39:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-33947962',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-33947962',id=10,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIdCNKzLiAn2Q13xbOCD8ZPlD+eO//YVXoFIvGbsPKz6uIG05Zl46YzdZNVppAESHBJ5c7x504UoPOi2h4C/rReLxZIefNMfs782HxaAMxatIuv5bfUOf4RFetVf3rDbPw==',key_name='tempest-keypair-2077757082',keypairs=<?>,launch_index=0,launched_at=2023-11-06T15:41:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='664f419c1b904bb3bdd7aff9e621e2e4',ramdisk_id='',reservation_id='r-inl405pu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1790653325',owner_user_name='tempest-TaggedBootDevicesTest-1790653325-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T15:41:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8a81cde9102743438dd8b84183048cae',uuid=67d9ceff-c1fc-48ad-85c8-3aa37ebabf11,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "94df5f62-239e-4b8e-a91d-5223c1585f6f", "address": "fa:16:3e:03:8e:66", "network": {"id": "512e1b59-3c5a-4be6-bf3d-2ee51ce2042a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1219094622", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "664f419c1b904bb3bdd7aff9e621e2e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94df5f62-23", "ovs_interfaceid": "94df5f62-239e-4b8e-a91d-5223c1585f6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 15:43:30 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-1827f735-7849-46b7-94a4-a93a1fdfc874 tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Converting VIF {"id": "94df5f62-239e-4b8e-a91d-5223c1585f6f", "address": "fa:16:3e:03:8e:66", "network": {"id": "512e1b59-3c5a-4be6-bf3d-2ee51ce2042a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1219094622", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "664f419c1b904bb3bdd7aff9e621e2e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94df5f62-23", "ovs_interfaceid": "94df5f62-239e-4b8e-a91d-5223c1585f6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 15:43:30 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-1827f735-7849-46b7-94a4-a93a1fdfc874 tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:8e:66,bridge_name='br-int',has_traffic_filtering=True,id=94df5f62-239e-4b8e-a91d-5223c1585f6f,network=Network(512e1b59-3c5a-4be6-bf3d-2ee51ce2042a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94df5f62-23') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 15:43:30 user nova-compute[75337]: DEBUG os_vif [None req-1827f735-7849-46b7-94a4-a93a1fdfc874 tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:8e:66,bridge_name='br-int',has_traffic_filtering=True,id=94df5f62-239e-4b8e-a91d-5223c1585f6f,network=Network(512e1b59-3c5a-4be6-bf3d-2ee51ce2042a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94df5f62-23') {{(pid=75337) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 15:43:30 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:43:30 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap94df5f62-23, bridge=br-int, if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:43:30 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:43:30 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:43:30 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:43:30 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fe134bad-f592-4ef1-9aaf-7a99085492f0) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:43:30 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:43:30 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:43:30 user nova-compute[75337]: INFO os_vif [None req-1827f735-7849-46b7-94a4-a93a1fdfc874 tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:8e:66,bridge_name='br-int',has_traffic_filtering=True,id=94df5f62-239e-4b8e-a91d-5223c1585f6f,network=Network(512e1b59-3c5a-4be6-bf3d-2ee51ce2042a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94df5f62-23')
Nov 06 15:43:30 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1827f735-7849-46b7-94a4-a93a1fdfc874 tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] calling os-brick to detach iSCSI Volume {{(pid=75337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 15:43:30 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-1827f735-7849-46b7-94a4-a93a1fdfc874 tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2abc33d0c0>, {'target_iqn': 'iqn.2010-10.org.openstack:4367fb98-2ae9-40c3-a2d0-6e9b0f70dc7c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QAxLaeTs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 15:43:30 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-1827f735-7849-46b7-94a4-a93a1fdfc874 tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 15:43:30 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-1827f735-7849-46b7-94a4-a93a1fdfc874 tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 15:43:30 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-1827f735-7849-46b7-94a4-a93a1fdfc874 tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 15:43:30 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:43:30 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:43:30 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[0495bd77-7027-47a6-9d84-f77b8223732a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:eaf5fc54-be7c-4748-9e2f-12a01971e6f4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0ad85d1f-7027-4997-96c4-991e3969067d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4367fb98-2ae9-40c3-a2d0-6e9b0f70dc7c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:43:30 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-1827f735-7849-46b7-94a4-a93a1fdfc874 tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 15:43:30 user nova-compute[75337]: No targets found.
Nov 06 15:43:30 user nova-compute[75337]: iSNS:
Nov 06 15:43:30 user nova-compute[75337]: No targets found.
Nov 06 15:43:30 user nova-compute[75337]: STATIC:
Nov 06 15:43:30 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e
Nov 06 15:43:30 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 15:43:30 user nova-compute[75337]:                 Iface Name: default
Nov 06 15:43:30 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:eaf5fc54-be7c-4748-9e2f-12a01971e6f4
Nov 06 15:43:30 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 15:43:30 user nova-compute[75337]:                 Iface Name: default
Nov 06 15:43:30 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:0ad85d1f-7027-4997-96c4-991e3969067d
Nov 06 15:43:30 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 15:43:30 user nova-compute[75337]:                 Iface Name: default
Nov 06 15:43:30 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158
Nov 06 15:43:30 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 15:43:30 user nova-compute[75337]:                 Iface Name: default
Nov 06 15:43:30 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759
Nov 06 15:43:30 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 15:43:30 user nova-compute[75337]:                 Iface Name: default
Nov 06 15:43:30 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:4367fb98-2ae9-40c3-a2d0-6e9b0f70dc7c
Nov 06 15:43:30 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 15:43:30 user nova-compute[75337]:                 Iface Name: default
Nov 06 15:43:30 user nova-compute[75337]: FIRMWARE:
Nov 06 15:43:30 user nova-compute[75337]: No targets found.
Nov 06 15:43:30 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 15:43:30 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-1827f735-7849-46b7-94a4-a93a1fdfc874 tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 15:43:30 user nova-compute[75337]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 15:43:30 user nova-compute[75337]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75337) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 15:43:30 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-1827f735-7849-46b7-94a4-a93a1fdfc874 tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4367fb98-2ae9-40c3-a2d0-6e9b0f70dc7c', 0)] {{(pid=75337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 15:43:30 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:43:30 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:43:30 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[6627e6f8-a015-426e-b883-b093487432db]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ad85d1f-7027-4997-96c4-991e3969067d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4367fb98-2ae9-40c3-a2d0-6e9b0f70dc7c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eaf5fc54-be7c-4748-9e2f-12a01971e6f4\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:43:30 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:43:30 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:43:30 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[47f9bb6b-819f-4aa1-9df1-5e2033181550]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4367fb98-2ae9-40c3-a2d0-6e9b0f70dc7c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ad85d1f-7027-4997-96c4-991e3969067d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaf5fc54-be7c-4748-9e2f-12a01971e6f4 (non-flash)\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:43:30 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-1827f735-7849-46b7-94a4-a93a1fdfc874 tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)
Nov 06 15:43:30 user nova-compute[75337]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e (non-flash)
Nov 06 15:43:30 user nova-compute[75337]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759 (non-flash)
Nov 06 15:43:30 user nova-compute[75337]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4367fb98-2ae9-40c3-a2d0-6e9b0f70dc7c (non-flash)
Nov 06 15:43:30 user nova-compute[75337]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ad85d1f-7027-4997-96c4-991e3969067d (non-flash)
Nov 06 15:43:30 user nova-compute[75337]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaf5fc54-be7c-4748-9e2f-12a01971e6f4 (non-flash)
Nov 06 15:43:30 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 15:43:30 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-1827f735-7849-46b7-94a4-a93a1fdfc874 tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)
Nov 06 15:43:30 user nova-compute[75337]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e (non-flash)
Nov 06 15:43:30 user nova-compute[75337]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759 (non-flash)
Nov 06 15:43:30 user nova-compute[75337]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4367fb98-2ae9-40c3-a2d0-6e9b0f70dc7c (non-flash)
Nov 06 15:43:30 user nova-compute[75337]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ad85d1f-7027-4997-96c4-991e3969067d (non-flash)
Nov 06 15:43:30 user nova-compute[75337]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaf5fc54-be7c-4748-9e2f-12a01971e6f4 (non-flash)
Nov 06 15:43:30 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 15:43:30 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-1827f735-7849-46b7-94a4-a93a1fdfc874 tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2abc60d3f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4367fb98-2ae9-40c3-a2d0-6e9b0f70dc7c'): ({'sdf'}, set())}) {{(pid=75337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 15:43:30 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-1827f735-7849-46b7-94a4-a93a1fdfc874 tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Removing single pathed devices sdf {{(pid=75337) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 15:43:30 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:43:30 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:43:30 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f25cdee-714b-42ea-9195-ee9d547cbaa5]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:43:30 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:43:30 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.021s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:43:30 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d321f97-861f-4c3f-be9d-ecf194cfbbe6]: (4, ('ok\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:43:30 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-1827f735-7849-46b7-94a4-a93a1fdfc874 tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Flushing IO for device /dev/sdf {{(pid=75337) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 15:43:30 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:43:30 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:43:30 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b2aa60b-7958-4fd7-93c4-bc572902fd4a]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:43:30 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-1827f735-7849-46b7-94a4-a93a1fdfc874 tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75337) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 15:43:30 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:43:30 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.044s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:43:30 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[79546903-0d39-414c-98b3-1ec37219acd0]: (4, ('1', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:43:30 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-1827f735-7849-46b7-94a4-a93a1fdfc874 tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 15:43:30 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-1827f735-7849-46b7-94a4-a93a1fdfc874 tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] SCSI volumes sdf have been removed. {{(pid=75337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 15:43:30 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-1827f735-7849-46b7-94a4-a93a1fdfc874 tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4367fb98-2ae9-40c3-a2d0-6e9b0f70dc7c')] {{(pid=75337) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 15:43:30 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4367fb98-2ae9-40c3-a2d0-6e9b0f70dc7c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:43:30 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4367fb98-2ae9-40c3-a2d0-6e9b0f70dc7c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.039s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:43:30 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[198ef26c-5cf1-408e-8e61-8af24faee94e]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:43:30 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-1827f735-7849-46b7-94a4-a93a1fdfc874 tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:43:30 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4367fb98-2ae9-40c3-a2d0-6e9b0f70dc7c -p 172.16.0.220:3260 --logout {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:43:30 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4367fb98-2ae9-40c3-a2d0-6e9b0f70dc7c -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:43:30 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f3bdede-06d6-41ab-b01a-a01451813014]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:4367fb98-2ae9-40c3-a2d0-6e9b0f70dc7c, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:4367fb98-2ae9-40c3-a2d0-6e9b0f70dc7c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:43:30 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-1827f735-7849-46b7-94a4-a93a1fdfc874 tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:4367fb98-2ae9-40c3-a2d0-6e9b0f70dc7c, portal: 172.16.0.220,3260]
Nov 06 15:43:30 user nova-compute[75337]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:4367fb98-2ae9-40c3-a2d0-6e9b0f70dc7c, portal: 172.16.0.220,3260] successful.
Nov 06 15:43:30 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:43:30 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4367fb98-2ae9-40c3-a2d0-6e9b0f70dc7c -p 172.16.0.220:3260 --op delete {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:43:30 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4367fb98-2ae9-40c3-a2d0-6e9b0f70dc7c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:43:30 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf37978f-818c-4d0d-bd92-c11eb74b9cc0]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:43:30 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-1827f735-7849-46b7-94a4-a93a1fdfc874 tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:43:30 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-1827f735-7849-46b7-94a4-a93a1fdfc874 tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.342s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 15:43:30 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-1827f735-7849-46b7-94a4-a93a1fdfc874 tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] <== disconnect_volume: return (346ms) None {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 15:43:30 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1827f735-7849-46b7-94a4-a93a1fdfc874 tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Disconnected iSCSI Volume {{(pid=75337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 15:43:30 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1827f735-7849-46b7-94a4-a93a1fdfc874 tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] calling os-brick to detach iSCSI Volume {{(pid=75337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 15:43:30 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-1827f735-7849-46b7-94a4-a93a1fdfc874 tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2abc33d0c0>, {'target_iqn': 'iqn.2010-10.org.openstack:0ad85d1f-7027-4997-96c4-991e3969067d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pJrvRwbO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 15:43:30 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-1827f735-7849-46b7-94a4-a93a1fdfc874 tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 15:43:30 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-1827f735-7849-46b7-94a4-a93a1fdfc874 tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 15:43:30 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-1827f735-7849-46b7-94a4-a93a1fdfc874 tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 15:43:30 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:43:30 user nova-compute[75337]: DEBUG nova.network.neutron [-] [instance: cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1] Updating instance_info_cache with network_info: [] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:43:30 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:43:30 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[c83b9599-9c8b-4229-8a16-d28271d60d69]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:eaf5fc54-be7c-4748-9e2f-12a01971e6f4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0ad85d1f-7027-4997-96c4-991e3969067d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:43:30 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-1827f735-7849-46b7-94a4-a93a1fdfc874 tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 15:43:30 user nova-compute[75337]: No targets found.
Nov 06 15:43:30 user nova-compute[75337]: iSNS:
Nov 06 15:43:30 user nova-compute[75337]: No targets found.
Nov 06 15:43:30 user nova-compute[75337]: STATIC:
Nov 06 15:43:30 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e
Nov 06 15:43:30 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 15:43:30 user nova-compute[75337]:                 Iface Name: default
Nov 06 15:43:30 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:eaf5fc54-be7c-4748-9e2f-12a01971e6f4
Nov 06 15:43:30 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 15:43:30 user nova-compute[75337]:                 Iface Name: default
Nov 06 15:43:30 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:0ad85d1f-7027-4997-96c4-991e3969067d
Nov 06 15:43:30 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 15:43:30 user nova-compute[75337]:                 Iface Name: default
Nov 06 15:43:30 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158
Nov 06 15:43:30 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 15:43:30 user nova-compute[75337]:                 Iface Name: default
Nov 06 15:43:30 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759
Nov 06 15:43:30 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 15:43:30 user nova-compute[75337]:                 Iface Name: default
Nov 06 15:43:30 user nova-compute[75337]: FIRMWARE:
Nov 06 15:43:30 user nova-compute[75337]: No targets found.
Nov 06 15:43:30 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 15:43:30 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-1827f735-7849-46b7-94a4-a93a1fdfc874 tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 15:43:30 user nova-compute[75337]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 15:43:30 user nova-compute[75337]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75337) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 15:43:30 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-1827f735-7849-46b7-94a4-a93a1fdfc874 tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0ad85d1f-7027-4997-96c4-991e3969067d', 0)] {{(pid=75337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 15:43:30 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:43:30 user nova-compute[75337]: INFO nova.compute.manager [-] [instance: cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1] Took 0.73 seconds to deallocate network for instance.
Nov 06 15:43:30 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:43:30 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[218e61ee-b77d-4da0-bf04-932505f7939a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ad85d1f-7027-4997-96c4-991e3969067d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eaf5fc54-be7c-4748-9e2f-12a01971e6f4\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:43:30 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:43:30 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:43:30 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae4100e1-3ed9-4a35-b150-9bd4083c9133]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ad85d1f-7027-4997-96c4-991e3969067d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaf5fc54-be7c-4748-9e2f-12a01971e6f4 (non-flash)\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:43:30 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-1827f735-7849-46b7-94a4-a93a1fdfc874 tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)
Nov 06 15:43:30 user nova-compute[75337]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e (non-flash)
Nov 06 15:43:30 user nova-compute[75337]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759 (non-flash)
Nov 06 15:43:30 user nova-compute[75337]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ad85d1f-7027-4997-96c4-991e3969067d (non-flash)
Nov 06 15:43:30 user nova-compute[75337]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaf5fc54-be7c-4748-9e2f-12a01971e6f4 (non-flash)
Nov 06 15:43:30 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 15:43:30 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-1827f735-7849-46b7-94a4-a93a1fdfc874 tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)
Nov 06 15:43:30 user nova-compute[75337]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e (non-flash)
Nov 06 15:43:30 user nova-compute[75337]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759 (non-flash)
Nov 06 15:43:30 user nova-compute[75337]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ad85d1f-7027-4997-96c4-991e3969067d (non-flash)
Nov 06 15:43:30 user nova-compute[75337]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaf5fc54-be7c-4748-9e2f-12a01971e6f4 (non-flash)
Nov 06 15:43:30 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 15:43:30 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-1827f735-7849-46b7-94a4-a93a1fdfc874 tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2abc412f80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0ad85d1f-7027-4997-96c4-991e3969067d'): ({'sdd'}, set())}) {{(pid=75337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 15:43:30 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-1827f735-7849-46b7-94a4-a93a1fdfc874 tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Removing single pathed devices sdd {{(pid=75337) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 15:43:30 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:43:30 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:43:30 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdbaecd5-2e7a-45bd-ae48-45fa036d0cc6]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:43:30 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:43:30 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-e8d88afe-1e71-427a-9e65-056efe2cf3d9 tempest-VolumesAssistedSnapshotsTest-618385559 tempest-VolumesAssistedSnapshotsTest-618385559-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:43:30 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-e8d88afe-1e71-427a-9e65-056efe2cf3d9 tempest-VolumesAssistedSnapshotsTest-618385559 tempest-VolumesAssistedSnapshotsTest-618385559-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:43:30 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:43:30 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[dea68900-516b-452e-ba1b-13f2bbe54c1c]: (4, ('ok\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:43:30 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-1827f735-7849-46b7-94a4-a93a1fdfc874 tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Flushing IO for device /dev/sdd {{(pid=75337) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 15:43:30 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:43:30 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:43:30 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[417dc1d6-b8e4-4dcd-b134-04a72b88bab0]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:43:30 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-1827f735-7849-46b7-94a4-a93a1fdfc874 tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75337) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 15:43:30 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:43:30 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.043s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:43:30 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[42fb053d-e46b-41dc-a40e-f172ad8f33ff]: (4, ('1', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:43:30 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-1827f735-7849-46b7-94a4-a93a1fdfc874 tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 15:43:30 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-1827f735-7849-46b7-94a4-a93a1fdfc874 tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] SCSI volumes sdd have been removed. {{(pid=75337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 15:43:30 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-1827f735-7849-46b7-94a4-a93a1fdfc874 tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0ad85d1f-7027-4997-96c4-991e3969067d')] {{(pid=75337) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 15:43:30 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ad85d1f-7027-4997-96c4-991e3969067d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:43:30 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ad85d1f-7027-4997-96c4-991e3969067d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:43:30 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfb08a48-a5bb-4f4e-b376-f3ba5ef5f21b]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:43:30 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-1827f735-7849-46b7-94a4-a93a1fdfc874 tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:43:30 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ad85d1f-7027-4997-96c4-991e3969067d -p 172.16.0.220:3260 --logout {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:43:30 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ad85d1f-7027-4997-96c4-991e3969067d -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:43:30 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[de55b4ab-3859-421c-89a6-b709d0649672]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:0ad85d1f-7027-4997-96c4-991e3969067d, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:0ad85d1f-7027-4997-96c4-991e3969067d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:43:30 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-1827f735-7849-46b7-94a4-a93a1fdfc874 tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:0ad85d1f-7027-4997-96c4-991e3969067d, portal: 172.16.0.220,3260]
Nov 06 15:43:30 user nova-compute[75337]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:0ad85d1f-7027-4997-96c4-991e3969067d, portal: 172.16.0.220,3260] successful.
Nov 06 15:43:30 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:43:30 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ad85d1f-7027-4997-96c4-991e3969067d -p 172.16.0.220:3260 --op delete {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:43:30 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ad85d1f-7027-4997-96c4-991e3969067d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:43:30 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6b2fde3-79bf-450c-bbd9-784bc4fd75f7]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:43:30 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-1827f735-7849-46b7-94a4-a93a1fdfc874 tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:43:30 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-1827f735-7849-46b7-94a4-a93a1fdfc874 tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.347s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 15:43:30 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-1827f735-7849-46b7-94a4-a93a1fdfc874 tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] <== disconnect_volume: return (349ms) None {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 15:43:30 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1827f735-7849-46b7-94a4-a93a1fdfc874 tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Disconnected iSCSI Volume {{(pid=75337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 15:43:31 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1827f735-7849-46b7-94a4-a93a1fdfc874 tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] calling os-brick to detach iSCSI Volume {{(pid=75337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 15:43:31 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-1827f735-7849-46b7-94a4-a93a1fdfc874 tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2abc33d0c0>, {'target_iqn': 'iqn.2010-10.org.openstack:eaf5fc54-be7c-4748-9e2f-12a01971e6f4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vqFapLyg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 15:43:31 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-1827f735-7849-46b7-94a4-a93a1fdfc874 tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 15:43:31 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-1827f735-7849-46b7-94a4-a93a1fdfc874 tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 15:43:31 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-1827f735-7849-46b7-94a4-a93a1fdfc874 tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 15:43:31 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:43:31 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:43:31 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbd9f66c-49ea-4c25-a975-e4ef323d5f2d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:eaf5fc54-be7c-4748-9e2f-12a01971e6f4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:43:31 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-1827f735-7849-46b7-94a4-a93a1fdfc874 tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 15:43:31 user nova-compute[75337]: No targets found.
Nov 06 15:43:31 user nova-compute[75337]: iSNS:
Nov 06 15:43:31 user nova-compute[75337]: No targets found.
Nov 06 15:43:31 user nova-compute[75337]: STATIC:
Nov 06 15:43:31 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e
Nov 06 15:43:31 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 15:43:31 user nova-compute[75337]:                 Iface Name: default
Nov 06 15:43:31 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:eaf5fc54-be7c-4748-9e2f-12a01971e6f4
Nov 06 15:43:31 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 15:43:31 user nova-compute[75337]:                 Iface Name: default
Nov 06 15:43:31 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158
Nov 06 15:43:31 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 15:43:31 user nova-compute[75337]:                 Iface Name: default
Nov 06 15:43:31 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759
Nov 06 15:43:31 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 15:43:31 user nova-compute[75337]:                 Iface Name: default
Nov 06 15:43:31 user nova-compute[75337]: FIRMWARE:
Nov 06 15:43:31 user nova-compute[75337]: No targets found.
Nov 06 15:43:31 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 15:43:31 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-1827f735-7849-46b7-94a4-a93a1fdfc874 tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 15:43:31 user nova-compute[75337]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 15:43:31 user nova-compute[75337]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75337) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 15:43:31 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-1827f735-7849-46b7-94a4-a93a1fdfc874 tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eaf5fc54-be7c-4748-9e2f-12a01971e6f4', 0)] {{(pid=75337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 15:43:31 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:43:31 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:43:31 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[008f0ee1-6769-4c80-a14c-8b4aab201f8f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eaf5fc54-be7c-4748-9e2f-12a01971e6f4\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:43:31 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:43:31 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-e8d88afe-1e71-427a-9e65-056efe2cf3d9 tempest-VolumesAssistedSnapshotsTest-618385559 tempest-VolumesAssistedSnapshotsTest-618385559-project-member] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 15:43:31 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:43:31 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee544beb-3c77-497f-ac10-0dbbd22e1ed4]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaf5fc54-be7c-4748-9e2f-12a01971e6f4 (non-flash)\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:43:31 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-1827f735-7849-46b7-94a4-a93a1fdfc874 tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)
Nov 06 15:43:31 user nova-compute[75337]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e (non-flash)
Nov 06 15:43:31 user nova-compute[75337]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759 (non-flash)
Nov 06 15:43:31 user nova-compute[75337]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaf5fc54-be7c-4748-9e2f-12a01971e6f4 (non-flash)
Nov 06 15:43:31 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 15:43:31 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-1827f735-7849-46b7-94a4-a93a1fdfc874 tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)
Nov 06 15:43:31 user nova-compute[75337]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e (non-flash)
Nov 06 15:43:31 user nova-compute[75337]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759 (non-flash)
Nov 06 15:43:31 user nova-compute[75337]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaf5fc54-be7c-4748-9e2f-12a01971e6f4 (non-flash)
Nov 06 15:43:31 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 15:43:31 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-1827f735-7849-46b7-94a4-a93a1fdfc874 tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2a9c64d5a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eaf5fc54-be7c-4748-9e2f-12a01971e6f4'): ({'sdg'}, set())}) {{(pid=75337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 15:43:31 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-1827f735-7849-46b7-94a4-a93a1fdfc874 tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Removing single pathed devices sdg {{(pid=75337) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 15:43:31 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-e8d88afe-1e71-427a-9e65-056efe2cf3d9 tempest-VolumesAssistedSnapshotsTest-618385559 tempest-VolumesAssistedSnapshotsTest-618385559-project-member] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 15:43:31 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:43:31 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:43:31 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d627f29-7e11-465a-93c0-9fdbcaf2fb13]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:43:31 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:43:31 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-e8d88afe-1e71-427a-9e65-056efe2cf3d9 tempest-VolumesAssistedSnapshotsTest-618385559 tempest-VolumesAssistedSnapshotsTest-618385559-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.358s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:43:31 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.019s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:43:31 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[d061cc26-63bc-44fc-a223-c3e43a2232f2]: (4, ('ok\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:43:31 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-1827f735-7849-46b7-94a4-a93a1fdfc874 tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Flushing IO for device /dev/sdg {{(pid=75337) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 15:43:31 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:43:31 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:43:31 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7603922-15a9-4fb7-8656-c82f8c4a04d9]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:43:31 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-1827f735-7849-46b7-94a4-a93a1fdfc874 tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75337) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 15:43:31 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:43:31 user nova-compute[75337]: INFO nova.scheduler.client.report [None req-e8d88afe-1e71-427a-9e65-056efe2cf3d9 tempest-VolumesAssistedSnapshotsTest-618385559 tempest-VolumesAssistedSnapshotsTest-618385559-project-member] Deleted allocations for instance cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1
Nov 06 15:43:31 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.037s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:43:31 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dd66bed-3bb5-44cc-bfac-409ad24a49dd]: (4, ('1', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:43:31 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-1827f735-7849-46b7-94a4-a93a1fdfc874 tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 15:43:31 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-1827f735-7849-46b7-94a4-a93a1fdfc874 tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] SCSI volumes sdg have been removed. {{(pid=75337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 15:43:31 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-1827f735-7849-46b7-94a4-a93a1fdfc874 tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eaf5fc54-be7c-4748-9e2f-12a01971e6f4')] {{(pid=75337) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 15:43:31 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eaf5fc54-be7c-4748-9e2f-12a01971e6f4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:43:31 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eaf5fc54-be7c-4748-9e2f-12a01971e6f4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:43:31 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[78700e47-42e8-4b49-944c-0a24ac4851f7]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:43:31 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-1827f735-7849-46b7-94a4-a93a1fdfc874 tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:43:31 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eaf5fc54-be7c-4748-9e2f-12a01971e6f4 -p 172.16.0.220:3260 --logout {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:43:31 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-e8d88afe-1e71-427a-9e65-056efe2cf3d9 tempest-VolumesAssistedSnapshotsTest-618385559 tempest-VolumesAssistedSnapshotsTest-618385559-project-member] Lock "cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.309s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:43:31 user nova-compute[75337]: DEBUG nova.compute.manager [req-1f2ffa74-1976-49b1-a98f-821a7d1424a5 req-c8c3bba0-978c-42a6-8aeb-7349fc1aa010 service nova] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Received event network-vif-plugged-ba50db67-9fb0-49ef-9ea2-db9014b66b17 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:43:31 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-1f2ffa74-1976-49b1-a98f-821a7d1424a5 req-c8c3bba0-978c-42a6-8aeb-7349fc1aa010 service nova] Acquiring lock "67d9ceff-c1fc-48ad-85c8-3aa37ebabf11-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:43:31 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-1f2ffa74-1976-49b1-a98f-821a7d1424a5 req-c8c3bba0-978c-42a6-8aeb-7349fc1aa010 service nova] Lock "67d9ceff-c1fc-48ad-85c8-3aa37ebabf11-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:43:31 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-1f2ffa74-1976-49b1-a98f-821a7d1424a5 req-c8c3bba0-978c-42a6-8aeb-7349fc1aa010 service nova] Lock "67d9ceff-c1fc-48ad-85c8-3aa37ebabf11-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:43:31 user nova-compute[75337]: DEBUG nova.compute.manager [req-1f2ffa74-1976-49b1-a98f-821a7d1424a5 req-c8c3bba0-978c-42a6-8aeb-7349fc1aa010 service nova] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] No waiting events found dispatching network-vif-plugged-ba50db67-9fb0-49ef-9ea2-db9014b66b17 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:43:31 user nova-compute[75337]: WARNING nova.compute.manager [req-1f2ffa74-1976-49b1-a98f-821a7d1424a5 req-c8c3bba0-978c-42a6-8aeb-7349fc1aa010 service nova] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Received unexpected event network-vif-plugged-ba50db67-9fb0-49ef-9ea2-db9014b66b17 for instance with vm_state active and task_state deleting.
Nov 06 15:43:31 user nova-compute[75337]: DEBUG nova.compute.manager [req-1f2ffa74-1976-49b1-a98f-821a7d1424a5 req-c8c3bba0-978c-42a6-8aeb-7349fc1aa010 service nova] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Received event network-vif-unplugged-e6be4a87-8794-4e4f-91c1-3c417e0c8d62 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:43:31 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-1f2ffa74-1976-49b1-a98f-821a7d1424a5 req-c8c3bba0-978c-42a6-8aeb-7349fc1aa010 service nova] Acquiring lock "67d9ceff-c1fc-48ad-85c8-3aa37ebabf11-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:43:31 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-1f2ffa74-1976-49b1-a98f-821a7d1424a5 req-c8c3bba0-978c-42a6-8aeb-7349fc1aa010 service nova] Lock "67d9ceff-c1fc-48ad-85c8-3aa37ebabf11-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:43:31 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-1f2ffa74-1976-49b1-a98f-821a7d1424a5 req-c8c3bba0-978c-42a6-8aeb-7349fc1aa010 service nova] Lock "67d9ceff-c1fc-48ad-85c8-3aa37ebabf11-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:43:31 user nova-compute[75337]: DEBUG nova.compute.manager [req-1f2ffa74-1976-49b1-a98f-821a7d1424a5 req-c8c3bba0-978c-42a6-8aeb-7349fc1aa010 service nova] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] No waiting events found dispatching network-vif-unplugged-e6be4a87-8794-4e4f-91c1-3c417e0c8d62 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:43:31 user nova-compute[75337]: DEBUG nova.compute.manager [req-1f2ffa74-1976-49b1-a98f-821a7d1424a5 req-c8c3bba0-978c-42a6-8aeb-7349fc1aa010 service nova] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Received event network-vif-unplugged-e6be4a87-8794-4e4f-91c1-3c417e0c8d62 for instance with task_state deleting. {{(pid=75337) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 15:43:31 user nova-compute[75337]: DEBUG nova.compute.manager [req-1f2ffa74-1976-49b1-a98f-821a7d1424a5 req-c8c3bba0-978c-42a6-8aeb-7349fc1aa010 service nova] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Received event network-vif-plugged-e6be4a87-8794-4e4f-91c1-3c417e0c8d62 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:43:31 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-1f2ffa74-1976-49b1-a98f-821a7d1424a5 req-c8c3bba0-978c-42a6-8aeb-7349fc1aa010 service nova] Acquiring lock "67d9ceff-c1fc-48ad-85c8-3aa37ebabf11-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:43:31 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-1f2ffa74-1976-49b1-a98f-821a7d1424a5 req-c8c3bba0-978c-42a6-8aeb-7349fc1aa010 service nova] Lock "67d9ceff-c1fc-48ad-85c8-3aa37ebabf11-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:43:31 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-1f2ffa74-1976-49b1-a98f-821a7d1424a5 req-c8c3bba0-978c-42a6-8aeb-7349fc1aa010 service nova] Lock "67d9ceff-c1fc-48ad-85c8-3aa37ebabf11-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:43:31 user nova-compute[75337]: DEBUG nova.compute.manager [req-1f2ffa74-1976-49b1-a98f-821a7d1424a5 req-c8c3bba0-978c-42a6-8aeb-7349fc1aa010 service nova] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] No waiting events found dispatching network-vif-plugged-e6be4a87-8794-4e4f-91c1-3c417e0c8d62 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:43:31 user nova-compute[75337]: WARNING nova.compute.manager [req-1f2ffa74-1976-49b1-a98f-821a7d1424a5 req-c8c3bba0-978c-42a6-8aeb-7349fc1aa010 service nova] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Received unexpected event network-vif-plugged-e6be4a87-8794-4e4f-91c1-3c417e0c8d62 for instance with vm_state active and task_state deleting.
Nov 06 15:43:31 user nova-compute[75337]: DEBUG nova.compute.manager [req-1f2ffa74-1976-49b1-a98f-821a7d1424a5 req-c8c3bba0-978c-42a6-8aeb-7349fc1aa010 service nova] [instance: cf1a41be-7e8b-4d1b-bdf2-a9a56ec722c1] Received event network-vif-deleted-5b01e7c7-929d-4e31-b8d4-e4ba3bba4ea2 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:43:31 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eaf5fc54-be7c-4748-9e2f-12a01971e6f4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:43:31 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[28cf0608-860b-420a-aa99-e36140143f75]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:eaf5fc54-be7c-4748-9e2f-12a01971e6f4, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:eaf5fc54-be7c-4748-9e2f-12a01971e6f4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:43:31 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-1827f735-7849-46b7-94a4-a93a1fdfc874 tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:eaf5fc54-be7c-4748-9e2f-12a01971e6f4, portal: 172.16.0.220,3260]
Nov 06 15:43:31 user nova-compute[75337]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:eaf5fc54-be7c-4748-9e2f-12a01971e6f4, portal: 172.16.0.220,3260] successful.
Nov 06 15:43:31 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:43:31 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eaf5fc54-be7c-4748-9e2f-12a01971e6f4 -p 172.16.0.220:3260 --op delete {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:43:31 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eaf5fc54-be7c-4748-9e2f-12a01971e6f4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:43:31 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a1e4ed5-f079-41b5-a72b-c0a31afdf086]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:43:31 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-1827f735-7849-46b7-94a4-a93a1fdfc874 tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:43:31 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-1827f735-7849-46b7-94a4-a93a1fdfc874 tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.338s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 15:43:31 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-1827f735-7849-46b7-94a4-a93a1fdfc874 tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] <== disconnect_volume: return (340ms) None {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 15:43:31 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1827f735-7849-46b7-94a4-a93a1fdfc874 tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Disconnected iSCSI Volume {{(pid=75337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 15:43:31 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-1827f735-7849-46b7-94a4-a93a1fdfc874 tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Deleting instance files /opt/stack/data/nova/instances/67d9ceff-c1fc-48ad-85c8-3aa37ebabf11_del
Nov 06 15:43:31 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-1827f735-7849-46b7-94a4-a93a1fdfc874 tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Deletion of /opt/stack/data/nova/instances/67d9ceff-c1fc-48ad-85c8-3aa37ebabf11_del complete
Nov 06 15:43:31 user nova-compute[75337]: INFO nova.compute.manager [None req-1827f735-7849-46b7-94a4-a93a1fdfc874 tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Took 4.65 seconds to destroy the instance on the hypervisor.
Nov 06 15:43:31 user nova-compute[75337]: DEBUG oslo.service.loopingcall [None req-1827f735-7849-46b7-94a4-a93a1fdfc874 tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75337) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 15:43:31 user nova-compute[75337]: DEBUG nova.compute.manager [-] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Deallocating network for instance {{(pid=75337) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 15:43:31 user nova-compute[75337]: DEBUG nova.network.neutron [-] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] deallocate_for_instance() {{(pid=75337) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 15:43:33 user nova-compute[75337]: DEBUG nova.compute.manager [req-cb8c3e55-b8ea-4867-b82a-69c1c24a178f req-35134dc1-6538-4c59-87b5-c48079858da9 service nova] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Received event network-vif-deleted-94df5f62-239e-4b8e-a91d-5223c1585f6f {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:43:33 user nova-compute[75337]: INFO nova.compute.manager [req-cb8c3e55-b8ea-4867-b82a-69c1c24a178f req-35134dc1-6538-4c59-87b5-c48079858da9 service nova] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Neutron deleted interface 94df5f62-239e-4b8e-a91d-5223c1585f6f; detaching it from the instance and deleting it from the info cache
Nov 06 15:43:33 user nova-compute[75337]: DEBUG nova.network.neutron [req-cb8c3e55-b8ea-4867-b82a-69c1c24a178f req-35134dc1-6538-4c59-87b5-c48079858da9 service nova] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Updating instance_info_cache with network_info: [{"id": "5d25f565-70a5-427c-a198-4f88dd8b7338", "address": "fa:16:3e:39:62:9f", "network": {"id": "4b3a9463-7120-499a-bdef-bd2ce9443d88", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1482718546-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "664f419c1b904bb3bdd7aff9e621e2e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d25f565-70", "ovs_interfaceid": "5d25f565-70a5-427c-a198-4f88dd8b7338", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ac99553f-c5d8-46df-8357-f1f7f189fa22", "address": "fa:16:3e:37:11:e5", "network": {"id": "793579d8-5696-4c41-b09e-19e19908b703", "bridge": "br-int", "label": "tempest-device-tagging-net1-1052173633", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.61", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "664f419c1b904bb3bdd7aff9e621e2e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac99553f-c5", "ovs_interfaceid": "ac99553f-c5d8-46df-8357-f1f7f189fa22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "abf73a6f-c3c7-46b5-8a9b-0fce5677fa27", "address": "fa:16:3e:68:66:1c", "network": {"id": "793579d8-5696-4c41-b09e-19e19908b703", "bridge": "br-int", "label": "tempest-device-tagging-net1-1052173633", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.239", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "664f419c1b904bb3bdd7aff9e621e2e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabf73a6f-c3", "ovs_interfaceid": "abf73a6f-c3c7-46b5-8a9b-0fce5677fa27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e87c0766-dd71-4aca-b5f0-32888c7437f5", "address": "fa:16:3e:b5:06:33", "network": {"id": "793579d8-5696-4c41-b09e-19e19908b703", "bridge": "br-int", "label": "tempest-device-tagging-net1-1052173633", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "664f419c1b904bb3bdd7aff9e621e2e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape87c0766-dd", "ovs_interfaceid": "e87c0766-dd71-4aca-b5f0-32888c7437f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ba50db67-9fb0-49ef-9ea2-db9014b66b17", "address": "fa:16:3e:1a:f9:b0", "network": {"id": "793579d8-5696-4c41-b09e-19e19908b703", "bridge": "br-int", "label": "tempest-device-tagging-net1-1052173633", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "664f419c1b904bb3bdd7aff9e621e2e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba50db67-9f", "ovs_interfaceid": "ba50db67-9fb0-49ef-9ea2-db9014b66b17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e6be4a87-8794-4e4f-91c1-3c417e0c8d62", "address": "fa:16:3e:df:a8:14", "network": {"id": "512e1b59-3c5a-4be6-bf3d-2ee51ce2042a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1219094622", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "664f419c1b904bb3bdd7aff9e621e2e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6be4a87-87", "ovs_interfaceid": "e6be4a87-8794-4e4f-91c1-3c417e0c8d62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:43:33 user nova-compute[75337]: DEBUG nova.compute.manager [req-cb8c3e55-b8ea-4867-b82a-69c1c24a178f req-35134dc1-6538-4c59-87b5-c48079858da9 service nova] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Detach interface failed, port_id=94df5f62-239e-4b8e-a91d-5223c1585f6f, reason: Instance 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11 could not be found. {{(pid=75337) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 06 15:43:33 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:43:35 user nova-compute[75337]: DEBUG nova.network.neutron [-] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Updating instance_info_cache with network_info: [] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:43:35 user nova-compute[75337]: INFO nova.compute.manager [-] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Took 3.64 seconds to deallocate network for instance.
Nov 06 15:43:35 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:43:35 user nova-compute[75337]: DEBUG nova.compute.manager [req-61c579a0-52a5-49e0-81db-f1102a9a49a5 req-f285b318-abd1-48e9-ba13-4c626f05db6b service nova] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Received event network-vif-deleted-ba50db67-9fb0-49ef-9ea2-db9014b66b17 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:43:35 user nova-compute[75337]: DEBUG nova.compute.manager [req-61c579a0-52a5-49e0-81db-f1102a9a49a5 req-f285b318-abd1-48e9-ba13-4c626f05db6b service nova] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Received event network-vif-deleted-e6be4a87-8794-4e4f-91c1-3c417e0c8d62 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:43:35 user nova-compute[75337]: DEBUG nova.compute.manager [req-61c579a0-52a5-49e0-81db-f1102a9a49a5 req-f285b318-abd1-48e9-ba13-4c626f05db6b service nova] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Received event network-vif-deleted-5d25f565-70a5-427c-a198-4f88dd8b7338 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:43:35 user nova-compute[75337]: DEBUG nova.compute.manager [req-61c579a0-52a5-49e0-81db-f1102a9a49a5 req-f285b318-abd1-48e9-ba13-4c626f05db6b service nova] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Received event network-vif-deleted-e87c0766-dd71-4aca-b5f0-32888c7437f5 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:43:35 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5bbc7a93-b7ae-4bbf-b337-b04a3f7edfaf tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] [instance: c8cf1ead-a87c-459c-b914-a0e976c9e464] Calling os-brick to attach iSCSI Volume {{(pid=75337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 15:43:35 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bbc7a93-b7ae-4bbf-b337-b04a3f7edfaf tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2abc33d0c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6f5503fc-8cc8-46fa-8450-d967f769a947', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kStTucve', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 15:43:35 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-5bbc7a93-b7ae-4bbf-b337-b04a3f7edfaf tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 15:43:35 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-5bbc7a93-b7ae-4bbf-b337-b04a3f7edfaf tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 15:43:35 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-5bbc7a93-b7ae-4bbf-b337-b04a3f7edfaf tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 15:43:35 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-5bbc7a93-b7ae-4bbf-b337-b04a3f7edfaf tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 15:43:35 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-5bbc7a93-b7ae-4bbf-b337-b04a3f7edfaf tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6f5503fc-8cc8-46fa-8450-d967f769a947" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 15:43:35 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-5bbc7a93-b7ae-4bbf-b337-b04a3f7edfaf tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6f5503fc-8cc8-46fa-8450-d967f769a947" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 15:43:35 user nova-compute[75337]: INFO os_brick.initiator.connectors.iscsi [None req-5bbc7a93-b7ae-4bbf-b337-b04a3f7edfaf tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 15:43:35 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f5503fc-8cc8-46fa-8450-d967f769a947 -p 172.16.0.220:3260 {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:43:35 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f5503fc-8cc8-46fa-8450-d967f769a947 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:43:35 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[88e05053-2269-4d15-8c56-32cb9199a948]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:43:35 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bbc7a93-b7ae-4bbf-b337-b04a3f7edfaf tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 15:43:35 user nova-compute[75337]:  {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:43:35 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f5503fc-8cc8-46fa-8450-d967f769a947 -p 172.16.0.220:3260 --interface default --op new {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:43:35 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f5503fc-8cc8-46fa-8450-d967f769a947 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:43:35 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d826ad5-9140-4a4b-b131-2c46a9020b5c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6f5503fc-8cc8-46fa-8450-d967f769a947] added\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:43:35 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bbc7a93-b7ae-4bbf-b337-b04a3f7edfaf tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6f5503fc-8cc8-46fa-8450-d967f769a947] added
Nov 06 15:43:35 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:43:35 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f5503fc-8cc8-46fa-8450-d967f769a947 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:43:35 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f5503fc-8cc8-46fa-8450-d967f769a947 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:43:35 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[35ffe8d8-7b34-49fc-9fa4-283433f6ba30]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:43:35 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bbc7a93-b7ae-4bbf-b337-b04a3f7edfaf tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:43:35 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f5503fc-8cc8-46fa-8450-d967f769a947 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:43:35 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f5503fc-8cc8-46fa-8450-d967f769a947 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:43:35 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0a9d43a-9322-4532-b31e-5248b5854708]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:43:35 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bbc7a93-b7ae-4bbf-b337-b04a3f7edfaf tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:43:35 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f5503fc-8cc8-46fa-8450-d967f769a947 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kStTucve {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:43:35 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f5503fc-8cc8-46fa-8450-d967f769a947 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kStTucve" returned: 0 in 0.021s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:43:35 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[57222d5c-ef7a-473f-ba10-4c3c5d3faab4]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:43:35 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bbc7a93-b7ae-4bbf-b337-b04a3f7edfaf tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kStTucve'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:43:35 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f5503fc-8cc8-46fa-8450-d967f769a947 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:43:35 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f5503fc-8cc8-46fa-8450-d967f769a947 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:43:35 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f5efd87-9129-4021-8515-0bdc058f21fc]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:43:35 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bbc7a93-b7ae-4bbf-b337-b04a3f7edfaf tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:43:35 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:43:35 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:43:35 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[b07b9406-640e-48da-9b20-40ffe5a33190]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759 (non-flash)\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:43:35 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bbc7a93-b7ae-4bbf-b337-b04a3f7edfaf tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)
Nov 06 15:43:35 user nova-compute[75337]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e (non-flash)
Nov 06 15:43:35 user nova-compute[75337]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759 (non-flash)
Nov 06 15:43:35 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 15:43:35 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bbc7a93-b7ae-4bbf-b337-b04a3f7edfaf tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)
Nov 06 15:43:35 user nova-compute[75337]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e (non-flash)
Nov 06 15:43:35 user nova-compute[75337]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759 (non-flash)
Nov 06 15:43:35 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 15:43:35 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f5503fc-8cc8-46fa-8450-d967f769a947 -p 172.16.0.220:3260 --login {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:43:35 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f5503fc-8cc8-46fa-8450-d967f769a947 -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:43:35 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bbe29e1-45ca-4b0c-98e7-e67cacd107c6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6f5503fc-8cc8-46fa-8450-d967f769a947, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6f5503fc-8cc8-46fa-8450-d967f769a947, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:43:35 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bbc7a93-b7ae-4bbf-b337-b04a3f7edfaf tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6f5503fc-8cc8-46fa-8450-d967f769a947, portal: 172.16.0.220,3260]
Nov 06 15:43:35 user nova-compute[75337]: Login to [iface: default, target: iqn.2010-10.org.openstack:6f5503fc-8cc8-46fa-8450-d967f769a947, portal: 172.16.0.220,3260] successful.
Nov 06 15:43:35 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:43:35 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f5503fc-8cc8-46fa-8450-d967f769a947 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:43:35 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f5503fc-8cc8-46fa-8450-d967f769a947 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.030s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:43:35 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[da1fbf5b-c13f-4caa-9f4f-ee8013e19906]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:43:35 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bbc7a93-b7ae-4bbf-b337-b04a3f7edfaf tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:43:35 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:43:35 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:43:35 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e104da5-92c8-44bc-8ef1-85177d7b609a]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f5503fc-8cc8-46fa-8450-d967f769a947 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759 (non-flash)\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:43:35 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bbc7a93-b7ae-4bbf-b337-b04a3f7edfaf tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)
Nov 06 15:43:35 user nova-compute[75337]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e (non-flash)
Nov 06 15:43:35 user nova-compute[75337]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f5503fc-8cc8-46fa-8450-d967f769a947 (non-flash)
Nov 06 15:43:35 user nova-compute[75337]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759 (non-flash)
Nov 06 15:43:35 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 15:43:35 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bbc7a93-b7ae-4bbf-b337-b04a3f7edfaf tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)
Nov 06 15:43:35 user nova-compute[75337]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e (non-flash)
Nov 06 15:43:35 user nova-compute[75337]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f5503fc-8cc8-46fa-8450-d967f769a947 (non-flash)
Nov 06 15:43:35 user nova-compute[75337]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759 (non-flash)
Nov 06 15:43:35 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 15:43:35 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-5bbc7a93-b7ae-4bbf-b337-b04a3f7edfaf tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6f5503fc-8cc8-46fa-8450-d967f769a947" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.339s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 15:43:35 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bbc7a93-b7ae-4bbf-b337-b04a3f7edfaf tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Connected to 172.16.0.220:3260 {{(pid=75337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 15:43:35 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-5bbc7a93-b7ae-4bbf-b337-b04a3f7edfaf tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] HCTL ('35', '-', '-', 0) found on session 13 with lun 0 {{(pid=75337) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 15:43:35 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-5bbc7a93-b7ae-4bbf-b337-b04a3f7edfaf tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75337) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 15:43:35 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:43:35 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.039s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:43:35 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a3b467b-e735-486c-9db1-874807d869a1]: (4, ('- - 0', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:43:35 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-5bbc7a93-b7ae-4bbf-b337-b04a3f7edfaf tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Searching for a device in session 13 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75337) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 15:43:35 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bbc7a93-b7ae-4bbf-b337-b04a3f7edfaf tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:6f5503fc-8cc8-46fa-8450-d967f769a947', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kStTucve', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 15:43:35 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-23745249-14b8-4dc4-98ad-425185e4742d tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Acquiring lock "dfadb21f-5ed1-42f4-956b-95cccf128b6a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:43:35 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-23745249-14b8-4dc4-98ad-425185e4742d tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Lock "dfadb21f-5ed1-42f4-956b-95cccf128b6a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:43:36 user nova-compute[75337]: INFO nova.compute.manager [None req-23745249-14b8-4dc4-98ad-425185e4742d tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] [instance: dfadb21f-5ed1-42f4-956b-95cccf128b6a] Detaching volume 466b6a4a-f809-4194-abc2-cb0148279759
Nov 06 15:43:36 user nova-compute[75337]: INFO nova.virt.block_device [None req-23745249-14b8-4dc4-98ad-425185e4742d tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] [instance: dfadb21f-5ed1-42f4-956b-95cccf128b6a] Attempting to driver detach volume 466b6a4a-f809-4194-abc2-cb0148279759 from mountpoint /dev/vdb
Nov 06 15:43:36 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-23745249-14b8-4dc4-98ad-425185e4742d tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Attempting to detach device vdb from instance dfadb21f-5ed1-42f4-956b-95cccf128b6a from the persistent domain config. {{(pid=75337) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 06 15:43:36 user nova-compute[75337]: DEBUG nova.virt.libvirt.guest [None req-23745249-14b8-4dc4-98ad-425185e4742d tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 15:43:36 user nova-compute[75337]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 15:43:36 user nova-compute[75337]:   <source dev="/dev/sdb"/>
Nov 06 15:43:36 user nova-compute[75337]:   <target dev="vdb" bus="virtio"/>
Nov 06 15:43:36 user nova-compute[75337]:   <serial>466b6a4a-f809-4194-abc2-cb0148279759</serial>
Nov 06 15:43:36 user nova-compute[75337]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 06 15:43:36 user nova-compute[75337]: </disk>
Nov 06 15:43:36 user nova-compute[75337]:  {{(pid=75337) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 15:43:36 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-23745249-14b8-4dc4-98ad-425185e4742d tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Successfully detached device vdb from instance dfadb21f-5ed1-42f4-956b-95cccf128b6a from the persistent domain config.
Nov 06 15:43:36 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-23745249-14b8-4dc4-98ad-425185e4742d tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance dfadb21f-5ed1-42f4-956b-95cccf128b6a from the live domain config. {{(pid=75337) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 06 15:43:36 user nova-compute[75337]: DEBUG nova.virt.libvirt.guest [None req-23745249-14b8-4dc4-98ad-425185e4742d tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 15:43:36 user nova-compute[75337]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 15:43:36 user nova-compute[75337]:   <source dev="/dev/sdb"/>
Nov 06 15:43:36 user nova-compute[75337]:   <target dev="vdb" bus="virtio"/>
Nov 06 15:43:36 user nova-compute[75337]:   <serial>466b6a4a-f809-4194-abc2-cb0148279759</serial>
Nov 06 15:43:36 user nova-compute[75337]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 06 15:43:36 user nova-compute[75337]: </disk>
Nov 06 15:43:36 user nova-compute[75337]:  {{(pid=75337) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 15:43:36 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-1742b26e-22f7-4005-a190-354af68c53aa tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:43:36 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-1742b26e-22f7-4005-a190-354af68c53aa tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:43:36 user nova-compute[75337]: DEBUG nova.objects.instance [None req-1742b26e-22f7-4005-a190-354af68c53aa tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Lazy-loading 'pci_requests' on Instance uuid 8a600bd8-b94a-4242-a443-c2defb002280 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 15:43:36 user nova-compute[75337]: DEBUG nova.objects.instance [None req-1742b26e-22f7-4005-a190-354af68c53aa tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Lazy-loading 'numa_topology' on Instance uuid 8a600bd8-b94a-4242-a443-c2defb002280 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 15:43:36 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-1742b26e-22f7-4005-a190-354af68c53aa tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75337) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 15:43:36 user nova-compute[75337]: INFO nova.compute.claims [None req-1742b26e-22f7-4005-a190-354af68c53aa tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] [instance: 8a600bd8-b94a-4242-a443-c2defb002280] Claim successful on node user
Nov 06 15:43:36 user nova-compute[75337]: INFO nova.compute.manager [None req-351db0e9-14e3-4c42-a98e-ed2ec14aa38d tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: 1fa4c927-7485-4f34-94bd-9e20358904b6] Rescuing
Nov 06 15:43:36 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-351db0e9-14e3-4c42-a98e-ed2ec14aa38d tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Acquiring lock "refresh_cache-1fa4c927-7485-4f34-94bd-9e20358904b6" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 15:43:36 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-351db0e9-14e3-4c42-a98e-ed2ec14aa38d tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Acquired lock "refresh_cache-1fa4c927-7485-4f34-94bd-9e20358904b6" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 15:43:36 user nova-compute[75337]: DEBUG nova.network.neutron [None req-351db0e9-14e3-4c42-a98e-ed2ec14aa38d tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: 1fa4c927-7485-4f34-94bd-9e20358904b6] Building network info cache for instance {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 15:43:36 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-23745249-14b8-4dc4-98ad-425185e4742d tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance dfadb21f-5ed1-42f4-956b-95cccf128b6a {{(pid=75337) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 06 15:43:36 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-1742b26e-22f7-4005-a190-354af68c53aa tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 15:43:36 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-1742b26e-22f7-4005-a190-354af68c53aa tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 15:43:36 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-1742b26e-22f7-4005-a190-354af68c53aa tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.579s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:43:36 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-5bbc7a93-b7ae-4bbf-b337-b04a3f7edfaf tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.406s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 15:43:36 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bbc7a93-b7ae-4bbf-b337-b04a3f7edfaf tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] <== connect_volume: return (1409ms) {'type': 'block', 'scsi_wwn': '23732656230336539', 'path': '/dev/sdd'} {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 15:43:36 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5bbc7a93-b7ae-4bbf-b337-b04a3f7edfaf tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] [instance: c8cf1ead-a87c-459c-b914-a0e976c9e464] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23732656230336539', 'path': '/dev/sdd'} {{(pid=75337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 15:43:36 user nova-compute[75337]: DEBUG nova.objects.instance [None req-5bbc7a93-b7ae-4bbf-b337-b04a3f7edfaf tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Lazy-loading 'flavor' on Instance uuid c8cf1ead-a87c-459c-b914-a0e976c9e464 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 15:43:36 user nova-compute[75337]: DEBUG nova.virt.libvirt.guest [None req-5bbc7a93-b7ae-4bbf-b337-b04a3f7edfaf tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] attach device xml: <disk type="block" device="disk">
Nov 06 15:43:36 user nova-compute[75337]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 15:43:36 user nova-compute[75337]:   <source dev="/dev/sdd"/>
Nov 06 15:43:36 user nova-compute[75337]:   <target dev="vdb" bus="virtio"/>
Nov 06 15:43:36 user nova-compute[75337]:   <serial>6f5503fc-8cc8-46fa-8450-d967f769a947</serial>
Nov 06 15:43:36 user nova-compute[75337]: </disk>
Nov 06 15:43:36 user nova-compute[75337]:  {{(pid=75337) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 06 15:43:36 user nova-compute[75337]: INFO nova.network.neutron [None req-1742b26e-22f7-4005-a190-354af68c53aa tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] [instance: 8a600bd8-b94a-4242-a443-c2defb002280] Updating port 01aa7168-78cd-44e6-8496-08d468f62cfe with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 06 15:43:36 user nova-compute[75337]: DEBUG nova.network.neutron [None req-351db0e9-14e3-4c42-a98e-ed2ec14aa38d tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: 1fa4c927-7485-4f34-94bd-9e20358904b6] Updating instance_info_cache with network_info: [{"id": "3812cc74-01db-4b2b-815c-770420051e1b", "address": "fa:16:3e:f4:aa:7b", "network": {"id": "736be000-ee94-41fd-9de0-f2f885ec9be7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1715443852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb76b5b0f2b24f1c84a92403176bcc00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3812cc74-01", "ovs_interfaceid": "3812cc74-01db-4b2b-815c-770420051e1b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:43:36 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-351db0e9-14e3-4c42-a98e-ed2ec14aa38d tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Releasing lock "refresh_cache-1fa4c927-7485-4f34-94bd-9e20358904b6" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 15:43:37 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:43:37 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:43:37 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-5bbc7a93-b7ae-4bbf-b337-b04a3f7edfaf tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] No BDM found with device name vda, not building metadata. {{(pid=75337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 15:43:37 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-5bbc7a93-b7ae-4bbf-b337-b04a3f7edfaf tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 15:43:37 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-5bbc7a93-b7ae-4bbf-b337-b04a3f7edfaf tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] No VIF found with MAC fa:16:3e:37:16:66, not building metadata {{(pid=75337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 15:43:37 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:43:37 user nova-compute[75337]: DEBUG nova.compute.manager [req-7ec1f22a-0496-44b6-9267-3ffc95f5b16f req-75b5121a-6c87-465c-a4cb-31b394debcc2 service nova] [instance: 1fa4c927-7485-4f34-94bd-9e20358904b6] Received event network-vif-unplugged-3812cc74-01db-4b2b-815c-770420051e1b {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:43:37 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-7ec1f22a-0496-44b6-9267-3ffc95f5b16f req-75b5121a-6c87-465c-a4cb-31b394debcc2 service nova] Acquiring lock "1fa4c927-7485-4f34-94bd-9e20358904b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:43:37 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-7ec1f22a-0496-44b6-9267-3ffc95f5b16f req-75b5121a-6c87-465c-a4cb-31b394debcc2 service nova] Lock "1fa4c927-7485-4f34-94bd-9e20358904b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:43:37 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-7ec1f22a-0496-44b6-9267-3ffc95f5b16f req-75b5121a-6c87-465c-a4cb-31b394debcc2 service nova] Lock "1fa4c927-7485-4f34-94bd-9e20358904b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:43:37 user nova-compute[75337]: DEBUG nova.compute.manager [req-7ec1f22a-0496-44b6-9267-3ffc95f5b16f req-75b5121a-6c87-465c-a4cb-31b394debcc2 service nova] [instance: 1fa4c927-7485-4f34-94bd-9e20358904b6] No waiting events found dispatching network-vif-unplugged-3812cc74-01db-4b2b-815c-770420051e1b {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:43:37 user nova-compute[75337]: WARNING nova.compute.manager [req-7ec1f22a-0496-44b6-9267-3ffc95f5b16f req-75b5121a-6c87-465c-a4cb-31b394debcc2 service nova] [instance: 1fa4c927-7485-4f34-94bd-9e20358904b6] Received unexpected event network-vif-unplugged-3812cc74-01db-4b2b-815c-770420051e1b for instance with vm_state active and task_state rescuing.
Nov 06 15:43:37 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-5bbc7a93-b7ae-4bbf-b337-b04a3f7edfaf tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Lock "c8cf1ead-a87c-459c-b914-a0e976c9e464" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 109.945s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:43:37 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-1742b26e-22f7-4005-a190-354af68c53aa tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Acquiring lock "refresh_cache-8a600bd8-b94a-4242-a443-c2defb002280" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 15:43:37 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-1742b26e-22f7-4005-a190-354af68c53aa tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Acquired lock "refresh_cache-8a600bd8-b94a-4242-a443-c2defb002280" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 15:43:37 user nova-compute[75337]: DEBUG nova.network.neutron [None req-1742b26e-22f7-4005-a190-354af68c53aa tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] [instance: 8a600bd8-b94a-4242-a443-c2defb002280] Building network info cache for instance {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 15:43:37 user nova-compute[75337]: DEBUG nova.compute.manager [req-b5f4df8e-d681-4f11-86b4-216d61f8092b req-4ccd743d-c981-4aed-81da-ce545b66400d service nova] [instance: 8a600bd8-b94a-4242-a443-c2defb002280] Received event network-changed-01aa7168-78cd-44e6-8496-08d468f62cfe {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:43:37 user nova-compute[75337]: DEBUG nova.compute.manager [req-b5f4df8e-d681-4f11-86b4-216d61f8092b req-4ccd743d-c981-4aed-81da-ce545b66400d service nova] [instance: 8a600bd8-b94a-4242-a443-c2defb002280] Refreshing instance network info cache due to event network-changed-01aa7168-78cd-44e6-8496-08d468f62cfe. {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 15:43:37 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-b5f4df8e-d681-4f11-86b4-216d61f8092b req-4ccd743d-c981-4aed-81da-ce545b66400d service nova] Acquiring lock "refresh_cache-8a600bd8-b94a-4242-a443-c2defb002280" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 15:43:37 user nova-compute[75337]: INFO nova.virt.libvirt.driver [-] [instance: 1fa4c927-7485-4f34-94bd-9e20358904b6] Instance destroyed successfully.
Nov 06 15:43:37 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-351db0e9-14e3-4c42-a98e-ed2ec14aa38d tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: 1fa4c927-7485-4f34-94bd-9e20358904b6] Attempting a stable device rescue
Nov 06 15:43:38 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-351db0e9-14e3-4c42-a98e-ed2ec14aa38d tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75337) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 06 15:43:38 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-351db0e9-14e3-4c42-a98e-ed2ec14aa38d tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: 1fa4c927-7485-4f34-94bd-9e20358904b6] Instance directory exists: not creating {{(pid=75337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 06 15:43:38 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-351db0e9-14e3-4c42-a98e-ed2ec14aa38d tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: 1fa4c927-7485-4f34-94bd-9e20358904b6] Creating image(s)
Nov 06 15:43:38 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-351db0e9-14e3-4c42-a98e-ed2ec14aa38d tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Acquiring lock "/opt/stack/data/nova/instances/1fa4c927-7485-4f34-94bd-9e20358904b6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:43:38 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-351db0e9-14e3-4c42-a98e-ed2ec14aa38d tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Lock "/opt/stack/data/nova/instances/1fa4c927-7485-4f34-94bd-9e20358904b6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:43:38 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-351db0e9-14e3-4c42-a98e-ed2ec14aa38d tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Lock "/opt/stack/data/nova/instances/1fa4c927-7485-4f34-94bd-9e20358904b6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:43:38 user nova-compute[75337]: DEBUG nova.objects.instance [None req-351db0e9-14e3-4c42-a98e-ed2ec14aa38d tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Lazy-loading 'trusted_certs' on Instance uuid 1fa4c927-7485-4f34-94bd-9e20358904b6 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 15:43:38 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-351db0e9-14e3-4c42-a98e-ed2ec14aa38d tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Acquiring lock "de3199ff811058900b61738c0e14021565ee14a4" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:43:38 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-351db0e9-14e3-4c42-a98e-ed2ec14aa38d tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Lock "de3199ff811058900b61738c0e14021565ee14a4" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:43:39 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-351db0e9-14e3-4c42-a98e-ed2ec14aa38d tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de3199ff811058900b61738c0e14021565ee14a4.part --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:43:39 user nova-compute[75337]: INFO nova.compute.manager [None req-1827f735-7849-46b7-94a4-a93a1fdfc874 tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] [instance: 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11] Took 4.50 seconds to detach 3 volumes for instance.
Nov 06 15:43:39 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:43:40 user nova-compute[75337]: DEBUG nova.compute.manager [req-bd93f656-d659-47fa-9b31-2046cccb5a61 req-a4795278-8ae8-45b3-9845-37462bae1f31 service nova] [instance: 1fa4c927-7485-4f34-94bd-9e20358904b6] Received event network-vif-plugged-3812cc74-01db-4b2b-815c-770420051e1b {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:43:40 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-bd93f656-d659-47fa-9b31-2046cccb5a61 req-a4795278-8ae8-45b3-9845-37462bae1f31 service nova] Acquiring lock "1fa4c927-7485-4f34-94bd-9e20358904b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:43:40 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-bd93f656-d659-47fa-9b31-2046cccb5a61 req-a4795278-8ae8-45b3-9845-37462bae1f31 service nova] Lock "1fa4c927-7485-4f34-94bd-9e20358904b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:43:40 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-bd93f656-d659-47fa-9b31-2046cccb5a61 req-a4795278-8ae8-45b3-9845-37462bae1f31 service nova] Lock "1fa4c927-7485-4f34-94bd-9e20358904b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:43:40 user nova-compute[75337]: DEBUG nova.compute.manager [req-bd93f656-d659-47fa-9b31-2046cccb5a61 req-a4795278-8ae8-45b3-9845-37462bae1f31 service nova] [instance: 1fa4c927-7485-4f34-94bd-9e20358904b6] No waiting events found dispatching network-vif-plugged-3812cc74-01db-4b2b-815c-770420051e1b {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:43:40 user nova-compute[75337]: WARNING nova.compute.manager [req-bd93f656-d659-47fa-9b31-2046cccb5a61 req-a4795278-8ae8-45b3-9845-37462bae1f31 service nova] [instance: 1fa4c927-7485-4f34-94bd-9e20358904b6] Received unexpected event network-vif-plugged-3812cc74-01db-4b2b-815c-770420051e1b for instance with vm_state active and task_state rescuing.
Nov 06 15:43:40 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-351db0e9-14e3-4c42-a98e-ed2ec14aa38d tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de3199ff811058900b61738c0e14021565ee14a4.part --force-share --output=json" returned: 0 in 0.572s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:43:40 user nova-compute[75337]: DEBUG nova.virt.images [None req-351db0e9-14e3-4c42-a98e-ed2ec14aa38d tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] 88551c86-98e8-4e00-8348-ad85248c09e9 was qcow2, converting to raw {{(pid=75337) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 06 15:43:40 user nova-compute[75337]: DEBUG nova.privsep.utils [None req-351db0e9-14e3-4c42-a98e-ed2ec14aa38d tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75337) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 06 15:43:40 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-351db0e9-14e3-4c42-a98e-ed2ec14aa38d tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/de3199ff811058900b61738c0e14021565ee14a4.part /opt/stack/data/nova/instances/_base/de3199ff811058900b61738c0e14021565ee14a4.converted {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:43:40 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-1827f735-7849-46b7-94a4-a93a1fdfc874 tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:43:40 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-1827f735-7849-46b7-94a4-a93a1fdfc874 tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:43:40 user nova-compute[75337]: DEBUG nova.network.neutron [None req-1742b26e-22f7-4005-a190-354af68c53aa tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] [instance: 8a600bd8-b94a-4242-a443-c2defb002280] Updating instance_info_cache with network_info: [{"id": "01aa7168-78cd-44e6-8496-08d468f62cfe", "address": "fa:16:3e:f1:25:3e", "network": {"id": "f24470c2-ff6f-49fd-b28f-16b8a87ed3b4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-217486733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed09a1def6f0477796404d9bd3357dd0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01aa7168-78", "ovs_interfaceid": "01aa7168-78cd-44e6-8496-08d468f62cfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:43:40 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:43:40 user nova-compute[75337]: INFO nova.compute.manager [None req-f7cec134-ce83-44f9-b444-89be187dd718 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] [instance: c8cf1ead-a87c-459c-b914-a0e976c9e464] Rescuing
Nov 06 15:43:40 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-f7cec134-ce83-44f9-b444-89be187dd718 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Acquiring lock "refresh_cache-c8cf1ead-a87c-459c-b914-a0e976c9e464" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 15:43:40 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-f7cec134-ce83-44f9-b444-89be187dd718 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Acquired lock "refresh_cache-c8cf1ead-a87c-459c-b914-a0e976c9e464" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 15:43:40 user nova-compute[75337]: DEBUG nova.network.neutron [None req-f7cec134-ce83-44f9-b444-89be187dd718 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] [instance: c8cf1ead-a87c-459c-b914-a0e976c9e464] Building network info cache for instance {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 15:43:40 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-1742b26e-22f7-4005-a190-354af68c53aa tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Releasing lock "refresh_cache-8a600bd8-b94a-4242-a443-c2defb002280" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 15:43:40 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-1742b26e-22f7-4005-a190-354af68c53aa tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] [instance: 8a600bd8-b94a-4242-a443-c2defb002280] Creating instance directory {{(pid=75337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 15:43:40 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-1742b26e-22f7-4005-a190-354af68c53aa tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] [instance: 8a600bd8-b94a-4242-a443-c2defb002280] Creating image(s)
Nov 06 15:43:40 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-1742b26e-22f7-4005-a190-354af68c53aa tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Acquiring lock "/opt/stack/data/nova/instances/8a600bd8-b94a-4242-a443-c2defb002280/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:43:40 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-1742b26e-22f7-4005-a190-354af68c53aa tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Lock "/opt/stack/data/nova/instances/8a600bd8-b94a-4242-a443-c2defb002280/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:43:40 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-1742b26e-22f7-4005-a190-354af68c53aa tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Lock "/opt/stack/data/nova/instances/8a600bd8-b94a-4242-a443-c2defb002280/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.032s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:43:40 user nova-compute[75337]: DEBUG nova.objects.instance [None req-1742b26e-22f7-4005-a190-354af68c53aa tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Lazy-loading 'trusted_certs' on Instance uuid 8a600bd8-b94a-4242-a443-c2defb002280 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 15:43:40 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-b5f4df8e-d681-4f11-86b4-216d61f8092b req-4ccd743d-c981-4aed-81da-ce545b66400d service nova] Acquired lock "refresh_cache-8a600bd8-b94a-4242-a443-c2defb002280" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 15:43:40 user nova-compute[75337]: DEBUG nova.network.neutron [req-b5f4df8e-d681-4f11-86b4-216d61f8092b req-4ccd743d-c981-4aed-81da-ce545b66400d service nova] [instance: 8a600bd8-b94a-4242-a443-c2defb002280] Refreshing network info cache for port 01aa7168-78cd-44e6-8496-08d468f62cfe {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 15:43:40 user nova-compute[75337]: DEBUG nova.objects.base [None req-1742b26e-22f7-4005-a190-354af68c53aa tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Object Instance<8a600bd8-b94a-4242-a443-c2defb002280> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=75337) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 15:43:40 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-1742b26e-22f7-4005-a190-354af68c53aa tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Acquiring lock "f52330de9506d9910cc3b4a9f6bd1a285101ae16" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:43:40 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-1742b26e-22f7-4005-a190-354af68c53aa tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Lock "f52330de9506d9910cc3b4a9f6bd1a285101ae16" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:43:41 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-1742b26e-22f7-4005-a190-354af68c53aa tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f52330de9506d9910cc3b4a9f6bd1a285101ae16.part --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:43:41 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:43:41 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-351db0e9-14e3-4c42-a98e-ed2ec14aa38d tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/de3199ff811058900b61738c0e14021565ee14a4.part /opt/stack/data/nova/instances/_base/de3199ff811058900b61738c0e14021565ee14a4.converted" returned: 0 in 1.671s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:43:41 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-351db0e9-14e3-4c42-a98e-ed2ec14aa38d tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de3199ff811058900b61738c0e14021565ee14a4.converted --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:43:41 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-1742b26e-22f7-4005-a190-354af68c53aa tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f52330de9506d9910cc3b4a9f6bd1a285101ae16.part --force-share --output=json" returned: 0 in 0.250s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:43:41 user nova-compute[75337]: DEBUG nova.virt.images [None req-1742b26e-22f7-4005-a190-354af68c53aa tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] b903ecce-b6cc-4173-97b0-7dcdc01e4622 was qcow2, converting to raw {{(pid=75337) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 06 15:43:41 user nova-compute[75337]: DEBUG nova.privsep.utils [None req-1742b26e-22f7-4005-a190-354af68c53aa tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75337) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 06 15:43:41 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-1742b26e-22f7-4005-a190-354af68c53aa tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f52330de9506d9910cc3b4a9f6bd1a285101ae16.part /opt/stack/data/nova/instances/_base/f52330de9506d9910cc3b4a9f6bd1a285101ae16.converted {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:43:41 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-351db0e9-14e3-4c42-a98e-ed2ec14aa38d tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de3199ff811058900b61738c0e14021565ee14a4.converted --force-share --output=json" returned: 0 in 0.202s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:43:41 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-351db0e9-14e3-4c42-a98e-ed2ec14aa38d tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Lock "de3199ff811058900b61738c0e14021565ee14a4" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 3.938s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:43:41 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-351db0e9-14e3-4c42-a98e-ed2ec14aa38d tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Acquiring lock "de3199ff811058900b61738c0e14021565ee14a4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:43:41 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-351db0e9-14e3-4c42-a98e-ed2ec14aa38d tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Lock "de3199ff811058900b61738c0e14021565ee14a4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:43:41 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-351db0e9-14e3-4c42-a98e-ed2ec14aa38d tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de3199ff811058900b61738c0e14021565ee14a4 --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:43:42 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-1827f735-7849-46b7-94a4-a93a1fdfc874 tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 15:43:42 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-1827f735-7849-46b7-94a4-a93a1fdfc874 tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 15:43:42 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-1827f735-7849-46b7-94a4-a93a1fdfc874 tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 2.103s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:43:42 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-1742b26e-22f7-4005-a190-354af68c53aa tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f52330de9506d9910cc3b4a9f6bd1a285101ae16.part /opt/stack/data/nova/instances/_base/f52330de9506d9910cc3b4a9f6bd1a285101ae16.converted" returned: 0 in 0.339s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:43:42 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-1742b26e-22f7-4005-a190-354af68c53aa tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f52330de9506d9910cc3b4a9f6bd1a285101ae16.converted --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:43:42 user nova-compute[75337]: DEBUG nova.network.neutron [None req-f7cec134-ce83-44f9-b444-89be187dd718 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] [instance: c8cf1ead-a87c-459c-b914-a0e976c9e464] Updating instance_info_cache with network_info: [{"id": "b33373f6-0289-4623-90ac-f5c3db0d3681", "address": "fa:16:3e:37:16:66", "network": {"id": "a839a9d1-fdf3-4a72-898b-6829ceef2055", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1927950273-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86f4b41336384a53a3fd22caa0fe8e6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb33373f6-02", "ovs_interfaceid": "b33373f6-0289-4623-90ac-f5c3db0d3681", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:43:42 user nova-compute[75337]: INFO nova.scheduler.client.report [None req-1827f735-7849-46b7-94a4-a93a1fdfc874 tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Deleted allocations for instance 67d9ceff-c1fc-48ad-85c8-3aa37ebabf11
Nov 06 15:43:42 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-351db0e9-14e3-4c42-a98e-ed2ec14aa38d tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de3199ff811058900b61738c0e14021565ee14a4 --force-share --output=json" returned: 0 in 0.369s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:43:42 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-351db0e9-14e3-4c42-a98e-ed2ec14aa38d tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/de3199ff811058900b61738c0e14021565ee14a4,backing_fmt=raw /opt/stack/data/nova/instances/1fa4c927-7485-4f34-94bd-9e20358904b6/disk.rescue {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:43:42 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-f7cec134-ce83-44f9-b444-89be187dd718 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Releasing lock "refresh_cache-c8cf1ead-a87c-459c-b914-a0e976c9e464" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 15:43:42 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-351db0e9-14e3-4c42-a98e-ed2ec14aa38d tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/de3199ff811058900b61738c0e14021565ee14a4,backing_fmt=raw /opt/stack/data/nova/instances/1fa4c927-7485-4f34-94bd-9e20358904b6/disk.rescue" returned: 0 in 0.079s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:43:42 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-351db0e9-14e3-4c42-a98e-ed2ec14aa38d tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Lock "de3199ff811058900b61738c0e14021565ee14a4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.451s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:43:42 user nova-compute[75337]: DEBUG nova.objects.instance [None req-351db0e9-14e3-4c42-a98e-ed2ec14aa38d tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Lazy-loading 'migration_context' on Instance uuid 1fa4c927-7485-4f34-94bd-9e20358904b6 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 15:43:42 user nova-compute[75337]: DEBUG nova.objects.base [None req-351db0e9-14e3-4c42-a98e-ed2ec14aa38d tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Object Instance<1fa4c927-7485-4f34-94bd-9e20358904b6> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75337) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 15:43:42 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-351db0e9-14e3-4c42-a98e-ed2ec14aa38d tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: 1fa4c927-7485-4f34-94bd-9e20358904b6] Created local disks {{(pid=75337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 15:43:42 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-351db0e9-14e3-4c42-a98e-ed2ec14aa38d tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: 1fa4c927-7485-4f34-94bd-9e20358904b6] Start _get_guest_xml network_info=[{"id": "3812cc74-01db-4b2b-815c-770420051e1b", "address": "fa:16:3e:f4:aa:7b", "network": {"id": "736be000-ee94-41fd-9de0-f2f885ec9be7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1715443852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1715443852-network", "vif_mac": "fa:16:3e:f4:aa:7b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb76b5b0f2b24f1c84a92403176bcc00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3812cc74-01", "ovs_interfaceid": "3812cc74-01db-4b2b-815c-770420051e1b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T15:34:14Z,direct_url=<?>,disk_format='qcow2',id=16b903ae-a40f-41a7-985b-4804cce92c62,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6549a15819f1469bbd5eeae8190e3d44',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T15:34:15Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '88551c86-98e8-4e00-8348-ad85248c09e9', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'attachment_id': '558ab0eb-f864-4606-b5a8-2d7f980cbea6', 'guest_format': None, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WUOuHYhT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '1fa4c927-7485-4f34-94bd-9e20358904b6', 'attached_at': '', 'detached_at': '', 'volume_id': '2e08ef35-543e-4718-beed-36e2ed8dd158', 'serial': '2e08ef35-543e-4718-beed-36e2ed8dd158'}, 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=75337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 15:43:42 user nova-compute[75337]: DEBUG nova.objects.instance [None req-351db0e9-14e3-4c42-a98e-ed2ec14aa38d tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Lazy-loading 'resources' on Instance uuid 1fa4c927-7485-4f34-94bd-9e20358904b6 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 15:43:42 user nova-compute[75337]: DEBUG nova.objects.base [None req-351db0e9-14e3-4c42-a98e-ed2ec14aa38d tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Object Instance<1fa4c927-7485-4f34-94bd-9e20358904b6> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75337) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 15:43:42 user nova-compute[75337]: DEBUG nova.objects.instance [None req-351db0e9-14e3-4c42-a98e-ed2ec14aa38d tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Lazy-loading 'numa_topology' on Instance uuid 1fa4c927-7485-4f34-94bd-9e20358904b6 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 15:43:42 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-1742b26e-22f7-4005-a190-354af68c53aa tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f52330de9506d9910cc3b4a9f6bd1a285101ae16.converted --force-share --output=json" returned: 0 in 0.210s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:43:42 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-1742b26e-22f7-4005-a190-354af68c53aa tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Lock "f52330de9506d9910cc3b4a9f6bd1a285101ae16" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.059s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:43:42 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-1742b26e-22f7-4005-a190-354af68c53aa tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f52330de9506d9910cc3b4a9f6bd1a285101ae16 --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:43:42 user nova-compute[75337]: DEBUG nova.network.neutron [req-b5f4df8e-d681-4f11-86b4-216d61f8092b req-4ccd743d-c981-4aed-81da-ce545b66400d service nova] [instance: 8a600bd8-b94a-4242-a443-c2defb002280] Updated VIF entry in instance network info cache for port 01aa7168-78cd-44e6-8496-08d468f62cfe. {{(pid=75337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 15:43:42 user nova-compute[75337]: DEBUG nova.network.neutron [req-b5f4df8e-d681-4f11-86b4-216d61f8092b req-4ccd743d-c981-4aed-81da-ce545b66400d service nova] [instance: 8a600bd8-b94a-4242-a443-c2defb002280] Updating instance_info_cache with network_info: [{"id": "01aa7168-78cd-44e6-8496-08d468f62cfe", "address": "fa:16:3e:f1:25:3e", "network": {"id": "f24470c2-ff6f-49fd-b28f-16b8a87ed3b4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-217486733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed09a1def6f0477796404d9bd3357dd0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01aa7168-78", "ovs_interfaceid": "01aa7168-78cd-44e6-8496-08d468f62cfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:43:42 user nova-compute[75337]: DEBUG nova.objects.base [None req-351db0e9-14e3-4c42-a98e-ed2ec14aa38d tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Object Instance<1fa4c927-7485-4f34-94bd-9e20358904b6> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75337) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 15:43:42 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-1827f735-7849-46b7-94a4-a93a1fdfc874 tempest-TaggedBootDevicesTest-1790653325 tempest-TaggedBootDevicesTest-1790653325-project-member] Lock "67d9ceff-c1fc-48ad-85c8-3aa37ebabf11" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 15.842s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:43:42 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-b5f4df8e-d681-4f11-86b4-216d61f8092b req-4ccd743d-c981-4aed-81da-ce545b66400d service nova] Releasing lock "refresh_cache-8a600bd8-b94a-4242-a443-c2defb002280" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 15:43:42 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-351db0e9-14e3-4c42-a98e-ed2ec14aa38d tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 15:43:42 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-351db0e9-14e3-4c42-a98e-ed2ec14aa38d tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 15:43:42 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-351db0e9-14e3-4c42-a98e-ed2ec14aa38d tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 15:43:42 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-351db0e9-14e3-4c42-a98e-ed2ec14aa38d tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] CPU controller missing on host. {{(pid=75337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 15:43:42 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-351db0e9-14e3-4c42-a98e-ed2ec14aa38d tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 15:43:42 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-351db0e9-14e3-4c42-a98e-ed2ec14aa38d tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] CPU controller found on host. {{(pid=75337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 15:43:42 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-351db0e9-14e3-4c42-a98e-ed2ec14aa38d tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75337) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 15:43:42 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-351db0e9-14e3-4c42-a98e-ed2ec14aa38d tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T15:34:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T15:34:14Z,direct_url=<?>,disk_format='qcow2',id=16b903ae-a40f-41a7-985b-4804cce92c62,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6549a15819f1469bbd5eeae8190e3d44',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T15:34:15Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 15:43:42 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-351db0e9-14e3-4c42-a98e-ed2ec14aa38d tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Flavor limits 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 15:43:42 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-351db0e9-14e3-4c42-a98e-ed2ec14aa38d tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Image limits 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 15:43:42 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-351db0e9-14e3-4c42-a98e-ed2ec14aa38d tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Flavor pref 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 15:43:42 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-351db0e9-14e3-4c42-a98e-ed2ec14aa38d tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Image pref 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 15:43:42 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-351db0e9-14e3-4c42-a98e-ed2ec14aa38d tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 15:43:42 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-351db0e9-14e3-4c42-a98e-ed2ec14aa38d tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 15:43:42 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-351db0e9-14e3-4c42-a98e-ed2ec14aa38d tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 15:43:42 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-351db0e9-14e3-4c42-a98e-ed2ec14aa38d tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Got 1 possible topologies {{(pid=75337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 15:43:42 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-351db0e9-14e3-4c42-a98e-ed2ec14aa38d tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 15:43:42 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-351db0e9-14e3-4c42-a98e-ed2ec14aa38d tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 15:43:42 user nova-compute[75337]: DEBUG nova.objects.instance [None req-351db0e9-14e3-4c42-a98e-ed2ec14aa38d tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Lazy-loading 'vcpu_model' on Instance uuid 1fa4c927-7485-4f34-94bd-9e20358904b6 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 15:43:42 user nova-compute[75337]: DEBUG nova.objects.base [None req-351db0e9-14e3-4c42-a98e-ed2ec14aa38d tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Object Instance<1fa4c927-7485-4f34-94bd-9e20358904b6> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75337) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 15:43:42 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-351db0e9-14e3-4c42-a98e-ed2ec14aa38d tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: 1fa4c927-7485-4f34-94bd-9e20358904b6] Calling os-brick to attach iSCSI Volume {{(pid=75337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 15:43:42 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-351db0e9-14e3-4c42-a98e-ed2ec14aa38d tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2abc33d0c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WUOuHYhT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 15:43:42 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-351db0e9-14e3-4c42-a98e-ed2ec14aa38d tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 15:43:42 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-351db0e9-14e3-4c42-a98e-ed2ec14aa38d tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 15:43:42 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-351db0e9-14e3-4c42-a98e-ed2ec14aa38d tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 15:43:42 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-351db0e9-14e3-4c42-a98e-ed2ec14aa38d tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 15:43:42 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-351db0e9-14e3-4c42-a98e-ed2ec14aa38d tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 15:43:42 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-351db0e9-14e3-4c42-a98e-ed2ec14aa38d tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.006s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 15:43:42 user nova-compute[75337]: INFO os_brick.initiator.connectors.iscsi [None req-351db0e9-14e3-4c42-a98e-ed2ec14aa38d tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 15:43:42 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:43:42 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-1742b26e-22f7-4005-a190-354af68c53aa tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f52330de9506d9910cc3b4a9f6bd1a285101ae16 --force-share --output=json" returned: 0 in 0.241s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:43:42 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 -p 172.16.0.220:3260 {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:43:42 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-1742b26e-22f7-4005-a190-354af68c53aa tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Acquiring lock "f52330de9506d9910cc3b4a9f6bd1a285101ae16" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:43:42 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-1742b26e-22f7-4005-a190-354af68c53aa tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Lock "f52330de9506d9910cc3b4a9f6bd1a285101ae16" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:43:42 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-1742b26e-22f7-4005-a190-354af68c53aa tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f52330de9506d9910cc3b4a9f6bd1a285101ae16 --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:43:42 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 -p 172.16.0.220:3260" returned: 0 in 0.024s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:43:42 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3859802-adf6-4414-84b0-ae1d249f4664]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = WUOuHYhT\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:43:42 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:43:42 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-351db0e9-14e3-4c42-a98e-ed2ec14aa38d tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 06 15:43:42 user nova-compute[75337]: node.name = iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158
Nov 06 15:43:42 user nova-compute[75337]: node.tpgt = -1
Nov 06 15:43:42 user nova-compute[75337]: node.startup = automatic
Nov 06 15:43:42 user nova-compute[75337]: node.leading_login = No
Nov 06 15:43:42 user nova-compute[75337]: iface.iscsi_ifacename = default
Nov 06 15:43:42 user nova-compute[75337]: iface.net_ifacename = <empty>
Nov 06 15:43:42 user nova-compute[75337]: iface.ipaddress = <empty>
Nov 06 15:43:42 user nova-compute[75337]: iface.prefix_len = 0
Nov 06 15:43:42 user nova-compute[75337]: iface.hwaddress = <empty>
Nov 06 15:43:42 user nova-compute[75337]: iface.transport_name = tcp
Nov 06 15:43:42 user nova-compute[75337]: iface.initiatorname = <empty>
Nov 06 15:43:42 user nova-compute[75337]: iface.state = <empty>
Nov 06 15:43:42 user nova-compute[75337]: iface.vlan_id = 0
Nov 06 15:43:42 user nova-compute[75337]: iface.vlan_priority = 0
Nov 06 15:43:42 user nova-compute[75337]: iface.vlan_state = <empty>
Nov 06 15:43:42 user nova-compute[75337]: iface.iface_num = 0
Nov 06 15:43:42 user nova-compute[75337]: iface.mtu = 0
Nov 06 15:43:42 user nova-compute[75337]: iface.port = 0
Nov 06 15:43:42 user nova-compute[75337]: iface.bootproto = <empty>
Nov 06 15:43:42 user nova-compute[75337]: iface.subnet_mask = <empty>
Nov 06 15:43:42 user nova-compute[75337]: iface.gateway = <empty>
Nov 06 15:43:42 user nova-compute[75337]: iface.dhcp_alt_client_id_state = <empty>
Nov 06 15:43:42 user nova-compute[75337]: iface.dhcp_alt_client_id = <empty>
Nov 06 15:43:42 user nova-compute[75337]: iface.dhcp_dns = <empty>
Nov 06 15:43:42 user nova-compute[75337]: iface.dhcp_learn_iqn = <empty>
Nov 06 15:43:42 user nova-compute[75337]: iface.dhcp_req_vendor_id_state = <empty>
Nov 06 15:43:42 user nova-compute[75337]: iface.dhcp_vendor_id_state = <empty>
Nov 06 15:43:42 user nova-compute[75337]: iface.dhcp_vendor_id = <empty>
Nov 06 15:43:42 user nova-compute[75337]: iface.dhcp_slp_da = <empty>
Nov 06 15:43:42 user nova-compute[75337]: iface.fragmentation = <empty>
Nov 06 15:43:42 user nova-compute[75337]: iface.gratuitous_arp = <empty>
Nov 06 15:43:42 user nova-compute[75337]: iface.incoming_forwarding = <empty>
Nov 06 15:43:42 user nova-compute[75337]: iface.tos_state = <empty>
Nov 06 15:43:42 user nova-compute[75337]: iface.tos = 0
Nov 06 15:43:42 user nova-compute[75337]: iface.ttl = 0
Nov 06 15:43:42 user nova-compute[75337]: iface.delayed_ack = <empty>
Nov 06 15:43:42 user nova-compute[75337]: iface.tcp_nagle = <empty>
Nov 06 15:43:42 user nova-compute[75337]: iface.tcp_wsf_state = <empty>
Nov 06 15:43:42 user nova-compute[75337]: iface.tcp_wsf = 0
Nov 06 15:43:42 user nova-compute[75337]: iface.tcp_timer_scale = 0
Nov 06 15:43:42 user nova-compute[75337]: iface.tcp_timestamp = <empty>
Nov 06 15:43:42 user nova-compute[75337]: iface.redirect = <empty>
Nov 06 15:43:42 user nova-compute[75337]: iface.def_task_mgmt_timeout = 0
Nov 06 15:43:42 user nova-compute[75337]: iface.header_digest = <empty>
Nov 06 15:43:42 user nova-compute[75337]: iface.data_digest = <empty>
Nov 06 15:43:42 user nova-compute[75337]: iface.immediate_data = <empty>
Nov 06 15:43:42 user nova-compute[75337]: iface.initial_r2t = <empty>
Nov 06 15:43:42 user nova-compute[75337]: iface.data_seq_inorder = <empty>
Nov 06 15:43:42 user nova-compute[75337]: iface.data_pdu_inorder = <empty>
Nov 06 15:43:42 user nova-compute[75337]: iface.erl = 0
Nov 06 15:43:42 user nova-compute[75337]: iface.max_receive_data_len = 0
Nov 06 15:43:42 user nova-compute[75337]: iface.first_burst_len = 0
Nov 06 15:43:42 user nova-compute[75337]: iface.max_outstanding_r2t = 0
Nov 06 15:43:42 user nova-compute[75337]: iface.max_burst_len = 0
Nov 06 15:43:42 user nova-compute[75337]: iface.chap_auth = <empty>
Nov 06 15:43:42 user nova-compute[75337]: iface.bidi_chap = <empty>
Nov 06 15:43:42 user nova-compute[75337]: iface.strict_login_compliance = <empty>
Nov 06 15:43:42 user nova-compute[75337]: iface.discovery_auth = <empty>
Nov 06 15:43:42 user nova-compute[75337]: iface.discovery_logout = <empty>
Nov 06 15:43:42 user nova-compute[75337]: node.discovery_address = <empty>
Nov 06 15:43:42 user nova-compute[75337]: node.discovery_port = 0
Nov 06 15:43:42 user nova-compute[75337]: node.discovery_type = static
Nov 06 15:43:42 user nova-compute[75337]: node.session.initial_cmdsn = 0
Nov 06 15:43:42 user nova-compute[75337]: node.session.initial_login_retry_max = 8
Nov 06 15:43:42 user nova-compute[75337]: node.session.xmit_thread_priority = -20
Nov 06 15:43:42 user nova-compute[75337]: node.session.cmds_max = 128
Nov 06 15:43:42 user nova-compute[75337]: node.session.queue_depth = 32
Nov 06 15:43:42 user nova-compute[75337]: node.session.nr_sessions = 1
Nov 06 15:43:42 user nova-compute[75337]: node.session.auth.authmethod = CHAP
Nov 06 15:43:42 user nova-compute[75337]: node.session.auth.username = WUOuHYhT
Nov 06 15:43:42 user nova-compute[75337]: node.session.auth.password = ***
Nov 06 15:43:42 user nova-compute[75337]: node.session.auth.username_in = <empty>
Nov 06 15:43:42 user nova-compute[75337]: node.session.auth.password_in = <empty>
Nov 06 15:43:42 user nova-compute[75337]: node.session.auth.chap_algs = MD5
Nov 06 15:43:42 user nova-compute[75337]: node.session.timeo.replacement_timeout = 120
Nov 06 15:43:42 user nova-compute[75337]: node.session.err_timeo.abort_timeout = 15
Nov 06 15:43:42 user nova-compute[75337]: node.session.err_timeo.lu_reset_timeout = 30
Nov 06 15:43:42 user nova-compute[75337]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 06 15:43:42 user nova-compute[75337]: node.session.err_timeo.host_reset_timeout = 60
Nov 06 15:43:42 user nova-compute[75337]: node.session.iscsi.FastAbort = Yes
Nov 06 15:43:42 user nova-compute[75337]: node.session.iscsi.InitialR2T = No
Nov 06 15:43:42 user nova-compute[75337]: node.session.iscsi.ImmediateData = Yes
Nov 06 15:43:42 user nova-compute[75337]: node.session.iscsi.FirstBurstLength = 262144
Nov 06 15:43:42 user nova-compute[75337]: node.session.iscsi.MaxBurstLength = 16776192
Nov 06 15:43:42 user nova-compute[75337]: node.session.iscsi.DefaultTime2Retain = 0
Nov 06 15:43:42 user nova-compute[75337]: node.session.iscsi.DefaultTime2Wait = 2
Nov 06 15:43:42 user nova-compute[75337]: node.session.iscsi.MaxConnections = 1
Nov 06 15:43:42 user nova-compute[75337]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 06 15:43:42 user nova-compute[75337]: node.session.iscsi.ERL = 0
Nov 06 15:43:42 user nova-compute[75337]: node.session.scan = manual
Nov 06 15:43:42 user nova-compute[75337]: node.session.reopen_max = 0
Nov 06 15:43:42 user nova-compute[75337]: node.conn[0].address = 172.16.0.220
Nov 06 15:43:42 user nova-compute[75337]: node.conn[0].port = 3260
Nov 06 15:43:42 user nova-compute[75337]: node.conn[0].startup = manual
Nov 06 15:43:42 user nova-compute[75337]: node.conn[0].tcp.window_size = 524288
Nov 06 15:43:42 user nova-compute[75337]: node.conn[0].tcp.type_of_service = 0
Nov 06 15:43:42 user nova-compute[75337]: node.conn[0].timeo.logout_timeout = 15
Nov 06 15:43:42 user nova-compute[75337]: node.conn[0].timeo.login_timeout = 15
Nov 06 15:43:42 user nova-compute[75337]: node.conn[0].timeo.auth_timeout = 45
Nov 06 15:43:42 user nova-compute[75337]: node.conn[0].timeo.noop_out_interval = 5
Nov 06 15:43:42 user nova-compute[75337]: node.conn[0].timeo.noop_out_timeout = 5
Nov 06 15:43:42 user nova-compute[75337]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 06 15:43:42 user nova-compute[75337]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 06 15:43:42 user nova-compute[75337]: node.conn[0].iscsi.HeaderDigest = None
Nov 06 15:43:42 user nova-compute[75337]: node.conn[0].iscsi.DataDigest = None
Nov 06 15:43:42 user nova-compute[75337]: node.conn[0].iscsi.IFMarker = No
Nov 06 15:43:42 user nova-compute[75337]: node.conn[0].iscsi.OFMarker = No
Nov 06 15:43:42 user nova-compute[75337]: # END RECORD
Nov 06 15:43:42 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:43:42 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:43:42 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:43:42 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[af30eb13-5f85-4e72-9b1b-f7560aaad9d3]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:43:42 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-351db0e9-14e3-4c42-a98e-ed2ec14aa38d tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:43:42 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:43:42 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.040s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:43:42 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e4fff35-437e-4c4d-978c-5c69ca828434]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:43:42 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-351db0e9-14e3-4c42-a98e-ed2ec14aa38d tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:43:42 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WUOuHYhT {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:43:42 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WUOuHYhT" returned: 0 in 0.026s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:43:42 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[a755508f-5b6c-43a6-8fcc-85bc18249a2c]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:43:42 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-351db0e9-14e3-4c42-a98e-ed2ec14aa38d tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WUOuHYhT'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:43:42 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:43:42 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:43:42 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[33ce16f5-4b9b-426c-bf8c-eabf970b84d0]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:43:42 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-351db0e9-14e3-4c42-a98e-ed2ec14aa38d tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:43:42 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:43:42 user nova-compute[75337]: DEBUG nova.compute.manager [req-200b9e54-b6f0-4041-90f6-d1e281ed64f3 req-88c41121-c743-4a95-8763-584532a70de8 service nova] [instance: c8cf1ead-a87c-459c-b914-a0e976c9e464] Received event network-vif-unplugged-b33373f6-0289-4623-90ac-f5c3db0d3681 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:43:42 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-200b9e54-b6f0-4041-90f6-d1e281ed64f3 req-88c41121-c743-4a95-8763-584532a70de8 service nova] Acquiring lock "c8cf1ead-a87c-459c-b914-a0e976c9e464-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:43:42 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-200b9e54-b6f0-4041-90f6-d1e281ed64f3 req-88c41121-c743-4a95-8763-584532a70de8 service nova] Lock "c8cf1ead-a87c-459c-b914-a0e976c9e464-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:43:42 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-200b9e54-b6f0-4041-90f6-d1e281ed64f3 req-88c41121-c743-4a95-8763-584532a70de8 service nova] Lock "c8cf1ead-a87c-459c-b914-a0e976c9e464-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:43:42 user nova-compute[75337]: DEBUG nova.compute.manager [req-200b9e54-b6f0-4041-90f6-d1e281ed64f3 req-88c41121-c743-4a95-8763-584532a70de8 service nova] [instance: c8cf1ead-a87c-459c-b914-a0e976c9e464] No waiting events found dispatching network-vif-unplugged-b33373f6-0289-4623-90ac-f5c3db0d3681 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:43:42 user nova-compute[75337]: WARNING nova.compute.manager [req-200b9e54-b6f0-4041-90f6-d1e281ed64f3 req-88c41121-c743-4a95-8763-584532a70de8 service nova] [instance: c8cf1ead-a87c-459c-b914-a0e976c9e464] Received unexpected event network-vif-unplugged-b33373f6-0289-4623-90ac-f5c3db0d3681 for instance with vm_state active and task_state rescuing.
Nov 06 15:43:42 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:43:42 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[36a27d58-6d94-407c-a879-701775460b55]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f5503fc-8cc8-46fa-8450-d967f769a947 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759 (non-flash)\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:43:42 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-351db0e9-14e3-4c42-a98e-ed2ec14aa38d tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)
Nov 06 15:43:42 user nova-compute[75337]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e (non-flash)
Nov 06 15:43:42 user nova-compute[75337]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f5503fc-8cc8-46fa-8450-d967f769a947 (non-flash)
Nov 06 15:43:42 user nova-compute[75337]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759 (non-flash)
Nov 06 15:43:42 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 15:43:42 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-351db0e9-14e3-4c42-a98e-ed2ec14aa38d tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)
Nov 06 15:43:42 user nova-compute[75337]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e (non-flash)
Nov 06 15:43:42 user nova-compute[75337]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f5503fc-8cc8-46fa-8450-d967f769a947 (non-flash)
Nov 06 15:43:42 user nova-compute[75337]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759 (non-flash)
Nov 06 15:43:42 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 15:43:42 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-351db0e9-14e3-4c42-a98e-ed2ec14aa38d tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.250s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 15:43:42 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-351db0e9-14e3-4c42-a98e-ed2ec14aa38d tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Connected to 172.16.0.220:3260 {{(pid=75337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 15:43:42 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-351db0e9-14e3-4c42-a98e-ed2ec14aa38d tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] HCTL ('34', '0', '0', 0) found on session 10 with lun 0 {{(pid=75337) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 15:43:42 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-351db0e9-14e3-4c42-a98e-ed2ec14aa38d tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=75337) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 15:43:42 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:43:43 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.014s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:43:43 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d1200b6-a611-4a60-859d-e113fdc44eb7]: (4, ('0 0 0', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:43:43 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-351db0e9-14e3-4c42-a98e-ed2ec14aa38d tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Searching for a device in session 10 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=75337) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 15:43:43 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-351db0e9-14e3-4c42-a98e-ed2ec14aa38d tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WUOuHYhT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 15:43:43 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-351db0e9-14e3-4c42-a98e-ed2ec14aa38d tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.281s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 15:43:43 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-351db0e9-14e3-4c42-a98e-ed2ec14aa38d tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] <== connect_volume: return (284ms) {'type': 'block', 'scsi_wwn': '26661646130616538', 'path': '/dev/sdc'} {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 15:43:43 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-351db0e9-14e3-4c42-a98e-ed2ec14aa38d tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: 1fa4c927-7485-4f34-94bd-9e20358904b6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26661646130616538', 'path': '/dev/sdc'} {{(pid=75337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 15:43:43 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-1742b26e-22f7-4005-a190-354af68c53aa tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f52330de9506d9910cc3b4a9f6bd1a285101ae16 --force-share --output=json" returned: 0 in 0.258s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:43:43 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-1742b26e-22f7-4005-a190-354af68c53aa tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f52330de9506d9910cc3b4a9f6bd1a285101ae16,backing_fmt=raw /opt/stack/data/nova/instances/8a600bd8-b94a-4242-a443-c2defb002280/disk 1073741824 {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:43:43 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-1742b26e-22f7-4005-a190-354af68c53aa tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f52330de9506d9910cc3b4a9f6bd1a285101ae16,backing_fmt=raw /opt/stack/data/nova/instances/8a600bd8-b94a-4242-a443-c2defb002280/disk 1073741824" returned: 0 in 0.068s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:43:43 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-1742b26e-22f7-4005-a190-354af68c53aa tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Lock "f52330de9506d9910cc3b4a9f6bd1a285101ae16" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.331s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:43:43 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-1742b26e-22f7-4005-a190-354af68c53aa tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f52330de9506d9910cc3b4a9f6bd1a285101ae16 --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:43:43 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-351db0e9-14e3-4c42-a98e-ed2ec14aa38d tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T15:40:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-777586837',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-777586837',id=12,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-06T15:42:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='eb76b5b0f2b24f1c84a92403176bcc00',ramdisk_id='',reservation_id='r-hsqdw3vy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2044295020',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T15:42:21Z,user_data=None,user_id='74090d6e5b354d79bf6ded92e6de56aa',uuid=1fa4c927-7485-4f34-94bd-9e20358904b6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3812cc74-01db-4b2b-815c-770420051e1b", "address": "fa:16:3e:f4:aa:7b", "network": {"id": "736be000-ee94-41fd-9de0-f2f885ec9be7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1715443852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1715443852-network", "vif_mac": "fa:16:3e:f4:aa:7b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb76b5b0f2b24f1c84a92403176bcc00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3812cc74-01", "ovs_interfaceid": "3812cc74-01db-4b2b-815c-770420051e1b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75337) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 15:43:43 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-351db0e9-14e3-4c42-a98e-ed2ec14aa38d tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Converting VIF {"id": "3812cc74-01db-4b2b-815c-770420051e1b", "address": "fa:16:3e:f4:aa:7b", "network": {"id": "736be000-ee94-41fd-9de0-f2f885ec9be7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1715443852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1715443852-network", "vif_mac": "fa:16:3e:f4:aa:7b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb76b5b0f2b24f1c84a92403176bcc00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3812cc74-01", "ovs_interfaceid": "3812cc74-01db-4b2b-815c-770420051e1b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 15:43:43 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-351db0e9-14e3-4c42-a98e-ed2ec14aa38d tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f4:aa:7b,bridge_name='br-int',has_traffic_filtering=True,id=3812cc74-01db-4b2b-815c-770420051e1b,network=Network(736be000-ee94-41fd-9de0-f2f885ec9be7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3812cc74-01') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 15:43:43 user nova-compute[75337]: DEBUG nova.objects.instance [None req-351db0e9-14e3-4c42-a98e-ed2ec14aa38d tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Lazy-loading 'pci_devices' on Instance uuid 1fa4c927-7485-4f34-94bd-9e20358904b6 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 15:43:43 user nova-compute[75337]: DEBUG nova.objects.base [None req-351db0e9-14e3-4c42-a98e-ed2ec14aa38d tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Object Instance<1fa4c927-7485-4f34-94bd-9e20358904b6> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75337) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 15:43:43 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-351db0e9-14e3-4c42-a98e-ed2ec14aa38d tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: 1fa4c927-7485-4f34-94bd-9e20358904b6] End _get_guest_xml xml=<domain type="kvm">
Nov 06 15:43:43 user nova-compute[75337]:   <uuid>1fa4c927-7485-4f34-94bd-9e20358904b6</uuid>
Nov 06 15:43:43 user nova-compute[75337]:   <name>instance-0000000c</name>
Nov 06 15:43:43 user nova-compute[75337]:   <memory>524288</memory>
Nov 06 15:43:43 user nova-compute[75337]:   <vcpu>1</vcpu>
Nov 06 15:43:43 user nova-compute[75337]:   <metadata>
Nov 06 15:43:43 user nova-compute[75337]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 15:43:43 user nova-compute[75337]:       <nova:package version="0.0.0"/>
Nov 06 15:43:43 user nova-compute[75337]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-777586837</nova:name>
Nov 06 15:43:43 user nova-compute[75337]:       <nova:creationTime>2023-11-06 15:43:42</nova:creationTime>
Nov 06 15:43:43 user nova-compute[75337]:       <nova:flavor name="m1.tiny">
Nov 06 15:43:43 user nova-compute[75337]:         <nova:memory>512</nova:memory>
Nov 06 15:43:43 user nova-compute[75337]:         <nova:disk>1</nova:disk>
Nov 06 15:43:43 user nova-compute[75337]:         <nova:swap>0</nova:swap>
Nov 06 15:43:43 user nova-compute[75337]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 15:43:43 user nova-compute[75337]:         <nova:vcpus>1</nova:vcpus>
Nov 06 15:43:43 user nova-compute[75337]:       </nova:flavor>
Nov 06 15:43:43 user nova-compute[75337]:       <nova:owner>
Nov 06 15:43:43 user nova-compute[75337]:         <nova:user uuid="74090d6e5b354d79bf6ded92e6de56aa">tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member</nova:user>
Nov 06 15:43:43 user nova-compute[75337]:         <nova:project uuid="eb76b5b0f2b24f1c84a92403176bcc00">tempest-ServerBootFromVolumeStableRescueTest-2044295020</nova:project>
Nov 06 15:43:43 user nova-compute[75337]:       </nova:owner>
Nov 06 15:43:43 user nova-compute[75337]:       <nova:root type="image" uuid="16b903ae-a40f-41a7-985b-4804cce92c62"/>
Nov 06 15:43:43 user nova-compute[75337]:       <nova:ports>
Nov 06 15:43:43 user nova-compute[75337]:         <nova:port uuid="3812cc74-01db-4b2b-815c-770420051e1b">
Nov 06 15:43:43 user nova-compute[75337]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 06 15:43:43 user nova-compute[75337]:         </nova:port>
Nov 06 15:43:43 user nova-compute[75337]:       </nova:ports>
Nov 06 15:43:43 user nova-compute[75337]:     </nova:instance>
Nov 06 15:43:43 user nova-compute[75337]:   </metadata>
Nov 06 15:43:43 user nova-compute[75337]:   <sysinfo type="smbios">
Nov 06 15:43:43 user nova-compute[75337]:     <system>
Nov 06 15:43:43 user nova-compute[75337]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 15:43:43 user nova-compute[75337]:       <entry name="product">OpenStack Nova</entry>
Nov 06 15:43:43 user nova-compute[75337]:       <entry name="version">0.0.0</entry>
Nov 06 15:43:43 user nova-compute[75337]:       <entry name="serial">1fa4c927-7485-4f34-94bd-9e20358904b6</entry>
Nov 06 15:43:43 user nova-compute[75337]:       <entry name="uuid">1fa4c927-7485-4f34-94bd-9e20358904b6</entry>
Nov 06 15:43:43 user nova-compute[75337]:       <entry name="family">Virtual Machine</entry>
Nov 06 15:43:43 user nova-compute[75337]:     </system>
Nov 06 15:43:43 user nova-compute[75337]:   </sysinfo>
Nov 06 15:43:43 user nova-compute[75337]:   <os>
Nov 06 15:43:43 user nova-compute[75337]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 15:43:43 user nova-compute[75337]:     <smbios mode="sysinfo"/>
Nov 06 15:43:43 user nova-compute[75337]:   </os>
Nov 06 15:43:43 user nova-compute[75337]:   <features>
Nov 06 15:43:43 user nova-compute[75337]:     <acpi/>
Nov 06 15:43:43 user nova-compute[75337]:     <apic/>
Nov 06 15:43:43 user nova-compute[75337]:     <vmcoreinfo/>
Nov 06 15:43:43 user nova-compute[75337]:   </features>
Nov 06 15:43:43 user nova-compute[75337]:   <clock offset="utc">
Nov 06 15:43:43 user nova-compute[75337]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 15:43:43 user nova-compute[75337]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 15:43:43 user nova-compute[75337]:     <timer name="hpet" present="no"/>
Nov 06 15:43:43 user nova-compute[75337]:   </clock>
Nov 06 15:43:43 user nova-compute[75337]:   <cpu mode="custom" match="exact">
Nov 06 15:43:43 user nova-compute[75337]:     <model>Nehalem</model>
Nov 06 15:43:43 user nova-compute[75337]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 15:43:43 user nova-compute[75337]:   </cpu>
Nov 06 15:43:43 user nova-compute[75337]:   <devices>
Nov 06 15:43:43 user nova-compute[75337]:     <disk type="block" device="disk">
Nov 06 15:43:43 user nova-compute[75337]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 15:43:43 user nova-compute[75337]:       <source dev="/dev/sdc"/>
Nov 06 15:43:43 user nova-compute[75337]:       <target dev="vda" bus="virtio"/>
Nov 06 15:43:43 user nova-compute[75337]:       <serial>2e08ef35-543e-4718-beed-36e2ed8dd158</serial>
Nov 06 15:43:43 user nova-compute[75337]:     </disk>
Nov 06 15:43:43 user nova-compute[75337]:     <disk type="file" device="disk">
Nov 06 15:43:43 user nova-compute[75337]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 15:43:43 user nova-compute[75337]:       <source file="/opt/stack/data/nova/instances/1fa4c927-7485-4f34-94bd-9e20358904b6/disk.rescue"/>
Nov 06 15:43:43 user nova-compute[75337]:       <target dev="vdb" bus="virtio"/>
Nov 06 15:43:43 user nova-compute[75337]:       <boot order="1"/>
Nov 06 15:43:43 user nova-compute[75337]:     </disk>
Nov 06 15:43:43 user nova-compute[75337]:     <interface type="ethernet">
Nov 06 15:43:43 user nova-compute[75337]:       <mac address="fa:16:3e:f4:aa:7b"/>
Nov 06 15:43:43 user nova-compute[75337]:       <model type="virtio"/>
Nov 06 15:43:43 user nova-compute[75337]:       <mtu size="1442"/>
Nov 06 15:43:43 user nova-compute[75337]:       <target dev="tap3812cc74-01"/>
Nov 06 15:43:43 user nova-compute[75337]:     </interface>
Nov 06 15:43:43 user nova-compute[75337]:     <serial type="pty">
Nov 06 15:43:43 user nova-compute[75337]:       <log file="/opt/stack/data/nova/instances/1fa4c927-7485-4f34-94bd-9e20358904b6/console.log" append="off"/>
Nov 06 15:43:43 user nova-compute[75337]:     </serial>
Nov 06 15:43:43 user nova-compute[75337]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 15:43:43 user nova-compute[75337]:     <video>
Nov 06 15:43:43 user nova-compute[75337]:       <model type="virtio"/>
Nov 06 15:43:43 user nova-compute[75337]:     </video>
Nov 06 15:43:43 user nova-compute[75337]:     <rng model="virtio">
Nov 06 15:43:43 user nova-compute[75337]:       <backend model="random">/dev/urandom</backend>
Nov 06 15:43:43 user nova-compute[75337]:     </rng>
Nov 06 15:43:43 user nova-compute[75337]:     <controller type="usb" index="0" model="none"/>
Nov 06 15:43:43 user nova-compute[75337]:     <memballoon model="virtio">
Nov 06 15:43:43 user nova-compute[75337]:       <stats period="10"/>
Nov 06 15:43:43 user nova-compute[75337]:     </memballoon>
Nov 06 15:43:43 user nova-compute[75337]:   </devices>
Nov 06 15:43:43 user nova-compute[75337]: </domain>
Nov 06 15:43:43 user nova-compute[75337]:  {{(pid=75337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 15:43:43 user nova-compute[75337]: INFO nova.virt.libvirt.driver [-] [instance: 1fa4c927-7485-4f34-94bd-9e20358904b6] Instance destroyed successfully.
Nov 06 15:43:43 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-351db0e9-14e3-4c42-a98e-ed2ec14aa38d tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] No BDM found with device name vda, not building metadata. {{(pid=75337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 15:43:43 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-351db0e9-14e3-4c42-a98e-ed2ec14aa38d tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 15:43:43 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-351db0e9-14e3-4c42-a98e-ed2ec14aa38d tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] No VIF found with MAC fa:16:3e:f4:aa:7b, not building metadata {{(pid=75337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 15:43:43 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-1742b26e-22f7-4005-a190-354af68c53aa tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f52330de9506d9910cc3b4a9f6bd1a285101ae16 --force-share --output=json" returned: 0 in 0.228s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:43:43 user nova-compute[75337]: DEBUG nova.objects.instance [None req-1742b26e-22f7-4005-a190-354af68c53aa tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Lazy-loading 'migration_context' on Instance uuid 8a600bd8-b94a-4242-a443-c2defb002280 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 15:43:43 user nova-compute[75337]: DEBUG nova.objects.base [None req-1742b26e-22f7-4005-a190-354af68c53aa tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Object Instance<8a600bd8-b94a-4242-a443-c2defb002280> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=75337) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 15:43:43 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-1742b26e-22f7-4005-a190-354af68c53aa tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] [instance: 8a600bd8-b94a-4242-a443-c2defb002280] Rebasing disk image.
Nov 06 15:43:43 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-1742b26e-22f7-4005-a190-354af68c53aa tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:43:43 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-1742b26e-22f7-4005-a190-354af68c53aa tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json" returned: 0 in 0.214s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:43:43 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-1742b26e-22f7-4005-a190-354af68c53aa tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 -F raw /opt/stack/data/nova/instances/8a600bd8-b94a-4242-a443-c2defb002280/disk {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:43:43 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:43:43 user nova-compute[75337]: INFO nova.virt.libvirt.driver [-] [instance: c8cf1ead-a87c-459c-b914-a0e976c9e464] Instance destroyed successfully.
Nov 06 15:43:43 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-f7cec134-ce83-44f9-b444-89be187dd718 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] [instance: c8cf1ead-a87c-459c-b914-a0e976c9e464] Attempting a stable device rescue
Nov 06 15:43:43 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-f7cec134-ce83-44f9-b444-89be187dd718 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=75337) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 06 15:43:43 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-f7cec134-ce83-44f9-b444-89be187dd718 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] [instance: c8cf1ead-a87c-459c-b914-a0e976c9e464] Instance directory exists: not creating {{(pid=75337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 06 15:43:43 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-f7cec134-ce83-44f9-b444-89be187dd718 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] [instance: c8cf1ead-a87c-459c-b914-a0e976c9e464] Creating image(s)
Nov 06 15:43:43 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-f7cec134-ce83-44f9-b444-89be187dd718 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Acquiring lock "/opt/stack/data/nova/instances/c8cf1ead-a87c-459c-b914-a0e976c9e464/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:43:43 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-f7cec134-ce83-44f9-b444-89be187dd718 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Lock "/opt/stack/data/nova/instances/c8cf1ead-a87c-459c-b914-a0e976c9e464/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:43:43 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-f7cec134-ce83-44f9-b444-89be187dd718 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Lock "/opt/stack/data/nova/instances/c8cf1ead-a87c-459c-b914-a0e976c9e464/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:43:43 user nova-compute[75337]: DEBUG nova.objects.instance [None req-f7cec134-ce83-44f9-b444-89be187dd718 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Lazy-loading 'trusted_certs' on Instance uuid c8cf1ead-a87c-459c-b914-a0e976c9e464 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 15:43:43 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-f7cec134-ce83-44f9-b444-89be187dd718 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Acquiring lock "886e49c215980bb477bbfd15105c79194e5c3c8a" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:43:43 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-f7cec134-ce83-44f9-b444-89be187dd718 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Lock "886e49c215980bb477bbfd15105c79194e5c3c8a" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:43:44 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-f7cec134-ce83-44f9-b444-89be187dd718 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/886e49c215980bb477bbfd15105c79194e5c3c8a.part --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:43:45 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:43:45 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:43:45 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:43:45 user nova-compute[75337]: DEBUG nova.compute.manager [req-6617da30-593d-4c89-acd4-e50b43e0198a req-97fa4179-1194-4e40-b41d-90c234093528 service nova] [instance: c8cf1ead-a87c-459c-b914-a0e976c9e464] Received event network-vif-plugged-b33373f6-0289-4623-90ac-f5c3db0d3681 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:43:45 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-6617da30-593d-4c89-acd4-e50b43e0198a req-97fa4179-1194-4e40-b41d-90c234093528 service nova] Acquiring lock "c8cf1ead-a87c-459c-b914-a0e976c9e464-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:43:45 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-6617da30-593d-4c89-acd4-e50b43e0198a req-97fa4179-1194-4e40-b41d-90c234093528 service nova] Lock "c8cf1ead-a87c-459c-b914-a0e976c9e464-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:43:45 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-6617da30-593d-4c89-acd4-e50b43e0198a req-97fa4179-1194-4e40-b41d-90c234093528 service nova] Lock "c8cf1ead-a87c-459c-b914-a0e976c9e464-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:43:45 user nova-compute[75337]: DEBUG nova.compute.manager [req-6617da30-593d-4c89-acd4-e50b43e0198a req-97fa4179-1194-4e40-b41d-90c234093528 service nova] [instance: c8cf1ead-a87c-459c-b914-a0e976c9e464] No waiting events found dispatching network-vif-plugged-b33373f6-0289-4623-90ac-f5c3db0d3681 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:43:45 user nova-compute[75337]: WARNING nova.compute.manager [req-6617da30-593d-4c89-acd4-e50b43e0198a req-97fa4179-1194-4e40-b41d-90c234093528 service nova] [instance: c8cf1ead-a87c-459c-b914-a0e976c9e464] Received unexpected event network-vif-plugged-b33373f6-0289-4623-90ac-f5c3db0d3681 for instance with vm_state active and task_state rescuing.
Nov 06 15:43:45 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:43:45 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-f7cec134-ce83-44f9-b444-89be187dd718 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/886e49c215980bb477bbfd15105c79194e5c3c8a.part --force-share --output=json" returned: 0 in 0.336s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:43:45 user nova-compute[75337]: DEBUG nova.virt.images [None req-f7cec134-ce83-44f9-b444-89be187dd718 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] 9d2dc454-8720-4d78-8590-470b35d45aef was qcow2, converting to raw {{(pid=75337) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 06 15:43:45 user nova-compute[75337]: DEBUG nova.privsep.utils [None req-f7cec134-ce83-44f9-b444-89be187dd718 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75337) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 06 15:43:45 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-f7cec134-ce83-44f9-b444-89be187dd718 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/886e49c215980bb477bbfd15105c79194e5c3c8a.part /opt/stack/data/nova/instances/_base/886e49c215980bb477bbfd15105c79194e5c3c8a.converted {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:43:45 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:43:45 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:43:45 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:43:45 user nova-compute[75337]: DEBUG nova.compute.manager [req-f5166b5e-a6b7-4a52-9c53-e6a5be1fc1ed req-4a860fec-7d51-4f26-9280-ee89e483821c service nova] [instance: 1fa4c927-7485-4f34-94bd-9e20358904b6] Received event network-vif-plugged-3812cc74-01db-4b2b-815c-770420051e1b {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:43:45 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-f5166b5e-a6b7-4a52-9c53-e6a5be1fc1ed req-4a860fec-7d51-4f26-9280-ee89e483821c service nova] Acquiring lock "1fa4c927-7485-4f34-94bd-9e20358904b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:43:45 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-f5166b5e-a6b7-4a52-9c53-e6a5be1fc1ed req-4a860fec-7d51-4f26-9280-ee89e483821c service nova] Lock "1fa4c927-7485-4f34-94bd-9e20358904b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:43:45 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-f5166b5e-a6b7-4a52-9c53-e6a5be1fc1ed req-4a860fec-7d51-4f26-9280-ee89e483821c service nova] Lock "1fa4c927-7485-4f34-94bd-9e20358904b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:43:45 user nova-compute[75337]: DEBUG nova.compute.manager [req-f5166b5e-a6b7-4a52-9c53-e6a5be1fc1ed req-4a860fec-7d51-4f26-9280-ee89e483821c service nova] [instance: 1fa4c927-7485-4f34-94bd-9e20358904b6] No waiting events found dispatching network-vif-plugged-3812cc74-01db-4b2b-815c-770420051e1b {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:43:45 user nova-compute[75337]: WARNING nova.compute.manager [req-f5166b5e-a6b7-4a52-9c53-e6a5be1fc1ed req-4a860fec-7d51-4f26-9280-ee89e483821c service nova] [instance: 1fa4c927-7485-4f34-94bd-9e20358904b6] Received unexpected event network-vif-plugged-3812cc74-01db-4b2b-815c-770420051e1b for instance with vm_state active and task_state rescuing.
Nov 06 15:43:45 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-f7cec134-ce83-44f9-b444-89be187dd718 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/886e49c215980bb477bbfd15105c79194e5c3c8a.part /opt/stack/data/nova/instances/_base/886e49c215980bb477bbfd15105c79194e5c3c8a.converted" returned: 0 in 0.407s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:43:45 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-f7cec134-ce83-44f9-b444-89be187dd718 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/886e49c215980bb477bbfd15105c79194e5c3c8a.converted --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:43:45 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-f7cec134-ce83-44f9-b444-89be187dd718 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/886e49c215980bb477bbfd15105c79194e5c3c8a.converted --force-share --output=json" returned: 0 in 0.275s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:43:45 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-f7cec134-ce83-44f9-b444-89be187dd718 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Lock "886e49c215980bb477bbfd15105c79194e5c3c8a" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.060s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:43:45 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-f7cec134-ce83-44f9-b444-89be187dd718 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Acquiring lock "886e49c215980bb477bbfd15105c79194e5c3c8a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:43:45 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-f7cec134-ce83-44f9-b444-89be187dd718 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Lock "886e49c215980bb477bbfd15105c79194e5c3c8a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:43:45 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-f7cec134-ce83-44f9-b444-89be187dd718 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/886e49c215980bb477bbfd15105c79194e5c3c8a --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:43:46 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-f7cec134-ce83-44f9-b444-89be187dd718 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/886e49c215980bb477bbfd15105c79194e5c3c8a --force-share --output=json" returned: 0 in 0.316s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:43:46 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-f7cec134-ce83-44f9-b444-89be187dd718 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/886e49c215980bb477bbfd15105c79194e5c3c8a,backing_fmt=raw /opt/stack/data/nova/instances/c8cf1ead-a87c-459c-b914-a0e976c9e464/disk.rescue {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:43:47 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-f7cec134-ce83-44f9-b444-89be187dd718 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/886e49c215980bb477bbfd15105c79194e5c3c8a,backing_fmt=raw /opt/stack/data/nova/instances/c8cf1ead-a87c-459c-b914-a0e976c9e464/disk.rescue" returned: 0 in 0.501s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:43:47 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-f7cec134-ce83-44f9-b444-89be187dd718 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Lock "886e49c215980bb477bbfd15105c79194e5c3c8a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.833s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:43:47 user nova-compute[75337]: DEBUG nova.objects.instance [None req-f7cec134-ce83-44f9-b444-89be187dd718 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Lazy-loading 'migration_context' on Instance uuid c8cf1ead-a87c-459c-b914-a0e976c9e464 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 15:43:47 user nova-compute[75337]: DEBUG nova.objects.base [None req-f7cec134-ce83-44f9-b444-89be187dd718 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Object Instance<c8cf1ead-a87c-459c-b914-a0e976c9e464> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75337) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 15:43:47 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-f7cec134-ce83-44f9-b444-89be187dd718 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] [instance: c8cf1ead-a87c-459c-b914-a0e976c9e464] Created local disks {{(pid=75337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 15:43:47 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-f7cec134-ce83-44f9-b444-89be187dd718 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] [instance: c8cf1ead-a87c-459c-b914-a0e976c9e464] Start _get_guest_xml network_info=[{"id": "b33373f6-0289-4623-90ac-f5c3db0d3681", "address": "fa:16:3e:37:16:66", "network": {"id": "a839a9d1-fdf3-4a72-898b-6829ceef2055", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1927950273-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1927950273-network", "vif_mac": "fa:16:3e:37:16:66"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86f4b41336384a53a3fd22caa0fe8e6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb33373f6-02", "ovs_interfaceid": "b33373f6-0289-4623-90ac-f5c3db0d3681", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T15:34:14Z,direct_url=<?>,disk_format='qcow2',id=16b903ae-a40f-41a7-985b-4804cce92c62,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6549a15819f1469bbd5eeae8190e3d44',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T15:34:15Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '9d2dc454-8720-4d78-8590-470b35d45aef', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'guest_format': None, 'size': 0, 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '16b903ae-a40f-41a7-985b-4804cce92c62'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'attachment_id': '26b29488-49fb-4e1c-9082-9b36bb478f8b', 'guest_format': None, 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6f5503fc-8cc8-46fa-8450-d967f769a947', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kStTucve', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': 'c8cf1ead-a87c-459c-b914-a0e976c9e464', 'attached_at': '', 'detached_at': '', 'volume_id': '6f5503fc-8cc8-46fa-8450-d967f769a947', 'serial': '6f5503fc-8cc8-46fa-8450-d967f769a947'}, 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=75337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 15:43:47 user nova-compute[75337]: DEBUG nova.objects.instance [None req-f7cec134-ce83-44f9-b444-89be187dd718 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Lazy-loading 'resources' on Instance uuid c8cf1ead-a87c-459c-b914-a0e976c9e464 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 15:43:47 user nova-compute[75337]: DEBUG nova.objects.base [None req-f7cec134-ce83-44f9-b444-89be187dd718 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Object Instance<c8cf1ead-a87c-459c-b914-a0e976c9e464> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75337) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 15:43:47 user nova-compute[75337]: DEBUG nova.objects.instance [None req-f7cec134-ce83-44f9-b444-89be187dd718 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Lazy-loading 'numa_topology' on Instance uuid c8cf1ead-a87c-459c-b914-a0e976c9e464 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 15:43:47 user nova-compute[75337]: DEBUG nova.objects.base [None req-f7cec134-ce83-44f9-b444-89be187dd718 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Object Instance<c8cf1ead-a87c-459c-b914-a0e976c9e464> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75337) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 15:43:47 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-1742b26e-22f7-4005-a190-354af68c53aa tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 -F raw /opt/stack/data/nova/instances/8a600bd8-b94a-4242-a443-c2defb002280/disk" returned: 0 in 3.495s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:43:47 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-1742b26e-22f7-4005-a190-354af68c53aa tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] [instance: 8a600bd8-b94a-4242-a443-c2defb002280] Created local disks {{(pid=75337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 15:43:47 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-1742b26e-22f7-4005-a190-354af68c53aa tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] [instance: 8a600bd8-b94a-4242-a443-c2defb002280] Ensure instance console log exists: /opt/stack/data/nova/instances/8a600bd8-b94a-4242-a443-c2defb002280/console.log {{(pid=75337) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 15:43:47 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-1742b26e-22f7-4005-a190-354af68c53aa tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:43:47 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-1742b26e-22f7-4005-a190-354af68c53aa tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:43:47 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-1742b26e-22f7-4005-a190-354af68c53aa tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:43:47 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-1742b26e-22f7-4005-a190-354af68c53aa tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] [instance: 8a600bd8-b94a-4242-a443-c2defb002280] Start _get_guest_xml network_info=[{"id": "01aa7168-78cd-44e6-8496-08d468f62cfe", "address": "fa:16:3e:f1:25:3e", "network": {"id": "f24470c2-ff6f-49fd-b28f-16b8a87ed3b4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-217486733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed09a1def6f0477796404d9bd3357dd0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01aa7168-78", "ovs_interfaceid": "01aa7168-78cd-44e6-8496-08d468f62cfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='eddfaf7018d7200e525bdb93819d5b39',container_format='bare',created_at=2023-11-06T15:39:58Z,direct_url=<?>,disk_format='qcow2',id=b903ecce-b6cc-4173-97b0-7dcdc01e4622,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1664848086-shelved',owner='ed09a1def6f0477796404d9bd3357dd0',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-06T15:40:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'guest_format': None, 'size': 0, 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '16b903ae-a40f-41a7-985b-4804cce92c62'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'attachment_id': 'bcfeed58-3fbb-4703-8603-777bae6ec64a', 'guest_format': None, 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:bc0578f4-b30e-45b3-8cac-26620e7c3e96', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vFOjicIu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '8a600bd8-b94a-4242-a443-c2defb002280', 'attached_at': '', 'detached_at': '', 'volume_id': 'bc0578f4-b30e-45b3-8cac-26620e7c3e96', 'serial': 'bc0578f4-b30e-45b3-8cac-26620e7c3e96'}, 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vdc', 'volume_type': None} {{(pid=75337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 15:43:47 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-f7cec134-ce83-44f9-b444-89be187dd718 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 15:43:47 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-f7cec134-ce83-44f9-b444-89be187dd718 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 15:43:47 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-f7cec134-ce83-44f9-b444-89be187dd718 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 15:43:47 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-f7cec134-ce83-44f9-b444-89be187dd718 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] CPU controller missing on host. {{(pid=75337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 15:43:47 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-1742b26e-22f7-4005-a190-354af68c53aa tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 15:43:47 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-1742b26e-22f7-4005-a190-354af68c53aa tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 15:43:47 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-f7cec134-ce83-44f9-b444-89be187dd718 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 15:43:47 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-f7cec134-ce83-44f9-b444-89be187dd718 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] CPU controller found on host. {{(pid=75337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 15:43:47 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-f7cec134-ce83-44f9-b444-89be187dd718 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75337) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 15:43:47 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-f7cec134-ce83-44f9-b444-89be187dd718 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T15:34:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T15:34:14Z,direct_url=<?>,disk_format='qcow2',id=16b903ae-a40f-41a7-985b-4804cce92c62,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6549a15819f1469bbd5eeae8190e3d44',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T15:34:15Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 15:43:47 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-f7cec134-ce83-44f9-b444-89be187dd718 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Flavor limits 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 15:43:47 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-f7cec134-ce83-44f9-b444-89be187dd718 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Image limits 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 15:43:47 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-f7cec134-ce83-44f9-b444-89be187dd718 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Flavor pref 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 15:43:47 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-f7cec134-ce83-44f9-b444-89be187dd718 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Image pref 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 15:43:47 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-f7cec134-ce83-44f9-b444-89be187dd718 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 15:43:47 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-f7cec134-ce83-44f9-b444-89be187dd718 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 15:43:47 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-f7cec134-ce83-44f9-b444-89be187dd718 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 15:43:47 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-f7cec134-ce83-44f9-b444-89be187dd718 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Got 1 possible topologies {{(pid=75337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 15:43:47 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-f7cec134-ce83-44f9-b444-89be187dd718 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 15:43:47 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-f7cec134-ce83-44f9-b444-89be187dd718 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 15:43:47 user nova-compute[75337]: DEBUG nova.objects.instance [None req-f7cec134-ce83-44f9-b444-89be187dd718 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Lazy-loading 'vcpu_model' on Instance uuid c8cf1ead-a87c-459c-b914-a0e976c9e464 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 15:43:47 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-1742b26e-22f7-4005-a190-354af68c53aa tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 15:43:47 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-1742b26e-22f7-4005-a190-354af68c53aa tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] CPU controller missing on host. {{(pid=75337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 15:43:47 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-1742b26e-22f7-4005-a190-354af68c53aa tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 15:43:47 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-1742b26e-22f7-4005-a190-354af68c53aa tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] CPU controller found on host. {{(pid=75337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 15:43:47 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-1742b26e-22f7-4005-a190-354af68c53aa tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75337) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 15:43:47 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-1742b26e-22f7-4005-a190-354af68c53aa tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T15:34:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='eddfaf7018d7200e525bdb93819d5b39',container_format='bare',created_at=2023-11-06T15:39:58Z,direct_url=<?>,disk_format='qcow2',id=b903ecce-b6cc-4173-97b0-7dcdc01e4622,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1664848086-shelved',owner='ed09a1def6f0477796404d9bd3357dd0',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-06T15:40:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 15:43:47 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-1742b26e-22f7-4005-a190-354af68c53aa tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Flavor limits 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 15:43:47 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-1742b26e-22f7-4005-a190-354af68c53aa tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Image limits 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 15:43:47 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-1742b26e-22f7-4005-a190-354af68c53aa tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Flavor pref 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 15:43:47 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-1742b26e-22f7-4005-a190-354af68c53aa tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Image pref 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 15:43:47 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-1742b26e-22f7-4005-a190-354af68c53aa tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 15:43:47 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-1742b26e-22f7-4005-a190-354af68c53aa tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 15:43:47 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-1742b26e-22f7-4005-a190-354af68c53aa tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 15:43:47 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-1742b26e-22f7-4005-a190-354af68c53aa tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Got 1 possible topologies {{(pid=75337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 15:43:47 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-1742b26e-22f7-4005-a190-354af68c53aa tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 15:43:47 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-1742b26e-22f7-4005-a190-354af68c53aa tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 15:43:47 user nova-compute[75337]: DEBUG nova.objects.instance [None req-1742b26e-22f7-4005-a190-354af68c53aa tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Lazy-loading 'vcpu_model' on Instance uuid 8a600bd8-b94a-4242-a443-c2defb002280 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 15:43:47 user nova-compute[75337]: DEBUG nova.objects.base [None req-f7cec134-ce83-44f9-b444-89be187dd718 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Object Instance<c8cf1ead-a87c-459c-b914-a0e976c9e464> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75337) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 15:43:47 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7cec134-ce83-44f9-b444-89be187dd718 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] [instance: c8cf1ead-a87c-459c-b914-a0e976c9e464] Calling os-brick to attach iSCSI Volume {{(pid=75337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 15:43:47 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7cec134-ce83-44f9-b444-89be187dd718 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2abc33d0c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6f5503fc-8cc8-46fa-8450-d967f769a947', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kStTucve', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 15:43:47 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-f7cec134-ce83-44f9-b444-89be187dd718 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 15:43:47 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-f7cec134-ce83-44f9-b444-89be187dd718 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 15:43:47 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-f7cec134-ce83-44f9-b444-89be187dd718 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 15:43:47 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-f7cec134-ce83-44f9-b444-89be187dd718 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 15:43:47 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-f7cec134-ce83-44f9-b444-89be187dd718 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6f5503fc-8cc8-46fa-8450-d967f769a947" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 15:43:47 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-f7cec134-ce83-44f9-b444-89be187dd718 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6f5503fc-8cc8-46fa-8450-d967f769a947" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 15:43:47 user nova-compute[75337]: INFO os_brick.initiator.connectors.iscsi [None req-f7cec134-ce83-44f9-b444-89be187dd718 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 15:43:47 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f5503fc-8cc8-46fa-8450-d967f769a947 -p 172.16.0.220:3260 {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:43:47 user nova-compute[75337]: DEBUG nova.objects.base [None req-1742b26e-22f7-4005-a190-354af68c53aa tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Object Instance<8a600bd8-b94a-4242-a443-c2defb002280> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=75337) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 15:43:47 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1742b26e-22f7-4005-a190-354af68c53aa tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] [instance: 8a600bd8-b94a-4242-a443-c2defb002280] Calling os-brick to attach iSCSI Volume {{(pid=75337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 15:43:47 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-1742b26e-22f7-4005-a190-354af68c53aa tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2abc33d0c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bc0578f4-b30e-45b3-8cac-26620e7c3e96', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vFOjicIu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 15:43:47 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-1742b26e-22f7-4005-a190-354af68c53aa tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 15:43:47 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-1742b26e-22f7-4005-a190-354af68c53aa tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 15:43:47 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f5503fc-8cc8-46fa-8450-d967f769a947 -p 172.16.0.220:3260" returned: 0 in 0.030s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:43:47 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[6591b95f-6561-425c-a77b-671bed581b57]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:6f5503fc-8cc8-46fa-8450-d967f769a947\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = kStTucve\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:43:47 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7cec134-ce83-44f9-b444-89be187dd718 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 06 15:43:47 user nova-compute[75337]: node.name = iqn.2010-10.org.openstack:6f5503fc-8cc8-46fa-8450-d967f769a947
Nov 06 15:43:47 user nova-compute[75337]: node.tpgt = -1
Nov 06 15:43:47 user nova-compute[75337]: node.startup = automatic
Nov 06 15:43:47 user nova-compute[75337]: node.leading_login = No
Nov 06 15:43:47 user nova-compute[75337]: iface.iscsi_ifacename = default
Nov 06 15:43:47 user nova-compute[75337]: iface.net_ifacename = <empty>
Nov 06 15:43:47 user nova-compute[75337]: iface.ipaddress = <empty>
Nov 06 15:43:47 user nova-compute[75337]: iface.prefix_len = 0
Nov 06 15:43:47 user nova-compute[75337]: iface.hwaddress = <empty>
Nov 06 15:43:47 user nova-compute[75337]: iface.transport_name = tcp
Nov 06 15:43:47 user nova-compute[75337]: iface.initiatorname = <empty>
Nov 06 15:43:47 user nova-compute[75337]: iface.state = <empty>
Nov 06 15:43:47 user nova-compute[75337]: iface.vlan_id = 0
Nov 06 15:43:47 user nova-compute[75337]: iface.vlan_priority = 0
Nov 06 15:43:47 user nova-compute[75337]: iface.vlan_state = <empty>
Nov 06 15:43:47 user nova-compute[75337]: iface.iface_num = 0
Nov 06 15:43:47 user nova-compute[75337]: iface.mtu = 0
Nov 06 15:43:47 user nova-compute[75337]: iface.port = 0
Nov 06 15:43:47 user nova-compute[75337]: iface.bootproto = <empty>
Nov 06 15:43:47 user nova-compute[75337]: iface.subnet_mask = <empty>
Nov 06 15:43:47 user nova-compute[75337]: iface.gateway = <empty>
Nov 06 15:43:47 user nova-compute[75337]: iface.dhcp_alt_client_id_state = <empty>
Nov 06 15:43:47 user nova-compute[75337]: iface.dhcp_alt_client_id = <empty>
Nov 06 15:43:47 user nova-compute[75337]: iface.dhcp_dns = <empty>
Nov 06 15:43:47 user nova-compute[75337]: iface.dhcp_learn_iqn = <empty>
Nov 06 15:43:47 user nova-compute[75337]: iface.dhcp_req_vendor_id_state = <empty>
Nov 06 15:43:47 user nova-compute[75337]: iface.dhcp_vendor_id_state = <empty>
Nov 06 15:43:47 user nova-compute[75337]: iface.dhcp_vendor_id = <empty>
Nov 06 15:43:47 user nova-compute[75337]: iface.dhcp_slp_da = <empty>
Nov 06 15:43:47 user nova-compute[75337]: iface.fragmentation = <empty>
Nov 06 15:43:47 user nova-compute[75337]: iface.gratuitous_arp = <empty>
Nov 06 15:43:47 user nova-compute[75337]: iface.incoming_forwarding = <empty>
Nov 06 15:43:47 user nova-compute[75337]: iface.tos_state = <empty>
Nov 06 15:43:47 user nova-compute[75337]: iface.tos = 0
Nov 06 15:43:47 user nova-compute[75337]: iface.ttl = 0
Nov 06 15:43:47 user nova-compute[75337]: iface.delayed_ack = <empty>
Nov 06 15:43:47 user nova-compute[75337]: iface.tcp_nagle = <empty>
Nov 06 15:43:47 user nova-compute[75337]: iface.tcp_wsf_state = <empty>
Nov 06 15:43:47 user nova-compute[75337]: iface.tcp_wsf = 0
Nov 06 15:43:47 user nova-compute[75337]: iface.tcp_timer_scale = 0
Nov 06 15:43:47 user nova-compute[75337]: iface.tcp_timestamp = <empty>
Nov 06 15:43:47 user nova-compute[75337]: iface.redirect = <empty>
Nov 06 15:43:47 user nova-compute[75337]: iface.def_task_mgmt_timeout = 0
Nov 06 15:43:47 user nova-compute[75337]: iface.header_digest = <empty>
Nov 06 15:43:47 user nova-compute[75337]: iface.data_digest = <empty>
Nov 06 15:43:47 user nova-compute[75337]: iface.immediate_data = <empty>
Nov 06 15:43:47 user nova-compute[75337]: iface.initial_r2t = <empty>
Nov 06 15:43:47 user nova-compute[75337]: iface.data_seq_inorder = <empty>
Nov 06 15:43:47 user nova-compute[75337]: iface.data_pdu_inorder = <empty>
Nov 06 15:43:47 user nova-compute[75337]: iface.erl = 0
Nov 06 15:43:47 user nova-compute[75337]: iface.max_receive_data_len = 0
Nov 06 15:43:47 user nova-compute[75337]: iface.first_burst_len = 0
Nov 06 15:43:47 user nova-compute[75337]: iface.max_outstanding_r2t = 0
Nov 06 15:43:47 user nova-compute[75337]: iface.max_burst_len = 0
Nov 06 15:43:47 user nova-compute[75337]: iface.chap_auth = <empty>
Nov 06 15:43:47 user nova-compute[75337]: iface.bidi_chap = <empty>
Nov 06 15:43:47 user nova-compute[75337]: iface.strict_login_compliance = <empty>
Nov 06 15:43:47 user nova-compute[75337]: iface.discovery_auth = <empty>
Nov 06 15:43:47 user nova-compute[75337]: iface.discovery_logout = <empty>
Nov 06 15:43:47 user nova-compute[75337]: node.discovery_address = <empty>
Nov 06 15:43:47 user nova-compute[75337]: node.discovery_port = 0
Nov 06 15:43:47 user nova-compute[75337]: node.discovery_type = static
Nov 06 15:43:47 user nova-compute[75337]: node.session.initial_cmdsn = 0
Nov 06 15:43:47 user nova-compute[75337]: node.session.initial_login_retry_max = 8
Nov 06 15:43:47 user nova-compute[75337]: node.session.xmit_thread_priority = -20
Nov 06 15:43:47 user nova-compute[75337]: node.session.cmds_max = 128
Nov 06 15:43:47 user nova-compute[75337]: node.session.queue_depth = 32
Nov 06 15:43:47 user nova-compute[75337]: node.session.nr_sessions = 1
Nov 06 15:43:47 user nova-compute[75337]: node.session.auth.authmethod = CHAP
Nov 06 15:43:47 user nova-compute[75337]: node.session.auth.username = kStTucve
Nov 06 15:43:47 user nova-compute[75337]: node.session.auth.password = ***
Nov 06 15:43:47 user nova-compute[75337]: node.session.auth.username_in = <empty>
Nov 06 15:43:47 user nova-compute[75337]: node.session.auth.password_in = <empty>
Nov 06 15:43:47 user nova-compute[75337]: node.session.auth.chap_algs = MD5
Nov 06 15:43:47 user nova-compute[75337]: node.session.timeo.replacement_timeout = 120
Nov 06 15:43:47 user nova-compute[75337]: node.session.err_timeo.abort_timeout = 15
Nov 06 15:43:47 user nova-compute[75337]: node.session.err_timeo.lu_reset_timeout = 30
Nov 06 15:43:47 user nova-compute[75337]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 06 15:43:47 user nova-compute[75337]: node.session.err_timeo.host_reset_timeout = 60
Nov 06 15:43:47 user nova-compute[75337]: node.session.iscsi.FastAbort = Yes
Nov 06 15:43:47 user nova-compute[75337]: node.session.iscsi.InitialR2T = No
Nov 06 15:43:47 user nova-compute[75337]: node.session.iscsi.ImmediateData = Yes
Nov 06 15:43:47 user nova-compute[75337]: node.session.iscsi.FirstBurstLength = 262144
Nov 06 15:43:47 user nova-compute[75337]: node.session.iscsi.MaxBurstLength = 16776192
Nov 06 15:43:47 user nova-compute[75337]: node.session.iscsi.DefaultTime2Retain = 0
Nov 06 15:43:47 user nova-compute[75337]: node.session.iscsi.DefaultTime2Wait = 2
Nov 06 15:43:47 user nova-compute[75337]: node.session.iscsi.MaxConnections = 1
Nov 06 15:43:47 user nova-compute[75337]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 06 15:43:47 user nova-compute[75337]: node.session.iscsi.ERL = 0
Nov 06 15:43:47 user nova-compute[75337]: node.session.scan = manual
Nov 06 15:43:47 user nova-compute[75337]: node.session.reopen_max = 0
Nov 06 15:43:47 user nova-compute[75337]: node.conn[0].address = 172.16.0.220
Nov 06 15:43:47 user nova-compute[75337]: node.conn[0].port = 3260
Nov 06 15:43:47 user nova-compute[75337]: node.conn[0].startup = manual
Nov 06 15:43:47 user nova-compute[75337]: node.conn[0].tcp.window_size = 524288
Nov 06 15:43:47 user nova-compute[75337]: node.conn[0].tcp.type_of_service = 0
Nov 06 15:43:47 user nova-compute[75337]: node.conn[0].timeo.logout_timeout = 15
Nov 06 15:43:47 user nova-compute[75337]: node.conn[0].timeo.login_timeout = 15
Nov 06 15:43:47 user nova-compute[75337]: node.conn[0].timeo.auth_timeout = 45
Nov 06 15:43:47 user nova-compute[75337]: node.conn[0].timeo.noop_out_interval = 5
Nov 06 15:43:47 user nova-compute[75337]: node.conn[0].timeo.noop_out_timeout = 5
Nov 06 15:43:47 user nova-compute[75337]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 06 15:43:47 user nova-compute[75337]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 06 15:43:47 user nova-compute[75337]: node.conn[0].iscsi.HeaderDigest = None
Nov 06 15:43:47 user nova-compute[75337]: node.conn[0].iscsi.DataDigest = None
Nov 06 15:43:47 user nova-compute[75337]: node.conn[0].iscsi.IFMarker = No
Nov 06 15:43:47 user nova-compute[75337]: node.conn[0].iscsi.OFMarker = No
Nov 06 15:43:47 user nova-compute[75337]: # END RECORD
Nov 06 15:43:47 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:43:47 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f5503fc-8cc8-46fa-8450-d967f769a947 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:43:47 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f5503fc-8cc8-46fa-8450-d967f769a947 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:43:47 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[68e76bfa-b8e3-4677-99bc-6d7438f44243]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:43:47 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7cec134-ce83-44f9-b444-89be187dd718 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:43:47 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f5503fc-8cc8-46fa-8450-d967f769a947 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:43:47 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f5503fc-8cc8-46fa-8450-d967f769a947 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:43:47 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[fee3bf68-e4e9-441f-a913-5aeef4a170e2]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:43:47 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7cec134-ce83-44f9-b444-89be187dd718 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:43:47 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f5503fc-8cc8-46fa-8450-d967f769a947 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kStTucve {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:43:47 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f5503fc-8cc8-46fa-8450-d967f769a947 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kStTucve" returned: 0 in 0.023s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:43:47 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff545454-ae6a-4e6a-bf5e-9923d598ddc2]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:43:47 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7cec134-ce83-44f9-b444-89be187dd718 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kStTucve'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:43:47 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f5503fc-8cc8-46fa-8450-d967f769a947 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:43:47 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f5503fc-8cc8-46fa-8450-d967f769a947 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:43:47 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a91845a-5c65-418e-b5c7-3915b2b5a105]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:43:47 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7cec134-ce83-44f9-b444-89be187dd718 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:43:47 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:43:47 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:43:47 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0ab6864-e027-41f0-adbe-48aa1fdaa262]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f5503fc-8cc8-46fa-8450-d967f769a947 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759 (non-flash)\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:43:47 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7cec134-ce83-44f9-b444-89be187dd718 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)
Nov 06 15:43:47 user nova-compute[75337]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e (non-flash)
Nov 06 15:43:47 user nova-compute[75337]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f5503fc-8cc8-46fa-8450-d967f769a947 (non-flash)
Nov 06 15:43:47 user nova-compute[75337]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759 (non-flash)
Nov 06 15:43:47 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 15:43:47 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7cec134-ce83-44f9-b444-89be187dd718 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)
Nov 06 15:43:47 user nova-compute[75337]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e (non-flash)
Nov 06 15:43:47 user nova-compute[75337]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f5503fc-8cc8-46fa-8450-d967f769a947 (non-flash)
Nov 06 15:43:47 user nova-compute[75337]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759 (non-flash)
Nov 06 15:43:47 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 15:43:47 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-f7cec134-ce83-44f9-b444-89be187dd718 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6f5503fc-8cc8-46fa-8450-d967f769a947" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.194s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 15:43:47 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7cec134-ce83-44f9-b444-89be187dd718 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Connected to 172.16.0.220:3260 {{(pid=75337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 15:43:47 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-f7cec134-ce83-44f9-b444-89be187dd718 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] HCTL ('35', '0', '0', 0) found on session 13 with lun 0 {{(pid=75337) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 15:43:47 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-f7cec134-ce83-44f9-b444-89be187dd718 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Scanning host 35 c: 0, t: 0, l: 0) {{(pid=75337) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 15:43:47 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:43:47 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:43:47 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[962f7537-ba9d-42a8-abb9-e9292487c83a]: (4, ('0 0 0', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:43:47 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-f7cec134-ce83-44f9-b444-89be187dd718 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Searching for a device in session 13 and hctl ('35', '0', '0', 0) yield: sdd {{(pid=75337) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 15:43:47 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7cec134-ce83-44f9-b444-89be187dd718 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:6f5503fc-8cc8-46fa-8450-d967f769a947', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kStTucve', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 15:43:47 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-f7cec134-ce83-44f9-b444-89be187dd718 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.228s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 15:43:47 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7cec134-ce83-44f9-b444-89be187dd718 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] <== connect_volume: return (230ms) {'type': 'block', 'scsi_wwn': '23732656230336539', 'path': '/dev/sdd'} {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 15:43:47 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7cec134-ce83-44f9-b444-89be187dd718 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] [instance: c8cf1ead-a87c-459c-b914-a0e976c9e464] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23732656230336539', 'path': '/dev/sdd'} {{(pid=75337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 15:43:47 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-1742b26e-22f7-4005-a190-354af68c53aa tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.179s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 15:43:47 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-1742b26e-22f7-4005-a190-354af68c53aa tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 15:43:47 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-1742b26e-22f7-4005-a190-354af68c53aa tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bc0578f4-b30e-45b3-8cac-26620e7c3e96" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 15:43:47 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-1742b26e-22f7-4005-a190-354af68c53aa tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bc0578f4-b30e-45b3-8cac-26620e7c3e96" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 15:43:47 user nova-compute[75337]: INFO os_brick.initiator.connectors.iscsi [None req-1742b26e-22f7-4005-a190-354af68c53aa tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 15:43:47 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc0578f4-b30e-45b3-8cac-26620e7c3e96 -p 172.16.0.220:3260 {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:43:47 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc0578f4-b30e-45b3-8cac-26620e7c3e96 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:43:47 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc6d2b27-e57b-4b3f-9d0e-3bb5edacd4ff]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:43:47 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-1742b26e-22f7-4005-a190-354af68c53aa tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 15:43:47 user nova-compute[75337]:  {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:43:47 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc0578f4-b30e-45b3-8cac-26620e7c3e96 -p 172.16.0.220:3260 --interface default --op new {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:43:47 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc0578f4-b30e-45b3-8cac-26620e7c3e96 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:43:47 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[14c485a9-4464-43cc-97e6-9a48cff807ef]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bc0578f4-b30e-45b3-8cac-26620e7c3e96] added\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:43:47 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-1742b26e-22f7-4005-a190-354af68c53aa tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bc0578f4-b30e-45b3-8cac-26620e7c3e96] added
Nov 06 15:43:47 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:43:47 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-f7cec134-ce83-44f9-b444-89be187dd718 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T15:37:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1460081442',display_name='tempest-ServerStableDeviceRescueTest-server-1460081442',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1460081442',id=3,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNhWd6+eUiIBQZGc6LZ0InXN96wVpRF9RHeVy5tDr/sqc5jJYeqvZnGJOTX8afCIFIyA3qCwBSUAfC6fowKfta99KGcXm2stZlkUkyQJaJ7NDTIzQAW/nlfJ0mGtYGBdsw==',key_name='tempest-keypair-2068455996',keypairs=<?>,launch_index=0,launched_at=2023-11-06T15:38:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='86f4b41336384a53a3fd22caa0fe8e6e',ramdisk_id='',reservation_id='r-dfh80oqh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1727960867',owner_user_name='tempest-ServerStableDeviceRescueTest-1727960867-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T15:39:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f5356a7304a34428bbb0f39fb7d9a489',uuid=c8cf1ead-a87c-459c-b914-a0e976c9e464,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b33373f6-0289-4623-90ac-f5c3db0d3681", "address": "fa:16:3e:37:16:66", "network": {"id": "a839a9d1-fdf3-4a72-898b-6829ceef2055", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1927950273-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1927950273-network", "vif_mac": "fa:16:3e:37:16:66"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86f4b41336384a53a3fd22caa0fe8e6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb33373f6-02", "ovs_interfaceid": "b33373f6-0289-4623-90ac-f5c3db0d3681", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75337) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 15:43:47 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-f7cec134-ce83-44f9-b444-89be187dd718 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Converting VIF {"id": "b33373f6-0289-4623-90ac-f5c3db0d3681", "address": "fa:16:3e:37:16:66", "network": {"id": "a839a9d1-fdf3-4a72-898b-6829ceef2055", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1927950273-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1927950273-network", "vif_mac": "fa:16:3e:37:16:66"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86f4b41336384a53a3fd22caa0fe8e6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb33373f6-02", "ovs_interfaceid": "b33373f6-0289-4623-90ac-f5c3db0d3681", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 15:43:47 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-f7cec134-ce83-44f9-b444-89be187dd718 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:37:16:66,bridge_name='br-int',has_traffic_filtering=True,id=b33373f6-0289-4623-90ac-f5c3db0d3681,network=Network(a839a9d1-fdf3-4a72-898b-6829ceef2055),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb33373f6-02') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 15:43:47 user nova-compute[75337]: DEBUG nova.objects.instance [None req-f7cec134-ce83-44f9-b444-89be187dd718 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Lazy-loading 'pci_devices' on Instance uuid c8cf1ead-a87c-459c-b914-a0e976c9e464 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 15:43:47 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc0578f4-b30e-45b3-8cac-26620e7c3e96 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:43:47 user nova-compute[75337]: DEBUG nova.objects.base [None req-f7cec134-ce83-44f9-b444-89be187dd718 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Object Instance<c8cf1ead-a87c-459c-b914-a0e976c9e464> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75337) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 15:43:47 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-f7cec134-ce83-44f9-b444-89be187dd718 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] [instance: c8cf1ead-a87c-459c-b914-a0e976c9e464] End _get_guest_xml xml=<domain type="kvm">
Nov 06 15:43:47 user nova-compute[75337]:   <uuid>c8cf1ead-a87c-459c-b914-a0e976c9e464</uuid>
Nov 06 15:43:47 user nova-compute[75337]:   <name>instance-00000003</name>
Nov 06 15:43:47 user nova-compute[75337]:   <memory>524288</memory>
Nov 06 15:43:47 user nova-compute[75337]:   <vcpu>1</vcpu>
Nov 06 15:43:47 user nova-compute[75337]:   <metadata>
Nov 06 15:43:47 user nova-compute[75337]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 15:43:47 user nova-compute[75337]:       <nova:package version="0.0.0"/>
Nov 06 15:43:47 user nova-compute[75337]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1460081442</nova:name>
Nov 06 15:43:47 user nova-compute[75337]:       <nova:creationTime>2023-11-06 15:43:47</nova:creationTime>
Nov 06 15:43:47 user nova-compute[75337]:       <nova:flavor name="m1.tiny">
Nov 06 15:43:47 user nova-compute[75337]:         <nova:memory>512</nova:memory>
Nov 06 15:43:47 user nova-compute[75337]:         <nova:disk>1</nova:disk>
Nov 06 15:43:47 user nova-compute[75337]:         <nova:swap>0</nova:swap>
Nov 06 15:43:47 user nova-compute[75337]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 15:43:47 user nova-compute[75337]:         <nova:vcpus>1</nova:vcpus>
Nov 06 15:43:47 user nova-compute[75337]:       </nova:flavor>
Nov 06 15:43:47 user nova-compute[75337]:       <nova:owner>
Nov 06 15:43:47 user nova-compute[75337]:         <nova:user uuid="f5356a7304a34428bbb0f39fb7d9a489">tempest-ServerStableDeviceRescueTest-1727960867-project-member</nova:user>
Nov 06 15:43:47 user nova-compute[75337]:         <nova:project uuid="86f4b41336384a53a3fd22caa0fe8e6e">tempest-ServerStableDeviceRescueTest-1727960867</nova:project>
Nov 06 15:43:47 user nova-compute[75337]:       </nova:owner>
Nov 06 15:43:47 user nova-compute[75337]:       <nova:root type="image" uuid="16b903ae-a40f-41a7-985b-4804cce92c62"/>
Nov 06 15:43:47 user nova-compute[75337]:       <nova:ports>
Nov 06 15:43:47 user nova-compute[75337]:         <nova:port uuid="b33373f6-0289-4623-90ac-f5c3db0d3681">
Nov 06 15:43:47 user nova-compute[75337]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 06 15:43:47 user nova-compute[75337]:         </nova:port>
Nov 06 15:43:47 user nova-compute[75337]:       </nova:ports>
Nov 06 15:43:47 user nova-compute[75337]:     </nova:instance>
Nov 06 15:43:47 user nova-compute[75337]:   </metadata>
Nov 06 15:43:47 user nova-compute[75337]:   <sysinfo type="smbios">
Nov 06 15:43:47 user nova-compute[75337]:     <system>
Nov 06 15:43:47 user nova-compute[75337]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 15:43:47 user nova-compute[75337]:       <entry name="product">OpenStack Nova</entry>
Nov 06 15:43:47 user nova-compute[75337]:       <entry name="version">0.0.0</entry>
Nov 06 15:43:47 user nova-compute[75337]:       <entry name="serial">c8cf1ead-a87c-459c-b914-a0e976c9e464</entry>
Nov 06 15:43:47 user nova-compute[75337]:       <entry name="uuid">c8cf1ead-a87c-459c-b914-a0e976c9e464</entry>
Nov 06 15:43:47 user nova-compute[75337]:       <entry name="family">Virtual Machine</entry>
Nov 06 15:43:47 user nova-compute[75337]:     </system>
Nov 06 15:43:47 user nova-compute[75337]:   </sysinfo>
Nov 06 15:43:47 user nova-compute[75337]:   <os>
Nov 06 15:43:47 user nova-compute[75337]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 15:43:47 user nova-compute[75337]:     <smbios mode="sysinfo"/>
Nov 06 15:43:47 user nova-compute[75337]:   </os>
Nov 06 15:43:47 user nova-compute[75337]:   <features>
Nov 06 15:43:47 user nova-compute[75337]:     <acpi/>
Nov 06 15:43:47 user nova-compute[75337]:     <apic/>
Nov 06 15:43:47 user nova-compute[75337]:     <vmcoreinfo/>
Nov 06 15:43:47 user nova-compute[75337]:   </features>
Nov 06 15:43:47 user nova-compute[75337]:   <clock offset="utc">
Nov 06 15:43:47 user nova-compute[75337]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 15:43:47 user nova-compute[75337]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 15:43:47 user nova-compute[75337]:     <timer name="hpet" present="no"/>
Nov 06 15:43:47 user nova-compute[75337]:   </clock>
Nov 06 15:43:47 user nova-compute[75337]:   <cpu mode="custom" match="exact">
Nov 06 15:43:47 user nova-compute[75337]:     <model>Nehalem</model>
Nov 06 15:43:47 user nova-compute[75337]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 15:43:47 user nova-compute[75337]:   </cpu>
Nov 06 15:43:47 user nova-compute[75337]:   <devices>
Nov 06 15:43:47 user nova-compute[75337]:     <disk type="file" device="disk">
Nov 06 15:43:47 user nova-compute[75337]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 15:43:47 user nova-compute[75337]:       <source file="/opt/stack/data/nova/instances/c8cf1ead-a87c-459c-b914-a0e976c9e464/disk"/>
Nov 06 15:43:47 user nova-compute[75337]:       <target dev="vda" bus="virtio"/>
Nov 06 15:43:47 user nova-compute[75337]:     </disk>
Nov 06 15:43:47 user nova-compute[75337]:     <disk type="block" device="disk">
Nov 06 15:43:47 user nova-compute[75337]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 15:43:47 user nova-compute[75337]:       <source dev="/dev/sdd"/>
Nov 06 15:43:47 user nova-compute[75337]:       <target dev="vdb" bus="virtio"/>
Nov 06 15:43:47 user nova-compute[75337]:       <serial>6f5503fc-8cc8-46fa-8450-d967f769a947</serial>
Nov 06 15:43:47 user nova-compute[75337]:     </disk>
Nov 06 15:43:47 user nova-compute[75337]:     <disk type="file" device="disk">
Nov 06 15:43:47 user nova-compute[75337]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 15:43:47 user nova-compute[75337]:       <source file="/opt/stack/data/nova/instances/c8cf1ead-a87c-459c-b914-a0e976c9e464/disk.rescue"/>
Nov 06 15:43:47 user nova-compute[75337]:       <target dev="vdc" bus="virtio"/>
Nov 06 15:43:47 user nova-compute[75337]:       <boot order="1"/>
Nov 06 15:43:47 user nova-compute[75337]:     </disk>
Nov 06 15:43:47 user nova-compute[75337]:     <interface type="ethernet">
Nov 06 15:43:47 user nova-compute[75337]:       <mac address="fa:16:3e:37:16:66"/>
Nov 06 15:43:47 user nova-compute[75337]:       <model type="virtio"/>
Nov 06 15:43:47 user nova-compute[75337]:       <mtu size="1442"/>
Nov 06 15:43:47 user nova-compute[75337]:       <target dev="tapb33373f6-02"/>
Nov 06 15:43:47 user nova-compute[75337]:     </interface>
Nov 06 15:43:47 user nova-compute[75337]:     <serial type="pty">
Nov 06 15:43:47 user nova-compute[75337]:       <log file="/opt/stack/data/nova/instances/c8cf1ead-a87c-459c-b914-a0e976c9e464/console.log" append="off"/>
Nov 06 15:43:47 user nova-compute[75337]:     </serial>
Nov 06 15:43:47 user nova-compute[75337]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 15:43:47 user nova-compute[75337]:     <video>
Nov 06 15:43:47 user nova-compute[75337]:       <model type="virtio"/>
Nov 06 15:43:47 user nova-compute[75337]:     </video>
Nov 06 15:43:47 user nova-compute[75337]:     <rng model="virtio">
Nov 06 15:43:47 user nova-compute[75337]:       <backend model="random">/dev/urandom</backend>
Nov 06 15:43:47 user nova-compute[75337]:     </rng>
Nov 06 15:43:47 user nova-compute[75337]:     <controller type="usb" index="0" model="none"/>
Nov 06 15:43:47 user nova-compute[75337]:     <memballoon model="virtio">
Nov 06 15:43:47 user nova-compute[75337]:       <stats period="10"/>
Nov 06 15:43:47 user nova-compute[75337]:     </memballoon>
Nov 06 15:43:47 user nova-compute[75337]:   </devices>
Nov 06 15:43:47 user nova-compute[75337]: </domain>
Nov 06 15:43:47 user nova-compute[75337]:  {{(pid=75337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 15:43:47 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc0578f4-b30e-45b3-8cac-26620e7c3e96 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:43:47 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[452f2186-e500-4d5d-a7c5-b7058643a59f]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:43:47 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-1742b26e-22f7-4005-a190-354af68c53aa tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:43:47 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc0578f4-b30e-45b3-8cac-26620e7c3e96 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:43:47 user nova-compute[75337]: INFO nova.virt.libvirt.driver [-] [instance: c8cf1ead-a87c-459c-b914-a0e976c9e464] Instance destroyed successfully.
Nov 06 15:43:47 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc0578f4-b30e-45b3-8cac-26620e7c3e96 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:43:47 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[db8d1de6-2a8f-4223-8253-fb408b5ea4c4]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:43:47 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-1742b26e-22f7-4005-a190-354af68c53aa tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:43:47 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc0578f4-b30e-45b3-8cac-26620e7c3e96 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vFOjicIu {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:43:47 user nova-compute[75337]: DEBUG nova.compute.manager [req-79b114d7-d5d1-496b-b717-8e7e3b7bb16e req-df9e00f2-965b-4c2c-b7ed-ad21df240aa8 service nova] [instance: 1fa4c927-7485-4f34-94bd-9e20358904b6] Received event network-vif-plugged-3812cc74-01db-4b2b-815c-770420051e1b {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:43:47 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-79b114d7-d5d1-496b-b717-8e7e3b7bb16e req-df9e00f2-965b-4c2c-b7ed-ad21df240aa8 service nova] Acquiring lock "1fa4c927-7485-4f34-94bd-9e20358904b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:43:47 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-79b114d7-d5d1-496b-b717-8e7e3b7bb16e req-df9e00f2-965b-4c2c-b7ed-ad21df240aa8 service nova] Lock "1fa4c927-7485-4f34-94bd-9e20358904b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:43:47 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-79b114d7-d5d1-496b-b717-8e7e3b7bb16e req-df9e00f2-965b-4c2c-b7ed-ad21df240aa8 service nova] Lock "1fa4c927-7485-4f34-94bd-9e20358904b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:43:47 user nova-compute[75337]: DEBUG nova.compute.manager [req-79b114d7-d5d1-496b-b717-8e7e3b7bb16e req-df9e00f2-965b-4c2c-b7ed-ad21df240aa8 service nova] [instance: 1fa4c927-7485-4f34-94bd-9e20358904b6] No waiting events found dispatching network-vif-plugged-3812cc74-01db-4b2b-815c-770420051e1b {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:43:47 user nova-compute[75337]: WARNING nova.compute.manager [req-79b114d7-d5d1-496b-b717-8e7e3b7bb16e req-df9e00f2-965b-4c2c-b7ed-ad21df240aa8 service nova] [instance: 1fa4c927-7485-4f34-94bd-9e20358904b6] Received unexpected event network-vif-plugged-3812cc74-01db-4b2b-815c-770420051e1b for instance with vm_state active and task_state rescuing.
Nov 06 15:43:47 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc0578f4-b30e-45b3-8cac-26620e7c3e96 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vFOjicIu" returned: 0 in 0.029s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:43:47 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e1d7f42-3a15-4afb-b716-140cb404b1db]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:43:47 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-1742b26e-22f7-4005-a190-354af68c53aa tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vFOjicIu'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:43:47 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc0578f4-b30e-45b3-8cac-26620e7c3e96 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:43:47 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-f7cec134-ce83-44f9-b444-89be187dd718 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] No BDM found with device name vda, not building metadata. {{(pid=75337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 15:43:47 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-f7cec134-ce83-44f9-b444-89be187dd718 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 15:43:47 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-f7cec134-ce83-44f9-b444-89be187dd718 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 15:43:47 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-f7cec134-ce83-44f9-b444-89be187dd718 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] No VIF found with MAC fa:16:3e:37:16:66, not building metadata {{(pid=75337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 15:43:47 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc0578f4-b30e-45b3-8cac-26620e7c3e96 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:43:47 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[818bee75-219a-4d50-bbdc-0ccb00f81a64]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:43:47 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-1742b26e-22f7-4005-a190-354af68c53aa tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:43:47 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:43:47 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:43:47 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[938f1479-4dae-42d0-9fb8-3e3e23e55ea2]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f5503fc-8cc8-46fa-8450-d967f769a947 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759 (non-flash)\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:43:47 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-1742b26e-22f7-4005-a190-354af68c53aa tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)
Nov 06 15:43:47 user nova-compute[75337]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e (non-flash)
Nov 06 15:43:47 user nova-compute[75337]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f5503fc-8cc8-46fa-8450-d967f769a947 (non-flash)
Nov 06 15:43:47 user nova-compute[75337]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759 (non-flash)
Nov 06 15:43:47 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 15:43:47 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-1742b26e-22f7-4005-a190-354af68c53aa tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)
Nov 06 15:43:47 user nova-compute[75337]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e (non-flash)
Nov 06 15:43:47 user nova-compute[75337]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f5503fc-8cc8-46fa-8450-d967f769a947 (non-flash)
Nov 06 15:43:47 user nova-compute[75337]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759 (non-flash)
Nov 06 15:43:47 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 15:43:47 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc0578f4-b30e-45b3-8cac-26620e7c3e96 -p 172.16.0.220:3260 --login {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:43:47 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc0578f4-b30e-45b3-8cac-26620e7c3e96 -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:43:47 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c7f6fe7-0b7e-4ea3-b760-b3df930a5b89]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bc0578f4-b30e-45b3-8cac-26620e7c3e96, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bc0578f4-b30e-45b3-8cac-26620e7c3e96, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:43:47 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-1742b26e-22f7-4005-a190-354af68c53aa tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bc0578f4-b30e-45b3-8cac-26620e7c3e96, portal: 172.16.0.220,3260]
Nov 06 15:43:47 user nova-compute[75337]: Login to [iface: default, target: iqn.2010-10.org.openstack:bc0578f4-b30e-45b3-8cac-26620e7c3e96, portal: 172.16.0.220,3260] successful.
Nov 06 15:43:47 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:43:47 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc0578f4-b30e-45b3-8cac-26620e7c3e96 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:43:47 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc0578f4-b30e-45b3-8cac-26620e7c3e96 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:43:47 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb0ac0ef-039a-4ce5-8f64-5488ea47607f]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:43:47 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-1742b26e-22f7-4005-a190-354af68c53aa tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:43:47 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:43:48 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:43:48 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[70f892a7-20c9-43db-b161-398b98156577]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f5503fc-8cc8-46fa-8450-d967f769a947 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0578f4-b30e-45b3-8cac-26620e7c3e96 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759 (non-flash)\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:43:48 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-1742b26e-22f7-4005-a190-354af68c53aa tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)
Nov 06 15:43:48 user nova-compute[75337]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e (non-flash)
Nov 06 15:43:48 user nova-compute[75337]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f5503fc-8cc8-46fa-8450-d967f769a947 (non-flash)
Nov 06 15:43:48 user nova-compute[75337]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0578f4-b30e-45b3-8cac-26620e7c3e96 (non-flash)
Nov 06 15:43:48 user nova-compute[75337]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759 (non-flash)
Nov 06 15:43:48 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 15:43:48 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-1742b26e-22f7-4005-a190-354af68c53aa tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)
Nov 06 15:43:48 user nova-compute[75337]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e (non-flash)
Nov 06 15:43:48 user nova-compute[75337]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f5503fc-8cc8-46fa-8450-d967f769a947 (non-flash)
Nov 06 15:43:48 user nova-compute[75337]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0578f4-b30e-45b3-8cac-26620e7c3e96 (non-flash)
Nov 06 15:43:48 user nova-compute[75337]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759 (non-flash)
Nov 06 15:43:48 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 15:43:48 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-1742b26e-22f7-4005-a190-354af68c53aa tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bc0578f4-b30e-45b3-8cac-26620e7c3e96" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.398s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 15:43:48 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-1742b26e-22f7-4005-a190-354af68c53aa tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Connected to 172.16.0.220:3260 {{(pid=75337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 15:43:48 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-1742b26e-22f7-4005-a190-354af68c53aa tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] HCTL ('37', '-', '-', 0) found on session 14 with lun 0 {{(pid=75337) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 15:43:48 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-1742b26e-22f7-4005-a190-354af68c53aa tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75337) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 15:43:48 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:43:48 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.021s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:43:48 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[47e21b6f-b9be-4fa5-91e6-b0f2f37c56be]: (4, ('- - 0', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:43:48 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-1742b26e-22f7-4005-a190-354af68c53aa tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Searching for a device in session 14 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75337) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 15:43:48 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-1742b26e-22f7-4005-a190-354af68c53aa tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:bc0578f4-b30e-45b3-8cac-26620e7c3e96', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vFOjicIu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 15:43:48 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:43:48 user nova-compute[75337]: DEBUG nova.compute.manager [None req-351db0e9-14e3-4c42-a98e-ed2ec14aa38d tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: 1fa4c927-7485-4f34-94bd-9e20358904b6] Checking state {{(pid=75337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 15:43:49 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-1742b26e-22f7-4005-a190-354af68c53aa tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.439s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 15:43:49 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-1742b26e-22f7-4005-a190-354af68c53aa tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] <== connect_volume: return (1619ms) {'type': 'block', 'scsi_wwn': '23665373539626430', 'path': '/dev/sdf'} {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 15:43:49 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1742b26e-22f7-4005-a190-354af68c53aa tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] [instance: 8a600bd8-b94a-4242-a443-c2defb002280] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23665373539626430', 'path': '/dev/sdf'} {{(pid=75337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 15:43:49 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-1742b26e-22f7-4005-a190-354af68c53aa tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-06T15:37:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1664848086',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1664848086',id=5,image_ref='b903ecce-b6cc-4173-97b0-7dcdc01e4622',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1277258187',keypairs=<?>,launch_index=0,launched_at=2023-11-06T15:38:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='ed09a1def6f0477796404d9bd3357dd0',ramdisk_id='',reservation_id='r-4kx37btu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-417383725',owner_user_name='tempest-AttachVolumeShelveTestJSON-417383725-project-member',shelved_at='2023-11-06T15:40:03.727921',shelved_host='user',shelved_image_id='b903ecce-b6cc-4173-97b0-7dcdc01e4622'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T15:42:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9e1c021de4da40518ddc45a57ef79d6f',uuid=8a600bd8-b94a-4242-a443-c2defb002280,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "01aa7168-78cd-44e6-8496-08d468f62cfe", "address": "fa:16:3e:f1:25:3e", "network": {"id": "f24470c2-ff6f-49fd-b28f-16b8a87ed3b4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-217486733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed09a1def6f0477796404d9bd3357dd0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01aa7168-78", "ovs_interfaceid": "01aa7168-78cd-44e6-8496-08d468f62cfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75337) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 15:43:49 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-1742b26e-22f7-4005-a190-354af68c53aa tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Converting VIF {"id": "01aa7168-78cd-44e6-8496-08d468f62cfe", "address": "fa:16:3e:f1:25:3e", "network": {"id": "f24470c2-ff6f-49fd-b28f-16b8a87ed3b4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-217486733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed09a1def6f0477796404d9bd3357dd0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01aa7168-78", "ovs_interfaceid": "01aa7168-78cd-44e6-8496-08d468f62cfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 15:43:49 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-1742b26e-22f7-4005-a190-354af68c53aa tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:25:3e,bridge_name='br-int',has_traffic_filtering=True,id=01aa7168-78cd-44e6-8496-08d468f62cfe,network=Network(f24470c2-ff6f-49fd-b28f-16b8a87ed3b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01aa7168-78') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 15:43:49 user nova-compute[75337]: DEBUG nova.objects.instance [None req-1742b26e-22f7-4005-a190-354af68c53aa tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Lazy-loading 'pci_devices' on Instance uuid 8a600bd8-b94a-4242-a443-c2defb002280 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 15:43:49 user nova-compute[75337]: DEBUG nova.objects.base [None req-1742b26e-22f7-4005-a190-354af68c53aa tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Object Instance<8a600bd8-b94a-4242-a443-c2defb002280> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=75337) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 15:43:49 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-1742b26e-22f7-4005-a190-354af68c53aa tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] [instance: 8a600bd8-b94a-4242-a443-c2defb002280] End _get_guest_xml xml=<domain type="kvm">
Nov 06 15:43:49 user nova-compute[75337]:   <uuid>8a600bd8-b94a-4242-a443-c2defb002280</uuid>
Nov 06 15:43:49 user nova-compute[75337]:   <name>instance-00000005</name>
Nov 06 15:43:49 user nova-compute[75337]:   <memory>524288</memory>
Nov 06 15:43:49 user nova-compute[75337]:   <vcpu>1</vcpu>
Nov 06 15:43:49 user nova-compute[75337]:   <metadata>
Nov 06 15:43:49 user nova-compute[75337]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 15:43:49 user nova-compute[75337]:       <nova:package version="0.0.0"/>
Nov 06 15:43:49 user nova-compute[75337]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1664848086</nova:name>
Nov 06 15:43:49 user nova-compute[75337]:       <nova:creationTime>2023-11-06 15:43:47</nova:creationTime>
Nov 06 15:43:49 user nova-compute[75337]:       <nova:flavor name="m1.tiny">
Nov 06 15:43:49 user nova-compute[75337]:         <nova:memory>512</nova:memory>
Nov 06 15:43:49 user nova-compute[75337]:         <nova:disk>1</nova:disk>
Nov 06 15:43:49 user nova-compute[75337]:         <nova:swap>0</nova:swap>
Nov 06 15:43:49 user nova-compute[75337]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 15:43:49 user nova-compute[75337]:         <nova:vcpus>1</nova:vcpus>
Nov 06 15:43:49 user nova-compute[75337]:       </nova:flavor>
Nov 06 15:43:49 user nova-compute[75337]:       <nova:owner>
Nov 06 15:43:49 user nova-compute[75337]:         <nova:user uuid="9e1c021de4da40518ddc45a57ef79d6f">tempest-AttachVolumeShelveTestJSON-417383725-project-member</nova:user>
Nov 06 15:43:49 user nova-compute[75337]:         <nova:project uuid="ed09a1def6f0477796404d9bd3357dd0">tempest-AttachVolumeShelveTestJSON-417383725</nova:project>
Nov 06 15:43:49 user nova-compute[75337]:       </nova:owner>
Nov 06 15:43:49 user nova-compute[75337]:       <nova:root type="image" uuid="b903ecce-b6cc-4173-97b0-7dcdc01e4622"/>
Nov 06 15:43:49 user nova-compute[75337]:       <nova:ports>
Nov 06 15:43:49 user nova-compute[75337]:         <nova:port uuid="01aa7168-78cd-44e6-8496-08d468f62cfe">
Nov 06 15:43:49 user nova-compute[75337]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 06 15:43:49 user nova-compute[75337]:         </nova:port>
Nov 06 15:43:49 user nova-compute[75337]:       </nova:ports>
Nov 06 15:43:49 user nova-compute[75337]:     </nova:instance>
Nov 06 15:43:49 user nova-compute[75337]:   </metadata>
Nov 06 15:43:49 user nova-compute[75337]:   <sysinfo type="smbios">
Nov 06 15:43:49 user nova-compute[75337]:     <system>
Nov 06 15:43:49 user nova-compute[75337]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 15:43:49 user nova-compute[75337]:       <entry name="product">OpenStack Nova</entry>
Nov 06 15:43:49 user nova-compute[75337]:       <entry name="version">0.0.0</entry>
Nov 06 15:43:49 user nova-compute[75337]:       <entry name="serial">8a600bd8-b94a-4242-a443-c2defb002280</entry>
Nov 06 15:43:49 user nova-compute[75337]:       <entry name="uuid">8a600bd8-b94a-4242-a443-c2defb002280</entry>
Nov 06 15:43:49 user nova-compute[75337]:       <entry name="family">Virtual Machine</entry>
Nov 06 15:43:49 user nova-compute[75337]:     </system>
Nov 06 15:43:49 user nova-compute[75337]:   </sysinfo>
Nov 06 15:43:49 user nova-compute[75337]:   <os>
Nov 06 15:43:49 user nova-compute[75337]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 15:43:49 user nova-compute[75337]:     <boot dev="hd"/>
Nov 06 15:43:49 user nova-compute[75337]:     <smbios mode="sysinfo"/>
Nov 06 15:43:49 user nova-compute[75337]:   </os>
Nov 06 15:43:49 user nova-compute[75337]:   <features>
Nov 06 15:43:49 user nova-compute[75337]:     <acpi/>
Nov 06 15:43:49 user nova-compute[75337]:     <apic/>
Nov 06 15:43:49 user nova-compute[75337]:     <vmcoreinfo/>
Nov 06 15:43:49 user nova-compute[75337]:   </features>
Nov 06 15:43:49 user nova-compute[75337]:   <clock offset="utc">
Nov 06 15:43:49 user nova-compute[75337]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 15:43:49 user nova-compute[75337]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 15:43:49 user nova-compute[75337]:     <timer name="hpet" present="no"/>
Nov 06 15:43:49 user nova-compute[75337]:   </clock>
Nov 06 15:43:49 user nova-compute[75337]:   <cpu mode="custom" match="exact">
Nov 06 15:43:49 user nova-compute[75337]:     <model>Nehalem</model>
Nov 06 15:43:49 user nova-compute[75337]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 15:43:49 user nova-compute[75337]:   </cpu>
Nov 06 15:43:49 user nova-compute[75337]:   <devices>
Nov 06 15:43:49 user nova-compute[75337]:     <disk type="file" device="disk">
Nov 06 15:43:49 user nova-compute[75337]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 15:43:49 user nova-compute[75337]:       <source file="/opt/stack/data/nova/instances/8a600bd8-b94a-4242-a443-c2defb002280/disk"/>
Nov 06 15:43:49 user nova-compute[75337]:       <target dev="vda" bus="virtio"/>
Nov 06 15:43:49 user nova-compute[75337]:     </disk>
Nov 06 15:43:49 user nova-compute[75337]:     <disk type="block" device="disk">
Nov 06 15:43:49 user nova-compute[75337]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 15:43:49 user nova-compute[75337]:       <source dev="/dev/sdf"/>
Nov 06 15:43:49 user nova-compute[75337]:       <target dev="vdc" bus="virtio"/>
Nov 06 15:43:49 user nova-compute[75337]:       <serial>bc0578f4-b30e-45b3-8cac-26620e7c3e96</serial>
Nov 06 15:43:49 user nova-compute[75337]:     </disk>
Nov 06 15:43:49 user nova-compute[75337]:     <interface type="ethernet">
Nov 06 15:43:49 user nova-compute[75337]:       <mac address="fa:16:3e:f1:25:3e"/>
Nov 06 15:43:49 user nova-compute[75337]:       <model type="virtio"/>
Nov 06 15:43:49 user nova-compute[75337]:       <mtu size="1442"/>
Nov 06 15:43:49 user nova-compute[75337]:       <target dev="tap01aa7168-78"/>
Nov 06 15:43:49 user nova-compute[75337]:     </interface>
Nov 06 15:43:49 user nova-compute[75337]:     <serial type="pty">
Nov 06 15:43:49 user nova-compute[75337]:       <log file="/opt/stack/data/nova/instances/8a600bd8-b94a-4242-a443-c2defb002280/console.log" append="off"/>
Nov 06 15:43:49 user nova-compute[75337]:     </serial>
Nov 06 15:43:49 user nova-compute[75337]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 15:43:49 user nova-compute[75337]:     <video>
Nov 06 15:43:49 user nova-compute[75337]:       <model type="virtio"/>
Nov 06 15:43:49 user nova-compute[75337]:     </video>
Nov 06 15:43:49 user nova-compute[75337]:     <rng model="virtio">
Nov 06 15:43:49 user nova-compute[75337]:       <backend model="random">/dev/urandom</backend>
Nov 06 15:43:49 user nova-compute[75337]:     </rng>
Nov 06 15:43:49 user nova-compute[75337]:     <controller type="usb" index="0" model="none"/>
Nov 06 15:43:49 user nova-compute[75337]:     <memballoon model="virtio">
Nov 06 15:43:49 user nova-compute[75337]:       <stats period="10"/>
Nov 06 15:43:49 user nova-compute[75337]:     </memballoon>
Nov 06 15:43:49 user nova-compute[75337]:   </devices>
Nov 06 15:43:49 user nova-compute[75337]: </domain>
Nov 06 15:43:49 user nova-compute[75337]:  {{(pid=75337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 15:43:49 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-1742b26e-22f7-4005-a190-354af68c53aa tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-06T15:37:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1664848086',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1664848086',id=5,image_ref='b903ecce-b6cc-4173-97b0-7dcdc01e4622',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1277258187',keypairs=<?>,launch_index=0,launched_at=2023-11-06T15:38:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='ed09a1def6f0477796404d9bd3357dd0',ramdisk_id='',reservation_id='r-4kx37btu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-417383725',owner_user_name='tempest-AttachVolumeShelveTestJSON-417383725-project-member',shelved_at='2023-11-06T15:40:03.727921',shelved_host='user',shelved_image_id='b903ecce-b6cc-4173-97b0-7dcdc01e4622'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T15:42:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9e1c021de4da40518ddc45a57ef79d6f',uuid=8a600bd8-b94a-4242-a443-c2defb002280,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "01aa7168-78cd-44e6-8496-08d468f62cfe", "address": "fa:16:3e:f1:25:3e", "network": {"id": "f24470c2-ff6f-49fd-b28f-16b8a87ed3b4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-217486733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed09a1def6f0477796404d9bd3357dd0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01aa7168-78", "ovs_interfaceid": "01aa7168-78cd-44e6-8496-08d468f62cfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 15:43:49 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-1742b26e-22f7-4005-a190-354af68c53aa tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Converting VIF {"id": "01aa7168-78cd-44e6-8496-08d468f62cfe", "address": "fa:16:3e:f1:25:3e", "network": {"id": "f24470c2-ff6f-49fd-b28f-16b8a87ed3b4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-217486733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed09a1def6f0477796404d9bd3357dd0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01aa7168-78", "ovs_interfaceid": "01aa7168-78cd-44e6-8496-08d468f62cfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 15:43:49 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-1742b26e-22f7-4005-a190-354af68c53aa tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:25:3e,bridge_name='br-int',has_traffic_filtering=True,id=01aa7168-78cd-44e6-8496-08d468f62cfe,network=Network(f24470c2-ff6f-49fd-b28f-16b8a87ed3b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01aa7168-78') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 15:43:49 user nova-compute[75337]: DEBUG os_vif [None req-1742b26e-22f7-4005-a190-354af68c53aa tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:25:3e,bridge_name='br-int',has_traffic_filtering=True,id=01aa7168-78cd-44e6-8496-08d468f62cfe,network=Network(f24470c2-ff6f-49fd-b28f-16b8a87ed3b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01aa7168-78') {{(pid=75337) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 15:43:49 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:43:49 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:43:49 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 15:43:49 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:43:49 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c1f8d2fe-3b7b-5a9c-a24f-6ba1913d4ec2', '_type': 'linux-noop'}}, row=False) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:43:49 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:43:49 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:43:49 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:43:49 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:43:49 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap01aa7168-78, may_exist=True, interface_attrs={}) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:43:49 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap01aa7168-78, col_values=(('qos', UUID('9b62d07f-6e7c-4178-aa4b-6322f63908af')),), if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:43:49 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap01aa7168-78, col_values=(('external_ids', {'iface-id': '01aa7168-78cd-44e6-8496-08d468f62cfe', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f1:25:3e', 'vm-uuid': '8a600bd8-b94a-4242-a443-c2defb002280'}),), if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:43:49 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:43:49 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:43:49 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:43:49 user nova-compute[75337]: INFO os_vif [None req-1742b26e-22f7-4005-a190-354af68c53aa tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:25:3e,bridge_name='br-int',has_traffic_filtering=True,id=01aa7168-78cd-44e6-8496-08d468f62cfe,network=Network(f24470c2-ff6f-49fd-b28f-16b8a87ed3b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01aa7168-78')
Nov 06 15:43:49 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-1742b26e-22f7-4005-a190-354af68c53aa tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] No BDM found with device name vda, not building metadata. {{(pid=75337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 15:43:49 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-1742b26e-22f7-4005-a190-354af68c53aa tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 15:43:49 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-1742b26e-22f7-4005-a190-354af68c53aa tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] No VIF found with MAC fa:16:3e:f1:25:3e, not building metadata {{(pid=75337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 15:43:49 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:43:49 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:43:49 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:43:49 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:43:50 user nova-compute[75337]: DEBUG nova.compute.manager [req-cc457ce5-f191-457c-9711-a9c14842f4d1 req-e6d534a3-fd38-42e2-9749-34d5fe56fbb0 service nova] [instance: c8cf1ead-a87c-459c-b914-a0e976c9e464] Received event network-vif-plugged-b33373f6-0289-4623-90ac-f5c3db0d3681 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:43:50 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-cc457ce5-f191-457c-9711-a9c14842f4d1 req-e6d534a3-fd38-42e2-9749-34d5fe56fbb0 service nova] Acquiring lock "c8cf1ead-a87c-459c-b914-a0e976c9e464-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:43:50 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-cc457ce5-f191-457c-9711-a9c14842f4d1 req-e6d534a3-fd38-42e2-9749-34d5fe56fbb0 service nova] Lock "c8cf1ead-a87c-459c-b914-a0e976c9e464-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:43:50 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-cc457ce5-f191-457c-9711-a9c14842f4d1 req-e6d534a3-fd38-42e2-9749-34d5fe56fbb0 service nova] Lock "c8cf1ead-a87c-459c-b914-a0e976c9e464-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:43:50 user nova-compute[75337]: DEBUG nova.compute.manager [req-cc457ce5-f191-457c-9711-a9c14842f4d1 req-e6d534a3-fd38-42e2-9749-34d5fe56fbb0 service nova] [instance: c8cf1ead-a87c-459c-b914-a0e976c9e464] No waiting events found dispatching network-vif-plugged-b33373f6-0289-4623-90ac-f5c3db0d3681 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:43:50 user nova-compute[75337]: WARNING nova.compute.manager [req-cc457ce5-f191-457c-9711-a9c14842f4d1 req-e6d534a3-fd38-42e2-9749-34d5fe56fbb0 service nova] [instance: c8cf1ead-a87c-459c-b914-a0e976c9e464] Received unexpected event network-vif-plugged-b33373f6-0289-4623-90ac-f5c3db0d3681 for instance with vm_state active and task_state rescuing.
Nov 06 15:43:50 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:43:50 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:43:51 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:43:51 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:43:52 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:43:52 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:43:52 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:43:52 user nova-compute[75337]: DEBUG nova.compute.manager [req-c794caf6-cfa7-4d70-be93-71d6075797ec req-0d9644f9-e87f-4240-9996-95cc17fd0800 service nova] [instance: c8cf1ead-a87c-459c-b914-a0e976c9e464] Received event network-vif-plugged-b33373f6-0289-4623-90ac-f5c3db0d3681 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:43:52 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-c794caf6-cfa7-4d70-be93-71d6075797ec req-0d9644f9-e87f-4240-9996-95cc17fd0800 service nova] Acquiring lock "c8cf1ead-a87c-459c-b914-a0e976c9e464-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:43:52 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-c794caf6-cfa7-4d70-be93-71d6075797ec req-0d9644f9-e87f-4240-9996-95cc17fd0800 service nova] Lock "c8cf1ead-a87c-459c-b914-a0e976c9e464-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:43:52 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-c794caf6-cfa7-4d70-be93-71d6075797ec req-0d9644f9-e87f-4240-9996-95cc17fd0800 service nova] Lock "c8cf1ead-a87c-459c-b914-a0e976c9e464-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:43:52 user nova-compute[75337]: DEBUG nova.compute.manager [req-c794caf6-cfa7-4d70-be93-71d6075797ec req-0d9644f9-e87f-4240-9996-95cc17fd0800 service nova] [instance: c8cf1ead-a87c-459c-b914-a0e976c9e464] No waiting events found dispatching network-vif-plugged-b33373f6-0289-4623-90ac-f5c3db0d3681 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:43:52 user nova-compute[75337]: WARNING nova.compute.manager [req-c794caf6-cfa7-4d70-be93-71d6075797ec req-0d9644f9-e87f-4240-9996-95cc17fd0800 service nova] [instance: c8cf1ead-a87c-459c-b914-a0e976c9e464] Received unexpected event network-vif-plugged-b33373f6-0289-4623-90ac-f5c3db0d3681 for instance with vm_state active and task_state rescuing.
Nov 06 15:43:52 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:43:52 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:43:52 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:43:53 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:43:53 user nova-compute[75337]: DEBUG nova.compute.manager [req-b0ab2e01-de63-4be6-8f74-d9728c86effd req-2b3a6f6c-a958-4140-ab03-73cd54b04d43 service nova] [instance: 8a600bd8-b94a-4242-a443-c2defb002280] Received event network-vif-plugged-01aa7168-78cd-44e6-8496-08d468f62cfe {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:43:53 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-b0ab2e01-de63-4be6-8f74-d9728c86effd req-2b3a6f6c-a958-4140-ab03-73cd54b04d43 service nova] Acquiring lock "8a600bd8-b94a-4242-a443-c2defb002280-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:43:53 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-b0ab2e01-de63-4be6-8f74-d9728c86effd req-2b3a6f6c-a958-4140-ab03-73cd54b04d43 service nova] Lock "8a600bd8-b94a-4242-a443-c2defb002280-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:43:53 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-b0ab2e01-de63-4be6-8f74-d9728c86effd req-2b3a6f6c-a958-4140-ab03-73cd54b04d43 service nova] Lock "8a600bd8-b94a-4242-a443-c2defb002280-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:43:53 user nova-compute[75337]: DEBUG nova.compute.manager [req-b0ab2e01-de63-4be6-8f74-d9728c86effd req-2b3a6f6c-a958-4140-ab03-73cd54b04d43 service nova] [instance: 8a600bd8-b94a-4242-a443-c2defb002280] No waiting events found dispatching network-vif-plugged-01aa7168-78cd-44e6-8496-08d468f62cfe {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:43:53 user nova-compute[75337]: WARNING nova.compute.manager [req-b0ab2e01-de63-4be6-8f74-d9728c86effd req-2b3a6f6c-a958-4140-ab03-73cd54b04d43 service nova] [instance: 8a600bd8-b94a-4242-a443-c2defb002280] Received unexpected event network-vif-plugged-01aa7168-78cd-44e6-8496-08d468f62cfe for instance with vm_state shelved_offloaded and task_state spawning.
Nov 06 15:43:54 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:43:54 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:43:54 user nova-compute[75337]: DEBUG nova.compute.manager [None req-f7cec134-ce83-44f9-b444-89be187dd718 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] [instance: c8cf1ead-a87c-459c-b914-a0e976c9e464] Checking state {{(pid=75337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 15:43:54 user nova-compute[75337]: DEBUG nova.compute.manager [None req-1742b26e-22f7-4005-a190-354af68c53aa tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] [instance: 8a600bd8-b94a-4242-a443-c2defb002280] Instance event wait completed in 0 seconds for  {{(pid=75337) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 15:43:54 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-1742b26e-22f7-4005-a190-354af68c53aa tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] [instance: 8a600bd8-b94a-4242-a443-c2defb002280] Guest created on hypervisor {{(pid=75337) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 15:43:54 user nova-compute[75337]: INFO nova.virt.libvirt.driver [-] [instance: 8a600bd8-b94a-4242-a443-c2defb002280] Instance spawned successfully.
Nov 06 15:43:54 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:43:54 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:43:54 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:43:54 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:43:54 user nova-compute[75337]: DEBUG nova.compute.manager [None req-1742b26e-22f7-4005-a190-354af68c53aa tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] [instance: 8a600bd8-b94a-4242-a443-c2defb002280] Checking state {{(pid=75337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 15:43:54 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-1742b26e-22f7-4005-a190-354af68c53aa tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Lock "8a600bd8-b94a-4242-a443-c2defb002280" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 99.490s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:43:55 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:43:55 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:43:55 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Starting heal instance info cache {{(pid=75337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 15:43:55 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Didn't find any instances for network info cache update. {{(pid=75337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 06 15:43:55 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:43:55 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Cleaning up deleted instances {{(pid=75337) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 06 15:43:55 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] There are 0 instances to clean {{(pid=75337) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 06 15:43:55 user nova-compute[75337]: DEBUG nova.compute.manager [req-ac726013-ee85-4d76-9736-841d4348cdc9 req-808dfaf9-6d63-45f5-85b5-8781b40f5105 service nova] [instance: 8a600bd8-b94a-4242-a443-c2defb002280] Received event network-vif-plugged-01aa7168-78cd-44e6-8496-08d468f62cfe {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:43:55 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-ac726013-ee85-4d76-9736-841d4348cdc9 req-808dfaf9-6d63-45f5-85b5-8781b40f5105 service nova] Acquiring lock "8a600bd8-b94a-4242-a443-c2defb002280-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:43:55 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-ac726013-ee85-4d76-9736-841d4348cdc9 req-808dfaf9-6d63-45f5-85b5-8781b40f5105 service nova] Lock "8a600bd8-b94a-4242-a443-c2defb002280-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:43:55 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-ac726013-ee85-4d76-9736-841d4348cdc9 req-808dfaf9-6d63-45f5-85b5-8781b40f5105 service nova] Lock "8a600bd8-b94a-4242-a443-c2defb002280-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:43:55 user nova-compute[75337]: DEBUG nova.compute.manager [req-ac726013-ee85-4d76-9736-841d4348cdc9 req-808dfaf9-6d63-45f5-85b5-8781b40f5105 service nova] [instance: 8a600bd8-b94a-4242-a443-c2defb002280] No waiting events found dispatching network-vif-plugged-01aa7168-78cd-44e6-8496-08d468f62cfe {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:43:56 user nova-compute[75337]: WARNING nova.compute.manager [req-ac726013-ee85-4d76-9736-841d4348cdc9 req-808dfaf9-6d63-45f5-85b5-8781b40f5105 service nova] [instance: 8a600bd8-b94a-4242-a443-c2defb002280] Received unexpected event network-vif-plugged-01aa7168-78cd-44e6-8496-08d468f62cfe for instance with vm_state active and task_state None.
Nov 06 15:43:56 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:43:56 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:43:56 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:43:56 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75337) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 15:43:56 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-23745249-14b8-4dc4-98ad-425185e4742d tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance dfadb21f-5ed1-42f4-956b-95cccf128b6a is timed out.
Nov 06 15:43:56 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-23745249-14b8-4dc4-98ad-425185e4742d tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Successfully detached device vdb from instance dfadb21f-5ed1-42f4-956b-95cccf128b6a from the live domain config.
Nov 06 15:43:56 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-23745249-14b8-4dc4-98ad-425185e4742d tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] [instance: dfadb21f-5ed1-42f4-956b-95cccf128b6a] calling os-brick to detach iSCSI Volume {{(pid=75337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 15:43:56 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-23745249-14b8-4dc4-98ad-425185e4742d tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2abc33d0c0>, {'target_iqn': 'iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZArmKPWO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 15:43:56 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-23745249-14b8-4dc4-98ad-425185e4742d tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 15:43:56 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-23745249-14b8-4dc4-98ad-425185e4742d tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 15:43:56 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-23745249-14b8-4dc4-98ad-425185e4742d tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 15:43:56 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:43:56 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.029s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:43:56 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[31b80cd3-6a65-4410-ab6e-6ff0bc009bd1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6f5503fc-8cc8-46fa-8450-d967f769a947\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bc0578f4-b30e-45b3-8cac-26620e7c3e96\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:43:56 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-23745249-14b8-4dc4-98ad-425185e4742d tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 15:43:56 user nova-compute[75337]: No targets found.
Nov 06 15:43:56 user nova-compute[75337]: iSNS:
Nov 06 15:43:56 user nova-compute[75337]: No targets found.
Nov 06 15:43:56 user nova-compute[75337]: STATIC:
Nov 06 15:43:56 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e
Nov 06 15:43:56 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 15:43:56 user nova-compute[75337]:                 Iface Name: default
Nov 06 15:43:56 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:6f5503fc-8cc8-46fa-8450-d967f769a947
Nov 06 15:43:56 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 15:43:56 user nova-compute[75337]:                 Iface Name: default
Nov 06 15:43:56 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158
Nov 06 15:43:56 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 15:43:56 user nova-compute[75337]:                 Iface Name: default
Nov 06 15:43:56 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759
Nov 06 15:43:56 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 15:43:56 user nova-compute[75337]:                 Iface Name: default
Nov 06 15:43:56 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:bc0578f4-b30e-45b3-8cac-26620e7c3e96
Nov 06 15:43:56 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 15:43:56 user nova-compute[75337]:                 Iface Name: default
Nov 06 15:43:56 user nova-compute[75337]: FIRMWARE:
Nov 06 15:43:56 user nova-compute[75337]: No targets found.
Nov 06 15:43:56 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 15:43:56 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-23745249-14b8-4dc4-98ad-425185e4742d tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 15:43:56 user nova-compute[75337]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 15:43:56 user nova-compute[75337]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75337) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 15:43:56 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-23745249-14b8-4dc4-98ad-425185e4742d tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759', 0)] {{(pid=75337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 15:43:56 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:43:56 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.046s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:43:56 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[538eee77-3938-47f6-b5e5-8ab5371c8d48]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6f5503fc-8cc8-46fa-8450-d967f769a947\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bc0578f4-b30e-45b3-8cac-26620e7c3e96\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:43:56 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:43:56 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.043s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:43:56 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[87da3202-e6e3-4696-b678-ce00cfe384d5]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f5503fc-8cc8-46fa-8450-d967f769a947 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0578f4-b30e-45b3-8cac-26620e7c3e96 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759 (non-flash)\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:43:56 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-23745249-14b8-4dc4-98ad-425185e4742d tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)
Nov 06 15:43:56 user nova-compute[75337]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e (non-flash)
Nov 06 15:43:56 user nova-compute[75337]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f5503fc-8cc8-46fa-8450-d967f769a947 (non-flash)
Nov 06 15:43:56 user nova-compute[75337]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0578f4-b30e-45b3-8cac-26620e7c3e96 (non-flash)
Nov 06 15:43:56 user nova-compute[75337]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759 (non-flash)
Nov 06 15:43:56 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 15:43:56 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-23745249-14b8-4dc4-98ad-425185e4742d tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)
Nov 06 15:43:56 user nova-compute[75337]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e (non-flash)
Nov 06 15:43:56 user nova-compute[75337]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f5503fc-8cc8-46fa-8450-d967f769a947 (non-flash)
Nov 06 15:43:56 user nova-compute[75337]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0578f4-b30e-45b3-8cac-26620e7c3e96 (non-flash)
Nov 06 15:43:56 user nova-compute[75337]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759 (non-flash)
Nov 06 15:43:56 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 15:43:56 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-23745249-14b8-4dc4-98ad-425185e4742d tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2a9c428ca0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759'): ({'sdb'}, set())}) {{(pid=75337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 15:43:56 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-23745249-14b8-4dc4-98ad-425185e4742d tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Removing single pathed devices sdb {{(pid=75337) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 15:43:56 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:43:56 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:43:57 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.052s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:43:57 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5c6e660-8033-4c0d-ad6f-14b762717c35]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:43:57 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:43:57 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.037s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:43:57 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f15469b-5517-4ed3-9e38-0fd6070684f4]: (4, ('ok\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:43:57 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-23745249-14b8-4dc4-98ad-425185e4742d tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Flushing IO for device /dev/sdb {{(pid=75337) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 15:43:57 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:43:57 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.026s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:43:57 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[14c5210d-33c1-42a6-a04f-1286547a9a8d]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:43:57 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-23745249-14b8-4dc4-98ad-425185e4742d tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75337) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 15:43:57 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:43:57 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.071s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:43:57 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6d3230b-340d-42a8-89bd-d264468139bf]: (4, ('1', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:43:57 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-23745249-14b8-4dc4-98ad-425185e4742d tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 15:43:57 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-23745249-14b8-4dc4-98ad-425185e4742d tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] SCSI volumes sdb have been removed. {{(pid=75337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 15:43:57 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-23745249-14b8-4dc4-98ad-425185e4742d tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759')] {{(pid=75337) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 15:43:57 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:43:57 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.059s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:43:57 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[608fe3d6-927d-4111-943e-c6b28770341d]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:43:57 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-23745249-14b8-4dc4-98ad-425185e4742d tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:43:57 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759 -p 172.16.0.220:3260 --logout {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:43:57 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759 -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:43:57 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[736ab058-fe00-400d-8b52-f8525009cb63]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:43:57 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-23745249-14b8-4dc4-98ad-425185e4742d tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759, portal: 172.16.0.220,3260]
Nov 06 15:43:57 user nova-compute[75337]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759, portal: 172.16.0.220,3260] successful.
Nov 06 15:43:57 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:43:57 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759 -p 172.16.0.220:3260 --op delete {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:43:57 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:466b6a4a-f809-4194-abc2-cb0148279759 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:43:57 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c13396b-ebc2-4576-bd01-48f589567df2]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:43:57 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-23745249-14b8-4dc4-98ad-425185e4742d tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:43:57 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-23745249-14b8-4dc4-98ad-425185e4742d tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.573s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 15:43:57 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-23745249-14b8-4dc4-98ad-425185e4742d tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] <== disconnect_volume: return (575ms) None {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 15:43:57 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-23745249-14b8-4dc4-98ad-425185e4742d tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] [instance: dfadb21f-5ed1-42f4-956b-95cccf128b6a] Disconnected iSCSI Volume {{(pid=75337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 15:43:57 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:43:58 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:43:59 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:43:59 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager.update_available_resource {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:43:59 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:43:59 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:43:59 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:43:59 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Auditing locally available compute resources for user (node: user) {{(pid=75337) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 15:43:59 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/581cf468-65e7-42e5-9250-c3d645577011/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:44:00 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/581cf468-65e7-42e5-9250-c3d645577011/disk --force-share --output=json" returned: 0 in 0.304s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:44:00 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/581cf468-65e7-42e5-9250-c3d645577011/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:44:00 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/581cf468-65e7-42e5-9250-c3d645577011/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:44:00 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 15:44:00 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8cf1ead-a87c-459c-b914-a0e976c9e464/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:44:00 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8cf1ead-a87c-459c-b914-a0e976c9e464/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:44:00 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8cf1ead-a87c-459c-b914-a0e976c9e464/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:44:00 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8cf1ead-a87c-459c-b914-a0e976c9e464/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:44:00 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 15:44:00 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8cf1ead-a87c-459c-b914-a0e976c9e464/disk.rescue --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:44:01 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8cf1ead-a87c-459c-b914-a0e976c9e464/disk.rescue --force-share --output=json" returned: 0 in 0.291s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:44:01 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8cf1ead-a87c-459c-b914-a0e976c9e464/disk.rescue --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:44:01 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8cf1ead-a87c-459c-b914-a0e976c9e464/disk.rescue --force-share --output=json" returned: 0 in 0.408s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:44:01 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a600bd8-b94a-4242-a443-c2defb002280/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:44:01 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a600bd8-b94a-4242-a443-c2defb002280/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:44:01 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a600bd8-b94a-4242-a443-c2defb002280/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:44:02 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a600bd8-b94a-4242-a443-c2defb002280/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:44:02 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] skipping disk /dev/sdf (vdc) as it is a volume {{(pid=75337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 15:44:02 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfadb21f-5ed1-42f4-956b-95cccf128b6a/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:44:02 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfadb21f-5ed1-42f4-956b-95cccf128b6a/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:44:02 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfadb21f-5ed1-42f4-956b-95cccf128b6a/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:44:02 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfadb21f-5ed1-42f4-956b-95cccf128b6a/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:44:02 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83516ff5-c4e7-4e91-a2f9-8af9b51cf475/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:44:02 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83516ff5-c4e7-4e91-a2f9-8af9b51cf475/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:44:02 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83516ff5-c4e7-4e91-a2f9-8af9b51cf475/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:44:03 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83516ff5-c4e7-4e91-a2f9-8af9b51cf475/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:44:03 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 15:44:03 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fa4c927-7485-4f34-94bd-9e20358904b6/disk.rescue --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:44:03 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fa4c927-7485-4f34-94bd-9e20358904b6/disk.rescue --force-share --output=json" returned: 0 in 0.211s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:44:03 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fa4c927-7485-4f34-94bd-9e20358904b6/disk.rescue --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:44:03 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fa4c927-7485-4f34-94bd-9e20358904b6/disk.rescue --force-share --output=json" returned: 0 in 0.212s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:44:04 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 15:44:04 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 15:44:04 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Hypervisor/Node resource view: name=user free_ram=8175MB free_disk=25.226154327392578GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75337) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 15:44:04 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:44:04 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:44:04 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Applying migration context for instance 581cf468-65e7-42e5-9250-c3d645577011 as it has an incoming, in-progress migration bc81b8ec-ec83-4c9d-aa18-aa0e339c5fec. Migration status is finished {{(pid=75337) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 06 15:44:04 user nova-compute[75337]: INFO nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] [instance: 581cf468-65e7-42e5-9250-c3d645577011] Updating resource usage from migration bc81b8ec-ec83-4c9d-aa18-aa0e339c5fec
Nov 06 15:44:04 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:44:04 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 83516ff5-c4e7-4e91-a2f9-8af9b51cf475 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:44:04 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance c8cf1ead-a87c-459c-b914-a0e976c9e464 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:44:04 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance dfadb21f-5ed1-42f4-956b-95cccf128b6a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:44:04 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 1fa4c927-7485-4f34-94bd-9e20358904b6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:44:04 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 8a600bd8-b94a-4242-a443-c2defb002280 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:44:04 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Migration bc81b8ec-ec83-4c9d-aa18-aa0e339c5fec is active on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 06 15:44:04 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 581cf468-65e7-42e5-9250-c3d645577011 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:44:04 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 15:44:04 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=25GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 15:44:04 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Refreshing inventories for resource provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 06 15:44:04 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Updating ProviderTree inventory for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 06 15:44:04 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Updating inventory in ProviderTree for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 06 15:44:04 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Refreshing aggregate associations for resource provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7, aggregates: None {{(pid=75337) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 06 15:44:04 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Refreshing trait associations for resource provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7, traits: COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NODE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_IDE,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSSE3,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_USB {{(pid=75337) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 06 15:44:04 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 15:44:04 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 15:44:04 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Compute_service record updated for user:user {{(pid=75337) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 15:44:04 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.805s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:44:04 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:44:04 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Cleaning up deleted instances with incomplete migration  {{(pid=75337) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 06 15:44:05 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:44:06 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:44:08 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:44:09 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:44:09 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:44:09 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:44:13 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:44:13 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:44:14 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:44:14 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:44:15 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:44:17 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:44:17 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:44:18 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:44:19 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:44:19 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-2cacf475-9335-400a-8796-56c8795c34b5 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Acquiring lock "cdced0ba-84ff-42af-baab-e2f3412e1676" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:44:19 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-2cacf475-9335-400a-8796-56c8795c34b5 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Lock "cdced0ba-84ff-42af-baab-e2f3412e1676" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:44:19 user nova-compute[75337]: DEBUG nova.compute.manager [None req-2cacf475-9335-400a-8796-56c8795c34b5 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] [instance: cdced0ba-84ff-42af-baab-e2f3412e1676] Starting instance... {{(pid=75337) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 15:44:19 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-2cacf475-9335-400a-8796-56c8795c34b5 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:44:19 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-2cacf475-9335-400a-8796-56c8795c34b5 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:44:19 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-2cacf475-9335-400a-8796-56c8795c34b5 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75337) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 15:44:19 user nova-compute[75337]: INFO nova.compute.claims [None req-2cacf475-9335-400a-8796-56c8795c34b5 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] [instance: cdced0ba-84ff-42af-baab-e2f3412e1676] Claim successful on node user
Nov 06 15:44:20 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-2cacf475-9335-400a-8796-56c8795c34b5 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 15:44:20 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-2cacf475-9335-400a-8796-56c8795c34b5 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 15:44:20 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-2cacf475-9335-400a-8796-56c8795c34b5 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.447s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:44:20 user nova-compute[75337]: DEBUG nova.compute.manager [None req-2cacf475-9335-400a-8796-56c8795c34b5 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] [instance: cdced0ba-84ff-42af-baab-e2f3412e1676] Start building networks asynchronously for instance. {{(pid=75337) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 15:44:20 user nova-compute[75337]: DEBUG nova.compute.manager [None req-2cacf475-9335-400a-8796-56c8795c34b5 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] [instance: cdced0ba-84ff-42af-baab-e2f3412e1676] Allocating IP information in the background. {{(pid=75337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 15:44:20 user nova-compute[75337]: DEBUG nova.network.neutron [None req-2cacf475-9335-400a-8796-56c8795c34b5 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] [instance: cdced0ba-84ff-42af-baab-e2f3412e1676] allocate_for_instance() {{(pid=75337) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 15:44:20 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-2cacf475-9335-400a-8796-56c8795c34b5 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] [instance: cdced0ba-84ff-42af-baab-e2f3412e1676] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 15:44:20 user nova-compute[75337]: DEBUG nova.compute.manager [None req-2cacf475-9335-400a-8796-56c8795c34b5 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] [instance: cdced0ba-84ff-42af-baab-e2f3412e1676] Start building block device mappings for instance. {{(pid=75337) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 15:44:20 user nova-compute[75337]: DEBUG nova.policy [None req-2cacf475-9335-400a-8796-56c8795c34b5 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '38d79821f1a8466fa7c925fcc0bfb778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2de62cc51864374a29a5d96584e8dd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75337) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 15:44:20 user nova-compute[75337]: DEBUG nova.compute.manager [None req-2cacf475-9335-400a-8796-56c8795c34b5 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] [instance: cdced0ba-84ff-42af-baab-e2f3412e1676] Start spawning the instance on the hypervisor. {{(pid=75337) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 15:44:20 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-2cacf475-9335-400a-8796-56c8795c34b5 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] [instance: cdced0ba-84ff-42af-baab-e2f3412e1676] Creating instance directory {{(pid=75337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 15:44:20 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-2cacf475-9335-400a-8796-56c8795c34b5 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] [instance: cdced0ba-84ff-42af-baab-e2f3412e1676] Creating image(s)
Nov 06 15:44:20 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-2cacf475-9335-400a-8796-56c8795c34b5 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Acquiring lock "/opt/stack/data/nova/instances/cdced0ba-84ff-42af-baab-e2f3412e1676/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:44:20 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-2cacf475-9335-400a-8796-56c8795c34b5 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Lock "/opt/stack/data/nova/instances/cdced0ba-84ff-42af-baab-e2f3412e1676/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:44:20 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-2cacf475-9335-400a-8796-56c8795c34b5 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Lock "/opt/stack/data/nova/instances/cdced0ba-84ff-42af-baab-e2f3412e1676/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:44:20 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-2cacf475-9335-400a-8796-56c8795c34b5 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:44:20 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-2cacf475-9335-400a-8796-56c8795c34b5 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json" returned: 0 in 0.275s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:44:20 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-2cacf475-9335-400a-8796-56c8795c34b5 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Acquiring lock "06ba3c914798499e686c5ac75886932347225275" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:44:20 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-2cacf475-9335-400a-8796-56c8795c34b5 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Lock "06ba3c914798499e686c5ac75886932347225275" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:44:20 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-2cacf475-9335-400a-8796-56c8795c34b5 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:44:20 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-2cacf475-9335-400a-8796-56c8795c34b5 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json" returned: 0 in 0.203s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:44:20 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-2cacf475-9335-400a-8796-56c8795c34b5 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275,backing_fmt=raw /opt/stack/data/nova/instances/cdced0ba-84ff-42af-baab-e2f3412e1676/disk 1073741824 {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:44:20 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-2cacf475-9335-400a-8796-56c8795c34b5 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275,backing_fmt=raw /opt/stack/data/nova/instances/cdced0ba-84ff-42af-baab-e2f3412e1676/disk 1073741824" returned: 0 in 0.062s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:44:20 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-2cacf475-9335-400a-8796-56c8795c34b5 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Lock "06ba3c914798499e686c5ac75886932347225275" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.280s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:44:20 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-2cacf475-9335-400a-8796-56c8795c34b5 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:44:21 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-2cacf475-9335-400a-8796-56c8795c34b5 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json" returned: 0 in 0.224s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:44:21 user nova-compute[75337]: DEBUG nova.virt.disk.api [None req-2cacf475-9335-400a-8796-56c8795c34b5 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cdced0ba-84ff-42af-baab-e2f3412e1676/disk. size=1073741824 {{(pid=75337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 15:44:21 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-2cacf475-9335-400a-8796-56c8795c34b5 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdced0ba-84ff-42af-baab-e2f3412e1676/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:44:21 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-2cacf475-9335-400a-8796-56c8795c34b5 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdced0ba-84ff-42af-baab-e2f3412e1676/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:44:21 user nova-compute[75337]: DEBUG nova.virt.disk.api [None req-2cacf475-9335-400a-8796-56c8795c34b5 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Cannot resize image /opt/stack/data/nova/instances/cdced0ba-84ff-42af-baab-e2f3412e1676/disk to a smaller size. {{(pid=75337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 06 15:44:21 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-2cacf475-9335-400a-8796-56c8795c34b5 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] [instance: cdced0ba-84ff-42af-baab-e2f3412e1676] Created local disks {{(pid=75337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 15:44:21 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-2cacf475-9335-400a-8796-56c8795c34b5 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] [instance: cdced0ba-84ff-42af-baab-e2f3412e1676] Ensure instance console log exists: /opt/stack/data/nova/instances/cdced0ba-84ff-42af-baab-e2f3412e1676/console.log {{(pid=75337) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 15:44:21 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-2cacf475-9335-400a-8796-56c8795c34b5 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:44:21 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-2cacf475-9335-400a-8796-56c8795c34b5 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.004s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:44:21 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-2cacf475-9335-400a-8796-56c8795c34b5 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:44:21 user nova-compute[75337]: DEBUG nova.network.neutron [None req-2cacf475-9335-400a-8796-56c8795c34b5 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] [instance: cdced0ba-84ff-42af-baab-e2f3412e1676] Successfully created port: 6439aebd-fede-4cad-857e-1c44587827ef {{(pid=75337) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 15:44:22 user nova-compute[75337]: DEBUG nova.network.neutron [None req-2cacf475-9335-400a-8796-56c8795c34b5 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] [instance: cdced0ba-84ff-42af-baab-e2f3412e1676] Successfully updated port: 6439aebd-fede-4cad-857e-1c44587827ef {{(pid=75337) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 15:44:22 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-2cacf475-9335-400a-8796-56c8795c34b5 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Acquiring lock "refresh_cache-cdced0ba-84ff-42af-baab-e2f3412e1676" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 15:44:22 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-2cacf475-9335-400a-8796-56c8795c34b5 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Acquired lock "refresh_cache-cdced0ba-84ff-42af-baab-e2f3412e1676" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 15:44:22 user nova-compute[75337]: DEBUG nova.network.neutron [None req-2cacf475-9335-400a-8796-56c8795c34b5 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] [instance: cdced0ba-84ff-42af-baab-e2f3412e1676] Building network info cache for instance {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 15:44:22 user nova-compute[75337]: DEBUG nova.compute.manager [req-e21fa4e4-a6c2-44fc-a634-7c5c83e3100b req-62822ab4-b46e-4083-9353-dab2d9083a06 service nova] [instance: cdced0ba-84ff-42af-baab-e2f3412e1676] Received event network-changed-6439aebd-fede-4cad-857e-1c44587827ef {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:44:22 user nova-compute[75337]: DEBUG nova.compute.manager [req-e21fa4e4-a6c2-44fc-a634-7c5c83e3100b req-62822ab4-b46e-4083-9353-dab2d9083a06 service nova] [instance: cdced0ba-84ff-42af-baab-e2f3412e1676] Refreshing instance network info cache due to event network-changed-6439aebd-fede-4cad-857e-1c44587827ef. {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 15:44:22 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-e21fa4e4-a6c2-44fc-a634-7c5c83e3100b req-62822ab4-b46e-4083-9353-dab2d9083a06 service nova] Acquiring lock "refresh_cache-cdced0ba-84ff-42af-baab-e2f3412e1676" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 15:44:22 user nova-compute[75337]: DEBUG nova.network.neutron [None req-2cacf475-9335-400a-8796-56c8795c34b5 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] [instance: cdced0ba-84ff-42af-baab-e2f3412e1676] Instance cache missing network info. {{(pid=75337) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 15:44:23 user nova-compute[75337]: DEBUG nova.network.neutron [None req-2cacf475-9335-400a-8796-56c8795c34b5 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] [instance: cdced0ba-84ff-42af-baab-e2f3412e1676] Updating instance_info_cache with network_info: [{"id": "6439aebd-fede-4cad-857e-1c44587827ef", "address": "fa:16:3e:cf:ac:79", "network": {"id": "c07dbf10-d5b5-40f4-b841-826ca6f505d8", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1886147547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2de62cc51864374a29a5d96584e8dd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6439aebd-fe", "ovs_interfaceid": "6439aebd-fede-4cad-857e-1c44587827ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:44:23 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-2cacf475-9335-400a-8796-56c8795c34b5 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Releasing lock "refresh_cache-cdced0ba-84ff-42af-baab-e2f3412e1676" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 15:44:23 user nova-compute[75337]: DEBUG nova.compute.manager [None req-2cacf475-9335-400a-8796-56c8795c34b5 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] [instance: cdced0ba-84ff-42af-baab-e2f3412e1676] Instance network_info: |[{"id": "6439aebd-fede-4cad-857e-1c44587827ef", "address": "fa:16:3e:cf:ac:79", "network": {"id": "c07dbf10-d5b5-40f4-b841-826ca6f505d8", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1886147547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2de62cc51864374a29a5d96584e8dd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6439aebd-fe", "ovs_interfaceid": "6439aebd-fede-4cad-857e-1c44587827ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 15:44:23 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-e21fa4e4-a6c2-44fc-a634-7c5c83e3100b req-62822ab4-b46e-4083-9353-dab2d9083a06 service nova] Acquired lock "refresh_cache-cdced0ba-84ff-42af-baab-e2f3412e1676" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 15:44:23 user nova-compute[75337]: DEBUG nova.network.neutron [req-e21fa4e4-a6c2-44fc-a634-7c5c83e3100b req-62822ab4-b46e-4083-9353-dab2d9083a06 service nova] [instance: cdced0ba-84ff-42af-baab-e2f3412e1676] Refreshing network info cache for port 6439aebd-fede-4cad-857e-1c44587827ef {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 15:44:23 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-2cacf475-9335-400a-8796-56c8795c34b5 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] [instance: cdced0ba-84ff-42af-baab-e2f3412e1676] Start _get_guest_xml network_info=[{"id": "6439aebd-fede-4cad-857e-1c44587827ef", "address": "fa:16:3e:cf:ac:79", "network": {"id": "c07dbf10-d5b5-40f4-b841-826ca6f505d8", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1886147547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2de62cc51864374a29a5d96584e8dd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6439aebd-fe", "ovs_interfaceid": "6439aebd-fede-4cad-857e-1c44587827ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T15:34:14Z,direct_url=<?>,disk_format='qcow2',id=16b903ae-a40f-41a7-985b-4804cce92c62,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6549a15819f1469bbd5eeae8190e3d44',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T15:34:15Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'guest_format': None, 'size': 0, 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '16b903ae-a40f-41a7-985b-4804cce92c62'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 15:44:23 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-2cacf475-9335-400a-8796-56c8795c34b5 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 15:44:23 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-2cacf475-9335-400a-8796-56c8795c34b5 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 15:44:23 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-2cacf475-9335-400a-8796-56c8795c34b5 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 15:44:23 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-2cacf475-9335-400a-8796-56c8795c34b5 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] CPU controller missing on host. {{(pid=75337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 15:44:23 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-2cacf475-9335-400a-8796-56c8795c34b5 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 15:44:23 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-2cacf475-9335-400a-8796-56c8795c34b5 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] CPU controller found on host. {{(pid=75337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 15:44:23 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-2cacf475-9335-400a-8796-56c8795c34b5 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75337) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 15:44:23 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-2cacf475-9335-400a-8796-56c8795c34b5 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T15:34:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T15:34:14Z,direct_url=<?>,disk_format='qcow2',id=16b903ae-a40f-41a7-985b-4804cce92c62,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6549a15819f1469bbd5eeae8190e3d44',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T15:34:15Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 15:44:23 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-2cacf475-9335-400a-8796-56c8795c34b5 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Flavor limits 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 15:44:23 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-2cacf475-9335-400a-8796-56c8795c34b5 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Image limits 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 15:44:23 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-2cacf475-9335-400a-8796-56c8795c34b5 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Flavor pref 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 15:44:23 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-2cacf475-9335-400a-8796-56c8795c34b5 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Image pref 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 15:44:23 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-2cacf475-9335-400a-8796-56c8795c34b5 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 15:44:23 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-2cacf475-9335-400a-8796-56c8795c34b5 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 15:44:23 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-2cacf475-9335-400a-8796-56c8795c34b5 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 15:44:23 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-2cacf475-9335-400a-8796-56c8795c34b5 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Got 1 possible topologies {{(pid=75337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 15:44:23 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-2cacf475-9335-400a-8796-56c8795c34b5 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 15:44:23 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-2cacf475-9335-400a-8796-56c8795c34b5 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 15:44:23 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-2cacf475-9335-400a-8796-56c8795c34b5 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T15:44:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1066788308',display_name='tempest-VolumesAdminNegativeTest-server-1066788308',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1066788308',id=13,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBDvvG1rHj+FOCmF08QnUesYCpiMZYDGXPXH349ApsTwWwh8LFnarOxbvyKb7CAA1JSmXU7OR9l9zSxwXCbNuJ82oNnDWulS1R+NOTAKmnuR4ldeBiBiQouy9eWYkTJp8w==',key_name='tempest-keypair-1863701025',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f2de62cc51864374a29a5d96584e8dd1',ramdisk_id='',reservation_id='r-15cwq3e9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1559219265',owner_user_name='tempest-VolumesAdminNegativeTest-1559219265-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T15:44:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='38d79821f1a8466fa7c925fcc0bfb778',uuid=cdced0ba-84ff-42af-baab-e2f3412e1676,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6439aebd-fede-4cad-857e-1c44587827ef", "address": "fa:16:3e:cf:ac:79", "network": {"id": "c07dbf10-d5b5-40f4-b841-826ca6f505d8", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1886147547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2de62cc51864374a29a5d96584e8dd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6439aebd-fe", "ovs_interfaceid": "6439aebd-fede-4cad-857e-1c44587827ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75337) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 15:44:23 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-2cacf475-9335-400a-8796-56c8795c34b5 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Converting VIF {"id": "6439aebd-fede-4cad-857e-1c44587827ef", "address": "fa:16:3e:cf:ac:79", "network": {"id": "c07dbf10-d5b5-40f4-b841-826ca6f505d8", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1886147547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2de62cc51864374a29a5d96584e8dd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6439aebd-fe", "ovs_interfaceid": "6439aebd-fede-4cad-857e-1c44587827ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 15:44:23 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-2cacf475-9335-400a-8796-56c8795c34b5 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:ac:79,bridge_name='br-int',has_traffic_filtering=True,id=6439aebd-fede-4cad-857e-1c44587827ef,network=Network(c07dbf10-d5b5-40f4-b841-826ca6f505d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6439aebd-fe') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 15:44:23 user nova-compute[75337]: DEBUG nova.objects.instance [None req-2cacf475-9335-400a-8796-56c8795c34b5 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Lazy-loading 'pci_devices' on Instance uuid cdced0ba-84ff-42af-baab-e2f3412e1676 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 15:44:23 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:44:23 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-2cacf475-9335-400a-8796-56c8795c34b5 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] [instance: cdced0ba-84ff-42af-baab-e2f3412e1676] End _get_guest_xml xml=<domain type="kvm">
Nov 06 15:44:23 user nova-compute[75337]:   <uuid>cdced0ba-84ff-42af-baab-e2f3412e1676</uuid>
Nov 06 15:44:23 user nova-compute[75337]:   <name>instance-0000000d</name>
Nov 06 15:44:23 user nova-compute[75337]:   <memory>524288</memory>
Nov 06 15:44:23 user nova-compute[75337]:   <vcpu>1</vcpu>
Nov 06 15:44:23 user nova-compute[75337]:   <metadata>
Nov 06 15:44:23 user nova-compute[75337]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 15:44:23 user nova-compute[75337]:       <nova:package version="0.0.0"/>
Nov 06 15:44:23 user nova-compute[75337]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1066788308</nova:name>
Nov 06 15:44:23 user nova-compute[75337]:       <nova:creationTime>2023-11-06 15:44:23</nova:creationTime>
Nov 06 15:44:23 user nova-compute[75337]:       <nova:flavor name="m1.tiny">
Nov 06 15:44:23 user nova-compute[75337]:         <nova:memory>512</nova:memory>
Nov 06 15:44:23 user nova-compute[75337]:         <nova:disk>1</nova:disk>
Nov 06 15:44:23 user nova-compute[75337]:         <nova:swap>0</nova:swap>
Nov 06 15:44:23 user nova-compute[75337]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 15:44:23 user nova-compute[75337]:         <nova:vcpus>1</nova:vcpus>
Nov 06 15:44:23 user nova-compute[75337]:       </nova:flavor>
Nov 06 15:44:23 user nova-compute[75337]:       <nova:owner>
Nov 06 15:44:23 user nova-compute[75337]:         <nova:user uuid="38d79821f1a8466fa7c925fcc0bfb778">tempest-VolumesAdminNegativeTest-1559219265-project-member</nova:user>
Nov 06 15:44:23 user nova-compute[75337]:         <nova:project uuid="f2de62cc51864374a29a5d96584e8dd1">tempest-VolumesAdminNegativeTest-1559219265</nova:project>
Nov 06 15:44:23 user nova-compute[75337]:       </nova:owner>
Nov 06 15:44:23 user nova-compute[75337]:       <nova:root type="image" uuid="16b903ae-a40f-41a7-985b-4804cce92c62"/>
Nov 06 15:44:23 user nova-compute[75337]:       <nova:ports>
Nov 06 15:44:23 user nova-compute[75337]:         <nova:port uuid="6439aebd-fede-4cad-857e-1c44587827ef">
Nov 06 15:44:23 user nova-compute[75337]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 06 15:44:23 user nova-compute[75337]:         </nova:port>
Nov 06 15:44:23 user nova-compute[75337]:       </nova:ports>
Nov 06 15:44:23 user nova-compute[75337]:     </nova:instance>
Nov 06 15:44:23 user nova-compute[75337]:   </metadata>
Nov 06 15:44:23 user nova-compute[75337]:   <sysinfo type="smbios">
Nov 06 15:44:23 user nova-compute[75337]:     <system>
Nov 06 15:44:23 user nova-compute[75337]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 15:44:23 user nova-compute[75337]:       <entry name="product">OpenStack Nova</entry>
Nov 06 15:44:23 user nova-compute[75337]:       <entry name="version">0.0.0</entry>
Nov 06 15:44:23 user nova-compute[75337]:       <entry name="serial">cdced0ba-84ff-42af-baab-e2f3412e1676</entry>
Nov 06 15:44:23 user nova-compute[75337]:       <entry name="uuid">cdced0ba-84ff-42af-baab-e2f3412e1676</entry>
Nov 06 15:44:23 user nova-compute[75337]:       <entry name="family">Virtual Machine</entry>
Nov 06 15:44:23 user nova-compute[75337]:     </system>
Nov 06 15:44:23 user nova-compute[75337]:   </sysinfo>
Nov 06 15:44:23 user nova-compute[75337]:   <os>
Nov 06 15:44:23 user nova-compute[75337]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 15:44:23 user nova-compute[75337]:     <boot dev="hd"/>
Nov 06 15:44:23 user nova-compute[75337]:     <smbios mode="sysinfo"/>
Nov 06 15:44:23 user nova-compute[75337]:   </os>
Nov 06 15:44:23 user nova-compute[75337]:   <features>
Nov 06 15:44:23 user nova-compute[75337]:     <acpi/>
Nov 06 15:44:23 user nova-compute[75337]:     <apic/>
Nov 06 15:44:23 user nova-compute[75337]:     <vmcoreinfo/>
Nov 06 15:44:23 user nova-compute[75337]:   </features>
Nov 06 15:44:23 user nova-compute[75337]:   <clock offset="utc">
Nov 06 15:44:23 user nova-compute[75337]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 15:44:23 user nova-compute[75337]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 15:44:23 user nova-compute[75337]:     <timer name="hpet" present="no"/>
Nov 06 15:44:23 user nova-compute[75337]:   </clock>
Nov 06 15:44:23 user nova-compute[75337]:   <cpu mode="custom" match="exact">
Nov 06 15:44:23 user nova-compute[75337]:     <model>Nehalem</model>
Nov 06 15:44:23 user nova-compute[75337]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 15:44:23 user nova-compute[75337]:   </cpu>
Nov 06 15:44:23 user nova-compute[75337]:   <devices>
Nov 06 15:44:23 user nova-compute[75337]:     <disk type="file" device="disk">
Nov 06 15:44:23 user nova-compute[75337]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 15:44:23 user nova-compute[75337]:       <source file="/opt/stack/data/nova/instances/cdced0ba-84ff-42af-baab-e2f3412e1676/disk"/>
Nov 06 15:44:23 user nova-compute[75337]:       <target dev="vda" bus="virtio"/>
Nov 06 15:44:23 user nova-compute[75337]:     </disk>
Nov 06 15:44:23 user nova-compute[75337]:     <interface type="ethernet">
Nov 06 15:44:23 user nova-compute[75337]:       <mac address="fa:16:3e:cf:ac:79"/>
Nov 06 15:44:23 user nova-compute[75337]:       <model type="virtio"/>
Nov 06 15:44:23 user nova-compute[75337]:       <mtu size="1442"/>
Nov 06 15:44:23 user nova-compute[75337]:       <target dev="tap6439aebd-fe"/>
Nov 06 15:44:23 user nova-compute[75337]:     </interface>
Nov 06 15:44:23 user nova-compute[75337]:     <serial type="pty">
Nov 06 15:44:23 user nova-compute[75337]:       <log file="/opt/stack/data/nova/instances/cdced0ba-84ff-42af-baab-e2f3412e1676/console.log" append="off"/>
Nov 06 15:44:23 user nova-compute[75337]:     </serial>
Nov 06 15:44:23 user nova-compute[75337]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 15:44:23 user nova-compute[75337]:     <video>
Nov 06 15:44:23 user nova-compute[75337]:       <model type="virtio"/>
Nov 06 15:44:23 user nova-compute[75337]:     </video>
Nov 06 15:44:23 user nova-compute[75337]:     <rng model="virtio">
Nov 06 15:44:23 user nova-compute[75337]:       <backend model="random">/dev/urandom</backend>
Nov 06 15:44:23 user nova-compute[75337]:     </rng>
Nov 06 15:44:23 user nova-compute[75337]:     <controller type="usb" index="0" model="none"/>
Nov 06 15:44:23 user nova-compute[75337]:     <memballoon model="virtio">
Nov 06 15:44:23 user nova-compute[75337]:       <stats period="10"/>
Nov 06 15:44:23 user nova-compute[75337]:     </memballoon>
Nov 06 15:44:23 user nova-compute[75337]:   </devices>
Nov 06 15:44:23 user nova-compute[75337]: </domain>
Nov 06 15:44:23 user nova-compute[75337]:  {{(pid=75337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 15:44:23 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-2cacf475-9335-400a-8796-56c8795c34b5 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T15:44:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1066788308',display_name='tempest-VolumesAdminNegativeTest-server-1066788308',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1066788308',id=13,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBDvvG1rHj+FOCmF08QnUesYCpiMZYDGXPXH349ApsTwWwh8LFnarOxbvyKb7CAA1JSmXU7OR9l9zSxwXCbNuJ82oNnDWulS1R+NOTAKmnuR4ldeBiBiQouy9eWYkTJp8w==',key_name='tempest-keypair-1863701025',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f2de62cc51864374a29a5d96584e8dd1',ramdisk_id='',reservation_id='r-15cwq3e9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1559219265',owner_user_name='tempest-VolumesAdminNegativeTest-1559219265-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T15:44:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='38d79821f1a8466fa7c925fcc0bfb778',uuid=cdced0ba-84ff-42af-baab-e2f3412e1676,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6439aebd-fede-4cad-857e-1c44587827ef", "address": "fa:16:3e:cf:ac:79", "network": {"id": "c07dbf10-d5b5-40f4-b841-826ca6f505d8", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1886147547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2de62cc51864374a29a5d96584e8dd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6439aebd-fe", "ovs_interfaceid": "6439aebd-fede-4cad-857e-1c44587827ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 15:44:23 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-2cacf475-9335-400a-8796-56c8795c34b5 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Converting VIF {"id": "6439aebd-fede-4cad-857e-1c44587827ef", "address": "fa:16:3e:cf:ac:79", "network": {"id": "c07dbf10-d5b5-40f4-b841-826ca6f505d8", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1886147547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2de62cc51864374a29a5d96584e8dd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6439aebd-fe", "ovs_interfaceid": "6439aebd-fede-4cad-857e-1c44587827ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 15:44:23 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-2cacf475-9335-400a-8796-56c8795c34b5 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:ac:79,bridge_name='br-int',has_traffic_filtering=True,id=6439aebd-fede-4cad-857e-1c44587827ef,network=Network(c07dbf10-d5b5-40f4-b841-826ca6f505d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6439aebd-fe') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 15:44:23 user nova-compute[75337]: DEBUG os_vif [None req-2cacf475-9335-400a-8796-56c8795c34b5 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:ac:79,bridge_name='br-int',has_traffic_filtering=True,id=6439aebd-fede-4cad-857e-1c44587827ef,network=Network(c07dbf10-d5b5-40f4-b841-826ca6f505d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6439aebd-fe') {{(pid=75337) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 15:44:23 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:44:23 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:44:23 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 15:44:23 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:44:23 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '68966095-a490-5434-9fd8-dfd13517f666', '_type': 'linux-noop'}}, row=False) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:44:23 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:44:23 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:44:23 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:44:23 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6439aebd-fe, may_exist=True, interface_attrs={}) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:44:23 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6439aebd-fe, col_values=(('qos', UUID('ff865a4e-faa4-4a94-990f-b8b352527c0b')),), if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:44:23 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6439aebd-fe, col_values=(('external_ids', {'iface-id': '6439aebd-fede-4cad-857e-1c44587827ef', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cf:ac:79', 'vm-uuid': 'cdced0ba-84ff-42af-baab-e2f3412e1676'}),), if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:44:23 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:44:23 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:44:23 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:44:23 user nova-compute[75337]: INFO os_vif [None req-2cacf475-9335-400a-8796-56c8795c34b5 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:ac:79,bridge_name='br-int',has_traffic_filtering=True,id=6439aebd-fede-4cad-857e-1c44587827ef,network=Network(c07dbf10-d5b5-40f4-b841-826ca6f505d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6439aebd-fe')
Nov 06 15:44:23 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-2cacf475-9335-400a-8796-56c8795c34b5 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] No BDM found with device name vda, not building metadata. {{(pid=75337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 15:44:23 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-2cacf475-9335-400a-8796-56c8795c34b5 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] No VIF found with MAC fa:16:3e:cf:ac:79, not building metadata {{(pid=75337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 15:44:23 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:44:24 user nova-compute[75337]: DEBUG nova.network.neutron [req-e21fa4e4-a6c2-44fc-a634-7c5c83e3100b req-62822ab4-b46e-4083-9353-dab2d9083a06 service nova] [instance: cdced0ba-84ff-42af-baab-e2f3412e1676] Updated VIF entry in instance network info cache for port 6439aebd-fede-4cad-857e-1c44587827ef. {{(pid=75337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 15:44:24 user nova-compute[75337]: DEBUG nova.network.neutron [req-e21fa4e4-a6c2-44fc-a634-7c5c83e3100b req-62822ab4-b46e-4083-9353-dab2d9083a06 service nova] [instance: cdced0ba-84ff-42af-baab-e2f3412e1676] Updating instance_info_cache with network_info: [{"id": "6439aebd-fede-4cad-857e-1c44587827ef", "address": "fa:16:3e:cf:ac:79", "network": {"id": "c07dbf10-d5b5-40f4-b841-826ca6f505d8", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1886147547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2de62cc51864374a29a5d96584e8dd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6439aebd-fe", "ovs_interfaceid": "6439aebd-fede-4cad-857e-1c44587827ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:44:24 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-e21fa4e4-a6c2-44fc-a634-7c5c83e3100b req-62822ab4-b46e-4083-9353-dab2d9083a06 service nova] Releasing lock "refresh_cache-cdced0ba-84ff-42af-baab-e2f3412e1676" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 15:44:24 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-acf7fc4c-691c-435a-9562-62e43f5b33cf tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] Acquiring lock "7a6b16de-4506-432f-97f9-f083243dc047" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:44:24 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-acf7fc4c-691c-435a-9562-62e43f5b33cf tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] Lock "7a6b16de-4506-432f-97f9-f083243dc047" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:44:24 user nova-compute[75337]: DEBUG nova.compute.manager [None req-acf7fc4c-691c-435a-9562-62e43f5b33cf tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] [instance: 7a6b16de-4506-432f-97f9-f083243dc047] Starting instance... {{(pid=75337) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 15:44:24 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-acf7fc4c-691c-435a-9562-62e43f5b33cf tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:44:24 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-acf7fc4c-691c-435a-9562-62e43f5b33cf tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:44:24 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-acf7fc4c-691c-435a-9562-62e43f5b33cf tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75337) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 15:44:24 user nova-compute[75337]: INFO nova.compute.claims [None req-acf7fc4c-691c-435a-9562-62e43f5b33cf tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] [instance: 7a6b16de-4506-432f-97f9-f083243dc047] Claim successful on node user
Nov 06 15:44:25 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:44:25 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:44:25 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:44:25 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:44:25 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-acf7fc4c-691c-435a-9562-62e43f5b33cf tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 15:44:25 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-acf7fc4c-691c-435a-9562-62e43f5b33cf tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 15:44:25 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-acf7fc4c-691c-435a-9562-62e43f5b33cf tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.823s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:44:25 user nova-compute[75337]: DEBUG nova.compute.manager [None req-acf7fc4c-691c-435a-9562-62e43f5b33cf tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] [instance: 7a6b16de-4506-432f-97f9-f083243dc047] Start building networks asynchronously for instance. {{(pid=75337) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 15:44:25 user nova-compute[75337]: DEBUG nova.compute.manager [None req-acf7fc4c-691c-435a-9562-62e43f5b33cf tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] [instance: 7a6b16de-4506-432f-97f9-f083243dc047] Allocating IP information in the background. {{(pid=75337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 15:44:25 user nova-compute[75337]: DEBUG nova.network.neutron [None req-acf7fc4c-691c-435a-9562-62e43f5b33cf tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] [instance: 7a6b16de-4506-432f-97f9-f083243dc047] allocate_for_instance() {{(pid=75337) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 15:44:25 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-acf7fc4c-691c-435a-9562-62e43f5b33cf tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] [instance: 7a6b16de-4506-432f-97f9-f083243dc047] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 15:44:25 user nova-compute[75337]: DEBUG nova.compute.manager [None req-acf7fc4c-691c-435a-9562-62e43f5b33cf tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] [instance: 7a6b16de-4506-432f-97f9-f083243dc047] Start building block device mappings for instance. {{(pid=75337) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 15:44:26 user nova-compute[75337]: INFO nova.virt.block_device [None req-acf7fc4c-691c-435a-9562-62e43f5b33cf tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] [instance: 7a6b16de-4506-432f-97f9-f083243dc047] Booting with volume 15793a67-283e-461b-b16a-a42e1b3ea8e6 at /dev/vda
Nov 06 15:44:26 user nova-compute[75337]: DEBUG nova.policy [None req-acf7fc4c-691c-435a-9562-62e43f5b33cf tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '360ca2f8787a424e91dcc73d7c2b5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8fbcf3ad3c42a08501891748de8abc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75337) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 15:44:26 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:44:26 user nova-compute[75337]: DEBUG os_brick.utils [None req-acf7fc4c-691c-435a-9562-62e43f5b33cf tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 15:44:26 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:44:26 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:44:26 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:44:26 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.022s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:44:26 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[a45362a9-c8ef-4abf-893a-8b32cae9e221]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4ff6411e45b8\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:44:26 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:44:26 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.030s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:44:26 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[25d86cd0-f7f8-4e8f-9980-fbd5d38551e4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:44:26 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:44:26 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.027s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:44:26 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[250bf2d6-3b8f-4469-82cb-9521d5ca7ddd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:44:26 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ee681c7-2b56-43d9-a581-b74020b47deb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:44:26 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-acf7fc4c-691c-435a-9562-62e43f5b33cf tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] Running cmd (subprocess): nvme version {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:44:26 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-acf7fc4c-691c-435a-9562-62e43f5b33cf tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] 'nvme version' failed. Not Retrying. {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 15:44:26 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:44:26 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.nvmeof [None req-acf7fc4c-691c-435a-9562-62e43f5b33cf tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] nvme not present on system {{(pid=75337) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 15:44:26 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:44:26 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 15:44:26 user nova-compute[75337]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 15:44:26 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a39303d-b851-483b-8745-90633ecb7f54]: (4, '') {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:44:26 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.lightos [None req-acf7fc4c-691c-435a-9562-62e43f5b33cf tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75337) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 15:44:26 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.lightos [None req-acf7fc4c-691c-435a-9562-62e43f5b33cf tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 15:44:26 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.lightos [None req-acf7fc4c-691c-435a-9562-62e43f5b33cf tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] LIGHTOS: no hostnqn found. {{(pid=75337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 15:44:26 user nova-compute[75337]: DEBUG os_brick.utils [None req-acf7fc4c-691c-435a-9562-62e43f5b33cf tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] <== get_connector_properties: return (189ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4ff6411e45b8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 15:44:26 user nova-compute[75337]: DEBUG nova.virt.block_device [None req-acf7fc4c-691c-435a-9562-62e43f5b33cf tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] [instance: 7a6b16de-4506-432f-97f9-f083243dc047] Updating existing volume attachment record: 732a7d94-60f8-4b35-ba6b-8e7c89612ebe {{(pid=75337) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 15:44:26 user nova-compute[75337]: DEBUG nova.compute.manager [req-b7a95b5a-03d6-463d-b507-967b6b93a268 req-830148ea-a74e-4ffa-be70-cfcf2398c67b service nova] [instance: cdced0ba-84ff-42af-baab-e2f3412e1676] Received event network-vif-plugged-6439aebd-fede-4cad-857e-1c44587827ef {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:44:26 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-b7a95b5a-03d6-463d-b507-967b6b93a268 req-830148ea-a74e-4ffa-be70-cfcf2398c67b service nova] Acquiring lock "cdced0ba-84ff-42af-baab-e2f3412e1676-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:44:26 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-b7a95b5a-03d6-463d-b507-967b6b93a268 req-830148ea-a74e-4ffa-be70-cfcf2398c67b service nova] Lock "cdced0ba-84ff-42af-baab-e2f3412e1676-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:44:26 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-b7a95b5a-03d6-463d-b507-967b6b93a268 req-830148ea-a74e-4ffa-be70-cfcf2398c67b service nova] Lock "cdced0ba-84ff-42af-baab-e2f3412e1676-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:44:26 user nova-compute[75337]: DEBUG nova.compute.manager [req-b7a95b5a-03d6-463d-b507-967b6b93a268 req-830148ea-a74e-4ffa-be70-cfcf2398c67b service nova] [instance: cdced0ba-84ff-42af-baab-e2f3412e1676] No waiting events found dispatching network-vif-plugged-6439aebd-fede-4cad-857e-1c44587827ef {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:44:26 user nova-compute[75337]: WARNING nova.compute.manager [req-b7a95b5a-03d6-463d-b507-967b6b93a268 req-830148ea-a74e-4ffa-be70-cfcf2398c67b service nova] [instance: cdced0ba-84ff-42af-baab-e2f3412e1676] Received unexpected event network-vif-plugged-6439aebd-fede-4cad-857e-1c44587827ef for instance with vm_state building and task_state spawning.
Nov 06 15:44:27 user nova-compute[75337]: DEBUG nova.network.neutron [None req-acf7fc4c-691c-435a-9562-62e43f5b33cf tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] [instance: 7a6b16de-4506-432f-97f9-f083243dc047] Successfully created port: 4e4e1bfc-ebf9-41eb-81be-d1c34001dcff {{(pid=75337) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 15:44:27 user nova-compute[75337]: DEBUG nova.compute.manager [None req-2cacf475-9335-400a-8796-56c8795c34b5 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] [instance: cdced0ba-84ff-42af-baab-e2f3412e1676] Instance event wait completed in 0 seconds for  {{(pid=75337) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 15:44:27 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-2cacf475-9335-400a-8796-56c8795c34b5 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] [instance: cdced0ba-84ff-42af-baab-e2f3412e1676] Guest created on hypervisor {{(pid=75337) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 15:44:27 user nova-compute[75337]: INFO nova.virt.libvirt.driver [-] [instance: cdced0ba-84ff-42af-baab-e2f3412e1676] Instance spawned successfully.
Nov 06 15:44:27 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-2cacf475-9335-400a-8796-56c8795c34b5 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] [instance: cdced0ba-84ff-42af-baab-e2f3412e1676] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 15:44:27 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-2cacf475-9335-400a-8796-56c8795c34b5 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] [instance: cdced0ba-84ff-42af-baab-e2f3412e1676] Found default for hw_cdrom_bus of ide {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:44:27 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-2cacf475-9335-400a-8796-56c8795c34b5 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] [instance: cdced0ba-84ff-42af-baab-e2f3412e1676] Found default for hw_disk_bus of virtio {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:44:27 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-2cacf475-9335-400a-8796-56c8795c34b5 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] [instance: cdced0ba-84ff-42af-baab-e2f3412e1676] Found default for hw_input_bus of None {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:44:27 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-2cacf475-9335-400a-8796-56c8795c34b5 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] [instance: cdced0ba-84ff-42af-baab-e2f3412e1676] Found default for hw_pointer_model of None {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:44:27 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-2cacf475-9335-400a-8796-56c8795c34b5 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] [instance: cdced0ba-84ff-42af-baab-e2f3412e1676] Found default for hw_video_model of virtio {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:44:27 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-2cacf475-9335-400a-8796-56c8795c34b5 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] [instance: cdced0ba-84ff-42af-baab-e2f3412e1676] Found default for hw_vif_model of virtio {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:44:28 user nova-compute[75337]: INFO nova.compute.manager [None req-2cacf475-9335-400a-8796-56c8795c34b5 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] [instance: cdced0ba-84ff-42af-baab-e2f3412e1676] Took 7.72 seconds to spawn the instance on the hypervisor.
Nov 06 15:44:28 user nova-compute[75337]: DEBUG nova.compute.manager [None req-2cacf475-9335-400a-8796-56c8795c34b5 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] [instance: cdced0ba-84ff-42af-baab-e2f3412e1676] Checking state {{(pid=75337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 15:44:28 user nova-compute[75337]: INFO nova.compute.manager [None req-2cacf475-9335-400a-8796-56c8795c34b5 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] [instance: cdced0ba-84ff-42af-baab-e2f3412e1676] Took 8.57 seconds to build instance.
Nov 06 15:44:28 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-2cacf475-9335-400a-8796-56c8795c34b5 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Lock "cdced0ba-84ff-42af-baab-e2f3412e1676" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.693s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:44:28 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:44:28 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:44:29 user nova-compute[75337]: DEBUG nova.compute.manager [req-f8840bed-458d-4035-a519-3237307dcfb9 req-2fbbe118-f060-4496-b033-8099fcf12667 service nova] [instance: cdced0ba-84ff-42af-baab-e2f3412e1676] Received event network-vif-plugged-6439aebd-fede-4cad-857e-1c44587827ef {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:44:29 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-f8840bed-458d-4035-a519-3237307dcfb9 req-2fbbe118-f060-4496-b033-8099fcf12667 service nova] Acquiring lock "cdced0ba-84ff-42af-baab-e2f3412e1676-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:44:29 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-f8840bed-458d-4035-a519-3237307dcfb9 req-2fbbe118-f060-4496-b033-8099fcf12667 service nova] Lock "cdced0ba-84ff-42af-baab-e2f3412e1676-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:44:29 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-f8840bed-458d-4035-a519-3237307dcfb9 req-2fbbe118-f060-4496-b033-8099fcf12667 service nova] Lock "cdced0ba-84ff-42af-baab-e2f3412e1676-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:44:29 user nova-compute[75337]: DEBUG nova.compute.manager [req-f8840bed-458d-4035-a519-3237307dcfb9 req-2fbbe118-f060-4496-b033-8099fcf12667 service nova] [instance: cdced0ba-84ff-42af-baab-e2f3412e1676] No waiting events found dispatching network-vif-plugged-6439aebd-fede-4cad-857e-1c44587827ef {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:44:29 user nova-compute[75337]: WARNING nova.compute.manager [req-f8840bed-458d-4035-a519-3237307dcfb9 req-2fbbe118-f060-4496-b033-8099fcf12667 service nova] [instance: cdced0ba-84ff-42af-baab-e2f3412e1676] Received unexpected event network-vif-plugged-6439aebd-fede-4cad-857e-1c44587827ef for instance with vm_state active and task_state None.
Nov 06 15:44:29 user nova-compute[75337]: DEBUG nova.network.neutron [None req-acf7fc4c-691c-435a-9562-62e43f5b33cf tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] [instance: 7a6b16de-4506-432f-97f9-f083243dc047] Successfully updated port: 4e4e1bfc-ebf9-41eb-81be-d1c34001dcff {{(pid=75337) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 15:44:29 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-acf7fc4c-691c-435a-9562-62e43f5b33cf tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] Acquiring lock "refresh_cache-7a6b16de-4506-432f-97f9-f083243dc047" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 15:44:29 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-acf7fc4c-691c-435a-9562-62e43f5b33cf tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] Acquired lock "refresh_cache-7a6b16de-4506-432f-97f9-f083243dc047" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 15:44:29 user nova-compute[75337]: DEBUG nova.network.neutron [None req-acf7fc4c-691c-435a-9562-62e43f5b33cf tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] [instance: 7a6b16de-4506-432f-97f9-f083243dc047] Building network info cache for instance {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 15:44:29 user nova-compute[75337]: DEBUG nova.compute.manager [req-d888b729-decb-4942-8dbd-823c3896fc18 req-cb294d34-52e8-47d6-adf7-5de448098876 service nova] [instance: 7a6b16de-4506-432f-97f9-f083243dc047] Received event network-changed-4e4e1bfc-ebf9-41eb-81be-d1c34001dcff {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:44:29 user nova-compute[75337]: DEBUG nova.compute.manager [req-d888b729-decb-4942-8dbd-823c3896fc18 req-cb294d34-52e8-47d6-adf7-5de448098876 service nova] [instance: 7a6b16de-4506-432f-97f9-f083243dc047] Refreshing instance network info cache due to event network-changed-4e4e1bfc-ebf9-41eb-81be-d1c34001dcff. {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 15:44:29 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-d888b729-decb-4942-8dbd-823c3896fc18 req-cb294d34-52e8-47d6-adf7-5de448098876 service nova] Acquiring lock "refresh_cache-7a6b16de-4506-432f-97f9-f083243dc047" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 15:44:29 user nova-compute[75337]: DEBUG nova.network.neutron [None req-acf7fc4c-691c-435a-9562-62e43f5b33cf tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] [instance: 7a6b16de-4506-432f-97f9-f083243dc047] Instance cache missing network info. {{(pid=75337) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 15:44:29 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:44:29 user nova-compute[75337]: DEBUG nova.network.neutron [None req-acf7fc4c-691c-435a-9562-62e43f5b33cf tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] [instance: 7a6b16de-4506-432f-97f9-f083243dc047] Updating instance_info_cache with network_info: [{"id": "4e4e1bfc-ebf9-41eb-81be-d1c34001dcff", "address": "fa:16:3e:d1:64:1b", "network": {"id": "ffb95242-a859-4479-a4c8-2b8fa68b53fc", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-976415891-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed8fbcf3ad3c42a08501891748de8abc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e4e1bfc-eb", "ovs_interfaceid": "4e4e1bfc-ebf9-41eb-81be-d1c34001dcff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:44:29 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-acf7fc4c-691c-435a-9562-62e43f5b33cf tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] Releasing lock "refresh_cache-7a6b16de-4506-432f-97f9-f083243dc047" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 15:44:29 user nova-compute[75337]: DEBUG nova.compute.manager [None req-acf7fc4c-691c-435a-9562-62e43f5b33cf tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] [instance: 7a6b16de-4506-432f-97f9-f083243dc047] Instance network_info: |[{"id": "4e4e1bfc-ebf9-41eb-81be-d1c34001dcff", "address": "fa:16:3e:d1:64:1b", "network": {"id": "ffb95242-a859-4479-a4c8-2b8fa68b53fc", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-976415891-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed8fbcf3ad3c42a08501891748de8abc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e4e1bfc-eb", "ovs_interfaceid": "4e4e1bfc-ebf9-41eb-81be-d1c34001dcff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 15:44:29 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-d888b729-decb-4942-8dbd-823c3896fc18 req-cb294d34-52e8-47d6-adf7-5de448098876 service nova] Acquired lock "refresh_cache-7a6b16de-4506-432f-97f9-f083243dc047" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 15:44:29 user nova-compute[75337]: DEBUG nova.network.neutron [req-d888b729-decb-4942-8dbd-823c3896fc18 req-cb294d34-52e8-47d6-adf7-5de448098876 service nova] [instance: 7a6b16de-4506-432f-97f9-f083243dc047] Refreshing network info cache for port 4e4e1bfc-ebf9-41eb-81be-d1c34001dcff {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 15:44:30 user nova-compute[75337]: DEBUG nova.network.neutron [req-d888b729-decb-4942-8dbd-823c3896fc18 req-cb294d34-52e8-47d6-adf7-5de448098876 service nova] [instance: 7a6b16de-4506-432f-97f9-f083243dc047] Updated VIF entry in instance network info cache for port 4e4e1bfc-ebf9-41eb-81be-d1c34001dcff. {{(pid=75337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 15:44:30 user nova-compute[75337]: DEBUG nova.network.neutron [req-d888b729-decb-4942-8dbd-823c3896fc18 req-cb294d34-52e8-47d6-adf7-5de448098876 service nova] [instance: 7a6b16de-4506-432f-97f9-f083243dc047] Updating instance_info_cache with network_info: [{"id": "4e4e1bfc-ebf9-41eb-81be-d1c34001dcff", "address": "fa:16:3e:d1:64:1b", "network": {"id": "ffb95242-a859-4479-a4c8-2b8fa68b53fc", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-976415891-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed8fbcf3ad3c42a08501891748de8abc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e4e1bfc-eb", "ovs_interfaceid": "4e4e1bfc-ebf9-41eb-81be-d1c34001dcff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:44:30 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-d888b729-decb-4942-8dbd-823c3896fc18 req-cb294d34-52e8-47d6-adf7-5de448098876 service nova] Releasing lock "refresh_cache-7a6b16de-4506-432f-97f9-f083243dc047" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 15:44:30 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:44:33 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:44:33 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:44:33 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:44:34 user nova-compute[75337]: DEBUG nova.objects.instance [None req-23745249-14b8-4dc4-98ad-425185e4742d tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Lazy-loading 'flavor' on Instance uuid dfadb21f-5ed1-42f4-956b-95cccf128b6a {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 15:44:34 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-23745249-14b8-4dc4-98ad-425185e4742d tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Lock "dfadb21f-5ed1-42f4-956b-95cccf128b6a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 58.871s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:44:35 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._sync_power_states {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:44:35 user nova-compute[75337]: WARNING nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] While synchronizing instance power states, found 8 instances in the database and 7 instances on the hypervisor.
Nov 06 15:44:35 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Triggering sync for uuid 83516ff5-c4e7-4e91-a2f9-8af9b51cf475 {{(pid=75337) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 06 15:44:35 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Triggering sync for uuid c8cf1ead-a87c-459c-b914-a0e976c9e464 {{(pid=75337) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 06 15:44:35 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Triggering sync for uuid 581cf468-65e7-42e5-9250-c3d645577011 {{(pid=75337) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 06 15:44:35 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Triggering sync for uuid dfadb21f-5ed1-42f4-956b-95cccf128b6a {{(pid=75337) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 06 15:44:35 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Triggering sync for uuid 1fa4c927-7485-4f34-94bd-9e20358904b6 {{(pid=75337) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 06 15:44:35 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Triggering sync for uuid cdced0ba-84ff-42af-baab-e2f3412e1676 {{(pid=75337) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 06 15:44:35 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Triggering sync for uuid 7a6b16de-4506-432f-97f9-f083243dc047 {{(pid=75337) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 06 15:44:35 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Triggering sync for uuid 8a600bd8-b94a-4242-a443-c2defb002280 {{(pid=75337) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 06 15:44:35 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "83516ff5-c4e7-4e91-a2f9-8af9b51cf475" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:44:35 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "83516ff5-c4e7-4e91-a2f9-8af9b51cf475" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:44:35 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "c8cf1ead-a87c-459c-b914-a0e976c9e464" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:44:35 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "c8cf1ead-a87c-459c-b914-a0e976c9e464" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:44:35 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "581cf468-65e7-42e5-9250-c3d645577011" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:44:35 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "581cf468-65e7-42e5-9250-c3d645577011" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:44:35 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "dfadb21f-5ed1-42f4-956b-95cccf128b6a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:44:35 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "dfadb21f-5ed1-42f4-956b-95cccf128b6a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:44:35 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "1fa4c927-7485-4f34-94bd-9e20358904b6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:44:35 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "1fa4c927-7485-4f34-94bd-9e20358904b6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:44:35 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "cdced0ba-84ff-42af-baab-e2f3412e1676" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:44:35 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "cdced0ba-84ff-42af-baab-e2f3412e1676" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:44:35 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "7a6b16de-4506-432f-97f9-f083243dc047" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:44:35 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "8a600bd8-b94a-4242-a443-c2defb002280" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:44:35 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "8a600bd8-b94a-4242-a443-c2defb002280" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:44:35 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "c8cf1ead-a87c-459c-b914-a0e976c9e464" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.077s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:44:35 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "1fa4c927-7485-4f34-94bd-9e20358904b6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.082s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:44:35 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "581cf468-65e7-42e5-9250-c3d645577011" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.086s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:44:35 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "cdced0ba-84ff-42af-baab-e2f3412e1676" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.090s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:44:35 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "83516ff5-c4e7-4e91-a2f9-8af9b51cf475" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.102s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:44:35 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "8a600bd8-b94a-4242-a443-c2defb002280" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.097s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:44:35 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "dfadb21f-5ed1-42f4-956b-95cccf128b6a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.105s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:44:36 user nova-compute[75337]: DEBUG nova.network.neutron [None req-e14dc784-33fa-4520-88be-b2c74b2145ef tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] [instance: 581cf468-65e7-42e5-9250-c3d645577011] Port d1c68bac-be37-4645-afcb-2b89f47c1793 binding to destination host user is already ACTIVE {{(pid=75337) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 06 15:44:36 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-e14dc784-33fa-4520-88be-b2c74b2145ef tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Acquiring lock "refresh_cache-581cf468-65e7-42e5-9250-c3d645577011" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 15:44:36 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-e14dc784-33fa-4520-88be-b2c74b2145ef tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Acquired lock "refresh_cache-581cf468-65e7-42e5-9250-c3d645577011" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 15:44:36 user nova-compute[75337]: DEBUG nova.network.neutron [None req-e14dc784-33fa-4520-88be-b2c74b2145ef tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] [instance: 581cf468-65e7-42e5-9250-c3d645577011] Building network info cache for instance {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 15:44:36 user nova-compute[75337]: DEBUG nova.network.neutron [None req-e14dc784-33fa-4520-88be-b2c74b2145ef tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] [instance: 581cf468-65e7-42e5-9250-c3d645577011] Updating instance_info_cache with network_info: [{"id": "d1c68bac-be37-4645-afcb-2b89f47c1793", "address": "fa:16:3e:00:1c:74", "network": {"id": "2623bcbf-c77c-47b4-abd5-ab538f9a2814", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1497688706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f40165c076e341bba42fb537ce98bbe2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1c68bac-be", "ovs_interfaceid": "d1c68bac-be37-4645-afcb-2b89f47c1793", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:44:36 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-e14dc784-33fa-4520-88be-b2c74b2145ef tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Releasing lock "refresh_cache-581cf468-65e7-42e5-9250-c3d645577011" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 15:44:36 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-e14dc784-33fa-4520-88be-b2c74b2145ef tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] [instance: 581cf468-65e7-42e5-9250-c3d645577011] Creating tmpfile /opt/stack/data/nova/instances/581cf468-65e7-42e5-9250-c3d645577011/tmpxy9og12b to verify with other compute node that the instance is on the same shared storage. {{(pid=75337) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9628}}
Nov 06 15:44:36 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:44:36 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:44:36 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:44:36 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:44:36 user nova-compute[75337]: DEBUG nova.compute.manager [req-d01d9935-835e-42d9-977d-ce13eb705a95 req-a79e9fe6-d768-4ccb-95a3-b1556ae94c28 service nova] [instance: 581cf468-65e7-42e5-9250-c3d645577011] Received event network-vif-unplugged-d1c68bac-be37-4645-afcb-2b89f47c1793 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:44:36 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-d01d9935-835e-42d9-977d-ce13eb705a95 req-a79e9fe6-d768-4ccb-95a3-b1556ae94c28 service nova] Acquiring lock "581cf468-65e7-42e5-9250-c3d645577011-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:44:36 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-d01d9935-835e-42d9-977d-ce13eb705a95 req-a79e9fe6-d768-4ccb-95a3-b1556ae94c28 service nova] Lock "581cf468-65e7-42e5-9250-c3d645577011-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:44:36 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-d01d9935-835e-42d9-977d-ce13eb705a95 req-a79e9fe6-d768-4ccb-95a3-b1556ae94c28 service nova] Lock "581cf468-65e7-42e5-9250-c3d645577011-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:44:36 user nova-compute[75337]: DEBUG nova.compute.manager [req-d01d9935-835e-42d9-977d-ce13eb705a95 req-a79e9fe6-d768-4ccb-95a3-b1556ae94c28 service nova] [instance: 581cf468-65e7-42e5-9250-c3d645577011] No waiting events found dispatching network-vif-unplugged-d1c68bac-be37-4645-afcb-2b89f47c1793 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:44:36 user nova-compute[75337]: WARNING nova.compute.manager [req-d01d9935-835e-42d9-977d-ce13eb705a95 req-a79e9fe6-d768-4ccb-95a3-b1556ae94c28 service nova] [instance: 581cf468-65e7-42e5-9250-c3d645577011] Received unexpected event network-vif-unplugged-d1c68bac-be37-4645-afcb-2b89f47c1793 for instance with vm_state resized and task_state resize_reverting.
Nov 06 15:44:37 user nova-compute[75337]: INFO nova.virt.libvirt.driver [-] [instance: 581cf468-65e7-42e5-9250-c3d645577011] Instance destroyed successfully.
Nov 06 15:44:37 user nova-compute[75337]: DEBUG nova.objects.instance [None req-e14dc784-33fa-4520-88be-b2c74b2145ef tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Lazy-loading 'resources' on Instance uuid 581cf468-65e7-42e5-9250-c3d645577011 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 15:44:37 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-e14dc784-33fa-4520-88be-b2c74b2145ef tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T15:37:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-143035342',display_name='tempest-ServerActionsTestOtherB-server-143035342',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-143035342',id=4,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGvgawdpwOKUFbYuIfCQHAYAwMkYeyGp/mWnvHMxoikCW6rq7Lc9iVzhCxfsvGYfdcuDE3wf7kwN77XNEdHIhKuYJC28UJSD4qJahdz/1x3pQWmM3jC4aksXmnaw21FVfw==',key_name='tempest-keypair-1619039595',keypairs=<?>,launch_index=0,launched_at=2023-11-06T15:43:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f40165c076e341bba42fb537ce98bbe2',ramdisk_id='',reservation_id='r-w3wq64j4',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-464439480',owner_user_name='tempest-ServerActionsTestOtherB-464439480-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T15:43:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2810a15c1608465aa7465eae455eb5c6',uuid=581cf468-65e7-42e5-9250-c3d645577011,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "d1c68bac-be37-4645-afcb-2b89f47c1793", "address": "fa:16:3e:00:1c:74", "network": {"id": "2623bcbf-c77c-47b4-abd5-ab538f9a2814", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1497688706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f40165c076e341bba42fb537ce98bbe2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1c68bac-be", "ovs_interfaceid": "d1c68bac-be37-4645-afcb-2b89f47c1793", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 15:44:37 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-e14dc784-33fa-4520-88be-b2c74b2145ef tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Converting VIF {"id": "d1c68bac-be37-4645-afcb-2b89f47c1793", "address": "fa:16:3e:00:1c:74", "network": {"id": "2623bcbf-c77c-47b4-abd5-ab538f9a2814", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1497688706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f40165c076e341bba42fb537ce98bbe2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1c68bac-be", "ovs_interfaceid": "d1c68bac-be37-4645-afcb-2b89f47c1793", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 15:44:37 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-e14dc784-33fa-4520-88be-b2c74b2145ef tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:00:1c:74,bridge_name='br-int',has_traffic_filtering=True,id=d1c68bac-be37-4645-afcb-2b89f47c1793,network=Network(2623bcbf-c77c-47b4-abd5-ab538f9a2814),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1c68bac-be') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 15:44:37 user nova-compute[75337]: DEBUG os_vif [None req-e14dc784-33fa-4520-88be-b2c74b2145ef tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:00:1c:74,bridge_name='br-int',has_traffic_filtering=True,id=d1c68bac-be37-4645-afcb-2b89f47c1793,network=Network(2623bcbf-c77c-47b4-abd5-ab538f9a2814),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1c68bac-be') {{(pid=75337) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 15:44:37 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:44:37 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd1c68bac-be, bridge=br-int, if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:44:37 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:44:37 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:44:37 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:44:37 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=054abe9b-decb-4f61-aac8-d24879f68a45) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:44:37 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:44:37 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:44:37 user nova-compute[75337]: INFO os_vif [None req-e14dc784-33fa-4520-88be-b2c74b2145ef tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:00:1c:74,bridge_name='br-int',has_traffic_filtering=True,id=d1c68bac-be37-4645-afcb-2b89f47c1793,network=Network(2623bcbf-c77c-47b4-abd5-ab538f9a2814),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1c68bac-be')
Nov 06 15:44:37 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e14dc784-33fa-4520-88be-b2c74b2145ef tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] [instance: 581cf468-65e7-42e5-9250-c3d645577011] calling os-brick to detach iSCSI Volume {{(pid=75337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 15:44:37 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e14dc784-33fa-4520-88be-b2c74b2145ef tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2abc33d0c0>, {'target_iqn': 'iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XMEQSsAU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 15:44:37 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-e14dc784-33fa-4520-88be-b2c74b2145ef tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 15:44:37 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-e14dc784-33fa-4520-88be-b2c74b2145ef tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 15:44:37 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-e14dc784-33fa-4520-88be-b2c74b2145ef tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 15:44:37 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:44:37 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:44:37 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc1820a3-430e-4d57-a363-dbb3d12e5e79]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6f5503fc-8cc8-46fa-8450-d967f769a947\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bc0578f4-b30e-45b3-8cac-26620e7c3e96\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:44:37 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e14dc784-33fa-4520-88be-b2c74b2145ef tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 15:44:37 user nova-compute[75337]: No targets found.
Nov 06 15:44:37 user nova-compute[75337]: iSNS:
Nov 06 15:44:37 user nova-compute[75337]: No targets found.
Nov 06 15:44:37 user nova-compute[75337]: STATIC:
Nov 06 15:44:37 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e
Nov 06 15:44:37 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 15:44:37 user nova-compute[75337]:                 Iface Name: default
Nov 06 15:44:37 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:6f5503fc-8cc8-46fa-8450-d967f769a947
Nov 06 15:44:37 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 15:44:37 user nova-compute[75337]:                 Iface Name: default
Nov 06 15:44:37 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158
Nov 06 15:44:37 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 15:44:37 user nova-compute[75337]:                 Iface Name: default
Nov 06 15:44:37 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:bc0578f4-b30e-45b3-8cac-26620e7c3e96
Nov 06 15:44:37 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 15:44:37 user nova-compute[75337]:                 Iface Name: default
Nov 06 15:44:37 user nova-compute[75337]: FIRMWARE:
Nov 06 15:44:37 user nova-compute[75337]: No targets found.
Nov 06 15:44:37 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 15:44:37 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e14dc784-33fa-4520-88be-b2c74b2145ef tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 15:44:37 user nova-compute[75337]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 15:44:37 user nova-compute[75337]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75337) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 15:44:37 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e14dc784-33fa-4520-88be-b2c74b2145ef tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e', 0)] {{(pid=75337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 15:44:37 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:44:37 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:44:37 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[2161b1ee-6755-4ab2-982e-191f1680c363]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6f5503fc-8cc8-46fa-8450-d967f769a947\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bc0578f4-b30e-45b3-8cac-26620e7c3e96\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:44:37 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:44:37 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:44:37 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ed5f381-7c6a-47a9-b307-c4ccc0cdefbe]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f5503fc-8cc8-46fa-8450-d967f769a947 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0578f4-b30e-45b3-8cac-26620e7c3e96 (non-flash)\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:44:37 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e14dc784-33fa-4520-88be-b2c74b2145ef tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)
Nov 06 15:44:37 user nova-compute[75337]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e (non-flash)
Nov 06 15:44:37 user nova-compute[75337]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f5503fc-8cc8-46fa-8450-d967f769a947 (non-flash)
Nov 06 15:44:37 user nova-compute[75337]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0578f4-b30e-45b3-8cac-26620e7c3e96 (non-flash)
Nov 06 15:44:37 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 15:44:37 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e14dc784-33fa-4520-88be-b2c74b2145ef tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)
Nov 06 15:44:37 user nova-compute[75337]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e (non-flash)
Nov 06 15:44:37 user nova-compute[75337]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f5503fc-8cc8-46fa-8450-d967f769a947 (non-flash)
Nov 06 15:44:37 user nova-compute[75337]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0578f4-b30e-45b3-8cac-26620e7c3e96 (non-flash)
Nov 06 15:44:37 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 15:44:37 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e14dc784-33fa-4520-88be-b2c74b2145ef tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2a9c5d7ac0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e'): ({'sde'}, set())}) {{(pid=75337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 15:44:37 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-e14dc784-33fa-4520-88be-b2c74b2145ef tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Removing single pathed devices sde {{(pid=75337) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 15:44:37 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:44:37 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:44:37 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[a83644ba-47cb-4b49-9ce1-87c48022cf67]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:44:37 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:44:37 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.024s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:44:37 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d420647-a374-4f3b-9849-33d0d778fb4f]: (4, ('ok\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:44:37 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-e14dc784-33fa-4520-88be-b2c74b2145ef tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Flushing IO for device /dev/sde {{(pid=75337) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 15:44:37 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:44:37 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:44:37 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[92a99b6c-9a5f-49fe-89ea-bf942939f774]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:44:37 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-e14dc784-33fa-4520-88be-b2c74b2145ef tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75337) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 15:44:37 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:44:37 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.037s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:44:37 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[7af263c9-f58f-40a6-8876-1ab6c8784ef7]: (4, ('1', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:44:37 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-e14dc784-33fa-4520-88be-b2c74b2145ef tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 15:44:37 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-e14dc784-33fa-4520-88be-b2c74b2145ef tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] SCSI volumes sde have been removed. {{(pid=75337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 15:44:37 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e14dc784-33fa-4520-88be-b2c74b2145ef tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e')] {{(pid=75337) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 15:44:37 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:44:37 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:44:37 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[81510d90-93be-4c72-85a0-abb935c2082f]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:44:37 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e14dc784-33fa-4520-88be-b2c74b2145ef tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:44:37 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e -p 172.16.0.220:3260 --logout {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:44:37 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:44:37 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[69a0799e-d4ac-42f7-83d5-b84653bf09cf]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:44:37 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e14dc784-33fa-4520-88be-b2c74b2145ef tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e, portal: 172.16.0.220,3260]
Nov 06 15:44:37 user nova-compute[75337]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e, portal: 172.16.0.220,3260] successful.
Nov 06 15:44:37 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:44:37 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e -p 172.16.0.220:3260 --op delete {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:44:37 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:44:37 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[f36ebf8e-6841-4755-99b2-b14569769cc8]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:44:37 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e14dc784-33fa-4520-88be-b2c74b2145ef tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:44:37 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-e14dc784-33fa-4520-88be-b2c74b2145ef tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.331s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 15:44:37 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e14dc784-33fa-4520-88be-b2c74b2145ef tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] <== disconnect_volume: return (332ms) None {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 15:44:37 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e14dc784-33fa-4520-88be-b2c74b2145ef tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] [instance: 581cf468-65e7-42e5-9250-c3d645577011] Disconnected iSCSI Volume {{(pid=75337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 15:44:38 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:44:38 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-e14dc784-33fa-4520-88be-b2c74b2145ef tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:44:38 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-e14dc784-33fa-4520-88be-b2c74b2145ef tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:44:38 user nova-compute[75337]: DEBUG nova.compute.manager [req-34f88ab0-0e44-43f7-bb14-08808aea936a req-7bff9664-ff26-4f42-85eb-1b376de5adf9 service nova] [instance: 581cf468-65e7-42e5-9250-c3d645577011] Received event network-vif-plugged-d1c68bac-be37-4645-afcb-2b89f47c1793 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:44:38 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-34f88ab0-0e44-43f7-bb14-08808aea936a req-7bff9664-ff26-4f42-85eb-1b376de5adf9 service nova] Acquiring lock "581cf468-65e7-42e5-9250-c3d645577011-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:44:38 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-34f88ab0-0e44-43f7-bb14-08808aea936a req-7bff9664-ff26-4f42-85eb-1b376de5adf9 service nova] Lock "581cf468-65e7-42e5-9250-c3d645577011-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:44:38 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-34f88ab0-0e44-43f7-bb14-08808aea936a req-7bff9664-ff26-4f42-85eb-1b376de5adf9 service nova] Lock "581cf468-65e7-42e5-9250-c3d645577011-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:44:38 user nova-compute[75337]: DEBUG nova.compute.manager [req-34f88ab0-0e44-43f7-bb14-08808aea936a req-7bff9664-ff26-4f42-85eb-1b376de5adf9 service nova] [instance: 581cf468-65e7-42e5-9250-c3d645577011] No waiting events found dispatching network-vif-plugged-d1c68bac-be37-4645-afcb-2b89f47c1793 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:44:38 user nova-compute[75337]: WARNING nova.compute.manager [req-34f88ab0-0e44-43f7-bb14-08808aea936a req-7bff9664-ff26-4f42-85eb-1b376de5adf9 service nova] [instance: 581cf468-65e7-42e5-9250-c3d645577011] Received unexpected event network-vif-plugged-d1c68bac-be37-4645-afcb-2b89f47c1793 for instance with vm_state resized and task_state resize_reverting.
Nov 06 15:44:38 user nova-compute[75337]: DEBUG nova.objects.instance [None req-e14dc784-33fa-4520-88be-b2c74b2145ef tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Lazy-loading 'migration_context' on Instance uuid 581cf468-65e7-42e5-9250-c3d645577011 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 15:44:38 user nova-compute[75337]: DEBUG nova.objects.base [None req-e14dc784-33fa-4520-88be-b2c74b2145ef tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Object Instance<581cf468-65e7-42e5-9250-c3d645577011> lazy-loaded attributes: resources,migration_context {{(pid=75337) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 15:44:39 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-e14dc784-33fa-4520-88be-b2c74b2145ef tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 15:44:39 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-e14dc784-33fa-4520-88be-b2c74b2145ef tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 15:44:39 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-e14dc784-33fa-4520-88be-b2c74b2145ef tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.513s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:44:39 user nova-compute[75337]: INFO nova.compute.manager [None req-e14dc784-33fa-4520-88be-b2c74b2145ef tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] [instance: 581cf468-65e7-42e5-9250-c3d645577011] Swapping old allocation on dict_keys(['4d91090a-92e5-4a8b-957b-2c8ad80bd8f7']) held by migration bc81b8ec-ec83-4c9d-aa18-aa0e339c5fec for instance
Nov 06 15:44:39 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-e14dc784-33fa-4520-88be-b2c74b2145ef tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Overwriting current allocation {'allocations': {'4d91090a-92e5-4a8b-957b-2c8ad80bd8f7': {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}, 'generation': 19}}, 'project_id': 'f40165c076e341bba42fb537ce98bbe2', 'user_id': '2810a15c1608465aa7465eae455eb5c6', 'consumer_generation': 1} on consumer 581cf468-65e7-42e5-9250-c3d645577011 {{(pid=75337) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Nov 06 15:44:39 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-e14dc784-33fa-4520-88be-b2c74b2145ef tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Acquiring lock "refresh_cache-581cf468-65e7-42e5-9250-c3d645577011" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 15:44:39 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-e14dc784-33fa-4520-88be-b2c74b2145ef tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Acquired lock "refresh_cache-581cf468-65e7-42e5-9250-c3d645577011" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 15:44:39 user nova-compute[75337]: DEBUG nova.network.neutron [None req-e14dc784-33fa-4520-88be-b2c74b2145ef tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] [instance: 581cf468-65e7-42e5-9250-c3d645577011] Building network info cache for instance {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 15:44:40 user nova-compute[75337]: DEBUG nova.network.neutron [None req-e14dc784-33fa-4520-88be-b2c74b2145ef tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] [instance: 581cf468-65e7-42e5-9250-c3d645577011] Updating instance_info_cache with network_info: [{"id": "d1c68bac-be37-4645-afcb-2b89f47c1793", "address": "fa:16:3e:00:1c:74", "network": {"id": "2623bcbf-c77c-47b4-abd5-ab538f9a2814", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1497688706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f40165c076e341bba42fb537ce98bbe2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1c68bac-be", "ovs_interfaceid": "d1c68bac-be37-4645-afcb-2b89f47c1793", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:44:40 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-e14dc784-33fa-4520-88be-b2c74b2145ef tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Releasing lock "refresh_cache-581cf468-65e7-42e5-9250-c3d645577011" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 15:44:40 user nova-compute[75337]: DEBUG os_brick.utils [None req-e14dc784-33fa-4520-88be-b2c74b2145ef tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 15:44:40 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:44:40 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:44:40 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[af553e34-9bfa-4182-92b3-36f275d19be5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4ff6411e45b8\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:44:40 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:44:40 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:44:40 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a340be6-7805-4596-b8cf-04be4c7cd38c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:44:40 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:44:40 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:44:40 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[55d2fcf9-ad5a-487a-aefc-c7cd0d126076]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:44:40 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[3694d483-9fb7-401d-ae2d-575567c77f7b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:44:40 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-e14dc784-33fa-4520-88be-b2c74b2145ef tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Running cmd (subprocess): nvme version {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:44:40 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-e14dc784-33fa-4520-88be-b2c74b2145ef tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] 'nvme version' failed. Not Retrying. {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 15:44:40 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e14dc784-33fa-4520-88be-b2c74b2145ef tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] nvme not present on system {{(pid=75337) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 15:44:40 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:44:40 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 15:44:40 user nova-compute[75337]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 15:44:40 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f015b15-9f8f-4576-9dd3-2269c51a3baa]: (4, '') {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:44:40 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.lightos [None req-e14dc784-33fa-4520-88be-b2c74b2145ef tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75337) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 15:44:40 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.lightos [None req-e14dc784-33fa-4520-88be-b2c74b2145ef tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 15:44:40 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.lightos [None req-e14dc784-33fa-4520-88be-b2c74b2145ef tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] LIGHTOS: no hostnqn found. {{(pid=75337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 15:44:40 user nova-compute[75337]: DEBUG os_brick.utils [None req-e14dc784-33fa-4520-88be-b2c74b2145ef tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] <== get_connector_properties: return (153ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4ff6411e45b8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 15:44:41 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:44:42 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:44:43 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:44:43 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:44:47 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:44:48 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:44:48 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:44:50 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-2611c1ed-c376-409f-aec3-28b5c19f604c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Acquiring lock "4015f2f7-a176-46aa-bdff-58d164058e15" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:44:50 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-2611c1ed-c376-409f-aec3-28b5c19f604c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Lock "4015f2f7-a176-46aa-bdff-58d164058e15" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:44:50 user nova-compute[75337]: DEBUG nova.compute.manager [None req-2611c1ed-c376-409f-aec3-28b5c19f604c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 4015f2f7-a176-46aa-bdff-58d164058e15] Starting instance... {{(pid=75337) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 15:44:51 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-2611c1ed-c376-409f-aec3-28b5c19f604c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:44:51 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-2611c1ed-c376-409f-aec3-28b5c19f604c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:44:51 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-2611c1ed-c376-409f-aec3-28b5c19f604c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75337) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 15:44:51 user nova-compute[75337]: INFO nova.compute.claims [None req-2611c1ed-c376-409f-aec3-28b5c19f604c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 4015f2f7-a176-46aa-bdff-58d164058e15] Claim successful on node user
Nov 06 15:44:51 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:44:51 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-2611c1ed-c376-409f-aec3-28b5c19f604c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 15:44:51 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-2611c1ed-c376-409f-aec3-28b5c19f604c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 15:44:51 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-2611c1ed-c376-409f-aec3-28b5c19f604c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.477s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:44:51 user nova-compute[75337]: DEBUG nova.compute.manager [None req-2611c1ed-c376-409f-aec3-28b5c19f604c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 4015f2f7-a176-46aa-bdff-58d164058e15] Start building networks asynchronously for instance. {{(pid=75337) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 15:44:51 user nova-compute[75337]: DEBUG nova.compute.manager [None req-2611c1ed-c376-409f-aec3-28b5c19f604c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 4015f2f7-a176-46aa-bdff-58d164058e15] Allocating IP information in the background. {{(pid=75337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 15:44:51 user nova-compute[75337]: DEBUG nova.network.neutron [None req-2611c1ed-c376-409f-aec3-28b5c19f604c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 4015f2f7-a176-46aa-bdff-58d164058e15] allocate_for_instance() {{(pid=75337) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 15:44:51 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-2611c1ed-c376-409f-aec3-28b5c19f604c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 4015f2f7-a176-46aa-bdff-58d164058e15] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 15:44:51 user nova-compute[75337]: DEBUG nova.compute.manager [None req-2611c1ed-c376-409f-aec3-28b5c19f604c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 4015f2f7-a176-46aa-bdff-58d164058e15] Start building block device mappings for instance. {{(pid=75337) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 15:44:51 user nova-compute[75337]: INFO nova.virt.block_device [None req-2611c1ed-c376-409f-aec3-28b5c19f604c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 4015f2f7-a176-46aa-bdff-58d164058e15] Booting with volume snapshot f46d20c8-ce77-4975-a117-3b1e35ec8990 at /dev/vda
Nov 06 15:44:51 user nova-compute[75337]: DEBUG nova.policy [None req-2611c1ed-c376-409f-aec3-28b5c19f604c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bb8d5f0200124588be1cfde107341a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915211c6a2734c36b34ff92a56b085f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75337) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 15:44:52 user nova-compute[75337]: DEBUG nova.network.neutron [None req-2611c1ed-c376-409f-aec3-28b5c19f604c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 4015f2f7-a176-46aa-bdff-58d164058e15] Successfully created port: 2ae7d4fb-8a67-4570-aa53-56cbaa82b78f {{(pid=75337) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 15:44:52 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:44:53 user nova-compute[75337]: DEBUG nova.network.neutron [None req-2611c1ed-c376-409f-aec3-28b5c19f604c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 4015f2f7-a176-46aa-bdff-58d164058e15] Successfully updated port: 2ae7d4fb-8a67-4570-aa53-56cbaa82b78f {{(pid=75337) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 15:44:53 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-2611c1ed-c376-409f-aec3-28b5c19f604c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Acquiring lock "refresh_cache-4015f2f7-a176-46aa-bdff-58d164058e15" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 15:44:53 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-2611c1ed-c376-409f-aec3-28b5c19f604c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Acquired lock "refresh_cache-4015f2f7-a176-46aa-bdff-58d164058e15" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 15:44:53 user nova-compute[75337]: DEBUG nova.network.neutron [None req-2611c1ed-c376-409f-aec3-28b5c19f604c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 4015f2f7-a176-46aa-bdff-58d164058e15] Building network info cache for instance {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 15:44:53 user nova-compute[75337]: DEBUG nova.compute.manager [req-716971a5-e8c8-4e8f-be64-041167d098fc req-203623e4-b984-4e59-8d8b-35c4a8ec8347 service nova] [instance: 4015f2f7-a176-46aa-bdff-58d164058e15] Received event network-changed-2ae7d4fb-8a67-4570-aa53-56cbaa82b78f {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:44:53 user nova-compute[75337]: DEBUG nova.compute.manager [req-716971a5-e8c8-4e8f-be64-041167d098fc req-203623e4-b984-4e59-8d8b-35c4a8ec8347 service nova] [instance: 4015f2f7-a176-46aa-bdff-58d164058e15] Refreshing instance network info cache due to event network-changed-2ae7d4fb-8a67-4570-aa53-56cbaa82b78f. {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 15:44:53 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-716971a5-e8c8-4e8f-be64-041167d098fc req-203623e4-b984-4e59-8d8b-35c4a8ec8347 service nova] Acquiring lock "refresh_cache-4015f2f7-a176-46aa-bdff-58d164058e15" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 15:44:53 user nova-compute[75337]: DEBUG nova.network.neutron [None req-2611c1ed-c376-409f-aec3-28b5c19f604c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 4015f2f7-a176-46aa-bdff-58d164058e15] Instance cache missing network info. {{(pid=75337) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 15:44:53 user nova-compute[75337]: DEBUG nova.network.neutron [None req-2611c1ed-c376-409f-aec3-28b5c19f604c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 4015f2f7-a176-46aa-bdff-58d164058e15] Updating instance_info_cache with network_info: [{"id": "2ae7d4fb-8a67-4570-aa53-56cbaa82b78f", "address": "fa:16:3e:ea:78:b5", "network": {"id": "4e47319f-de1d-4dfe-9915-7d2d5131704d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-895093240-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "915211c6a2734c36b34ff92a56b085f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ae7d4fb-8a", "ovs_interfaceid": "2ae7d4fb-8a67-4570-aa53-56cbaa82b78f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:44:53 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-2611c1ed-c376-409f-aec3-28b5c19f604c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Releasing lock "refresh_cache-4015f2f7-a176-46aa-bdff-58d164058e15" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 15:44:53 user nova-compute[75337]: DEBUG nova.compute.manager [None req-2611c1ed-c376-409f-aec3-28b5c19f604c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 4015f2f7-a176-46aa-bdff-58d164058e15] Instance network_info: |[{"id": "2ae7d4fb-8a67-4570-aa53-56cbaa82b78f", "address": "fa:16:3e:ea:78:b5", "network": {"id": "4e47319f-de1d-4dfe-9915-7d2d5131704d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-895093240-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "915211c6a2734c36b34ff92a56b085f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ae7d4fb-8a", "ovs_interfaceid": "2ae7d4fb-8a67-4570-aa53-56cbaa82b78f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 15:44:53 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-716971a5-e8c8-4e8f-be64-041167d098fc req-203623e4-b984-4e59-8d8b-35c4a8ec8347 service nova] Acquired lock "refresh_cache-4015f2f7-a176-46aa-bdff-58d164058e15" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 15:44:53 user nova-compute[75337]: DEBUG nova.network.neutron [req-716971a5-e8c8-4e8f-be64-041167d098fc req-203623e4-b984-4e59-8d8b-35c4a8ec8347 service nova] [instance: 4015f2f7-a176-46aa-bdff-58d164058e15] Refreshing network info cache for port 2ae7d4fb-8a67-4570-aa53-56cbaa82b78f {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 15:44:53 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:44:53 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:44:53 user nova-compute[75337]: DEBUG nova.network.neutron [req-716971a5-e8c8-4e8f-be64-041167d098fc req-203623e4-b984-4e59-8d8b-35c4a8ec8347 service nova] [instance: 4015f2f7-a176-46aa-bdff-58d164058e15] Updated VIF entry in instance network info cache for port 2ae7d4fb-8a67-4570-aa53-56cbaa82b78f. {{(pid=75337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 15:44:53 user nova-compute[75337]: DEBUG nova.network.neutron [req-716971a5-e8c8-4e8f-be64-041167d098fc req-203623e4-b984-4e59-8d8b-35c4a8ec8347 service nova] [instance: 4015f2f7-a176-46aa-bdff-58d164058e15] Updating instance_info_cache with network_info: [{"id": "2ae7d4fb-8a67-4570-aa53-56cbaa82b78f", "address": "fa:16:3e:ea:78:b5", "network": {"id": "4e47319f-de1d-4dfe-9915-7d2d5131704d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-895093240-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "915211c6a2734c36b34ff92a56b085f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ae7d4fb-8a", "ovs_interfaceid": "2ae7d4fb-8a67-4570-aa53-56cbaa82b78f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:44:53 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-716971a5-e8c8-4e8f-be64-041167d098fc req-203623e4-b984-4e59-8d8b-35c4a8ec8347 service nova] Releasing lock "refresh_cache-4015f2f7-a176-46aa-bdff-58d164058e15" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 15:44:55 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:44:55 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:44:56 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-31465917-4273-4134-aee2-67aad4d853c3 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Acquiring lock "8a600bd8-b94a-4242-a443-c2defb002280" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:44:56 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-31465917-4273-4134-aee2-67aad4d853c3 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Lock "8a600bd8-b94a-4242-a443-c2defb002280" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:44:56 user nova-compute[75337]: INFO nova.compute.manager [None req-31465917-4273-4134-aee2-67aad4d853c3 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] [instance: 8a600bd8-b94a-4242-a443-c2defb002280] Detaching volume bc0578f4-b30e-45b3-8cac-26620e7c3e96
Nov 06 15:44:56 user nova-compute[75337]: INFO nova.virt.block_device [None req-31465917-4273-4134-aee2-67aad4d853c3 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] [instance: 8a600bd8-b94a-4242-a443-c2defb002280] Attempting to driver detach volume bc0578f4-b30e-45b3-8cac-26620e7c3e96 from mountpoint /dev/vdc
Nov 06 15:44:56 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-31465917-4273-4134-aee2-67aad4d853c3 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Attempting to detach device vdc from instance 8a600bd8-b94a-4242-a443-c2defb002280 from the persistent domain config. {{(pid=75337) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 06 15:44:56 user nova-compute[75337]: DEBUG nova.virt.libvirt.guest [None req-31465917-4273-4134-aee2-67aad4d853c3 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 15:44:56 user nova-compute[75337]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 15:44:56 user nova-compute[75337]:   <source dev="/dev/sdf"/>
Nov 06 15:44:56 user nova-compute[75337]:   <target dev="vdc" bus="virtio"/>
Nov 06 15:44:56 user nova-compute[75337]:   <serial>bc0578f4-b30e-45b3-8cac-26620e7c3e96</serial>
Nov 06 15:44:56 user nova-compute[75337]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 06 15:44:56 user nova-compute[75337]: </disk>
Nov 06 15:44:56 user nova-compute[75337]:  {{(pid=75337) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 15:44:56 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-31465917-4273-4134-aee2-67aad4d853c3 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Successfully detached device vdc from instance 8a600bd8-b94a-4242-a443-c2defb002280 from the persistent domain config.
Nov 06 15:44:56 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-31465917-4273-4134-aee2-67aad4d853c3 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 8a600bd8-b94a-4242-a443-c2defb002280 from the live domain config. {{(pid=75337) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 06 15:44:56 user nova-compute[75337]: DEBUG nova.virt.libvirt.guest [None req-31465917-4273-4134-aee2-67aad4d853c3 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 15:44:56 user nova-compute[75337]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 15:44:56 user nova-compute[75337]:   <source dev="/dev/sdf"/>
Nov 06 15:44:56 user nova-compute[75337]:   <target dev="vdc" bus="virtio"/>
Nov 06 15:44:56 user nova-compute[75337]:   <serial>bc0578f4-b30e-45b3-8cac-26620e7c3e96</serial>
Nov 06 15:44:56 user nova-compute[75337]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 06 15:44:56 user nova-compute[75337]: </disk>
Nov 06 15:44:56 user nova-compute[75337]:  {{(pid=75337) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 15:44:56 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-31465917-4273-4134-aee2-67aad4d853c3 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 8a600bd8-b94a-4242-a443-c2defb002280 {{(pid=75337) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 06 15:44:57 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:44:57 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:44:57 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:44:57 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Starting heal instance info cache {{(pid=75337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 15:44:57 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Rebuilding the list of instances to heal {{(pid=75337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 06 15:44:57 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] [instance: 7a6b16de-4506-432f-97f9-f083243dc047] Skipping network cache update for instance because it is Building. {{(pid=75337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 06 15:44:57 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] [instance: 4015f2f7-a176-46aa-bdff-58d164058e15] Skipping network cache update for instance because it is Building. {{(pid=75337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 06 15:44:57 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "refresh_cache-83516ff5-c4e7-4e91-a2f9-8af9b51cf475" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 15:44:57 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquired lock "refresh_cache-83516ff5-c4e7-4e91-a2f9-8af9b51cf475" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 15:44:57 user nova-compute[75337]: DEBUG nova.network.neutron [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] [instance: 83516ff5-c4e7-4e91-a2f9-8af9b51cf475] Forcefully refreshing network info cache for instance {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 15:44:57 user nova-compute[75337]: DEBUG nova.objects.instance [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lazy-loading 'info_cache' on Instance uuid 83516ff5-c4e7-4e91-a2f9-8af9b51cf475 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 15:44:58 user nova-compute[75337]: DEBUG nova.network.neutron [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] [instance: 83516ff5-c4e7-4e91-a2f9-8af9b51cf475] Updating instance_info_cache with network_info: [{"id": "452cb189-f59e-42e1-80e1-9eebb0c65bd7", "address": "fa:16:3e:f6:56:c4", "network": {"id": "736be000-ee94-41fd-9de0-f2f885ec9be7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1715443852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb76b5b0f2b24f1c84a92403176bcc00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap452cb189-f5", "ovs_interfaceid": "452cb189-f59e-42e1-80e1-9eebb0c65bd7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:44:58 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Releasing lock "refresh_cache-83516ff5-c4e7-4e91-a2f9-8af9b51cf475" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 15:44:58 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] [instance: 83516ff5-c4e7-4e91-a2f9-8af9b51cf475] Updated the network info_cache for instance {{(pid=75337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 15:44:58 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:44:58 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:44:58 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75337) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 15:44:58 user nova-compute[75337]: DEBUG os_brick.utils [None req-2611c1ed-c376-409f-aec3-28b5c19f604c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 15:44:58 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:44:58 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:44:58 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[4be8d545-c511-41cd-9868-ab84900a2f2c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4ff6411e45b8\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:44:58 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:44:58 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:44:58 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[648a4def-d20a-4fba-abff-2395ee32a8c5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:44:58 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:44:58 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:44:58 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8a60784-ce2c-4cb7-8179-ba1cca82277e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:44:58 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[e039d8c0-e570-4b42-a4e3-b6484be412a7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:44:58 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-2611c1ed-c376-409f-aec3-28b5c19f604c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Running cmd (subprocess): nvme version {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:44:58 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-2611c1ed-c376-409f-aec3-28b5c19f604c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] 'nvme version' failed. Not Retrying. {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 15:44:58 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2611c1ed-c376-409f-aec3-28b5c19f604c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] nvme not present on system {{(pid=75337) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 15:44:58 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:44:58 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 15:44:58 user nova-compute[75337]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 15:44:58 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[5787a589-3834-4918-899f-11d9de5a8917]: (4, '') {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:44:58 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.lightos [None req-2611c1ed-c376-409f-aec3-28b5c19f604c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75337) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 15:44:58 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.lightos [None req-2611c1ed-c376-409f-aec3-28b5c19f604c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 15:44:58 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.lightos [None req-2611c1ed-c376-409f-aec3-28b5c19f604c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] LIGHTOS: no hostnqn found. {{(pid=75337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 15:44:58 user nova-compute[75337]: DEBUG os_brick.utils [None req-2611c1ed-c376-409f-aec3-28b5c19f604c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4ff6411e45b8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 15:44:58 user nova-compute[75337]: DEBUG nova.virt.block_device [None req-2611c1ed-c376-409f-aec3-28b5c19f604c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 4015f2f7-a176-46aa-bdff-58d164058e15] Updating existing volume attachment record: d6c10843-f997-4428-ad60-365b6b0d05a7 {{(pid=75337) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 15:44:58 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:44:58 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:44:59 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager.update_available_resource {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:44:59 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:44:59 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:44:59 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:44:59 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Auditing locally available compute resources for user (node: user) {{(pid=75337) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 15:44:59 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8cf1ead-a87c-459c-b914-a0e976c9e464/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:45:00 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8cf1ead-a87c-459c-b914-a0e976c9e464/disk --force-share --output=json" returned: 0 in 0.259s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:45:00 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8cf1ead-a87c-459c-b914-a0e976c9e464/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:45:00 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8cf1ead-a87c-459c-b914-a0e976c9e464/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:45:00 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 15:45:00 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8cf1ead-a87c-459c-b914-a0e976c9e464/disk.rescue --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:45:00 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8cf1ead-a87c-459c-b914-a0e976c9e464/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:45:00 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8cf1ead-a87c-459c-b914-a0e976c9e464/disk.rescue --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:45:00 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8cf1ead-a87c-459c-b914-a0e976c9e464/disk.rescue --force-share --output=json" returned: 0 in 0.198s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:45:00 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a600bd8-b94a-4242-a443-c2defb002280/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:45:00 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a600bd8-b94a-4242-a443-c2defb002280/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:45:00 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a600bd8-b94a-4242-a443-c2defb002280/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:45:00 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a600bd8-b94a-4242-a443-c2defb002280/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:45:01 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfadb21f-5ed1-42f4-956b-95cccf128b6a/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:45:01 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfadb21f-5ed1-42f4-956b-95cccf128b6a/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:45:01 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfadb21f-5ed1-42f4-956b-95cccf128b6a/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:45:01 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfadb21f-5ed1-42f4-956b-95cccf128b6a/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:45:01 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdced0ba-84ff-42af-baab-e2f3412e1676/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:45:01 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdced0ba-84ff-42af-baab-e2f3412e1676/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:45:01 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdced0ba-84ff-42af-baab-e2f3412e1676/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:45:01 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdced0ba-84ff-42af-baab-e2f3412e1676/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:45:01 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83516ff5-c4e7-4e91-a2f9-8af9b51cf475/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:45:02 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83516ff5-c4e7-4e91-a2f9-8af9b51cf475/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:45:02 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83516ff5-c4e7-4e91-a2f9-8af9b51cf475/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:45:02 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83516ff5-c4e7-4e91-a2f9-8af9b51cf475/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:45:02 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 15:45:02 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fa4c927-7485-4f34-94bd-9e20358904b6/disk.rescue --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:45:02 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fa4c927-7485-4f34-94bd-9e20358904b6/disk.rescue --force-share --output=json" returned: 0 in 0.247s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:45:02 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fa4c927-7485-4f34-94bd-9e20358904b6/disk.rescue --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:45:02 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:45:02 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fa4c927-7485-4f34-94bd-9e20358904b6/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:45:02 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 15:45:02 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 15:45:02 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Hypervisor/Node resource view: name=user free_ram=7856MB free_disk=25.170791625976562GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75337) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 15:45:02 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:45:02 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:45:03 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 83516ff5-c4e7-4e91-a2f9-8af9b51cf475 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:45:03 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance c8cf1ead-a87c-459c-b914-a0e976c9e464 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:45:03 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance dfadb21f-5ed1-42f4-956b-95cccf128b6a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:45:03 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 1fa4c927-7485-4f34-94bd-9e20358904b6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:45:03 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 8a600bd8-b94a-4242-a443-c2defb002280 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:45:03 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance cdced0ba-84ff-42af-baab-e2f3412e1676 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:45:03 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 7a6b16de-4506-432f-97f9-f083243dc047 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:45:03 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 581cf468-65e7-42e5-9250-c3d645577011 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:45:03 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 4015f2f7-a176-46aa-bdff-58d164058e15 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:45:03 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 15:45:03 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 15:45:03 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 15:45:03 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 15:45:03 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Compute_service record updated for user:user {{(pid=75337) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 15:45:03 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.470s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:45:05 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-e14dc784-33fa-4520-88be-b2c74b2145ef tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] [instance: 581cf468-65e7-42e5-9250-c3d645577011] Starting finish_revert_migration {{(pid=75337) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Nov 06 15:45:05 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-e14dc784-33fa-4520-88be-b2c74b2145ef tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] [instance: 581cf468-65e7-42e5-9250-c3d645577011] Start _get_guest_xml network_info=[{"id": "d1c68bac-be37-4645-afcb-2b89f47c1793", "address": "fa:16:3e:00:1c:74", "network": {"id": "2623bcbf-c77c-47b4-abd5-ab538f9a2814", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1497688706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f40165c076e341bba42fb537ce98bbe2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1c68bac-be", "ovs_interfaceid": "d1c68bac-be37-4645-afcb-2b89f47c1793", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=16b903ae-a40f-41a7-985b-4804cce92c62,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'guest_format': None, 'size': 0, 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '16b903ae-a40f-41a7-985b-4804cce92c62'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'attachment_id': '2f9879ba-5e60-447d-9806-24e2c8f00200', 'guest_format': None, 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XMEQSsAU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '581cf468-65e7-42e5-9250-c3d645577011', 'attached_at': '2023-11-06T15:45:05.000000', 'detached_at': '', 'volume_id': '84119968-a048-41d8-9688-39c01b5f860e', 'serial': '84119968-a048-41d8-9688-39c01b5f860e'}, 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=75337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 15:45:05 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-e14dc784-33fa-4520-88be-b2c74b2145ef tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 15:45:05 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-e14dc784-33fa-4520-88be-b2c74b2145ef tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 15:45:05 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-e14dc784-33fa-4520-88be-b2c74b2145ef tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 15:45:05 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-e14dc784-33fa-4520-88be-b2c74b2145ef tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] CPU controller missing on host. {{(pid=75337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 15:45:05 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-e14dc784-33fa-4520-88be-b2c74b2145ef tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 15:45:05 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-e14dc784-33fa-4520-88be-b2c74b2145ef tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] CPU controller found on host. {{(pid=75337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 15:45:05 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-e14dc784-33fa-4520-88be-b2c74b2145ef tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75337) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 15:45:05 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-e14dc784-33fa-4520-88be-b2c74b2145ef tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T15:34:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=16b903ae-a40f-41a7-985b-4804cce92c62,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 15:45:05 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-e14dc784-33fa-4520-88be-b2c74b2145ef tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Flavor limits 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 15:45:05 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-e14dc784-33fa-4520-88be-b2c74b2145ef tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Image limits 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 15:45:05 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-e14dc784-33fa-4520-88be-b2c74b2145ef tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Flavor pref 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 15:45:05 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-e14dc784-33fa-4520-88be-b2c74b2145ef tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Image pref 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 15:45:05 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-e14dc784-33fa-4520-88be-b2c74b2145ef tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 15:45:05 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-e14dc784-33fa-4520-88be-b2c74b2145ef tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 15:45:05 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-e14dc784-33fa-4520-88be-b2c74b2145ef tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 15:45:05 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-e14dc784-33fa-4520-88be-b2c74b2145ef tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Got 1 possible topologies {{(pid=75337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 15:45:05 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-e14dc784-33fa-4520-88be-b2c74b2145ef tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 15:45:05 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-e14dc784-33fa-4520-88be-b2c74b2145ef tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 15:45:05 user nova-compute[75337]: DEBUG nova.objects.instance [None req-e14dc784-33fa-4520-88be-b2c74b2145ef tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Lazy-loading 'vcpu_model' on Instance uuid 581cf468-65e7-42e5-9250-c3d645577011 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 15:45:05 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e14dc784-33fa-4520-88be-b2c74b2145ef tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] [instance: 581cf468-65e7-42e5-9250-c3d645577011] Calling os-brick to attach iSCSI Volume {{(pid=75337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 15:45:05 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e14dc784-33fa-4520-88be-b2c74b2145ef tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2abc33d0c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XMEQSsAU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 15:45:05 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-e14dc784-33fa-4520-88be-b2c74b2145ef tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 15:45:05 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-e14dc784-33fa-4520-88be-b2c74b2145ef tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 15:45:05 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-e14dc784-33fa-4520-88be-b2c74b2145ef tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 15:45:05 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-e14dc784-33fa-4520-88be-b2c74b2145ef tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 15:45:05 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-e14dc784-33fa-4520-88be-b2c74b2145ef tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 15:45:05 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-e14dc784-33fa-4520-88be-b2c74b2145ef tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 15:45:05 user nova-compute[75337]: INFO os_brick.initiator.connectors.iscsi [None req-e14dc784-33fa-4520-88be-b2c74b2145ef tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 15:45:05 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e -p 172.16.0.220:3260 {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:45:05 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:45:05 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[db9e57ab-47b2-43c1-bedb-968c32cef14e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:45:05 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e14dc784-33fa-4520-88be-b2c74b2145ef tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 15:45:05 user nova-compute[75337]:  {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:45:05 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e -p 172.16.0.220:3260 --interface default --op new {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:45:05 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:45:05 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[9420475b-3835-4aba-946b-019593cc8c4f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e] added\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:45:05 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e14dc784-33fa-4520-88be-b2c74b2145ef tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e] added
Nov 06 15:45:05 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:45:05 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:45:05 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:45:05 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec4b856e-0629-42c1-8cb7-7d061496e94e]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:45:05 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e14dc784-33fa-4520-88be-b2c74b2145ef tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:45:05 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:45:05 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:45:05 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[e65fd435-488d-4bfe-8d20-c3f6381c61d5]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:45:05 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e14dc784-33fa-4520-88be-b2c74b2145ef tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:45:05 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XMEQSsAU {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:45:05 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XMEQSsAU" returned: 0 in 0.019s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:45:05 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3170de8-cbba-439b-972a-894e2f5b95f7]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:45:05 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e14dc784-33fa-4520-88be-b2c74b2145ef tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XMEQSsAU'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:45:05 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:45:05 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:45:05 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[f759133e-e66d-441e-89f7-44ecb522dd71]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:45:05 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e14dc784-33fa-4520-88be-b2c74b2145ef tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:45:05 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:45:05 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:45:05 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6fbd39e-bf28-4473-b774-9a5212529584]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f5503fc-8cc8-46fa-8450-d967f769a947 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0578f4-b30e-45b3-8cac-26620e7c3e96 (non-flash)\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:45:05 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e14dc784-33fa-4520-88be-b2c74b2145ef tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)
Nov 06 15:45:05 user nova-compute[75337]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f5503fc-8cc8-46fa-8450-d967f769a947 (non-flash)
Nov 06 15:45:05 user nova-compute[75337]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0578f4-b30e-45b3-8cac-26620e7c3e96 (non-flash)
Nov 06 15:45:05 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 15:45:05 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e14dc784-33fa-4520-88be-b2c74b2145ef tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)
Nov 06 15:45:05 user nova-compute[75337]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f5503fc-8cc8-46fa-8450-d967f769a947 (non-flash)
Nov 06 15:45:05 user nova-compute[75337]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0578f4-b30e-45b3-8cac-26620e7c3e96 (non-flash)
Nov 06 15:45:05 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 15:45:05 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e -p 172.16.0.220:3260 --login {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:45:05 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:45:05 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d55682e-3822-4cb9-9a8f-0f9c1e3673fa]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:45:05 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e14dc784-33fa-4520-88be-b2c74b2145ef tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e, portal: 172.16.0.220,3260]
Nov 06 15:45:05 user nova-compute[75337]: Login to [iface: default, target: iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e, portal: 172.16.0.220,3260] successful.
Nov 06 15:45:05 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:45:05 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:45:05 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:45:05 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4092e35-581b-4fe7-b58a-37ffe482da35]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:45:05 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e14dc784-33fa-4520-88be-b2c74b2145ef tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:45:05 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:45:05 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:45:05 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aaffdf6-ccad-49ea-8555-b651aff54665]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f5503fc-8cc8-46fa-8450-d967f769a947 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0578f4-b30e-45b3-8cac-26620e7c3e96 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e (non-flash)\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:45:05 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e14dc784-33fa-4520-88be-b2c74b2145ef tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)
Nov 06 15:45:05 user nova-compute[75337]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f5503fc-8cc8-46fa-8450-d967f769a947 (non-flash)
Nov 06 15:45:05 user nova-compute[75337]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0578f4-b30e-45b3-8cac-26620e7c3e96 (non-flash)
Nov 06 15:45:05 user nova-compute[75337]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e (non-flash)
Nov 06 15:45:05 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 15:45:05 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e14dc784-33fa-4520-88be-b2c74b2145ef tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)
Nov 06 15:45:05 user nova-compute[75337]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f5503fc-8cc8-46fa-8450-d967f769a947 (non-flash)
Nov 06 15:45:05 user nova-compute[75337]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0578f4-b30e-45b3-8cac-26620e7c3e96 (non-flash)
Nov 06 15:45:05 user nova-compute[75337]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e (non-flash)
Nov 06 15:45:05 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 15:45:05 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-e14dc784-33fa-4520-88be-b2c74b2145ef tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.304s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 15:45:05 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e14dc784-33fa-4520-88be-b2c74b2145ef tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Connected to 172.16.0.220:3260 {{(pid=75337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 15:45:05 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-e14dc784-33fa-4520-88be-b2c74b2145ef tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] HCTL ('33', '-', '-', 0) found on session 15 with lun 0 {{(pid=75337) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 15:45:05 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-e14dc784-33fa-4520-88be-b2c74b2145ef tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75337) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 15:45:05 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:45:05 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:45:05 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[8859269c-8563-4ed7-a231-43749f8543df]: (4, ('- - 0', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:45:05 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-e14dc784-33fa-4520-88be-b2c74b2145ef tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Searching for a device in session 15 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75337) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 15:45:05 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e14dc784-33fa-4520-88be-b2c74b2145ef tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XMEQSsAU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 15:45:06 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-e14dc784-33fa-4520-88be-b2c74b2145ef tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.334s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 15:45:06 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e14dc784-33fa-4520-88be-b2c74b2145ef tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] <== connect_volume: return (1336ms) {'type': 'block', 'scsi_wwn': '23635626366623136', 'path': '/dev/sdb'} {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 15:45:06 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e14dc784-33fa-4520-88be-b2c74b2145ef tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] [instance: 581cf468-65e7-42e5-9250-c3d645577011] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23635626366623136', 'path': '/dev/sdb'} {{(pid=75337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 15:45:06 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-e14dc784-33fa-4520-88be-b2c74b2145ef tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T15:37:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-143035342',display_name='tempest-ServerActionsTestOtherB-server-143035342',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-143035342',id=4,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGvgawdpwOKUFbYuIfCQHAYAwMkYeyGp/mWnvHMxoikCW6rq7Lc9iVzhCxfsvGYfdcuDE3wf7kwN77XNEdHIhKuYJC28UJSD4qJahdz/1x3pQWmM3jC4aksXmnaw21FVfw==',key_name='tempest-keypair-1619039595',keypairs=<?>,launch_index=0,launched_at=2023-11-06T15:43:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f40165c076e341bba42fb537ce98bbe2',ramdisk_id='',reservation_id='r-w3wq64j4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-464439480',owner_user_name='tempest-ServerActionsTestOtherB-464439480-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T15:44:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2810a15c1608465aa7465eae455eb5c6',uuid=581cf468-65e7-42e5-9250-c3d645577011,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "d1c68bac-be37-4645-afcb-2b89f47c1793", "address": "fa:16:3e:00:1c:74", "network": {"id": "2623bcbf-c77c-47b4-abd5-ab538f9a2814", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1497688706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f40165c076e341bba42fb537ce98bbe2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1c68bac-be", "ovs_interfaceid": "d1c68bac-be37-4645-afcb-2b89f47c1793", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75337) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 15:45:06 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-e14dc784-33fa-4520-88be-b2c74b2145ef tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Converting VIF {"id": "d1c68bac-be37-4645-afcb-2b89f47c1793", "address": "fa:16:3e:00:1c:74", "network": {"id": "2623bcbf-c77c-47b4-abd5-ab538f9a2814", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1497688706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f40165c076e341bba42fb537ce98bbe2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1c68bac-be", "ovs_interfaceid": "d1c68bac-be37-4645-afcb-2b89f47c1793", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 15:45:06 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-e14dc784-33fa-4520-88be-b2c74b2145ef tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:1c:74,bridge_name='br-int',has_traffic_filtering=True,id=d1c68bac-be37-4645-afcb-2b89f47c1793,network=Network(2623bcbf-c77c-47b4-abd5-ab538f9a2814),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1c68bac-be') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 15:45:06 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-e14dc784-33fa-4520-88be-b2c74b2145ef tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] [instance: 581cf468-65e7-42e5-9250-c3d645577011] End _get_guest_xml xml=<domain type="kvm">
Nov 06 15:45:06 user nova-compute[75337]:   <uuid>581cf468-65e7-42e5-9250-c3d645577011</uuid>
Nov 06 15:45:06 user nova-compute[75337]:   <name>instance-00000004</name>
Nov 06 15:45:06 user nova-compute[75337]:   <memory>524288</memory>
Nov 06 15:45:06 user nova-compute[75337]:   <vcpu>1</vcpu>
Nov 06 15:45:06 user nova-compute[75337]:   <metadata>
Nov 06 15:45:06 user nova-compute[75337]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 15:45:06 user nova-compute[75337]:       <nova:package version="0.0.0"/>
Nov 06 15:45:06 user nova-compute[75337]:       <nova:name>tempest-ServerActionsTestOtherB-server-143035342</nova:name>
Nov 06 15:45:06 user nova-compute[75337]:       <nova:creationTime>2023-11-06 15:45:05</nova:creationTime>
Nov 06 15:45:06 user nova-compute[75337]:       <nova:flavor name="m1.tiny">
Nov 06 15:45:06 user nova-compute[75337]:         <nova:memory>512</nova:memory>
Nov 06 15:45:06 user nova-compute[75337]:         <nova:disk>1</nova:disk>
Nov 06 15:45:06 user nova-compute[75337]:         <nova:swap>0</nova:swap>
Nov 06 15:45:06 user nova-compute[75337]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 15:45:06 user nova-compute[75337]:         <nova:vcpus>1</nova:vcpus>
Nov 06 15:45:06 user nova-compute[75337]:       </nova:flavor>
Nov 06 15:45:06 user nova-compute[75337]:       <nova:owner>
Nov 06 15:45:06 user nova-compute[75337]:         <nova:user uuid="2810a15c1608465aa7465eae455eb5c6">tempest-ServerActionsTestOtherB-464439480-project-member</nova:user>
Nov 06 15:45:06 user nova-compute[75337]:         <nova:project uuid="f40165c076e341bba42fb537ce98bbe2">tempest-ServerActionsTestOtherB-464439480</nova:project>
Nov 06 15:45:06 user nova-compute[75337]:       </nova:owner>
Nov 06 15:45:06 user nova-compute[75337]:       <nova:root type="image" uuid="16b903ae-a40f-41a7-985b-4804cce92c62"/>
Nov 06 15:45:06 user nova-compute[75337]:       <nova:ports>
Nov 06 15:45:06 user nova-compute[75337]:         <nova:port uuid="d1c68bac-be37-4645-afcb-2b89f47c1793">
Nov 06 15:45:06 user nova-compute[75337]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 06 15:45:06 user nova-compute[75337]:         </nova:port>
Nov 06 15:45:06 user nova-compute[75337]:       </nova:ports>
Nov 06 15:45:06 user nova-compute[75337]:     </nova:instance>
Nov 06 15:45:06 user nova-compute[75337]:   </metadata>
Nov 06 15:45:06 user nova-compute[75337]:   <sysinfo type="smbios">
Nov 06 15:45:06 user nova-compute[75337]:     <system>
Nov 06 15:45:06 user nova-compute[75337]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 15:45:06 user nova-compute[75337]:       <entry name="product">OpenStack Nova</entry>
Nov 06 15:45:06 user nova-compute[75337]:       <entry name="version">0.0.0</entry>
Nov 06 15:45:06 user nova-compute[75337]:       <entry name="serial">581cf468-65e7-42e5-9250-c3d645577011</entry>
Nov 06 15:45:06 user nova-compute[75337]:       <entry name="uuid">581cf468-65e7-42e5-9250-c3d645577011</entry>
Nov 06 15:45:06 user nova-compute[75337]:       <entry name="family">Virtual Machine</entry>
Nov 06 15:45:06 user nova-compute[75337]:     </system>
Nov 06 15:45:06 user nova-compute[75337]:   </sysinfo>
Nov 06 15:45:06 user nova-compute[75337]:   <os>
Nov 06 15:45:06 user nova-compute[75337]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 15:45:06 user nova-compute[75337]:     <boot dev="hd"/>
Nov 06 15:45:06 user nova-compute[75337]:     <smbios mode="sysinfo"/>
Nov 06 15:45:06 user nova-compute[75337]:   </os>
Nov 06 15:45:06 user nova-compute[75337]:   <features>
Nov 06 15:45:06 user nova-compute[75337]:     <acpi/>
Nov 06 15:45:06 user nova-compute[75337]:     <apic/>
Nov 06 15:45:06 user nova-compute[75337]:     <vmcoreinfo/>
Nov 06 15:45:06 user nova-compute[75337]:   </features>
Nov 06 15:45:06 user nova-compute[75337]:   <clock offset="utc">
Nov 06 15:45:06 user nova-compute[75337]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 15:45:06 user nova-compute[75337]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 15:45:06 user nova-compute[75337]:     <timer name="hpet" present="no"/>
Nov 06 15:45:06 user nova-compute[75337]:   </clock>
Nov 06 15:45:06 user nova-compute[75337]:   <cpu mode="custom" match="exact">
Nov 06 15:45:06 user nova-compute[75337]:     <model>Nehalem</model>
Nov 06 15:45:06 user nova-compute[75337]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 15:45:06 user nova-compute[75337]:   </cpu>
Nov 06 15:45:06 user nova-compute[75337]:   <devices>
Nov 06 15:45:06 user nova-compute[75337]:     <disk type="file" device="disk">
Nov 06 15:45:06 user nova-compute[75337]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 15:45:06 user nova-compute[75337]:       <source file="/opt/stack/data/nova/instances/581cf468-65e7-42e5-9250-c3d645577011/disk"/>
Nov 06 15:45:06 user nova-compute[75337]:       <target dev="vda" bus="virtio"/>
Nov 06 15:45:06 user nova-compute[75337]:     </disk>
Nov 06 15:45:06 user nova-compute[75337]:     <disk type="block" device="disk">
Nov 06 15:45:06 user nova-compute[75337]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 15:45:06 user nova-compute[75337]:       <source dev="/dev/sdb"/>
Nov 06 15:45:06 user nova-compute[75337]:       <target dev="vdb" bus="virtio"/>
Nov 06 15:45:06 user nova-compute[75337]:       <serial>84119968-a048-41d8-9688-39c01b5f860e</serial>
Nov 06 15:45:06 user nova-compute[75337]:     </disk>
Nov 06 15:45:06 user nova-compute[75337]:     <interface type="ethernet">
Nov 06 15:45:06 user nova-compute[75337]:       <mac address="fa:16:3e:00:1c:74"/>
Nov 06 15:45:06 user nova-compute[75337]:       <model type="virtio"/>
Nov 06 15:45:06 user nova-compute[75337]:       <mtu size="1442"/>
Nov 06 15:45:06 user nova-compute[75337]:       <target dev="tapd1c68bac-be"/>
Nov 06 15:45:06 user nova-compute[75337]:     </interface>
Nov 06 15:45:06 user nova-compute[75337]:     <serial type="pty">
Nov 06 15:45:06 user nova-compute[75337]:       <log file="/opt/stack/data/nova/instances/581cf468-65e7-42e5-9250-c3d645577011/console.log" append="off"/>
Nov 06 15:45:06 user nova-compute[75337]:     </serial>
Nov 06 15:45:06 user nova-compute[75337]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 15:45:06 user nova-compute[75337]:     <video>
Nov 06 15:45:06 user nova-compute[75337]:       <model type="virtio"/>
Nov 06 15:45:06 user nova-compute[75337]:     </video>
Nov 06 15:45:06 user nova-compute[75337]:     <rng model="virtio">
Nov 06 15:45:06 user nova-compute[75337]:       <backend model="random">/dev/urandom</backend>
Nov 06 15:45:06 user nova-compute[75337]:     </rng>
Nov 06 15:45:06 user nova-compute[75337]:     <controller type="usb" index="0" model="none"/>
Nov 06 15:45:06 user nova-compute[75337]:     <memballoon model="virtio">
Nov 06 15:45:06 user nova-compute[75337]:       <stats period="10"/>
Nov 06 15:45:06 user nova-compute[75337]:     </memballoon>
Nov 06 15:45:06 user nova-compute[75337]:   </devices>
Nov 06 15:45:06 user nova-compute[75337]: </domain>
Nov 06 15:45:06 user nova-compute[75337]:  {{(pid=75337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 15:45:06 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-e14dc784-33fa-4520-88be-b2c74b2145ef tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T15:37:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-143035342',display_name='tempest-ServerActionsTestOtherB-server-143035342',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-143035342',id=4,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGvgawdpwOKUFbYuIfCQHAYAwMkYeyGp/mWnvHMxoikCW6rq7Lc9iVzhCxfsvGYfdcuDE3wf7kwN77XNEdHIhKuYJC28UJSD4qJahdz/1x3pQWmM3jC4aksXmnaw21FVfw==',key_name='tempest-keypair-1619039595',keypairs=<?>,launch_index=0,launched_at=2023-11-06T15:43:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f40165c076e341bba42fb537ce98bbe2',ramdisk_id='',reservation_id='r-w3wq64j4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-464439480',owner_user_name='tempest-ServerActionsTestOtherB-464439480-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T15:44:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2810a15c1608465aa7465eae455eb5c6',uuid=581cf468-65e7-42e5-9250-c3d645577011,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "d1c68bac-be37-4645-afcb-2b89f47c1793", "address": "fa:16:3e:00:1c:74", "network": {"id": "2623bcbf-c77c-47b4-abd5-ab538f9a2814", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1497688706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f40165c076e341bba42fb537ce98bbe2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1c68bac-be", "ovs_interfaceid": "d1c68bac-be37-4645-afcb-2b89f47c1793", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 15:45:06 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-e14dc784-33fa-4520-88be-b2c74b2145ef tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Converting VIF {"id": "d1c68bac-be37-4645-afcb-2b89f47c1793", "address": "fa:16:3e:00:1c:74", "network": {"id": "2623bcbf-c77c-47b4-abd5-ab538f9a2814", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1497688706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f40165c076e341bba42fb537ce98bbe2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1c68bac-be", "ovs_interfaceid": "d1c68bac-be37-4645-afcb-2b89f47c1793", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 15:45:06 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-e14dc784-33fa-4520-88be-b2c74b2145ef tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:1c:74,bridge_name='br-int',has_traffic_filtering=True,id=d1c68bac-be37-4645-afcb-2b89f47c1793,network=Network(2623bcbf-c77c-47b4-abd5-ab538f9a2814),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1c68bac-be') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 15:45:06 user nova-compute[75337]: DEBUG os_vif [None req-e14dc784-33fa-4520-88be-b2c74b2145ef tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:1c:74,bridge_name='br-int',has_traffic_filtering=True,id=d1c68bac-be37-4645-afcb-2b89f47c1793,network=Network(2623bcbf-c77c-47b4-abd5-ab538f9a2814),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1c68bac-be') {{(pid=75337) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 15:45:06 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:45:06 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:45:06 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 15:45:06 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:45:06 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c7c8f7f7-a966-5f35-8c9b-6076307a23c7', '_type': 'linux-noop'}}, row=False) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:45:06 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:45:06 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:45:06 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:45:06 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd1c68bac-be, may_exist=True, interface_attrs={}) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:45:06 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd1c68bac-be, col_values=(('qos', UUID('0b269b33-8054-4bdb-bb26-ec3cec408e29')),), if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:45:06 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd1c68bac-be, col_values=(('external_ids', {'iface-id': 'd1c68bac-be37-4645-afcb-2b89f47c1793', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:00:1c:74', 'vm-uuid': '581cf468-65e7-42e5-9250-c3d645577011'}),), if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:45:06 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:45:06 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:45:06 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:45:06 user nova-compute[75337]: INFO os_vif [None req-e14dc784-33fa-4520-88be-b2c74b2145ef tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:1c:74,bridge_name='br-int',has_traffic_filtering=True,id=d1c68bac-be37-4645-afcb-2b89f47c1793,network=Network(2623bcbf-c77c-47b4-abd5-ab538f9a2814),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1c68bac-be')
Nov 06 15:45:07 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-56b81139-d1ab-46de-873d-ec1f277dcdd3 tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] Acquiring lock "9125364b-332f-4297-815f-3aa1eadaf743" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:45:07 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-56b81139-d1ab-46de-873d-ec1f277dcdd3 tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] Lock "9125364b-332f-4297-815f-3aa1eadaf743" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:45:07 user nova-compute[75337]: DEBUG nova.compute.manager [None req-56b81139-d1ab-46de-873d-ec1f277dcdd3 tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] [instance: 9125364b-332f-4297-815f-3aa1eadaf743] Starting instance... {{(pid=75337) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 15:45:07 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-56b81139-d1ab-46de-873d-ec1f277dcdd3 tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:45:07 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-56b81139-d1ab-46de-873d-ec1f277dcdd3 tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:45:07 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-56b81139-d1ab-46de-873d-ec1f277dcdd3 tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75337) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 15:45:07 user nova-compute[75337]: INFO nova.compute.claims [None req-56b81139-d1ab-46de-873d-ec1f277dcdd3 tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] [instance: 9125364b-332f-4297-815f-3aa1eadaf743] Claim successful on node user
Nov 06 15:45:08 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:45:08 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:45:08 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:45:08 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-56b81139-d1ab-46de-873d-ec1f277dcdd3 tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 15:45:08 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-56b81139-d1ab-46de-873d-ec1f277dcdd3 tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 15:45:08 user nova-compute[75337]: DEBUG nova.compute.manager [req-2cc9c774-7ebf-40f4-8bbe-21ae1ef6fb60 req-329948ec-ae34-432c-9413-b90db276fc24 service nova] [instance: 581cf468-65e7-42e5-9250-c3d645577011] Received event network-vif-plugged-d1c68bac-be37-4645-afcb-2b89f47c1793 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:45:08 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-2cc9c774-7ebf-40f4-8bbe-21ae1ef6fb60 req-329948ec-ae34-432c-9413-b90db276fc24 service nova] Acquiring lock "581cf468-65e7-42e5-9250-c3d645577011-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:45:08 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-2cc9c774-7ebf-40f4-8bbe-21ae1ef6fb60 req-329948ec-ae34-432c-9413-b90db276fc24 service nova] Lock "581cf468-65e7-42e5-9250-c3d645577011-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:45:08 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-2cc9c774-7ebf-40f4-8bbe-21ae1ef6fb60 req-329948ec-ae34-432c-9413-b90db276fc24 service nova] Lock "581cf468-65e7-42e5-9250-c3d645577011-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:45:08 user nova-compute[75337]: DEBUG nova.compute.manager [req-2cc9c774-7ebf-40f4-8bbe-21ae1ef6fb60 req-329948ec-ae34-432c-9413-b90db276fc24 service nova] [instance: 581cf468-65e7-42e5-9250-c3d645577011] No waiting events found dispatching network-vif-plugged-d1c68bac-be37-4645-afcb-2b89f47c1793 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:45:08 user nova-compute[75337]: WARNING nova.compute.manager [req-2cc9c774-7ebf-40f4-8bbe-21ae1ef6fb60 req-329948ec-ae34-432c-9413-b90db276fc24 service nova] [instance: 581cf468-65e7-42e5-9250-c3d645577011] Received unexpected event network-vif-plugged-d1c68bac-be37-4645-afcb-2b89f47c1793 for instance with vm_state resized and task_state resize_reverting.
Nov 06 15:45:08 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-56b81139-d1ab-46de-873d-ec1f277dcdd3 tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.548s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:45:08 user nova-compute[75337]: DEBUG nova.compute.manager [None req-56b81139-d1ab-46de-873d-ec1f277dcdd3 tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] [instance: 9125364b-332f-4297-815f-3aa1eadaf743] Start building networks asynchronously for instance. {{(pid=75337) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 15:45:08 user nova-compute[75337]: DEBUG nova.compute.manager [None req-56b81139-d1ab-46de-873d-ec1f277dcdd3 tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] [instance: 9125364b-332f-4297-815f-3aa1eadaf743] Allocating IP information in the background. {{(pid=75337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 15:45:08 user nova-compute[75337]: DEBUG nova.network.neutron [None req-56b81139-d1ab-46de-873d-ec1f277dcdd3 tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] [instance: 9125364b-332f-4297-815f-3aa1eadaf743] allocate_for_instance() {{(pid=75337) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 15:45:08 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-56b81139-d1ab-46de-873d-ec1f277dcdd3 tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] [instance: 9125364b-332f-4297-815f-3aa1eadaf743] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 15:45:08 user nova-compute[75337]: DEBUG nova.compute.manager [None req-56b81139-d1ab-46de-873d-ec1f277dcdd3 tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] [instance: 9125364b-332f-4297-815f-3aa1eadaf743] Start building block device mappings for instance. {{(pid=75337) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 15:45:08 user nova-compute[75337]: DEBUG nova.policy [None req-56b81139-d1ab-46de-873d-ec1f277dcdd3 tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '44a35e5af93b4817acae19d471e26463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eca67bcdbde46579049659635e8476b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75337) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 15:45:08 user nova-compute[75337]: DEBUG nova.compute.manager [None req-56b81139-d1ab-46de-873d-ec1f277dcdd3 tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] [instance: 9125364b-332f-4297-815f-3aa1eadaf743] Start spawning the instance on the hypervisor. {{(pid=75337) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 15:45:08 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-56b81139-d1ab-46de-873d-ec1f277dcdd3 tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] [instance: 9125364b-332f-4297-815f-3aa1eadaf743] Creating instance directory {{(pid=75337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 15:45:08 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-56b81139-d1ab-46de-873d-ec1f277dcdd3 tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] [instance: 9125364b-332f-4297-815f-3aa1eadaf743] Creating image(s)
Nov 06 15:45:08 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-56b81139-d1ab-46de-873d-ec1f277dcdd3 tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] Acquiring lock "/opt/stack/data/nova/instances/9125364b-332f-4297-815f-3aa1eadaf743/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:45:08 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-56b81139-d1ab-46de-873d-ec1f277dcdd3 tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] Lock "/opt/stack/data/nova/instances/9125364b-332f-4297-815f-3aa1eadaf743/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:45:08 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-56b81139-d1ab-46de-873d-ec1f277dcdd3 tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] Lock "/opt/stack/data/nova/instances/9125364b-332f-4297-815f-3aa1eadaf743/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:45:08 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:45:08 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-56b81139-d1ab-46de-873d-ec1f277dcdd3 tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:45:08 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:45:08 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:45:08 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:45:08 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:45:09 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-56b81139-d1ab-46de-873d-ec1f277dcdd3 tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json" returned: 0 in 0.229s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:45:09 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-56b81139-d1ab-46de-873d-ec1f277dcdd3 tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] Acquiring lock "06ba3c914798499e686c5ac75886932347225275" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:45:09 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-56b81139-d1ab-46de-873d-ec1f277dcdd3 tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] Lock "06ba3c914798499e686c5ac75886932347225275" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:45:09 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-56b81139-d1ab-46de-873d-ec1f277dcdd3 tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:45:09 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-56b81139-d1ab-46de-873d-ec1f277dcdd3 tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json" returned: 0 in 0.196s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:45:09 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-56b81139-d1ab-46de-873d-ec1f277dcdd3 tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275,backing_fmt=raw /opt/stack/data/nova/instances/9125364b-332f-4297-815f-3aa1eadaf743/disk 1073741824 {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:45:09 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-56b81139-d1ab-46de-873d-ec1f277dcdd3 tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275,backing_fmt=raw /opt/stack/data/nova/instances/9125364b-332f-4297-815f-3aa1eadaf743/disk 1073741824" returned: 0 in 0.058s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:45:09 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-56b81139-d1ab-46de-873d-ec1f277dcdd3 tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] Lock "06ba3c914798499e686c5ac75886932347225275" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.265s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:45:09 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-56b81139-d1ab-46de-873d-ec1f277dcdd3 tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:45:09 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-56b81139-d1ab-46de-873d-ec1f277dcdd3 tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json" returned: 0 in 0.260s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:45:09 user nova-compute[75337]: DEBUG nova.virt.disk.api [None req-56b81139-d1ab-46de-873d-ec1f277dcdd3 tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9125364b-332f-4297-815f-3aa1eadaf743/disk. size=1073741824 {{(pid=75337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 15:45:09 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-56b81139-d1ab-46de-873d-ec1f277dcdd3 tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9125364b-332f-4297-815f-3aa1eadaf743/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:45:09 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-56b81139-d1ab-46de-873d-ec1f277dcdd3 tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9125364b-332f-4297-815f-3aa1eadaf743/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:45:09 user nova-compute[75337]: DEBUG nova.virt.disk.api [None req-56b81139-d1ab-46de-873d-ec1f277dcdd3 tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] Cannot resize image /opt/stack/data/nova/instances/9125364b-332f-4297-815f-3aa1eadaf743/disk to a smaller size. {{(pid=75337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 06 15:45:09 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-56b81139-d1ab-46de-873d-ec1f277dcdd3 tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] [instance: 9125364b-332f-4297-815f-3aa1eadaf743] Created local disks {{(pid=75337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 15:45:09 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-56b81139-d1ab-46de-873d-ec1f277dcdd3 tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] [instance: 9125364b-332f-4297-815f-3aa1eadaf743] Ensure instance console log exists: /opt/stack/data/nova/instances/9125364b-332f-4297-815f-3aa1eadaf743/console.log {{(pid=75337) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 15:45:09 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-56b81139-d1ab-46de-873d-ec1f277dcdd3 tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:45:09 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-56b81139-d1ab-46de-873d-ec1f277dcdd3 tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:45:09 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-56b81139-d1ab-46de-873d-ec1f277dcdd3 tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:45:09 user nova-compute[75337]: DEBUG nova.network.neutron [None req-56b81139-d1ab-46de-873d-ec1f277dcdd3 tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] [instance: 9125364b-332f-4297-815f-3aa1eadaf743] Successfully created port: f38ac99b-98f5-4892-9098-71487faa5282 {{(pid=75337) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 15:45:10 user nova-compute[75337]: DEBUG nova.compute.manager [req-d10d060e-e9f3-48f6-bae9-0f1ef0a50554 req-68cdbe87-c85b-4d05-842c-16f6fe147174 service nova] [instance: 581cf468-65e7-42e5-9250-c3d645577011] Received event network-vif-plugged-d1c68bac-be37-4645-afcb-2b89f47c1793 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:45:10 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-d10d060e-e9f3-48f6-bae9-0f1ef0a50554 req-68cdbe87-c85b-4d05-842c-16f6fe147174 service nova] Acquiring lock "581cf468-65e7-42e5-9250-c3d645577011-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:45:10 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-d10d060e-e9f3-48f6-bae9-0f1ef0a50554 req-68cdbe87-c85b-4d05-842c-16f6fe147174 service nova] Lock "581cf468-65e7-42e5-9250-c3d645577011-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:45:10 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-d10d060e-e9f3-48f6-bae9-0f1ef0a50554 req-68cdbe87-c85b-4d05-842c-16f6fe147174 service nova] Lock "581cf468-65e7-42e5-9250-c3d645577011-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:45:10 user nova-compute[75337]: DEBUG nova.compute.manager [req-d10d060e-e9f3-48f6-bae9-0f1ef0a50554 req-68cdbe87-c85b-4d05-842c-16f6fe147174 service nova] [instance: 581cf468-65e7-42e5-9250-c3d645577011] No waiting events found dispatching network-vif-plugged-d1c68bac-be37-4645-afcb-2b89f47c1793 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:45:10 user nova-compute[75337]: WARNING nova.compute.manager [req-d10d060e-e9f3-48f6-bae9-0f1ef0a50554 req-68cdbe87-c85b-4d05-842c-16f6fe147174 service nova] [instance: 581cf468-65e7-42e5-9250-c3d645577011] Received unexpected event network-vif-plugged-d1c68bac-be37-4645-afcb-2b89f47c1793 for instance with vm_state resized and task_state resize_reverting.
Nov 06 15:45:10 user nova-compute[75337]: DEBUG nova.compute.manager [None req-e14dc784-33fa-4520-88be-b2c74b2145ef tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] [instance: 581cf468-65e7-42e5-9250-c3d645577011] Instance event wait completed in 0 seconds for  {{(pid=75337) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 15:45:10 user nova-compute[75337]: INFO nova.virt.libvirt.driver [-] [instance: 581cf468-65e7-42e5-9250-c3d645577011] Instance running successfully.
Nov 06 15:45:10 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-e14dc784-33fa-4520-88be-b2c74b2145ef tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] [instance: 581cf468-65e7-42e5-9250-c3d645577011] finish_revert_migration finished successfully. {{(pid=75337) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Nov 06 15:45:10 user nova-compute[75337]: DEBUG nova.network.neutron [None req-56b81139-d1ab-46de-873d-ec1f277dcdd3 tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] [instance: 9125364b-332f-4297-815f-3aa1eadaf743] Successfully updated port: f38ac99b-98f5-4892-9098-71487faa5282 {{(pid=75337) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 15:45:10 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-56b81139-d1ab-46de-873d-ec1f277dcdd3 tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] Acquiring lock "refresh_cache-9125364b-332f-4297-815f-3aa1eadaf743" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 15:45:10 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-56b81139-d1ab-46de-873d-ec1f277dcdd3 tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] Acquired lock "refresh_cache-9125364b-332f-4297-815f-3aa1eadaf743" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 15:45:10 user nova-compute[75337]: DEBUG nova.network.neutron [None req-56b81139-d1ab-46de-873d-ec1f277dcdd3 tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] [instance: 9125364b-332f-4297-815f-3aa1eadaf743] Building network info cache for instance {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 15:45:11 user nova-compute[75337]: DEBUG nova.network.neutron [None req-56b81139-d1ab-46de-873d-ec1f277dcdd3 tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] [instance: 9125364b-332f-4297-815f-3aa1eadaf743] Instance cache missing network info. {{(pid=75337) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 15:45:11 user nova-compute[75337]: INFO nova.compute.manager [None req-e14dc784-33fa-4520-88be-b2c74b2145ef tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] [instance: 581cf468-65e7-42e5-9250-c3d645577011] Updating instance to original state: 'active'
Nov 06 15:45:11 user nova-compute[75337]: DEBUG nova.network.neutron [None req-56b81139-d1ab-46de-873d-ec1f277dcdd3 tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] [instance: 9125364b-332f-4297-815f-3aa1eadaf743] Updating instance_info_cache with network_info: [{"id": "f38ac99b-98f5-4892-9098-71487faa5282", "address": "fa:16:3e:d5:76:83", "network": {"id": "d1def424-b3a7-441d-aee5-0a2465f37ecc", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1418475866-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0eca67bcdbde46579049659635e8476b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf38ac99b-98", "ovs_interfaceid": "f38ac99b-98f5-4892-9098-71487faa5282", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:45:11 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-56b81139-d1ab-46de-873d-ec1f277dcdd3 tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] Releasing lock "refresh_cache-9125364b-332f-4297-815f-3aa1eadaf743" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 15:45:11 user nova-compute[75337]: DEBUG nova.compute.manager [None req-56b81139-d1ab-46de-873d-ec1f277dcdd3 tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] [instance: 9125364b-332f-4297-815f-3aa1eadaf743] Instance network_info: |[{"id": "f38ac99b-98f5-4892-9098-71487faa5282", "address": "fa:16:3e:d5:76:83", "network": {"id": "d1def424-b3a7-441d-aee5-0a2465f37ecc", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1418475866-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0eca67bcdbde46579049659635e8476b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf38ac99b-98", "ovs_interfaceid": "f38ac99b-98f5-4892-9098-71487faa5282", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 15:45:11 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-56b81139-d1ab-46de-873d-ec1f277dcdd3 tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] [instance: 9125364b-332f-4297-815f-3aa1eadaf743] Start _get_guest_xml network_info=[{"id": "f38ac99b-98f5-4892-9098-71487faa5282", "address": "fa:16:3e:d5:76:83", "network": {"id": "d1def424-b3a7-441d-aee5-0a2465f37ecc", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1418475866-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0eca67bcdbde46579049659635e8476b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf38ac99b-98", "ovs_interfaceid": "f38ac99b-98f5-4892-9098-71487faa5282", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T15:34:14Z,direct_url=<?>,disk_format='qcow2',id=16b903ae-a40f-41a7-985b-4804cce92c62,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6549a15819f1469bbd5eeae8190e3d44',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T15:34:15Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'guest_format': None, 'size': 0, 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '16b903ae-a40f-41a7-985b-4804cce92c62'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 15:45:11 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-56b81139-d1ab-46de-873d-ec1f277dcdd3 tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 15:45:11 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-56b81139-d1ab-46de-873d-ec1f277dcdd3 tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 15:45:11 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-56b81139-d1ab-46de-873d-ec1f277dcdd3 tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 15:45:11 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-56b81139-d1ab-46de-873d-ec1f277dcdd3 tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] CPU controller missing on host. {{(pid=75337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 15:45:11 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-56b81139-d1ab-46de-873d-ec1f277dcdd3 tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 15:45:11 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-56b81139-d1ab-46de-873d-ec1f277dcdd3 tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] CPU controller found on host. {{(pid=75337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 15:45:11 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-56b81139-d1ab-46de-873d-ec1f277dcdd3 tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75337) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 15:45:11 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-56b81139-d1ab-46de-873d-ec1f277dcdd3 tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T15:34:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T15:34:14Z,direct_url=<?>,disk_format='qcow2',id=16b903ae-a40f-41a7-985b-4804cce92c62,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6549a15819f1469bbd5eeae8190e3d44',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T15:34:15Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 15:45:11 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-56b81139-d1ab-46de-873d-ec1f277dcdd3 tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] Flavor limits 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 15:45:11 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-56b81139-d1ab-46de-873d-ec1f277dcdd3 tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] Image limits 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 15:45:11 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-56b81139-d1ab-46de-873d-ec1f277dcdd3 tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] Flavor pref 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 15:45:11 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-56b81139-d1ab-46de-873d-ec1f277dcdd3 tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] Image pref 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 15:45:11 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-56b81139-d1ab-46de-873d-ec1f277dcdd3 tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 15:45:11 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-56b81139-d1ab-46de-873d-ec1f277dcdd3 tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 15:45:11 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-56b81139-d1ab-46de-873d-ec1f277dcdd3 tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 15:45:11 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-56b81139-d1ab-46de-873d-ec1f277dcdd3 tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] Got 1 possible topologies {{(pid=75337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 15:45:11 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-56b81139-d1ab-46de-873d-ec1f277dcdd3 tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 15:45:11 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-56b81139-d1ab-46de-873d-ec1f277dcdd3 tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 15:45:11 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-56b81139-d1ab-46de-873d-ec1f277dcdd3 tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T15:45:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-147418644',display_name='tempest-TestVolumeSwap-server-147418644',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-147418644',id=16,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFTzCDcegbPEDOq1MYT8m/U4fKnrhQleiNetk6N/xJqk153diuOnWfp/E7K9Cg34o9TXvzuplyNTQPO/2neTnFqhpAdvzKLAMqrm205lzETvYPfiQ+ookb40gXOCfhG2mQ==',key_name='tempest-keypair-1845115653',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0eca67bcdbde46579049659635e8476b',ramdisk_id='',reservation_id='r-09r0itxm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-899206319',owner_user_name='tempest-TestVolumeSwap-899206319-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T15:45:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='44a35e5af93b4817acae19d471e26463',uuid=9125364b-332f-4297-815f-3aa1eadaf743,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f38ac99b-98f5-4892-9098-71487faa5282", "address": "fa:16:3e:d5:76:83", "network": {"id": "d1def424-b3a7-441d-aee5-0a2465f37ecc", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1418475866-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0eca67bcdbde46579049659635e8476b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf38ac99b-98", "ovs_interfaceid": "f38ac99b-98f5-4892-9098-71487faa5282", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75337) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 15:45:11 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-56b81139-d1ab-46de-873d-ec1f277dcdd3 tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] Converting VIF {"id": "f38ac99b-98f5-4892-9098-71487faa5282", "address": "fa:16:3e:d5:76:83", "network": {"id": "d1def424-b3a7-441d-aee5-0a2465f37ecc", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1418475866-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0eca67bcdbde46579049659635e8476b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf38ac99b-98", "ovs_interfaceid": "f38ac99b-98f5-4892-9098-71487faa5282", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 15:45:11 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-56b81139-d1ab-46de-873d-ec1f277dcdd3 tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:76:83,bridge_name='br-int',has_traffic_filtering=True,id=f38ac99b-98f5-4892-9098-71487faa5282,network=Network(d1def424-b3a7-441d-aee5-0a2465f37ecc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf38ac99b-98') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 15:45:11 user nova-compute[75337]: DEBUG nova.objects.instance [None req-56b81139-d1ab-46de-873d-ec1f277dcdd3 tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] Lazy-loading 'pci_devices' on Instance uuid 9125364b-332f-4297-815f-3aa1eadaf743 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 15:45:11 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-56b81139-d1ab-46de-873d-ec1f277dcdd3 tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] [instance: 9125364b-332f-4297-815f-3aa1eadaf743] End _get_guest_xml xml=<domain type="kvm">
Nov 06 15:45:11 user nova-compute[75337]:   <uuid>9125364b-332f-4297-815f-3aa1eadaf743</uuid>
Nov 06 15:45:11 user nova-compute[75337]:   <name>instance-00000010</name>
Nov 06 15:45:11 user nova-compute[75337]:   <memory>524288</memory>
Nov 06 15:45:11 user nova-compute[75337]:   <vcpu>1</vcpu>
Nov 06 15:45:11 user nova-compute[75337]:   <metadata>
Nov 06 15:45:11 user nova-compute[75337]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 15:45:11 user nova-compute[75337]:       <nova:package version="0.0.0"/>
Nov 06 15:45:11 user nova-compute[75337]:       <nova:name>tempest-TestVolumeSwap-server-147418644</nova:name>
Nov 06 15:45:11 user nova-compute[75337]:       <nova:creationTime>2023-11-06 15:45:11</nova:creationTime>
Nov 06 15:45:11 user nova-compute[75337]:       <nova:flavor name="m1.tiny">
Nov 06 15:45:11 user nova-compute[75337]:         <nova:memory>512</nova:memory>
Nov 06 15:45:11 user nova-compute[75337]:         <nova:disk>1</nova:disk>
Nov 06 15:45:11 user nova-compute[75337]:         <nova:swap>0</nova:swap>
Nov 06 15:45:11 user nova-compute[75337]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 15:45:11 user nova-compute[75337]:         <nova:vcpus>1</nova:vcpus>
Nov 06 15:45:11 user nova-compute[75337]:       </nova:flavor>
Nov 06 15:45:11 user nova-compute[75337]:       <nova:owner>
Nov 06 15:45:11 user nova-compute[75337]:         <nova:user uuid="44a35e5af93b4817acae19d471e26463">tempest-TestVolumeSwap-899206319-project-member</nova:user>
Nov 06 15:45:11 user nova-compute[75337]:         <nova:project uuid="0eca67bcdbde46579049659635e8476b">tempest-TestVolumeSwap-899206319</nova:project>
Nov 06 15:45:11 user nova-compute[75337]:       </nova:owner>
Nov 06 15:45:11 user nova-compute[75337]:       <nova:root type="image" uuid="16b903ae-a40f-41a7-985b-4804cce92c62"/>
Nov 06 15:45:11 user nova-compute[75337]:       <nova:ports>
Nov 06 15:45:11 user nova-compute[75337]:         <nova:port uuid="f38ac99b-98f5-4892-9098-71487faa5282">
Nov 06 15:45:11 user nova-compute[75337]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 06 15:45:11 user nova-compute[75337]:         </nova:port>
Nov 06 15:45:11 user nova-compute[75337]:       </nova:ports>
Nov 06 15:45:11 user nova-compute[75337]:     </nova:instance>
Nov 06 15:45:11 user nova-compute[75337]:   </metadata>
Nov 06 15:45:11 user nova-compute[75337]:   <sysinfo type="smbios">
Nov 06 15:45:11 user nova-compute[75337]:     <system>
Nov 06 15:45:11 user nova-compute[75337]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 15:45:11 user nova-compute[75337]:       <entry name="product">OpenStack Nova</entry>
Nov 06 15:45:11 user nova-compute[75337]:       <entry name="version">0.0.0</entry>
Nov 06 15:45:11 user nova-compute[75337]:       <entry name="serial">9125364b-332f-4297-815f-3aa1eadaf743</entry>
Nov 06 15:45:11 user nova-compute[75337]:       <entry name="uuid">9125364b-332f-4297-815f-3aa1eadaf743</entry>
Nov 06 15:45:11 user nova-compute[75337]:       <entry name="family">Virtual Machine</entry>
Nov 06 15:45:11 user nova-compute[75337]:     </system>
Nov 06 15:45:11 user nova-compute[75337]:   </sysinfo>
Nov 06 15:45:11 user nova-compute[75337]:   <os>
Nov 06 15:45:11 user nova-compute[75337]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 15:45:11 user nova-compute[75337]:     <boot dev="hd"/>
Nov 06 15:45:11 user nova-compute[75337]:     <smbios mode="sysinfo"/>
Nov 06 15:45:11 user nova-compute[75337]:   </os>
Nov 06 15:45:11 user nova-compute[75337]:   <features>
Nov 06 15:45:11 user nova-compute[75337]:     <acpi/>
Nov 06 15:45:11 user nova-compute[75337]:     <apic/>
Nov 06 15:45:11 user nova-compute[75337]:     <vmcoreinfo/>
Nov 06 15:45:11 user nova-compute[75337]:   </features>
Nov 06 15:45:11 user nova-compute[75337]:   <clock offset="utc">
Nov 06 15:45:11 user nova-compute[75337]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 15:45:11 user nova-compute[75337]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 15:45:11 user nova-compute[75337]:     <timer name="hpet" present="no"/>
Nov 06 15:45:11 user nova-compute[75337]:   </clock>
Nov 06 15:45:11 user nova-compute[75337]:   <cpu mode="custom" match="exact">
Nov 06 15:45:11 user nova-compute[75337]:     <model>Nehalem</model>
Nov 06 15:45:11 user nova-compute[75337]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 15:45:11 user nova-compute[75337]:   </cpu>
Nov 06 15:45:11 user nova-compute[75337]:   <devices>
Nov 06 15:45:11 user nova-compute[75337]:     <disk type="file" device="disk">
Nov 06 15:45:11 user nova-compute[75337]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 15:45:11 user nova-compute[75337]:       <source file="/opt/stack/data/nova/instances/9125364b-332f-4297-815f-3aa1eadaf743/disk"/>
Nov 06 15:45:11 user nova-compute[75337]:       <target dev="vda" bus="virtio"/>
Nov 06 15:45:11 user nova-compute[75337]:     </disk>
Nov 06 15:45:11 user nova-compute[75337]:     <interface type="ethernet">
Nov 06 15:45:11 user nova-compute[75337]:       <mac address="fa:16:3e:d5:76:83"/>
Nov 06 15:45:11 user nova-compute[75337]:       <model type="virtio"/>
Nov 06 15:45:11 user nova-compute[75337]:       <mtu size="1442"/>
Nov 06 15:45:11 user nova-compute[75337]:       <target dev="tapf38ac99b-98"/>
Nov 06 15:45:11 user nova-compute[75337]:     </interface>
Nov 06 15:45:11 user nova-compute[75337]:     <serial type="pty">
Nov 06 15:45:11 user nova-compute[75337]:       <log file="/opt/stack/data/nova/instances/9125364b-332f-4297-815f-3aa1eadaf743/console.log" append="off"/>
Nov 06 15:45:11 user nova-compute[75337]:     </serial>
Nov 06 15:45:11 user nova-compute[75337]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 15:45:11 user nova-compute[75337]:     <video>
Nov 06 15:45:11 user nova-compute[75337]:       <model type="virtio"/>
Nov 06 15:45:11 user nova-compute[75337]:     </video>
Nov 06 15:45:11 user nova-compute[75337]:     <rng model="virtio">
Nov 06 15:45:11 user nova-compute[75337]:       <backend model="random">/dev/urandom</backend>
Nov 06 15:45:11 user nova-compute[75337]:     </rng>
Nov 06 15:45:11 user nova-compute[75337]:     <controller type="usb" index="0" model="none"/>
Nov 06 15:45:11 user nova-compute[75337]:     <memballoon model="virtio">
Nov 06 15:45:11 user nova-compute[75337]:       <stats period="10"/>
Nov 06 15:45:11 user nova-compute[75337]:     </memballoon>
Nov 06 15:45:11 user nova-compute[75337]:   </devices>
Nov 06 15:45:11 user nova-compute[75337]: </domain>
Nov 06 15:45:11 user nova-compute[75337]:  {{(pid=75337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 15:45:11 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-56b81139-d1ab-46de-873d-ec1f277dcdd3 tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T15:45:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-147418644',display_name='tempest-TestVolumeSwap-server-147418644',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-147418644',id=16,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFTzCDcegbPEDOq1MYT8m/U4fKnrhQleiNetk6N/xJqk153diuOnWfp/E7K9Cg34o9TXvzuplyNTQPO/2neTnFqhpAdvzKLAMqrm205lzETvYPfiQ+ookb40gXOCfhG2mQ==',key_name='tempest-keypair-1845115653',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0eca67bcdbde46579049659635e8476b',ramdisk_id='',reservation_id='r-09r0itxm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-899206319',owner_user_name='tempest-TestVolumeSwap-899206319-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T15:45:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='44a35e5af93b4817acae19d471e26463',uuid=9125364b-332f-4297-815f-3aa1eadaf743,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f38ac99b-98f5-4892-9098-71487faa5282", "address": "fa:16:3e:d5:76:83", "network": {"id": "d1def424-b3a7-441d-aee5-0a2465f37ecc", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1418475866-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0eca67bcdbde46579049659635e8476b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf38ac99b-98", "ovs_interfaceid": "f38ac99b-98f5-4892-9098-71487faa5282", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 15:45:11 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-56b81139-d1ab-46de-873d-ec1f277dcdd3 tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] Converting VIF {"id": "f38ac99b-98f5-4892-9098-71487faa5282", "address": "fa:16:3e:d5:76:83", "network": {"id": "d1def424-b3a7-441d-aee5-0a2465f37ecc", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1418475866-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0eca67bcdbde46579049659635e8476b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf38ac99b-98", "ovs_interfaceid": "f38ac99b-98f5-4892-9098-71487faa5282", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 15:45:11 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-56b81139-d1ab-46de-873d-ec1f277dcdd3 tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:76:83,bridge_name='br-int',has_traffic_filtering=True,id=f38ac99b-98f5-4892-9098-71487faa5282,network=Network(d1def424-b3a7-441d-aee5-0a2465f37ecc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf38ac99b-98') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 15:45:11 user nova-compute[75337]: DEBUG os_vif [None req-56b81139-d1ab-46de-873d-ec1f277dcdd3 tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:76:83,bridge_name='br-int',has_traffic_filtering=True,id=f38ac99b-98f5-4892-9098-71487faa5282,network=Network(d1def424-b3a7-441d-aee5-0a2465f37ecc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf38ac99b-98') {{(pid=75337) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 15:45:11 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:45:11 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:45:11 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 15:45:11 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:45:11 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7698af59-589d-5f5c-8c40-df316b1c9213', '_type': 'linux-noop'}}, row=False) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:45:11 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:45:11 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:45:11 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:45:11 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf38ac99b-98, may_exist=True, interface_attrs={}) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:45:11 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf38ac99b-98, col_values=(('qos', UUID('67002848-fa02-40ce-ad16-298b2d6ad791')),), if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:45:11 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf38ac99b-98, col_values=(('external_ids', {'iface-id': 'f38ac99b-98f5-4892-9098-71487faa5282', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d5:76:83', 'vm-uuid': '9125364b-332f-4297-815f-3aa1eadaf743'}),), if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:45:11 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:45:11 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:45:11 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:45:11 user nova-compute[75337]: INFO os_vif [None req-56b81139-d1ab-46de-873d-ec1f277dcdd3 tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:76:83,bridge_name='br-int',has_traffic_filtering=True,id=f38ac99b-98f5-4892-9098-71487faa5282,network=Network(d1def424-b3a7-441d-aee5-0a2465f37ecc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf38ac99b-98')
Nov 06 15:45:11 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-56b81139-d1ab-46de-873d-ec1f277dcdd3 tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] No BDM found with device name vda, not building metadata. {{(pid=75337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 15:45:11 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-56b81139-d1ab-46de-873d-ec1f277dcdd3 tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] No VIF found with MAC fa:16:3e:d5:76:83, not building metadata {{(pid=75337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 15:45:12 user nova-compute[75337]: DEBUG nova.compute.manager [req-cc960fe1-e180-4f85-830a-c710310e7cfd req-546a85a0-66f2-4c5d-bed5-463b5195dd91 service nova] [instance: 9125364b-332f-4297-815f-3aa1eadaf743] Received event network-changed-f38ac99b-98f5-4892-9098-71487faa5282 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:45:12 user nova-compute[75337]: DEBUG nova.compute.manager [req-cc960fe1-e180-4f85-830a-c710310e7cfd req-546a85a0-66f2-4c5d-bed5-463b5195dd91 service nova] [instance: 9125364b-332f-4297-815f-3aa1eadaf743] Refreshing instance network info cache due to event network-changed-f38ac99b-98f5-4892-9098-71487faa5282. {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 15:45:12 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-cc960fe1-e180-4f85-830a-c710310e7cfd req-546a85a0-66f2-4c5d-bed5-463b5195dd91 service nova] Acquiring lock "refresh_cache-9125364b-332f-4297-815f-3aa1eadaf743" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 15:45:12 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-cc960fe1-e180-4f85-830a-c710310e7cfd req-546a85a0-66f2-4c5d-bed5-463b5195dd91 service nova] Acquired lock "refresh_cache-9125364b-332f-4297-815f-3aa1eadaf743" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 15:45:12 user nova-compute[75337]: DEBUG nova.network.neutron [req-cc960fe1-e180-4f85-830a-c710310e7cfd req-546a85a0-66f2-4c5d-bed5-463b5195dd91 service nova] [instance: 9125364b-332f-4297-815f-3aa1eadaf743] Refreshing network info cache for port f38ac99b-98f5-4892-9098-71487faa5282 {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 15:45:13 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:45:13 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:45:13 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:45:13 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:45:13 user nova-compute[75337]: DEBUG nova.network.neutron [req-cc960fe1-e180-4f85-830a-c710310e7cfd req-546a85a0-66f2-4c5d-bed5-463b5195dd91 service nova] [instance: 9125364b-332f-4297-815f-3aa1eadaf743] Updated VIF entry in instance network info cache for port f38ac99b-98f5-4892-9098-71487faa5282. {{(pid=75337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 15:45:13 user nova-compute[75337]: DEBUG nova.network.neutron [req-cc960fe1-e180-4f85-830a-c710310e7cfd req-546a85a0-66f2-4c5d-bed5-463b5195dd91 service nova] [instance: 9125364b-332f-4297-815f-3aa1eadaf743] Updating instance_info_cache with network_info: [{"id": "f38ac99b-98f5-4892-9098-71487faa5282", "address": "fa:16:3e:d5:76:83", "network": {"id": "d1def424-b3a7-441d-aee5-0a2465f37ecc", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1418475866-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0eca67bcdbde46579049659635e8476b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf38ac99b-98", "ovs_interfaceid": "f38ac99b-98f5-4892-9098-71487faa5282", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:45:13 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-cc960fe1-e180-4f85-830a-c710310e7cfd req-546a85a0-66f2-4c5d-bed5-463b5195dd91 service nova] Releasing lock "refresh_cache-9125364b-332f-4297-815f-3aa1eadaf743" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 15:45:13 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:45:13 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:45:13 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:45:13 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:45:13 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:45:13 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:45:14 user nova-compute[75337]: DEBUG nova.compute.manager [req-b72363c5-1633-4af1-9fe2-007732dc29f5 req-af1a5830-1ef6-4ba9-8473-d6f33dbf2a4c service nova] [instance: 9125364b-332f-4297-815f-3aa1eadaf743] Received event network-vif-plugged-f38ac99b-98f5-4892-9098-71487faa5282 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:45:14 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-b72363c5-1633-4af1-9fe2-007732dc29f5 req-af1a5830-1ef6-4ba9-8473-d6f33dbf2a4c service nova] Acquiring lock "9125364b-332f-4297-815f-3aa1eadaf743-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:45:14 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-b72363c5-1633-4af1-9fe2-007732dc29f5 req-af1a5830-1ef6-4ba9-8473-d6f33dbf2a4c service nova] Lock "9125364b-332f-4297-815f-3aa1eadaf743-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:45:14 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-b72363c5-1633-4af1-9fe2-007732dc29f5 req-af1a5830-1ef6-4ba9-8473-d6f33dbf2a4c service nova] Lock "9125364b-332f-4297-815f-3aa1eadaf743-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:45:14 user nova-compute[75337]: DEBUG nova.compute.manager [req-b72363c5-1633-4af1-9fe2-007732dc29f5 req-af1a5830-1ef6-4ba9-8473-d6f33dbf2a4c service nova] [instance: 9125364b-332f-4297-815f-3aa1eadaf743] No waiting events found dispatching network-vif-plugged-f38ac99b-98f5-4892-9098-71487faa5282 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:45:14 user nova-compute[75337]: WARNING nova.compute.manager [req-b72363c5-1633-4af1-9fe2-007732dc29f5 req-af1a5830-1ef6-4ba9-8473-d6f33dbf2a4c service nova] [instance: 9125364b-332f-4297-815f-3aa1eadaf743] Received unexpected event network-vif-plugged-f38ac99b-98f5-4892-9098-71487faa5282 for instance with vm_state building and task_state spawning.
Nov 06 15:45:14 user nova-compute[75337]: DEBUG nova.compute.manager [req-b72363c5-1633-4af1-9fe2-007732dc29f5 req-af1a5830-1ef6-4ba9-8473-d6f33dbf2a4c service nova] [instance: 9125364b-332f-4297-815f-3aa1eadaf743] Received event network-vif-plugged-f38ac99b-98f5-4892-9098-71487faa5282 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:45:14 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-b72363c5-1633-4af1-9fe2-007732dc29f5 req-af1a5830-1ef6-4ba9-8473-d6f33dbf2a4c service nova] Acquiring lock "9125364b-332f-4297-815f-3aa1eadaf743-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:45:14 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-b72363c5-1633-4af1-9fe2-007732dc29f5 req-af1a5830-1ef6-4ba9-8473-d6f33dbf2a4c service nova] Lock "9125364b-332f-4297-815f-3aa1eadaf743-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:45:14 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-b72363c5-1633-4af1-9fe2-007732dc29f5 req-af1a5830-1ef6-4ba9-8473-d6f33dbf2a4c service nova] Lock "9125364b-332f-4297-815f-3aa1eadaf743-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:45:14 user nova-compute[75337]: DEBUG nova.compute.manager [req-b72363c5-1633-4af1-9fe2-007732dc29f5 req-af1a5830-1ef6-4ba9-8473-d6f33dbf2a4c service nova] [instance: 9125364b-332f-4297-815f-3aa1eadaf743] No waiting events found dispatching network-vif-plugged-f38ac99b-98f5-4892-9098-71487faa5282 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:45:14 user nova-compute[75337]: WARNING nova.compute.manager [req-b72363c5-1633-4af1-9fe2-007732dc29f5 req-af1a5830-1ef6-4ba9-8473-d6f33dbf2a4c service nova] [instance: 9125364b-332f-4297-815f-3aa1eadaf743] Received unexpected event network-vif-plugged-f38ac99b-98f5-4892-9098-71487faa5282 for instance with vm_state building and task_state spawning.
Nov 06 15:45:15 user nova-compute[75337]: DEBUG nova.compute.manager [None req-56b81139-d1ab-46de-873d-ec1f277dcdd3 tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] [instance: 9125364b-332f-4297-815f-3aa1eadaf743] Instance event wait completed in 0 seconds for  {{(pid=75337) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 15:45:15 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-56b81139-d1ab-46de-873d-ec1f277dcdd3 tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] [instance: 9125364b-332f-4297-815f-3aa1eadaf743] Guest created on hypervisor {{(pid=75337) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 15:45:15 user nova-compute[75337]: INFO nova.virt.libvirt.driver [-] [instance: 9125364b-332f-4297-815f-3aa1eadaf743] Instance spawned successfully.
Nov 06 15:45:15 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-56b81139-d1ab-46de-873d-ec1f277dcdd3 tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] [instance: 9125364b-332f-4297-815f-3aa1eadaf743] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 15:45:15 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-56b81139-d1ab-46de-873d-ec1f277dcdd3 tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] [instance: 9125364b-332f-4297-815f-3aa1eadaf743] Found default for hw_cdrom_bus of ide {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:45:15 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-56b81139-d1ab-46de-873d-ec1f277dcdd3 tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] [instance: 9125364b-332f-4297-815f-3aa1eadaf743] Found default for hw_disk_bus of virtio {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:45:15 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-56b81139-d1ab-46de-873d-ec1f277dcdd3 tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] [instance: 9125364b-332f-4297-815f-3aa1eadaf743] Found default for hw_input_bus of None {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:45:15 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-56b81139-d1ab-46de-873d-ec1f277dcdd3 tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] [instance: 9125364b-332f-4297-815f-3aa1eadaf743] Found default for hw_pointer_model of None {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:45:15 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-56b81139-d1ab-46de-873d-ec1f277dcdd3 tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] [instance: 9125364b-332f-4297-815f-3aa1eadaf743] Found default for hw_video_model of virtio {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:45:15 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-56b81139-d1ab-46de-873d-ec1f277dcdd3 tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] [instance: 9125364b-332f-4297-815f-3aa1eadaf743] Found default for hw_vif_model of virtio {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:45:15 user nova-compute[75337]: INFO nova.compute.manager [None req-56b81139-d1ab-46de-873d-ec1f277dcdd3 tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] [instance: 9125364b-332f-4297-815f-3aa1eadaf743] Took 6.86 seconds to spawn the instance on the hypervisor.
Nov 06 15:45:15 user nova-compute[75337]: DEBUG nova.compute.manager [None req-56b81139-d1ab-46de-873d-ec1f277dcdd3 tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] [instance: 9125364b-332f-4297-815f-3aa1eadaf743] Checking state {{(pid=75337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 15:45:15 user nova-compute[75337]: INFO nova.compute.manager [None req-56b81139-d1ab-46de-873d-ec1f277dcdd3 tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] [instance: 9125364b-332f-4297-815f-3aa1eadaf743] Took 7.83 seconds to build instance.
Nov 06 15:45:15 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-56b81139-d1ab-46de-873d-ec1f277dcdd3 tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] Lock "9125364b-332f-4297-815f-3aa1eadaf743" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.949s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:45:16 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-c090037e-837f-44c7-88a0-a4a344ee191b tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Acquiring lock "dfadb21f-5ed1-42f4-956b-95cccf128b6a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:45:16 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-c090037e-837f-44c7-88a0-a4a344ee191b tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Lock "dfadb21f-5ed1-42f4-956b-95cccf128b6a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:45:16 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-c090037e-837f-44c7-88a0-a4a344ee191b tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Acquiring lock "dfadb21f-5ed1-42f4-956b-95cccf128b6a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:45:16 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-c090037e-837f-44c7-88a0-a4a344ee191b tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Lock "dfadb21f-5ed1-42f4-956b-95cccf128b6a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:45:16 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-c090037e-837f-44c7-88a0-a4a344ee191b tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Lock "dfadb21f-5ed1-42f4-956b-95cccf128b6a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:45:16 user nova-compute[75337]: INFO nova.compute.manager [None req-c090037e-837f-44c7-88a0-a4a344ee191b tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] [instance: dfadb21f-5ed1-42f4-956b-95cccf128b6a] Terminating instance
Nov 06 15:45:16 user nova-compute[75337]: DEBUG nova.compute.manager [None req-c090037e-837f-44c7-88a0-a4a344ee191b tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] [instance: dfadb21f-5ed1-42f4-956b-95cccf128b6a] Start destroying the instance on the hypervisor. {{(pid=75337) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 15:45:16 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:45:16 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:45:16 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:45:16 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:45:16 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:45:16 user nova-compute[75337]: DEBUG nova.compute.manager [req-602fdc8d-08c5-4023-bada-489e3d506870 req-7ac05681-51ce-496b-a6a5-94e2f155b366 service nova] [instance: dfadb21f-5ed1-42f4-956b-95cccf128b6a] Received event network-vif-unplugged-8592b366-9f21-4d92-b297-8872d9a7110f {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:45:16 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-602fdc8d-08c5-4023-bada-489e3d506870 req-7ac05681-51ce-496b-a6a5-94e2f155b366 service nova] Acquiring lock "dfadb21f-5ed1-42f4-956b-95cccf128b6a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:45:16 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-602fdc8d-08c5-4023-bada-489e3d506870 req-7ac05681-51ce-496b-a6a5-94e2f155b366 service nova] Lock "dfadb21f-5ed1-42f4-956b-95cccf128b6a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:45:16 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-602fdc8d-08c5-4023-bada-489e3d506870 req-7ac05681-51ce-496b-a6a5-94e2f155b366 service nova] Lock "dfadb21f-5ed1-42f4-956b-95cccf128b6a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:45:16 user nova-compute[75337]: DEBUG nova.compute.manager [req-602fdc8d-08c5-4023-bada-489e3d506870 req-7ac05681-51ce-496b-a6a5-94e2f155b366 service nova] [instance: dfadb21f-5ed1-42f4-956b-95cccf128b6a] No waiting events found dispatching network-vif-unplugged-8592b366-9f21-4d92-b297-8872d9a7110f {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:45:16 user nova-compute[75337]: DEBUG nova.compute.manager [req-602fdc8d-08c5-4023-bada-489e3d506870 req-7ac05681-51ce-496b-a6a5-94e2f155b366 service nova] [instance: dfadb21f-5ed1-42f4-956b-95cccf128b6a] Received event network-vif-unplugged-8592b366-9f21-4d92-b297-8872d9a7110f for instance with task_state deleting. {{(pid=75337) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 15:45:16 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-31465917-4273-4134-aee2-67aad4d853c3 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 8a600bd8-b94a-4242-a443-c2defb002280 is timed out.
Nov 06 15:45:16 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-31465917-4273-4134-aee2-67aad4d853c3 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Successfully detached device vdc from instance 8a600bd8-b94a-4242-a443-c2defb002280 from the live domain config.
Nov 06 15:45:16 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-31465917-4273-4134-aee2-67aad4d853c3 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] [instance: 8a600bd8-b94a-4242-a443-c2defb002280] calling os-brick to detach iSCSI Volume {{(pid=75337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 15:45:16 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-31465917-4273-4134-aee2-67aad4d853c3 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2abc33d0c0>, {'target_iqn': 'iqn.2010-10.org.openstack:bc0578f4-b30e-45b3-8cac-26620e7c3e96', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vFOjicIu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 15:45:16 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-31465917-4273-4134-aee2-67aad4d853c3 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 15:45:16 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-31465917-4273-4134-aee2-67aad4d853c3 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 15:45:16 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-31465917-4273-4134-aee2-67aad4d853c3 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 15:45:16 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:45:17 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:45:17 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[830cadd0-19ad-4b3a-b66b-86fbcd3aca54]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6f5503fc-8cc8-46fa-8450-d967f769a947\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bc0578f4-b30e-45b3-8cac-26620e7c3e96\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:45:17 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-31465917-4273-4134-aee2-67aad4d853c3 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 15:45:17 user nova-compute[75337]: No targets found.
Nov 06 15:45:17 user nova-compute[75337]: iSNS:
Nov 06 15:45:17 user nova-compute[75337]: No targets found.
Nov 06 15:45:17 user nova-compute[75337]: STATIC:
Nov 06 15:45:17 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e
Nov 06 15:45:17 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 15:45:17 user nova-compute[75337]:                 Iface Name: default
Nov 06 15:45:17 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:6f5503fc-8cc8-46fa-8450-d967f769a947
Nov 06 15:45:17 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 15:45:17 user nova-compute[75337]:                 Iface Name: default
Nov 06 15:45:17 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158
Nov 06 15:45:17 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 15:45:17 user nova-compute[75337]:                 Iface Name: default
Nov 06 15:45:17 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:bc0578f4-b30e-45b3-8cac-26620e7c3e96
Nov 06 15:45:17 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 15:45:17 user nova-compute[75337]:                 Iface Name: default
Nov 06 15:45:17 user nova-compute[75337]: FIRMWARE:
Nov 06 15:45:17 user nova-compute[75337]: No targets found.
Nov 06 15:45:17 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 15:45:17 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-31465917-4273-4134-aee2-67aad4d853c3 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 15:45:17 user nova-compute[75337]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 15:45:17 user nova-compute[75337]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75337) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 15:45:17 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-31465917-4273-4134-aee2-67aad4d853c3 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bc0578f4-b30e-45b3-8cac-26620e7c3e96', 0)] {{(pid=75337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 15:45:17 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:45:17 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:45:17 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f7e791e-0de6-4cb3-b8e6-cb748527c7ca]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6f5503fc-8cc8-46fa-8450-d967f769a947\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bc0578f4-b30e-45b3-8cac-26620e7c3e96\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:45:17 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:45:17 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:45:17 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eb1debe-d09d-4747-83c5-43718d764829]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f5503fc-8cc8-46fa-8450-d967f769a947 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0578f4-b30e-45b3-8cac-26620e7c3e96 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e (non-flash)\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:45:17 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-31465917-4273-4134-aee2-67aad4d853c3 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)
Nov 06 15:45:17 user nova-compute[75337]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f5503fc-8cc8-46fa-8450-d967f769a947 (non-flash)
Nov 06 15:45:17 user nova-compute[75337]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0578f4-b30e-45b3-8cac-26620e7c3e96 (non-flash)
Nov 06 15:45:17 user nova-compute[75337]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e (non-flash)
Nov 06 15:45:17 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 15:45:17 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-31465917-4273-4134-aee2-67aad4d853c3 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)
Nov 06 15:45:17 user nova-compute[75337]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f5503fc-8cc8-46fa-8450-d967f769a947 (non-flash)
Nov 06 15:45:17 user nova-compute[75337]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0578f4-b30e-45b3-8cac-26620e7c3e96 (non-flash)
Nov 06 15:45:17 user nova-compute[75337]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e (non-flash)
Nov 06 15:45:17 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 15:45:17 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-31465917-4273-4134-aee2-67aad4d853c3 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2abc438790>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bc0578f4-b30e-45b3-8cac-26620e7c3e96'): ({'sdf'}, set())}) {{(pid=75337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 15:45:17 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-31465917-4273-4134-aee2-67aad4d853c3 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Removing single pathed devices sdf {{(pid=75337) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 15:45:17 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:45:17 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:45:17 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[aba614ba-81db-428d-b163-3c921fa7fb62]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:45:17 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:45:17 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.027s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:45:17 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f265a43-3a31-4364-ad2f-026a8c1e5015]: (4, ('ok\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:45:17 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-31465917-4273-4134-aee2-67aad4d853c3 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Flushing IO for device /dev/sdf {{(pid=75337) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 15:45:17 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:45:17 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.016s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:45:17 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[665f78cf-6a55-4c6d-a5bf-3343004f215e]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:45:17 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-31465917-4273-4134-aee2-67aad4d853c3 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75337) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 15:45:17 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:45:17 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.044s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:45:17 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b1d7548-5b8f-43db-829a-a6700558a54c]: (4, ('1', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:45:17 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-31465917-4273-4134-aee2-67aad4d853c3 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 15:45:17 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-31465917-4273-4134-aee2-67aad4d853c3 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] SCSI volumes sdf have been removed. {{(pid=75337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 15:45:17 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-31465917-4273-4134-aee2-67aad4d853c3 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bc0578f4-b30e-45b3-8cac-26620e7c3e96')] {{(pid=75337) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 15:45:17 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc0578f4-b30e-45b3-8cac-26620e7c3e96 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:45:17 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc0578f4-b30e-45b3-8cac-26620e7c3e96 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:45:17 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5d86f72-71d1-496e-b3d0-09bae1d7de3a]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:45:17 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-31465917-4273-4134-aee2-67aad4d853c3 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:45:17 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc0578f4-b30e-45b3-8cac-26620e7c3e96 -p 172.16.0.220:3260 --logout {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:45:17 user nova-compute[75337]: INFO nova.virt.libvirt.driver [-] [instance: dfadb21f-5ed1-42f4-956b-95cccf128b6a] Instance destroyed successfully.
Nov 06 15:45:17 user nova-compute[75337]: DEBUG nova.objects.instance [None req-c090037e-837f-44c7-88a0-a4a344ee191b tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Lazy-loading 'resources' on Instance uuid dfadb21f-5ed1-42f4-956b-95cccf128b6a {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 15:45:17 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-c090037e-837f-44c7-88a0-a4a344ee191b tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T15:38:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1414083334',display_name='tempest-AttachVolumeNegativeTest-server-1414083334',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1414083334',id=6,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMM52JwCKgpkbgioUGMI0NI1B2YA6YCTZsHJyf9K8op+p9kwd0OG2YGfA8GNNGZDP2ZRZZV08pLVyNzsHr61PQwYkHr5Edy24Jllzi1i8a7jhx9bnOvb3N/DgbyCjt6ADA==',key_name='tempest-keypair-1468084483',keypairs=<?>,launch_index=0,launched_at=2023-11-06T15:38:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1013e7afbefd4146a3be04587710b1de',ramdisk_id='',reservation_id='r-f2mxi13h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1104237961',owner_user_name='tempest-AttachVolumeNegativeTest-1104237961-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T15:38:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aeeea58fcd3e4217a34a4a38be6adf30',uuid=dfadb21f-5ed1-42f4-956b-95cccf128b6a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8592b366-9f21-4d92-b297-8872d9a7110f", "address": "fa:16:3e:f8:26:1d", "network": {"id": "48f1545d-7e80-462f-9dbf-f1102ddcda9a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1210368397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1013e7afbefd4146a3be04587710b1de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8592b366-9f", "ovs_interfaceid": "8592b366-9f21-4d92-b297-8872d9a7110f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 15:45:17 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-c090037e-837f-44c7-88a0-a4a344ee191b tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Converting VIF {"id": "8592b366-9f21-4d92-b297-8872d9a7110f", "address": "fa:16:3e:f8:26:1d", "network": {"id": "48f1545d-7e80-462f-9dbf-f1102ddcda9a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1210368397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1013e7afbefd4146a3be04587710b1de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8592b366-9f", "ovs_interfaceid": "8592b366-9f21-4d92-b297-8872d9a7110f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 15:45:17 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-c090037e-837f-44c7-88a0-a4a344ee191b tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f8:26:1d,bridge_name='br-int',has_traffic_filtering=True,id=8592b366-9f21-4d92-b297-8872d9a7110f,network=Network(48f1545d-7e80-462f-9dbf-f1102ddcda9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8592b366-9f') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 15:45:17 user nova-compute[75337]: DEBUG os_vif [None req-c090037e-837f-44c7-88a0-a4a344ee191b tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f8:26:1d,bridge_name='br-int',has_traffic_filtering=True,id=8592b366-9f21-4d92-b297-8872d9a7110f,network=Network(48f1545d-7e80-462f-9dbf-f1102ddcda9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8592b366-9f') {{(pid=75337) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 15:45:17 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:45:17 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8592b366-9f, bridge=br-int, if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:45:17 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:45:17 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:45:17 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:45:17 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=eb8f37ad-cd01-456a-9da7-c98c15de0f29) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:45:17 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:45:17 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:45:17 user nova-compute[75337]: INFO os_vif [None req-c090037e-837f-44c7-88a0-a4a344ee191b tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f8:26:1d,bridge_name='br-int',has_traffic_filtering=True,id=8592b366-9f21-4d92-b297-8872d9a7110f,network=Network(48f1545d-7e80-462f-9dbf-f1102ddcda9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8592b366-9f')
Nov 06 15:45:17 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-c090037e-837f-44c7-88a0-a4a344ee191b tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] [instance: dfadb21f-5ed1-42f4-956b-95cccf128b6a] Deleting instance files /opt/stack/data/nova/instances/dfadb21f-5ed1-42f4-956b-95cccf128b6a_del
Nov 06 15:45:17 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-c090037e-837f-44c7-88a0-a4a344ee191b tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] [instance: dfadb21f-5ed1-42f4-956b-95cccf128b6a] Deletion of /opt/stack/data/nova/instances/dfadb21f-5ed1-42f4-956b-95cccf128b6a_del complete
Nov 06 15:45:17 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc0578f4-b30e-45b3-8cac-26620e7c3e96 -p 172.16.0.220:3260 --logout" returned: 0 in 0.118s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:45:17 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c373157-34fc-49e1-b7ef-a19677e0b14f]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:bc0578f4-b30e-45b3-8cac-26620e7c3e96, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:bc0578f4-b30e-45b3-8cac-26620e7c3e96, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:45:17 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-31465917-4273-4134-aee2-67aad4d853c3 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:bc0578f4-b30e-45b3-8cac-26620e7c3e96, portal: 172.16.0.220,3260]
Nov 06 15:45:17 user nova-compute[75337]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:bc0578f4-b30e-45b3-8cac-26620e7c3e96, portal: 172.16.0.220,3260] successful.
Nov 06 15:45:17 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:45:17 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc0578f4-b30e-45b3-8cac-26620e7c3e96 -p 172.16.0.220:3260 --op delete {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:45:17 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc0578f4-b30e-45b3-8cac-26620e7c3e96 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.040s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:45:17 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[51fa4844-c59a-4dc8-97dc-0c4239259df4]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:45:17 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-31465917-4273-4134-aee2-67aad4d853c3 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:45:17 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-31465917-4273-4134-aee2-67aad4d853c3 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.429s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 15:45:17 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-31465917-4273-4134-aee2-67aad4d853c3 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] <== disconnect_volume: return (432ms) None {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 15:45:17 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-31465917-4273-4134-aee2-67aad4d853c3 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] [instance: 8a600bd8-b94a-4242-a443-c2defb002280] Disconnected iSCSI Volume {{(pid=75337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 15:45:17 user nova-compute[75337]: INFO nova.compute.manager [None req-c090037e-837f-44c7-88a0-a4a344ee191b tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] [instance: dfadb21f-5ed1-42f4-956b-95cccf128b6a] Took 0.95 seconds to destroy the instance on the hypervisor.
Nov 06 15:45:17 user nova-compute[75337]: DEBUG oslo.service.loopingcall [None req-c090037e-837f-44c7-88a0-a4a344ee191b tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75337) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 15:45:17 user nova-compute[75337]: DEBUG nova.compute.manager [-] [instance: dfadb21f-5ed1-42f4-956b-95cccf128b6a] Deallocating network for instance {{(pid=75337) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 15:45:17 user nova-compute[75337]: DEBUG nova.network.neutron [-] [instance: dfadb21f-5ed1-42f4-956b-95cccf128b6a] deallocate_for_instance() {{(pid=75337) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 15:45:17 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:45:18 user nova-compute[75337]: DEBUG nova.compute.manager [req-40262361-c442-4d79-93aa-b89e299be248 req-7418bf06-caa8-4599-b0e7-86629e187596 service nova] [instance: dfadb21f-5ed1-42f4-956b-95cccf128b6a] Received event network-vif-deleted-8592b366-9f21-4d92-b297-8872d9a7110f {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:45:18 user nova-compute[75337]: INFO nova.compute.manager [req-40262361-c442-4d79-93aa-b89e299be248 req-7418bf06-caa8-4599-b0e7-86629e187596 service nova] [instance: dfadb21f-5ed1-42f4-956b-95cccf128b6a] Neutron deleted interface 8592b366-9f21-4d92-b297-8872d9a7110f; detaching it from the instance and deleting it from the info cache
Nov 06 15:45:18 user nova-compute[75337]: DEBUG nova.network.neutron [req-40262361-c442-4d79-93aa-b89e299be248 req-7418bf06-caa8-4599-b0e7-86629e187596 service nova] [instance: dfadb21f-5ed1-42f4-956b-95cccf128b6a] Updating instance_info_cache with network_info: [] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:45:18 user nova-compute[75337]: DEBUG nova.network.neutron [-] [instance: dfadb21f-5ed1-42f4-956b-95cccf128b6a] Updating instance_info_cache with network_info: [] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:45:18 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:45:18 user nova-compute[75337]: INFO nova.compute.manager [-] [instance: dfadb21f-5ed1-42f4-956b-95cccf128b6a] Took 1.51 seconds to deallocate network for instance.
Nov 06 15:45:18 user nova-compute[75337]: DEBUG nova.compute.manager [req-bdb47fb4-5807-41e2-bbf0-90eb658ca9bd req-99952ee0-be4c-4735-a365-294d8c549c73 service nova] [instance: dfadb21f-5ed1-42f4-956b-95cccf128b6a] Received event network-vif-plugged-8592b366-9f21-4d92-b297-8872d9a7110f {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:45:18 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-bdb47fb4-5807-41e2-bbf0-90eb658ca9bd req-99952ee0-be4c-4735-a365-294d8c549c73 service nova] Acquiring lock "dfadb21f-5ed1-42f4-956b-95cccf128b6a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:45:18 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-bdb47fb4-5807-41e2-bbf0-90eb658ca9bd req-99952ee0-be4c-4735-a365-294d8c549c73 service nova] Lock "dfadb21f-5ed1-42f4-956b-95cccf128b6a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:45:18 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-bdb47fb4-5807-41e2-bbf0-90eb658ca9bd req-99952ee0-be4c-4735-a365-294d8c549c73 service nova] Lock "dfadb21f-5ed1-42f4-956b-95cccf128b6a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:45:18 user nova-compute[75337]: DEBUG nova.compute.manager [req-bdb47fb4-5807-41e2-bbf0-90eb658ca9bd req-99952ee0-be4c-4735-a365-294d8c549c73 service nova] [instance: dfadb21f-5ed1-42f4-956b-95cccf128b6a] No waiting events found dispatching network-vif-plugged-8592b366-9f21-4d92-b297-8872d9a7110f {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:45:18 user nova-compute[75337]: WARNING nova.compute.manager [req-bdb47fb4-5807-41e2-bbf0-90eb658ca9bd req-99952ee0-be4c-4735-a365-294d8c549c73 service nova] [instance: dfadb21f-5ed1-42f4-956b-95cccf128b6a] Received unexpected event network-vif-plugged-8592b366-9f21-4d92-b297-8872d9a7110f for instance with vm_state active and task_state deleting.
Nov 06 15:45:18 user nova-compute[75337]: DEBUG nova.compute.manager [req-40262361-c442-4d79-93aa-b89e299be248 req-7418bf06-caa8-4599-b0e7-86629e187596 service nova] [instance: dfadb21f-5ed1-42f4-956b-95cccf128b6a] Detach interface failed, port_id=8592b366-9f21-4d92-b297-8872d9a7110f, reason: Instance dfadb21f-5ed1-42f4-956b-95cccf128b6a could not be found. {{(pid=75337) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 06 15:45:19 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-c090037e-837f-44c7-88a0-a4a344ee191b tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:45:19 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-c090037e-837f-44c7-88a0-a4a344ee191b tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:45:19 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-c090037e-837f-44c7-88a0-a4a344ee191b tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 15:45:19 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-c090037e-837f-44c7-88a0-a4a344ee191b tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 15:45:19 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-c090037e-837f-44c7-88a0-a4a344ee191b tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.404s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:45:19 user nova-compute[75337]: INFO nova.scheduler.client.report [None req-c090037e-837f-44c7-88a0-a4a344ee191b tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Deleted allocations for instance dfadb21f-5ed1-42f4-956b-95cccf128b6a
Nov 06 15:45:19 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-c090037e-837f-44c7-88a0-a4a344ee191b tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Lock "dfadb21f-5ed1-42f4-956b-95cccf128b6a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.173s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:45:22 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:45:23 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:45:25 user nova-compute[75337]: DEBUG nova.compute.manager [None req-2611c1ed-c376-409f-aec3-28b5c19f604c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 4015f2f7-a176-46aa-bdff-58d164058e15] Start spawning the instance on the hypervisor. {{(pid=75337) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 15:45:25 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-2611c1ed-c376-409f-aec3-28b5c19f604c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 4015f2f7-a176-46aa-bdff-58d164058e15] Creating instance directory {{(pid=75337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 15:45:25 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-2611c1ed-c376-409f-aec3-28b5c19f604c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 4015f2f7-a176-46aa-bdff-58d164058e15] Creating image(s)
Nov 06 15:45:25 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-2611c1ed-c376-409f-aec3-28b5c19f604c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 4015f2f7-a176-46aa-bdff-58d164058e15] Did not create local disks {{(pid=75337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 06 15:45:25 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-2611c1ed-c376-409f-aec3-28b5c19f604c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 4015f2f7-a176-46aa-bdff-58d164058e15] Ensure instance console log exists: /opt/stack/data/nova/instances/4015f2f7-a176-46aa-bdff-58d164058e15/console.log {{(pid=75337) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 15:45:25 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-2611c1ed-c376-409f-aec3-28b5c19f604c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:45:25 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-2611c1ed-c376-409f-aec3-28b5c19f604c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:45:25 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-2611c1ed-c376-409f-aec3-28b5c19f604c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:45:25 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-2611c1ed-c376-409f-aec3-28b5c19f604c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 4015f2f7-a176-46aa-bdff-58d164058e15] Start _get_guest_xml network_info=[{"id": "2ae7d4fb-8a67-4570-aa53-56cbaa82b78f", "address": "fa:16:3e:ea:78:b5", "network": {"id": "4e47319f-de1d-4dfe-9915-7d2d5131704d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-895093240-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "915211c6a2734c36b34ff92a56b085f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ae7d4fb-8a", "ovs_interfaceid": "2ae7d4fb-8a67-4570-aa53-56cbaa82b78f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'attachment_id': 'd6c10843-f997-4428-ad60-365b6b0d05a7', 'guest_format': None, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:46c1deb3-55e2-44bd-b4da-b037378d79f2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rYquUSgD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4015f2f7-a176-46aa-bdff-58d164058e15', 'attached_at': '', 'detached_at': '', 'volume_id': '46c1deb3-55e2-44bd-b4da-b037378d79f2', 'serial': '46c1deb3-55e2-44bd-b4da-b037378d79f2'}, 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=75337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 15:45:25 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-2611c1ed-c376-409f-aec3-28b5c19f604c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 15:45:25 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-2611c1ed-c376-409f-aec3-28b5c19f604c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 15:45:25 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-2611c1ed-c376-409f-aec3-28b5c19f604c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 15:45:25 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-2611c1ed-c376-409f-aec3-28b5c19f604c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] CPU controller missing on host. {{(pid=75337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 15:45:25 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-2611c1ed-c376-409f-aec3-28b5c19f604c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 15:45:25 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-2611c1ed-c376-409f-aec3-28b5c19f604c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] CPU controller found on host. {{(pid=75337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 15:45:25 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-2611c1ed-c376-409f-aec3-28b5c19f604c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75337) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 15:45:25 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-2611c1ed-c376-409f-aec3-28b5c19f604c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T15:34:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 15:45:25 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-2611c1ed-c376-409f-aec3-28b5c19f604c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Flavor limits 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 15:45:25 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-2611c1ed-c376-409f-aec3-28b5c19f604c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Image limits 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 15:45:25 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-2611c1ed-c376-409f-aec3-28b5c19f604c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Flavor pref 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 15:45:25 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-2611c1ed-c376-409f-aec3-28b5c19f604c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Image pref 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 15:45:25 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-2611c1ed-c376-409f-aec3-28b5c19f604c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 15:45:25 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-2611c1ed-c376-409f-aec3-28b5c19f604c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 15:45:25 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-2611c1ed-c376-409f-aec3-28b5c19f604c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 15:45:25 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-2611c1ed-c376-409f-aec3-28b5c19f604c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Got 1 possible topologies {{(pid=75337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 15:45:25 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-2611c1ed-c376-409f-aec3-28b5c19f604c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 15:45:25 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-2611c1ed-c376-409f-aec3-28b5c19f604c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 15:45:25 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2611c1ed-c376-409f-aec3-28b5c19f604c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 4015f2f7-a176-46aa-bdff-58d164058e15] Calling os-brick to attach iSCSI Volume {{(pid=75337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 15:45:25 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-2611c1ed-c376-409f-aec3-28b5c19f604c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2abc33d0c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:46c1deb3-55e2-44bd-b4da-b037378d79f2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rYquUSgD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 15:45:25 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-2611c1ed-c376-409f-aec3-28b5c19f604c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 15:45:25 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-2611c1ed-c376-409f-aec3-28b5c19f604c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 15:45:25 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-2611c1ed-c376-409f-aec3-28b5c19f604c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 15:45:25 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-2611c1ed-c376-409f-aec3-28b5c19f604c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 15:45:25 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-2611c1ed-c376-409f-aec3-28b5c19f604c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:46c1deb3-55e2-44bd-b4da-b037378d79f2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 15:45:25 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-2611c1ed-c376-409f-aec3-28b5c19f604c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:46c1deb3-55e2-44bd-b4da-b037378d79f2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 15:45:25 user nova-compute[75337]: INFO os_brick.initiator.connectors.iscsi [None req-2611c1ed-c376-409f-aec3-28b5c19f604c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 15:45:25 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46c1deb3-55e2-44bd-b4da-b037378d79f2 -p 172.16.0.220:3260 {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:45:25 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46c1deb3-55e2-44bd-b4da-b037378d79f2 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:45:25 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8e58822-62a4-400c-ae13-d6b46cb202d8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:45:25 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-2611c1ed-c376-409f-aec3-28b5c19f604c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 15:45:25 user nova-compute[75337]:  {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:45:25 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46c1deb3-55e2-44bd-b4da-b037378d79f2 -p 172.16.0.220:3260 --interface default --op new {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:45:25 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46c1deb3-55e2-44bd-b4da-b037378d79f2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:45:25 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ae0e8a6-49c0-4414-aa86-0e821bd9e395]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:46c1deb3-55e2-44bd-b4da-b037378d79f2] added\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:45:25 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-2611c1ed-c376-409f-aec3-28b5c19f604c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:46c1deb3-55e2-44bd-b4da-b037378d79f2] added
Nov 06 15:45:25 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:45:25 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46c1deb3-55e2-44bd-b4da-b037378d79f2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:45:25 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46c1deb3-55e2-44bd-b4da-b037378d79f2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:45:25 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[a966fcc4-9899-4762-8c35-065d7a1cbc21]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:45:25 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-2611c1ed-c376-409f-aec3-28b5c19f604c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:45:25 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46c1deb3-55e2-44bd-b4da-b037378d79f2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:45:25 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46c1deb3-55e2-44bd-b4da-b037378d79f2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:45:25 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a080e81-05eb-4fdd-8d6e-e5bc68b1a5de]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:45:25 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-2611c1ed-c376-409f-aec3-28b5c19f604c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:45:25 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46c1deb3-55e2-44bd-b4da-b037378d79f2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rYquUSgD {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:45:25 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46c1deb3-55e2-44bd-b4da-b037378d79f2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rYquUSgD" returned: 0 in 0.032s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:45:25 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5f18413-2334-4f34-9bb8-1f46071d7043]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:45:25 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-2611c1ed-c376-409f-aec3-28b5c19f604c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rYquUSgD'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:45:25 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46c1deb3-55e2-44bd-b4da-b037378d79f2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:45:25 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46c1deb3-55e2-44bd-b4da-b037378d79f2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:45:25 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[93957515-58b8-48a5-8d26-a3eb8f187548]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:45:25 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-2611c1ed-c376-409f-aec3-28b5c19f604c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:45:25 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:45:25 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:45:25 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[32ed6a7d-aefe-4061-840f-bd5d005af344]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f5503fc-8cc8-46fa-8450-d967f769a947 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e (non-flash)\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:45:25 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-2611c1ed-c376-409f-aec3-28b5c19f604c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)
Nov 06 15:45:25 user nova-compute[75337]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f5503fc-8cc8-46fa-8450-d967f769a947 (non-flash)
Nov 06 15:45:25 user nova-compute[75337]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e (non-flash)
Nov 06 15:45:25 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 15:45:25 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-2611c1ed-c376-409f-aec3-28b5c19f604c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)
Nov 06 15:45:25 user nova-compute[75337]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f5503fc-8cc8-46fa-8450-d967f769a947 (non-flash)
Nov 06 15:45:25 user nova-compute[75337]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e (non-flash)
Nov 06 15:45:25 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 15:45:25 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46c1deb3-55e2-44bd-b4da-b037378d79f2 -p 172.16.0.220:3260 --login {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:45:26 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46c1deb3-55e2-44bd-b4da-b037378d79f2 -p 172.16.0.220:3260 --login" returned: 0 in 0.149s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:45:26 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[c952c1b3-2c47-47df-ac3f-cb7a1082e162]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:46c1deb3-55e2-44bd-b4da-b037378d79f2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:46c1deb3-55e2-44bd-b4da-b037378d79f2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:45:26 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-2611c1ed-c376-409f-aec3-28b5c19f604c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:46c1deb3-55e2-44bd-b4da-b037378d79f2, portal: 172.16.0.220,3260]
Nov 06 15:45:26 user nova-compute[75337]: Login to [iface: default, target: iqn.2010-10.org.openstack:46c1deb3-55e2-44bd-b4da-b037378d79f2, portal: 172.16.0.220,3260] successful.
Nov 06 15:45:26 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:45:26 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46c1deb3-55e2-44bd-b4da-b037378d79f2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:45:26 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46c1deb3-55e2-44bd-b4da-b037378d79f2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:45:26 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b29e9ca-a747-49f2-ab0b-c53c48c86727]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:45:26 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-2611c1ed-c376-409f-aec3-28b5c19f604c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:45:26 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:45:26 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:45:26 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[937ac0b9-423e-49ed-a2cf-ff05e440295e]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f5503fc-8cc8-46fa-8450-d967f769a947 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c1deb3-55e2-44bd-b4da-b037378d79f2 (non-flash)\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:45:26 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-2611c1ed-c376-409f-aec3-28b5c19f604c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)
Nov 06 15:45:26 user nova-compute[75337]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f5503fc-8cc8-46fa-8450-d967f769a947 (non-flash)
Nov 06 15:45:26 user nova-compute[75337]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e (non-flash)
Nov 06 15:45:26 user nova-compute[75337]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c1deb3-55e2-44bd-b4da-b037378d79f2 (non-flash)
Nov 06 15:45:26 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 15:45:26 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-2611c1ed-c376-409f-aec3-28b5c19f604c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)
Nov 06 15:45:26 user nova-compute[75337]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f5503fc-8cc8-46fa-8450-d967f769a947 (non-flash)
Nov 06 15:45:26 user nova-compute[75337]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e (non-flash)
Nov 06 15:45:26 user nova-compute[75337]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c1deb3-55e2-44bd-b4da-b037378d79f2 (non-flash)
Nov 06 15:45:26 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 15:45:26 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-2611c1ed-c376-409f-aec3-28b5c19f604c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:46c1deb3-55e2-44bd-b4da-b037378d79f2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.420s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 15:45:26 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-2611c1ed-c376-409f-aec3-28b5c19f604c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Connected to 172.16.0.220:3260 {{(pid=75337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 15:45:26 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-2611c1ed-c376-409f-aec3-28b5c19f604c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] HCTL ('36', '-', '-', 0) found on session 16 with lun 0 {{(pid=75337) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 15:45:26 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-2611c1ed-c376-409f-aec3-28b5c19f604c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75337) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 15:45:26 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:45:26 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.026s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:45:26 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b77ea80-c1a1-4d28-ac3b-c0b105a0a7d3]: (4, ('- - 0', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:45:26 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-2611c1ed-c376-409f-aec3-28b5c19f604c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Searching for a device in session 16 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75337) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 15:45:26 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-2611c1ed-c376-409f-aec3-28b5c19f604c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:46c1deb3-55e2-44bd-b4da-b037378d79f2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rYquUSgD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 15:45:27 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-2611c1ed-c376-409f-aec3-28b5c19f604c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.460s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 15:45:27 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-2611c1ed-c376-409f-aec3-28b5c19f604c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] <== connect_volume: return (1462ms) {'type': 'block', 'scsi_wwn': '23064373339613563', 'path': '/dev/sde'} {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 15:45:27 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2611c1ed-c376-409f-aec3-28b5c19f604c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 4015f2f7-a176-46aa-bdff-58d164058e15] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23064373339613563', 'path': '/dev/sde'} {{(pid=75337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 15:45:27 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-2611c1ed-c376-409f-aec3-28b5c19f604c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T15:44:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-791013206',display_name='tempest-TestVolumeBootPattern-server-791013206',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-791013206',id=15,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='915211c6a2734c36b34ff92a56b085f6',ramdisk_id='',reservation_id='r-5hb0rxgl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1055092640',owner_user_name='tempest-TestVolumeBootPattern-1055092640-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T15:44:52Z,user_data=None,user_id='bb8d5f0200124588be1cfde107341a45',uuid=4015f2f7-a176-46aa-bdff-58d164058e15,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2ae7d4fb-8a67-4570-aa53-56cbaa82b78f", "address": "fa:16:3e:ea:78:b5", "network": {"id": "4e47319f-de1d-4dfe-9915-7d2d5131704d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-895093240-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "915211c6a2734c36b34ff92a56b085f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ae7d4fb-8a", "ovs_interfaceid": "2ae7d4fb-8a67-4570-aa53-56cbaa82b78f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75337) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 15:45:27 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-2611c1ed-c376-409f-aec3-28b5c19f604c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Converting VIF {"id": "2ae7d4fb-8a67-4570-aa53-56cbaa82b78f", "address": "fa:16:3e:ea:78:b5", "network": {"id": "4e47319f-de1d-4dfe-9915-7d2d5131704d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-895093240-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "915211c6a2734c36b34ff92a56b085f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ae7d4fb-8a", "ovs_interfaceid": "2ae7d4fb-8a67-4570-aa53-56cbaa82b78f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 15:45:27 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-2611c1ed-c376-409f-aec3-28b5c19f604c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:78:b5,bridge_name='br-int',has_traffic_filtering=True,id=2ae7d4fb-8a67-4570-aa53-56cbaa82b78f,network=Network(4e47319f-de1d-4dfe-9915-7d2d5131704d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ae7d4fb-8a') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 15:45:27 user nova-compute[75337]: DEBUG nova.objects.instance [None req-2611c1ed-c376-409f-aec3-28b5c19f604c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Lazy-loading 'pci_devices' on Instance uuid 4015f2f7-a176-46aa-bdff-58d164058e15 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 15:45:27 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-2611c1ed-c376-409f-aec3-28b5c19f604c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 4015f2f7-a176-46aa-bdff-58d164058e15] End _get_guest_xml xml=<domain type="kvm">
Nov 06 15:45:27 user nova-compute[75337]:   <uuid>4015f2f7-a176-46aa-bdff-58d164058e15</uuid>
Nov 06 15:45:27 user nova-compute[75337]:   <name>instance-0000000f</name>
Nov 06 15:45:27 user nova-compute[75337]:   <memory>524288</memory>
Nov 06 15:45:27 user nova-compute[75337]:   <vcpu>1</vcpu>
Nov 06 15:45:27 user nova-compute[75337]:   <metadata>
Nov 06 15:45:27 user nova-compute[75337]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 15:45:27 user nova-compute[75337]:       <nova:package version="0.0.0"/>
Nov 06 15:45:27 user nova-compute[75337]:       <nova:name>tempest-TestVolumeBootPattern-server-791013206</nova:name>
Nov 06 15:45:27 user nova-compute[75337]:       <nova:creationTime>2023-11-06 15:45:25</nova:creationTime>
Nov 06 15:45:27 user nova-compute[75337]:       <nova:flavor name="m1.tiny">
Nov 06 15:45:27 user nova-compute[75337]:         <nova:memory>512</nova:memory>
Nov 06 15:45:27 user nova-compute[75337]:         <nova:disk>1</nova:disk>
Nov 06 15:45:27 user nova-compute[75337]:         <nova:swap>0</nova:swap>
Nov 06 15:45:27 user nova-compute[75337]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 15:45:27 user nova-compute[75337]:         <nova:vcpus>1</nova:vcpus>
Nov 06 15:45:27 user nova-compute[75337]:       </nova:flavor>
Nov 06 15:45:27 user nova-compute[75337]:       <nova:owner>
Nov 06 15:45:27 user nova-compute[75337]:         <nova:user uuid="bb8d5f0200124588be1cfde107341a45">tempest-TestVolumeBootPattern-1055092640-project-member</nova:user>
Nov 06 15:45:27 user nova-compute[75337]:         <nova:project uuid="915211c6a2734c36b34ff92a56b085f6">tempest-TestVolumeBootPattern-1055092640</nova:project>
Nov 06 15:45:27 user nova-compute[75337]:       </nova:owner>
Nov 06 15:45:27 user nova-compute[75337]:       <nova:ports>
Nov 06 15:45:27 user nova-compute[75337]:         <nova:port uuid="2ae7d4fb-8a67-4570-aa53-56cbaa82b78f">
Nov 06 15:45:27 user nova-compute[75337]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 06 15:45:27 user nova-compute[75337]:         </nova:port>
Nov 06 15:45:27 user nova-compute[75337]:       </nova:ports>
Nov 06 15:45:27 user nova-compute[75337]:     </nova:instance>
Nov 06 15:45:27 user nova-compute[75337]:   </metadata>
Nov 06 15:45:27 user nova-compute[75337]:   <sysinfo type="smbios">
Nov 06 15:45:27 user nova-compute[75337]:     <system>
Nov 06 15:45:27 user nova-compute[75337]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 15:45:27 user nova-compute[75337]:       <entry name="product">OpenStack Nova</entry>
Nov 06 15:45:27 user nova-compute[75337]:       <entry name="version">0.0.0</entry>
Nov 06 15:45:27 user nova-compute[75337]:       <entry name="serial">4015f2f7-a176-46aa-bdff-58d164058e15</entry>
Nov 06 15:45:27 user nova-compute[75337]:       <entry name="uuid">4015f2f7-a176-46aa-bdff-58d164058e15</entry>
Nov 06 15:45:27 user nova-compute[75337]:       <entry name="family">Virtual Machine</entry>
Nov 06 15:45:27 user nova-compute[75337]:     </system>
Nov 06 15:45:27 user nova-compute[75337]:   </sysinfo>
Nov 06 15:45:27 user nova-compute[75337]:   <os>
Nov 06 15:45:27 user nova-compute[75337]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 15:45:27 user nova-compute[75337]:     <boot dev="hd"/>
Nov 06 15:45:27 user nova-compute[75337]:     <smbios mode="sysinfo"/>
Nov 06 15:45:27 user nova-compute[75337]:   </os>
Nov 06 15:45:27 user nova-compute[75337]:   <features>
Nov 06 15:45:27 user nova-compute[75337]:     <acpi/>
Nov 06 15:45:27 user nova-compute[75337]:     <apic/>
Nov 06 15:45:27 user nova-compute[75337]:     <vmcoreinfo/>
Nov 06 15:45:27 user nova-compute[75337]:   </features>
Nov 06 15:45:27 user nova-compute[75337]:   <clock offset="utc">
Nov 06 15:45:27 user nova-compute[75337]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 15:45:27 user nova-compute[75337]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 15:45:27 user nova-compute[75337]:     <timer name="hpet" present="no"/>
Nov 06 15:45:27 user nova-compute[75337]:   </clock>
Nov 06 15:45:27 user nova-compute[75337]:   <cpu mode="custom" match="exact">
Nov 06 15:45:27 user nova-compute[75337]:     <model>Nehalem</model>
Nov 06 15:45:27 user nova-compute[75337]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 15:45:27 user nova-compute[75337]:   </cpu>
Nov 06 15:45:27 user nova-compute[75337]:   <devices>
Nov 06 15:45:27 user nova-compute[75337]:     <disk type="block" device="disk">
Nov 06 15:45:27 user nova-compute[75337]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 15:45:27 user nova-compute[75337]:       <source dev="/dev/sde"/>
Nov 06 15:45:27 user nova-compute[75337]:       <target dev="vda" bus="virtio"/>
Nov 06 15:45:27 user nova-compute[75337]:       <serial>46c1deb3-55e2-44bd-b4da-b037378d79f2</serial>
Nov 06 15:45:27 user nova-compute[75337]:     </disk>
Nov 06 15:45:27 user nova-compute[75337]:     <interface type="ethernet">
Nov 06 15:45:27 user nova-compute[75337]:       <mac address="fa:16:3e:ea:78:b5"/>
Nov 06 15:45:27 user nova-compute[75337]:       <model type="virtio"/>
Nov 06 15:45:27 user nova-compute[75337]:       <mtu size="1442"/>
Nov 06 15:45:27 user nova-compute[75337]:       <target dev="tap2ae7d4fb-8a"/>
Nov 06 15:45:27 user nova-compute[75337]:     </interface>
Nov 06 15:45:27 user nova-compute[75337]:     <serial type="pty">
Nov 06 15:45:27 user nova-compute[75337]:       <log file="/opt/stack/data/nova/instances/4015f2f7-a176-46aa-bdff-58d164058e15/console.log" append="off"/>
Nov 06 15:45:27 user nova-compute[75337]:     </serial>
Nov 06 15:45:27 user nova-compute[75337]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 15:45:27 user nova-compute[75337]:     <video>
Nov 06 15:45:27 user nova-compute[75337]:       <model type="virtio"/>
Nov 06 15:45:27 user nova-compute[75337]:     </video>
Nov 06 15:45:27 user nova-compute[75337]:     <rng model="virtio">
Nov 06 15:45:27 user nova-compute[75337]:       <backend model="random">/dev/urandom</backend>
Nov 06 15:45:27 user nova-compute[75337]:     </rng>
Nov 06 15:45:27 user nova-compute[75337]:     <controller type="usb" index="0" model="none"/>
Nov 06 15:45:27 user nova-compute[75337]:     <memballoon model="virtio">
Nov 06 15:45:27 user nova-compute[75337]:       <stats period="10"/>
Nov 06 15:45:27 user nova-compute[75337]:     </memballoon>
Nov 06 15:45:27 user nova-compute[75337]:   </devices>
Nov 06 15:45:27 user nova-compute[75337]: </domain>
Nov 06 15:45:27 user nova-compute[75337]:  {{(pid=75337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 15:45:27 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-2611c1ed-c376-409f-aec3-28b5c19f604c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T15:44:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-791013206',display_name='tempest-TestVolumeBootPattern-server-791013206',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-791013206',id=15,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='915211c6a2734c36b34ff92a56b085f6',ramdisk_id='',reservation_id='r-5hb0rxgl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1055092640',owner_user_name='tempest-TestVolumeBootPattern-1055092640-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T15:44:52Z,user_data=None,user_id='bb8d5f0200124588be1cfde107341a45',uuid=4015f2f7-a176-46aa-bdff-58d164058e15,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2ae7d4fb-8a67-4570-aa53-56cbaa82b78f", "address": "fa:16:3e:ea:78:b5", "network": {"id": "4e47319f-de1d-4dfe-9915-7d2d5131704d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-895093240-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "915211c6a2734c36b34ff92a56b085f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ae7d4fb-8a", "ovs_interfaceid": "2ae7d4fb-8a67-4570-aa53-56cbaa82b78f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 15:45:27 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-2611c1ed-c376-409f-aec3-28b5c19f604c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Converting VIF {"id": "2ae7d4fb-8a67-4570-aa53-56cbaa82b78f", "address": "fa:16:3e:ea:78:b5", "network": {"id": "4e47319f-de1d-4dfe-9915-7d2d5131704d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-895093240-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "915211c6a2734c36b34ff92a56b085f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ae7d4fb-8a", "ovs_interfaceid": "2ae7d4fb-8a67-4570-aa53-56cbaa82b78f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 15:45:27 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-2611c1ed-c376-409f-aec3-28b5c19f604c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:78:b5,bridge_name='br-int',has_traffic_filtering=True,id=2ae7d4fb-8a67-4570-aa53-56cbaa82b78f,network=Network(4e47319f-de1d-4dfe-9915-7d2d5131704d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ae7d4fb-8a') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 15:45:27 user nova-compute[75337]: DEBUG os_vif [None req-2611c1ed-c376-409f-aec3-28b5c19f604c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:78:b5,bridge_name='br-int',has_traffic_filtering=True,id=2ae7d4fb-8a67-4570-aa53-56cbaa82b78f,network=Network(4e47319f-de1d-4dfe-9915-7d2d5131704d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ae7d4fb-8a') {{(pid=75337) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 15:45:27 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:45:27 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:45:27 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 15:45:27 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:45:27 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '67a55eca-d65a-5cb7-aede-997e4bf636c3', '_type': 'linux-noop'}}, row=False) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:45:27 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:45:27 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:45:27 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:45:27 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:45:27 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2ae7d4fb-8a, may_exist=True, interface_attrs={}) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:45:27 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2ae7d4fb-8a, col_values=(('qos', UUID('e2fa2864-450e-4478-95f5-5b55fe9b614e')),), if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:45:27 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2ae7d4fb-8a, col_values=(('external_ids', {'iface-id': '2ae7d4fb-8a67-4570-aa53-56cbaa82b78f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ea:78:b5', 'vm-uuid': '4015f2f7-a176-46aa-bdff-58d164058e15'}),), if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:45:27 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:45:27 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:45:27 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:45:27 user nova-compute[75337]: INFO os_vif [None req-2611c1ed-c376-409f-aec3-28b5c19f604c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:78:b5,bridge_name='br-int',has_traffic_filtering=True,id=2ae7d4fb-8a67-4570-aa53-56cbaa82b78f,network=Network(4e47319f-de1d-4dfe-9915-7d2d5131704d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ae7d4fb-8a')
Nov 06 15:45:27 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-2611c1ed-c376-409f-aec3-28b5c19f604c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] No BDM found with device name vda, not building metadata. {{(pid=75337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 15:45:27 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-2611c1ed-c376-409f-aec3-28b5c19f604c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] No VIF found with MAC fa:16:3e:ea:78:b5, not building metadata {{(pid=75337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 15:45:27 user nova-compute[75337]: INFO nova.compute.manager [None req-cf9fbed9-681c-41ec-bf44-9914fab759e1 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: 1fa4c927-7485-4f34-94bd-9e20358904b6] Unrescuing
Nov 06 15:45:27 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-cf9fbed9-681c-41ec-bf44-9914fab759e1 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Acquiring lock "refresh_cache-1fa4c927-7485-4f34-94bd-9e20358904b6" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 15:45:27 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-cf9fbed9-681c-41ec-bf44-9914fab759e1 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Acquired lock "refresh_cache-1fa4c927-7485-4f34-94bd-9e20358904b6" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 15:45:27 user nova-compute[75337]: DEBUG nova.network.neutron [None req-cf9fbed9-681c-41ec-bf44-9914fab759e1 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: 1fa4c927-7485-4f34-94bd-9e20358904b6] Building network info cache for instance {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 15:45:27 user nova-compute[75337]: DEBUG nova.network.neutron [None req-cf9fbed9-681c-41ec-bf44-9914fab759e1 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: 1fa4c927-7485-4f34-94bd-9e20358904b6] Updating instance_info_cache with network_info: [{"id": "3812cc74-01db-4b2b-815c-770420051e1b", "address": "fa:16:3e:f4:aa:7b", "network": {"id": "736be000-ee94-41fd-9de0-f2f885ec9be7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1715443852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb76b5b0f2b24f1c84a92403176bcc00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3812cc74-01", "ovs_interfaceid": "3812cc74-01db-4b2b-815c-770420051e1b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:45:27 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-cf9fbed9-681c-41ec-bf44-9914fab759e1 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Releasing lock "refresh_cache-1fa4c927-7485-4f34-94bd-9e20358904b6" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 15:45:27 user nova-compute[75337]: DEBUG nova.objects.instance [None req-cf9fbed9-681c-41ec-bf44-9914fab759e1 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Lazy-loading 'flavor' on Instance uuid 1fa4c927-7485-4f34-94bd-9e20358904b6 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 15:45:28 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:45:28 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:45:28 user nova-compute[75337]: DEBUG nova.compute.manager [req-e997c803-81c7-4de5-8324-a1b020552719 req-084e71ff-f046-4224-b827-c11454dbf23f service nova] [instance: 1fa4c927-7485-4f34-94bd-9e20358904b6] Received event network-vif-unplugged-3812cc74-01db-4b2b-815c-770420051e1b {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:45:28 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-e997c803-81c7-4de5-8324-a1b020552719 req-084e71ff-f046-4224-b827-c11454dbf23f service nova] Acquiring lock "1fa4c927-7485-4f34-94bd-9e20358904b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:45:28 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-e997c803-81c7-4de5-8324-a1b020552719 req-084e71ff-f046-4224-b827-c11454dbf23f service nova] Lock "1fa4c927-7485-4f34-94bd-9e20358904b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:45:28 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-e997c803-81c7-4de5-8324-a1b020552719 req-084e71ff-f046-4224-b827-c11454dbf23f service nova] Lock "1fa4c927-7485-4f34-94bd-9e20358904b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:45:28 user nova-compute[75337]: DEBUG nova.compute.manager [req-e997c803-81c7-4de5-8324-a1b020552719 req-084e71ff-f046-4224-b827-c11454dbf23f service nova] [instance: 1fa4c927-7485-4f34-94bd-9e20358904b6] No waiting events found dispatching network-vif-unplugged-3812cc74-01db-4b2b-815c-770420051e1b {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:45:28 user nova-compute[75337]: WARNING nova.compute.manager [req-e997c803-81c7-4de5-8324-a1b020552719 req-084e71ff-f046-4224-b827-c11454dbf23f service nova] [instance: 1fa4c927-7485-4f34-94bd-9e20358904b6] Received unexpected event network-vif-unplugged-3812cc74-01db-4b2b-815c-770420051e1b for instance with vm_state rescued and task_state unrescuing.
Nov 06 15:45:28 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:45:28 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:45:28 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:45:29 user nova-compute[75337]: DEBUG nova.compute.manager [None req-acf7fc4c-691c-435a-9562-62e43f5b33cf tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] [instance: 7a6b16de-4506-432f-97f9-f083243dc047] Start spawning the instance on the hypervisor. {{(pid=75337) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 15:45:29 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-acf7fc4c-691c-435a-9562-62e43f5b33cf tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] [instance: 7a6b16de-4506-432f-97f9-f083243dc047] Creating instance directory {{(pid=75337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 15:45:29 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-acf7fc4c-691c-435a-9562-62e43f5b33cf tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] [instance: 7a6b16de-4506-432f-97f9-f083243dc047] Creating image(s)
Nov 06 15:45:29 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-acf7fc4c-691c-435a-9562-62e43f5b33cf tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] [instance: 7a6b16de-4506-432f-97f9-f083243dc047] Did not create local disks {{(pid=75337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 06 15:45:29 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-acf7fc4c-691c-435a-9562-62e43f5b33cf tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] [instance: 7a6b16de-4506-432f-97f9-f083243dc047] Ensure instance console log exists: /opt/stack/data/nova/instances/7a6b16de-4506-432f-97f9-f083243dc047/console.log {{(pid=75337) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 15:45:29 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-acf7fc4c-691c-435a-9562-62e43f5b33cf tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:45:29 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-acf7fc4c-691c-435a-9562-62e43f5b33cf tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:45:29 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-acf7fc4c-691c-435a-9562-62e43f5b33cf tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:45:29 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-acf7fc4c-691c-435a-9562-62e43f5b33cf tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] [instance: 7a6b16de-4506-432f-97f9-f083243dc047] Start _get_guest_xml network_info=[{"id": "4e4e1bfc-ebf9-41eb-81be-d1c34001dcff", "address": "fa:16:3e:d1:64:1b", "network": {"id": "ffb95242-a859-4479-a4c8-2b8fa68b53fc", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-976415891-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed8fbcf3ad3c42a08501891748de8abc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e4e1bfc-eb", "ovs_interfaceid": "4e4e1bfc-ebf9-41eb-81be-d1c34001dcff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'attachment_id': '732a7d94-60f8-4b35-ba6b-8e7c89612ebe', 'guest_format': None, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'maEwpfvl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7a6b16de-4506-432f-97f9-f083243dc047', 'attached_at': '', 'detached_at': '', 'volume_id': '15793a67-283e-461b-b16a-a42e1b3ea8e6', 'serial': '15793a67-283e-461b-b16a-a42e1b3ea8e6'}, 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=75337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 15:45:29 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-acf7fc4c-691c-435a-9562-62e43f5b33cf tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 15:45:29 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-acf7fc4c-691c-435a-9562-62e43f5b33cf tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 15:45:29 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-acf7fc4c-691c-435a-9562-62e43f5b33cf tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 15:45:29 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-acf7fc4c-691c-435a-9562-62e43f5b33cf tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] CPU controller missing on host. {{(pid=75337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 15:45:29 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-acf7fc4c-691c-435a-9562-62e43f5b33cf tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 15:45:29 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-acf7fc4c-691c-435a-9562-62e43f5b33cf tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] CPU controller found on host. {{(pid=75337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 15:45:29 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-acf7fc4c-691c-435a-9562-62e43f5b33cf tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75337) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 15:45:29 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-acf7fc4c-691c-435a-9562-62e43f5b33cf tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T15:34:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 15:45:29 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-acf7fc4c-691c-435a-9562-62e43f5b33cf tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] Flavor limits 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 15:45:29 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-acf7fc4c-691c-435a-9562-62e43f5b33cf tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] Image limits 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 15:45:29 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-acf7fc4c-691c-435a-9562-62e43f5b33cf tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] Flavor pref 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 15:45:29 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-acf7fc4c-691c-435a-9562-62e43f5b33cf tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] Image pref 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 15:45:29 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-acf7fc4c-691c-435a-9562-62e43f5b33cf tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 15:45:29 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-acf7fc4c-691c-435a-9562-62e43f5b33cf tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 15:45:29 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-acf7fc4c-691c-435a-9562-62e43f5b33cf tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 15:45:29 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-acf7fc4c-691c-435a-9562-62e43f5b33cf tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] Got 1 possible topologies {{(pid=75337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 15:45:29 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-acf7fc4c-691c-435a-9562-62e43f5b33cf tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 15:45:29 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-acf7fc4c-691c-435a-9562-62e43f5b33cf tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 15:45:29 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-acf7fc4c-691c-435a-9562-62e43f5b33cf tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] [instance: 7a6b16de-4506-432f-97f9-f083243dc047] Calling os-brick to attach iSCSI Volume {{(pid=75337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 15:45:29 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-acf7fc4c-691c-435a-9562-62e43f5b33cf tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2abc33d0c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'maEwpfvl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 15:45:29 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-acf7fc4c-691c-435a-9562-62e43f5b33cf tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 15:45:29 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-acf7fc4c-691c-435a-9562-62e43f5b33cf tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 15:45:29 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-acf7fc4c-691c-435a-9562-62e43f5b33cf tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 15:45:29 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-acf7fc4c-691c-435a-9562-62e43f5b33cf tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 15:45:29 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-acf7fc4c-691c-435a-9562-62e43f5b33cf tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 15:45:29 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-acf7fc4c-691c-435a-9562-62e43f5b33cf tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 15:45:29 user nova-compute[75337]: INFO os_brick.initiator.connectors.iscsi [None req-acf7fc4c-691c-435a-9562-62e43f5b33cf tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 15:45:29 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6 -p 172.16.0.220:3260 {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:45:29 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:45:29 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[109a1e0d-b3fe-4633-97fb-e570cc9770ca]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:45:29 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-acf7fc4c-691c-435a-9562-62e43f5b33cf tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 15:45:29 user nova-compute[75337]:  {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:45:29 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6 -p 172.16.0.220:3260 --interface default --op new {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:45:29 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:45:29 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.034s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:45:29 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[884a3400-87d7-4f38-a10b-24ed3eb81c97]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6] added\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:45:29 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-acf7fc4c-691c-435a-9562-62e43f5b33cf tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6] added
Nov 06 15:45:29 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:45:29 user nova-compute[75337]: INFO nova.virt.libvirt.driver [-] [instance: 1fa4c927-7485-4f34-94bd-9e20358904b6] Instance destroyed successfully.
Nov 06 15:45:29 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:45:29 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:45:29 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:45:29 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:45:29 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.033s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:45:29 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[04f543aa-8d7b-4ddb-9bb8-baabd4aeff73]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:45:29 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-acf7fc4c-691c-435a-9562-62e43f5b33cf tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:45:29 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:45:29 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.032s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:45:29 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[53cf844f-13bd-4bf3-b7ab-3bd1183909aa]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:45:29 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-acf7fc4c-691c-435a-9562-62e43f5b33cf tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:45:29 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v maEwpfvl {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:45:29 user nova-compute[75337]: DEBUG nova.objects.instance [None req-31465917-4273-4134-aee2-67aad4d853c3 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Lazy-loading 'flavor' on Instance uuid 8a600bd8-b94a-4242-a443-c2defb002280 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 15:45:29 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v maEwpfvl" returned: 0 in 0.032s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:45:29 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[22fd9ecf-daa9-4ccb-8f70-6c98fef2c6ca]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:45:29 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-acf7fc4c-691c-435a-9562-62e43f5b33cf tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'maEwpfvl'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:45:29 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:45:29 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:45:29 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[895fc677-de83-4747-8604-06969a775fd8]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:45:29 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-acf7fc4c-691c-435a-9562-62e43f5b33cf tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:45:29 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:45:29 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-31465917-4273-4134-aee2-67aad4d853c3 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Lock "8a600bd8-b94a-4242-a443-c2defb002280" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 33.009s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:45:29 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:45:29 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[467858e2-c8bf-46f4-99b9-d272553c2749]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f5503fc-8cc8-46fa-8450-d967f769a947 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c1deb3-55e2-44bd-b4da-b037378d79f2 (non-flash)\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:45:29 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-acf7fc4c-691c-435a-9562-62e43f5b33cf tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)
Nov 06 15:45:29 user nova-compute[75337]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f5503fc-8cc8-46fa-8450-d967f769a947 (non-flash)
Nov 06 15:45:29 user nova-compute[75337]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e (non-flash)
Nov 06 15:45:29 user nova-compute[75337]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c1deb3-55e2-44bd-b4da-b037378d79f2 (non-flash)
Nov 06 15:45:29 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 15:45:29 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-acf7fc4c-691c-435a-9562-62e43f5b33cf tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)
Nov 06 15:45:29 user nova-compute[75337]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f5503fc-8cc8-46fa-8450-d967f769a947 (non-flash)
Nov 06 15:45:29 user nova-compute[75337]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e (non-flash)
Nov 06 15:45:29 user nova-compute[75337]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c1deb3-55e2-44bd-b4da-b037378d79f2 (non-flash)
Nov 06 15:45:29 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 15:45:29 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6 -p 172.16.0.220:3260 --login {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:45:29 user nova-compute[75337]: DEBUG nova.compute.manager [req-2abed96b-1512-44a2-8bf3-5ea1a402bbce req-d515136e-6d1c-4d3f-be9f-7d8e9c6a210d service nova] [instance: 4015f2f7-a176-46aa-bdff-58d164058e15] Received event network-vif-plugged-2ae7d4fb-8a67-4570-aa53-56cbaa82b78f {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:45:29 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-2abed96b-1512-44a2-8bf3-5ea1a402bbce req-d515136e-6d1c-4d3f-be9f-7d8e9c6a210d service nova] Acquiring lock "4015f2f7-a176-46aa-bdff-58d164058e15-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:45:29 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-2abed96b-1512-44a2-8bf3-5ea1a402bbce req-d515136e-6d1c-4d3f-be9f-7d8e9c6a210d service nova] Lock "4015f2f7-a176-46aa-bdff-58d164058e15-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:45:29 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-2abed96b-1512-44a2-8bf3-5ea1a402bbce req-d515136e-6d1c-4d3f-be9f-7d8e9c6a210d service nova] Lock "4015f2f7-a176-46aa-bdff-58d164058e15-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:45:29 user nova-compute[75337]: DEBUG nova.compute.manager [req-2abed96b-1512-44a2-8bf3-5ea1a402bbce req-d515136e-6d1c-4d3f-be9f-7d8e9c6a210d service nova] [instance: 4015f2f7-a176-46aa-bdff-58d164058e15] No waiting events found dispatching network-vif-plugged-2ae7d4fb-8a67-4570-aa53-56cbaa82b78f {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:45:29 user nova-compute[75337]: WARNING nova.compute.manager [req-2abed96b-1512-44a2-8bf3-5ea1a402bbce req-d515136e-6d1c-4d3f-be9f-7d8e9c6a210d service nova] [instance: 4015f2f7-a176-46aa-bdff-58d164058e15] Received unexpected event network-vif-plugged-2ae7d4fb-8a67-4570-aa53-56cbaa82b78f for instance with vm_state building and task_state spawning.
Nov 06 15:45:29 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6 -p 172.16.0.220:3260 --login" returned: 0 in 0.178s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:45:29 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[99d3146e-1c2a-42cb-889a-a90c0dad8db6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:45:29 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-acf7fc4c-691c-435a-9562-62e43f5b33cf tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6, portal: 172.16.0.220,3260]
Nov 06 15:45:29 user nova-compute[75337]: Login to [iface: default, target: iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6, portal: 172.16.0.220,3260] successful.
Nov 06 15:45:29 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:45:29 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:45:29 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.040s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:45:29 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fddd93d-85ad-4b4a-9ce4-6531fbb26d07]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:45:29 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-acf7fc4c-691c-435a-9562-62e43f5b33cf tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:45:29 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:45:29 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:45:29 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[94a85136-9a94-42b0-98f8-6ace3898b59d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f5503fc-8cc8-46fa-8450-d967f769a947 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c1deb3-55e2-44bd-b4da-b037378d79f2 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6 (non-flash)\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:45:29 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-acf7fc4c-691c-435a-9562-62e43f5b33cf tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)
Nov 06 15:45:29 user nova-compute[75337]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f5503fc-8cc8-46fa-8450-d967f769a947 (non-flash)
Nov 06 15:45:29 user nova-compute[75337]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e (non-flash)
Nov 06 15:45:29 user nova-compute[75337]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c1deb3-55e2-44bd-b4da-b037378d79f2 (non-flash)
Nov 06 15:45:29 user nova-compute[75337]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6 (non-flash)
Nov 06 15:45:29 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 15:45:29 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-acf7fc4c-691c-435a-9562-62e43f5b33cf tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)
Nov 06 15:45:29 user nova-compute[75337]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f5503fc-8cc8-46fa-8450-d967f769a947 (non-flash)
Nov 06 15:45:29 user nova-compute[75337]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e (non-flash)
Nov 06 15:45:29 user nova-compute[75337]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c1deb3-55e2-44bd-b4da-b037378d79f2 (non-flash)
Nov 06 15:45:29 user nova-compute[75337]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6 (non-flash)
Nov 06 15:45:29 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 15:45:29 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-acf7fc4c-691c-435a-9562-62e43f5b33cf tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.510s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 15:45:29 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-acf7fc4c-691c-435a-9562-62e43f5b33cf tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] Connected to 172.16.0.220:3260 {{(pid=75337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 15:45:29 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-acf7fc4c-691c-435a-9562-62e43f5b33cf tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] HCTL ('37', '-', '-', 0) found on session 17 with lun 0 {{(pid=75337) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 15:45:29 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-acf7fc4c-691c-435a-9562-62e43f5b33cf tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75337) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 15:45:29 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:45:29 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.020s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:45:29 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[243e509c-3b9e-42ed-a889-e4fa9ca6fe32]: (4, ('- - 0', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:45:29 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-acf7fc4c-691c-435a-9562-62e43f5b33cf tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] Searching for a device in session 17 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75337) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 15:45:29 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-acf7fc4c-691c-435a-9562-62e43f5b33cf tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'maEwpfvl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 15:45:29 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:45:29 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:45:29 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:45:30 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:45:30 user nova-compute[75337]: DEBUG nova.compute.manager [req-244e334a-de82-4e8e-8309-f5da6c780ec0 req-618423a4-3a17-4002-84a4-e425e4c238bb service nova] [instance: 1fa4c927-7485-4f34-94bd-9e20358904b6] Received event network-vif-plugged-3812cc74-01db-4b2b-815c-770420051e1b {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:45:30 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-244e334a-de82-4e8e-8309-f5da6c780ec0 req-618423a4-3a17-4002-84a4-e425e4c238bb service nova] Acquiring lock "1fa4c927-7485-4f34-94bd-9e20358904b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:45:30 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-244e334a-de82-4e8e-8309-f5da6c780ec0 req-618423a4-3a17-4002-84a4-e425e4c238bb service nova] Lock "1fa4c927-7485-4f34-94bd-9e20358904b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:45:30 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-244e334a-de82-4e8e-8309-f5da6c780ec0 req-618423a4-3a17-4002-84a4-e425e4c238bb service nova] Lock "1fa4c927-7485-4f34-94bd-9e20358904b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:45:30 user nova-compute[75337]: DEBUG nova.compute.manager [req-244e334a-de82-4e8e-8309-f5da6c780ec0 req-618423a4-3a17-4002-84a4-e425e4c238bb service nova] [instance: 1fa4c927-7485-4f34-94bd-9e20358904b6] No waiting events found dispatching network-vif-plugged-3812cc74-01db-4b2b-815c-770420051e1b {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:45:30 user nova-compute[75337]: WARNING nova.compute.manager [req-244e334a-de82-4e8e-8309-f5da6c780ec0 req-618423a4-3a17-4002-84a4-e425e4c238bb service nova] [instance: 1fa4c927-7485-4f34-94bd-9e20358904b6] Received unexpected event network-vif-plugged-3812cc74-01db-4b2b-815c-770420051e1b for instance with vm_state rescued and task_state unrescuing.
Nov 06 15:45:30 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-acf7fc4c-691c-435a-9562-62e43f5b33cf tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.560s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 15:45:30 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-acf7fc4c-691c-435a-9562-62e43f5b33cf tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] <== connect_volume: return (1561ms) {'type': 'block', 'scsi_wwn': '23538363530323134', 'path': '/dev/sdf'} {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 15:45:30 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-acf7fc4c-691c-435a-9562-62e43f5b33cf tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] [instance: 7a6b16de-4506-432f-97f9-f083243dc047] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23538363530323134', 'path': '/dev/sdf'} {{(pid=75337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 15:45:30 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-acf7fc4c-691c-435a-9562-62e43f5b33cf tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T15:44:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-154622819',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-154622819',id=14,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOQEIvPwsFtYJCxBuAzGJFBj2NMxdPf9zCY8lR96jqahU4yNb1jUNqLm9D/kbYl6impHm2KGg3eQFdJ96Vvx3tPM5bfUf7AgedT0Ye9qKpHUXm2yidVS0pDcdAVMt/qqDw==',key_name='tempest-keypair-1607456997',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ed8fbcf3ad3c42a08501891748de8abc',ramdisk_id='',reservation_id='r-y91vj4ff',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-541966055',owner_user_name='tempest-ServerActionsV293TestJSON-541966055-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T15:44:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='360ca2f8787a424e91dcc73d7c2b5017',uuid=7a6b16de-4506-432f-97f9-f083243dc047,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4e4e1bfc-ebf9-41eb-81be-d1c34001dcff", "address": "fa:16:3e:d1:64:1b", "network": {"id": "ffb95242-a859-4479-a4c8-2b8fa68b53fc", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-976415891-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed8fbcf3ad3c42a08501891748de8abc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e4e1bfc-eb", "ovs_interfaceid": "4e4e1bfc-ebf9-41eb-81be-d1c34001dcff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75337) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 15:45:30 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-acf7fc4c-691c-435a-9562-62e43f5b33cf tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] Converting VIF {"id": "4e4e1bfc-ebf9-41eb-81be-d1c34001dcff", "address": "fa:16:3e:d1:64:1b", "network": {"id": "ffb95242-a859-4479-a4c8-2b8fa68b53fc", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-976415891-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed8fbcf3ad3c42a08501891748de8abc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e4e1bfc-eb", "ovs_interfaceid": "4e4e1bfc-ebf9-41eb-81be-d1c34001dcff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 15:45:30 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-acf7fc4c-691c-435a-9562-62e43f5b33cf tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:64:1b,bridge_name='br-int',has_traffic_filtering=True,id=4e4e1bfc-ebf9-41eb-81be-d1c34001dcff,network=Network(ffb95242-a859-4479-a4c8-2b8fa68b53fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e4e1bfc-eb') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 15:45:30 user nova-compute[75337]: DEBUG nova.objects.instance [None req-acf7fc4c-691c-435a-9562-62e43f5b33cf tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] Lazy-loading 'pci_devices' on Instance uuid 7a6b16de-4506-432f-97f9-f083243dc047 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 15:45:30 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-acf7fc4c-691c-435a-9562-62e43f5b33cf tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] [instance: 7a6b16de-4506-432f-97f9-f083243dc047] End _get_guest_xml xml=<domain type="kvm">
Nov 06 15:45:30 user nova-compute[75337]:   <uuid>7a6b16de-4506-432f-97f9-f083243dc047</uuid>
Nov 06 15:45:30 user nova-compute[75337]:   <name>instance-0000000e</name>
Nov 06 15:45:30 user nova-compute[75337]:   <memory>524288</memory>
Nov 06 15:45:30 user nova-compute[75337]:   <vcpu>1</vcpu>
Nov 06 15:45:30 user nova-compute[75337]:   <metadata>
Nov 06 15:45:30 user nova-compute[75337]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 15:45:30 user nova-compute[75337]:       <nova:package version="0.0.0"/>
Nov 06 15:45:30 user nova-compute[75337]:       <nova:name>tempest-ServerActionsV293TestJSON-server-154622819</nova:name>
Nov 06 15:45:30 user nova-compute[75337]:       <nova:creationTime>2023-11-06 15:45:29</nova:creationTime>
Nov 06 15:45:30 user nova-compute[75337]:       <nova:flavor name="m1.tiny">
Nov 06 15:45:30 user nova-compute[75337]:         <nova:memory>512</nova:memory>
Nov 06 15:45:30 user nova-compute[75337]:         <nova:disk>1</nova:disk>
Nov 06 15:45:30 user nova-compute[75337]:         <nova:swap>0</nova:swap>
Nov 06 15:45:30 user nova-compute[75337]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 15:45:30 user nova-compute[75337]:         <nova:vcpus>1</nova:vcpus>
Nov 06 15:45:30 user nova-compute[75337]:       </nova:flavor>
Nov 06 15:45:30 user nova-compute[75337]:       <nova:owner>
Nov 06 15:45:30 user nova-compute[75337]:         <nova:user uuid="360ca2f8787a424e91dcc73d7c2b5017">tempest-ServerActionsV293TestJSON-541966055-project-member</nova:user>
Nov 06 15:45:30 user nova-compute[75337]:         <nova:project uuid="ed8fbcf3ad3c42a08501891748de8abc">tempest-ServerActionsV293TestJSON-541966055</nova:project>
Nov 06 15:45:30 user nova-compute[75337]:       </nova:owner>
Nov 06 15:45:30 user nova-compute[75337]:       <nova:ports>
Nov 06 15:45:30 user nova-compute[75337]:         <nova:port uuid="4e4e1bfc-ebf9-41eb-81be-d1c34001dcff">
Nov 06 15:45:30 user nova-compute[75337]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 06 15:45:30 user nova-compute[75337]:         </nova:port>
Nov 06 15:45:30 user nova-compute[75337]:       </nova:ports>
Nov 06 15:45:30 user nova-compute[75337]:     </nova:instance>
Nov 06 15:45:30 user nova-compute[75337]:   </metadata>
Nov 06 15:45:30 user nova-compute[75337]:   <sysinfo type="smbios">
Nov 06 15:45:30 user nova-compute[75337]:     <system>
Nov 06 15:45:30 user nova-compute[75337]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 15:45:30 user nova-compute[75337]:       <entry name="product">OpenStack Nova</entry>
Nov 06 15:45:30 user nova-compute[75337]:       <entry name="version">0.0.0</entry>
Nov 06 15:45:30 user nova-compute[75337]:       <entry name="serial">7a6b16de-4506-432f-97f9-f083243dc047</entry>
Nov 06 15:45:30 user nova-compute[75337]:       <entry name="uuid">7a6b16de-4506-432f-97f9-f083243dc047</entry>
Nov 06 15:45:30 user nova-compute[75337]:       <entry name="family">Virtual Machine</entry>
Nov 06 15:45:30 user nova-compute[75337]:     </system>
Nov 06 15:45:30 user nova-compute[75337]:   </sysinfo>
Nov 06 15:45:30 user nova-compute[75337]:   <os>
Nov 06 15:45:30 user nova-compute[75337]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 15:45:30 user nova-compute[75337]:     <boot dev="hd"/>
Nov 06 15:45:30 user nova-compute[75337]:     <smbios mode="sysinfo"/>
Nov 06 15:45:30 user nova-compute[75337]:   </os>
Nov 06 15:45:30 user nova-compute[75337]:   <features>
Nov 06 15:45:30 user nova-compute[75337]:     <acpi/>
Nov 06 15:45:30 user nova-compute[75337]:     <apic/>
Nov 06 15:45:30 user nova-compute[75337]:     <vmcoreinfo/>
Nov 06 15:45:30 user nova-compute[75337]:   </features>
Nov 06 15:45:30 user nova-compute[75337]:   <clock offset="utc">
Nov 06 15:45:30 user nova-compute[75337]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 15:45:30 user nova-compute[75337]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 15:45:30 user nova-compute[75337]:     <timer name="hpet" present="no"/>
Nov 06 15:45:30 user nova-compute[75337]:   </clock>
Nov 06 15:45:30 user nova-compute[75337]:   <cpu mode="custom" match="exact">
Nov 06 15:45:30 user nova-compute[75337]:     <model>Nehalem</model>
Nov 06 15:45:30 user nova-compute[75337]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 15:45:30 user nova-compute[75337]:   </cpu>
Nov 06 15:45:30 user nova-compute[75337]:   <devices>
Nov 06 15:45:30 user nova-compute[75337]:     <disk type="block" device="disk">
Nov 06 15:45:30 user nova-compute[75337]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 15:45:30 user nova-compute[75337]:       <source dev="/dev/sdf"/>
Nov 06 15:45:30 user nova-compute[75337]:       <target dev="vda" bus="virtio"/>
Nov 06 15:45:30 user nova-compute[75337]:       <serial>15793a67-283e-461b-b16a-a42e1b3ea8e6</serial>
Nov 06 15:45:30 user nova-compute[75337]:     </disk>
Nov 06 15:45:30 user nova-compute[75337]:     <interface type="ethernet">
Nov 06 15:45:30 user nova-compute[75337]:       <mac address="fa:16:3e:d1:64:1b"/>
Nov 06 15:45:30 user nova-compute[75337]:       <model type="virtio"/>
Nov 06 15:45:30 user nova-compute[75337]:       <mtu size="1442"/>
Nov 06 15:45:30 user nova-compute[75337]:       <target dev="tap4e4e1bfc-eb"/>
Nov 06 15:45:30 user nova-compute[75337]:     </interface>
Nov 06 15:45:30 user nova-compute[75337]:     <serial type="pty">
Nov 06 15:45:30 user nova-compute[75337]:       <log file="/opt/stack/data/nova/instances/7a6b16de-4506-432f-97f9-f083243dc047/console.log" append="off"/>
Nov 06 15:45:30 user nova-compute[75337]:     </serial>
Nov 06 15:45:30 user nova-compute[75337]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 15:45:30 user nova-compute[75337]:     <video>
Nov 06 15:45:30 user nova-compute[75337]:       <model type="virtio"/>
Nov 06 15:45:30 user nova-compute[75337]:     </video>
Nov 06 15:45:30 user nova-compute[75337]:     <rng model="virtio">
Nov 06 15:45:30 user nova-compute[75337]:       <backend model="random">/dev/urandom</backend>
Nov 06 15:45:30 user nova-compute[75337]:     </rng>
Nov 06 15:45:30 user nova-compute[75337]:     <controller type="usb" index="0" model="none"/>
Nov 06 15:45:30 user nova-compute[75337]:     <memballoon model="virtio">
Nov 06 15:45:30 user nova-compute[75337]:       <stats period="10"/>
Nov 06 15:45:30 user nova-compute[75337]:     </memballoon>
Nov 06 15:45:30 user nova-compute[75337]:   </devices>
Nov 06 15:45:30 user nova-compute[75337]: </domain>
Nov 06 15:45:30 user nova-compute[75337]:  {{(pid=75337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 15:45:30 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-acf7fc4c-691c-435a-9562-62e43f5b33cf tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T15:44:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-154622819',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-154622819',id=14,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOQEIvPwsFtYJCxBuAzGJFBj2NMxdPf9zCY8lR96jqahU4yNb1jUNqLm9D/kbYl6impHm2KGg3eQFdJ96Vvx3tPM5bfUf7AgedT0Ye9qKpHUXm2yidVS0pDcdAVMt/qqDw==',key_name='tempest-keypair-1607456997',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ed8fbcf3ad3c42a08501891748de8abc',ramdisk_id='',reservation_id='r-y91vj4ff',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-541966055',owner_user_name='tempest-ServerActionsV293TestJSON-541966055-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T15:44:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='360ca2f8787a424e91dcc73d7c2b5017',uuid=7a6b16de-4506-432f-97f9-f083243dc047,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4e4e1bfc-ebf9-41eb-81be-d1c34001dcff", "address": "fa:16:3e:d1:64:1b", "network": {"id": "ffb95242-a859-4479-a4c8-2b8fa68b53fc", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-976415891-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed8fbcf3ad3c42a08501891748de8abc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e4e1bfc-eb", "ovs_interfaceid": "4e4e1bfc-ebf9-41eb-81be-d1c34001dcff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 15:45:30 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-acf7fc4c-691c-435a-9562-62e43f5b33cf tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] Converting VIF {"id": "4e4e1bfc-ebf9-41eb-81be-d1c34001dcff", "address": "fa:16:3e:d1:64:1b", "network": {"id": "ffb95242-a859-4479-a4c8-2b8fa68b53fc", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-976415891-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed8fbcf3ad3c42a08501891748de8abc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e4e1bfc-eb", "ovs_interfaceid": "4e4e1bfc-ebf9-41eb-81be-d1c34001dcff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 15:45:30 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-acf7fc4c-691c-435a-9562-62e43f5b33cf tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:64:1b,bridge_name='br-int',has_traffic_filtering=True,id=4e4e1bfc-ebf9-41eb-81be-d1c34001dcff,network=Network(ffb95242-a859-4479-a4c8-2b8fa68b53fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e4e1bfc-eb') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 15:45:30 user nova-compute[75337]: DEBUG os_vif [None req-acf7fc4c-691c-435a-9562-62e43f5b33cf tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:64:1b,bridge_name='br-int',has_traffic_filtering=True,id=4e4e1bfc-ebf9-41eb-81be-d1c34001dcff,network=Network(ffb95242-a859-4479-a4c8-2b8fa68b53fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e4e1bfc-eb') {{(pid=75337) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 15:45:30 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:45:30 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:45:30 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 15:45:30 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:45:30 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ac5ee7cb-a84b-5fd8-887c-b8e54ee8c8d9', '_type': 'linux-noop'}}, row=False) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:45:30 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:45:30 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:45:30 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:45:30 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:45:30 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4e4e1bfc-eb, may_exist=True, interface_attrs={}) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:45:30 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4e4e1bfc-eb, col_values=(('qos', UUID('f91d51cf-557d-4974-8197-e5be2d8c34a1')),), if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:45:30 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4e4e1bfc-eb, col_values=(('external_ids', {'iface-id': '4e4e1bfc-ebf9-41eb-81be-d1c34001dcff', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d1:64:1b', 'vm-uuid': '7a6b16de-4506-432f-97f9-f083243dc047'}),), if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:45:30 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:45:30 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:45:30 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:45:30 user nova-compute[75337]: INFO os_vif [None req-acf7fc4c-691c-435a-9562-62e43f5b33cf tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:64:1b,bridge_name='br-int',has_traffic_filtering=True,id=4e4e1bfc-ebf9-41eb-81be-d1c34001dcff,network=Network(ffb95242-a859-4479-a4c8-2b8fa68b53fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e4e1bfc-eb')
Nov 06 15:45:30 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-acf7fc4c-691c-435a-9562-62e43f5b33cf tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] No BDM found with device name vda, not building metadata. {{(pid=75337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 15:45:30 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-acf7fc4c-691c-435a-9562-62e43f5b33cf tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] No VIF found with MAC fa:16:3e:d1:64:1b, not building metadata {{(pid=75337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 15:45:30 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:45:31 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:45:31 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:45:31 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:45:31 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:45:31 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:45:31 user nova-compute[75337]: INFO nova.compute.manager [None req-afff0d68-f81f-46a5-98b0-554595d1b032 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] [instance: c8cf1ead-a87c-459c-b914-a0e976c9e464] Unrescuing
Nov 06 15:45:31 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-afff0d68-f81f-46a5-98b0-554595d1b032 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Acquiring lock "refresh_cache-c8cf1ead-a87c-459c-b914-a0e976c9e464" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 15:45:31 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-afff0d68-f81f-46a5-98b0-554595d1b032 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Acquired lock "refresh_cache-c8cf1ead-a87c-459c-b914-a0e976c9e464" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 15:45:31 user nova-compute[75337]: DEBUG nova.network.neutron [None req-afff0d68-f81f-46a5-98b0-554595d1b032 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] [instance: c8cf1ead-a87c-459c-b914-a0e976c9e464] Building network info cache for instance {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 15:45:31 user nova-compute[75337]: DEBUG nova.compute.manager [req-aba7e62e-a2ca-4457-a591-ec18f2299419 req-32d7125a-b326-4d6f-b975-dea00bb18598 service nova] [instance: 4015f2f7-a176-46aa-bdff-58d164058e15] Received event network-vif-plugged-2ae7d4fb-8a67-4570-aa53-56cbaa82b78f {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:45:31 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-aba7e62e-a2ca-4457-a591-ec18f2299419 req-32d7125a-b326-4d6f-b975-dea00bb18598 service nova] Acquiring lock "4015f2f7-a176-46aa-bdff-58d164058e15-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:45:31 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-aba7e62e-a2ca-4457-a591-ec18f2299419 req-32d7125a-b326-4d6f-b975-dea00bb18598 service nova] Lock "4015f2f7-a176-46aa-bdff-58d164058e15-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:45:31 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-aba7e62e-a2ca-4457-a591-ec18f2299419 req-32d7125a-b326-4d6f-b975-dea00bb18598 service nova] Lock "4015f2f7-a176-46aa-bdff-58d164058e15-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:45:31 user nova-compute[75337]: DEBUG nova.compute.manager [req-aba7e62e-a2ca-4457-a591-ec18f2299419 req-32d7125a-b326-4d6f-b975-dea00bb18598 service nova] [instance: 4015f2f7-a176-46aa-bdff-58d164058e15] No waiting events found dispatching network-vif-plugged-2ae7d4fb-8a67-4570-aa53-56cbaa82b78f {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:45:31 user nova-compute[75337]: WARNING nova.compute.manager [req-aba7e62e-a2ca-4457-a591-ec18f2299419 req-32d7125a-b326-4d6f-b975-dea00bb18598 service nova] [instance: 4015f2f7-a176-46aa-bdff-58d164058e15] Received unexpected event network-vif-plugged-2ae7d4fb-8a67-4570-aa53-56cbaa82b78f for instance with vm_state building and task_state spawning.
Nov 06 15:45:31 user nova-compute[75337]: DEBUG nova.network.neutron [None req-afff0d68-f81f-46a5-98b0-554595d1b032 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] [instance: c8cf1ead-a87c-459c-b914-a0e976c9e464] Updating instance_info_cache with network_info: [{"id": "b33373f6-0289-4623-90ac-f5c3db0d3681", "address": "fa:16:3e:37:16:66", "network": {"id": "a839a9d1-fdf3-4a72-898b-6829ceef2055", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1927950273-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86f4b41336384a53a3fd22caa0fe8e6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb33373f6-02", "ovs_interfaceid": "b33373f6-0289-4623-90ac-f5c3db0d3681", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:45:31 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-afff0d68-f81f-46a5-98b0-554595d1b032 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Releasing lock "refresh_cache-c8cf1ead-a87c-459c-b914-a0e976c9e464" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 15:45:31 user nova-compute[75337]: DEBUG nova.objects.instance [None req-afff0d68-f81f-46a5-98b0-554595d1b032 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Lazy-loading 'flavor' on Instance uuid c8cf1ead-a87c-459c-b914-a0e976c9e464 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 15:45:32 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:45:32 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:45:32 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:45:32 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:45:32 user nova-compute[75337]: DEBUG nova.compute.manager [req-486a3695-af6f-483a-b251-bbf34b475750 req-cf444ef9-a9cd-48d9-afdd-619a3e412b64 service nova] [instance: 1fa4c927-7485-4f34-94bd-9e20358904b6] Received event network-vif-plugged-3812cc74-01db-4b2b-815c-770420051e1b {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:45:32 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-486a3695-af6f-483a-b251-bbf34b475750 req-cf444ef9-a9cd-48d9-afdd-619a3e412b64 service nova] Acquiring lock "1fa4c927-7485-4f34-94bd-9e20358904b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:45:32 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-486a3695-af6f-483a-b251-bbf34b475750 req-cf444ef9-a9cd-48d9-afdd-619a3e412b64 service nova] Lock "1fa4c927-7485-4f34-94bd-9e20358904b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:45:32 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-486a3695-af6f-483a-b251-bbf34b475750 req-cf444ef9-a9cd-48d9-afdd-619a3e412b64 service nova] Lock "1fa4c927-7485-4f34-94bd-9e20358904b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:45:32 user nova-compute[75337]: DEBUG nova.compute.manager [req-486a3695-af6f-483a-b251-bbf34b475750 req-cf444ef9-a9cd-48d9-afdd-619a3e412b64 service nova] [instance: 1fa4c927-7485-4f34-94bd-9e20358904b6] No waiting events found dispatching network-vif-plugged-3812cc74-01db-4b2b-815c-770420051e1b {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:45:32 user nova-compute[75337]: WARNING nova.compute.manager [req-486a3695-af6f-483a-b251-bbf34b475750 req-cf444ef9-a9cd-48d9-afdd-619a3e412b64 service nova] [instance: 1fa4c927-7485-4f34-94bd-9e20358904b6] Received unexpected event network-vif-plugged-3812cc74-01db-4b2b-815c-770420051e1b for instance with vm_state rescued and task_state unrescuing.
Nov 06 15:45:32 user nova-compute[75337]: DEBUG nova.compute.manager [req-486a3695-af6f-483a-b251-bbf34b475750 req-cf444ef9-a9cd-48d9-afdd-619a3e412b64 service nova] [instance: 1fa4c927-7485-4f34-94bd-9e20358904b6] Received event network-vif-plugged-3812cc74-01db-4b2b-815c-770420051e1b {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:45:32 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-486a3695-af6f-483a-b251-bbf34b475750 req-cf444ef9-a9cd-48d9-afdd-619a3e412b64 service nova] Acquiring lock "1fa4c927-7485-4f34-94bd-9e20358904b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:45:32 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-486a3695-af6f-483a-b251-bbf34b475750 req-cf444ef9-a9cd-48d9-afdd-619a3e412b64 service nova] Lock "1fa4c927-7485-4f34-94bd-9e20358904b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:45:32 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-486a3695-af6f-483a-b251-bbf34b475750 req-cf444ef9-a9cd-48d9-afdd-619a3e412b64 service nova] Lock "1fa4c927-7485-4f34-94bd-9e20358904b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:45:32 user nova-compute[75337]: DEBUG nova.compute.manager [req-486a3695-af6f-483a-b251-bbf34b475750 req-cf444ef9-a9cd-48d9-afdd-619a3e412b64 service nova] [instance: 1fa4c927-7485-4f34-94bd-9e20358904b6] No waiting events found dispatching network-vif-plugged-3812cc74-01db-4b2b-815c-770420051e1b {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:45:32 user nova-compute[75337]: WARNING nova.compute.manager [req-486a3695-af6f-483a-b251-bbf34b475750 req-cf444ef9-a9cd-48d9-afdd-619a3e412b64 service nova] [instance: 1fa4c927-7485-4f34-94bd-9e20358904b6] Received unexpected event network-vif-plugged-3812cc74-01db-4b2b-815c-770420051e1b for instance with vm_state rescued and task_state unrescuing.
Nov 06 15:45:32 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:45:32 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:45:32 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:45:32 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:45:32 user nova-compute[75337]: DEBUG nova.compute.manager [req-f83e69dc-7271-4db7-a3b6-8c59cd88dd34 req-a90498ab-67e4-448b-b6f4-dbbb6c4d9291 service nova] [instance: 7a6b16de-4506-432f-97f9-f083243dc047] Received event network-vif-plugged-4e4e1bfc-ebf9-41eb-81be-d1c34001dcff {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:45:32 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-f83e69dc-7271-4db7-a3b6-8c59cd88dd34 req-a90498ab-67e4-448b-b6f4-dbbb6c4d9291 service nova] Acquiring lock "7a6b16de-4506-432f-97f9-f083243dc047-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:45:32 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-f83e69dc-7271-4db7-a3b6-8c59cd88dd34 req-a90498ab-67e4-448b-b6f4-dbbb6c4d9291 service nova] Lock "7a6b16de-4506-432f-97f9-f083243dc047-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:45:32 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-f83e69dc-7271-4db7-a3b6-8c59cd88dd34 req-a90498ab-67e4-448b-b6f4-dbbb6c4d9291 service nova] Lock "7a6b16de-4506-432f-97f9-f083243dc047-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:45:32 user nova-compute[75337]: DEBUG nova.compute.manager [req-f83e69dc-7271-4db7-a3b6-8c59cd88dd34 req-a90498ab-67e4-448b-b6f4-dbbb6c4d9291 service nova] [instance: 7a6b16de-4506-432f-97f9-f083243dc047] No waiting events found dispatching network-vif-plugged-4e4e1bfc-ebf9-41eb-81be-d1c34001dcff {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:45:32 user nova-compute[75337]: WARNING nova.compute.manager [req-f83e69dc-7271-4db7-a3b6-8c59cd88dd34 req-a90498ab-67e4-448b-b6f4-dbbb6c4d9291 service nova] [instance: 7a6b16de-4506-432f-97f9-f083243dc047] Received unexpected event network-vif-plugged-4e4e1bfc-ebf9-41eb-81be-d1c34001dcff for instance with vm_state building and task_state spawning.
Nov 06 15:45:32 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:45:33 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:45:33 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:45:33 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:45:33 user nova-compute[75337]: INFO nova.virt.libvirt.driver [-] [instance: c8cf1ead-a87c-459c-b914-a0e976c9e464] Instance destroyed successfully.
Nov 06 15:45:33 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:45:33 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:45:33 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:45:33 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:45:33 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:45:33 user nova-compute[75337]: DEBUG nova.compute.manager [req-4e9489af-f984-4c29-bf2a-ee824cb21056 req-d6d08026-91a3-4802-b2aa-b266ad299cc0 service nova] [instance: c8cf1ead-a87c-459c-b914-a0e976c9e464] Received event network-vif-unplugged-b33373f6-0289-4623-90ac-f5c3db0d3681 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:45:33 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-4e9489af-f984-4c29-bf2a-ee824cb21056 req-d6d08026-91a3-4802-b2aa-b266ad299cc0 service nova] Acquiring lock "c8cf1ead-a87c-459c-b914-a0e976c9e464-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:45:33 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-4e9489af-f984-4c29-bf2a-ee824cb21056 req-d6d08026-91a3-4802-b2aa-b266ad299cc0 service nova] Lock "c8cf1ead-a87c-459c-b914-a0e976c9e464-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:45:33 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-4e9489af-f984-4c29-bf2a-ee824cb21056 req-d6d08026-91a3-4802-b2aa-b266ad299cc0 service nova] Lock "c8cf1ead-a87c-459c-b914-a0e976c9e464-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:45:33 user nova-compute[75337]: DEBUG nova.compute.manager [req-4e9489af-f984-4c29-bf2a-ee824cb21056 req-d6d08026-91a3-4802-b2aa-b266ad299cc0 service nova] [instance: c8cf1ead-a87c-459c-b914-a0e976c9e464] No waiting events found dispatching network-vif-unplugged-b33373f6-0289-4623-90ac-f5c3db0d3681 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:45:33 user nova-compute[75337]: WARNING nova.compute.manager [req-4e9489af-f984-4c29-bf2a-ee824cb21056 req-d6d08026-91a3-4802-b2aa-b266ad299cc0 service nova] [instance: c8cf1ead-a87c-459c-b914-a0e976c9e464] Received unexpected event network-vif-unplugged-b33373f6-0289-4623-90ac-f5c3db0d3681 for instance with vm_state rescued and task_state unrescuing.
Nov 06 15:45:33 user nova-compute[75337]: DEBUG nova.compute.manager [req-4e9489af-f984-4c29-bf2a-ee824cb21056 req-d6d08026-91a3-4802-b2aa-b266ad299cc0 service nova] [instance: c8cf1ead-a87c-459c-b914-a0e976c9e464] Received event network-vif-plugged-b33373f6-0289-4623-90ac-f5c3db0d3681 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:45:33 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-4e9489af-f984-4c29-bf2a-ee824cb21056 req-d6d08026-91a3-4802-b2aa-b266ad299cc0 service nova] Acquiring lock "c8cf1ead-a87c-459c-b914-a0e976c9e464-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:45:33 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-4e9489af-f984-4c29-bf2a-ee824cb21056 req-d6d08026-91a3-4802-b2aa-b266ad299cc0 service nova] Lock "c8cf1ead-a87c-459c-b914-a0e976c9e464-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:45:33 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-4e9489af-f984-4c29-bf2a-ee824cb21056 req-d6d08026-91a3-4802-b2aa-b266ad299cc0 service nova] Lock "c8cf1ead-a87c-459c-b914-a0e976c9e464-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:45:33 user nova-compute[75337]: DEBUG nova.compute.manager [req-4e9489af-f984-4c29-bf2a-ee824cb21056 req-d6d08026-91a3-4802-b2aa-b266ad299cc0 service nova] [instance: c8cf1ead-a87c-459c-b914-a0e976c9e464] No waiting events found dispatching network-vif-plugged-b33373f6-0289-4623-90ac-f5c3db0d3681 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:45:33 user nova-compute[75337]: WARNING nova.compute.manager [req-4e9489af-f984-4c29-bf2a-ee824cb21056 req-d6d08026-91a3-4802-b2aa-b266ad299cc0 service nova] [instance: c8cf1ead-a87c-459c-b914-a0e976c9e464] Received unexpected event network-vif-plugged-b33373f6-0289-4623-90ac-f5c3db0d3681 for instance with vm_state rescued and task_state unrescuing.
Nov 06 15:45:33 user nova-compute[75337]: DEBUG nova.compute.manager [req-4e9489af-f984-4c29-bf2a-ee824cb21056 req-d6d08026-91a3-4802-b2aa-b266ad299cc0 service nova] [instance: c8cf1ead-a87c-459c-b914-a0e976c9e464] Received event network-vif-plugged-b33373f6-0289-4623-90ac-f5c3db0d3681 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:45:33 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-4e9489af-f984-4c29-bf2a-ee824cb21056 req-d6d08026-91a3-4802-b2aa-b266ad299cc0 service nova] Acquiring lock "c8cf1ead-a87c-459c-b914-a0e976c9e464-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:45:33 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-4e9489af-f984-4c29-bf2a-ee824cb21056 req-d6d08026-91a3-4802-b2aa-b266ad299cc0 service nova] Lock "c8cf1ead-a87c-459c-b914-a0e976c9e464-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:45:33 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-4e9489af-f984-4c29-bf2a-ee824cb21056 req-d6d08026-91a3-4802-b2aa-b266ad299cc0 service nova] Lock "c8cf1ead-a87c-459c-b914-a0e976c9e464-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:45:33 user nova-compute[75337]: DEBUG nova.compute.manager [req-4e9489af-f984-4c29-bf2a-ee824cb21056 req-d6d08026-91a3-4802-b2aa-b266ad299cc0 service nova] [instance: c8cf1ead-a87c-459c-b914-a0e976c9e464] No waiting events found dispatching network-vif-plugged-b33373f6-0289-4623-90ac-f5c3db0d3681 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:45:33 user nova-compute[75337]: WARNING nova.compute.manager [req-4e9489af-f984-4c29-bf2a-ee824cb21056 req-d6d08026-91a3-4802-b2aa-b266ad299cc0 service nova] [instance: c8cf1ead-a87c-459c-b914-a0e976c9e464] Received unexpected event network-vif-plugged-b33373f6-0289-4623-90ac-f5c3db0d3681 for instance with vm_state rescued and task_state unrescuing.
Nov 06 15:45:33 user nova-compute[75337]: DEBUG nova.compute.manager [req-4e9489af-f984-4c29-bf2a-ee824cb21056 req-d6d08026-91a3-4802-b2aa-b266ad299cc0 service nova] [instance: c8cf1ead-a87c-459c-b914-a0e976c9e464] Received event network-vif-plugged-b33373f6-0289-4623-90ac-f5c3db0d3681 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:45:33 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-4e9489af-f984-4c29-bf2a-ee824cb21056 req-d6d08026-91a3-4802-b2aa-b266ad299cc0 service nova] Acquiring lock "c8cf1ead-a87c-459c-b914-a0e976c9e464-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:45:33 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-4e9489af-f984-4c29-bf2a-ee824cb21056 req-d6d08026-91a3-4802-b2aa-b266ad299cc0 service nova] Lock "c8cf1ead-a87c-459c-b914-a0e976c9e464-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:45:33 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-4e9489af-f984-4c29-bf2a-ee824cb21056 req-d6d08026-91a3-4802-b2aa-b266ad299cc0 service nova] Lock "c8cf1ead-a87c-459c-b914-a0e976c9e464-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:45:33 user nova-compute[75337]: DEBUG nova.compute.manager [req-4e9489af-f984-4c29-bf2a-ee824cb21056 req-d6d08026-91a3-4802-b2aa-b266ad299cc0 service nova] [instance: c8cf1ead-a87c-459c-b914-a0e976c9e464] No waiting events found dispatching network-vif-plugged-b33373f6-0289-4623-90ac-f5c3db0d3681 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:45:33 user nova-compute[75337]: WARNING nova.compute.manager [req-4e9489af-f984-4c29-bf2a-ee824cb21056 req-d6d08026-91a3-4802-b2aa-b266ad299cc0 service nova] [instance: c8cf1ead-a87c-459c-b914-a0e976c9e464] Received unexpected event network-vif-plugged-b33373f6-0289-4623-90ac-f5c3db0d3681 for instance with vm_state rescued and task_state unrescuing.
Nov 06 15:45:33 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:45:33 user nova-compute[75337]: DEBUG nova.compute.manager [None req-2611c1ed-c376-409f-aec3-28b5c19f604c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 4015f2f7-a176-46aa-bdff-58d164058e15] Instance event wait completed in 0 seconds for  {{(pid=75337) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 15:45:33 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-2611c1ed-c376-409f-aec3-28b5c19f604c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 4015f2f7-a176-46aa-bdff-58d164058e15] Guest created on hypervisor {{(pid=75337) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 15:45:33 user nova-compute[75337]: INFO nova.virt.libvirt.driver [-] [instance: 4015f2f7-a176-46aa-bdff-58d164058e15] Instance spawned successfully.
Nov 06 15:45:33 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-2611c1ed-c376-409f-aec3-28b5c19f604c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 4015f2f7-a176-46aa-bdff-58d164058e15] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 15:45:34 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-2611c1ed-c376-409f-aec3-28b5c19f604c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 4015f2f7-a176-46aa-bdff-58d164058e15] Found default for hw_cdrom_bus of ide {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:45:34 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-2611c1ed-c376-409f-aec3-28b5c19f604c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 4015f2f7-a176-46aa-bdff-58d164058e15] Found default for hw_disk_bus of virtio {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:45:34 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-2611c1ed-c376-409f-aec3-28b5c19f604c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 4015f2f7-a176-46aa-bdff-58d164058e15] Found default for hw_input_bus of None {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:45:34 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-2611c1ed-c376-409f-aec3-28b5c19f604c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 4015f2f7-a176-46aa-bdff-58d164058e15] Found default for hw_pointer_model of None {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:45:34 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-2611c1ed-c376-409f-aec3-28b5c19f604c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 4015f2f7-a176-46aa-bdff-58d164058e15] Found default for hw_video_model of virtio {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:45:34 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-2611c1ed-c376-409f-aec3-28b5c19f604c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 4015f2f7-a176-46aa-bdff-58d164058e15] Found default for hw_vif_model of virtio {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:45:34 user nova-compute[75337]: INFO nova.compute.manager [None req-2611c1ed-c376-409f-aec3-28b5c19f604c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 4015f2f7-a176-46aa-bdff-58d164058e15] Took 8.49 seconds to spawn the instance on the hypervisor.
Nov 06 15:45:34 user nova-compute[75337]: DEBUG nova.compute.manager [None req-2611c1ed-c376-409f-aec3-28b5c19f604c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 4015f2f7-a176-46aa-bdff-58d164058e15] Checking state {{(pid=75337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 15:45:34 user nova-compute[75337]: INFO nova.compute.manager [None req-2611c1ed-c376-409f-aec3-28b5c19f604c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 4015f2f7-a176-46aa-bdff-58d164058e15] Took 43.18 seconds to build instance.
Nov 06 15:45:34 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-2611c1ed-c376-409f-aec3-28b5c19f604c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Lock "4015f2f7-a176-46aa-bdff-58d164058e15" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 43.332s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:45:34 user nova-compute[75337]: DEBUG nova.compute.manager [req-469bef83-5668-4a50-aa0e-c75d5b2d47c1 req-47416d16-8c08-4cab-ac43-4df1a73ecb2e service nova] [instance: c8cf1ead-a87c-459c-b914-a0e976c9e464] Received event network-changed-b33373f6-0289-4623-90ac-f5c3db0d3681 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:45:34 user nova-compute[75337]: DEBUG nova.compute.manager [req-469bef83-5668-4a50-aa0e-c75d5b2d47c1 req-47416d16-8c08-4cab-ac43-4df1a73ecb2e service nova] [instance: c8cf1ead-a87c-459c-b914-a0e976c9e464] Refreshing instance network info cache due to event network-changed-b33373f6-0289-4623-90ac-f5c3db0d3681. {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 15:45:34 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-469bef83-5668-4a50-aa0e-c75d5b2d47c1 req-47416d16-8c08-4cab-ac43-4df1a73ecb2e service nova] Acquiring lock "refresh_cache-c8cf1ead-a87c-459c-b914-a0e976c9e464" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 15:45:34 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-469bef83-5668-4a50-aa0e-c75d5b2d47c1 req-47416d16-8c08-4cab-ac43-4df1a73ecb2e service nova] Acquired lock "refresh_cache-c8cf1ead-a87c-459c-b914-a0e976c9e464" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 15:45:34 user nova-compute[75337]: DEBUG nova.network.neutron [req-469bef83-5668-4a50-aa0e-c75d5b2d47c1 req-47416d16-8c08-4cab-ac43-4df1a73ecb2e service nova] [instance: c8cf1ead-a87c-459c-b914-a0e976c9e464] Refreshing network info cache for port b33373f6-0289-4623-90ac-f5c3db0d3681 {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 15:45:34 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:45:34 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:45:34 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:45:34 user nova-compute[75337]: DEBUG nova.compute.manager [req-1e7818d0-1e24-4ef7-ac0f-b96122509a2a req-838fa4bb-6d3c-4331-9aa7-1416e5652124 service nova] [instance: 7a6b16de-4506-432f-97f9-f083243dc047] Received event network-vif-plugged-4e4e1bfc-ebf9-41eb-81be-d1c34001dcff {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:45:34 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-1e7818d0-1e24-4ef7-ac0f-b96122509a2a req-838fa4bb-6d3c-4331-9aa7-1416e5652124 service nova] Acquiring lock "7a6b16de-4506-432f-97f9-f083243dc047-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:45:34 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-1e7818d0-1e24-4ef7-ac0f-b96122509a2a req-838fa4bb-6d3c-4331-9aa7-1416e5652124 service nova] Lock "7a6b16de-4506-432f-97f9-f083243dc047-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:45:34 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-1e7818d0-1e24-4ef7-ac0f-b96122509a2a req-838fa4bb-6d3c-4331-9aa7-1416e5652124 service nova] Lock "7a6b16de-4506-432f-97f9-f083243dc047-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:45:34 user nova-compute[75337]: DEBUG nova.compute.manager [req-1e7818d0-1e24-4ef7-ac0f-b96122509a2a req-838fa4bb-6d3c-4331-9aa7-1416e5652124 service nova] [instance: 7a6b16de-4506-432f-97f9-f083243dc047] No waiting events found dispatching network-vif-plugged-4e4e1bfc-ebf9-41eb-81be-d1c34001dcff {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:45:34 user nova-compute[75337]: WARNING nova.compute.manager [req-1e7818d0-1e24-4ef7-ac0f-b96122509a2a req-838fa4bb-6d3c-4331-9aa7-1416e5652124 service nova] [instance: 7a6b16de-4506-432f-97f9-f083243dc047] Received unexpected event network-vif-plugged-4e4e1bfc-ebf9-41eb-81be-d1c34001dcff for instance with vm_state building and task_state spawning.
Nov 06 15:45:35 user nova-compute[75337]: DEBUG nova.network.neutron [req-469bef83-5668-4a50-aa0e-c75d5b2d47c1 req-47416d16-8c08-4cab-ac43-4df1a73ecb2e service nova] [instance: c8cf1ead-a87c-459c-b914-a0e976c9e464] Updated VIF entry in instance network info cache for port b33373f6-0289-4623-90ac-f5c3db0d3681. {{(pid=75337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 15:45:35 user nova-compute[75337]: DEBUG nova.network.neutron [req-469bef83-5668-4a50-aa0e-c75d5b2d47c1 req-47416d16-8c08-4cab-ac43-4df1a73ecb2e service nova] [instance: c8cf1ead-a87c-459c-b914-a0e976c9e464] Updating instance_info_cache with network_info: [{"id": "b33373f6-0289-4623-90ac-f5c3db0d3681", "address": "fa:16:3e:37:16:66", "network": {"id": "a839a9d1-fdf3-4a72-898b-6829ceef2055", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1927950273-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86f4b41336384a53a3fd22caa0fe8e6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb33373f6-02", "ovs_interfaceid": "b33373f6-0289-4623-90ac-f5c3db0d3681", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:45:35 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-469bef83-5668-4a50-aa0e-c75d5b2d47c1 req-47416d16-8c08-4cab-ac43-4df1a73ecb2e service nova] Releasing lock "refresh_cache-c8cf1ead-a87c-459c-b914-a0e976c9e464" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 15:45:35 user nova-compute[75337]: DEBUG nova.compute.manager [req-469bef83-5668-4a50-aa0e-c75d5b2d47c1 req-47416d16-8c08-4cab-ac43-4df1a73ecb2e service nova] [instance: c8cf1ead-a87c-459c-b914-a0e976c9e464] Received event network-changed-b33373f6-0289-4623-90ac-f5c3db0d3681 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:45:35 user nova-compute[75337]: DEBUG nova.compute.manager [req-469bef83-5668-4a50-aa0e-c75d5b2d47c1 req-47416d16-8c08-4cab-ac43-4df1a73ecb2e service nova] [instance: c8cf1ead-a87c-459c-b914-a0e976c9e464] Refreshing instance network info cache due to event network-changed-b33373f6-0289-4623-90ac-f5c3db0d3681. {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 15:45:35 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-469bef83-5668-4a50-aa0e-c75d5b2d47c1 req-47416d16-8c08-4cab-ac43-4df1a73ecb2e service nova] Acquiring lock "refresh_cache-c8cf1ead-a87c-459c-b914-a0e976c9e464" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 15:45:35 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-469bef83-5668-4a50-aa0e-c75d5b2d47c1 req-47416d16-8c08-4cab-ac43-4df1a73ecb2e service nova] Acquired lock "refresh_cache-c8cf1ead-a87c-459c-b914-a0e976c9e464" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 15:45:35 user nova-compute[75337]: DEBUG nova.network.neutron [req-469bef83-5668-4a50-aa0e-c75d5b2d47c1 req-47416d16-8c08-4cab-ac43-4df1a73ecb2e service nova] [instance: c8cf1ead-a87c-459c-b914-a0e976c9e464] Refreshing network info cache for port b33373f6-0289-4623-90ac-f5c3db0d3681 {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 15:45:35 user nova-compute[75337]: DEBUG nova.compute.manager [None req-cf9fbed9-681c-41ec-bf44-9914fab759e1 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: 1fa4c927-7485-4f34-94bd-9e20358904b6] Checking state {{(pid=75337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 15:45:35 user nova-compute[75337]: DEBUG nova.compute.manager [req-4164b651-c94b-4407-8d30-9332c5b0995b req-37cb3f51-8aba-4918-af4b-694da06d3a02 service nova] [instance: c8cf1ead-a87c-459c-b914-a0e976c9e464] Received event network-vif-unplugged-b33373f6-0289-4623-90ac-f5c3db0d3681 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:45:35 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-4164b651-c94b-4407-8d30-9332c5b0995b req-37cb3f51-8aba-4918-af4b-694da06d3a02 service nova] Acquiring lock "c8cf1ead-a87c-459c-b914-a0e976c9e464-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:45:35 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-4164b651-c94b-4407-8d30-9332c5b0995b req-37cb3f51-8aba-4918-af4b-694da06d3a02 service nova] Lock "c8cf1ead-a87c-459c-b914-a0e976c9e464-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:45:35 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-4164b651-c94b-4407-8d30-9332c5b0995b req-37cb3f51-8aba-4918-af4b-694da06d3a02 service nova] Lock "c8cf1ead-a87c-459c-b914-a0e976c9e464-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:45:35 user nova-compute[75337]: DEBUG nova.compute.manager [req-4164b651-c94b-4407-8d30-9332c5b0995b req-37cb3f51-8aba-4918-af4b-694da06d3a02 service nova] [instance: c8cf1ead-a87c-459c-b914-a0e976c9e464] No waiting events found dispatching network-vif-unplugged-b33373f6-0289-4623-90ac-f5c3db0d3681 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:45:35 user nova-compute[75337]: WARNING nova.compute.manager [req-4164b651-c94b-4407-8d30-9332c5b0995b req-37cb3f51-8aba-4918-af4b-694da06d3a02 service nova] [instance: c8cf1ead-a87c-459c-b914-a0e976c9e464] Received unexpected event network-vif-unplugged-b33373f6-0289-4623-90ac-f5c3db0d3681 for instance with vm_state rescued and task_state unrescuing.
Nov 06 15:45:35 user nova-compute[75337]: DEBUG nova.compute.manager [req-4164b651-c94b-4407-8d30-9332c5b0995b req-37cb3f51-8aba-4918-af4b-694da06d3a02 service nova] [instance: c8cf1ead-a87c-459c-b914-a0e976c9e464] Received event network-vif-plugged-b33373f6-0289-4623-90ac-f5c3db0d3681 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:45:35 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-4164b651-c94b-4407-8d30-9332c5b0995b req-37cb3f51-8aba-4918-af4b-694da06d3a02 service nova] Acquiring lock "c8cf1ead-a87c-459c-b914-a0e976c9e464-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:45:35 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-4164b651-c94b-4407-8d30-9332c5b0995b req-37cb3f51-8aba-4918-af4b-694da06d3a02 service nova] Lock "c8cf1ead-a87c-459c-b914-a0e976c9e464-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:45:35 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-4164b651-c94b-4407-8d30-9332c5b0995b req-37cb3f51-8aba-4918-af4b-694da06d3a02 service nova] Lock "c8cf1ead-a87c-459c-b914-a0e976c9e464-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:45:35 user nova-compute[75337]: DEBUG nova.compute.manager [req-4164b651-c94b-4407-8d30-9332c5b0995b req-37cb3f51-8aba-4918-af4b-694da06d3a02 service nova] [instance: c8cf1ead-a87c-459c-b914-a0e976c9e464] No waiting events found dispatching network-vif-plugged-b33373f6-0289-4623-90ac-f5c3db0d3681 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:45:35 user nova-compute[75337]: WARNING nova.compute.manager [req-4164b651-c94b-4407-8d30-9332c5b0995b req-37cb3f51-8aba-4918-af4b-694da06d3a02 service nova] [instance: c8cf1ead-a87c-459c-b914-a0e976c9e464] Received unexpected event network-vif-plugged-b33373f6-0289-4623-90ac-f5c3db0d3681 for instance with vm_state rescued and task_state unrescuing.
Nov 06 15:45:35 user nova-compute[75337]: DEBUG nova.compute.manager [req-4164b651-c94b-4407-8d30-9332c5b0995b req-37cb3f51-8aba-4918-af4b-694da06d3a02 service nova] [instance: c8cf1ead-a87c-459c-b914-a0e976c9e464] Received event network-vif-plugged-b33373f6-0289-4623-90ac-f5c3db0d3681 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:45:35 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-4164b651-c94b-4407-8d30-9332c5b0995b req-37cb3f51-8aba-4918-af4b-694da06d3a02 service nova] Acquiring lock "c8cf1ead-a87c-459c-b914-a0e976c9e464-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:45:35 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-4164b651-c94b-4407-8d30-9332c5b0995b req-37cb3f51-8aba-4918-af4b-694da06d3a02 service nova] Lock "c8cf1ead-a87c-459c-b914-a0e976c9e464-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:45:35 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-4164b651-c94b-4407-8d30-9332c5b0995b req-37cb3f51-8aba-4918-af4b-694da06d3a02 service nova] Lock "c8cf1ead-a87c-459c-b914-a0e976c9e464-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:45:35 user nova-compute[75337]: DEBUG nova.compute.manager [req-4164b651-c94b-4407-8d30-9332c5b0995b req-37cb3f51-8aba-4918-af4b-694da06d3a02 service nova] [instance: c8cf1ead-a87c-459c-b914-a0e976c9e464] No waiting events found dispatching network-vif-plugged-b33373f6-0289-4623-90ac-f5c3db0d3681 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:45:35 user nova-compute[75337]: WARNING nova.compute.manager [req-4164b651-c94b-4407-8d30-9332c5b0995b req-37cb3f51-8aba-4918-af4b-694da06d3a02 service nova] [instance: c8cf1ead-a87c-459c-b914-a0e976c9e464] Received unexpected event network-vif-plugged-b33373f6-0289-4623-90ac-f5c3db0d3681 for instance with vm_state rescued and task_state unrescuing.
Nov 06 15:45:35 user nova-compute[75337]: DEBUG nova.compute.manager [req-4164b651-c94b-4407-8d30-9332c5b0995b req-37cb3f51-8aba-4918-af4b-694da06d3a02 service nova] [instance: c8cf1ead-a87c-459c-b914-a0e976c9e464] Received event network-vif-plugged-b33373f6-0289-4623-90ac-f5c3db0d3681 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:45:35 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-4164b651-c94b-4407-8d30-9332c5b0995b req-37cb3f51-8aba-4918-af4b-694da06d3a02 service nova] Acquiring lock "c8cf1ead-a87c-459c-b914-a0e976c9e464-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:45:35 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-4164b651-c94b-4407-8d30-9332c5b0995b req-37cb3f51-8aba-4918-af4b-694da06d3a02 service nova] Lock "c8cf1ead-a87c-459c-b914-a0e976c9e464-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:45:35 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-4164b651-c94b-4407-8d30-9332c5b0995b req-37cb3f51-8aba-4918-af4b-694da06d3a02 service nova] Lock "c8cf1ead-a87c-459c-b914-a0e976c9e464-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:45:35 user nova-compute[75337]: DEBUG nova.compute.manager [req-4164b651-c94b-4407-8d30-9332c5b0995b req-37cb3f51-8aba-4918-af4b-694da06d3a02 service nova] [instance: c8cf1ead-a87c-459c-b914-a0e976c9e464] No waiting events found dispatching network-vif-plugged-b33373f6-0289-4623-90ac-f5c3db0d3681 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:45:35 user nova-compute[75337]: WARNING nova.compute.manager [req-4164b651-c94b-4407-8d30-9332c5b0995b req-37cb3f51-8aba-4918-af4b-694da06d3a02 service nova] [instance: c8cf1ead-a87c-459c-b914-a0e976c9e464] Received unexpected event network-vif-plugged-b33373f6-0289-4623-90ac-f5c3db0d3681 for instance with vm_state rescued and task_state unrescuing.
Nov 06 15:45:35 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:45:35 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:45:35 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:45:36 user nova-compute[75337]: DEBUG nova.network.neutron [req-469bef83-5668-4a50-aa0e-c75d5b2d47c1 req-47416d16-8c08-4cab-ac43-4df1a73ecb2e service nova] [instance: c8cf1ead-a87c-459c-b914-a0e976c9e464] Updated VIF entry in instance network info cache for port b33373f6-0289-4623-90ac-f5c3db0d3681. {{(pid=75337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 15:45:36 user nova-compute[75337]: DEBUG nova.network.neutron [req-469bef83-5668-4a50-aa0e-c75d5b2d47c1 req-47416d16-8c08-4cab-ac43-4df1a73ecb2e service nova] [instance: c8cf1ead-a87c-459c-b914-a0e976c9e464] Updating instance_info_cache with network_info: [{"id": "b33373f6-0289-4623-90ac-f5c3db0d3681", "address": "fa:16:3e:37:16:66", "network": {"id": "a839a9d1-fdf3-4a72-898b-6829ceef2055", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1927950273-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86f4b41336384a53a3fd22caa0fe8e6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb33373f6-02", "ovs_interfaceid": "b33373f6-0289-4623-90ac-f5c3db0d3681", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:45:36 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-469bef83-5668-4a50-aa0e-c75d5b2d47c1 req-47416d16-8c08-4cab-ac43-4df1a73ecb2e service nova] Releasing lock "refresh_cache-c8cf1ead-a87c-459c-b914-a0e976c9e464" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 15:45:36 user nova-compute[75337]: DEBUG nova.compute.manager [None req-acf7fc4c-691c-435a-9562-62e43f5b33cf tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] [instance: 7a6b16de-4506-432f-97f9-f083243dc047] Instance event wait completed in 0 seconds for  {{(pid=75337) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 15:45:36 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-acf7fc4c-691c-435a-9562-62e43f5b33cf tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] [instance: 7a6b16de-4506-432f-97f9-f083243dc047] Guest created on hypervisor {{(pid=75337) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 15:45:36 user nova-compute[75337]: INFO nova.virt.libvirt.driver [-] [instance: 7a6b16de-4506-432f-97f9-f083243dc047] Instance spawned successfully.
Nov 06 15:45:36 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-acf7fc4c-691c-435a-9562-62e43f5b33cf tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] [instance: 7a6b16de-4506-432f-97f9-f083243dc047] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 15:45:36 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-acf7fc4c-691c-435a-9562-62e43f5b33cf tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] [instance: 7a6b16de-4506-432f-97f9-f083243dc047] Found default for hw_cdrom_bus of ide {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:45:36 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-acf7fc4c-691c-435a-9562-62e43f5b33cf tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] [instance: 7a6b16de-4506-432f-97f9-f083243dc047] Found default for hw_disk_bus of virtio {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:45:36 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-acf7fc4c-691c-435a-9562-62e43f5b33cf tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] [instance: 7a6b16de-4506-432f-97f9-f083243dc047] Found default for hw_input_bus of None {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:45:36 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-acf7fc4c-691c-435a-9562-62e43f5b33cf tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] [instance: 7a6b16de-4506-432f-97f9-f083243dc047] Found default for hw_pointer_model of None {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:45:36 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-acf7fc4c-691c-435a-9562-62e43f5b33cf tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] [instance: 7a6b16de-4506-432f-97f9-f083243dc047] Found default for hw_video_model of virtio {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:45:36 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-acf7fc4c-691c-435a-9562-62e43f5b33cf tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] [instance: 7a6b16de-4506-432f-97f9-f083243dc047] Found default for hw_vif_model of virtio {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:45:37 user nova-compute[75337]: INFO nova.compute.manager [None req-acf7fc4c-691c-435a-9562-62e43f5b33cf tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] [instance: 7a6b16de-4506-432f-97f9-f083243dc047] Took 7.97 seconds to spawn the instance on the hypervisor.
Nov 06 15:45:37 user nova-compute[75337]: DEBUG nova.compute.manager [None req-acf7fc4c-691c-435a-9562-62e43f5b33cf tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] [instance: 7a6b16de-4506-432f-97f9-f083243dc047] Checking state {{(pid=75337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 15:45:37 user nova-compute[75337]: INFO nova.compute.manager [None req-acf7fc4c-691c-435a-9562-62e43f5b33cf tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] [instance: 7a6b16de-4506-432f-97f9-f083243dc047] Took 72.27 seconds to build instance.
Nov 06 15:45:37 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-acf7fc4c-691c-435a-9562-62e43f5b33cf tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] Lock "7a6b16de-4506-432f-97f9-f083243dc047" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 72.412s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:45:37 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "7a6b16de-4506-432f-97f9-f083243dc047" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 61.785s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:45:37 user nova-compute[75337]: INFO nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] [instance: 7a6b16de-4506-432f-97f9-f083243dc047] During sync_power_state the instance has a pending task (block_device_mapping). Skip.
Nov 06 15:45:37 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "7a6b16de-4506-432f-97f9-f083243dc047" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:45:37 user nova-compute[75337]: DEBUG nova.compute.manager [None req-afff0d68-f81f-46a5-98b0-554595d1b032 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] [instance: c8cf1ead-a87c-459c-b914-a0e976c9e464] Checking state {{(pid=75337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 15:45:38 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:45:40 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:45:43 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:45:45 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:45:46 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-a7d9e071-2cf8-4246-836c-e3cd82b0cfb9 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Acquiring lock "8a600bd8-b94a-4242-a443-c2defb002280" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:45:46 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-a7d9e071-2cf8-4246-836c-e3cd82b0cfb9 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Lock "8a600bd8-b94a-4242-a443-c2defb002280" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:45:46 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-a7d9e071-2cf8-4246-836c-e3cd82b0cfb9 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Acquiring lock "8a600bd8-b94a-4242-a443-c2defb002280-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:45:46 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-a7d9e071-2cf8-4246-836c-e3cd82b0cfb9 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Lock "8a600bd8-b94a-4242-a443-c2defb002280-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:45:46 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-a7d9e071-2cf8-4246-836c-e3cd82b0cfb9 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Lock "8a600bd8-b94a-4242-a443-c2defb002280-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:45:46 user nova-compute[75337]: INFO nova.compute.manager [None req-a7d9e071-2cf8-4246-836c-e3cd82b0cfb9 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] [instance: 8a600bd8-b94a-4242-a443-c2defb002280] Terminating instance
Nov 06 15:45:46 user nova-compute[75337]: DEBUG nova.compute.manager [None req-a7d9e071-2cf8-4246-836c-e3cd82b0cfb9 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] [instance: 8a600bd8-b94a-4242-a443-c2defb002280] Start destroying the instance on the hypervisor. {{(pid=75337) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 15:45:46 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:45:46 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:45:46 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:45:47 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:45:47 user nova-compute[75337]: DEBUG nova.compute.manager [req-7c613816-2b41-4a1c-95aa-a103976d63f5 req-14dc06d7-d9a8-4de9-816a-b6b2feba70bf service nova] [instance: 8a600bd8-b94a-4242-a443-c2defb002280] Received event network-vif-unplugged-01aa7168-78cd-44e6-8496-08d468f62cfe {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:45:47 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-7c613816-2b41-4a1c-95aa-a103976d63f5 req-14dc06d7-d9a8-4de9-816a-b6b2feba70bf service nova] Acquiring lock "8a600bd8-b94a-4242-a443-c2defb002280-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:45:47 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-7c613816-2b41-4a1c-95aa-a103976d63f5 req-14dc06d7-d9a8-4de9-816a-b6b2feba70bf service nova] Lock "8a600bd8-b94a-4242-a443-c2defb002280-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:45:47 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-7c613816-2b41-4a1c-95aa-a103976d63f5 req-14dc06d7-d9a8-4de9-816a-b6b2feba70bf service nova] Lock "8a600bd8-b94a-4242-a443-c2defb002280-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:45:47 user nova-compute[75337]: DEBUG nova.compute.manager [req-7c613816-2b41-4a1c-95aa-a103976d63f5 req-14dc06d7-d9a8-4de9-816a-b6b2feba70bf service nova] [instance: 8a600bd8-b94a-4242-a443-c2defb002280] No waiting events found dispatching network-vif-unplugged-01aa7168-78cd-44e6-8496-08d468f62cfe {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:45:47 user nova-compute[75337]: DEBUG nova.compute.manager [req-7c613816-2b41-4a1c-95aa-a103976d63f5 req-14dc06d7-d9a8-4de9-816a-b6b2feba70bf service nova] [instance: 8a600bd8-b94a-4242-a443-c2defb002280] Received event network-vif-unplugged-01aa7168-78cd-44e6-8496-08d468f62cfe for instance with task_state deleting. {{(pid=75337) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 15:45:47 user nova-compute[75337]: INFO nova.virt.libvirt.driver [-] [instance: 8a600bd8-b94a-4242-a443-c2defb002280] Instance destroyed successfully.
Nov 06 15:45:47 user nova-compute[75337]: DEBUG nova.objects.instance [None req-a7d9e071-2cf8-4246-836c-e3cd82b0cfb9 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Lazy-loading 'resources' on Instance uuid 8a600bd8-b94a-4242-a443-c2defb002280 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 15:45:47 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-a7d9e071-2cf8-4246-836c-e3cd82b0cfb9 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-06T15:37:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1664848086',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1664848086',id=5,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC0FniBLNu9YJVY4Z8IGuBWVqyZPytkJWiSZMci+GzSs1MwK9lb3C3ke0n2MIwR14vwCuigfmGIf66GQZ9tJlOwMOS19unmyr2FElzX/8lOCboMN5SHwokzc4XAnJBg1jA==',key_name='tempest-keypair-1277258187',keypairs=<?>,launch_index=0,launched_at=2023-11-06T15:43:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ed09a1def6f0477796404d9bd3357dd0',ramdisk_id='',reservation_id='r-4kx37btu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-417383725',owner_user_name='tempest-AttachVolumeShelveTestJSON-417383725-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T15:43:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9e1c021de4da40518ddc45a57ef79d6f',uuid=8a600bd8-b94a-4242-a443-c2defb002280,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "01aa7168-78cd-44e6-8496-08d468f62cfe", "address": "fa:16:3e:f1:25:3e", "network": {"id": "f24470c2-ff6f-49fd-b28f-16b8a87ed3b4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-217486733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed09a1def6f0477796404d9bd3357dd0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01aa7168-78", "ovs_interfaceid": "01aa7168-78cd-44e6-8496-08d468f62cfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 15:45:47 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-a7d9e071-2cf8-4246-836c-e3cd82b0cfb9 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Converting VIF {"id": "01aa7168-78cd-44e6-8496-08d468f62cfe", "address": "fa:16:3e:f1:25:3e", "network": {"id": "f24470c2-ff6f-49fd-b28f-16b8a87ed3b4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-217486733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed09a1def6f0477796404d9bd3357dd0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01aa7168-78", "ovs_interfaceid": "01aa7168-78cd-44e6-8496-08d468f62cfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 15:45:47 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-a7d9e071-2cf8-4246-836c-e3cd82b0cfb9 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:25:3e,bridge_name='br-int',has_traffic_filtering=True,id=01aa7168-78cd-44e6-8496-08d468f62cfe,network=Network(f24470c2-ff6f-49fd-b28f-16b8a87ed3b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01aa7168-78') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 15:45:47 user nova-compute[75337]: DEBUG os_vif [None req-a7d9e071-2cf8-4246-836c-e3cd82b0cfb9 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:25:3e,bridge_name='br-int',has_traffic_filtering=True,id=01aa7168-78cd-44e6-8496-08d468f62cfe,network=Network(f24470c2-ff6f-49fd-b28f-16b8a87ed3b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01aa7168-78') {{(pid=75337) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 15:45:47 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:45:47 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap01aa7168-78, bridge=br-int, if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:45:47 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:45:47 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:45:47 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:45:47 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:45:47 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9b62d07f-6e7c-4178-aa4b-6322f63908af) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:45:47 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:45:47 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:45:47 user nova-compute[75337]: INFO os_vif [None req-a7d9e071-2cf8-4246-836c-e3cd82b0cfb9 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:25:3e,bridge_name='br-int',has_traffic_filtering=True,id=01aa7168-78cd-44e6-8496-08d468f62cfe,network=Network(f24470c2-ff6f-49fd-b28f-16b8a87ed3b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01aa7168-78')
Nov 06 15:45:47 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-a7d9e071-2cf8-4246-836c-e3cd82b0cfb9 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] [instance: 8a600bd8-b94a-4242-a443-c2defb002280] Deleting instance files /opt/stack/data/nova/instances/8a600bd8-b94a-4242-a443-c2defb002280_del
Nov 06 15:45:47 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-a7d9e071-2cf8-4246-836c-e3cd82b0cfb9 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] [instance: 8a600bd8-b94a-4242-a443-c2defb002280] Deletion of /opt/stack/data/nova/instances/8a600bd8-b94a-4242-a443-c2defb002280_del complete
Nov 06 15:45:47 user nova-compute[75337]: INFO nova.compute.manager [None req-a7d9e071-2cf8-4246-836c-e3cd82b0cfb9 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] [instance: 8a600bd8-b94a-4242-a443-c2defb002280] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 06 15:45:47 user nova-compute[75337]: DEBUG oslo.service.loopingcall [None req-a7d9e071-2cf8-4246-836c-e3cd82b0cfb9 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75337) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 15:45:47 user nova-compute[75337]: DEBUG nova.compute.manager [-] [instance: 8a600bd8-b94a-4242-a443-c2defb002280] Deallocating network for instance {{(pid=75337) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 15:45:47 user nova-compute[75337]: DEBUG nova.network.neutron [-] [instance: 8a600bd8-b94a-4242-a443-c2defb002280] deallocate_for_instance() {{(pid=75337) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 15:45:48 user nova-compute[75337]: DEBUG nova.network.neutron [-] [instance: 8a600bd8-b94a-4242-a443-c2defb002280] Updating instance_info_cache with network_info: [] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:45:48 user nova-compute[75337]: INFO nova.compute.manager [-] [instance: 8a600bd8-b94a-4242-a443-c2defb002280] Took 1.12 seconds to deallocate network for instance.
Nov 06 15:45:48 user nova-compute[75337]: DEBUG nova.compute.manager [req-657c4a32-3ad6-4080-b37c-1c989642bbe0 req-7e60631e-fb7c-478e-aa58-8f778fc037e8 service nova] [instance: 8a600bd8-b94a-4242-a443-c2defb002280] Received event network-vif-deleted-01aa7168-78cd-44e6-8496-08d468f62cfe {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:45:48 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:45:48 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-a7d9e071-2cf8-4246-836c-e3cd82b0cfb9 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:45:48 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-a7d9e071-2cf8-4246-836c-e3cd82b0cfb9 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:45:49 user nova-compute[75337]: DEBUG nova.compute.manager [req-40f73ccc-8a1b-4f7a-a2da-5100cddea635 req-bdd70873-d082-4592-8a3b-03283499dd43 service nova] [instance: 8a600bd8-b94a-4242-a443-c2defb002280] Received event network-vif-plugged-01aa7168-78cd-44e6-8496-08d468f62cfe {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:45:49 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-40f73ccc-8a1b-4f7a-a2da-5100cddea635 req-bdd70873-d082-4592-8a3b-03283499dd43 service nova] Acquiring lock "8a600bd8-b94a-4242-a443-c2defb002280-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:45:49 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-40f73ccc-8a1b-4f7a-a2da-5100cddea635 req-bdd70873-d082-4592-8a3b-03283499dd43 service nova] Lock "8a600bd8-b94a-4242-a443-c2defb002280-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:45:49 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-40f73ccc-8a1b-4f7a-a2da-5100cddea635 req-bdd70873-d082-4592-8a3b-03283499dd43 service nova] Lock "8a600bd8-b94a-4242-a443-c2defb002280-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:45:49 user nova-compute[75337]: DEBUG nova.compute.manager [req-40f73ccc-8a1b-4f7a-a2da-5100cddea635 req-bdd70873-d082-4592-8a3b-03283499dd43 service nova] [instance: 8a600bd8-b94a-4242-a443-c2defb002280] No waiting events found dispatching network-vif-plugged-01aa7168-78cd-44e6-8496-08d468f62cfe {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:45:49 user nova-compute[75337]: WARNING nova.compute.manager [req-40f73ccc-8a1b-4f7a-a2da-5100cddea635 req-bdd70873-d082-4592-8a3b-03283499dd43 service nova] [instance: 8a600bd8-b94a-4242-a443-c2defb002280] Received unexpected event network-vif-plugged-01aa7168-78cd-44e6-8496-08d468f62cfe for instance with vm_state deleted and task_state None.
Nov 06 15:45:49 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-a7d9e071-2cf8-4246-836c-e3cd82b0cfb9 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 15:45:49 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-a7d9e071-2cf8-4246-836c-e3cd82b0cfb9 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 15:45:49 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-a7d9e071-2cf8-4246-836c-e3cd82b0cfb9 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.658s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:45:49 user nova-compute[75337]: INFO nova.scheduler.client.report [None req-a7d9e071-2cf8-4246-836c-e3cd82b0cfb9 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Deleted allocations for instance 8a600bd8-b94a-4242-a443-c2defb002280
Nov 06 15:45:49 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-a7d9e071-2cf8-4246-836c-e3cd82b0cfb9 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Lock "8a600bd8-b94a-4242-a443-c2defb002280" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.925s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:45:52 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:45:53 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:45:57 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:45:58 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:45:58 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:45:58 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Starting heal instance info cache {{(pid=75337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 15:45:58 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "refresh_cache-c8cf1ead-a87c-459c-b914-a0e976c9e464" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 15:45:58 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquired lock "refresh_cache-c8cf1ead-a87c-459c-b914-a0e976c9e464" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 15:45:58 user nova-compute[75337]: DEBUG nova.network.neutron [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] [instance: c8cf1ead-a87c-459c-b914-a0e976c9e464] Forcefully refreshing network info cache for instance {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 15:45:58 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:45:59 user nova-compute[75337]: DEBUG nova.network.neutron [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] [instance: c8cf1ead-a87c-459c-b914-a0e976c9e464] Updating instance_info_cache with network_info: [{"id": "b33373f6-0289-4623-90ac-f5c3db0d3681", "address": "fa:16:3e:37:16:66", "network": {"id": "a839a9d1-fdf3-4a72-898b-6829ceef2055", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1927950273-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86f4b41336384a53a3fd22caa0fe8e6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb33373f6-02", "ovs_interfaceid": "b33373f6-0289-4623-90ac-f5c3db0d3681", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:45:59 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Releasing lock "refresh_cache-c8cf1ead-a87c-459c-b914-a0e976c9e464" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 15:45:59 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] [instance: c8cf1ead-a87c-459c-b914-a0e976c9e464] Updated the network info_cache for instance {{(pid=75337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 15:45:59 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:45:59 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:45:59 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:45:59 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:45:59 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75337) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 15:45:59 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:45:59 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:46:00 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:46:01 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager.update_available_resource {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:46:01 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:46:01 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:46:01 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:46:01 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Auditing locally available compute resources for user (node: user) {{(pid=75337) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 15:46:01 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 15:46:01 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/581cf468-65e7-42e5-9250-c3d645577011/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:46:02 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/581cf468-65e7-42e5-9250-c3d645577011/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:46:02 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/581cf468-65e7-42e5-9250-c3d645577011/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:46:02 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/581cf468-65e7-42e5-9250-c3d645577011/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:46:02 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 15:46:02 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8cf1ead-a87c-459c-b914-a0e976c9e464/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:46:02 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8cf1ead-a87c-459c-b914-a0e976c9e464/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:46:02 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8cf1ead-a87c-459c-b914-a0e976c9e464/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:46:02 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:46:02 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8cf1ead-a87c-459c-b914-a0e976c9e464/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:46:02 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 15:46:02 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 15:46:02 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9125364b-332f-4297-815f-3aa1eadaf743/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:46:02 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9125364b-332f-4297-815f-3aa1eadaf743/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:46:02 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9125364b-332f-4297-815f-3aa1eadaf743/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:46:03 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9125364b-332f-4297-815f-3aa1eadaf743/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:46:03 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdced0ba-84ff-42af-baab-e2f3412e1676/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:46:03 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdced0ba-84ff-42af-baab-e2f3412e1676/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:46:03 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdced0ba-84ff-42af-baab-e2f3412e1676/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:46:03 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdced0ba-84ff-42af-baab-e2f3412e1676/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:46:03 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83516ff5-c4e7-4e91-a2f9-8af9b51cf475/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:46:03 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83516ff5-c4e7-4e91-a2f9-8af9b51cf475/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:46:03 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83516ff5-c4e7-4e91-a2f9-8af9b51cf475/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:46:03 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:46:04 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83516ff5-c4e7-4e91-a2f9-8af9b51cf475/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:46:04 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 15:46:04 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 15:46:04 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 15:46:04 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Hypervisor/Node resource view: name=user free_ram=7535MB free_disk=25.213741302490234GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75337) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 15:46:04 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:46:04 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:46:04 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:46:04 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 83516ff5-c4e7-4e91-a2f9-8af9b51cf475 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:46:04 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance c8cf1ead-a87c-459c-b914-a0e976c9e464 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:46:04 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 1fa4c927-7485-4f34-94bd-9e20358904b6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:46:04 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance cdced0ba-84ff-42af-baab-e2f3412e1676 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:46:04 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 7a6b16de-4506-432f-97f9-f083243dc047 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:46:04 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 581cf468-65e7-42e5-9250-c3d645577011 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:46:04 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 4015f2f7-a176-46aa-bdff-58d164058e15 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:46:04 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 9125364b-332f-4297-815f-3aa1eadaf743 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:46:04 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 15:46:04 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 15:46:04 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-eacdaf5c-1ea7-42ff-8f44-e7e407aedc23 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Acquiring lock "c8cf1ead-a87c-459c-b914-a0e976c9e464" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:46:04 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-eacdaf5c-1ea7-42ff-8f44-e7e407aedc23 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Lock "c8cf1ead-a87c-459c-b914-a0e976c9e464" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:46:04 user nova-compute[75337]: INFO nova.compute.manager [None req-eacdaf5c-1ea7-42ff-8f44-e7e407aedc23 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] [instance: c8cf1ead-a87c-459c-b914-a0e976c9e464] Detaching volume 6f5503fc-8cc8-46fa-8450-d967f769a947
Nov 06 15:46:04 user nova-compute[75337]: INFO nova.virt.block_device [None req-eacdaf5c-1ea7-42ff-8f44-e7e407aedc23 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] [instance: c8cf1ead-a87c-459c-b914-a0e976c9e464] Attempting to driver detach volume 6f5503fc-8cc8-46fa-8450-d967f769a947 from mountpoint /dev/vdb
Nov 06 15:46:04 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-eacdaf5c-1ea7-42ff-8f44-e7e407aedc23 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Attempting to detach device vdb from instance c8cf1ead-a87c-459c-b914-a0e976c9e464 from the persistent domain config. {{(pid=75337) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 06 15:46:04 user nova-compute[75337]: DEBUG nova.virt.libvirt.guest [None req-eacdaf5c-1ea7-42ff-8f44-e7e407aedc23 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 15:46:04 user nova-compute[75337]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 15:46:04 user nova-compute[75337]:   <source dev="/dev/sdd"/>
Nov 06 15:46:04 user nova-compute[75337]:   <target dev="vdb" bus="virtio"/>
Nov 06 15:46:04 user nova-compute[75337]:   <serial>6f5503fc-8cc8-46fa-8450-d967f769a947</serial>
Nov 06 15:46:04 user nova-compute[75337]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 06 15:46:04 user nova-compute[75337]: </disk>
Nov 06 15:46:04 user nova-compute[75337]:  {{(pid=75337) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 15:46:04 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-eacdaf5c-1ea7-42ff-8f44-e7e407aedc23 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Successfully detached device vdb from instance c8cf1ead-a87c-459c-b914-a0e976c9e464 from the persistent domain config.
Nov 06 15:46:04 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-eacdaf5c-1ea7-42ff-8f44-e7e407aedc23 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c8cf1ead-a87c-459c-b914-a0e976c9e464 from the live domain config. {{(pid=75337) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 06 15:46:04 user nova-compute[75337]: DEBUG nova.virt.libvirt.guest [None req-eacdaf5c-1ea7-42ff-8f44-e7e407aedc23 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 15:46:04 user nova-compute[75337]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 15:46:04 user nova-compute[75337]:   <source dev="/dev/sdd"/>
Nov 06 15:46:04 user nova-compute[75337]:   <target dev="vdb" bus="virtio"/>
Nov 06 15:46:04 user nova-compute[75337]:   <serial>6f5503fc-8cc8-46fa-8450-d967f769a947</serial>
Nov 06 15:46:04 user nova-compute[75337]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 06 15:46:04 user nova-compute[75337]: </disk>
Nov 06 15:46:04 user nova-compute[75337]:  {{(pid=75337) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 15:46:04 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 15:46:04 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 15:46:04 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Compute_service record updated for user:user {{(pid=75337) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 15:46:04 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.503s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:46:05 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-eacdaf5c-1ea7-42ff-8f44-e7e407aedc23 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c8cf1ead-a87c-459c-b914-a0e976c9e464 {{(pid=75337) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 06 15:46:06 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:46:07 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:46:08 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:46:10 user nova-compute[75337]: DEBUG nova.compute.manager [req-5f97448b-e349-40e1-80d3-e6b915495724 req-08346bea-d9ac-43c6-9c1b-5762b444fff5 service nova] [instance: cdced0ba-84ff-42af-baab-e2f3412e1676] Received event network-changed-6439aebd-fede-4cad-857e-1c44587827ef {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:46:10 user nova-compute[75337]: DEBUG nova.compute.manager [req-5f97448b-e349-40e1-80d3-e6b915495724 req-08346bea-d9ac-43c6-9c1b-5762b444fff5 service nova] [instance: cdced0ba-84ff-42af-baab-e2f3412e1676] Refreshing instance network info cache due to event network-changed-6439aebd-fede-4cad-857e-1c44587827ef. {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 15:46:10 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-5f97448b-e349-40e1-80d3-e6b915495724 req-08346bea-d9ac-43c6-9c1b-5762b444fff5 service nova] Acquiring lock "refresh_cache-cdced0ba-84ff-42af-baab-e2f3412e1676" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 15:46:10 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-5f97448b-e349-40e1-80d3-e6b915495724 req-08346bea-d9ac-43c6-9c1b-5762b444fff5 service nova] Acquired lock "refresh_cache-cdced0ba-84ff-42af-baab-e2f3412e1676" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 15:46:10 user nova-compute[75337]: DEBUG nova.network.neutron [req-5f97448b-e349-40e1-80d3-e6b915495724 req-08346bea-d9ac-43c6-9c1b-5762b444fff5 service nova] [instance: cdced0ba-84ff-42af-baab-e2f3412e1676] Refreshing network info cache for port 6439aebd-fede-4cad-857e-1c44587827ef {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 15:46:10 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-bde5d896-8b7c-4b86-a374-6592cf341d03 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Acquiring lock "477da5ee-3e03-4aa9-9a88-004c442e617a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:46:10 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-bde5d896-8b7c-4b86-a374-6592cf341d03 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Lock "477da5ee-3e03-4aa9-9a88-004c442e617a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:46:10 user nova-compute[75337]: DEBUG nova.network.neutron [req-5f97448b-e349-40e1-80d3-e6b915495724 req-08346bea-d9ac-43c6-9c1b-5762b444fff5 service nova] [instance: cdced0ba-84ff-42af-baab-e2f3412e1676] Updated VIF entry in instance network info cache for port 6439aebd-fede-4cad-857e-1c44587827ef. {{(pid=75337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 15:46:10 user nova-compute[75337]: DEBUG nova.network.neutron [req-5f97448b-e349-40e1-80d3-e6b915495724 req-08346bea-d9ac-43c6-9c1b-5762b444fff5 service nova] [instance: cdced0ba-84ff-42af-baab-e2f3412e1676] Updating instance_info_cache with network_info: [{"id": "6439aebd-fede-4cad-857e-1c44587827ef", "address": "fa:16:3e:cf:ac:79", "network": {"id": "c07dbf10-d5b5-40f4-b841-826ca6f505d8", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1886147547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2de62cc51864374a29a5d96584e8dd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6439aebd-fe", "ovs_interfaceid": "6439aebd-fede-4cad-857e-1c44587827ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:46:10 user nova-compute[75337]: DEBUG nova.compute.manager [None req-bde5d896-8b7c-4b86-a374-6592cf341d03 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] [instance: 477da5ee-3e03-4aa9-9a88-004c442e617a] Starting instance... {{(pid=75337) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 15:46:10 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:46:11 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-5f97448b-e349-40e1-80d3-e6b915495724 req-08346bea-d9ac-43c6-9c1b-5762b444fff5 service nova] Releasing lock "refresh_cache-cdced0ba-84ff-42af-baab-e2f3412e1676" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 15:46:11 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-bde5d896-8b7c-4b86-a374-6592cf341d03 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:46:11 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-bde5d896-8b7c-4b86-a374-6592cf341d03 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:46:11 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-bde5d896-8b7c-4b86-a374-6592cf341d03 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75337) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 15:46:11 user nova-compute[75337]: INFO nova.compute.claims [None req-bde5d896-8b7c-4b86-a374-6592cf341d03 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] [instance: 477da5ee-3e03-4aa9-9a88-004c442e617a] Claim successful on node user
Nov 06 15:46:11 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-bde5d896-8b7c-4b86-a374-6592cf341d03 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 15:46:11 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-bde5d896-8b7c-4b86-a374-6592cf341d03 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 15:46:11 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-bde5d896-8b7c-4b86-a374-6592cf341d03 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.456s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:46:11 user nova-compute[75337]: DEBUG nova.compute.manager [None req-bde5d896-8b7c-4b86-a374-6592cf341d03 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] [instance: 477da5ee-3e03-4aa9-9a88-004c442e617a] Start building networks asynchronously for instance. {{(pid=75337) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 15:46:11 user nova-compute[75337]: DEBUG nova.compute.manager [None req-bde5d896-8b7c-4b86-a374-6592cf341d03 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] [instance: 477da5ee-3e03-4aa9-9a88-004c442e617a] Allocating IP information in the background. {{(pid=75337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 15:46:11 user nova-compute[75337]: DEBUG nova.network.neutron [None req-bde5d896-8b7c-4b86-a374-6592cf341d03 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] [instance: 477da5ee-3e03-4aa9-9a88-004c442e617a] allocate_for_instance() {{(pid=75337) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 15:46:11 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-bde5d896-8b7c-4b86-a374-6592cf341d03 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] [instance: 477da5ee-3e03-4aa9-9a88-004c442e617a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 15:46:11 user nova-compute[75337]: DEBUG nova.compute.manager [None req-bde5d896-8b7c-4b86-a374-6592cf341d03 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] [instance: 477da5ee-3e03-4aa9-9a88-004c442e617a] Start building block device mappings for instance. {{(pid=75337) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 15:46:11 user nova-compute[75337]: DEBUG nova.policy [None req-bde5d896-8b7c-4b86-a374-6592cf341d03 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'aeeea58fcd3e4217a34a4a38be6adf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1013e7afbefd4146a3be04587710b1de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75337) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 15:46:11 user nova-compute[75337]: DEBUG nova.compute.manager [None req-bde5d896-8b7c-4b86-a374-6592cf341d03 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] [instance: 477da5ee-3e03-4aa9-9a88-004c442e617a] Start spawning the instance on the hypervisor. {{(pid=75337) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 15:46:11 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-bde5d896-8b7c-4b86-a374-6592cf341d03 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] [instance: 477da5ee-3e03-4aa9-9a88-004c442e617a] Creating instance directory {{(pid=75337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 15:46:11 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-bde5d896-8b7c-4b86-a374-6592cf341d03 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] [instance: 477da5ee-3e03-4aa9-9a88-004c442e617a] Creating image(s)
Nov 06 15:46:11 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-bde5d896-8b7c-4b86-a374-6592cf341d03 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Acquiring lock "/opt/stack/data/nova/instances/477da5ee-3e03-4aa9-9a88-004c442e617a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:46:11 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-bde5d896-8b7c-4b86-a374-6592cf341d03 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Lock "/opt/stack/data/nova/instances/477da5ee-3e03-4aa9-9a88-004c442e617a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:46:11 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-bde5d896-8b7c-4b86-a374-6592cf341d03 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Lock "/opt/stack/data/nova/instances/477da5ee-3e03-4aa9-9a88-004c442e617a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:46:11 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-bde5d896-8b7c-4b86-a374-6592cf341d03 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:46:12 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-bde5d896-8b7c-4b86-a374-6592cf341d03 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json" returned: 0 in 0.197s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:46:12 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-bde5d896-8b7c-4b86-a374-6592cf341d03 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Acquiring lock "06ba3c914798499e686c5ac75886932347225275" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:46:12 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-bde5d896-8b7c-4b86-a374-6592cf341d03 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Lock "06ba3c914798499e686c5ac75886932347225275" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:46:12 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-bde5d896-8b7c-4b86-a374-6592cf341d03 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:46:12 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-bde5d896-8b7c-4b86-a374-6592cf341d03 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json" returned: 0 in 0.211s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:46:12 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-bde5d896-8b7c-4b86-a374-6592cf341d03 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275,backing_fmt=raw /opt/stack/data/nova/instances/477da5ee-3e03-4aa9-9a88-004c442e617a/disk 1073741824 {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:46:12 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-bde5d896-8b7c-4b86-a374-6592cf341d03 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275,backing_fmt=raw /opt/stack/data/nova/instances/477da5ee-3e03-4aa9-9a88-004c442e617a/disk 1073741824" returned: 0 in 0.134s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:46:12 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-bde5d896-8b7c-4b86-a374-6592cf341d03 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Lock "06ba3c914798499e686c5ac75886932347225275" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.358s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:46:12 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-bde5d896-8b7c-4b86-a374-6592cf341d03 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:46:12 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:46:12 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-bde5d896-8b7c-4b86-a374-6592cf341d03 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json" returned: 0 in 0.202s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:46:12 user nova-compute[75337]: DEBUG nova.virt.disk.api [None req-bde5d896-8b7c-4b86-a374-6592cf341d03 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Checking if we can resize image /opt/stack/data/nova/instances/477da5ee-3e03-4aa9-9a88-004c442e617a/disk. size=1073741824 {{(pid=75337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 15:46:12 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-bde5d896-8b7c-4b86-a374-6592cf341d03 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/477da5ee-3e03-4aa9-9a88-004c442e617a/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:46:12 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-bde5d896-8b7c-4b86-a374-6592cf341d03 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/477da5ee-3e03-4aa9-9a88-004c442e617a/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:46:12 user nova-compute[75337]: DEBUG nova.virt.disk.api [None req-bde5d896-8b7c-4b86-a374-6592cf341d03 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Cannot resize image /opt/stack/data/nova/instances/477da5ee-3e03-4aa9-9a88-004c442e617a/disk to a smaller size. {{(pid=75337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 06 15:46:12 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-bde5d896-8b7c-4b86-a374-6592cf341d03 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] [instance: 477da5ee-3e03-4aa9-9a88-004c442e617a] Created local disks {{(pid=75337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 15:46:12 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-bde5d896-8b7c-4b86-a374-6592cf341d03 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] [instance: 477da5ee-3e03-4aa9-9a88-004c442e617a] Ensure instance console log exists: /opt/stack/data/nova/instances/477da5ee-3e03-4aa9-9a88-004c442e617a/console.log {{(pid=75337) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 15:46:12 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-bde5d896-8b7c-4b86-a374-6592cf341d03 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:46:12 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-bde5d896-8b7c-4b86-a374-6592cf341d03 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:46:12 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-bde5d896-8b7c-4b86-a374-6592cf341d03 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:46:13 user nova-compute[75337]: DEBUG nova.network.neutron [None req-bde5d896-8b7c-4b86-a374-6592cf341d03 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] [instance: 477da5ee-3e03-4aa9-9a88-004c442e617a] Successfully created port: 8e872f2c-9413-4a9e-8a10-606d0d9d0992 {{(pid=75337) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 15:46:13 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:46:14 user nova-compute[75337]: DEBUG nova.network.neutron [None req-bde5d896-8b7c-4b86-a374-6592cf341d03 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] [instance: 477da5ee-3e03-4aa9-9a88-004c442e617a] Successfully updated port: 8e872f2c-9413-4a9e-8a10-606d0d9d0992 {{(pid=75337) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 15:46:14 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-bde5d896-8b7c-4b86-a374-6592cf341d03 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Acquiring lock "refresh_cache-477da5ee-3e03-4aa9-9a88-004c442e617a" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 15:46:14 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-bde5d896-8b7c-4b86-a374-6592cf341d03 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Acquired lock "refresh_cache-477da5ee-3e03-4aa9-9a88-004c442e617a" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 15:46:14 user nova-compute[75337]: DEBUG nova.network.neutron [None req-bde5d896-8b7c-4b86-a374-6592cf341d03 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] [instance: 477da5ee-3e03-4aa9-9a88-004c442e617a] Building network info cache for instance {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 15:46:14 user nova-compute[75337]: DEBUG nova.compute.manager [req-ca2c5c3f-5989-4388-9f90-f9419fe7455b req-3c41bd8d-506f-4543-bd5b-2dd6f68c43d3 service nova] [instance: 477da5ee-3e03-4aa9-9a88-004c442e617a] Received event network-changed-8e872f2c-9413-4a9e-8a10-606d0d9d0992 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:46:14 user nova-compute[75337]: DEBUG nova.compute.manager [req-ca2c5c3f-5989-4388-9f90-f9419fe7455b req-3c41bd8d-506f-4543-bd5b-2dd6f68c43d3 service nova] [instance: 477da5ee-3e03-4aa9-9a88-004c442e617a] Refreshing instance network info cache due to event network-changed-8e872f2c-9413-4a9e-8a10-606d0d9d0992. {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 15:46:14 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-ca2c5c3f-5989-4388-9f90-f9419fe7455b req-3c41bd8d-506f-4543-bd5b-2dd6f68c43d3 service nova] Acquiring lock "refresh_cache-477da5ee-3e03-4aa9-9a88-004c442e617a" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 15:46:14 user nova-compute[75337]: DEBUG nova.network.neutron [None req-bde5d896-8b7c-4b86-a374-6592cf341d03 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] [instance: 477da5ee-3e03-4aa9-9a88-004c442e617a] Instance cache missing network info. {{(pid=75337) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 15:46:14 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:46:14 user nova-compute[75337]: DEBUG nova.network.neutron [None req-bde5d896-8b7c-4b86-a374-6592cf341d03 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] [instance: 477da5ee-3e03-4aa9-9a88-004c442e617a] Updating instance_info_cache with network_info: [{"id": "8e872f2c-9413-4a9e-8a10-606d0d9d0992", "address": "fa:16:3e:77:c1:a2", "network": {"id": "48f1545d-7e80-462f-9dbf-f1102ddcda9a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1210368397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1013e7afbefd4146a3be04587710b1de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e872f2c-94", "ovs_interfaceid": "8e872f2c-9413-4a9e-8a10-606d0d9d0992", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:46:14 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-bde5d896-8b7c-4b86-a374-6592cf341d03 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Releasing lock "refresh_cache-477da5ee-3e03-4aa9-9a88-004c442e617a" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 15:46:14 user nova-compute[75337]: DEBUG nova.compute.manager [None req-bde5d896-8b7c-4b86-a374-6592cf341d03 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] [instance: 477da5ee-3e03-4aa9-9a88-004c442e617a] Instance network_info: |[{"id": "8e872f2c-9413-4a9e-8a10-606d0d9d0992", "address": "fa:16:3e:77:c1:a2", "network": {"id": "48f1545d-7e80-462f-9dbf-f1102ddcda9a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1210368397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1013e7afbefd4146a3be04587710b1de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e872f2c-94", "ovs_interfaceid": "8e872f2c-9413-4a9e-8a10-606d0d9d0992", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 15:46:14 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-ca2c5c3f-5989-4388-9f90-f9419fe7455b req-3c41bd8d-506f-4543-bd5b-2dd6f68c43d3 service nova] Acquired lock "refresh_cache-477da5ee-3e03-4aa9-9a88-004c442e617a" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 15:46:14 user nova-compute[75337]: DEBUG nova.network.neutron [req-ca2c5c3f-5989-4388-9f90-f9419fe7455b req-3c41bd8d-506f-4543-bd5b-2dd6f68c43d3 service nova] [instance: 477da5ee-3e03-4aa9-9a88-004c442e617a] Refreshing network info cache for port 8e872f2c-9413-4a9e-8a10-606d0d9d0992 {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 15:46:14 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-bde5d896-8b7c-4b86-a374-6592cf341d03 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] [instance: 477da5ee-3e03-4aa9-9a88-004c442e617a] Start _get_guest_xml network_info=[{"id": "8e872f2c-9413-4a9e-8a10-606d0d9d0992", "address": "fa:16:3e:77:c1:a2", "network": {"id": "48f1545d-7e80-462f-9dbf-f1102ddcda9a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1210368397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1013e7afbefd4146a3be04587710b1de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e872f2c-94", "ovs_interfaceid": "8e872f2c-9413-4a9e-8a10-606d0d9d0992", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T15:34:14Z,direct_url=<?>,disk_format='qcow2',id=16b903ae-a40f-41a7-985b-4804cce92c62,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6549a15819f1469bbd5eeae8190e3d44',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T15:34:15Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'guest_format': None, 'size': 0, 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '16b903ae-a40f-41a7-985b-4804cce92c62'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 15:46:14 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-bde5d896-8b7c-4b86-a374-6592cf341d03 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 15:46:14 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-bde5d896-8b7c-4b86-a374-6592cf341d03 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 15:46:14 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-bde5d896-8b7c-4b86-a374-6592cf341d03 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 15:46:14 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-bde5d896-8b7c-4b86-a374-6592cf341d03 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] CPU controller missing on host. {{(pid=75337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 15:46:14 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-bde5d896-8b7c-4b86-a374-6592cf341d03 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 15:46:14 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-bde5d896-8b7c-4b86-a374-6592cf341d03 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] CPU controller found on host. {{(pid=75337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 15:46:14 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-bde5d896-8b7c-4b86-a374-6592cf341d03 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75337) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 15:46:14 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-bde5d896-8b7c-4b86-a374-6592cf341d03 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T15:34:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T15:34:14Z,direct_url=<?>,disk_format='qcow2',id=16b903ae-a40f-41a7-985b-4804cce92c62,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6549a15819f1469bbd5eeae8190e3d44',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T15:34:15Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 15:46:14 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-bde5d896-8b7c-4b86-a374-6592cf341d03 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Flavor limits 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 15:46:14 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-bde5d896-8b7c-4b86-a374-6592cf341d03 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Image limits 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 15:46:14 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-bde5d896-8b7c-4b86-a374-6592cf341d03 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Flavor pref 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 15:46:14 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-bde5d896-8b7c-4b86-a374-6592cf341d03 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Image pref 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 15:46:14 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-bde5d896-8b7c-4b86-a374-6592cf341d03 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 15:46:14 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-bde5d896-8b7c-4b86-a374-6592cf341d03 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 15:46:14 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-bde5d896-8b7c-4b86-a374-6592cf341d03 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 15:46:14 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-bde5d896-8b7c-4b86-a374-6592cf341d03 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Got 1 possible topologies {{(pid=75337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 15:46:14 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-bde5d896-8b7c-4b86-a374-6592cf341d03 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 15:46:14 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-bde5d896-8b7c-4b86-a374-6592cf341d03 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 15:46:15 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-bde5d896-8b7c-4b86-a374-6592cf341d03 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T15:46:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1758736972',display_name='tempest-AttachVolumeNegativeTest-server-1758736972',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1758736972',id=17,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH7dqPvhcfnz1mzEiM9azFogk5BeKGbk1O0PkhvUm2hejpeN3ZNjRmO4JMp/BDPtIIBh3UEc+th3rjiTBNJ7SgN2MuibVvfJd9bRg8igyNzS1HjslOYlCpfj954yLKP+4A==',key_name='tempest-keypair-26215211',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1013e7afbefd4146a3be04587710b1de',ramdisk_id='',reservation_id='r-ugao4b8b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1104237961',owner_user_name='tempest-AttachVolumeNegativeTest-1104237961-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T15:46:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aeeea58fcd3e4217a34a4a38be6adf30',uuid=477da5ee-3e03-4aa9-9a88-004c442e617a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8e872f2c-9413-4a9e-8a10-606d0d9d0992", "address": "fa:16:3e:77:c1:a2", "network": {"id": "48f1545d-7e80-462f-9dbf-f1102ddcda9a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1210368397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1013e7afbefd4146a3be04587710b1de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e872f2c-94", "ovs_interfaceid": "8e872f2c-9413-4a9e-8a10-606d0d9d0992", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75337) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 15:46:15 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-bde5d896-8b7c-4b86-a374-6592cf341d03 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Converting VIF {"id": "8e872f2c-9413-4a9e-8a10-606d0d9d0992", "address": "fa:16:3e:77:c1:a2", "network": {"id": "48f1545d-7e80-462f-9dbf-f1102ddcda9a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1210368397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1013e7afbefd4146a3be04587710b1de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e872f2c-94", "ovs_interfaceid": "8e872f2c-9413-4a9e-8a10-606d0d9d0992", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 15:46:15 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-bde5d896-8b7c-4b86-a374-6592cf341d03 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:c1:a2,bridge_name='br-int',has_traffic_filtering=True,id=8e872f2c-9413-4a9e-8a10-606d0d9d0992,network=Network(48f1545d-7e80-462f-9dbf-f1102ddcda9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e872f2c-94') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 15:46:15 user nova-compute[75337]: DEBUG nova.objects.instance [None req-bde5d896-8b7c-4b86-a374-6592cf341d03 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Lazy-loading 'pci_devices' on Instance uuid 477da5ee-3e03-4aa9-9a88-004c442e617a {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 15:46:15 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-bde5d896-8b7c-4b86-a374-6592cf341d03 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] [instance: 477da5ee-3e03-4aa9-9a88-004c442e617a] End _get_guest_xml xml=<domain type="kvm">
Nov 06 15:46:15 user nova-compute[75337]:   <uuid>477da5ee-3e03-4aa9-9a88-004c442e617a</uuid>
Nov 06 15:46:15 user nova-compute[75337]:   <name>instance-00000011</name>
Nov 06 15:46:15 user nova-compute[75337]:   <memory>524288</memory>
Nov 06 15:46:15 user nova-compute[75337]:   <vcpu>1</vcpu>
Nov 06 15:46:15 user nova-compute[75337]:   <metadata>
Nov 06 15:46:15 user nova-compute[75337]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 15:46:15 user nova-compute[75337]:       <nova:package version="0.0.0"/>
Nov 06 15:46:15 user nova-compute[75337]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1758736972</nova:name>
Nov 06 15:46:15 user nova-compute[75337]:       <nova:creationTime>2023-11-06 15:46:14</nova:creationTime>
Nov 06 15:46:15 user nova-compute[75337]:       <nova:flavor name="m1.tiny">
Nov 06 15:46:15 user nova-compute[75337]:         <nova:memory>512</nova:memory>
Nov 06 15:46:15 user nova-compute[75337]:         <nova:disk>1</nova:disk>
Nov 06 15:46:15 user nova-compute[75337]:         <nova:swap>0</nova:swap>
Nov 06 15:46:15 user nova-compute[75337]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 15:46:15 user nova-compute[75337]:         <nova:vcpus>1</nova:vcpus>
Nov 06 15:46:15 user nova-compute[75337]:       </nova:flavor>
Nov 06 15:46:15 user nova-compute[75337]:       <nova:owner>
Nov 06 15:46:15 user nova-compute[75337]:         <nova:user uuid="aeeea58fcd3e4217a34a4a38be6adf30">tempest-AttachVolumeNegativeTest-1104237961-project-member</nova:user>
Nov 06 15:46:15 user nova-compute[75337]:         <nova:project uuid="1013e7afbefd4146a3be04587710b1de">tempest-AttachVolumeNegativeTest-1104237961</nova:project>
Nov 06 15:46:15 user nova-compute[75337]:       </nova:owner>
Nov 06 15:46:15 user nova-compute[75337]:       <nova:root type="image" uuid="16b903ae-a40f-41a7-985b-4804cce92c62"/>
Nov 06 15:46:15 user nova-compute[75337]:       <nova:ports>
Nov 06 15:46:15 user nova-compute[75337]:         <nova:port uuid="8e872f2c-9413-4a9e-8a10-606d0d9d0992">
Nov 06 15:46:15 user nova-compute[75337]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 06 15:46:15 user nova-compute[75337]:         </nova:port>
Nov 06 15:46:15 user nova-compute[75337]:       </nova:ports>
Nov 06 15:46:15 user nova-compute[75337]:     </nova:instance>
Nov 06 15:46:15 user nova-compute[75337]:   </metadata>
Nov 06 15:46:15 user nova-compute[75337]:   <sysinfo type="smbios">
Nov 06 15:46:15 user nova-compute[75337]:     <system>
Nov 06 15:46:15 user nova-compute[75337]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 15:46:15 user nova-compute[75337]:       <entry name="product">OpenStack Nova</entry>
Nov 06 15:46:15 user nova-compute[75337]:       <entry name="version">0.0.0</entry>
Nov 06 15:46:15 user nova-compute[75337]:       <entry name="serial">477da5ee-3e03-4aa9-9a88-004c442e617a</entry>
Nov 06 15:46:15 user nova-compute[75337]:       <entry name="uuid">477da5ee-3e03-4aa9-9a88-004c442e617a</entry>
Nov 06 15:46:15 user nova-compute[75337]:       <entry name="family">Virtual Machine</entry>
Nov 06 15:46:15 user nova-compute[75337]:     </system>
Nov 06 15:46:15 user nova-compute[75337]:   </sysinfo>
Nov 06 15:46:15 user nova-compute[75337]:   <os>
Nov 06 15:46:15 user nova-compute[75337]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 15:46:15 user nova-compute[75337]:     <boot dev="hd"/>
Nov 06 15:46:15 user nova-compute[75337]:     <smbios mode="sysinfo"/>
Nov 06 15:46:15 user nova-compute[75337]:   </os>
Nov 06 15:46:15 user nova-compute[75337]:   <features>
Nov 06 15:46:15 user nova-compute[75337]:     <acpi/>
Nov 06 15:46:15 user nova-compute[75337]:     <apic/>
Nov 06 15:46:15 user nova-compute[75337]:     <vmcoreinfo/>
Nov 06 15:46:15 user nova-compute[75337]:   </features>
Nov 06 15:46:15 user nova-compute[75337]:   <clock offset="utc">
Nov 06 15:46:15 user nova-compute[75337]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 15:46:15 user nova-compute[75337]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 15:46:15 user nova-compute[75337]:     <timer name="hpet" present="no"/>
Nov 06 15:46:15 user nova-compute[75337]:   </clock>
Nov 06 15:46:15 user nova-compute[75337]:   <cpu mode="custom" match="exact">
Nov 06 15:46:15 user nova-compute[75337]:     <model>Nehalem</model>
Nov 06 15:46:15 user nova-compute[75337]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 15:46:15 user nova-compute[75337]:   </cpu>
Nov 06 15:46:15 user nova-compute[75337]:   <devices>
Nov 06 15:46:15 user nova-compute[75337]:     <disk type="file" device="disk">
Nov 06 15:46:15 user nova-compute[75337]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 15:46:15 user nova-compute[75337]:       <source file="/opt/stack/data/nova/instances/477da5ee-3e03-4aa9-9a88-004c442e617a/disk"/>
Nov 06 15:46:15 user nova-compute[75337]:       <target dev="vda" bus="virtio"/>
Nov 06 15:46:15 user nova-compute[75337]:     </disk>
Nov 06 15:46:15 user nova-compute[75337]:     <interface type="ethernet">
Nov 06 15:46:15 user nova-compute[75337]:       <mac address="fa:16:3e:77:c1:a2"/>
Nov 06 15:46:15 user nova-compute[75337]:       <model type="virtio"/>
Nov 06 15:46:15 user nova-compute[75337]:       <mtu size="1442"/>
Nov 06 15:46:15 user nova-compute[75337]:       <target dev="tap8e872f2c-94"/>
Nov 06 15:46:15 user nova-compute[75337]:     </interface>
Nov 06 15:46:15 user nova-compute[75337]:     <serial type="pty">
Nov 06 15:46:15 user nova-compute[75337]:       <log file="/opt/stack/data/nova/instances/477da5ee-3e03-4aa9-9a88-004c442e617a/console.log" append="off"/>
Nov 06 15:46:15 user nova-compute[75337]:     </serial>
Nov 06 15:46:15 user nova-compute[75337]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 15:46:15 user nova-compute[75337]:     <video>
Nov 06 15:46:15 user nova-compute[75337]:       <model type="virtio"/>
Nov 06 15:46:15 user nova-compute[75337]:     </video>
Nov 06 15:46:15 user nova-compute[75337]:     <rng model="virtio">
Nov 06 15:46:15 user nova-compute[75337]:       <backend model="random">/dev/urandom</backend>
Nov 06 15:46:15 user nova-compute[75337]:     </rng>
Nov 06 15:46:15 user nova-compute[75337]:     <controller type="usb" index="0" model="none"/>
Nov 06 15:46:15 user nova-compute[75337]:     <memballoon model="virtio">
Nov 06 15:46:15 user nova-compute[75337]:       <stats period="10"/>
Nov 06 15:46:15 user nova-compute[75337]:     </memballoon>
Nov 06 15:46:15 user nova-compute[75337]:   </devices>
Nov 06 15:46:15 user nova-compute[75337]: </domain>
Nov 06 15:46:15 user nova-compute[75337]:  {{(pid=75337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 15:46:15 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-bde5d896-8b7c-4b86-a374-6592cf341d03 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T15:46:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1758736972',display_name='tempest-AttachVolumeNegativeTest-server-1758736972',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1758736972',id=17,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH7dqPvhcfnz1mzEiM9azFogk5BeKGbk1O0PkhvUm2hejpeN3ZNjRmO4JMp/BDPtIIBh3UEc+th3rjiTBNJ7SgN2MuibVvfJd9bRg8igyNzS1HjslOYlCpfj954yLKP+4A==',key_name='tempest-keypair-26215211',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1013e7afbefd4146a3be04587710b1de',ramdisk_id='',reservation_id='r-ugao4b8b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1104237961',owner_user_name='tempest-AttachVolumeNegativeTest-1104237961-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T15:46:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aeeea58fcd3e4217a34a4a38be6adf30',uuid=477da5ee-3e03-4aa9-9a88-004c442e617a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8e872f2c-9413-4a9e-8a10-606d0d9d0992", "address": "fa:16:3e:77:c1:a2", "network": {"id": "48f1545d-7e80-462f-9dbf-f1102ddcda9a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1210368397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1013e7afbefd4146a3be04587710b1de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e872f2c-94", "ovs_interfaceid": "8e872f2c-9413-4a9e-8a10-606d0d9d0992", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 15:46:15 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-bde5d896-8b7c-4b86-a374-6592cf341d03 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Converting VIF {"id": "8e872f2c-9413-4a9e-8a10-606d0d9d0992", "address": "fa:16:3e:77:c1:a2", "network": {"id": "48f1545d-7e80-462f-9dbf-f1102ddcda9a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1210368397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1013e7afbefd4146a3be04587710b1de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e872f2c-94", "ovs_interfaceid": "8e872f2c-9413-4a9e-8a10-606d0d9d0992", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 15:46:15 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-bde5d896-8b7c-4b86-a374-6592cf341d03 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:c1:a2,bridge_name='br-int',has_traffic_filtering=True,id=8e872f2c-9413-4a9e-8a10-606d0d9d0992,network=Network(48f1545d-7e80-462f-9dbf-f1102ddcda9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e872f2c-94') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 15:46:15 user nova-compute[75337]: DEBUG os_vif [None req-bde5d896-8b7c-4b86-a374-6592cf341d03 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:c1:a2,bridge_name='br-int',has_traffic_filtering=True,id=8e872f2c-9413-4a9e-8a10-606d0d9d0992,network=Network(48f1545d-7e80-462f-9dbf-f1102ddcda9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e872f2c-94') {{(pid=75337) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 15:46:15 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:46:15 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:46:15 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 15:46:15 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:46:15 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd284a43d-6455-585e-b106-ec72e12720cb', '_type': 'linux-noop'}}, row=False) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:46:15 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:46:15 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:46:15 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:46:15 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8e872f2c-94, may_exist=True, interface_attrs={}) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:46:15 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8e872f2c-94, col_values=(('qos', UUID('97bca742-e7f4-4e1e-9231-e4eb19e2860c')),), if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:46:15 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8e872f2c-94, col_values=(('external_ids', {'iface-id': '8e872f2c-9413-4a9e-8a10-606d0d9d0992', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:77:c1:a2', 'vm-uuid': '477da5ee-3e03-4aa9-9a88-004c442e617a'}),), if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:46:15 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:46:15 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:46:15 user nova-compute[75337]: INFO os_vif [None req-bde5d896-8b7c-4b86-a374-6592cf341d03 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:c1:a2,bridge_name='br-int',has_traffic_filtering=True,id=8e872f2c-9413-4a9e-8a10-606d0d9d0992,network=Network(48f1545d-7e80-462f-9dbf-f1102ddcda9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e872f2c-94')
Nov 06 15:46:15 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-bde5d896-8b7c-4b86-a374-6592cf341d03 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] No BDM found with device name vda, not building metadata. {{(pid=75337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 15:46:15 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-bde5d896-8b7c-4b86-a374-6592cf341d03 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] No VIF found with MAC fa:16:3e:77:c1:a2, not building metadata {{(pid=75337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 15:46:15 user nova-compute[75337]: DEBUG nova.network.neutron [req-ca2c5c3f-5989-4388-9f90-f9419fe7455b req-3c41bd8d-506f-4543-bd5b-2dd6f68c43d3 service nova] [instance: 477da5ee-3e03-4aa9-9a88-004c442e617a] Updated VIF entry in instance network info cache for port 8e872f2c-9413-4a9e-8a10-606d0d9d0992. {{(pid=75337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 15:46:15 user nova-compute[75337]: DEBUG nova.network.neutron [req-ca2c5c3f-5989-4388-9f90-f9419fe7455b req-3c41bd8d-506f-4543-bd5b-2dd6f68c43d3 service nova] [instance: 477da5ee-3e03-4aa9-9a88-004c442e617a] Updating instance_info_cache with network_info: [{"id": "8e872f2c-9413-4a9e-8a10-606d0d9d0992", "address": "fa:16:3e:77:c1:a2", "network": {"id": "48f1545d-7e80-462f-9dbf-f1102ddcda9a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1210368397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1013e7afbefd4146a3be04587710b1de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e872f2c-94", "ovs_interfaceid": "8e872f2c-9413-4a9e-8a10-606d0d9d0992", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:46:15 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-ca2c5c3f-5989-4388-9f90-f9419fe7455b req-3c41bd8d-506f-4543-bd5b-2dd6f68c43d3 service nova] Releasing lock "refresh_cache-477da5ee-3e03-4aa9-9a88-004c442e617a" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 15:46:15 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:46:16 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:46:16 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:46:16 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:46:16 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:46:17 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:46:17 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:46:17 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:46:17 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-8c1b60b2-8606-41a0-93a4-8d7572a7cd70 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Acquiring lock "cdced0ba-84ff-42af-baab-e2f3412e1676" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:46:17 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-8c1b60b2-8606-41a0-93a4-8d7572a7cd70 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Lock "cdced0ba-84ff-42af-baab-e2f3412e1676" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:46:17 user nova-compute[75337]: DEBUG nova.objects.instance [None req-8c1b60b2-8606-41a0-93a4-8d7572a7cd70 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Lazy-loading 'flavor' on Instance uuid cdced0ba-84ff-42af-baab-e2f3412e1676 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 15:46:17 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-8c1b60b2-8606-41a0-93a4-8d7572a7cd70 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Lock "cdced0ba-84ff-42af-baab-e2f3412e1676" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.081s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:46:18 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:46:18 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-8c1b60b2-8606-41a0-93a4-8d7572a7cd70 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Acquiring lock "cdced0ba-84ff-42af-baab-e2f3412e1676" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:46:18 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-8c1b60b2-8606-41a0-93a4-8d7572a7cd70 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Lock "cdced0ba-84ff-42af-baab-e2f3412e1676" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:46:18 user nova-compute[75337]: INFO nova.compute.manager [None req-8c1b60b2-8606-41a0-93a4-8d7572a7cd70 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] [instance: cdced0ba-84ff-42af-baab-e2f3412e1676] Attaching volume 3b520000-6673-4e27-a3e8-770eb33d3751 to /dev/vdb
Nov 06 15:46:18 user nova-compute[75337]: DEBUG os_brick.utils [None req-8c1b60b2-8606-41a0-93a4-8d7572a7cd70 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 15:46:18 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:46:18 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:46:18 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[a876c583-57c7-4b58-8ddc-8782f08d6550]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4ff6411e45b8\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:46:18 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:46:18 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:46:18 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[351bec85-9e38-4966-996c-e17deea336a5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:46:18 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:46:18 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:46:18 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[253f4d2d-4fea-4534-bb9f-c673151218d9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:46:18 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[821372dd-3033-406d-85bb-a372b66f0cdb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:46:18 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-8c1b60b2-8606-41a0-93a4-8d7572a7cd70 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Running cmd (subprocess): nvme version {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:46:18 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-8c1b60b2-8606-41a0-93a4-8d7572a7cd70 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] 'nvme version' failed. Not Retrying. {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 15:46:18 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8c1b60b2-8606-41a0-93a4-8d7572a7cd70 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] nvme not present on system {{(pid=75337) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 15:46:18 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:46:18 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 15:46:18 user nova-compute[75337]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 15:46:18 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[17828a50-baba-46c2-8442-27d5fc82868a]: (4, '') {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:46:18 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.lightos [None req-8c1b60b2-8606-41a0-93a4-8d7572a7cd70 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75337) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 15:46:18 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.lightos [None req-8c1b60b2-8606-41a0-93a4-8d7572a7cd70 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 15:46:18 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.lightos [None req-8c1b60b2-8606-41a0-93a4-8d7572a7cd70 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] LIGHTOS: no hostnqn found. {{(pid=75337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 15:46:18 user nova-compute[75337]: DEBUG os_brick.utils [None req-8c1b60b2-8606-41a0-93a4-8d7572a7cd70 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4ff6411e45b8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 15:46:18 user nova-compute[75337]: DEBUG nova.virt.block_device [None req-8c1b60b2-8606-41a0-93a4-8d7572a7cd70 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] [instance: cdced0ba-84ff-42af-baab-e2f3412e1676] Updating existing volume attachment record: c4cbc0ab-2969-4e61-b016-40a6a44f9732 {{(pid=75337) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 15:46:18 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:46:19 user nova-compute[75337]: DEBUG nova.compute.manager [None req-bde5d896-8b7c-4b86-a374-6592cf341d03 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] [instance: 477da5ee-3e03-4aa9-9a88-004c442e617a] Instance event wait completed in 0 seconds for  {{(pid=75337) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 15:46:19 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-bde5d896-8b7c-4b86-a374-6592cf341d03 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] [instance: 477da5ee-3e03-4aa9-9a88-004c442e617a] Guest created on hypervisor {{(pid=75337) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 15:46:19 user nova-compute[75337]: INFO nova.virt.libvirt.driver [-] [instance: 477da5ee-3e03-4aa9-9a88-004c442e617a] Instance spawned successfully.
Nov 06 15:46:19 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-bde5d896-8b7c-4b86-a374-6592cf341d03 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] [instance: 477da5ee-3e03-4aa9-9a88-004c442e617a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 15:46:19 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-bde5d896-8b7c-4b86-a374-6592cf341d03 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] [instance: 477da5ee-3e03-4aa9-9a88-004c442e617a] Found default for hw_cdrom_bus of ide {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:46:19 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-bde5d896-8b7c-4b86-a374-6592cf341d03 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] [instance: 477da5ee-3e03-4aa9-9a88-004c442e617a] Found default for hw_disk_bus of virtio {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:46:19 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-bde5d896-8b7c-4b86-a374-6592cf341d03 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] [instance: 477da5ee-3e03-4aa9-9a88-004c442e617a] Found default for hw_input_bus of None {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:46:19 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-bde5d896-8b7c-4b86-a374-6592cf341d03 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] [instance: 477da5ee-3e03-4aa9-9a88-004c442e617a] Found default for hw_pointer_model of None {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:46:19 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-bde5d896-8b7c-4b86-a374-6592cf341d03 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] [instance: 477da5ee-3e03-4aa9-9a88-004c442e617a] Found default for hw_video_model of virtio {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:46:19 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-bde5d896-8b7c-4b86-a374-6592cf341d03 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] [instance: 477da5ee-3e03-4aa9-9a88-004c442e617a] Found default for hw_vif_model of virtio {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:46:19 user nova-compute[75337]: INFO nova.compute.manager [None req-bde5d896-8b7c-4b86-a374-6592cf341d03 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] [instance: 477da5ee-3e03-4aa9-9a88-004c442e617a] Took 7.38 seconds to spawn the instance on the hypervisor.
Nov 06 15:46:19 user nova-compute[75337]: DEBUG nova.compute.manager [None req-bde5d896-8b7c-4b86-a374-6592cf341d03 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] [instance: 477da5ee-3e03-4aa9-9a88-004c442e617a] Checking state {{(pid=75337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 15:46:19 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-a78c9495-b5d8-417c-917b-c902da60c29b tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Acquiring lock "bc0e07f8-2731-4ffa-8446-b71ad3ba7375" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:46:19 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-a78c9495-b5d8-417c-917b-c902da60c29b tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Lock "bc0e07f8-2731-4ffa-8446-b71ad3ba7375" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:46:19 user nova-compute[75337]: INFO nova.compute.manager [None req-bde5d896-8b7c-4b86-a374-6592cf341d03 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] [instance: 477da5ee-3e03-4aa9-9a88-004c442e617a] Took 8.31 seconds to build instance.
Nov 06 15:46:19 user nova-compute[75337]: DEBUG nova.compute.manager [None req-a78c9495-b5d8-417c-917b-c902da60c29b tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] [instance: bc0e07f8-2731-4ffa-8446-b71ad3ba7375] Starting instance... {{(pid=75337) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 15:46:19 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-bde5d896-8b7c-4b86-a374-6592cf341d03 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Lock "477da5ee-3e03-4aa9-9a88-004c442e617a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.578s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:46:19 user nova-compute[75337]: DEBUG nova.compute.manager [req-0a9d22e5-7ed0-4d8d-8b0b-b36d84ae55b0 req-c602c2cf-d538-45af-934b-a79167d5f2a6 service nova] [instance: 477da5ee-3e03-4aa9-9a88-004c442e617a] Received event network-vif-plugged-8e872f2c-9413-4a9e-8a10-606d0d9d0992 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:46:19 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-0a9d22e5-7ed0-4d8d-8b0b-b36d84ae55b0 req-c602c2cf-d538-45af-934b-a79167d5f2a6 service nova] Acquiring lock "477da5ee-3e03-4aa9-9a88-004c442e617a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:46:19 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-0a9d22e5-7ed0-4d8d-8b0b-b36d84ae55b0 req-c602c2cf-d538-45af-934b-a79167d5f2a6 service nova] Lock "477da5ee-3e03-4aa9-9a88-004c442e617a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:46:19 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-0a9d22e5-7ed0-4d8d-8b0b-b36d84ae55b0 req-c602c2cf-d538-45af-934b-a79167d5f2a6 service nova] Lock "477da5ee-3e03-4aa9-9a88-004c442e617a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:46:19 user nova-compute[75337]: DEBUG nova.compute.manager [req-0a9d22e5-7ed0-4d8d-8b0b-b36d84ae55b0 req-c602c2cf-d538-45af-934b-a79167d5f2a6 service nova] [instance: 477da5ee-3e03-4aa9-9a88-004c442e617a] No waiting events found dispatching network-vif-plugged-8e872f2c-9413-4a9e-8a10-606d0d9d0992 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:46:19 user nova-compute[75337]: WARNING nova.compute.manager [req-0a9d22e5-7ed0-4d8d-8b0b-b36d84ae55b0 req-c602c2cf-d538-45af-934b-a79167d5f2a6 service nova] [instance: 477da5ee-3e03-4aa9-9a88-004c442e617a] Received unexpected event network-vif-plugged-8e872f2c-9413-4a9e-8a10-606d0d9d0992 for instance with vm_state active and task_state None.
Nov 06 15:46:19 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-a78c9495-b5d8-417c-917b-c902da60c29b tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:46:19 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-a78c9495-b5d8-417c-917b-c902da60c29b tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:46:19 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-a78c9495-b5d8-417c-917b-c902da60c29b tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75337) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 15:46:19 user nova-compute[75337]: INFO nova.compute.claims [None req-a78c9495-b5d8-417c-917b-c902da60c29b tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] [instance: bc0e07f8-2731-4ffa-8446-b71ad3ba7375] Claim successful on node user
Nov 06 15:46:20 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:46:20 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-a78c9495-b5d8-417c-917b-c902da60c29b tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 15:46:20 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-a78c9495-b5d8-417c-917b-c902da60c29b tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 15:46:20 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-a78c9495-b5d8-417c-917b-c902da60c29b tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.627s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:46:20 user nova-compute[75337]: DEBUG nova.compute.manager [None req-a78c9495-b5d8-417c-917b-c902da60c29b tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] [instance: bc0e07f8-2731-4ffa-8446-b71ad3ba7375] Start building networks asynchronously for instance. {{(pid=75337) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 15:46:20 user nova-compute[75337]: DEBUG nova.compute.manager [None req-a78c9495-b5d8-417c-917b-c902da60c29b tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] [instance: bc0e07f8-2731-4ffa-8446-b71ad3ba7375] Allocating IP information in the background. {{(pid=75337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 15:46:20 user nova-compute[75337]: DEBUG nova.network.neutron [None req-a78c9495-b5d8-417c-917b-c902da60c29b tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] [instance: bc0e07f8-2731-4ffa-8446-b71ad3ba7375] allocate_for_instance() {{(pid=75337) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 15:46:20 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-a78c9495-b5d8-417c-917b-c902da60c29b tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] [instance: bc0e07f8-2731-4ffa-8446-b71ad3ba7375] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 15:46:20 user nova-compute[75337]: DEBUG nova.compute.manager [None req-a78c9495-b5d8-417c-917b-c902da60c29b tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] [instance: bc0e07f8-2731-4ffa-8446-b71ad3ba7375] Start building block device mappings for instance. {{(pid=75337) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 15:46:20 user nova-compute[75337]: DEBUG nova.policy [None req-a78c9495-b5d8-417c-917b-c902da60c29b tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8c795ee993a944ff89ed544450b90dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cddccc86bf54fe981667da5ef13fa8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75337) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 15:46:20 user nova-compute[75337]: DEBUG nova.compute.manager [None req-a78c9495-b5d8-417c-917b-c902da60c29b tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] [instance: bc0e07f8-2731-4ffa-8446-b71ad3ba7375] Start spawning the instance on the hypervisor. {{(pid=75337) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 15:46:20 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-a78c9495-b5d8-417c-917b-c902da60c29b tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] [instance: bc0e07f8-2731-4ffa-8446-b71ad3ba7375] Creating instance directory {{(pid=75337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 15:46:20 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-a78c9495-b5d8-417c-917b-c902da60c29b tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] [instance: bc0e07f8-2731-4ffa-8446-b71ad3ba7375] Creating image(s)
Nov 06 15:46:20 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-a78c9495-b5d8-417c-917b-c902da60c29b tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Acquiring lock "/opt/stack/data/nova/instances/bc0e07f8-2731-4ffa-8446-b71ad3ba7375/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:46:20 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-a78c9495-b5d8-417c-917b-c902da60c29b tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Lock "/opt/stack/data/nova/instances/bc0e07f8-2731-4ffa-8446-b71ad3ba7375/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:46:20 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-a78c9495-b5d8-417c-917b-c902da60c29b tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Lock "/opt/stack/data/nova/instances/bc0e07f8-2731-4ffa-8446-b71ad3ba7375/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:46:20 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-a78c9495-b5d8-417c-917b-c902da60c29b tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Acquiring lock "c7338109fcb7f9221b864c97256563d718cc56c1" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:46:20 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-a78c9495-b5d8-417c-917b-c902da60c29b tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Lock "c7338109fcb7f9221b864c97256563d718cc56c1" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:46:21 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-a78c9495-b5d8-417c-917b-c902da60c29b tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7338109fcb7f9221b864c97256563d718cc56c1.part --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:46:21 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:46:21 user nova-compute[75337]: DEBUG nova.compute.manager [req-bb8c94c9-8728-4380-bd59-791adcd330c3 req-962702ae-a1ca-4ca0-aea5-c18989f87d9b service nova] [instance: 477da5ee-3e03-4aa9-9a88-004c442e617a] Received event network-vif-plugged-8e872f2c-9413-4a9e-8a10-606d0d9d0992 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:46:21 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-bb8c94c9-8728-4380-bd59-791adcd330c3 req-962702ae-a1ca-4ca0-aea5-c18989f87d9b service nova] Acquiring lock "477da5ee-3e03-4aa9-9a88-004c442e617a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:46:21 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-bb8c94c9-8728-4380-bd59-791adcd330c3 req-962702ae-a1ca-4ca0-aea5-c18989f87d9b service nova] Lock "477da5ee-3e03-4aa9-9a88-004c442e617a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:46:21 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-bb8c94c9-8728-4380-bd59-791adcd330c3 req-962702ae-a1ca-4ca0-aea5-c18989f87d9b service nova] Lock "477da5ee-3e03-4aa9-9a88-004c442e617a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:46:21 user nova-compute[75337]: DEBUG nova.compute.manager [req-bb8c94c9-8728-4380-bd59-791adcd330c3 req-962702ae-a1ca-4ca0-aea5-c18989f87d9b service nova] [instance: 477da5ee-3e03-4aa9-9a88-004c442e617a] No waiting events found dispatching network-vif-plugged-8e872f2c-9413-4a9e-8a10-606d0d9d0992 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:46:21 user nova-compute[75337]: WARNING nova.compute.manager [req-bb8c94c9-8728-4380-bd59-791adcd330c3 req-962702ae-a1ca-4ca0-aea5-c18989f87d9b service nova] [instance: 477da5ee-3e03-4aa9-9a88-004c442e617a] Received unexpected event network-vif-plugged-8e872f2c-9413-4a9e-8a10-606d0d9d0992 for instance with vm_state active and task_state None.
Nov 06 15:46:21 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-a78c9495-b5d8-417c-917b-c902da60c29b tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7338109fcb7f9221b864c97256563d718cc56c1.part --force-share --output=json" returned: 0 in 0.263s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:46:21 user nova-compute[75337]: DEBUG nova.virt.images [None req-a78c9495-b5d8-417c-917b-c902da60c29b tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] 34019a0c-32a9-485d-804a-abd50629cecb was qcow2, converting to raw {{(pid=75337) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 06 15:46:21 user nova-compute[75337]: DEBUG nova.privsep.utils [None req-a78c9495-b5d8-417c-917b-c902da60c29b tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75337) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 06 15:46:21 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-a78c9495-b5d8-417c-917b-c902da60c29b tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c7338109fcb7f9221b864c97256563d718cc56c1.part /opt/stack/data/nova/instances/_base/c7338109fcb7f9221b864c97256563d718cc56c1.converted {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:46:22 user nova-compute[75337]: DEBUG nova.network.neutron [None req-a78c9495-b5d8-417c-917b-c902da60c29b tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] [instance: bc0e07f8-2731-4ffa-8446-b71ad3ba7375] Successfully created port: a20e3f62-5387-4f54-b623-d45a0a311da0 {{(pid=75337) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 15:46:22 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-a78c9495-b5d8-417c-917b-c902da60c29b tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c7338109fcb7f9221b864c97256563d718cc56c1.part /opt/stack/data/nova/instances/_base/c7338109fcb7f9221b864c97256563d718cc56c1.converted" returned: 0 in 0.403s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:46:22 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-a78c9495-b5d8-417c-917b-c902da60c29b tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7338109fcb7f9221b864c97256563d718cc56c1.converted --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:46:22 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-a78c9495-b5d8-417c-917b-c902da60c29b tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7338109fcb7f9221b864c97256563d718cc56c1.converted --force-share --output=json" returned: 0 in 0.233s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:46:22 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-a78c9495-b5d8-417c-917b-c902da60c29b tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Lock "c7338109fcb7f9221b864c97256563d718cc56c1" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.099s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:46:22 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-a78c9495-b5d8-417c-917b-c902da60c29b tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7338109fcb7f9221b864c97256563d718cc56c1 --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:46:22 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-a78c9495-b5d8-417c-917b-c902da60c29b tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7338109fcb7f9221b864c97256563d718cc56c1 --force-share --output=json" returned: 0 in 0.226s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:46:22 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-a78c9495-b5d8-417c-917b-c902da60c29b tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Acquiring lock "c7338109fcb7f9221b864c97256563d718cc56c1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:46:22 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-a78c9495-b5d8-417c-917b-c902da60c29b tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Lock "c7338109fcb7f9221b864c97256563d718cc56c1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:46:22 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-a78c9495-b5d8-417c-917b-c902da60c29b tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7338109fcb7f9221b864c97256563d718cc56c1 --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:46:22 user nova-compute[75337]: DEBUG nova.network.neutron [None req-a78c9495-b5d8-417c-917b-c902da60c29b tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] [instance: bc0e07f8-2731-4ffa-8446-b71ad3ba7375] Successfully updated port: a20e3f62-5387-4f54-b623-d45a0a311da0 {{(pid=75337) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 15:46:22 user nova-compute[75337]: DEBUG nova.compute.manager [req-eaa38946-1ab8-4fe5-bac8-2f2b90249572 req-48cefcba-86dc-45e9-9ff8-d10c097c2e6e service nova] [instance: bc0e07f8-2731-4ffa-8446-b71ad3ba7375] Received event network-changed-a20e3f62-5387-4f54-b623-d45a0a311da0 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:46:22 user nova-compute[75337]: DEBUG nova.compute.manager [req-eaa38946-1ab8-4fe5-bac8-2f2b90249572 req-48cefcba-86dc-45e9-9ff8-d10c097c2e6e service nova] [instance: bc0e07f8-2731-4ffa-8446-b71ad3ba7375] Refreshing instance network info cache due to event network-changed-a20e3f62-5387-4f54-b623-d45a0a311da0. {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 15:46:22 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-eaa38946-1ab8-4fe5-bac8-2f2b90249572 req-48cefcba-86dc-45e9-9ff8-d10c097c2e6e service nova] Acquiring lock "refresh_cache-bc0e07f8-2731-4ffa-8446-b71ad3ba7375" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 15:46:22 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-eaa38946-1ab8-4fe5-bac8-2f2b90249572 req-48cefcba-86dc-45e9-9ff8-d10c097c2e6e service nova] Acquired lock "refresh_cache-bc0e07f8-2731-4ffa-8446-b71ad3ba7375" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 15:46:22 user nova-compute[75337]: DEBUG nova.network.neutron [req-eaa38946-1ab8-4fe5-bac8-2f2b90249572 req-48cefcba-86dc-45e9-9ff8-d10c097c2e6e service nova] [instance: bc0e07f8-2731-4ffa-8446-b71ad3ba7375] Refreshing network info cache for port a20e3f62-5387-4f54-b623-d45a0a311da0 {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 15:46:22 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-a78c9495-b5d8-417c-917b-c902da60c29b tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Acquiring lock "refresh_cache-bc0e07f8-2731-4ffa-8446-b71ad3ba7375" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 15:46:23 user nova-compute[75337]: DEBUG nova.network.neutron [req-eaa38946-1ab8-4fe5-bac8-2f2b90249572 req-48cefcba-86dc-45e9-9ff8-d10c097c2e6e service nova] [instance: bc0e07f8-2731-4ffa-8446-b71ad3ba7375] Instance cache missing network info. {{(pid=75337) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 15:46:23 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-a78c9495-b5d8-417c-917b-c902da60c29b tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7338109fcb7f9221b864c97256563d718cc56c1 --force-share --output=json" returned: 0 in 0.237s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:46:23 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-a78c9495-b5d8-417c-917b-c902da60c29b tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c7338109fcb7f9221b864c97256563d718cc56c1,backing_fmt=raw /opt/stack/data/nova/instances/bc0e07f8-2731-4ffa-8446-b71ad3ba7375/disk 1073741824 {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:46:23 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-a78c9495-b5d8-417c-917b-c902da60c29b tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c7338109fcb7f9221b864c97256563d718cc56c1,backing_fmt=raw /opt/stack/data/nova/instances/bc0e07f8-2731-4ffa-8446-b71ad3ba7375/disk 1073741824" returned: 0 in 0.093s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:46:23 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-a78c9495-b5d8-417c-917b-c902da60c29b tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Lock "c7338109fcb7f9221b864c97256563d718cc56c1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.344s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:46:23 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-a78c9495-b5d8-417c-917b-c902da60c29b tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7338109fcb7f9221b864c97256563d718cc56c1 --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:46:23 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-a78c9495-b5d8-417c-917b-c902da60c29b tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7338109fcb7f9221b864c97256563d718cc56c1 --force-share --output=json" returned: 0 in 0.205s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:46:23 user nova-compute[75337]: DEBUG nova.virt.disk.api [None req-a78c9495-b5d8-417c-917b-c902da60c29b tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bc0e07f8-2731-4ffa-8446-b71ad3ba7375/disk. size=1073741824 {{(pid=75337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 15:46:23 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-a78c9495-b5d8-417c-917b-c902da60c29b tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc0e07f8-2731-4ffa-8446-b71ad3ba7375/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:46:23 user nova-compute[75337]: DEBUG nova.network.neutron [req-eaa38946-1ab8-4fe5-bac8-2f2b90249572 req-48cefcba-86dc-45e9-9ff8-d10c097c2e6e service nova] [instance: bc0e07f8-2731-4ffa-8446-b71ad3ba7375] Updating instance_info_cache with network_info: [] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:46:23 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-eaa38946-1ab8-4fe5-bac8-2f2b90249572 req-48cefcba-86dc-45e9-9ff8-d10c097c2e6e service nova] Releasing lock "refresh_cache-bc0e07f8-2731-4ffa-8446-b71ad3ba7375" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 15:46:23 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-a78c9495-b5d8-417c-917b-c902da60c29b tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Acquired lock "refresh_cache-bc0e07f8-2731-4ffa-8446-b71ad3ba7375" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 15:46:23 user nova-compute[75337]: DEBUG nova.network.neutron [None req-a78c9495-b5d8-417c-917b-c902da60c29b tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] [instance: bc0e07f8-2731-4ffa-8446-b71ad3ba7375] Building network info cache for instance {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 15:46:23 user nova-compute[75337]: DEBUG nova.network.neutron [None req-a78c9495-b5d8-417c-917b-c902da60c29b tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] [instance: bc0e07f8-2731-4ffa-8446-b71ad3ba7375] Instance cache missing network info. {{(pid=75337) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 15:46:23 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-a78c9495-b5d8-417c-917b-c902da60c29b tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc0e07f8-2731-4ffa-8446-b71ad3ba7375/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:46:23 user nova-compute[75337]: DEBUG nova.virt.disk.api [None req-a78c9495-b5d8-417c-917b-c902da60c29b tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Cannot resize image /opt/stack/data/nova/instances/bc0e07f8-2731-4ffa-8446-b71ad3ba7375/disk to a smaller size. {{(pid=75337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 06 15:46:23 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-a78c9495-b5d8-417c-917b-c902da60c29b tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] [instance: bc0e07f8-2731-4ffa-8446-b71ad3ba7375] Created local disks {{(pid=75337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 15:46:23 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-a78c9495-b5d8-417c-917b-c902da60c29b tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] [instance: bc0e07f8-2731-4ffa-8446-b71ad3ba7375] Ensure instance console log exists: /opt/stack/data/nova/instances/bc0e07f8-2731-4ffa-8446-b71ad3ba7375/console.log {{(pid=75337) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 15:46:23 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-a78c9495-b5d8-417c-917b-c902da60c29b tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:46:23 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-a78c9495-b5d8-417c-917b-c902da60c29b tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:46:23 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-a78c9495-b5d8-417c-917b-c902da60c29b tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:46:23 user nova-compute[75337]: DEBUG nova.network.neutron [None req-a78c9495-b5d8-417c-917b-c902da60c29b tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] [instance: bc0e07f8-2731-4ffa-8446-b71ad3ba7375] Updating instance_info_cache with network_info: [{"id": "a20e3f62-5387-4f54-b623-d45a0a311da0", "address": "fa:16:3e:fe:62:24", "network": {"id": "c31b513a-57f0-4bd5-b055-4a363aae9793", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1352256985-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cddccc86bf54fe981667da5ef13fa8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa20e3f62-53", "ovs_interfaceid": "a20e3f62-5387-4f54-b623-d45a0a311da0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:46:23 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-a78c9495-b5d8-417c-917b-c902da60c29b tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Releasing lock "refresh_cache-bc0e07f8-2731-4ffa-8446-b71ad3ba7375" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 15:46:23 user nova-compute[75337]: DEBUG nova.compute.manager [None req-a78c9495-b5d8-417c-917b-c902da60c29b tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] [instance: bc0e07f8-2731-4ffa-8446-b71ad3ba7375] Instance network_info: |[{"id": "a20e3f62-5387-4f54-b623-d45a0a311da0", "address": "fa:16:3e:fe:62:24", "network": {"id": "c31b513a-57f0-4bd5-b055-4a363aae9793", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1352256985-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cddccc86bf54fe981667da5ef13fa8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa20e3f62-53", "ovs_interfaceid": "a20e3f62-5387-4f54-b623-d45a0a311da0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 15:46:23 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-a78c9495-b5d8-417c-917b-c902da60c29b tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] [instance: bc0e07f8-2731-4ffa-8446-b71ad3ba7375] Start _get_guest_xml network_info=[{"id": "a20e3f62-5387-4f54-b623-d45a0a311da0", "address": "fa:16:3e:fe:62:24", "network": {"id": "c31b513a-57f0-4bd5-b055-4a363aae9793", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1352256985-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cddccc86bf54fe981667da5ef13fa8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa20e3f62-53", "ovs_interfaceid": "a20e3f62-5387-4f54-b623-d45a0a311da0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T15:46:16Z,direct_url=<?>,disk_format='qcow2',id=34019a0c-32a9-485d-804a-abd50629cecb,min_disk=0,min_ram=0,name='tempest-scenario-img--96459403',owner='2cddccc86bf54fe981667da5ef13fa8a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T15:46:18Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'guest_format': None, 'size': 0, 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '34019a0c-32a9-485d-804a-abd50629cecb'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 15:46:23 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:46:23 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-a78c9495-b5d8-417c-917b-c902da60c29b tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 15:46:23 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-a78c9495-b5d8-417c-917b-c902da60c29b tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 15:46:23 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-a78c9495-b5d8-417c-917b-c902da60c29b tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 15:46:23 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-a78c9495-b5d8-417c-917b-c902da60c29b tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] CPU controller missing on host. {{(pid=75337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 15:46:23 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-a78c9495-b5d8-417c-917b-c902da60c29b tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 15:46:23 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-a78c9495-b5d8-417c-917b-c902da60c29b tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] CPU controller found on host. {{(pid=75337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 15:46:23 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-a78c9495-b5d8-417c-917b-c902da60c29b tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75337) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 15:46:23 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-a78c9495-b5d8-417c-917b-c902da60c29b tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T15:34:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T15:46:16Z,direct_url=<?>,disk_format='qcow2',id=34019a0c-32a9-485d-804a-abd50629cecb,min_disk=0,min_ram=0,name='tempest-scenario-img--96459403',owner='2cddccc86bf54fe981667da5ef13fa8a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T15:46:18Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 15:46:23 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-a78c9495-b5d8-417c-917b-c902da60c29b tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Flavor limits 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 15:46:23 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-a78c9495-b5d8-417c-917b-c902da60c29b tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Image limits 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 15:46:23 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-a78c9495-b5d8-417c-917b-c902da60c29b tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Flavor pref 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 15:46:23 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-a78c9495-b5d8-417c-917b-c902da60c29b tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Image pref 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 15:46:23 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-a78c9495-b5d8-417c-917b-c902da60c29b tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 15:46:23 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-a78c9495-b5d8-417c-917b-c902da60c29b tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 15:46:23 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-a78c9495-b5d8-417c-917b-c902da60c29b tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 15:46:23 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-a78c9495-b5d8-417c-917b-c902da60c29b tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Got 1 possible topologies {{(pid=75337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 15:46:23 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-a78c9495-b5d8-417c-917b-c902da60c29b tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 15:46:23 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-a78c9495-b5d8-417c-917b-c902da60c29b tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 15:46:24 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-a78c9495-b5d8-417c-917b-c902da60c29b tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T15:46:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-305187601',display_name='tempest-TestMinimumBasicScenario-server-305187601',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-305187601',id=18,image_ref='34019a0c-32a9-485d-804a-abd50629cecb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLMTKRITbHOLi89utrqUrkdP7dp3D8u9fFIU8oK5Js2SaB/mlBSEFV4qG+zv1B+MrEcRr1Y6SUvYeu3ob8SsC0tPJypxoBps0L8MoitNXMQw8ZATzL/xbi+Lgg+BOq0dGA==',key_name='tempest-TestMinimumBasicScenario-1417411849',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2cddccc86bf54fe981667da5ef13fa8a',ramdisk_id='',reservation_id='r-p3ne9skw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='34019a0c-32a9-485d-804a-abd50629cecb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-2098539193',owner_user_name='tempest-TestMinimumBasicScenario-2098539193-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T15:46:20Z,user_data=None,user_id='8c795ee993a944ff89ed544450b90dc2',uuid=bc0e07f8-2731-4ffa-8446-b71ad3ba7375,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a20e3f62-5387-4f54-b623-d45a0a311da0", "address": "fa:16:3e:fe:62:24", "network": {"id": "c31b513a-57f0-4bd5-b055-4a363aae9793", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1352256985-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cddccc86bf54fe981667da5ef13fa8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa20e3f62-53", "ovs_interfaceid": "a20e3f62-5387-4f54-b623-d45a0a311da0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75337) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 15:46:24 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-a78c9495-b5d8-417c-917b-c902da60c29b tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Converting VIF {"id": "a20e3f62-5387-4f54-b623-d45a0a311da0", "address": "fa:16:3e:fe:62:24", "network": {"id": "c31b513a-57f0-4bd5-b055-4a363aae9793", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1352256985-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cddccc86bf54fe981667da5ef13fa8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa20e3f62-53", "ovs_interfaceid": "a20e3f62-5387-4f54-b623-d45a0a311da0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 15:46:24 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-a78c9495-b5d8-417c-917b-c902da60c29b tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:62:24,bridge_name='br-int',has_traffic_filtering=True,id=a20e3f62-5387-4f54-b623-d45a0a311da0,network=Network(c31b513a-57f0-4bd5-b055-4a363aae9793),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa20e3f62-53') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 15:46:24 user nova-compute[75337]: DEBUG nova.objects.instance [None req-a78c9495-b5d8-417c-917b-c902da60c29b tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Lazy-loading 'pci_devices' on Instance uuid bc0e07f8-2731-4ffa-8446-b71ad3ba7375 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 15:46:24 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-a78c9495-b5d8-417c-917b-c902da60c29b tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] [instance: bc0e07f8-2731-4ffa-8446-b71ad3ba7375] End _get_guest_xml xml=<domain type="kvm">
Nov 06 15:46:24 user nova-compute[75337]:   <uuid>bc0e07f8-2731-4ffa-8446-b71ad3ba7375</uuid>
Nov 06 15:46:24 user nova-compute[75337]:   <name>instance-00000012</name>
Nov 06 15:46:24 user nova-compute[75337]:   <memory>524288</memory>
Nov 06 15:46:24 user nova-compute[75337]:   <vcpu>1</vcpu>
Nov 06 15:46:24 user nova-compute[75337]:   <metadata>
Nov 06 15:46:24 user nova-compute[75337]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 15:46:24 user nova-compute[75337]:       <nova:package version="0.0.0"/>
Nov 06 15:46:24 user nova-compute[75337]:       <nova:name>tempest-TestMinimumBasicScenario-server-305187601</nova:name>
Nov 06 15:46:24 user nova-compute[75337]:       <nova:creationTime>2023-11-06 15:46:23</nova:creationTime>
Nov 06 15:46:24 user nova-compute[75337]:       <nova:flavor name="m1.tiny">
Nov 06 15:46:24 user nova-compute[75337]:         <nova:memory>512</nova:memory>
Nov 06 15:46:24 user nova-compute[75337]:         <nova:disk>1</nova:disk>
Nov 06 15:46:24 user nova-compute[75337]:         <nova:swap>0</nova:swap>
Nov 06 15:46:24 user nova-compute[75337]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 15:46:24 user nova-compute[75337]:         <nova:vcpus>1</nova:vcpus>
Nov 06 15:46:24 user nova-compute[75337]:       </nova:flavor>
Nov 06 15:46:24 user nova-compute[75337]:       <nova:owner>
Nov 06 15:46:24 user nova-compute[75337]:         <nova:user uuid="8c795ee993a944ff89ed544450b90dc2">tempest-TestMinimumBasicScenario-2098539193-project-member</nova:user>
Nov 06 15:46:24 user nova-compute[75337]:         <nova:project uuid="2cddccc86bf54fe981667da5ef13fa8a">tempest-TestMinimumBasicScenario-2098539193</nova:project>
Nov 06 15:46:24 user nova-compute[75337]:       </nova:owner>
Nov 06 15:46:24 user nova-compute[75337]:       <nova:root type="image" uuid="34019a0c-32a9-485d-804a-abd50629cecb"/>
Nov 06 15:46:24 user nova-compute[75337]:       <nova:ports>
Nov 06 15:46:24 user nova-compute[75337]:         <nova:port uuid="a20e3f62-5387-4f54-b623-d45a0a311da0">
Nov 06 15:46:24 user nova-compute[75337]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 06 15:46:24 user nova-compute[75337]:         </nova:port>
Nov 06 15:46:24 user nova-compute[75337]:       </nova:ports>
Nov 06 15:46:24 user nova-compute[75337]:     </nova:instance>
Nov 06 15:46:24 user nova-compute[75337]:   </metadata>
Nov 06 15:46:24 user nova-compute[75337]:   <sysinfo type="smbios">
Nov 06 15:46:24 user nova-compute[75337]:     <system>
Nov 06 15:46:24 user nova-compute[75337]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 15:46:24 user nova-compute[75337]:       <entry name="product">OpenStack Nova</entry>
Nov 06 15:46:24 user nova-compute[75337]:       <entry name="version">0.0.0</entry>
Nov 06 15:46:24 user nova-compute[75337]:       <entry name="serial">bc0e07f8-2731-4ffa-8446-b71ad3ba7375</entry>
Nov 06 15:46:24 user nova-compute[75337]:       <entry name="uuid">bc0e07f8-2731-4ffa-8446-b71ad3ba7375</entry>
Nov 06 15:46:24 user nova-compute[75337]:       <entry name="family">Virtual Machine</entry>
Nov 06 15:46:24 user nova-compute[75337]:     </system>
Nov 06 15:46:24 user nova-compute[75337]:   </sysinfo>
Nov 06 15:46:24 user nova-compute[75337]:   <os>
Nov 06 15:46:24 user nova-compute[75337]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 15:46:24 user nova-compute[75337]:     <boot dev="hd"/>
Nov 06 15:46:24 user nova-compute[75337]:     <smbios mode="sysinfo"/>
Nov 06 15:46:24 user nova-compute[75337]:   </os>
Nov 06 15:46:24 user nova-compute[75337]:   <features>
Nov 06 15:46:24 user nova-compute[75337]:     <acpi/>
Nov 06 15:46:24 user nova-compute[75337]:     <apic/>
Nov 06 15:46:24 user nova-compute[75337]:     <vmcoreinfo/>
Nov 06 15:46:24 user nova-compute[75337]:   </features>
Nov 06 15:46:24 user nova-compute[75337]:   <clock offset="utc">
Nov 06 15:46:24 user nova-compute[75337]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 15:46:24 user nova-compute[75337]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 15:46:24 user nova-compute[75337]:     <timer name="hpet" present="no"/>
Nov 06 15:46:24 user nova-compute[75337]:   </clock>
Nov 06 15:46:24 user nova-compute[75337]:   <cpu mode="custom" match="exact">
Nov 06 15:46:24 user nova-compute[75337]:     <model>Nehalem</model>
Nov 06 15:46:24 user nova-compute[75337]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 15:46:24 user nova-compute[75337]:   </cpu>
Nov 06 15:46:24 user nova-compute[75337]:   <devices>
Nov 06 15:46:24 user nova-compute[75337]:     <disk type="file" device="disk">
Nov 06 15:46:24 user nova-compute[75337]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 15:46:24 user nova-compute[75337]:       <source file="/opt/stack/data/nova/instances/bc0e07f8-2731-4ffa-8446-b71ad3ba7375/disk"/>
Nov 06 15:46:24 user nova-compute[75337]:       <target dev="vda" bus="virtio"/>
Nov 06 15:46:24 user nova-compute[75337]:     </disk>
Nov 06 15:46:24 user nova-compute[75337]:     <interface type="ethernet">
Nov 06 15:46:24 user nova-compute[75337]:       <mac address="fa:16:3e:fe:62:24"/>
Nov 06 15:46:24 user nova-compute[75337]:       <model type="virtio"/>
Nov 06 15:46:24 user nova-compute[75337]:       <mtu size="1442"/>
Nov 06 15:46:24 user nova-compute[75337]:       <target dev="tapa20e3f62-53"/>
Nov 06 15:46:24 user nova-compute[75337]:     </interface>
Nov 06 15:46:24 user nova-compute[75337]:     <serial type="pty">
Nov 06 15:46:24 user nova-compute[75337]:       <log file="/opt/stack/data/nova/instances/bc0e07f8-2731-4ffa-8446-b71ad3ba7375/console.log" append="off"/>
Nov 06 15:46:24 user nova-compute[75337]:     </serial>
Nov 06 15:46:24 user nova-compute[75337]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 15:46:24 user nova-compute[75337]:     <video>
Nov 06 15:46:24 user nova-compute[75337]:       <model type="virtio"/>
Nov 06 15:46:24 user nova-compute[75337]:     </video>
Nov 06 15:46:24 user nova-compute[75337]:     <rng model="virtio">
Nov 06 15:46:24 user nova-compute[75337]:       <backend model="random">/dev/urandom</backend>
Nov 06 15:46:24 user nova-compute[75337]:     </rng>
Nov 06 15:46:24 user nova-compute[75337]:     <controller type="usb" index="0" model="none"/>
Nov 06 15:46:24 user nova-compute[75337]:     <memballoon model="virtio">
Nov 06 15:46:24 user nova-compute[75337]:       <stats period="10"/>
Nov 06 15:46:24 user nova-compute[75337]:     </memballoon>
Nov 06 15:46:24 user nova-compute[75337]:   </devices>
Nov 06 15:46:24 user nova-compute[75337]: </domain>
Nov 06 15:46:24 user nova-compute[75337]:  {{(pid=75337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 15:46:24 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-a78c9495-b5d8-417c-917b-c902da60c29b tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T15:46:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-305187601',display_name='tempest-TestMinimumBasicScenario-server-305187601',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-305187601',id=18,image_ref='34019a0c-32a9-485d-804a-abd50629cecb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLMTKRITbHOLi89utrqUrkdP7dp3D8u9fFIU8oK5Js2SaB/mlBSEFV4qG+zv1B+MrEcRr1Y6SUvYeu3ob8SsC0tPJypxoBps0L8MoitNXMQw8ZATzL/xbi+Lgg+BOq0dGA==',key_name='tempest-TestMinimumBasicScenario-1417411849',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2cddccc86bf54fe981667da5ef13fa8a',ramdisk_id='',reservation_id='r-p3ne9skw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='34019a0c-32a9-485d-804a-abd50629cecb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-2098539193',owner_user_name='tempest-TestMinimumBasicScenario-2098539193-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T15:46:20Z,user_data=None,user_id='8c795ee993a944ff89ed544450b90dc2',uuid=bc0e07f8-2731-4ffa-8446-b71ad3ba7375,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a20e3f62-5387-4f54-b623-d45a0a311da0", "address": "fa:16:3e:fe:62:24", "network": {"id": "c31b513a-57f0-4bd5-b055-4a363aae9793", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1352256985-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cddccc86bf54fe981667da5ef13fa8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa20e3f62-53", "ovs_interfaceid": "a20e3f62-5387-4f54-b623-d45a0a311da0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 15:46:24 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-a78c9495-b5d8-417c-917b-c902da60c29b tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Converting VIF {"id": "a20e3f62-5387-4f54-b623-d45a0a311da0", "address": "fa:16:3e:fe:62:24", "network": {"id": "c31b513a-57f0-4bd5-b055-4a363aae9793", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1352256985-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cddccc86bf54fe981667da5ef13fa8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa20e3f62-53", "ovs_interfaceid": "a20e3f62-5387-4f54-b623-d45a0a311da0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 15:46:24 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-a78c9495-b5d8-417c-917b-c902da60c29b tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:62:24,bridge_name='br-int',has_traffic_filtering=True,id=a20e3f62-5387-4f54-b623-d45a0a311da0,network=Network(c31b513a-57f0-4bd5-b055-4a363aae9793),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa20e3f62-53') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 15:46:24 user nova-compute[75337]: DEBUG os_vif [None req-a78c9495-b5d8-417c-917b-c902da60c29b tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:62:24,bridge_name='br-int',has_traffic_filtering=True,id=a20e3f62-5387-4f54-b623-d45a0a311da0,network=Network(c31b513a-57f0-4bd5-b055-4a363aae9793),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa20e3f62-53') {{(pid=75337) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 15:46:24 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:46:24 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:46:24 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 15:46:24 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:46:24 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2805d5bf-06e4-539b-9363-4e4c1afc4206', '_type': 'linux-noop'}}, row=False) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:46:24 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:46:24 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:46:24 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:46:24 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa20e3f62-53, may_exist=True, interface_attrs={}) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:46:24 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa20e3f62-53, col_values=(('qos', UUID('29c45ad1-069e-4f97-8d3e-ea6cbb33a995')),), if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:46:24 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa20e3f62-53, col_values=(('external_ids', {'iface-id': 'a20e3f62-5387-4f54-b623-d45a0a311da0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fe:62:24', 'vm-uuid': 'bc0e07f8-2731-4ffa-8446-b71ad3ba7375'}),), if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:46:24 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:46:24 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:46:24 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:46:24 user nova-compute[75337]: INFO os_vif [None req-a78c9495-b5d8-417c-917b-c902da60c29b tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:62:24,bridge_name='br-int',has_traffic_filtering=True,id=a20e3f62-5387-4f54-b623-d45a0a311da0,network=Network(c31b513a-57f0-4bd5-b055-4a363aae9793),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa20e3f62-53')
Nov 06 15:46:24 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-a78c9495-b5d8-417c-917b-c902da60c29b tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] No BDM found with device name vda, not building metadata. {{(pid=75337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 15:46:24 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-a78c9495-b5d8-417c-917b-c902da60c29b tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] No VIF found with MAC fa:16:3e:fe:62:24, not building metadata {{(pid=75337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 15:46:25 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-eacdaf5c-1ea7-42ff-8f44-e7e407aedc23 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance c8cf1ead-a87c-459c-b914-a0e976c9e464 is timed out.
Nov 06 15:46:25 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-eacdaf5c-1ea7-42ff-8f44-e7e407aedc23 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Successfully detached device vdb from instance c8cf1ead-a87c-459c-b914-a0e976c9e464 from the live domain config.
Nov 06 15:46:25 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eacdaf5c-1ea7-42ff-8f44-e7e407aedc23 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] [instance: c8cf1ead-a87c-459c-b914-a0e976c9e464] calling os-brick to detach iSCSI Volume {{(pid=75337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 15:46:25 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-eacdaf5c-1ea7-42ff-8f44-e7e407aedc23 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2abc33d0c0>, {'target_iqn': 'iqn.2010-10.org.openstack:6f5503fc-8cc8-46fa-8450-d967f769a947', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kStTucve', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 15:46:25 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-eacdaf5c-1ea7-42ff-8f44-e7e407aedc23 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 15:46:25 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-eacdaf5c-1ea7-42ff-8f44-e7e407aedc23 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 15:46:25 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-eacdaf5c-1ea7-42ff-8f44-e7e407aedc23 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 15:46:25 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:46:25 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:46:25 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[d22c370d-583f-4191-bb96-a9550452c4f7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6f5503fc-8cc8-46fa-8450-d967f769a947\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:46c1deb3-55e2-44bd-b4da-b037378d79f2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:46:25 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-eacdaf5c-1ea7-42ff-8f44-e7e407aedc23 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 15:46:25 user nova-compute[75337]: No targets found.
Nov 06 15:46:25 user nova-compute[75337]: iSNS:
Nov 06 15:46:25 user nova-compute[75337]: No targets found.
Nov 06 15:46:25 user nova-compute[75337]: STATIC:
Nov 06 15:46:25 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e
Nov 06 15:46:25 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 15:46:25 user nova-compute[75337]:                 Iface Name: default
Nov 06 15:46:25 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:6f5503fc-8cc8-46fa-8450-d967f769a947
Nov 06 15:46:25 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 15:46:25 user nova-compute[75337]:                 Iface Name: default
Nov 06 15:46:25 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:46c1deb3-55e2-44bd-b4da-b037378d79f2
Nov 06 15:46:25 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 15:46:25 user nova-compute[75337]:                 Iface Name: default
Nov 06 15:46:25 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158
Nov 06 15:46:25 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 15:46:25 user nova-compute[75337]:                 Iface Name: default
Nov 06 15:46:25 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6
Nov 06 15:46:25 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 15:46:25 user nova-compute[75337]:                 Iface Name: default
Nov 06 15:46:25 user nova-compute[75337]: FIRMWARE:
Nov 06 15:46:25 user nova-compute[75337]: No targets found.
Nov 06 15:46:25 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 15:46:25 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-eacdaf5c-1ea7-42ff-8f44-e7e407aedc23 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 15:46:25 user nova-compute[75337]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 15:46:25 user nova-compute[75337]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75337) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 15:46:25 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-eacdaf5c-1ea7-42ff-8f44-e7e407aedc23 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6f5503fc-8cc8-46fa-8450-d967f769a947', 0)] {{(pid=75337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 15:46:25 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:46:25 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:46:25 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8be6eed-578c-433a-99dd-56f73b379b61]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:46c1deb3-55e2-44bd-b4da-b037378d79f2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6f5503fc-8cc8-46fa-8450-d967f769a947\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:46:25 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:46:25 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:46:25 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[944aad96-77e6-485f-adec-3cbdc9c10921]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f5503fc-8cc8-46fa-8450-d967f769a947 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c1deb3-55e2-44bd-b4da-b037378d79f2 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6 (non-flash)\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:46:25 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-eacdaf5c-1ea7-42ff-8f44-e7e407aedc23 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)
Nov 06 15:46:25 user nova-compute[75337]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f5503fc-8cc8-46fa-8450-d967f769a947 (non-flash)
Nov 06 15:46:25 user nova-compute[75337]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e (non-flash)
Nov 06 15:46:25 user nova-compute[75337]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c1deb3-55e2-44bd-b4da-b037378d79f2 (non-flash)
Nov 06 15:46:25 user nova-compute[75337]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6 (non-flash)
Nov 06 15:46:25 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 15:46:25 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-eacdaf5c-1ea7-42ff-8f44-e7e407aedc23 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)
Nov 06 15:46:25 user nova-compute[75337]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f5503fc-8cc8-46fa-8450-d967f769a947 (non-flash)
Nov 06 15:46:25 user nova-compute[75337]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e (non-flash)
Nov 06 15:46:25 user nova-compute[75337]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c1deb3-55e2-44bd-b4da-b037378d79f2 (non-flash)
Nov 06 15:46:25 user nova-compute[75337]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6 (non-flash)
Nov 06 15:46:25 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 15:46:25 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-eacdaf5c-1ea7-42ff-8f44-e7e407aedc23 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2a9c33e680>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6f5503fc-8cc8-46fa-8450-d967f769a947'): ({'sdd'}, set())}) {{(pid=75337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 15:46:25 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-eacdaf5c-1ea7-42ff-8f44-e7e407aedc23 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Removing single pathed devices sdd {{(pid=75337) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 15:46:25 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:46:25 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:46:25 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[144eac0d-8bfa-4b90-b122-5550d8156419]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:46:25 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:46:25 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:46:25 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b28a834-1fda-4ccf-967e-4b73fd2aca1b]: (4, ('ok\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:46:25 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-eacdaf5c-1ea7-42ff-8f44-e7e407aedc23 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Flushing IO for device /dev/sdd {{(pid=75337) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 15:46:25 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:46:25 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:46:25 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc8f1661-2d2a-42e5-84f2-91eab5eb4668]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:46:25 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-eacdaf5c-1ea7-42ff-8f44-e7e407aedc23 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75337) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 15:46:25 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:46:25 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.048s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:46:25 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[a14b38a0-cb20-4f45-bf10-f5210e3b3ec0]: (4, ('1', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:46:25 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-eacdaf5c-1ea7-42ff-8f44-e7e407aedc23 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 15:46:25 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-eacdaf5c-1ea7-42ff-8f44-e7e407aedc23 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] SCSI volumes sdd have been removed. {{(pid=75337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 15:46:25 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-eacdaf5c-1ea7-42ff-8f44-e7e407aedc23 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6f5503fc-8cc8-46fa-8450-d967f769a947')] {{(pid=75337) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 15:46:25 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f5503fc-8cc8-46fa-8450-d967f769a947 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:46:25 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f5503fc-8cc8-46fa-8450-d967f769a947 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:46:25 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[8937eb27-020d-4360-85ec-70406da343f8]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:46:25 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-eacdaf5c-1ea7-42ff-8f44-e7e407aedc23 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:46:25 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f5503fc-8cc8-46fa-8450-d967f769a947 -p 172.16.0.220:3260 --logout {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:46:25 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f5503fc-8cc8-46fa-8450-d967f769a947 -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:46:25 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[198ff1d4-f29f-4a35-bcbd-521c5e0b7657]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:6f5503fc-8cc8-46fa-8450-d967f769a947, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:6f5503fc-8cc8-46fa-8450-d967f769a947, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:46:25 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-eacdaf5c-1ea7-42ff-8f44-e7e407aedc23 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:6f5503fc-8cc8-46fa-8450-d967f769a947, portal: 172.16.0.220,3260]
Nov 06 15:46:25 user nova-compute[75337]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:6f5503fc-8cc8-46fa-8450-d967f769a947, portal: 172.16.0.220,3260] successful.
Nov 06 15:46:25 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:46:25 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f5503fc-8cc8-46fa-8450-d967f769a947 -p 172.16.0.220:3260 --op delete {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:46:25 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f5503fc-8cc8-46fa-8450-d967f769a947 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:46:25 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[48024440-8a35-49b4-8e55-07d912a79845]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:46:25 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-eacdaf5c-1ea7-42ff-8f44-e7e407aedc23 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:46:25 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-eacdaf5c-1ea7-42ff-8f44-e7e407aedc23 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.397s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 15:46:25 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-eacdaf5c-1ea7-42ff-8f44-e7e407aedc23 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] <== disconnect_volume: return (399ms) None {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 15:46:25 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eacdaf5c-1ea7-42ff-8f44-e7e407aedc23 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] [instance: c8cf1ead-a87c-459c-b914-a0e976c9e464] Disconnected iSCSI Volume {{(pid=75337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 15:46:25 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:46:25 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:46:25 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:46:25 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:46:26 user nova-compute[75337]: DEBUG nova.compute.manager [req-a1c1f888-5da9-4d9f-92f8-afa39e747da6 req-a11280e5-8d1e-49b0-adc2-e39c8fa075ef service nova] [instance: bc0e07f8-2731-4ffa-8446-b71ad3ba7375] Received event network-vif-plugged-a20e3f62-5387-4f54-b623-d45a0a311da0 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:46:26 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-a1c1f888-5da9-4d9f-92f8-afa39e747da6 req-a11280e5-8d1e-49b0-adc2-e39c8fa075ef service nova] Acquiring lock "bc0e07f8-2731-4ffa-8446-b71ad3ba7375-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:46:26 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-a1c1f888-5da9-4d9f-92f8-afa39e747da6 req-a11280e5-8d1e-49b0-adc2-e39c8fa075ef service nova] Lock "bc0e07f8-2731-4ffa-8446-b71ad3ba7375-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:46:26 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-a1c1f888-5da9-4d9f-92f8-afa39e747da6 req-a11280e5-8d1e-49b0-adc2-e39c8fa075ef service nova] Lock "bc0e07f8-2731-4ffa-8446-b71ad3ba7375-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:46:26 user nova-compute[75337]: DEBUG nova.compute.manager [req-a1c1f888-5da9-4d9f-92f8-afa39e747da6 req-a11280e5-8d1e-49b0-adc2-e39c8fa075ef service nova] [instance: bc0e07f8-2731-4ffa-8446-b71ad3ba7375] No waiting events found dispatching network-vif-plugged-a20e3f62-5387-4f54-b623-d45a0a311da0 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:46:26 user nova-compute[75337]: WARNING nova.compute.manager [req-a1c1f888-5da9-4d9f-92f8-afa39e747da6 req-a11280e5-8d1e-49b0-adc2-e39c8fa075ef service nova] [instance: bc0e07f8-2731-4ffa-8446-b71ad3ba7375] Received unexpected event network-vif-plugged-a20e3f62-5387-4f54-b623-d45a0a311da0 for instance with vm_state building and task_state spawning.
Nov 06 15:46:26 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:46:26 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:46:26 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:46:26 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:46:28 user nova-compute[75337]: DEBUG nova.compute.manager [req-28a4445a-ed46-4277-9f3a-774699ad5fa5 req-fd534f87-e28b-4107-ba11-24324d546305 service nova] [instance: bc0e07f8-2731-4ffa-8446-b71ad3ba7375] Received event network-vif-plugged-a20e3f62-5387-4f54-b623-d45a0a311da0 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:46:28 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-28a4445a-ed46-4277-9f3a-774699ad5fa5 req-fd534f87-e28b-4107-ba11-24324d546305 service nova] Acquiring lock "bc0e07f8-2731-4ffa-8446-b71ad3ba7375-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:46:28 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-28a4445a-ed46-4277-9f3a-774699ad5fa5 req-fd534f87-e28b-4107-ba11-24324d546305 service nova] Lock "bc0e07f8-2731-4ffa-8446-b71ad3ba7375-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:46:28 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-28a4445a-ed46-4277-9f3a-774699ad5fa5 req-fd534f87-e28b-4107-ba11-24324d546305 service nova] Lock "bc0e07f8-2731-4ffa-8446-b71ad3ba7375-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:46:28 user nova-compute[75337]: DEBUG nova.compute.manager [req-28a4445a-ed46-4277-9f3a-774699ad5fa5 req-fd534f87-e28b-4107-ba11-24324d546305 service nova] [instance: bc0e07f8-2731-4ffa-8446-b71ad3ba7375] No waiting events found dispatching network-vif-plugged-a20e3f62-5387-4f54-b623-d45a0a311da0 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:46:28 user nova-compute[75337]: WARNING nova.compute.manager [req-28a4445a-ed46-4277-9f3a-774699ad5fa5 req-fd534f87-e28b-4107-ba11-24324d546305 service nova] [instance: bc0e07f8-2731-4ffa-8446-b71ad3ba7375] Received unexpected event network-vif-plugged-a20e3f62-5387-4f54-b623-d45a0a311da0 for instance with vm_state building and task_state spawning.
Nov 06 15:46:28 user nova-compute[75337]: DEBUG nova.compute.manager [None req-a78c9495-b5d8-417c-917b-c902da60c29b tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] [instance: bc0e07f8-2731-4ffa-8446-b71ad3ba7375] Instance event wait completed in 0 seconds for  {{(pid=75337) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 15:46:28 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-a78c9495-b5d8-417c-917b-c902da60c29b tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] [instance: bc0e07f8-2731-4ffa-8446-b71ad3ba7375] Guest created on hypervisor {{(pid=75337) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 15:46:28 user nova-compute[75337]: INFO nova.virt.libvirt.driver [-] [instance: bc0e07f8-2731-4ffa-8446-b71ad3ba7375] Instance spawned successfully.
Nov 06 15:46:28 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-a78c9495-b5d8-417c-917b-c902da60c29b tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] [instance: bc0e07f8-2731-4ffa-8446-b71ad3ba7375] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 15:46:28 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-a78c9495-b5d8-417c-917b-c902da60c29b tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] [instance: bc0e07f8-2731-4ffa-8446-b71ad3ba7375] Found default for hw_cdrom_bus of ide {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:46:28 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-a78c9495-b5d8-417c-917b-c902da60c29b tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] [instance: bc0e07f8-2731-4ffa-8446-b71ad3ba7375] Found default for hw_disk_bus of virtio {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:46:28 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-a78c9495-b5d8-417c-917b-c902da60c29b tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] [instance: bc0e07f8-2731-4ffa-8446-b71ad3ba7375] Found default for hw_input_bus of None {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:46:28 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-a78c9495-b5d8-417c-917b-c902da60c29b tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] [instance: bc0e07f8-2731-4ffa-8446-b71ad3ba7375] Found default for hw_pointer_model of None {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:46:28 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-a78c9495-b5d8-417c-917b-c902da60c29b tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] [instance: bc0e07f8-2731-4ffa-8446-b71ad3ba7375] Found default for hw_video_model of virtio {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:46:28 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-a78c9495-b5d8-417c-917b-c902da60c29b tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] [instance: bc0e07f8-2731-4ffa-8446-b71ad3ba7375] Found default for hw_vif_model of virtio {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:46:28 user nova-compute[75337]: INFO nova.compute.manager [None req-a78c9495-b5d8-417c-917b-c902da60c29b tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] [instance: bc0e07f8-2731-4ffa-8446-b71ad3ba7375] Took 8.08 seconds to spawn the instance on the hypervisor.
Nov 06 15:46:28 user nova-compute[75337]: DEBUG nova.compute.manager [None req-a78c9495-b5d8-417c-917b-c902da60c29b tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] [instance: bc0e07f8-2731-4ffa-8446-b71ad3ba7375] Checking state {{(pid=75337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 15:46:28 user nova-compute[75337]: INFO nova.compute.manager [None req-a78c9495-b5d8-417c-917b-c902da60c29b tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] [instance: bc0e07f8-2731-4ffa-8446-b71ad3ba7375] Took 9.15 seconds to build instance.
Nov 06 15:46:28 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-a78c9495-b5d8-417c-917b-c902da60c29b tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Lock "bc0e07f8-2731-4ffa-8446-b71ad3ba7375" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.290s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:46:28 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:46:29 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:46:29 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:46:32 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:46:33 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:46:34 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:46:36 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:46:38 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:46:39 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:46:39 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:46:41 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-4648cd25-826a-4faf-b6de-66381016c552 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Acquiring lock "4015f2f7-a176-46aa-bdff-58d164058e15" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:46:41 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-4648cd25-826a-4faf-b6de-66381016c552 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Lock "4015f2f7-a176-46aa-bdff-58d164058e15" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:46:41 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-4648cd25-826a-4faf-b6de-66381016c552 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Acquiring lock "4015f2f7-a176-46aa-bdff-58d164058e15-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:46:41 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-4648cd25-826a-4faf-b6de-66381016c552 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Lock "4015f2f7-a176-46aa-bdff-58d164058e15-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:46:41 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-4648cd25-826a-4faf-b6de-66381016c552 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Lock "4015f2f7-a176-46aa-bdff-58d164058e15-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:46:41 user nova-compute[75337]: INFO nova.compute.manager [None req-4648cd25-826a-4faf-b6de-66381016c552 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 4015f2f7-a176-46aa-bdff-58d164058e15] Terminating instance
Nov 06 15:46:41 user nova-compute[75337]: DEBUG nova.compute.manager [None req-4648cd25-826a-4faf-b6de-66381016c552 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 4015f2f7-a176-46aa-bdff-58d164058e15] Start destroying the instance on the hypervisor. {{(pid=75337) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 15:46:41 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:46:41 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:46:41 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:46:41 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:46:42 user nova-compute[75337]: DEBUG nova.compute.manager [req-30d313c6-a5dd-4b26-ad98-3bb263d388c5 req-461f4a86-363a-44e1-87d9-0e8b31ada502 service nova] [instance: 4015f2f7-a176-46aa-bdff-58d164058e15] Received event network-vif-unplugged-2ae7d4fb-8a67-4570-aa53-56cbaa82b78f {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:46:42 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-30d313c6-a5dd-4b26-ad98-3bb263d388c5 req-461f4a86-363a-44e1-87d9-0e8b31ada502 service nova] Acquiring lock "4015f2f7-a176-46aa-bdff-58d164058e15-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:46:42 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-30d313c6-a5dd-4b26-ad98-3bb263d388c5 req-461f4a86-363a-44e1-87d9-0e8b31ada502 service nova] Lock "4015f2f7-a176-46aa-bdff-58d164058e15-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:46:42 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-30d313c6-a5dd-4b26-ad98-3bb263d388c5 req-461f4a86-363a-44e1-87d9-0e8b31ada502 service nova] Lock "4015f2f7-a176-46aa-bdff-58d164058e15-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:46:42 user nova-compute[75337]: DEBUG nova.compute.manager [req-30d313c6-a5dd-4b26-ad98-3bb263d388c5 req-461f4a86-363a-44e1-87d9-0e8b31ada502 service nova] [instance: 4015f2f7-a176-46aa-bdff-58d164058e15] No waiting events found dispatching network-vif-unplugged-2ae7d4fb-8a67-4570-aa53-56cbaa82b78f {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:46:42 user nova-compute[75337]: DEBUG nova.compute.manager [req-30d313c6-a5dd-4b26-ad98-3bb263d388c5 req-461f4a86-363a-44e1-87d9-0e8b31ada502 service nova] [instance: 4015f2f7-a176-46aa-bdff-58d164058e15] Received event network-vif-unplugged-2ae7d4fb-8a67-4570-aa53-56cbaa82b78f for instance with task_state deleting. {{(pid=75337) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 15:46:42 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-dd8aa74a-26d5-4e86-9bbd-17cef4b2937e tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Acquiring lock "afa4e52b-af51-45bf-b619-aeca14e7724d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:46:42 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-dd8aa74a-26d5-4e86-9bbd-17cef4b2937e tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Lock "afa4e52b-af51-45bf-b619-aeca14e7724d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:46:42 user nova-compute[75337]: DEBUG nova.compute.manager [None req-dd8aa74a-26d5-4e86-9bbd-17cef4b2937e tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] [instance: afa4e52b-af51-45bf-b619-aeca14e7724d] Starting instance... {{(pid=75337) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 15:46:42 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-dd8aa74a-26d5-4e86-9bbd-17cef4b2937e tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:46:42 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-dd8aa74a-26d5-4e86-9bbd-17cef4b2937e tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:46:42 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-dd8aa74a-26d5-4e86-9bbd-17cef4b2937e tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75337) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 15:46:42 user nova-compute[75337]: INFO nova.compute.claims [None req-dd8aa74a-26d5-4e86-9bbd-17cef4b2937e tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] [instance: afa4e52b-af51-45bf-b619-aeca14e7724d] Claim successful on node user
Nov 06 15:46:42 user nova-compute[75337]: INFO nova.virt.libvirt.driver [-] [instance: 4015f2f7-a176-46aa-bdff-58d164058e15] Instance destroyed successfully.
Nov 06 15:46:42 user nova-compute[75337]: DEBUG nova.objects.instance [None req-4648cd25-826a-4faf-b6de-66381016c552 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Lazy-loading 'resources' on Instance uuid 4015f2f7-a176-46aa-bdff-58d164058e15 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 15:46:42 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-4648cd25-826a-4faf-b6de-66381016c552 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T15:44:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-791013206',display_name='tempest-TestVolumeBootPattern-server-791013206',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-791013206',id=15,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-06T15:45:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='915211c6a2734c36b34ff92a56b085f6',ramdisk_id='',reservation_id='r-5hb0rxgl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1055092640',owner_user_name='tempest-TestVolumeBootPattern-1055092640-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T15:45:34Z,user_data=None,user_id='bb8d5f0200124588be1cfde107341a45',uuid=4015f2f7-a176-46aa-bdff-58d164058e15,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2ae7d4fb-8a67-4570-aa53-56cbaa82b78f", "address": "fa:16:3e:ea:78:b5", "network": {"id": "4e47319f-de1d-4dfe-9915-7d2d5131704d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-895093240-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "915211c6a2734c36b34ff92a56b085f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ae7d4fb-8a", "ovs_interfaceid": "2ae7d4fb-8a67-4570-aa53-56cbaa82b78f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 15:46:42 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-4648cd25-826a-4faf-b6de-66381016c552 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Converting VIF {"id": "2ae7d4fb-8a67-4570-aa53-56cbaa82b78f", "address": "fa:16:3e:ea:78:b5", "network": {"id": "4e47319f-de1d-4dfe-9915-7d2d5131704d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-895093240-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "915211c6a2734c36b34ff92a56b085f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ae7d4fb-8a", "ovs_interfaceid": "2ae7d4fb-8a67-4570-aa53-56cbaa82b78f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 15:46:42 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-4648cd25-826a-4faf-b6de-66381016c552 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:78:b5,bridge_name='br-int',has_traffic_filtering=True,id=2ae7d4fb-8a67-4570-aa53-56cbaa82b78f,network=Network(4e47319f-de1d-4dfe-9915-7d2d5131704d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ae7d4fb-8a') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 15:46:42 user nova-compute[75337]: DEBUG os_vif [None req-4648cd25-826a-4faf-b6de-66381016c552 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:78:b5,bridge_name='br-int',has_traffic_filtering=True,id=2ae7d4fb-8a67-4570-aa53-56cbaa82b78f,network=Network(4e47319f-de1d-4dfe-9915-7d2d5131704d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ae7d4fb-8a') {{(pid=75337) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 15:46:42 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:46:42 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2ae7d4fb-8a, bridge=br-int, if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:46:42 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:46:42 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:46:42 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:46:42 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e2fa2864-450e-4478-95f5-5b55fe9b614e) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:46:42 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:46:42 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:46:42 user nova-compute[75337]: INFO os_vif [None req-4648cd25-826a-4faf-b6de-66381016c552 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:78:b5,bridge_name='br-int',has_traffic_filtering=True,id=2ae7d4fb-8a67-4570-aa53-56cbaa82b78f,network=Network(4e47319f-de1d-4dfe-9915-7d2d5131704d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ae7d4fb-8a')
Nov 06 15:46:42 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4648cd25-826a-4faf-b6de-66381016c552 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 4015f2f7-a176-46aa-bdff-58d164058e15] calling os-brick to detach iSCSI Volume {{(pid=75337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 15:46:42 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-4648cd25-826a-4faf-b6de-66381016c552 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2abc33d0c0>, {'target_iqn': 'iqn.2010-10.org.openstack:46c1deb3-55e2-44bd-b4da-b037378d79f2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rYquUSgD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 15:46:42 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-4648cd25-826a-4faf-b6de-66381016c552 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 15:46:42 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-4648cd25-826a-4faf-b6de-66381016c552 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 15:46:42 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-4648cd25-826a-4faf-b6de-66381016c552 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 15:46:42 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:46:42 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.030s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:46:42 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e8cb059-dbbc-4b47-adfd-1d8699f46f19]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:46c1deb3-55e2-44bd-b4da-b037378d79f2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:46:42 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-4648cd25-826a-4faf-b6de-66381016c552 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 15:46:42 user nova-compute[75337]: No targets found.
Nov 06 15:46:42 user nova-compute[75337]: iSNS:
Nov 06 15:46:42 user nova-compute[75337]: No targets found.
Nov 06 15:46:42 user nova-compute[75337]: STATIC:
Nov 06 15:46:42 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e
Nov 06 15:46:42 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 15:46:42 user nova-compute[75337]:                 Iface Name: default
Nov 06 15:46:42 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:46c1deb3-55e2-44bd-b4da-b037378d79f2
Nov 06 15:46:42 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 15:46:42 user nova-compute[75337]:                 Iface Name: default
Nov 06 15:46:42 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158
Nov 06 15:46:42 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 15:46:42 user nova-compute[75337]:                 Iface Name: default
Nov 06 15:46:42 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6
Nov 06 15:46:42 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 15:46:42 user nova-compute[75337]:                 Iface Name: default
Nov 06 15:46:42 user nova-compute[75337]: FIRMWARE:
Nov 06 15:46:42 user nova-compute[75337]: No targets found.
Nov 06 15:46:42 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 15:46:42 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-4648cd25-826a-4faf-b6de-66381016c552 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 15:46:42 user nova-compute[75337]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 15:46:42 user nova-compute[75337]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75337) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 15:46:42 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-4648cd25-826a-4faf-b6de-66381016c552 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:46c1deb3-55e2-44bd-b4da-b037378d79f2', 0)] {{(pid=75337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 15:46:42 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:46:42 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:46:42 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[8abe8967-acfb-42b7-b746-0cbb3d84cc35]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:46c1deb3-55e2-44bd-b4da-b037378d79f2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:46:42 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:46:42 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.055s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:46:42 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba9dc28b-16f5-4167-aa57-66460458a298]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c1deb3-55e2-44bd-b4da-b037378d79f2 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6 (non-flash)\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:46:42 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-4648cd25-826a-4faf-b6de-66381016c552 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)
Nov 06 15:46:42 user nova-compute[75337]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e (non-flash)
Nov 06 15:46:42 user nova-compute[75337]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c1deb3-55e2-44bd-b4da-b037378d79f2 (non-flash)
Nov 06 15:46:42 user nova-compute[75337]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6 (non-flash)
Nov 06 15:46:42 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 15:46:42 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-4648cd25-826a-4faf-b6de-66381016c552 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)
Nov 06 15:46:42 user nova-compute[75337]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e (non-flash)
Nov 06 15:46:42 user nova-compute[75337]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46c1deb3-55e2-44bd-b4da-b037378d79f2 (non-flash)
Nov 06 15:46:42 user nova-compute[75337]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6 (non-flash)
Nov 06 15:46:42 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 15:46:42 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-4648cd25-826a-4faf-b6de-66381016c552 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2abc12b2e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:46c1deb3-55e2-44bd-b4da-b037378d79f2'): ({'sde'}, set())}) {{(pid=75337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 15:46:42 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-4648cd25-826a-4faf-b6de-66381016c552 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Removing single pathed devices sde {{(pid=75337) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 15:46:42 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:46:42 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.031s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:46:42 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf586d91-f7d9-4349-87d7-cb1a76025441]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:46:42 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:46:43 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.031s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:46:43 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f43c2f5-b21f-46fd-b776-686eb923a368]: (4, ('ok\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:46:43 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-4648cd25-826a-4faf-b6de-66381016c552 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Flushing IO for device /dev/sde {{(pid=75337) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 15:46:43 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:46:43 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.030s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:46:43 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9ba417b-9fdd-43ea-878b-d933072df48c]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:46:43 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-4648cd25-826a-4faf-b6de-66381016c552 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75337) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 15:46:43 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:46:43 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-dd8aa74a-26d5-4e86-9bbd-17cef4b2937e tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 15:46:43 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-dd8aa74a-26d5-4e86-9bbd-17cef4b2937e tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 15:46:43 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.059s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:46:43 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff34d6a6-5b88-45c1-89f7-5243dd3b7188]: (4, ('1', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:46:43 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-4648cd25-826a-4faf-b6de-66381016c552 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 15:46:43 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-4648cd25-826a-4faf-b6de-66381016c552 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] SCSI volumes sde have been removed. {{(pid=75337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 15:46:43 user nova-compute[75337]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23064373339613563', '/dev/disk/by-id/scsi-1SCST_BIOdf45ce58-0d739a5c4a4e9e30', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_df45ce58') {{(pid=86696) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 06 15:46:43 user nova-compute[75337]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-23064373339613563
Nov 06 15:46:43 user nova-compute[75337]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIOdf45ce58-0d739a5c4a4e9e30
Nov 06 15:46:43 user nova-compute[75337]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_df45ce58
Nov 06 15:46:43 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4745fbe-288f-4670-ac78-6b711c8b4a3a]: (4, None) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:46:43 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-4648cd25-826a-4faf-b6de-66381016c552 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:46c1deb3-55e2-44bd-b4da-b037378d79f2')] {{(pid=75337) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 15:46:43 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46c1deb3-55e2-44bd-b4da-b037378d79f2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:46:43 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-dd8aa74a-26d5-4e86-9bbd-17cef4b2937e tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.750s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:46:43 user nova-compute[75337]: DEBUG nova.compute.manager [None req-dd8aa74a-26d5-4e86-9bbd-17cef4b2937e tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] [instance: afa4e52b-af51-45bf-b619-aeca14e7724d] Start building networks asynchronously for instance. {{(pid=75337) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 15:46:43 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46c1deb3-55e2-44bd-b4da-b037378d79f2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:46:43 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[a900096d-049a-4685-9bf3-93a672f42643]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:46:43 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-4648cd25-826a-4faf-b6de-66381016c552 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:46:43 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46c1deb3-55e2-44bd-b4da-b037378d79f2 -p 172.16.0.220:3260 --logout {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:46:43 user nova-compute[75337]: DEBUG nova.compute.manager [None req-dd8aa74a-26d5-4e86-9bbd-17cef4b2937e tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] [instance: afa4e52b-af51-45bf-b619-aeca14e7724d] Allocating IP information in the background. {{(pid=75337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 15:46:43 user nova-compute[75337]: DEBUG nova.network.neutron [None req-dd8aa74a-26d5-4e86-9bbd-17cef4b2937e tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] [instance: afa4e52b-af51-45bf-b619-aeca14e7724d] allocate_for_instance() {{(pid=75337) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 15:46:43 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46c1deb3-55e2-44bd-b4da-b037378d79f2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:46:43 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c78f266-df18-4c26-8a4a-9906b888666b]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:46c1deb3-55e2-44bd-b4da-b037378d79f2, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:46c1deb3-55e2-44bd-b4da-b037378d79f2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:46:43 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-4648cd25-826a-4faf-b6de-66381016c552 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:46c1deb3-55e2-44bd-b4da-b037378d79f2, portal: 172.16.0.220,3260]
Nov 06 15:46:43 user nova-compute[75337]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:46c1deb3-55e2-44bd-b4da-b037378d79f2, portal: 172.16.0.220,3260] successful.
Nov 06 15:46:43 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:46:43 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46c1deb3-55e2-44bd-b4da-b037378d79f2 -p 172.16.0.220:3260 --op delete {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:46:43 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-dd8aa74a-26d5-4e86-9bbd-17cef4b2937e tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] [instance: afa4e52b-af51-45bf-b619-aeca14e7724d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 15:46:43 user nova-compute[75337]: DEBUG nova.compute.manager [None req-dd8aa74a-26d5-4e86-9bbd-17cef4b2937e tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] [instance: afa4e52b-af51-45bf-b619-aeca14e7724d] Start building block device mappings for instance. {{(pid=75337) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 15:46:43 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46c1deb3-55e2-44bd-b4da-b037378d79f2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:46:43 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[c97be321-600d-4aa5-95a5-9547eb7ea220]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:46:43 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-4648cd25-826a-4faf-b6de-66381016c552 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:46:43 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-4648cd25-826a-4faf-b6de-66381016c552 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.477s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 15:46:43 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-4648cd25-826a-4faf-b6de-66381016c552 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] <== disconnect_volume: return (479ms) None {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 15:46:43 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4648cd25-826a-4faf-b6de-66381016c552 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 4015f2f7-a176-46aa-bdff-58d164058e15] Disconnected iSCSI Volume {{(pid=75337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 15:46:43 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-4648cd25-826a-4faf-b6de-66381016c552 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 4015f2f7-a176-46aa-bdff-58d164058e15] Deleting instance files /opt/stack/data/nova/instances/4015f2f7-a176-46aa-bdff-58d164058e15_del
Nov 06 15:46:43 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-4648cd25-826a-4faf-b6de-66381016c552 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 4015f2f7-a176-46aa-bdff-58d164058e15] Deletion of /opt/stack/data/nova/instances/4015f2f7-a176-46aa-bdff-58d164058e15_del complete
Nov 06 15:46:43 user nova-compute[75337]: INFO nova.compute.manager [None req-4648cd25-826a-4faf-b6de-66381016c552 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 4015f2f7-a176-46aa-bdff-58d164058e15] Took 1.56 seconds to destroy the instance on the hypervisor.
Nov 06 15:46:43 user nova-compute[75337]: DEBUG oslo.service.loopingcall [None req-4648cd25-826a-4faf-b6de-66381016c552 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75337) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 15:46:43 user nova-compute[75337]: DEBUG nova.compute.manager [-] [instance: 4015f2f7-a176-46aa-bdff-58d164058e15] Deallocating network for instance {{(pid=75337) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 15:46:43 user nova-compute[75337]: DEBUG nova.network.neutron [-] [instance: 4015f2f7-a176-46aa-bdff-58d164058e15] deallocate_for_instance() {{(pid=75337) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 15:46:43 user nova-compute[75337]: DEBUG nova.policy [None req-dd8aa74a-26d5-4e86-9bbd-17cef4b2937e tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9e1c021de4da40518ddc45a57ef79d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed09a1def6f0477796404d9bd3357dd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75337) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 15:46:43 user nova-compute[75337]: DEBUG nova.compute.manager [None req-dd8aa74a-26d5-4e86-9bbd-17cef4b2937e tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] [instance: afa4e52b-af51-45bf-b619-aeca14e7724d] Start spawning the instance on the hypervisor. {{(pid=75337) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 15:46:43 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-dd8aa74a-26d5-4e86-9bbd-17cef4b2937e tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] [instance: afa4e52b-af51-45bf-b619-aeca14e7724d] Creating instance directory {{(pid=75337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 15:46:43 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-dd8aa74a-26d5-4e86-9bbd-17cef4b2937e tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] [instance: afa4e52b-af51-45bf-b619-aeca14e7724d] Creating image(s)
Nov 06 15:46:43 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-dd8aa74a-26d5-4e86-9bbd-17cef4b2937e tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Acquiring lock "/opt/stack/data/nova/instances/afa4e52b-af51-45bf-b619-aeca14e7724d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:46:43 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-dd8aa74a-26d5-4e86-9bbd-17cef4b2937e tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Lock "/opt/stack/data/nova/instances/afa4e52b-af51-45bf-b619-aeca14e7724d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:46:43 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-dd8aa74a-26d5-4e86-9bbd-17cef4b2937e tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Lock "/opt/stack/data/nova/instances/afa4e52b-af51-45bf-b619-aeca14e7724d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:46:43 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-dd8aa74a-26d5-4e86-9bbd-17cef4b2937e tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:46:43 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-dd8aa74a-26d5-4e86-9bbd-17cef4b2937e tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json" returned: 0 in 0.179s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:46:43 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-dd8aa74a-26d5-4e86-9bbd-17cef4b2937e tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Acquiring lock "06ba3c914798499e686c5ac75886932347225275" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:46:43 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-dd8aa74a-26d5-4e86-9bbd-17cef4b2937e tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Lock "06ba3c914798499e686c5ac75886932347225275" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:46:43 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-dd8aa74a-26d5-4e86-9bbd-17cef4b2937e tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:46:43 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-dd8aa74a-26d5-4e86-9bbd-17cef4b2937e tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json" returned: 0 in 0.291s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:46:43 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-dd8aa74a-26d5-4e86-9bbd-17cef4b2937e tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275,backing_fmt=raw /opt/stack/data/nova/instances/afa4e52b-af51-45bf-b619-aeca14e7724d/disk 1073741824 {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:46:43 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:46:43 user nova-compute[75337]: DEBUG nova.network.neutron [-] [instance: 4015f2f7-a176-46aa-bdff-58d164058e15] Updating instance_info_cache with network_info: [] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:46:43 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-dd8aa74a-26d5-4e86-9bbd-17cef4b2937e tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275,backing_fmt=raw /opt/stack/data/nova/instances/afa4e52b-af51-45bf-b619-aeca14e7724d/disk 1073741824" returned: 0 in 0.090s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:46:43 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-dd8aa74a-26d5-4e86-9bbd-17cef4b2937e tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Lock "06ba3c914798499e686c5ac75886932347225275" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.387s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:46:43 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-dd8aa74a-26d5-4e86-9bbd-17cef4b2937e tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:46:44 user nova-compute[75337]: INFO nova.compute.manager [-] [instance: 4015f2f7-a176-46aa-bdff-58d164058e15] Took 0.71 seconds to deallocate network for instance.
Nov 06 15:46:44 user nova-compute[75337]: DEBUG nova.network.neutron [None req-dd8aa74a-26d5-4e86-9bbd-17cef4b2937e tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] [instance: afa4e52b-af51-45bf-b619-aeca14e7724d] Successfully created port: d66c8fee-7efa-49a4-b9c3-2f7ad2ccc71b {{(pid=75337) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 15:46:44 user nova-compute[75337]: DEBUG nova.compute.manager [req-8750777f-9766-4d84-b393-db3124ff24e3 req-78cedc41-21a6-49eb-96e1-b555eb510246 service nova] [instance: 4015f2f7-a176-46aa-bdff-58d164058e15] Received event network-vif-plugged-2ae7d4fb-8a67-4570-aa53-56cbaa82b78f {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:46:44 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-8750777f-9766-4d84-b393-db3124ff24e3 req-78cedc41-21a6-49eb-96e1-b555eb510246 service nova] Acquiring lock "4015f2f7-a176-46aa-bdff-58d164058e15-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:46:44 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-8750777f-9766-4d84-b393-db3124ff24e3 req-78cedc41-21a6-49eb-96e1-b555eb510246 service nova] Lock "4015f2f7-a176-46aa-bdff-58d164058e15-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:46:44 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-8750777f-9766-4d84-b393-db3124ff24e3 req-78cedc41-21a6-49eb-96e1-b555eb510246 service nova] Lock "4015f2f7-a176-46aa-bdff-58d164058e15-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:46:44 user nova-compute[75337]: DEBUG nova.compute.manager [req-8750777f-9766-4d84-b393-db3124ff24e3 req-78cedc41-21a6-49eb-96e1-b555eb510246 service nova] [instance: 4015f2f7-a176-46aa-bdff-58d164058e15] No waiting events found dispatching network-vif-plugged-2ae7d4fb-8a67-4570-aa53-56cbaa82b78f {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:46:44 user nova-compute[75337]: WARNING nova.compute.manager [req-8750777f-9766-4d84-b393-db3124ff24e3 req-78cedc41-21a6-49eb-96e1-b555eb510246 service nova] [instance: 4015f2f7-a176-46aa-bdff-58d164058e15] Received unexpected event network-vif-plugged-2ae7d4fb-8a67-4570-aa53-56cbaa82b78f for instance with vm_state active and task_state deleting.
Nov 06 15:46:44 user nova-compute[75337]: DEBUG nova.compute.manager [req-8750777f-9766-4d84-b393-db3124ff24e3 req-78cedc41-21a6-49eb-96e1-b555eb510246 service nova] [instance: 4015f2f7-a176-46aa-bdff-58d164058e15] Received event network-vif-deleted-2ae7d4fb-8a67-4570-aa53-56cbaa82b78f {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:46:44 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-dd8aa74a-26d5-4e86-9bbd-17cef4b2937e tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json" returned: 0 in 0.297s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:46:44 user nova-compute[75337]: DEBUG nova.virt.disk.api [None req-dd8aa74a-26d5-4e86-9bbd-17cef4b2937e tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Checking if we can resize image /opt/stack/data/nova/instances/afa4e52b-af51-45bf-b619-aeca14e7724d/disk. size=1073741824 {{(pid=75337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 15:46:44 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-dd8aa74a-26d5-4e86-9bbd-17cef4b2937e tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afa4e52b-af51-45bf-b619-aeca14e7724d/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:46:44 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-dd8aa74a-26d5-4e86-9bbd-17cef4b2937e tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afa4e52b-af51-45bf-b619-aeca14e7724d/disk --force-share --output=json" returned: 0 in 0.291s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:46:44 user nova-compute[75337]: DEBUG nova.virt.disk.api [None req-dd8aa74a-26d5-4e86-9bbd-17cef4b2937e tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Cannot resize image /opt/stack/data/nova/instances/afa4e52b-af51-45bf-b619-aeca14e7724d/disk to a smaller size. {{(pid=75337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 06 15:46:44 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-dd8aa74a-26d5-4e86-9bbd-17cef4b2937e tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] [instance: afa4e52b-af51-45bf-b619-aeca14e7724d] Created local disks {{(pid=75337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 15:46:44 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-dd8aa74a-26d5-4e86-9bbd-17cef4b2937e tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] [instance: afa4e52b-af51-45bf-b619-aeca14e7724d] Ensure instance console log exists: /opt/stack/data/nova/instances/afa4e52b-af51-45bf-b619-aeca14e7724d/console.log {{(pid=75337) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 15:46:44 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-dd8aa74a-26d5-4e86-9bbd-17cef4b2937e tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:46:44 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-dd8aa74a-26d5-4e86-9bbd-17cef4b2937e tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:46:44 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-dd8aa74a-26d5-4e86-9bbd-17cef4b2937e tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.003s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:46:45 user nova-compute[75337]: DEBUG nova.network.neutron [None req-dd8aa74a-26d5-4e86-9bbd-17cef4b2937e tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] [instance: afa4e52b-af51-45bf-b619-aeca14e7724d] Successfully updated port: d66c8fee-7efa-49a4-b9c3-2f7ad2ccc71b {{(pid=75337) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 15:46:45 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-dd8aa74a-26d5-4e86-9bbd-17cef4b2937e tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Acquiring lock "refresh_cache-afa4e52b-af51-45bf-b619-aeca14e7724d" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 15:46:45 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-dd8aa74a-26d5-4e86-9bbd-17cef4b2937e tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Acquired lock "refresh_cache-afa4e52b-af51-45bf-b619-aeca14e7724d" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 15:46:45 user nova-compute[75337]: DEBUG nova.network.neutron [None req-dd8aa74a-26d5-4e86-9bbd-17cef4b2937e tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] [instance: afa4e52b-af51-45bf-b619-aeca14e7724d] Building network info cache for instance {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 15:46:45 user nova-compute[75337]: DEBUG nova.compute.manager [req-f5cf453e-3120-400c-ae8f-91f935758461 req-9cc2c7ff-9d21-4f00-9fd5-e15a950ce97d service nova] [instance: afa4e52b-af51-45bf-b619-aeca14e7724d] Received event network-changed-d66c8fee-7efa-49a4-b9c3-2f7ad2ccc71b {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:46:45 user nova-compute[75337]: DEBUG nova.compute.manager [req-f5cf453e-3120-400c-ae8f-91f935758461 req-9cc2c7ff-9d21-4f00-9fd5-e15a950ce97d service nova] [instance: afa4e52b-af51-45bf-b619-aeca14e7724d] Refreshing instance network info cache due to event network-changed-d66c8fee-7efa-49a4-b9c3-2f7ad2ccc71b. {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 15:46:45 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-f5cf453e-3120-400c-ae8f-91f935758461 req-9cc2c7ff-9d21-4f00-9fd5-e15a950ce97d service nova] Acquiring lock "refresh_cache-afa4e52b-af51-45bf-b619-aeca14e7724d" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 15:46:45 user nova-compute[75337]: DEBUG nova.network.neutron [None req-dd8aa74a-26d5-4e86-9bbd-17cef4b2937e tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] [instance: afa4e52b-af51-45bf-b619-aeca14e7724d] Instance cache missing network info. {{(pid=75337) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 15:46:45 user nova-compute[75337]: INFO nova.compute.manager [None req-4648cd25-826a-4faf-b6de-66381016c552 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 4015f2f7-a176-46aa-bdff-58d164058e15] Took 1.36 seconds to detach 1 volumes for instance.
Nov 06 15:46:45 user nova-compute[75337]: DEBUG nova.compute.manager [None req-4648cd25-826a-4faf-b6de-66381016c552 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 4015f2f7-a176-46aa-bdff-58d164058e15] Deleting volume: 46c1deb3-55e2-44bd-b4da-b037378d79f2 {{(pid=75337) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 06 15:46:45 user nova-compute[75337]: DEBUG nova.network.neutron [None req-dd8aa74a-26d5-4e86-9bbd-17cef4b2937e tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] [instance: afa4e52b-af51-45bf-b619-aeca14e7724d] Updating instance_info_cache with network_info: [{"id": "d66c8fee-7efa-49a4-b9c3-2f7ad2ccc71b", "address": "fa:16:3e:17:d2:52", "network": {"id": "f24470c2-ff6f-49fd-b28f-16b8a87ed3b4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-217486733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed09a1def6f0477796404d9bd3357dd0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd66c8fee-7e", "ovs_interfaceid": "d66c8fee-7efa-49a4-b9c3-2f7ad2ccc71b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:46:45 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-dd8aa74a-26d5-4e86-9bbd-17cef4b2937e tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Releasing lock "refresh_cache-afa4e52b-af51-45bf-b619-aeca14e7724d" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 15:46:45 user nova-compute[75337]: DEBUG nova.compute.manager [None req-dd8aa74a-26d5-4e86-9bbd-17cef4b2937e tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] [instance: afa4e52b-af51-45bf-b619-aeca14e7724d] Instance network_info: |[{"id": "d66c8fee-7efa-49a4-b9c3-2f7ad2ccc71b", "address": "fa:16:3e:17:d2:52", "network": {"id": "f24470c2-ff6f-49fd-b28f-16b8a87ed3b4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-217486733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed09a1def6f0477796404d9bd3357dd0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd66c8fee-7e", "ovs_interfaceid": "d66c8fee-7efa-49a4-b9c3-2f7ad2ccc71b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 15:46:45 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-f5cf453e-3120-400c-ae8f-91f935758461 req-9cc2c7ff-9d21-4f00-9fd5-e15a950ce97d service nova] Acquired lock "refresh_cache-afa4e52b-af51-45bf-b619-aeca14e7724d" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 15:46:45 user nova-compute[75337]: DEBUG nova.network.neutron [req-f5cf453e-3120-400c-ae8f-91f935758461 req-9cc2c7ff-9d21-4f00-9fd5-e15a950ce97d service nova] [instance: afa4e52b-af51-45bf-b619-aeca14e7724d] Refreshing network info cache for port d66c8fee-7efa-49a4-b9c3-2f7ad2ccc71b {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 15:46:45 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-dd8aa74a-26d5-4e86-9bbd-17cef4b2937e tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] [instance: afa4e52b-af51-45bf-b619-aeca14e7724d] Start _get_guest_xml network_info=[{"id": "d66c8fee-7efa-49a4-b9c3-2f7ad2ccc71b", "address": "fa:16:3e:17:d2:52", "network": {"id": "f24470c2-ff6f-49fd-b28f-16b8a87ed3b4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-217486733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed09a1def6f0477796404d9bd3357dd0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd66c8fee-7e", "ovs_interfaceid": "d66c8fee-7efa-49a4-b9c3-2f7ad2ccc71b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T15:34:14Z,direct_url=<?>,disk_format='qcow2',id=16b903ae-a40f-41a7-985b-4804cce92c62,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6549a15819f1469bbd5eeae8190e3d44',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T15:34:15Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'guest_format': None, 'size': 0, 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '16b903ae-a40f-41a7-985b-4804cce92c62'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 15:46:45 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-dd8aa74a-26d5-4e86-9bbd-17cef4b2937e tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 15:46:45 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-dd8aa74a-26d5-4e86-9bbd-17cef4b2937e tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 15:46:45 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-dd8aa74a-26d5-4e86-9bbd-17cef4b2937e tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 15:46:45 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-dd8aa74a-26d5-4e86-9bbd-17cef4b2937e tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] CPU controller missing on host. {{(pid=75337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 15:46:45 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-dd8aa74a-26d5-4e86-9bbd-17cef4b2937e tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 15:46:45 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-dd8aa74a-26d5-4e86-9bbd-17cef4b2937e tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] CPU controller found on host. {{(pid=75337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 15:46:45 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-dd8aa74a-26d5-4e86-9bbd-17cef4b2937e tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75337) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 15:46:45 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-dd8aa74a-26d5-4e86-9bbd-17cef4b2937e tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T15:34:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T15:34:14Z,direct_url=<?>,disk_format='qcow2',id=16b903ae-a40f-41a7-985b-4804cce92c62,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6549a15819f1469bbd5eeae8190e3d44',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T15:34:15Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 15:46:45 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-dd8aa74a-26d5-4e86-9bbd-17cef4b2937e tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Flavor limits 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 15:46:45 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-dd8aa74a-26d5-4e86-9bbd-17cef4b2937e tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Image limits 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 15:46:45 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-dd8aa74a-26d5-4e86-9bbd-17cef4b2937e tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Flavor pref 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 15:46:45 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-dd8aa74a-26d5-4e86-9bbd-17cef4b2937e tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Image pref 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 15:46:45 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-dd8aa74a-26d5-4e86-9bbd-17cef4b2937e tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 15:46:45 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-dd8aa74a-26d5-4e86-9bbd-17cef4b2937e tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 15:46:45 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-dd8aa74a-26d5-4e86-9bbd-17cef4b2937e tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 15:46:45 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-dd8aa74a-26d5-4e86-9bbd-17cef4b2937e tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Got 1 possible topologies {{(pid=75337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 15:46:45 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-dd8aa74a-26d5-4e86-9bbd-17cef4b2937e tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 15:46:45 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-dd8aa74a-26d5-4e86-9bbd-17cef4b2937e tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 15:46:45 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-dd8aa74a-26d5-4e86-9bbd-17cef4b2937e tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T15:46:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2034562466',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2034562466',id=19,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF82sEW5O6A3Q2brT3u+9GB1WIf+ebH23UlBANWc3lprOF36lFt5sOZdo4tfIJodY5NMNMTM6BNoWJkWdz/l+/cF+bZRgMJn1cr7pylEs7V4EldcWuCvMKcYzk70ZVi1Bg==',key_name='tempest-keypair-702382784',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ed09a1def6f0477796404d9bd3357dd0',ramdisk_id='',reservation_id='r-1fkdfqnf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-417383725',owner_user_name='tempest-AttachVolumeShelveTestJSON-417383725-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T15:46:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9e1c021de4da40518ddc45a57ef79d6f',uuid=afa4e52b-af51-45bf-b619-aeca14e7724d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d66c8fee-7efa-49a4-b9c3-2f7ad2ccc71b", "address": "fa:16:3e:17:d2:52", "network": {"id": "f24470c2-ff6f-49fd-b28f-16b8a87ed3b4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-217486733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed09a1def6f0477796404d9bd3357dd0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd66c8fee-7e", "ovs_interfaceid": "d66c8fee-7efa-49a4-b9c3-2f7ad2ccc71b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75337) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 15:46:45 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-dd8aa74a-26d5-4e86-9bbd-17cef4b2937e tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Converting VIF {"id": "d66c8fee-7efa-49a4-b9c3-2f7ad2ccc71b", "address": "fa:16:3e:17:d2:52", "network": {"id": "f24470c2-ff6f-49fd-b28f-16b8a87ed3b4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-217486733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed09a1def6f0477796404d9bd3357dd0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd66c8fee-7e", "ovs_interfaceid": "d66c8fee-7efa-49a4-b9c3-2f7ad2ccc71b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 15:46:45 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-dd8aa74a-26d5-4e86-9bbd-17cef4b2937e tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:d2:52,bridge_name='br-int',has_traffic_filtering=True,id=d66c8fee-7efa-49a4-b9c3-2f7ad2ccc71b,network=Network(f24470c2-ff6f-49fd-b28f-16b8a87ed3b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd66c8fee-7e') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 15:46:45 user nova-compute[75337]: DEBUG nova.objects.instance [None req-dd8aa74a-26d5-4e86-9bbd-17cef4b2937e tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Lazy-loading 'pci_devices' on Instance uuid afa4e52b-af51-45bf-b619-aeca14e7724d {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 15:46:45 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-4648cd25-826a-4faf-b6de-66381016c552 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:46:45 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-4648cd25-826a-4faf-b6de-66381016c552 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:46:45 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-dd8aa74a-26d5-4e86-9bbd-17cef4b2937e tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] [instance: afa4e52b-af51-45bf-b619-aeca14e7724d] End _get_guest_xml xml=<domain type="kvm">
Nov 06 15:46:45 user nova-compute[75337]:   <uuid>afa4e52b-af51-45bf-b619-aeca14e7724d</uuid>
Nov 06 15:46:45 user nova-compute[75337]:   <name>instance-00000013</name>
Nov 06 15:46:45 user nova-compute[75337]:   <memory>524288</memory>
Nov 06 15:46:45 user nova-compute[75337]:   <vcpu>1</vcpu>
Nov 06 15:46:45 user nova-compute[75337]:   <metadata>
Nov 06 15:46:45 user nova-compute[75337]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 15:46:45 user nova-compute[75337]:       <nova:package version="0.0.0"/>
Nov 06 15:46:45 user nova-compute[75337]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-2034562466</nova:name>
Nov 06 15:46:45 user nova-compute[75337]:       <nova:creationTime>2023-11-06 15:46:45</nova:creationTime>
Nov 06 15:46:45 user nova-compute[75337]:       <nova:flavor name="m1.tiny">
Nov 06 15:46:45 user nova-compute[75337]:         <nova:memory>512</nova:memory>
Nov 06 15:46:45 user nova-compute[75337]:         <nova:disk>1</nova:disk>
Nov 06 15:46:45 user nova-compute[75337]:         <nova:swap>0</nova:swap>
Nov 06 15:46:45 user nova-compute[75337]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 15:46:45 user nova-compute[75337]:         <nova:vcpus>1</nova:vcpus>
Nov 06 15:46:45 user nova-compute[75337]:       </nova:flavor>
Nov 06 15:46:45 user nova-compute[75337]:       <nova:owner>
Nov 06 15:46:45 user nova-compute[75337]:         <nova:user uuid="9e1c021de4da40518ddc45a57ef79d6f">tempest-AttachVolumeShelveTestJSON-417383725-project-member</nova:user>
Nov 06 15:46:45 user nova-compute[75337]:         <nova:project uuid="ed09a1def6f0477796404d9bd3357dd0">tempest-AttachVolumeShelveTestJSON-417383725</nova:project>
Nov 06 15:46:45 user nova-compute[75337]:       </nova:owner>
Nov 06 15:46:45 user nova-compute[75337]:       <nova:root type="image" uuid="16b903ae-a40f-41a7-985b-4804cce92c62"/>
Nov 06 15:46:45 user nova-compute[75337]:       <nova:ports>
Nov 06 15:46:45 user nova-compute[75337]:         <nova:port uuid="d66c8fee-7efa-49a4-b9c3-2f7ad2ccc71b">
Nov 06 15:46:45 user nova-compute[75337]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 06 15:46:45 user nova-compute[75337]:         </nova:port>
Nov 06 15:46:45 user nova-compute[75337]:       </nova:ports>
Nov 06 15:46:45 user nova-compute[75337]:     </nova:instance>
Nov 06 15:46:45 user nova-compute[75337]:   </metadata>
Nov 06 15:46:45 user nova-compute[75337]:   <sysinfo type="smbios">
Nov 06 15:46:45 user nova-compute[75337]:     <system>
Nov 06 15:46:45 user nova-compute[75337]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 15:46:45 user nova-compute[75337]:       <entry name="product">OpenStack Nova</entry>
Nov 06 15:46:45 user nova-compute[75337]:       <entry name="version">0.0.0</entry>
Nov 06 15:46:45 user nova-compute[75337]:       <entry name="serial">afa4e52b-af51-45bf-b619-aeca14e7724d</entry>
Nov 06 15:46:45 user nova-compute[75337]:       <entry name="uuid">afa4e52b-af51-45bf-b619-aeca14e7724d</entry>
Nov 06 15:46:45 user nova-compute[75337]:       <entry name="family">Virtual Machine</entry>
Nov 06 15:46:45 user nova-compute[75337]:     </system>
Nov 06 15:46:45 user nova-compute[75337]:   </sysinfo>
Nov 06 15:46:45 user nova-compute[75337]:   <os>
Nov 06 15:46:45 user nova-compute[75337]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 15:46:45 user nova-compute[75337]:     <boot dev="hd"/>
Nov 06 15:46:45 user nova-compute[75337]:     <smbios mode="sysinfo"/>
Nov 06 15:46:45 user nova-compute[75337]:   </os>
Nov 06 15:46:45 user nova-compute[75337]:   <features>
Nov 06 15:46:45 user nova-compute[75337]:     <acpi/>
Nov 06 15:46:45 user nova-compute[75337]:     <apic/>
Nov 06 15:46:45 user nova-compute[75337]:     <vmcoreinfo/>
Nov 06 15:46:45 user nova-compute[75337]:   </features>
Nov 06 15:46:45 user nova-compute[75337]:   <clock offset="utc">
Nov 06 15:46:45 user nova-compute[75337]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 15:46:45 user nova-compute[75337]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 15:46:45 user nova-compute[75337]:     <timer name="hpet" present="no"/>
Nov 06 15:46:45 user nova-compute[75337]:   </clock>
Nov 06 15:46:45 user nova-compute[75337]:   <cpu mode="custom" match="exact">
Nov 06 15:46:45 user nova-compute[75337]:     <model>Nehalem</model>
Nov 06 15:46:45 user nova-compute[75337]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 15:46:45 user nova-compute[75337]:   </cpu>
Nov 06 15:46:45 user nova-compute[75337]:   <devices>
Nov 06 15:46:45 user nova-compute[75337]:     <disk type="file" device="disk">
Nov 06 15:46:45 user nova-compute[75337]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 15:46:45 user nova-compute[75337]:       <source file="/opt/stack/data/nova/instances/afa4e52b-af51-45bf-b619-aeca14e7724d/disk"/>
Nov 06 15:46:45 user nova-compute[75337]:       <target dev="vda" bus="virtio"/>
Nov 06 15:46:45 user nova-compute[75337]:     </disk>
Nov 06 15:46:45 user nova-compute[75337]:     <interface type="ethernet">
Nov 06 15:46:45 user nova-compute[75337]:       <mac address="fa:16:3e:17:d2:52"/>
Nov 06 15:46:45 user nova-compute[75337]:       <model type="virtio"/>
Nov 06 15:46:45 user nova-compute[75337]:       <mtu size="1442"/>
Nov 06 15:46:45 user nova-compute[75337]:       <target dev="tapd66c8fee-7e"/>
Nov 06 15:46:45 user nova-compute[75337]:     </interface>
Nov 06 15:46:45 user nova-compute[75337]:     <serial type="pty">
Nov 06 15:46:45 user nova-compute[75337]:       <log file="/opt/stack/data/nova/instances/afa4e52b-af51-45bf-b619-aeca14e7724d/console.log" append="off"/>
Nov 06 15:46:45 user nova-compute[75337]:     </serial>
Nov 06 15:46:45 user nova-compute[75337]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 15:46:45 user nova-compute[75337]:     <video>
Nov 06 15:46:45 user nova-compute[75337]:       <model type="virtio"/>
Nov 06 15:46:45 user nova-compute[75337]:     </video>
Nov 06 15:46:45 user nova-compute[75337]:     <rng model="virtio">
Nov 06 15:46:45 user nova-compute[75337]:       <backend model="random">/dev/urandom</backend>
Nov 06 15:46:45 user nova-compute[75337]:     </rng>
Nov 06 15:46:45 user nova-compute[75337]:     <controller type="usb" index="0" model="none"/>
Nov 06 15:46:45 user nova-compute[75337]:     <memballoon model="virtio">
Nov 06 15:46:45 user nova-compute[75337]:       <stats period="10"/>
Nov 06 15:46:45 user nova-compute[75337]:     </memballoon>
Nov 06 15:46:45 user nova-compute[75337]:   </devices>
Nov 06 15:46:45 user nova-compute[75337]: </domain>
Nov 06 15:46:45 user nova-compute[75337]:  {{(pid=75337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 15:46:45 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-dd8aa74a-26d5-4e86-9bbd-17cef4b2937e tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T15:46:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2034562466',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2034562466',id=19,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF82sEW5O6A3Q2brT3u+9GB1WIf+ebH23UlBANWc3lprOF36lFt5sOZdo4tfIJodY5NMNMTM6BNoWJkWdz/l+/cF+bZRgMJn1cr7pylEs7V4EldcWuCvMKcYzk70ZVi1Bg==',key_name='tempest-keypair-702382784',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ed09a1def6f0477796404d9bd3357dd0',ramdisk_id='',reservation_id='r-1fkdfqnf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-417383725',owner_user_name='tempest-AttachVolumeShelveTestJSON-417383725-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T15:46:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9e1c021de4da40518ddc45a57ef79d6f',uuid=afa4e52b-af51-45bf-b619-aeca14e7724d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d66c8fee-7efa-49a4-b9c3-2f7ad2ccc71b", "address": "fa:16:3e:17:d2:52", "network": {"id": "f24470c2-ff6f-49fd-b28f-16b8a87ed3b4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-217486733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed09a1def6f0477796404d9bd3357dd0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd66c8fee-7e", "ovs_interfaceid": "d66c8fee-7efa-49a4-b9c3-2f7ad2ccc71b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 15:46:45 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-dd8aa74a-26d5-4e86-9bbd-17cef4b2937e tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Converting VIF {"id": "d66c8fee-7efa-49a4-b9c3-2f7ad2ccc71b", "address": "fa:16:3e:17:d2:52", "network": {"id": "f24470c2-ff6f-49fd-b28f-16b8a87ed3b4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-217486733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed09a1def6f0477796404d9bd3357dd0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd66c8fee-7e", "ovs_interfaceid": "d66c8fee-7efa-49a4-b9c3-2f7ad2ccc71b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 15:46:45 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-dd8aa74a-26d5-4e86-9bbd-17cef4b2937e tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:d2:52,bridge_name='br-int',has_traffic_filtering=True,id=d66c8fee-7efa-49a4-b9c3-2f7ad2ccc71b,network=Network(f24470c2-ff6f-49fd-b28f-16b8a87ed3b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd66c8fee-7e') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 15:46:45 user nova-compute[75337]: DEBUG os_vif [None req-dd8aa74a-26d5-4e86-9bbd-17cef4b2937e tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:d2:52,bridge_name='br-int',has_traffic_filtering=True,id=d66c8fee-7efa-49a4-b9c3-2f7ad2ccc71b,network=Network(f24470c2-ff6f-49fd-b28f-16b8a87ed3b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd66c8fee-7e') {{(pid=75337) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 15:46:45 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:46:45 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:46:45 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 15:46:45 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:46:45 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '88416cc1-9cac-5576-9cd1-5cd978a0507a', '_type': 'linux-noop'}}, row=False) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:46:45 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:46:45 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:46:45 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:46:45 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd66c8fee-7e, may_exist=True, interface_attrs={}) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:46:45 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd66c8fee-7e, col_values=(('qos', UUID('143d919c-3af3-463a-9192-9ad9f3b78607')),), if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:46:45 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd66c8fee-7e, col_values=(('external_ids', {'iface-id': 'd66c8fee-7efa-49a4-b9c3-2f7ad2ccc71b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:17:d2:52', 'vm-uuid': 'afa4e52b-af51-45bf-b619-aeca14e7724d'}),), if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:46:45 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:46:45 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:46:45 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:46:45 user nova-compute[75337]: INFO os_vif [None req-dd8aa74a-26d5-4e86-9bbd-17cef4b2937e tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:d2:52,bridge_name='br-int',has_traffic_filtering=True,id=d66c8fee-7efa-49a4-b9c3-2f7ad2ccc71b,network=Network(f24470c2-ff6f-49fd-b28f-16b8a87ed3b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd66c8fee-7e')
Nov 06 15:46:46 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-dd8aa74a-26d5-4e86-9bbd-17cef4b2937e tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] No BDM found with device name vda, not building metadata. {{(pid=75337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 15:46:46 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-dd8aa74a-26d5-4e86-9bbd-17cef4b2937e tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] No VIF found with MAC fa:16:3e:17:d2:52, not building metadata {{(pid=75337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 15:46:46 user nova-compute[75337]: DEBUG nova.objects.instance [None req-eacdaf5c-1ea7-42ff-8f44-e7e407aedc23 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Lazy-loading 'flavor' on Instance uuid c8cf1ead-a87c-459c-b914-a0e976c9e464 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 15:46:46 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-eacdaf5c-1ea7-42ff-8f44-e7e407aedc23 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Lock "c8cf1ead-a87c-459c-b914-a0e976c9e464" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 41.608s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:46:46 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c1b60b2-8606-41a0-93a4-8d7572a7cd70 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] [instance: cdced0ba-84ff-42af-baab-e2f3412e1676] Calling os-brick to attach iSCSI Volume {{(pid=75337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 15:46:46 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c1b60b2-8606-41a0-93a4-8d7572a7cd70 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2abc33d0c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3b520000-6673-4e27-a3e8-770eb33d3751', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HGIxXELq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 15:46:46 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-8c1b60b2-8606-41a0-93a4-8d7572a7cd70 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 15:46:46 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-8c1b60b2-8606-41a0-93a4-8d7572a7cd70 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 15:46:46 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-8c1b60b2-8606-41a0-93a4-8d7572a7cd70 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 15:46:46 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-8c1b60b2-8606-41a0-93a4-8d7572a7cd70 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 15:46:46 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-8c1b60b2-8606-41a0-93a4-8d7572a7cd70 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3b520000-6673-4e27-a3e8-770eb33d3751" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 15:46:46 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-8c1b60b2-8606-41a0-93a4-8d7572a7cd70 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3b520000-6673-4e27-a3e8-770eb33d3751" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 15:46:46 user nova-compute[75337]: INFO os_brick.initiator.connectors.iscsi [None req-8c1b60b2-8606-41a0-93a4-8d7572a7cd70 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 15:46:46 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b520000-6673-4e27-a3e8-770eb33d3751 -p 172.16.0.220:3260 {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:46:46 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-4648cd25-826a-4faf-b6de-66381016c552 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 15:46:46 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b520000-6673-4e27-a3e8-770eb33d3751 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:46:46 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fa8239e-197b-4e46-bb4b-1132f7bef305]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:46:46 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c1b60b2-8606-41a0-93a4-8d7572a7cd70 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 15:46:46 user nova-compute[75337]:  {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:46:46 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b520000-6673-4e27-a3e8-770eb33d3751 -p 172.16.0.220:3260 --interface default --op new {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:46:46 user nova-compute[75337]: DEBUG nova.network.neutron [req-f5cf453e-3120-400c-ae8f-91f935758461 req-9cc2c7ff-9d21-4f00-9fd5-e15a950ce97d service nova] [instance: afa4e52b-af51-45bf-b619-aeca14e7724d] Updated VIF entry in instance network info cache for port d66c8fee-7efa-49a4-b9c3-2f7ad2ccc71b. {{(pid=75337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 15:46:46 user nova-compute[75337]: DEBUG nova.network.neutron [req-f5cf453e-3120-400c-ae8f-91f935758461 req-9cc2c7ff-9d21-4f00-9fd5-e15a950ce97d service nova] [instance: afa4e52b-af51-45bf-b619-aeca14e7724d] Updating instance_info_cache with network_info: [{"id": "d66c8fee-7efa-49a4-b9c3-2f7ad2ccc71b", "address": "fa:16:3e:17:d2:52", "network": {"id": "f24470c2-ff6f-49fd-b28f-16b8a87ed3b4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-217486733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed09a1def6f0477796404d9bd3357dd0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd66c8fee-7e", "ovs_interfaceid": "d66c8fee-7efa-49a4-b9c3-2f7ad2ccc71b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:46:46 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-4648cd25-826a-4faf-b6de-66381016c552 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 15:46:46 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-f5cf453e-3120-400c-ae8f-91f935758461 req-9cc2c7ff-9d21-4f00-9fd5-e15a950ce97d service nova] Releasing lock "refresh_cache-afa4e52b-af51-45bf-b619-aeca14e7724d" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 15:46:46 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b520000-6673-4e27-a3e8-770eb33d3751 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:46:46 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4890b00-71ae-45ff-a5d9-1fefce0afad8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3b520000-6673-4e27-a3e8-770eb33d3751] added\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:46:46 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c1b60b2-8606-41a0-93a4-8d7572a7cd70 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3b520000-6673-4e27-a3e8-770eb33d3751] added
Nov 06 15:46:46 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:46:46 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b520000-6673-4e27-a3e8-770eb33d3751 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:46:46 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b520000-6673-4e27-a3e8-770eb33d3751 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:46:46 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcf0bf11-fdf6-4ce5-b680-4dd9c6d80756]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:46:46 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c1b60b2-8606-41a0-93a4-8d7572a7cd70 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:46:46 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b520000-6673-4e27-a3e8-770eb33d3751 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:46:46 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-4648cd25-826a-4faf-b6de-66381016c552 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.638s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:46:46 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b520000-6673-4e27-a3e8-770eb33d3751 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:46:46 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[13c06634-5f7e-44e4-bbe2-4f9201f9b1ab]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:46:46 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c1b60b2-8606-41a0-93a4-8d7572a7cd70 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:46:46 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b520000-6673-4e27-a3e8-770eb33d3751 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HGIxXELq {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:46:46 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b520000-6673-4e27-a3e8-770eb33d3751 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HGIxXELq" returned: 0 in 0.019s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:46:46 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b7f332a-66f3-4e7c-ba2c-2f3e6b898ee2]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:46:46 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c1b60b2-8606-41a0-93a4-8d7572a7cd70 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HGIxXELq'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:46:46 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b520000-6673-4e27-a3e8-770eb33d3751 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:46:46 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b520000-6673-4e27-a3e8-770eb33d3751 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:46:46 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[e27210e0-b6da-4c37-a9ec-edfe6dcde063]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:46:46 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c1b60b2-8606-41a0-93a4-8d7572a7cd70 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:46:46 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:46:46 user nova-compute[75337]: INFO nova.scheduler.client.report [None req-4648cd25-826a-4faf-b6de-66381016c552 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Deleted allocations for instance 4015f2f7-a176-46aa-bdff-58d164058e15
Nov 06 15:46:46 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:46:46 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[062bcff7-31b5-4eb2-a6a8-2f2e6c6b07f5]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6 (non-flash)\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:46:46 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c1b60b2-8606-41a0-93a4-8d7572a7cd70 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)
Nov 06 15:46:46 user nova-compute[75337]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e (non-flash)
Nov 06 15:46:46 user nova-compute[75337]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6 (non-flash)
Nov 06 15:46:46 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 15:46:46 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c1b60b2-8606-41a0-93a4-8d7572a7cd70 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)
Nov 06 15:46:46 user nova-compute[75337]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e (non-flash)
Nov 06 15:46:46 user nova-compute[75337]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6 (non-flash)
Nov 06 15:46:46 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 15:46:46 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b520000-6673-4e27-a3e8-770eb33d3751 -p 172.16.0.220:3260 --login {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:46:46 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-4648cd25-826a-4faf-b6de-66381016c552 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Lock "4015f2f7-a176-46aa-bdff-58d164058e15" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.894s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:46:46 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b520000-6673-4e27-a3e8-770eb33d3751 -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:46:46 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[12e02abb-35b2-431e-85b1-c5de7651e2f8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3b520000-6673-4e27-a3e8-770eb33d3751, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3b520000-6673-4e27-a3e8-770eb33d3751, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:46:46 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c1b60b2-8606-41a0-93a4-8d7572a7cd70 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3b520000-6673-4e27-a3e8-770eb33d3751, portal: 172.16.0.220,3260]
Nov 06 15:46:46 user nova-compute[75337]: Login to [iface: default, target: iqn.2010-10.org.openstack:3b520000-6673-4e27-a3e8-770eb33d3751, portal: 172.16.0.220,3260] successful.
Nov 06 15:46:46 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:46:46 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b520000-6673-4e27-a3e8-770eb33d3751 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:46:46 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b520000-6673-4e27-a3e8-770eb33d3751 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.031s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:46:46 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[4423d0be-ba29-4791-87f1-24e8fe3714f9]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:46:46 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c1b60b2-8606-41a0-93a4-8d7572a7cd70 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:46:46 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:46:46 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:46:46 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9fe568a-d975-4b59-85ee-10da7677dc23]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b520000-6673-4e27-a3e8-770eb33d3751 (non-flash)\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:46:46 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c1b60b2-8606-41a0-93a4-8d7572a7cd70 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)
Nov 06 15:46:46 user nova-compute[75337]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e (non-flash)
Nov 06 15:46:46 user nova-compute[75337]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6 (non-flash)
Nov 06 15:46:46 user nova-compute[75337]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b520000-6673-4e27-a3e8-770eb33d3751 (non-flash)
Nov 06 15:46:46 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 15:46:46 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c1b60b2-8606-41a0-93a4-8d7572a7cd70 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)
Nov 06 15:46:46 user nova-compute[75337]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e (non-flash)
Nov 06 15:46:46 user nova-compute[75337]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6 (non-flash)
Nov 06 15:46:46 user nova-compute[75337]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b520000-6673-4e27-a3e8-770eb33d3751 (non-flash)
Nov 06 15:46:46 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 15:46:46 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-8c1b60b2-8606-41a0-93a4-8d7572a7cd70 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3b520000-6673-4e27-a3e8-770eb33d3751" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.375s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 15:46:46 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c1b60b2-8606-41a0-93a4-8d7572a7cd70 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Connected to 172.16.0.220:3260 {{(pid=75337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 15:46:46 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-8c1b60b2-8606-41a0-93a4-8d7572a7cd70 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] HCTL ('35', '-', '-', 0) found on session 18 with lun 0 {{(pid=75337) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 15:46:46 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-8c1b60b2-8606-41a0-93a4-8d7572a7cd70 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75337) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 15:46:46 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:46:46 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:46:46 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[58c5aedd-c722-483f-87cc-f7882a991093]: (4, ('- - 0', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:46:46 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-8c1b60b2-8606-41a0-93a4-8d7572a7cd70 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Searching for a device in session 18 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75337) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 15:46:46 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c1b60b2-8606-41a0-93a4-8d7572a7cd70 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:3b520000-6673-4e27-a3e8-770eb33d3751', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HGIxXELq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 15:46:47 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:46:47 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:46:47 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-8c1b60b2-8606-41a0-93a4-8d7572a7cd70 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.415s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 15:46:47 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c1b60b2-8606-41a0-93a4-8d7572a7cd70 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] <== connect_volume: return (1417ms) {'type': 'block', 'scsi_wwn': '26464353538316165', 'path': '/dev/sdd'} {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 15:46:47 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c1b60b2-8606-41a0-93a4-8d7572a7cd70 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] [instance: cdced0ba-84ff-42af-baab-e2f3412e1676] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26464353538316165', 'path': '/dev/sdd'} {{(pid=75337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 15:46:47 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:46:47 user nova-compute[75337]: DEBUG nova.objects.instance [None req-8c1b60b2-8606-41a0-93a4-8d7572a7cd70 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Lazy-loading 'flavor' on Instance uuid cdced0ba-84ff-42af-baab-e2f3412e1676 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 15:46:47 user nova-compute[75337]: DEBUG nova.virt.libvirt.guest [None req-8c1b60b2-8606-41a0-93a4-8d7572a7cd70 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] attach device xml: <disk type="block" device="disk">
Nov 06 15:46:47 user nova-compute[75337]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 15:46:47 user nova-compute[75337]:   <source dev="/dev/sdd"/>
Nov 06 15:46:47 user nova-compute[75337]:   <target dev="vdb" bus="virtio"/>
Nov 06 15:46:47 user nova-compute[75337]:   <serial>3b520000-6673-4e27-a3e8-770eb33d3751</serial>
Nov 06 15:46:47 user nova-compute[75337]: </disk>
Nov 06 15:46:47 user nova-compute[75337]:  {{(pid=75337) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 06 15:46:48 user nova-compute[75337]: DEBUG nova.compute.manager [req-d8d391a9-809c-4e59-b846-1e0a4d08769c req-48b3bb8e-302b-4d00-8119-907e744c0878 service nova] [instance: afa4e52b-af51-45bf-b619-aeca14e7724d] Received event network-vif-plugged-d66c8fee-7efa-49a4-b9c3-2f7ad2ccc71b {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:46:48 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-d8d391a9-809c-4e59-b846-1e0a4d08769c req-48b3bb8e-302b-4d00-8119-907e744c0878 service nova] Acquiring lock "afa4e52b-af51-45bf-b619-aeca14e7724d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:46:48 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-d8d391a9-809c-4e59-b846-1e0a4d08769c req-48b3bb8e-302b-4d00-8119-907e744c0878 service nova] Lock "afa4e52b-af51-45bf-b619-aeca14e7724d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:46:48 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-d8d391a9-809c-4e59-b846-1e0a4d08769c req-48b3bb8e-302b-4d00-8119-907e744c0878 service nova] Lock "afa4e52b-af51-45bf-b619-aeca14e7724d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:46:48 user nova-compute[75337]: DEBUG nova.compute.manager [req-d8d391a9-809c-4e59-b846-1e0a4d08769c req-48b3bb8e-302b-4d00-8119-907e744c0878 service nova] [instance: afa4e52b-af51-45bf-b619-aeca14e7724d] No waiting events found dispatching network-vif-plugged-d66c8fee-7efa-49a4-b9c3-2f7ad2ccc71b {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:46:48 user nova-compute[75337]: WARNING nova.compute.manager [req-d8d391a9-809c-4e59-b846-1e0a4d08769c req-48b3bb8e-302b-4d00-8119-907e744c0878 service nova] [instance: afa4e52b-af51-45bf-b619-aeca14e7724d] Received unexpected event network-vif-plugged-d66c8fee-7efa-49a4-b9c3-2f7ad2ccc71b for instance with vm_state building and task_state spawning.
Nov 06 15:46:48 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:46:48 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:46:48 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-8c1b60b2-8606-41a0-93a4-8d7572a7cd70 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] No BDM found with device name vda, not building metadata. {{(pid=75337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 15:46:48 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-8c1b60b2-8606-41a0-93a4-8d7572a7cd70 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 15:46:48 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-8c1b60b2-8606-41a0-93a4-8d7572a7cd70 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] No VIF found with MAC fa:16:3e:cf:ac:79, not building metadata {{(pid=75337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 15:46:48 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-8c1b60b2-8606-41a0-93a4-8d7572a7cd70 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Lock "cdced0ba-84ff-42af-baab-e2f3412e1676" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 30.640s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:46:48 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:46:50 user nova-compute[75337]: DEBUG nova.compute.manager [req-66a3eb6d-0ab3-4c2a-8b3e-a687b38eb1e8 req-5a47de2d-64eb-4050-9600-84ca1407d3ac service nova] [instance: afa4e52b-af51-45bf-b619-aeca14e7724d] Received event network-vif-plugged-d66c8fee-7efa-49a4-b9c3-2f7ad2ccc71b {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:46:50 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-66a3eb6d-0ab3-4c2a-8b3e-a687b38eb1e8 req-5a47de2d-64eb-4050-9600-84ca1407d3ac service nova] Acquiring lock "afa4e52b-af51-45bf-b619-aeca14e7724d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:46:50 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-66a3eb6d-0ab3-4c2a-8b3e-a687b38eb1e8 req-5a47de2d-64eb-4050-9600-84ca1407d3ac service nova] Lock "afa4e52b-af51-45bf-b619-aeca14e7724d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:46:50 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-66a3eb6d-0ab3-4c2a-8b3e-a687b38eb1e8 req-5a47de2d-64eb-4050-9600-84ca1407d3ac service nova] Lock "afa4e52b-af51-45bf-b619-aeca14e7724d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:46:50 user nova-compute[75337]: DEBUG nova.compute.manager [req-66a3eb6d-0ab3-4c2a-8b3e-a687b38eb1e8 req-5a47de2d-64eb-4050-9600-84ca1407d3ac service nova] [instance: afa4e52b-af51-45bf-b619-aeca14e7724d] No waiting events found dispatching network-vif-plugged-d66c8fee-7efa-49a4-b9c3-2f7ad2ccc71b {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:46:50 user nova-compute[75337]: WARNING nova.compute.manager [req-66a3eb6d-0ab3-4c2a-8b3e-a687b38eb1e8 req-5a47de2d-64eb-4050-9600-84ca1407d3ac service nova] [instance: afa4e52b-af51-45bf-b619-aeca14e7724d] Received unexpected event network-vif-plugged-d66c8fee-7efa-49a4-b9c3-2f7ad2ccc71b for instance with vm_state building and task_state spawning.
Nov 06 15:46:50 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-9b20725f-14e3-4d3d-8f51-38357a357b25 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Acquiring lock "cdced0ba-84ff-42af-baab-e2f3412e1676" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:46:50 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-9b20725f-14e3-4d3d-8f51-38357a357b25 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Lock "cdced0ba-84ff-42af-baab-e2f3412e1676" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:46:50 user nova-compute[75337]: DEBUG nova.compute.manager [None req-dd8aa74a-26d5-4e86-9bbd-17cef4b2937e tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] [instance: afa4e52b-af51-45bf-b619-aeca14e7724d] Instance event wait completed in 0 seconds for  {{(pid=75337) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 15:46:50 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-dd8aa74a-26d5-4e86-9bbd-17cef4b2937e tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] [instance: afa4e52b-af51-45bf-b619-aeca14e7724d] Guest created on hypervisor {{(pid=75337) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 15:46:50 user nova-compute[75337]: INFO nova.compute.manager [None req-9b20725f-14e3-4d3d-8f51-38357a357b25 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] [instance: cdced0ba-84ff-42af-baab-e2f3412e1676] Detaching volume 3b520000-6673-4e27-a3e8-770eb33d3751
Nov 06 15:46:50 user nova-compute[75337]: INFO nova.virt.libvirt.driver [-] [instance: afa4e52b-af51-45bf-b619-aeca14e7724d] Instance spawned successfully.
Nov 06 15:46:50 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-dd8aa74a-26d5-4e86-9bbd-17cef4b2937e tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] [instance: afa4e52b-af51-45bf-b619-aeca14e7724d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 15:46:50 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-dd8aa74a-26d5-4e86-9bbd-17cef4b2937e tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] [instance: afa4e52b-af51-45bf-b619-aeca14e7724d] Found default for hw_cdrom_bus of ide {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:46:50 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-dd8aa74a-26d5-4e86-9bbd-17cef4b2937e tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] [instance: afa4e52b-af51-45bf-b619-aeca14e7724d] Found default for hw_disk_bus of virtio {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:46:50 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-dd8aa74a-26d5-4e86-9bbd-17cef4b2937e tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] [instance: afa4e52b-af51-45bf-b619-aeca14e7724d] Found default for hw_input_bus of None {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:46:50 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-dd8aa74a-26d5-4e86-9bbd-17cef4b2937e tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] [instance: afa4e52b-af51-45bf-b619-aeca14e7724d] Found default for hw_pointer_model of None {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:46:50 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-dd8aa74a-26d5-4e86-9bbd-17cef4b2937e tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] [instance: afa4e52b-af51-45bf-b619-aeca14e7724d] Found default for hw_video_model of virtio {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:46:50 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-dd8aa74a-26d5-4e86-9bbd-17cef4b2937e tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] [instance: afa4e52b-af51-45bf-b619-aeca14e7724d] Found default for hw_vif_model of virtio {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:46:50 user nova-compute[75337]: INFO nova.virt.block_device [None req-9b20725f-14e3-4d3d-8f51-38357a357b25 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] [instance: cdced0ba-84ff-42af-baab-e2f3412e1676] Attempting to driver detach volume 3b520000-6673-4e27-a3e8-770eb33d3751 from mountpoint /dev/vdb
Nov 06 15:46:50 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-9b20725f-14e3-4d3d-8f51-38357a357b25 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Attempting to detach device vdb from instance cdced0ba-84ff-42af-baab-e2f3412e1676 from the persistent domain config. {{(pid=75337) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 06 15:46:50 user nova-compute[75337]: DEBUG nova.virt.libvirt.guest [None req-9b20725f-14e3-4d3d-8f51-38357a357b25 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 15:46:50 user nova-compute[75337]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 15:46:50 user nova-compute[75337]:   <source dev="/dev/sdd"/>
Nov 06 15:46:50 user nova-compute[75337]:   <target dev="vdb" bus="virtio"/>
Nov 06 15:46:50 user nova-compute[75337]:   <serial>3b520000-6673-4e27-a3e8-770eb33d3751</serial>
Nov 06 15:46:50 user nova-compute[75337]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 06 15:46:50 user nova-compute[75337]: </disk>
Nov 06 15:46:50 user nova-compute[75337]:  {{(pid=75337) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 15:46:50 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-9b20725f-14e3-4d3d-8f51-38357a357b25 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Successfully detached device vdb from instance cdced0ba-84ff-42af-baab-e2f3412e1676 from the persistent domain config.
Nov 06 15:46:50 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-9b20725f-14e3-4d3d-8f51-38357a357b25 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance cdced0ba-84ff-42af-baab-e2f3412e1676 from the live domain config. {{(pid=75337) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 06 15:46:50 user nova-compute[75337]: DEBUG nova.virt.libvirt.guest [None req-9b20725f-14e3-4d3d-8f51-38357a357b25 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 15:46:50 user nova-compute[75337]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 15:46:50 user nova-compute[75337]:   <source dev="/dev/sdd"/>
Nov 06 15:46:50 user nova-compute[75337]:   <target dev="vdb" bus="virtio"/>
Nov 06 15:46:50 user nova-compute[75337]:   <serial>3b520000-6673-4e27-a3e8-770eb33d3751</serial>
Nov 06 15:46:50 user nova-compute[75337]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 06 15:46:50 user nova-compute[75337]: </disk>
Nov 06 15:46:50 user nova-compute[75337]:  {{(pid=75337) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 15:46:50 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:46:50 user nova-compute[75337]: INFO nova.compute.manager [None req-dd8aa74a-26d5-4e86-9bbd-17cef4b2937e tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] [instance: afa4e52b-af51-45bf-b619-aeca14e7724d] Took 7.49 seconds to spawn the instance on the hypervisor.
Nov 06 15:46:50 user nova-compute[75337]: DEBUG nova.compute.manager [None req-dd8aa74a-26d5-4e86-9bbd-17cef4b2937e tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] [instance: afa4e52b-af51-45bf-b619-aeca14e7724d] Checking state {{(pid=75337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 15:46:50 user nova-compute[75337]: INFO nova.compute.manager [None req-dd8aa74a-26d5-4e86-9bbd-17cef4b2937e tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] [instance: afa4e52b-af51-45bf-b619-aeca14e7724d] Took 8.63 seconds to build instance.
Nov 06 15:46:51 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-dd8aa74a-26d5-4e86-9bbd-17cef4b2937e tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Lock "afa4e52b-af51-45bf-b619-aeca14e7724d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.779s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:46:51 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-9b20725f-14e3-4d3d-8f51-38357a357b25 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance cdced0ba-84ff-42af-baab-e2f3412e1676 {{(pid=75337) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 06 15:46:53 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:46:55 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-ac810a62-f14a-4003-becc-1f92cc8806f7 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Acquiring lock "c8cf1ead-a87c-459c-b914-a0e976c9e464" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:46:55 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-ac810a62-f14a-4003-becc-1f92cc8806f7 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Lock "c8cf1ead-a87c-459c-b914-a0e976c9e464" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:46:55 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-ac810a62-f14a-4003-becc-1f92cc8806f7 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Acquiring lock "c8cf1ead-a87c-459c-b914-a0e976c9e464-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:46:55 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-ac810a62-f14a-4003-becc-1f92cc8806f7 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Lock "c8cf1ead-a87c-459c-b914-a0e976c9e464-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:46:55 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-ac810a62-f14a-4003-becc-1f92cc8806f7 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Lock "c8cf1ead-a87c-459c-b914-a0e976c9e464-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:46:55 user nova-compute[75337]: INFO nova.compute.manager [None req-ac810a62-f14a-4003-becc-1f92cc8806f7 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] [instance: c8cf1ead-a87c-459c-b914-a0e976c9e464] Terminating instance
Nov 06 15:46:55 user nova-compute[75337]: DEBUG nova.compute.manager [None req-ac810a62-f14a-4003-becc-1f92cc8806f7 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] [instance: c8cf1ead-a87c-459c-b914-a0e976c9e464] Start destroying the instance on the hypervisor. {{(pid=75337) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 15:46:55 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:46:55 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:46:55 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:46:55 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:46:55 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:46:56 user nova-compute[75337]: DEBUG nova.compute.manager [req-8165116e-4031-4dfa-b4a9-aa593749677c req-48e8ad60-a4ad-4991-89ff-3205c6e671f1 service nova] [instance: c8cf1ead-a87c-459c-b914-a0e976c9e464] Received event network-vif-unplugged-b33373f6-0289-4623-90ac-f5c3db0d3681 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:46:56 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-8165116e-4031-4dfa-b4a9-aa593749677c req-48e8ad60-a4ad-4991-89ff-3205c6e671f1 service nova] Acquiring lock "c8cf1ead-a87c-459c-b914-a0e976c9e464-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:46:56 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-8165116e-4031-4dfa-b4a9-aa593749677c req-48e8ad60-a4ad-4991-89ff-3205c6e671f1 service nova] Lock "c8cf1ead-a87c-459c-b914-a0e976c9e464-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:46:56 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-8165116e-4031-4dfa-b4a9-aa593749677c req-48e8ad60-a4ad-4991-89ff-3205c6e671f1 service nova] Lock "c8cf1ead-a87c-459c-b914-a0e976c9e464-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:46:56 user nova-compute[75337]: DEBUG nova.compute.manager [req-8165116e-4031-4dfa-b4a9-aa593749677c req-48e8ad60-a4ad-4991-89ff-3205c6e671f1 service nova] [instance: c8cf1ead-a87c-459c-b914-a0e976c9e464] No waiting events found dispatching network-vif-unplugged-b33373f6-0289-4623-90ac-f5c3db0d3681 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:46:56 user nova-compute[75337]: DEBUG nova.compute.manager [req-8165116e-4031-4dfa-b4a9-aa593749677c req-48e8ad60-a4ad-4991-89ff-3205c6e671f1 service nova] [instance: c8cf1ead-a87c-459c-b914-a0e976c9e464] Received event network-vif-unplugged-b33373f6-0289-4623-90ac-f5c3db0d3681 for instance with task_state deleting. {{(pid=75337) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 15:46:56 user nova-compute[75337]: INFO nova.virt.libvirt.driver [-] [instance: c8cf1ead-a87c-459c-b914-a0e976c9e464] Instance destroyed successfully.
Nov 06 15:46:56 user nova-compute[75337]: DEBUG nova.objects.instance [None req-ac810a62-f14a-4003-becc-1f92cc8806f7 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Lazy-loading 'resources' on Instance uuid c8cf1ead-a87c-459c-b914-a0e976c9e464 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 15:46:56 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-ac810a62-f14a-4003-becc-1f92cc8806f7 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T15:37:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1460081442',display_name='tempest-ServerStableDeviceRescueTest-server-1460081442',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1460081442',id=3,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNhWd6+eUiIBQZGc6LZ0InXN96wVpRF9RHeVy5tDr/sqc5jJYeqvZnGJOTX8afCIFIyA3qCwBSUAfC6fowKfta99KGcXm2stZlkUkyQJaJ7NDTIzQAW/nlfJ0mGtYGBdsw==',key_name='tempest-keypair-2068455996',keypairs=<?>,launch_index=0,launched_at=2023-11-06T15:43:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='86f4b41336384a53a3fd22caa0fe8e6e',ramdisk_id='',reservation_id='r-dfh80oqh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1727960867',owner_user_name='tempest-ServerStableDeviceRescueTest-1727960867-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T15:45:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f5356a7304a34428bbb0f39fb7d9a489',uuid=c8cf1ead-a87c-459c-b914-a0e976c9e464,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b33373f6-0289-4623-90ac-f5c3db0d3681", "address": "fa:16:3e:37:16:66", "network": {"id": "a839a9d1-fdf3-4a72-898b-6829ceef2055", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1927950273-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86f4b41336384a53a3fd22caa0fe8e6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb33373f6-02", "ovs_interfaceid": "b33373f6-0289-4623-90ac-f5c3db0d3681", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 15:46:56 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-ac810a62-f14a-4003-becc-1f92cc8806f7 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Converting VIF {"id": "b33373f6-0289-4623-90ac-f5c3db0d3681", "address": "fa:16:3e:37:16:66", "network": {"id": "a839a9d1-fdf3-4a72-898b-6829ceef2055", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1927950273-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86f4b41336384a53a3fd22caa0fe8e6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb33373f6-02", "ovs_interfaceid": "b33373f6-0289-4623-90ac-f5c3db0d3681", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 15:46:56 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-ac810a62-f14a-4003-becc-1f92cc8806f7 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:37:16:66,bridge_name='br-int',has_traffic_filtering=True,id=b33373f6-0289-4623-90ac-f5c3db0d3681,network=Network(a839a9d1-fdf3-4a72-898b-6829ceef2055),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb33373f6-02') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 15:46:56 user nova-compute[75337]: DEBUG os_vif [None req-ac810a62-f14a-4003-becc-1f92cc8806f7 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:37:16:66,bridge_name='br-int',has_traffic_filtering=True,id=b33373f6-0289-4623-90ac-f5c3db0d3681,network=Network(a839a9d1-fdf3-4a72-898b-6829ceef2055),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb33373f6-02') {{(pid=75337) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 15:46:56 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:46:56 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb33373f6-02, bridge=br-int, if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:46:56 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:46:56 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:46:56 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:46:56 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1443d31b-ad79-48db-a057-6f259fc19722) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:46:56 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:46:56 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:46:56 user nova-compute[75337]: INFO os_vif [None req-ac810a62-f14a-4003-becc-1f92cc8806f7 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:37:16:66,bridge_name='br-int',has_traffic_filtering=True,id=b33373f6-0289-4623-90ac-f5c3db0d3681,network=Network(a839a9d1-fdf3-4a72-898b-6829ceef2055),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb33373f6-02')
Nov 06 15:46:56 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-ac810a62-f14a-4003-becc-1f92cc8806f7 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] [instance: c8cf1ead-a87c-459c-b914-a0e976c9e464] Deleting instance files /opt/stack/data/nova/instances/c8cf1ead-a87c-459c-b914-a0e976c9e464_del
Nov 06 15:46:56 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-ac810a62-f14a-4003-becc-1f92cc8806f7 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] [instance: c8cf1ead-a87c-459c-b914-a0e976c9e464] Deletion of /opt/stack/data/nova/instances/c8cf1ead-a87c-459c-b914-a0e976c9e464_del complete
Nov 06 15:46:56 user nova-compute[75337]: INFO nova.compute.manager [None req-ac810a62-f14a-4003-becc-1f92cc8806f7 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] [instance: c8cf1ead-a87c-459c-b914-a0e976c9e464] Took 0.94 seconds to destroy the instance on the hypervisor.
Nov 06 15:46:56 user nova-compute[75337]: DEBUG oslo.service.loopingcall [None req-ac810a62-f14a-4003-becc-1f92cc8806f7 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75337) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 15:46:56 user nova-compute[75337]: DEBUG nova.compute.manager [-] [instance: c8cf1ead-a87c-459c-b914-a0e976c9e464] Deallocating network for instance {{(pid=75337) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 15:46:56 user nova-compute[75337]: DEBUG nova.network.neutron [-] [instance: c8cf1ead-a87c-459c-b914-a0e976c9e464] deallocate_for_instance() {{(pid=75337) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 15:46:57 user nova-compute[75337]: DEBUG nova.network.neutron [-] [instance: c8cf1ead-a87c-459c-b914-a0e976c9e464] Updating instance_info_cache with network_info: [] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:46:57 user nova-compute[75337]: INFO nova.compute.manager [-] [instance: c8cf1ead-a87c-459c-b914-a0e976c9e464] Took 0.76 seconds to deallocate network for instance.
Nov 06 15:46:57 user nova-compute[75337]: DEBUG nova.compute.manager [req-7f1270ac-2802-4911-8d2d-a25708722756 req-692b940b-3b98-43ff-aea7-ae7f204903fa service nova] [instance: c8cf1ead-a87c-459c-b914-a0e976c9e464] Received event network-vif-deleted-b33373f6-0289-4623-90ac-f5c3db0d3681 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:46:57 user nova-compute[75337]: INFO nova.compute.manager [req-7f1270ac-2802-4911-8d2d-a25708722756 req-692b940b-3b98-43ff-aea7-ae7f204903fa service nova] [instance: c8cf1ead-a87c-459c-b914-a0e976c9e464] Neutron deleted interface b33373f6-0289-4623-90ac-f5c3db0d3681; detaching it from the instance and deleting it from the info cache
Nov 06 15:46:57 user nova-compute[75337]: DEBUG nova.network.neutron [req-7f1270ac-2802-4911-8d2d-a25708722756 req-692b940b-3b98-43ff-aea7-ae7f204903fa service nova] [instance: c8cf1ead-a87c-459c-b914-a0e976c9e464] Updating instance_info_cache with network_info: [] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:46:57 user nova-compute[75337]: DEBUG nova.compute.manager [req-7f1270ac-2802-4911-8d2d-a25708722756 req-692b940b-3b98-43ff-aea7-ae7f204903fa service nova] [instance: c8cf1ead-a87c-459c-b914-a0e976c9e464] Detach interface failed, port_id=b33373f6-0289-4623-90ac-f5c3db0d3681, reason: Instance c8cf1ead-a87c-459c-b914-a0e976c9e464 could not be found. {{(pid=75337) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 06 15:46:57 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-ac810a62-f14a-4003-becc-1f92cc8806f7 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:46:57 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-ac810a62-f14a-4003-becc-1f92cc8806f7 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:46:57 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-ac810a62-f14a-4003-becc-1f92cc8806f7 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 15:46:57 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-ac810a62-f14a-4003-becc-1f92cc8806f7 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 15:46:57 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-ac810a62-f14a-4003-becc-1f92cc8806f7 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.386s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:46:57 user nova-compute[75337]: INFO nova.scheduler.client.report [None req-ac810a62-f14a-4003-becc-1f92cc8806f7 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Deleted allocations for instance c8cf1ead-a87c-459c-b914-a0e976c9e464
Nov 06 15:46:57 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-ac810a62-f14a-4003-becc-1f92cc8806f7 tempest-ServerStableDeviceRescueTest-1727960867 tempest-ServerStableDeviceRescueTest-1727960867-project-member] Lock "c8cf1ead-a87c-459c-b914-a0e976c9e464" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.311s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:46:58 user nova-compute[75337]: DEBUG nova.compute.manager [req-07ddcb5c-2683-4357-9e37-4ab0daa6be8d req-7f9e3496-f85f-4de5-a36f-61c3962ee0cd service nova] [instance: c8cf1ead-a87c-459c-b914-a0e976c9e464] Received event network-vif-plugged-b33373f6-0289-4623-90ac-f5c3db0d3681 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:46:58 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-07ddcb5c-2683-4357-9e37-4ab0daa6be8d req-7f9e3496-f85f-4de5-a36f-61c3962ee0cd service nova] Acquiring lock "c8cf1ead-a87c-459c-b914-a0e976c9e464-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:46:58 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-07ddcb5c-2683-4357-9e37-4ab0daa6be8d req-7f9e3496-f85f-4de5-a36f-61c3962ee0cd service nova] Lock "c8cf1ead-a87c-459c-b914-a0e976c9e464-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:46:58 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-07ddcb5c-2683-4357-9e37-4ab0daa6be8d req-7f9e3496-f85f-4de5-a36f-61c3962ee0cd service nova] Lock "c8cf1ead-a87c-459c-b914-a0e976c9e464-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:46:58 user nova-compute[75337]: DEBUG nova.compute.manager [req-07ddcb5c-2683-4357-9e37-4ab0daa6be8d req-7f9e3496-f85f-4de5-a36f-61c3962ee0cd service nova] [instance: c8cf1ead-a87c-459c-b914-a0e976c9e464] No waiting events found dispatching network-vif-plugged-b33373f6-0289-4623-90ac-f5c3db0d3681 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:46:58 user nova-compute[75337]: WARNING nova.compute.manager [req-07ddcb5c-2683-4357-9e37-4ab0daa6be8d req-7f9e3496-f85f-4de5-a36f-61c3962ee0cd service nova] [instance: c8cf1ead-a87c-459c-b914-a0e976c9e464] Received unexpected event network-vif-plugged-b33373f6-0289-4623-90ac-f5c3db0d3681 for instance with vm_state deleted and task_state None.
Nov 06 15:46:58 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:46:59 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-3514b2fa-3bd0-4481-a291-209cbd78cb8b tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] Acquiring lock "9125364b-332f-4297-815f-3aa1eadaf743" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:46:59 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-3514b2fa-3bd0-4481-a291-209cbd78cb8b tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] Lock "9125364b-332f-4297-815f-3aa1eadaf743" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:46:59 user nova-compute[75337]: DEBUG nova.objects.instance [None req-3514b2fa-3bd0-4481-a291-209cbd78cb8b tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] Lazy-loading 'flavor' on Instance uuid 9125364b-332f-4297-815f-3aa1eadaf743 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 15:46:59 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-3514b2fa-3bd0-4481-a291-209cbd78cb8b tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] Lock "9125364b-332f-4297-815f-3aa1eadaf743" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:46:59 user nova-compute[75337]: DEBUG nova.compute.manager [req-0498aab3-deaa-4faa-acca-9d729ec2406c req-08e03bbf-f125-4818-9fca-54c710fac22f service nova] [instance: 9125364b-332f-4297-815f-3aa1eadaf743] Received event network-changed-f38ac99b-98f5-4892-9098-71487faa5282 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:46:59 user nova-compute[75337]: DEBUG nova.compute.manager [req-0498aab3-deaa-4faa-acca-9d729ec2406c req-08e03bbf-f125-4818-9fca-54c710fac22f service nova] [instance: 9125364b-332f-4297-815f-3aa1eadaf743] Refreshing instance network info cache due to event network-changed-f38ac99b-98f5-4892-9098-71487faa5282. {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 15:46:59 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-0498aab3-deaa-4faa-acca-9d729ec2406c req-08e03bbf-f125-4818-9fca-54c710fac22f service nova] Acquiring lock "refresh_cache-9125364b-332f-4297-815f-3aa1eadaf743" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 15:46:59 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-0498aab3-deaa-4faa-acca-9d729ec2406c req-08e03bbf-f125-4818-9fca-54c710fac22f service nova] Acquired lock "refresh_cache-9125364b-332f-4297-815f-3aa1eadaf743" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 15:46:59 user nova-compute[75337]: DEBUG nova.network.neutron [req-0498aab3-deaa-4faa-acca-9d729ec2406c req-08e03bbf-f125-4818-9fca-54c710fac22f service nova] [instance: 9125364b-332f-4297-815f-3aa1eadaf743] Refreshing network info cache for port f38ac99b-98f5-4892-9098-71487faa5282 {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 15:46:59 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-3514b2fa-3bd0-4481-a291-209cbd78cb8b tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] Acquiring lock "9125364b-332f-4297-815f-3aa1eadaf743" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:46:59 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-3514b2fa-3bd0-4481-a291-209cbd78cb8b tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] Lock "9125364b-332f-4297-815f-3aa1eadaf743" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:46:59 user nova-compute[75337]: INFO nova.compute.manager [None req-3514b2fa-3bd0-4481-a291-209cbd78cb8b tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] [instance: 9125364b-332f-4297-815f-3aa1eadaf743] Attaching volume 0c5fa35a-1ba5-4390-9102-83ac1dbb790a to /dev/vdb
Nov 06 15:46:59 user nova-compute[75337]: DEBUG os_brick.utils [None req-3514b2fa-3bd0-4481-a291-209cbd78cb8b tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 15:46:59 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:46:59 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:46:59 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e8be40b-c2b1-4f48-b0fa-70585a1549f0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4ff6411e45b8\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:46:59 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:46:59 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:46:59 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[08cad74f-41a7-4da8-9d01-6c07c6e2c379]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:46:59 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:46:59 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:46:59 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d50b4d3-9a31-468d-9bdf-6feca71cbd8c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:46:59 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d525670-f9bc-4dc6-8f98-c83d6da75193]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:46:59 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-3514b2fa-3bd0-4481-a291-209cbd78cb8b tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] Running cmd (subprocess): nvme version {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:46:59 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-3514b2fa-3bd0-4481-a291-209cbd78cb8b tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] 'nvme version' failed. Not Retrying. {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 15:46:59 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3514b2fa-3bd0-4481-a291-209cbd78cb8b tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] nvme not present on system {{(pid=75337) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 15:46:59 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:46:59 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 15:46:59 user nova-compute[75337]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 15:46:59 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[c824ae0a-93d1-47d5-a2e7-bddf101ae838]: (4, '') {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:46:59 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.lightos [None req-3514b2fa-3bd0-4481-a291-209cbd78cb8b tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75337) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 15:46:59 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.lightos [None req-3514b2fa-3bd0-4481-a291-209cbd78cb8b tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 15:46:59 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.lightos [None req-3514b2fa-3bd0-4481-a291-209cbd78cb8b tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] LIGHTOS: no hostnqn found. {{(pid=75337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 15:46:59 user nova-compute[75337]: DEBUG os_brick.utils [None req-3514b2fa-3bd0-4481-a291-209cbd78cb8b tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4ff6411e45b8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 15:46:59 user nova-compute[75337]: DEBUG nova.virt.block_device [None req-3514b2fa-3bd0-4481-a291-209cbd78cb8b tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] [instance: 9125364b-332f-4297-815f-3aa1eadaf743] Updating existing volume attachment record: 718fd19c-ea16-4f3b-a126-2466c7d750a9 {{(pid=75337) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 15:46:59 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:46:59 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:46:59 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Starting heal instance info cache {{(pid=75337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 15:47:00 user nova-compute[75337]: DEBUG nova.network.neutron [req-0498aab3-deaa-4faa-acca-9d729ec2406c req-08e03bbf-f125-4818-9fca-54c710fac22f service nova] [instance: 9125364b-332f-4297-815f-3aa1eadaf743] Updated VIF entry in instance network info cache for port f38ac99b-98f5-4892-9098-71487faa5282. {{(pid=75337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 15:47:00 user nova-compute[75337]: DEBUG nova.network.neutron [req-0498aab3-deaa-4faa-acca-9d729ec2406c req-08e03bbf-f125-4818-9fca-54c710fac22f service nova] [instance: 9125364b-332f-4297-815f-3aa1eadaf743] Updating instance_info_cache with network_info: [{"id": "f38ac99b-98f5-4892-9098-71487faa5282", "address": "fa:16:3e:d5:76:83", "network": {"id": "d1def424-b3a7-441d-aee5-0a2465f37ecc", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1418475866-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0eca67bcdbde46579049659635e8476b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf38ac99b-98", "ovs_interfaceid": "f38ac99b-98f5-4892-9098-71487faa5282", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:47:00 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-0498aab3-deaa-4faa-acca-9d729ec2406c req-08e03bbf-f125-4818-9fca-54c710fac22f service nova] Releasing lock "refresh_cache-9125364b-332f-4297-815f-3aa1eadaf743" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 15:47:00 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "refresh_cache-581cf468-65e7-42e5-9250-c3d645577011" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 15:47:00 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquired lock "refresh_cache-581cf468-65e7-42e5-9250-c3d645577011" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 15:47:00 user nova-compute[75337]: DEBUG nova.network.neutron [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] [instance: 581cf468-65e7-42e5-9250-c3d645577011] Forcefully refreshing network info cache for instance {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 15:47:01 user nova-compute[75337]: DEBUG nova.network.neutron [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] [instance: 581cf468-65e7-42e5-9250-c3d645577011] Updating instance_info_cache with network_info: [{"id": "d1c68bac-be37-4645-afcb-2b89f47c1793", "address": "fa:16:3e:00:1c:74", "network": {"id": "2623bcbf-c77c-47b4-abd5-ab538f9a2814", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1497688706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f40165c076e341bba42fb537ce98bbe2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1c68bac-be", "ovs_interfaceid": "d1c68bac-be37-4645-afcb-2b89f47c1793", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:47:01 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Releasing lock "refresh_cache-581cf468-65e7-42e5-9250-c3d645577011" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 15:47:01 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] [instance: 581cf468-65e7-42e5-9250-c3d645577011] Updated the network info_cache for instance {{(pid=75337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 15:47:01 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:47:01 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:47:01 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:47:01 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:47:01 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:47:01 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75337) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 15:47:01 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:47:01 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:47:01 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager.update_available_resource {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:47:01 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:47:01 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:47:01 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:47:01 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Auditing locally available compute resources for user (node: user) {{(pid=75337) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 15:47:01 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/477da5ee-3e03-4aa9-9a88-004c442e617a/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:47:01 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/477da5ee-3e03-4aa9-9a88-004c442e617a/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:47:01 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/477da5ee-3e03-4aa9-9a88-004c442e617a/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:47:02 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/477da5ee-3e03-4aa9-9a88-004c442e617a/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:47:02 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afa4e52b-af51-45bf-b619-aeca14e7724d/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:47:02 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afa4e52b-af51-45bf-b619-aeca14e7724d/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:47:02 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afa4e52b-af51-45bf-b619-aeca14e7724d/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:47:02 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afa4e52b-af51-45bf-b619-aeca14e7724d/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:47:02 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/581cf468-65e7-42e5-9250-c3d645577011/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:47:02 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/581cf468-65e7-42e5-9250-c3d645577011/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:47:02 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/581cf468-65e7-42e5-9250-c3d645577011/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:47:02 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/581cf468-65e7-42e5-9250-c3d645577011/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:47:02 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 15:47:02 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 15:47:02 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc0e07f8-2731-4ffa-8446-b71ad3ba7375/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:47:03 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc0e07f8-2731-4ffa-8446-b71ad3ba7375/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:47:03 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc0e07f8-2731-4ffa-8446-b71ad3ba7375/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:47:03 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc0e07f8-2731-4ffa-8446-b71ad3ba7375/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:47:03 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9125364b-332f-4297-815f-3aa1eadaf743/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:47:03 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9125364b-332f-4297-815f-3aa1eadaf743/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:47:03 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9125364b-332f-4297-815f-3aa1eadaf743/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:47:03 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9125364b-332f-4297-815f-3aa1eadaf743/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:47:03 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdced0ba-84ff-42af-baab-e2f3412e1676/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:47:03 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdced0ba-84ff-42af-baab-e2f3412e1676/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:47:03 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdced0ba-84ff-42af-baab-e2f3412e1676/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:47:03 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:47:04 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdced0ba-84ff-42af-baab-e2f3412e1676/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:47:04 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83516ff5-c4e7-4e91-a2f9-8af9b51cf475/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:47:04 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83516ff5-c4e7-4e91-a2f9-8af9b51cf475/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:47:04 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83516ff5-c4e7-4e91-a2f9-8af9b51cf475/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:47:04 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83516ff5-c4e7-4e91-a2f9-8af9b51cf475/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:47:04 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 15:47:04 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 15:47:04 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 15:47:04 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Hypervisor/Node resource view: name=user free_ram=7536MB free_disk=25.19853973388672GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75337) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 15:47:04 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:47:04 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:47:05 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 83516ff5-c4e7-4e91-a2f9-8af9b51cf475 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:47:05 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 1fa4c927-7485-4f34-94bd-9e20358904b6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:47:05 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance cdced0ba-84ff-42af-baab-e2f3412e1676 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:47:05 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 7a6b16de-4506-432f-97f9-f083243dc047 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:47:05 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 581cf468-65e7-42e5-9250-c3d645577011 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:47:05 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 9125364b-332f-4297-815f-3aa1eadaf743 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:47:05 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 477da5ee-3e03-4aa9-9a88-004c442e617a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:47:05 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance bc0e07f8-2731-4ffa-8446-b71ad3ba7375 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:47:05 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance afa4e52b-af51-45bf-b619-aeca14e7724d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:47:05 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 15:47:05 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 15:47:05 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 15:47:05 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 15:47:05 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Compute_service record updated for user:user {{(pid=75337) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 15:47:05 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.503s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:47:06 user nova-compute[75337]: DEBUG nova.compute.manager [req-698f63e3-1766-48ff-aced-1fb5c443df6d req-e71bae6a-c147-4c0e-a85f-231cc7c9fdd4 service nova] [instance: 7a6b16de-4506-432f-97f9-f083243dc047] Received event network-changed-4e4e1bfc-ebf9-41eb-81be-d1c34001dcff {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:47:06 user nova-compute[75337]: DEBUG nova.compute.manager [req-698f63e3-1766-48ff-aced-1fb5c443df6d req-e71bae6a-c147-4c0e-a85f-231cc7c9fdd4 service nova] [instance: 7a6b16de-4506-432f-97f9-f083243dc047] Refreshing instance network info cache due to event network-changed-4e4e1bfc-ebf9-41eb-81be-d1c34001dcff. {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 15:47:06 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-698f63e3-1766-48ff-aced-1fb5c443df6d req-e71bae6a-c147-4c0e-a85f-231cc7c9fdd4 service nova] Acquiring lock "refresh_cache-7a6b16de-4506-432f-97f9-f083243dc047" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 15:47:06 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-698f63e3-1766-48ff-aced-1fb5c443df6d req-e71bae6a-c147-4c0e-a85f-231cc7c9fdd4 service nova] Acquired lock "refresh_cache-7a6b16de-4506-432f-97f9-f083243dc047" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 15:47:06 user nova-compute[75337]: DEBUG nova.network.neutron [req-698f63e3-1766-48ff-aced-1fb5c443df6d req-e71bae6a-c147-4c0e-a85f-231cc7c9fdd4 service nova] [instance: 7a6b16de-4506-432f-97f9-f083243dc047] Refreshing network info cache for port 4e4e1bfc-ebf9-41eb-81be-d1c34001dcff {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 15:47:06 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:47:06 user nova-compute[75337]: DEBUG nova.network.neutron [req-698f63e3-1766-48ff-aced-1fb5c443df6d req-e71bae6a-c147-4c0e-a85f-231cc7c9fdd4 service nova] [instance: 7a6b16de-4506-432f-97f9-f083243dc047] Updated VIF entry in instance network info cache for port 4e4e1bfc-ebf9-41eb-81be-d1c34001dcff. {{(pid=75337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 15:47:06 user nova-compute[75337]: DEBUG nova.network.neutron [req-698f63e3-1766-48ff-aced-1fb5c443df6d req-e71bae6a-c147-4c0e-a85f-231cc7c9fdd4 service nova] [instance: 7a6b16de-4506-432f-97f9-f083243dc047] Updating instance_info_cache with network_info: [{"id": "4e4e1bfc-ebf9-41eb-81be-d1c34001dcff", "address": "fa:16:3e:d1:64:1b", "network": {"id": "ffb95242-a859-4479-a4c8-2b8fa68b53fc", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-976415891-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed8fbcf3ad3c42a08501891748de8abc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e4e1bfc-eb", "ovs_interfaceid": "4e4e1bfc-ebf9-41eb-81be-d1c34001dcff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:47:06 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-698f63e3-1766-48ff-aced-1fb5c443df6d req-e71bae6a-c147-4c0e-a85f-231cc7c9fdd4 service nova] Releasing lock "refresh_cache-7a6b16de-4506-432f-97f9-f083243dc047" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 15:47:07 user nova-compute[75337]: INFO nova.compute.manager [None req-af28426e-8adf-4118-a307-79668cbd99aa tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] [instance: 7a6b16de-4506-432f-97f9-f083243dc047] Rebuilding instance
Nov 06 15:47:07 user nova-compute[75337]: DEBUG nova.compute.manager [None req-af28426e-8adf-4118-a307-79668cbd99aa tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] [instance: 7a6b16de-4506-432f-97f9-f083243dc047] Checking state {{(pid=75337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 15:47:07 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:47:07 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:47:07 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:47:07 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:47:08 user nova-compute[75337]: INFO nova.virt.libvirt.driver [-] [instance: 7a6b16de-4506-432f-97f9-f083243dc047] Instance destroyed successfully.
Nov 06 15:47:08 user nova-compute[75337]: INFO nova.virt.libvirt.driver [-] [instance: 7a6b16de-4506-432f-97f9-f083243dc047] Instance destroyed successfully.
Nov 06 15:47:08 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-af28426e-8adf-4118-a307-79668cbd99aa tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T15:44:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-2022980761',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-154622819',id=14,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOQEIvPwsFtYJCxBuAzGJFBj2NMxdPf9zCY8lR96jqahU4yNb1jUNqLm9D/kbYl6impHm2KGg3eQFdJ96Vvx3tPM5bfUf7AgedT0Ye9qKpHUXm2yidVS0pDcdAVMt/qqDw==',key_name='tempest-keypair-1607456997',keypairs=<?>,launch_index=0,launched_at=2023-11-06T15:45:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ed8fbcf3ad3c42a08501891748de8abc',ramdisk_id='',reservation_id='r-y91vj4ff',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-541966055',owner_user_name='tempest-ServerActionsV293TestJSON-541966055-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T15:47:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='360ca2f8787a424e91dcc73d7c2b5017',uuid=7a6b16de-4506-432f-97f9-f083243dc047,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4e4e1bfc-ebf9-41eb-81be-d1c34001dcff", "address": "fa:16:3e:d1:64:1b", "network": {"id": "ffb95242-a859-4479-a4c8-2b8fa68b53fc", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-976415891-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed8fbcf3ad3c42a08501891748de8abc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e4e1bfc-eb", "ovs_interfaceid": "4e4e1bfc-ebf9-41eb-81be-d1c34001dcff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 15:47:08 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-af28426e-8adf-4118-a307-79668cbd99aa tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] Converting VIF {"id": "4e4e1bfc-ebf9-41eb-81be-d1c34001dcff", "address": "fa:16:3e:d1:64:1b", "network": {"id": "ffb95242-a859-4479-a4c8-2b8fa68b53fc", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-976415891-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed8fbcf3ad3c42a08501891748de8abc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e4e1bfc-eb", "ovs_interfaceid": "4e4e1bfc-ebf9-41eb-81be-d1c34001dcff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 15:47:08 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-af28426e-8adf-4118-a307-79668cbd99aa tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d1:64:1b,bridge_name='br-int',has_traffic_filtering=True,id=4e4e1bfc-ebf9-41eb-81be-d1c34001dcff,network=Network(ffb95242-a859-4479-a4c8-2b8fa68b53fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e4e1bfc-eb') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 15:47:08 user nova-compute[75337]: DEBUG os_vif [None req-af28426e-8adf-4118-a307-79668cbd99aa tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d1:64:1b,bridge_name='br-int',has_traffic_filtering=True,id=4e4e1bfc-ebf9-41eb-81be-d1c34001dcff,network=Network(ffb95242-a859-4479-a4c8-2b8fa68b53fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e4e1bfc-eb') {{(pid=75337) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 15:47:08 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:47:08 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4e4e1bfc-eb, bridge=br-int, if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:47:08 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:47:08 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:47:08 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:47:08 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f91d51cf-557d-4974-8197-e5be2d8c34a1) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:47:08 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:47:08 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:47:08 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:47:08 user nova-compute[75337]: INFO os_vif [None req-af28426e-8adf-4118-a307-79668cbd99aa tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d1:64:1b,bridge_name='br-int',has_traffic_filtering=True,id=4e4e1bfc-ebf9-41eb-81be-d1c34001dcff,network=Network(ffb95242-a859-4479-a4c8-2b8fa68b53fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e4e1bfc-eb')
Nov 06 15:47:08 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af28426e-8adf-4118-a307-79668cbd99aa tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] [instance: 7a6b16de-4506-432f-97f9-f083243dc047] calling os-brick to detach iSCSI Volume {{(pid=75337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 15:47:08 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-af28426e-8adf-4118-a307-79668cbd99aa tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2abc33d0c0>, {'target_iqn': 'iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'maEwpfvl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 15:47:08 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-af28426e-8adf-4118-a307-79668cbd99aa tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 06 15:47:08 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-af28426e-8adf-4118-a307-79668cbd99aa tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 15:47:08 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-af28426e-8adf-4118-a307-79668cbd99aa tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 15:47:08 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:47:08 user nova-compute[75337]: DEBUG nova.compute.manager [req-5cea2bc1-a576-46bd-a7c1-78fd59b9e6f1 req-750808d2-3e01-44e8-9482-f8bb17385c92 service nova] [instance: 7a6b16de-4506-432f-97f9-f083243dc047] Received event network-vif-unplugged-4e4e1bfc-ebf9-41eb-81be-d1c34001dcff {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:47:08 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-5cea2bc1-a576-46bd-a7c1-78fd59b9e6f1 req-750808d2-3e01-44e8-9482-f8bb17385c92 service nova] Acquiring lock "7a6b16de-4506-432f-97f9-f083243dc047-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:47:08 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-5cea2bc1-a576-46bd-a7c1-78fd59b9e6f1 req-750808d2-3e01-44e8-9482-f8bb17385c92 service nova] Lock "7a6b16de-4506-432f-97f9-f083243dc047-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:47:08 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-5cea2bc1-a576-46bd-a7c1-78fd59b9e6f1 req-750808d2-3e01-44e8-9482-f8bb17385c92 service nova] Lock "7a6b16de-4506-432f-97f9-f083243dc047-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:47:08 user nova-compute[75337]: DEBUG nova.compute.manager [req-5cea2bc1-a576-46bd-a7c1-78fd59b9e6f1 req-750808d2-3e01-44e8-9482-f8bb17385c92 service nova] [instance: 7a6b16de-4506-432f-97f9-f083243dc047] No waiting events found dispatching network-vif-unplugged-4e4e1bfc-ebf9-41eb-81be-d1c34001dcff {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:47:08 user nova-compute[75337]: WARNING nova.compute.manager [req-5cea2bc1-a576-46bd-a7c1-78fd59b9e6f1 req-750808d2-3e01-44e8-9482-f8bb17385c92 service nova] [instance: 7a6b16de-4506-432f-97f9-f083243dc047] Received unexpected event network-vif-unplugged-4e4e1bfc-ebf9-41eb-81be-d1c34001dcff for instance with vm_state active and task_state rebuilding.
Nov 06 15:47:08 user nova-compute[75337]: DEBUG nova.compute.manager [req-5cea2bc1-a576-46bd-a7c1-78fd59b9e6f1 req-750808d2-3e01-44e8-9482-f8bb17385c92 service nova] [instance: 7a6b16de-4506-432f-97f9-f083243dc047] Received event network-vif-plugged-4e4e1bfc-ebf9-41eb-81be-d1c34001dcff {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:47:08 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-5cea2bc1-a576-46bd-a7c1-78fd59b9e6f1 req-750808d2-3e01-44e8-9482-f8bb17385c92 service nova] Acquiring lock "7a6b16de-4506-432f-97f9-f083243dc047-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:47:08 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-5cea2bc1-a576-46bd-a7c1-78fd59b9e6f1 req-750808d2-3e01-44e8-9482-f8bb17385c92 service nova] Lock "7a6b16de-4506-432f-97f9-f083243dc047-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:47:08 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-5cea2bc1-a576-46bd-a7c1-78fd59b9e6f1 req-750808d2-3e01-44e8-9482-f8bb17385c92 service nova] Lock "7a6b16de-4506-432f-97f9-f083243dc047-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:47:08 user nova-compute[75337]: DEBUG nova.compute.manager [req-5cea2bc1-a576-46bd-a7c1-78fd59b9e6f1 req-750808d2-3e01-44e8-9482-f8bb17385c92 service nova] [instance: 7a6b16de-4506-432f-97f9-f083243dc047] No waiting events found dispatching network-vif-plugged-4e4e1bfc-ebf9-41eb-81be-d1c34001dcff {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:47:08 user nova-compute[75337]: WARNING nova.compute.manager [req-5cea2bc1-a576-46bd-a7c1-78fd59b9e6f1 req-750808d2-3e01-44e8-9482-f8bb17385c92 service nova] [instance: 7a6b16de-4506-432f-97f9-f083243dc047] Received unexpected event network-vif-plugged-4e4e1bfc-ebf9-41eb-81be-d1c34001dcff for instance with vm_state active and task_state rebuilding.
Nov 06 15:47:08 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:47:08 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8da6fba-0d64-4206-8778-a13000c4c92b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3b520000-6673-4e27-a3e8-770eb33d3751\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:47:08 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-af28426e-8adf-4118-a307-79668cbd99aa tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 15:47:08 user nova-compute[75337]: No targets found.
Nov 06 15:47:08 user nova-compute[75337]: iSNS:
Nov 06 15:47:08 user nova-compute[75337]: No targets found.
Nov 06 15:47:08 user nova-compute[75337]: STATIC:
Nov 06 15:47:08 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e
Nov 06 15:47:08 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 15:47:08 user nova-compute[75337]:                 Iface Name: default
Nov 06 15:47:08 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158
Nov 06 15:47:08 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 15:47:08 user nova-compute[75337]:                 Iface Name: default
Nov 06 15:47:08 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:3b520000-6673-4e27-a3e8-770eb33d3751
Nov 06 15:47:08 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 15:47:08 user nova-compute[75337]:                 Iface Name: default
Nov 06 15:47:08 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6
Nov 06 15:47:08 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 15:47:08 user nova-compute[75337]:                 Iface Name: default
Nov 06 15:47:08 user nova-compute[75337]: FIRMWARE:
Nov 06 15:47:08 user nova-compute[75337]: No targets found.
Nov 06 15:47:08 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 15:47:08 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-af28426e-8adf-4118-a307-79668cbd99aa tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 15:47:08 user nova-compute[75337]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 15:47:08 user nova-compute[75337]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75337) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 15:47:08 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-af28426e-8adf-4118-a307-79668cbd99aa tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6', 0)] {{(pid=75337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 15:47:08 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:47:08 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:47:08 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[2702df49-ce4a-451e-b0a9-0d67e7f1dc5c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b520000-6673-4e27-a3e8-770eb33d3751\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:47:08 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:47:08 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:47:08 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[f97d589e-e42e-4126-961d-d3ba522a620e]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b520000-6673-4e27-a3e8-770eb33d3751 (non-flash)\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:47:08 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-af28426e-8adf-4118-a307-79668cbd99aa tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)
Nov 06 15:47:08 user nova-compute[75337]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e (non-flash)
Nov 06 15:47:08 user nova-compute[75337]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6 (non-flash)
Nov 06 15:47:08 user nova-compute[75337]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b520000-6673-4e27-a3e8-770eb33d3751 (non-flash)
Nov 06 15:47:08 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 15:47:08 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-af28426e-8adf-4118-a307-79668cbd99aa tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)
Nov 06 15:47:08 user nova-compute[75337]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e (non-flash)
Nov 06 15:47:08 user nova-compute[75337]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6 (non-flash)
Nov 06 15:47:08 user nova-compute[75337]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b520000-6673-4e27-a3e8-770eb33d3751 (non-flash)
Nov 06 15:47:08 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 15:47:08 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-af28426e-8adf-4118-a307-79668cbd99aa tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2abc24bac0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6'): ({'sdf'}, set())}) {{(pid=75337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 15:47:08 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-af28426e-8adf-4118-a307-79668cbd99aa tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] Removing single pathed devices sdf {{(pid=75337) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 15:47:08 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:47:08 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:47:08 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[839dbe40-1958-4a93-9935-21bb99cda555]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:47:08 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:47:08 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:47:08 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd986ca7-fe5c-4c91-8d72-d241afeb0c91]: (4, ('ok\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:47:08 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-af28426e-8adf-4118-a307-79668cbd99aa tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] Flushing IO for device /dev/sdf {{(pid=75337) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 15:47:08 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:47:08 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:47:08 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b79facc-c076-43ac-9eb1-f1355b189b86]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:47:08 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-af28426e-8adf-4118-a307-79668cbd99aa tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75337) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 15:47:08 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:47:08 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.045s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:47:08 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cf1b632-fc0e-4410-8821-d51442c77384]: (4, ('1', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:47:08 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-af28426e-8adf-4118-a307-79668cbd99aa tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 15:47:08 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-af28426e-8adf-4118-a307-79668cbd99aa tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] SCSI volumes sdf have been removed. {{(pid=75337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 15:47:08 user nova-compute[75337]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_7aba999f',) {{(pid=86696) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 06 15:47:08 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c412ce4-b7c8-4144-9046-31ea69d7f339]: (4, None) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:47:08 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-af28426e-8adf-4118-a307-79668cbd99aa tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6')] {{(pid=75337) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 15:47:08 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:47:08 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:47:08 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[83b0f0d5-8f0e-4d45-b9bc-2a4fc452119b]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:47:08 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-af28426e-8adf-4118-a307-79668cbd99aa tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:47:08 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6 -p 172.16.0.220:3260 --logout {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:47:08 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:47:08 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[67038057-3037-483e-ba58-c0509130fadf]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:47:08 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-af28426e-8adf-4118-a307-79668cbd99aa tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6, portal: 172.16.0.220,3260]
Nov 06 15:47:08 user nova-compute[75337]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6, portal: 172.16.0.220,3260] successful.
Nov 06 15:47:08 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:47:08 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6 -p 172.16.0.220:3260 --op delete {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:47:08 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:47:08 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea157a1e-c99b-4be8-a46a-8c86e93cbe24]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:47:08 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-af28426e-8adf-4118-a307-79668cbd99aa tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:47:08 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-af28426e-8adf-4118-a307-79668cbd99aa tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.343s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 15:47:08 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-af28426e-8adf-4118-a307-79668cbd99aa tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] <== disconnect_volume: return (345ms) None {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 15:47:08 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af28426e-8adf-4118-a307-79668cbd99aa tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] [instance: 7a6b16de-4506-432f-97f9-f083243dc047] Disconnected iSCSI Volume {{(pid=75337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 15:47:08 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-af28426e-8adf-4118-a307-79668cbd99aa tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] [instance: 7a6b16de-4506-432f-97f9-f083243dc047] Deleting instance files /opt/stack/data/nova/instances/7a6b16de-4506-432f-97f9-f083243dc047_del
Nov 06 15:47:08 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-af28426e-8adf-4118-a307-79668cbd99aa tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] [instance: 7a6b16de-4506-432f-97f9-f083243dc047] Deletion of /opt/stack/data/nova/instances/7a6b16de-4506-432f-97f9-f083243dc047_del complete
Nov 06 15:47:08 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-af28426e-8adf-4118-a307-79668cbd99aa tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] [instance: 7a6b16de-4506-432f-97f9-f083243dc047] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 7a6b16de-4506-432f-97f9-f083243dc047 could not be found.
Nov 06 15:47:08 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af28426e-8adf-4118-a307-79668cbd99aa tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] [instance: 7a6b16de-4506-432f-97f9-f083243dc047] calling os-brick to detach iSCSI Volume {{(pid=75337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 15:47:08 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-af28426e-8adf-4118-a307-79668cbd99aa tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2abc33d0c0>, {'target_iqn': 'iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'maEwpfvl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 15:47:08 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-af28426e-8adf-4118-a307-79668cbd99aa tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 06 15:47:08 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-af28426e-8adf-4118-a307-79668cbd99aa tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 15:47:08 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-af28426e-8adf-4118-a307-79668cbd99aa tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 15:47:08 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:47:08 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:47:08 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[acd13518-6aef-4e0e-bff4-e7ef6f487f6c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3b520000-6673-4e27-a3e8-770eb33d3751\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:47:08 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-af28426e-8adf-4118-a307-79668cbd99aa tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 15:47:08 user nova-compute[75337]: No targets found.
Nov 06 15:47:08 user nova-compute[75337]: iSNS:
Nov 06 15:47:08 user nova-compute[75337]: No targets found.
Nov 06 15:47:08 user nova-compute[75337]: STATIC:
Nov 06 15:47:08 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e
Nov 06 15:47:08 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 15:47:08 user nova-compute[75337]:                 Iface Name: default
Nov 06 15:47:08 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158
Nov 06 15:47:08 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 15:47:08 user nova-compute[75337]:                 Iface Name: default
Nov 06 15:47:08 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:3b520000-6673-4e27-a3e8-770eb33d3751
Nov 06 15:47:08 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 15:47:08 user nova-compute[75337]:                 Iface Name: default
Nov 06 15:47:08 user nova-compute[75337]: FIRMWARE:
Nov 06 15:47:08 user nova-compute[75337]: No targets found.
Nov 06 15:47:08 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 15:47:08 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-af28426e-8adf-4118-a307-79668cbd99aa tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 15:47:08 user nova-compute[75337]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 15:47:08 user nova-compute[75337]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75337) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 15:47:08 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-af28426e-8adf-4118-a307-79668cbd99aa tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6', 0)] {{(pid=75337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 15:47:08 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:47:08 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:47:08 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[b074406a-9df7-4563-b650-95dfb66cda7b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b520000-6673-4e27-a3e8-770eb33d3751\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:47:08 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:47:08 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:47:08 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d78f254-9dfc-46cb-9e90-fef0919c5048]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b520000-6673-4e27-a3e8-770eb33d3751 (non-flash)\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:47:08 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-af28426e-8adf-4118-a307-79668cbd99aa tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)
Nov 06 15:47:08 user nova-compute[75337]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e (non-flash)
Nov 06 15:47:08 user nova-compute[75337]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b520000-6673-4e27-a3e8-770eb33d3751 (non-flash)
Nov 06 15:47:08 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 15:47:08 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-af28426e-8adf-4118-a307-79668cbd99aa tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)
Nov 06 15:47:08 user nova-compute[75337]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e (non-flash)
Nov 06 15:47:08 user nova-compute[75337]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b520000-6673-4e27-a3e8-770eb33d3751 (non-flash)
Nov 06 15:47:08 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 15:47:08 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-af28426e-8adf-4118-a307-79668cbd99aa tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2a9c64d510>, {}) {{(pid=75337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 15:47:08 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-af28426e-8adf-4118-a307-79668cbd99aa tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] Disconnecting from: [] {{(pid=75337) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 15:47:08 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-af28426e-8adf-4118-a307-79668cbd99aa tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.086s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 15:47:08 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-af28426e-8adf-4118-a307-79668cbd99aa tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] <== disconnect_volume: return (88ms) None {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 15:47:08 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af28426e-8adf-4118-a307-79668cbd99aa tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] [instance: 7a6b16de-4506-432f-97f9-f083243dc047] Disconnected iSCSI Volume {{(pid=75337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 15:47:08 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:47:09 user nova-compute[75337]: DEBUG nova.compute.manager [None req-af28426e-8adf-4118-a307-79668cbd99aa tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] [instance: 7a6b16de-4506-432f-97f9-f083243dc047] Preparing to wait for external event volume-reimaged-15793a67-283e-461b-b16a-a42e1b3ea8e6 {{(pid=75337) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Nov 06 15:47:09 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-af28426e-8adf-4118-a307-79668cbd99aa tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] Acquiring lock "7a6b16de-4506-432f-97f9-f083243dc047-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:47:09 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-af28426e-8adf-4118-a307-79668cbd99aa tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] Lock "7a6b16de-4506-432f-97f9-f083243dc047-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:47:09 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-af28426e-8adf-4118-a307-79668cbd99aa tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] Lock "7a6b16de-4506-432f-97f9-f083243dc047-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:47:11 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-9b20725f-14e3-4d3d-8f51-38357a357b25 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance cdced0ba-84ff-42af-baab-e2f3412e1676 is timed out.
Nov 06 15:47:11 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-9b20725f-14e3-4d3d-8f51-38357a357b25 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Successfully detached device vdb from instance cdced0ba-84ff-42af-baab-e2f3412e1676 from the live domain config.
Nov 06 15:47:11 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b20725f-14e3-4d3d-8f51-38357a357b25 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] [instance: cdced0ba-84ff-42af-baab-e2f3412e1676] calling os-brick to detach iSCSI Volume {{(pid=75337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 15:47:11 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b20725f-14e3-4d3d-8f51-38357a357b25 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2abc33d0c0>, {'target_iqn': 'iqn.2010-10.org.openstack:3b520000-6673-4e27-a3e8-770eb33d3751', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HGIxXELq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 15:47:11 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-9b20725f-14e3-4d3d-8f51-38357a357b25 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 15:47:11 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-9b20725f-14e3-4d3d-8f51-38357a357b25 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 15:47:11 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-9b20725f-14e3-4d3d-8f51-38357a357b25 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 15:47:11 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:47:11 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:47:11 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[508d3c16-1574-46c0-bca4-ccc24c2c94ea]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3b520000-6673-4e27-a3e8-770eb33d3751\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:47:11 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b20725f-14e3-4d3d-8f51-38357a357b25 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 15:47:11 user nova-compute[75337]: No targets found.
Nov 06 15:47:11 user nova-compute[75337]: iSNS:
Nov 06 15:47:11 user nova-compute[75337]: No targets found.
Nov 06 15:47:11 user nova-compute[75337]: STATIC:
Nov 06 15:47:11 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e
Nov 06 15:47:11 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 15:47:11 user nova-compute[75337]:                 Iface Name: default
Nov 06 15:47:11 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158
Nov 06 15:47:11 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 15:47:11 user nova-compute[75337]:                 Iface Name: default
Nov 06 15:47:11 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:3b520000-6673-4e27-a3e8-770eb33d3751
Nov 06 15:47:11 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 15:47:11 user nova-compute[75337]:                 Iface Name: default
Nov 06 15:47:11 user nova-compute[75337]: FIRMWARE:
Nov 06 15:47:11 user nova-compute[75337]: No targets found.
Nov 06 15:47:11 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 15:47:11 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b20725f-14e3-4d3d-8f51-38357a357b25 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 15:47:11 user nova-compute[75337]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 15:47:11 user nova-compute[75337]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75337) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 15:47:11 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b20725f-14e3-4d3d-8f51-38357a357b25 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3b520000-6673-4e27-a3e8-770eb33d3751', 0)] {{(pid=75337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 15:47:11 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:47:11 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:47:11 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[711c013d-db57-4429-8116-1b08735e4f82]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b520000-6673-4e27-a3e8-770eb33d3751\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:47:11 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:47:11 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:47:11 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[ace7e7f5-e0ce-4384-b2db-9e9eae7d8622]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b520000-6673-4e27-a3e8-770eb33d3751 (non-flash)\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:47:11 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b20725f-14e3-4d3d-8f51-38357a357b25 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)
Nov 06 15:47:11 user nova-compute[75337]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e (non-flash)
Nov 06 15:47:11 user nova-compute[75337]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b520000-6673-4e27-a3e8-770eb33d3751 (non-flash)
Nov 06 15:47:11 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 15:47:11 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b20725f-14e3-4d3d-8f51-38357a357b25 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)
Nov 06 15:47:11 user nova-compute[75337]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e (non-flash)
Nov 06 15:47:11 user nova-compute[75337]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b520000-6673-4e27-a3e8-770eb33d3751 (non-flash)
Nov 06 15:47:11 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 15:47:11 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b20725f-14e3-4d3d-8f51-38357a357b25 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2a9c5d7250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3b520000-6673-4e27-a3e8-770eb33d3751'): ({'sdd'}, set())}) {{(pid=75337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 15:47:11 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-9b20725f-14e3-4d3d-8f51-38357a357b25 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Removing single pathed devices sdd {{(pid=75337) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 15:47:11 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:47:11 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:47:11 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b1e7f71-99e1-4840-abd5-5a8afb930a0f]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:47:11 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:47:11 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:47:11 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[b232cad9-d44d-4e00-87ac-3388cc5b20b5]: (4, ('ok\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:47:11 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-9b20725f-14e3-4d3d-8f51-38357a357b25 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Flushing IO for device /dev/sdd {{(pid=75337) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 15:47:11 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:47:11 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:47:11 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d0f7c9a-353f-4a46-a7c2-30100919a8f5]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:47:11 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-9b20725f-14e3-4d3d-8f51-38357a357b25 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75337) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 15:47:11 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:47:11 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.044s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:47:11 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[d673f33d-7eea-499a-81e2-b6ef4883ea86]: (4, ('1', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:47:11 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-9b20725f-14e3-4d3d-8f51-38357a357b25 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 15:47:11 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-9b20725f-14e3-4d3d-8f51-38357a357b25 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] SCSI volumes sdd have been removed. {{(pid=75337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 15:47:11 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b20725f-14e3-4d3d-8f51-38357a357b25 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3b520000-6673-4e27-a3e8-770eb33d3751')] {{(pid=75337) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 15:47:11 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b520000-6673-4e27-a3e8-770eb33d3751 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:47:11 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b520000-6673-4e27-a3e8-770eb33d3751 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:47:11 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[489e60bb-d85f-4e80-96f4-6c748a1d2b69]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:47:11 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b20725f-14e3-4d3d-8f51-38357a357b25 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:47:11 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b520000-6673-4e27-a3e8-770eb33d3751 -p 172.16.0.220:3260 --logout {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:47:11 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b520000-6673-4e27-a3e8-770eb33d3751 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:47:11 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b654759-f718-47db-add5-8d96dc673f90]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:3b520000-6673-4e27-a3e8-770eb33d3751, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:3b520000-6673-4e27-a3e8-770eb33d3751, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:47:11 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b20725f-14e3-4d3d-8f51-38357a357b25 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:3b520000-6673-4e27-a3e8-770eb33d3751, portal: 172.16.0.220,3260]
Nov 06 15:47:11 user nova-compute[75337]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:3b520000-6673-4e27-a3e8-770eb33d3751, portal: 172.16.0.220,3260] successful.
Nov 06 15:47:11 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:47:11 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b520000-6673-4e27-a3e8-770eb33d3751 -p 172.16.0.220:3260 --op delete {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:47:11 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b520000-6673-4e27-a3e8-770eb33d3751 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:47:11 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[93501f3a-53a0-4615-b2b8-48faac33c489]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:47:11 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b20725f-14e3-4d3d-8f51-38357a357b25 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:47:11 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-9b20725f-14e3-4d3d-8f51-38357a357b25 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.322s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 15:47:11 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b20725f-14e3-4d3d-8f51-38357a357b25 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] <== disconnect_volume: return (324ms) None {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 15:47:11 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b20725f-14e3-4d3d-8f51-38357a357b25 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] [instance: cdced0ba-84ff-42af-baab-e2f3412e1676] Disconnected iSCSI Volume {{(pid=75337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 15:47:12 user nova-compute[75337]: DEBUG nova.objects.instance [None req-9b20725f-14e3-4d3d-8f51-38357a357b25 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Lazy-loading 'flavor' on Instance uuid cdced0ba-84ff-42af-baab-e2f3412e1676 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 15:47:12 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-9b20725f-14e3-4d3d-8f51-38357a357b25 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Lock "cdced0ba-84ff-42af-baab-e2f3412e1676" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.964s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:47:13 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:47:13 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:47:18 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:47:18 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:47:19 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-8fd034d5-a82e-4546-aa95-82702672a404 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Acquiring lock "b7ececa5-256f-4a5d-aeda-3d2ee5c01cfe" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:47:19 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-8fd034d5-a82e-4546-aa95-82702672a404 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Lock "b7ececa5-256f-4a5d-aeda-3d2ee5c01cfe" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:47:19 user nova-compute[75337]: DEBUG nova.compute.manager [None req-8fd034d5-a82e-4546-aa95-82702672a404 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: b7ececa5-256f-4a5d-aeda-3d2ee5c01cfe] Starting instance... {{(pid=75337) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 15:47:19 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-8fd034d5-a82e-4546-aa95-82702672a404 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:47:19 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-8fd034d5-a82e-4546-aa95-82702672a404 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:47:19 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-8fd034d5-a82e-4546-aa95-82702672a404 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75337) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 15:47:19 user nova-compute[75337]: INFO nova.compute.claims [None req-8fd034d5-a82e-4546-aa95-82702672a404 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: b7ececa5-256f-4a5d-aeda-3d2ee5c01cfe] Claim successful on node user
Nov 06 15:47:20 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-8fd034d5-a82e-4546-aa95-82702672a404 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 15:47:20 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-8fd034d5-a82e-4546-aa95-82702672a404 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 15:47:20 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-8fd034d5-a82e-4546-aa95-82702672a404 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.463s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:47:20 user nova-compute[75337]: DEBUG nova.compute.manager [None req-8fd034d5-a82e-4546-aa95-82702672a404 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: b7ececa5-256f-4a5d-aeda-3d2ee5c01cfe] Start building networks asynchronously for instance. {{(pid=75337) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 15:47:20 user nova-compute[75337]: DEBUG nova.compute.manager [None req-8fd034d5-a82e-4546-aa95-82702672a404 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: b7ececa5-256f-4a5d-aeda-3d2ee5c01cfe] Allocating IP information in the background. {{(pid=75337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 15:47:20 user nova-compute[75337]: DEBUG nova.network.neutron [None req-8fd034d5-a82e-4546-aa95-82702672a404 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: b7ececa5-256f-4a5d-aeda-3d2ee5c01cfe] allocate_for_instance() {{(pid=75337) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 15:47:20 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-8fd034d5-a82e-4546-aa95-82702672a404 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: b7ececa5-256f-4a5d-aeda-3d2ee5c01cfe] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 15:47:20 user nova-compute[75337]: DEBUG nova.compute.manager [None req-8fd034d5-a82e-4546-aa95-82702672a404 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: b7ececa5-256f-4a5d-aeda-3d2ee5c01cfe] Start building block device mappings for instance. {{(pid=75337) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 15:47:20 user nova-compute[75337]: DEBUG nova.policy [None req-8fd034d5-a82e-4546-aa95-82702672a404 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '74090d6e5b354d79bf6ded92e6de56aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb76b5b0f2b24f1c84a92403176bcc00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75337) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 15:47:20 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Acquiring lock "fdda34b5-280f-489d-baf5-bf21ac6dd6c9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:47:20 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Lock "fdda34b5-280f-489d-baf5-bf21ac6dd6c9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:47:20 user nova-compute[75337]: DEBUG nova.compute.manager [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Starting instance... {{(pid=75337) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 15:47:20 user nova-compute[75337]: DEBUG nova.compute.manager [None req-8fd034d5-a82e-4546-aa95-82702672a404 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: b7ececa5-256f-4a5d-aeda-3d2ee5c01cfe] Start spawning the instance on the hypervisor. {{(pid=75337) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 15:47:20 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-8fd034d5-a82e-4546-aa95-82702672a404 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: b7ececa5-256f-4a5d-aeda-3d2ee5c01cfe] Creating instance directory {{(pid=75337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 15:47:20 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-8fd034d5-a82e-4546-aa95-82702672a404 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: b7ececa5-256f-4a5d-aeda-3d2ee5c01cfe] Creating image(s)
Nov 06 15:47:20 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-8fd034d5-a82e-4546-aa95-82702672a404 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Acquiring lock "/opt/stack/data/nova/instances/b7ececa5-256f-4a5d-aeda-3d2ee5c01cfe/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:47:20 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-8fd034d5-a82e-4546-aa95-82702672a404 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Lock "/opt/stack/data/nova/instances/b7ececa5-256f-4a5d-aeda-3d2ee5c01cfe/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:47:20 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-8fd034d5-a82e-4546-aa95-82702672a404 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Lock "/opt/stack/data/nova/instances/b7ececa5-256f-4a5d-aeda-3d2ee5c01cfe/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:47:20 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-8fd034d5-a82e-4546-aa95-82702672a404 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:47:20 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:47:20 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:47:20 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75337) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 15:47:20 user nova-compute[75337]: INFO nova.compute.claims [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Claim successful on node user
Nov 06 15:47:20 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-8fd034d5-a82e-4546-aa95-82702672a404 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json" returned: 0 in 0.183s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:47:20 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-8fd034d5-a82e-4546-aa95-82702672a404 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Acquiring lock "06ba3c914798499e686c5ac75886932347225275" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:47:20 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-8fd034d5-a82e-4546-aa95-82702672a404 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Lock "06ba3c914798499e686c5ac75886932347225275" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:47:20 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-8fd034d5-a82e-4546-aa95-82702672a404 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:47:20 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-8fd034d5-a82e-4546-aa95-82702672a404 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json" returned: 0 in 0.187s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:47:20 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-8fd034d5-a82e-4546-aa95-82702672a404 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275,backing_fmt=raw /opt/stack/data/nova/instances/b7ececa5-256f-4a5d-aeda-3d2ee5c01cfe/disk 1073741824 {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:47:20 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:47:20 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-8fd034d5-a82e-4546-aa95-82702672a404 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275,backing_fmt=raw /opt/stack/data/nova/instances/b7ececa5-256f-4a5d-aeda-3d2ee5c01cfe/disk 1073741824" returned: 0 in 0.056s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:47:20 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-8fd034d5-a82e-4546-aa95-82702672a404 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Lock "06ba3c914798499e686c5ac75886932347225275" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:47:20 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-8fd034d5-a82e-4546-aa95-82702672a404 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:47:21 user nova-compute[75337]: DEBUG nova.network.neutron [None req-8fd034d5-a82e-4546-aa95-82702672a404 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: b7ececa5-256f-4a5d-aeda-3d2ee5c01cfe] Successfully created port: 282f33e8-b542-4d05-bc4d-35e786dcd7ee {{(pid=75337) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 15:47:21 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-8fd034d5-a82e-4546-aa95-82702672a404 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json" returned: 0 in 0.203s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:47:21 user nova-compute[75337]: DEBUG nova.virt.disk.api [None req-8fd034d5-a82e-4546-aa95-82702672a404 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b7ececa5-256f-4a5d-aeda-3d2ee5c01cfe/disk. size=1073741824 {{(pid=75337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 15:47:21 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-8fd034d5-a82e-4546-aa95-82702672a404 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7ececa5-256f-4a5d-aeda-3d2ee5c01cfe/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:47:21 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 15:47:21 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 15:47:21 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.709s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:47:21 user nova-compute[75337]: DEBUG nova.compute.manager [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Start building networks asynchronously for instance. {{(pid=75337) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 15:47:21 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-8fd034d5-a82e-4546-aa95-82702672a404 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7ececa5-256f-4a5d-aeda-3d2ee5c01cfe/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:47:21 user nova-compute[75337]: DEBUG nova.virt.disk.api [None req-8fd034d5-a82e-4546-aa95-82702672a404 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Cannot resize image /opt/stack/data/nova/instances/b7ececa5-256f-4a5d-aeda-3d2ee5c01cfe/disk to a smaller size. {{(pid=75337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 06 15:47:21 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-8fd034d5-a82e-4546-aa95-82702672a404 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: b7ececa5-256f-4a5d-aeda-3d2ee5c01cfe] Created local disks {{(pid=75337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 15:47:21 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-8fd034d5-a82e-4546-aa95-82702672a404 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: b7ececa5-256f-4a5d-aeda-3d2ee5c01cfe] Ensure instance console log exists: /opt/stack/data/nova/instances/b7ececa5-256f-4a5d-aeda-3d2ee5c01cfe/console.log {{(pid=75337) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 15:47:21 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-8fd034d5-a82e-4546-aa95-82702672a404 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:47:21 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-8fd034d5-a82e-4546-aa95-82702672a404 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:47:21 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-8fd034d5-a82e-4546-aa95-82702672a404 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:47:21 user nova-compute[75337]: DEBUG nova.compute.manager [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Allocating IP information in the background. {{(pid=75337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 15:47:21 user nova-compute[75337]: DEBUG nova.network.neutron [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] allocate_for_instance() {{(pid=75337) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 15:47:21 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 15:47:21 user nova-compute[75337]: DEBUG nova.compute.manager [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Start building block device mappings for instance. {{(pid=75337) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 15:47:21 user nova-compute[75337]: INFO nova.virt.block_device [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Booting with volume 06631b49-02a1-4759-8d9b-22b7ebdaa584 at /dev/vda
Nov 06 15:47:21 user nova-compute[75337]: DEBUG nova.policy [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '65a31270ba05411aab57fe42295b1406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7944be2b6e2047f5a633242809f6f04e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75337) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 15:47:21 user nova-compute[75337]: DEBUG os_brick.utils [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 15:47:21 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:47:21 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:47:21 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bd1c7aa-7a56-40bb-ac28-b4d812ef7ee5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4ff6411e45b8\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:47:21 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:47:21 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:47:21 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[e91bdce4-b8f9-4aaf-b258-94436b8642b4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:47:21 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:47:21 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:47:21 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac614b94-8139-4151-ad9c-de543e09acd6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:47:21 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d2957f9-8abb-415b-98bd-bb877126b785]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:47:21 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Running cmd (subprocess): nvme version {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:47:21 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] 'nvme version' failed. Not Retrying. {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 15:47:21 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] nvme not present on system {{(pid=75337) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 15:47:21 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:47:21 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 15:47:21 user nova-compute[75337]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 15:47:21 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[f32fcc6e-0e81-41c1-b4cb-67cad4f5e9a7]: (4, '') {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:47:21 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.lightos [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75337) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 15:47:21 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.lightos [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 15:47:21 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.lightos [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] LIGHTOS: no hostnqn found. {{(pid=75337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 15:47:21 user nova-compute[75337]: DEBUG os_brick.utils [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4ff6411e45b8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 15:47:21 user nova-compute[75337]: DEBUG nova.virt.block_device [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Updating existing volume attachment record: ad7b03b5-a814-43a3-9515-0a39e1ed6262 {{(pid=75337) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 15:47:21 user nova-compute[75337]: DEBUG nova.network.neutron [None req-8fd034d5-a82e-4546-aa95-82702672a404 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: b7ececa5-256f-4a5d-aeda-3d2ee5c01cfe] Successfully updated port: 282f33e8-b542-4d05-bc4d-35e786dcd7ee {{(pid=75337) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 15:47:21 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-8fd034d5-a82e-4546-aa95-82702672a404 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Acquiring lock "refresh_cache-b7ececa5-256f-4a5d-aeda-3d2ee5c01cfe" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 15:47:21 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-8fd034d5-a82e-4546-aa95-82702672a404 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Acquired lock "refresh_cache-b7ececa5-256f-4a5d-aeda-3d2ee5c01cfe" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 15:47:21 user nova-compute[75337]: DEBUG nova.network.neutron [None req-8fd034d5-a82e-4546-aa95-82702672a404 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: b7ececa5-256f-4a5d-aeda-3d2ee5c01cfe] Building network info cache for instance {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 15:47:21 user nova-compute[75337]: DEBUG nova.compute.manager [req-48a2d7df-c232-49e0-8ee7-cfbfd93c9cd7 req-18483910-b017-4942-a7c3-7d66add734b4 service nova] [instance: b7ececa5-256f-4a5d-aeda-3d2ee5c01cfe] Received event network-changed-282f33e8-b542-4d05-bc4d-35e786dcd7ee {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:47:21 user nova-compute[75337]: DEBUG nova.compute.manager [req-48a2d7df-c232-49e0-8ee7-cfbfd93c9cd7 req-18483910-b017-4942-a7c3-7d66add734b4 service nova] [instance: b7ececa5-256f-4a5d-aeda-3d2ee5c01cfe] Refreshing instance network info cache due to event network-changed-282f33e8-b542-4d05-bc4d-35e786dcd7ee. {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 15:47:21 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-48a2d7df-c232-49e0-8ee7-cfbfd93c9cd7 req-18483910-b017-4942-a7c3-7d66add734b4 service nova] Acquiring lock "refresh_cache-b7ececa5-256f-4a5d-aeda-3d2ee5c01cfe" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 15:47:21 user nova-compute[75337]: DEBUG nova.network.neutron [None req-8fd034d5-a82e-4546-aa95-82702672a404 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: b7ececa5-256f-4a5d-aeda-3d2ee5c01cfe] Instance cache missing network info. {{(pid=75337) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 15:47:22 user nova-compute[75337]: DEBUG nova.network.neutron [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Successfully created port: ee068b96-f361-4cb1-afeb-d3db42848f50 {{(pid=75337) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 15:47:22 user nova-compute[75337]: DEBUG nova.network.neutron [None req-8fd034d5-a82e-4546-aa95-82702672a404 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: b7ececa5-256f-4a5d-aeda-3d2ee5c01cfe] Updating instance_info_cache with network_info: [{"id": "282f33e8-b542-4d05-bc4d-35e786dcd7ee", "address": "fa:16:3e:bb:32:22", "network": {"id": "736be000-ee94-41fd-9de0-f2f885ec9be7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1715443852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb76b5b0f2b24f1c84a92403176bcc00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap282f33e8-b5", "ovs_interfaceid": "282f33e8-b542-4d05-bc4d-35e786dcd7ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:47:22 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-8fd034d5-a82e-4546-aa95-82702672a404 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Releasing lock "refresh_cache-b7ececa5-256f-4a5d-aeda-3d2ee5c01cfe" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 15:47:22 user nova-compute[75337]: DEBUG nova.compute.manager [None req-8fd034d5-a82e-4546-aa95-82702672a404 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: b7ececa5-256f-4a5d-aeda-3d2ee5c01cfe] Instance network_info: |[{"id": "282f33e8-b542-4d05-bc4d-35e786dcd7ee", "address": "fa:16:3e:bb:32:22", "network": {"id": "736be000-ee94-41fd-9de0-f2f885ec9be7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1715443852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb76b5b0f2b24f1c84a92403176bcc00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap282f33e8-b5", "ovs_interfaceid": "282f33e8-b542-4d05-bc4d-35e786dcd7ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 15:47:22 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-48a2d7df-c232-49e0-8ee7-cfbfd93c9cd7 req-18483910-b017-4942-a7c3-7d66add734b4 service nova] Acquired lock "refresh_cache-b7ececa5-256f-4a5d-aeda-3d2ee5c01cfe" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 15:47:22 user nova-compute[75337]: DEBUG nova.network.neutron [req-48a2d7df-c232-49e0-8ee7-cfbfd93c9cd7 req-18483910-b017-4942-a7c3-7d66add734b4 service nova] [instance: b7ececa5-256f-4a5d-aeda-3d2ee5c01cfe] Refreshing network info cache for port 282f33e8-b542-4d05-bc4d-35e786dcd7ee {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 15:47:22 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-8fd034d5-a82e-4546-aa95-82702672a404 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: b7ececa5-256f-4a5d-aeda-3d2ee5c01cfe] Start _get_guest_xml network_info=[{"id": "282f33e8-b542-4d05-bc4d-35e786dcd7ee", "address": "fa:16:3e:bb:32:22", "network": {"id": "736be000-ee94-41fd-9de0-f2f885ec9be7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1715443852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb76b5b0f2b24f1c84a92403176bcc00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap282f33e8-b5", "ovs_interfaceid": "282f33e8-b542-4d05-bc4d-35e786dcd7ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T15:34:14Z,direct_url=<?>,disk_format='qcow2',id=16b903ae-a40f-41a7-985b-4804cce92c62,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6549a15819f1469bbd5eeae8190e3d44',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T15:34:15Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'guest_format': None, 'size': 0, 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '16b903ae-a40f-41a7-985b-4804cce92c62'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 15:47:22 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-8fd034d5-a82e-4546-aa95-82702672a404 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 15:47:22 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-8fd034d5-a82e-4546-aa95-82702672a404 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 15:47:22 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-8fd034d5-a82e-4546-aa95-82702672a404 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 15:47:22 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-8fd034d5-a82e-4546-aa95-82702672a404 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] CPU controller missing on host. {{(pid=75337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 15:47:22 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-8fd034d5-a82e-4546-aa95-82702672a404 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 15:47:22 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-8fd034d5-a82e-4546-aa95-82702672a404 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] CPU controller found on host. {{(pid=75337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 15:47:22 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-8fd034d5-a82e-4546-aa95-82702672a404 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75337) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 15:47:22 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-8fd034d5-a82e-4546-aa95-82702672a404 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T15:34:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T15:34:14Z,direct_url=<?>,disk_format='qcow2',id=16b903ae-a40f-41a7-985b-4804cce92c62,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6549a15819f1469bbd5eeae8190e3d44',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T15:34:15Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 15:47:22 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-8fd034d5-a82e-4546-aa95-82702672a404 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Flavor limits 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 15:47:22 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-8fd034d5-a82e-4546-aa95-82702672a404 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Image limits 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 15:47:22 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-8fd034d5-a82e-4546-aa95-82702672a404 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Flavor pref 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 15:47:22 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-8fd034d5-a82e-4546-aa95-82702672a404 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Image pref 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 15:47:22 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-8fd034d5-a82e-4546-aa95-82702672a404 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 15:47:22 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-8fd034d5-a82e-4546-aa95-82702672a404 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 15:47:22 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-8fd034d5-a82e-4546-aa95-82702672a404 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 15:47:22 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-8fd034d5-a82e-4546-aa95-82702672a404 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Got 1 possible topologies {{(pid=75337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 15:47:22 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-8fd034d5-a82e-4546-aa95-82702672a404 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 15:47:22 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-8fd034d5-a82e-4546-aa95-82702672a404 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 15:47:22 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-8fd034d5-a82e-4546-aa95-82702672a404 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T15:47:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1878925471',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1878925471',id=20,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eb76b5b0f2b24f1c84a92403176bcc00',ramdisk_id='',reservation_id='r-e0xj1xrk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2044295020',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T15:47:20Z,user_data=None,user_id='74090d6e5b354d79bf6ded92e6de56aa',uuid=b7ececa5-256f-4a5d-aeda-3d2ee5c01cfe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "282f33e8-b542-4d05-bc4d-35e786dcd7ee", "address": "fa:16:3e:bb:32:22", "network": {"id": "736be000-ee94-41fd-9de0-f2f885ec9be7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1715443852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb76b5b0f2b24f1c84a92403176bcc00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap282f33e8-b5", "ovs_interfaceid": "282f33e8-b542-4d05-bc4d-35e786dcd7ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75337) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 15:47:22 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-8fd034d5-a82e-4546-aa95-82702672a404 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Converting VIF {"id": "282f33e8-b542-4d05-bc4d-35e786dcd7ee", "address": "fa:16:3e:bb:32:22", "network": {"id": "736be000-ee94-41fd-9de0-f2f885ec9be7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1715443852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb76b5b0f2b24f1c84a92403176bcc00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap282f33e8-b5", "ovs_interfaceid": "282f33e8-b542-4d05-bc4d-35e786dcd7ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 15:47:22 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-8fd034d5-a82e-4546-aa95-82702672a404 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:32:22,bridge_name='br-int',has_traffic_filtering=True,id=282f33e8-b542-4d05-bc4d-35e786dcd7ee,network=Network(736be000-ee94-41fd-9de0-f2f885ec9be7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap282f33e8-b5') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 15:47:22 user nova-compute[75337]: DEBUG nova.objects.instance [None req-8fd034d5-a82e-4546-aa95-82702672a404 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Lazy-loading 'pci_devices' on Instance uuid b7ececa5-256f-4a5d-aeda-3d2ee5c01cfe {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 15:47:22 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-8fd034d5-a82e-4546-aa95-82702672a404 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: b7ececa5-256f-4a5d-aeda-3d2ee5c01cfe] End _get_guest_xml xml=<domain type="kvm">
Nov 06 15:47:22 user nova-compute[75337]:   <uuid>b7ececa5-256f-4a5d-aeda-3d2ee5c01cfe</uuid>
Nov 06 15:47:22 user nova-compute[75337]:   <name>instance-00000014</name>
Nov 06 15:47:22 user nova-compute[75337]:   <memory>524288</memory>
Nov 06 15:47:22 user nova-compute[75337]:   <vcpu>1</vcpu>
Nov 06 15:47:22 user nova-compute[75337]:   <metadata>
Nov 06 15:47:22 user nova-compute[75337]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 15:47:22 user nova-compute[75337]:       <nova:package version="0.0.0"/>
Nov 06 15:47:22 user nova-compute[75337]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1878925471</nova:name>
Nov 06 15:47:22 user nova-compute[75337]:       <nova:creationTime>2023-11-06 15:47:22</nova:creationTime>
Nov 06 15:47:22 user nova-compute[75337]:       <nova:flavor name="m1.tiny">
Nov 06 15:47:22 user nova-compute[75337]:         <nova:memory>512</nova:memory>
Nov 06 15:47:22 user nova-compute[75337]:         <nova:disk>1</nova:disk>
Nov 06 15:47:22 user nova-compute[75337]:         <nova:swap>0</nova:swap>
Nov 06 15:47:22 user nova-compute[75337]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 15:47:22 user nova-compute[75337]:         <nova:vcpus>1</nova:vcpus>
Nov 06 15:47:22 user nova-compute[75337]:       </nova:flavor>
Nov 06 15:47:22 user nova-compute[75337]:       <nova:owner>
Nov 06 15:47:22 user nova-compute[75337]:         <nova:user uuid="74090d6e5b354d79bf6ded92e6de56aa">tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member</nova:user>
Nov 06 15:47:22 user nova-compute[75337]:         <nova:project uuid="eb76b5b0f2b24f1c84a92403176bcc00">tempest-ServerBootFromVolumeStableRescueTest-2044295020</nova:project>
Nov 06 15:47:22 user nova-compute[75337]:       </nova:owner>
Nov 06 15:47:22 user nova-compute[75337]:       <nova:root type="image" uuid="16b903ae-a40f-41a7-985b-4804cce92c62"/>
Nov 06 15:47:22 user nova-compute[75337]:       <nova:ports>
Nov 06 15:47:22 user nova-compute[75337]:         <nova:port uuid="282f33e8-b542-4d05-bc4d-35e786dcd7ee">
Nov 06 15:47:22 user nova-compute[75337]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 06 15:47:22 user nova-compute[75337]:         </nova:port>
Nov 06 15:47:22 user nova-compute[75337]:       </nova:ports>
Nov 06 15:47:22 user nova-compute[75337]:     </nova:instance>
Nov 06 15:47:22 user nova-compute[75337]:   </metadata>
Nov 06 15:47:22 user nova-compute[75337]:   <sysinfo type="smbios">
Nov 06 15:47:22 user nova-compute[75337]:     <system>
Nov 06 15:47:22 user nova-compute[75337]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 15:47:22 user nova-compute[75337]:       <entry name="product">OpenStack Nova</entry>
Nov 06 15:47:22 user nova-compute[75337]:       <entry name="version">0.0.0</entry>
Nov 06 15:47:22 user nova-compute[75337]:       <entry name="serial">b7ececa5-256f-4a5d-aeda-3d2ee5c01cfe</entry>
Nov 06 15:47:22 user nova-compute[75337]:       <entry name="uuid">b7ececa5-256f-4a5d-aeda-3d2ee5c01cfe</entry>
Nov 06 15:47:22 user nova-compute[75337]:       <entry name="family">Virtual Machine</entry>
Nov 06 15:47:22 user nova-compute[75337]:     </system>
Nov 06 15:47:22 user nova-compute[75337]:   </sysinfo>
Nov 06 15:47:22 user nova-compute[75337]:   <os>
Nov 06 15:47:22 user nova-compute[75337]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 15:47:22 user nova-compute[75337]:     <boot dev="hd"/>
Nov 06 15:47:22 user nova-compute[75337]:     <smbios mode="sysinfo"/>
Nov 06 15:47:22 user nova-compute[75337]:   </os>
Nov 06 15:47:22 user nova-compute[75337]:   <features>
Nov 06 15:47:22 user nova-compute[75337]:     <acpi/>
Nov 06 15:47:22 user nova-compute[75337]:     <apic/>
Nov 06 15:47:22 user nova-compute[75337]:     <vmcoreinfo/>
Nov 06 15:47:22 user nova-compute[75337]:   </features>
Nov 06 15:47:22 user nova-compute[75337]:   <clock offset="utc">
Nov 06 15:47:22 user nova-compute[75337]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 15:47:22 user nova-compute[75337]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 15:47:22 user nova-compute[75337]:     <timer name="hpet" present="no"/>
Nov 06 15:47:22 user nova-compute[75337]:   </clock>
Nov 06 15:47:22 user nova-compute[75337]:   <cpu mode="custom" match="exact">
Nov 06 15:47:22 user nova-compute[75337]:     <model>Nehalem</model>
Nov 06 15:47:22 user nova-compute[75337]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 15:47:22 user nova-compute[75337]:   </cpu>
Nov 06 15:47:22 user nova-compute[75337]:   <devices>
Nov 06 15:47:22 user nova-compute[75337]:     <disk type="file" device="disk">
Nov 06 15:47:22 user nova-compute[75337]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 15:47:22 user nova-compute[75337]:       <source file="/opt/stack/data/nova/instances/b7ececa5-256f-4a5d-aeda-3d2ee5c01cfe/disk"/>
Nov 06 15:47:22 user nova-compute[75337]:       <target dev="vda" bus="virtio"/>
Nov 06 15:47:22 user nova-compute[75337]:     </disk>
Nov 06 15:47:22 user nova-compute[75337]:     <interface type="ethernet">
Nov 06 15:47:22 user nova-compute[75337]:       <mac address="fa:16:3e:bb:32:22"/>
Nov 06 15:47:22 user nova-compute[75337]:       <model type="virtio"/>
Nov 06 15:47:22 user nova-compute[75337]:       <mtu size="1442"/>
Nov 06 15:47:22 user nova-compute[75337]:       <target dev="tap282f33e8-b5"/>
Nov 06 15:47:22 user nova-compute[75337]:     </interface>
Nov 06 15:47:22 user nova-compute[75337]:     <serial type="pty">
Nov 06 15:47:22 user nova-compute[75337]:       <log file="/opt/stack/data/nova/instances/b7ececa5-256f-4a5d-aeda-3d2ee5c01cfe/console.log" append="off"/>
Nov 06 15:47:22 user nova-compute[75337]:     </serial>
Nov 06 15:47:22 user nova-compute[75337]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 15:47:22 user nova-compute[75337]:     <video>
Nov 06 15:47:22 user nova-compute[75337]:       <model type="virtio"/>
Nov 06 15:47:22 user nova-compute[75337]:     </video>
Nov 06 15:47:22 user nova-compute[75337]:     <rng model="virtio">
Nov 06 15:47:22 user nova-compute[75337]:       <backend model="random">/dev/urandom</backend>
Nov 06 15:47:22 user nova-compute[75337]:     </rng>
Nov 06 15:47:22 user nova-compute[75337]:     <controller type="usb" index="0" model="none"/>
Nov 06 15:47:22 user nova-compute[75337]:     <memballoon model="virtio">
Nov 06 15:47:22 user nova-compute[75337]:       <stats period="10"/>
Nov 06 15:47:22 user nova-compute[75337]:     </memballoon>
Nov 06 15:47:22 user nova-compute[75337]:   </devices>
Nov 06 15:47:22 user nova-compute[75337]: </domain>
Nov 06 15:47:22 user nova-compute[75337]:  {{(pid=75337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 15:47:22 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-8fd034d5-a82e-4546-aa95-82702672a404 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T15:47:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1878925471',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1878925471',id=20,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eb76b5b0f2b24f1c84a92403176bcc00',ramdisk_id='',reservation_id='r-e0xj1xrk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2044295020',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T15:47:20Z,user_data=None,user_id='74090d6e5b354d79bf6ded92e6de56aa',uuid=b7ececa5-256f-4a5d-aeda-3d2ee5c01cfe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "282f33e8-b542-4d05-bc4d-35e786dcd7ee", "address": "fa:16:3e:bb:32:22", "network": {"id": "736be000-ee94-41fd-9de0-f2f885ec9be7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1715443852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb76b5b0f2b24f1c84a92403176bcc00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap282f33e8-b5", "ovs_interfaceid": "282f33e8-b542-4d05-bc4d-35e786dcd7ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 15:47:22 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-8fd034d5-a82e-4546-aa95-82702672a404 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Converting VIF {"id": "282f33e8-b542-4d05-bc4d-35e786dcd7ee", "address": "fa:16:3e:bb:32:22", "network": {"id": "736be000-ee94-41fd-9de0-f2f885ec9be7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1715443852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb76b5b0f2b24f1c84a92403176bcc00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap282f33e8-b5", "ovs_interfaceid": "282f33e8-b542-4d05-bc4d-35e786dcd7ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 15:47:22 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-8fd034d5-a82e-4546-aa95-82702672a404 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:32:22,bridge_name='br-int',has_traffic_filtering=True,id=282f33e8-b542-4d05-bc4d-35e786dcd7ee,network=Network(736be000-ee94-41fd-9de0-f2f885ec9be7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap282f33e8-b5') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 15:47:22 user nova-compute[75337]: DEBUG os_vif [None req-8fd034d5-a82e-4546-aa95-82702672a404 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:32:22,bridge_name='br-int',has_traffic_filtering=True,id=282f33e8-b542-4d05-bc4d-35e786dcd7ee,network=Network(736be000-ee94-41fd-9de0-f2f885ec9be7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap282f33e8-b5') {{(pid=75337) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 15:47:22 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:47:22 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:47:22 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 15:47:22 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:47:22 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cee2e988-7173-5b24-acb1-08d2a9c5dcf9', '_type': 'linux-noop'}}, row=False) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:47:22 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:47:22 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:47:22 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:47:22 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap282f33e8-b5, may_exist=True, interface_attrs={}) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:47:22 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap282f33e8-b5, col_values=(('qos', UUID('6301c862-c15d-4d6c-b9a2-495ac3b37ac8')),), if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:47:22 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap282f33e8-b5, col_values=(('external_ids', {'iface-id': '282f33e8-b542-4d05-bc4d-35e786dcd7ee', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bb:32:22', 'vm-uuid': 'b7ececa5-256f-4a5d-aeda-3d2ee5c01cfe'}),), if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:47:22 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:47:22 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:47:22 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:47:22 user nova-compute[75337]: INFO os_vif [None req-8fd034d5-a82e-4546-aa95-82702672a404 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:32:22,bridge_name='br-int',has_traffic_filtering=True,id=282f33e8-b542-4d05-bc4d-35e786dcd7ee,network=Network(736be000-ee94-41fd-9de0-f2f885ec9be7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap282f33e8-b5')
Nov 06 15:47:22 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-8fd034d5-a82e-4546-aa95-82702672a404 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] No BDM found with device name vda, not building metadata. {{(pid=75337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 15:47:22 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-8fd034d5-a82e-4546-aa95-82702672a404 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] No VIF found with MAC fa:16:3e:bb:32:22, not building metadata {{(pid=75337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 15:47:22 user nova-compute[75337]: DEBUG nova.network.neutron [req-48a2d7df-c232-49e0-8ee7-cfbfd93c9cd7 req-18483910-b017-4942-a7c3-7d66add734b4 service nova] [instance: b7ececa5-256f-4a5d-aeda-3d2ee5c01cfe] Updated VIF entry in instance network info cache for port 282f33e8-b542-4d05-bc4d-35e786dcd7ee. {{(pid=75337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 15:47:22 user nova-compute[75337]: DEBUG nova.network.neutron [req-48a2d7df-c232-49e0-8ee7-cfbfd93c9cd7 req-18483910-b017-4942-a7c3-7d66add734b4 service nova] [instance: b7ececa5-256f-4a5d-aeda-3d2ee5c01cfe] Updating instance_info_cache with network_info: [{"id": "282f33e8-b542-4d05-bc4d-35e786dcd7ee", "address": "fa:16:3e:bb:32:22", "network": {"id": "736be000-ee94-41fd-9de0-f2f885ec9be7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1715443852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb76b5b0f2b24f1c84a92403176bcc00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap282f33e8-b5", "ovs_interfaceid": "282f33e8-b542-4d05-bc4d-35e786dcd7ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:47:22 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-48a2d7df-c232-49e0-8ee7-cfbfd93c9cd7 req-18483910-b017-4942-a7c3-7d66add734b4 service nova] Releasing lock "refresh_cache-b7ececa5-256f-4a5d-aeda-3d2ee5c01cfe" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 15:47:22 user nova-compute[75337]: DEBUG nova.network.neutron [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Successfully created port: 38a409f9-0fb9-4505-9f74-bf2859e6f66c {{(pid=75337) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 15:47:23 user nova-compute[75337]: DEBUG nova.network.neutron [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Successfully created port: d86aca21-e67b-48e9-b8de-a1d618a5dfc7 {{(pid=75337) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 15:47:23 user nova-compute[75337]: DEBUG nova.network.neutron [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Successfully created port: 4c56104b-528f-40b8-931d-7619e413ab07 {{(pid=75337) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 15:47:23 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:47:23 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:47:23 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:47:23 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:47:23 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:47:24 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:47:24 user nova-compute[75337]: DEBUG nova.compute.manager [req-3acf44b6-72e1-4797-ae26-03a4c6566a1b req-23ac67bc-55d4-486f-9a8c-6a2da40a6d06 service nova] [instance: b7ececa5-256f-4a5d-aeda-3d2ee5c01cfe] Received event network-vif-plugged-282f33e8-b542-4d05-bc4d-35e786dcd7ee {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:47:24 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-3acf44b6-72e1-4797-ae26-03a4c6566a1b req-23ac67bc-55d4-486f-9a8c-6a2da40a6d06 service nova] Acquiring lock "b7ececa5-256f-4a5d-aeda-3d2ee5c01cfe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:47:24 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-3acf44b6-72e1-4797-ae26-03a4c6566a1b req-23ac67bc-55d4-486f-9a8c-6a2da40a6d06 service nova] Lock "b7ececa5-256f-4a5d-aeda-3d2ee5c01cfe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:47:24 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-3acf44b6-72e1-4797-ae26-03a4c6566a1b req-23ac67bc-55d4-486f-9a8c-6a2da40a6d06 service nova] Lock "b7ececa5-256f-4a5d-aeda-3d2ee5c01cfe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:47:24 user nova-compute[75337]: DEBUG nova.compute.manager [req-3acf44b6-72e1-4797-ae26-03a4c6566a1b req-23ac67bc-55d4-486f-9a8c-6a2da40a6d06 service nova] [instance: b7ececa5-256f-4a5d-aeda-3d2ee5c01cfe] No waiting events found dispatching network-vif-plugged-282f33e8-b542-4d05-bc4d-35e786dcd7ee {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:47:24 user nova-compute[75337]: WARNING nova.compute.manager [req-3acf44b6-72e1-4797-ae26-03a4c6566a1b req-23ac67bc-55d4-486f-9a8c-6a2da40a6d06 service nova] [instance: b7ececa5-256f-4a5d-aeda-3d2ee5c01cfe] Received unexpected event network-vif-plugged-282f33e8-b542-4d05-bc4d-35e786dcd7ee for instance with vm_state building and task_state spawning.
Nov 06 15:47:24 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:47:24 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3514b2fa-3bd0-4481-a291-209cbd78cb8b tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] [instance: 9125364b-332f-4297-815f-3aa1eadaf743] Calling os-brick to attach iSCSI Volume {{(pid=75337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 15:47:24 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-3514b2fa-3bd0-4481-a291-209cbd78cb8b tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2abc33d0c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0c5fa35a-1ba5-4390-9102-83ac1dbb790a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nkapcTJV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 15:47:24 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-3514b2fa-3bd0-4481-a291-209cbd78cb8b tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 15:47:24 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-3514b2fa-3bd0-4481-a291-209cbd78cb8b tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 15:47:24 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-3514b2fa-3bd0-4481-a291-209cbd78cb8b tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 15:47:24 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-3514b2fa-3bd0-4481-a291-209cbd78cb8b tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 15:47:24 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-3514b2fa-3bd0-4481-a291-209cbd78cb8b tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0c5fa35a-1ba5-4390-9102-83ac1dbb790a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 15:47:24 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-3514b2fa-3bd0-4481-a291-209cbd78cb8b tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0c5fa35a-1ba5-4390-9102-83ac1dbb790a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 15:47:24 user nova-compute[75337]: INFO os_brick.initiator.connectors.iscsi [None req-3514b2fa-3bd0-4481-a291-209cbd78cb8b tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 15:47:24 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c5fa35a-1ba5-4390-9102-83ac1dbb790a -p 172.16.0.220:3260 {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:47:24 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c5fa35a-1ba5-4390-9102-83ac1dbb790a -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:47:24 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e007735-594d-4f61-9e9a-83282aa61095]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:47:24 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-3514b2fa-3bd0-4481-a291-209cbd78cb8b tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 15:47:24 user nova-compute[75337]:  {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:47:24 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c5fa35a-1ba5-4390-9102-83ac1dbb790a -p 172.16.0.220:3260 --interface default --op new {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:47:24 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c5fa35a-1ba5-4390-9102-83ac1dbb790a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:47:24 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9a2fdf7-88d0-499a-b56e-c494bb178856]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0c5fa35a-1ba5-4390-9102-83ac1dbb790a] added\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:47:24 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-3514b2fa-3bd0-4481-a291-209cbd78cb8b tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0c5fa35a-1ba5-4390-9102-83ac1dbb790a] added
Nov 06 15:47:24 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:47:24 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c5fa35a-1ba5-4390-9102-83ac1dbb790a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:47:24 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c5fa35a-1ba5-4390-9102-83ac1dbb790a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:47:24 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[a516818b-7e32-49a3-ba0b-8d3f186e14d6]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:47:24 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-3514b2fa-3bd0-4481-a291-209cbd78cb8b tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:47:24 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c5fa35a-1ba5-4390-9102-83ac1dbb790a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:47:24 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c5fa35a-1ba5-4390-9102-83ac1dbb790a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:47:24 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[690af0a3-0656-4501-aaaf-69edb0d506fa]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:47:24 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-3514b2fa-3bd0-4481-a291-209cbd78cb8b tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:47:24 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c5fa35a-1ba5-4390-9102-83ac1dbb790a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nkapcTJV {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:47:24 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c5fa35a-1ba5-4390-9102-83ac1dbb790a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nkapcTJV" returned: 0 in 0.032s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:47:24 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[6984de0f-5a92-4182-a249-c48fbbeeddc9]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:47:24 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-3514b2fa-3bd0-4481-a291-209cbd78cb8b tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nkapcTJV'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:47:24 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c5fa35a-1ba5-4390-9102-83ac1dbb790a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:47:24 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c5fa35a-1ba5-4390-9102-83ac1dbb790a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:47:24 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed33a6a7-9e05-4b40-b3bd-42fecf8f2ab2]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:47:24 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-3514b2fa-3bd0-4481-a291-209cbd78cb8b tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:47:24 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:47:24 user nova-compute[75337]: DEBUG nova.network.neutron [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Successfully created port: 996e784d-bbe6-447b-8f1f-066ec34be989 {{(pid=75337) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 15:47:24 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:47:24 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[d86885de-6af9-43f0-bee9-59a4e30d2d00]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e (non-flash)\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:47:24 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-3514b2fa-3bd0-4481-a291-209cbd78cb8b tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)
Nov 06 15:47:24 user nova-compute[75337]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e (non-flash)
Nov 06 15:47:24 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 15:47:24 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-3514b2fa-3bd0-4481-a291-209cbd78cb8b tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)
Nov 06 15:47:24 user nova-compute[75337]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e (non-flash)
Nov 06 15:47:24 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 15:47:24 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c5fa35a-1ba5-4390-9102-83ac1dbb790a -p 172.16.0.220:3260 --login {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:47:24 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c5fa35a-1ba5-4390-9102-83ac1dbb790a -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:47:24 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b950033-0633-443b-b9de-48be1d50ff25]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0c5fa35a-1ba5-4390-9102-83ac1dbb790a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0c5fa35a-1ba5-4390-9102-83ac1dbb790a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:47:24 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-3514b2fa-3bd0-4481-a291-209cbd78cb8b tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0c5fa35a-1ba5-4390-9102-83ac1dbb790a, portal: 172.16.0.220,3260]
Nov 06 15:47:24 user nova-compute[75337]: Login to [iface: default, target: iqn.2010-10.org.openstack:0c5fa35a-1ba5-4390-9102-83ac1dbb790a, portal: 172.16.0.220,3260] successful.
Nov 06 15:47:24 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:47:24 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c5fa35a-1ba5-4390-9102-83ac1dbb790a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:47:24 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c5fa35a-1ba5-4390-9102-83ac1dbb790a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:47:24 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aa1909a-a5f3-4bb6-bb4c-b87c5154a49a]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:47:24 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-3514b2fa-3bd0-4481-a291-209cbd78cb8b tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:47:24 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:47:24 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:47:24 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[004257fa-59c9-441c-b106-70294224f01e]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c5fa35a-1ba5-4390-9102-83ac1dbb790a (non-flash)\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:47:24 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-3514b2fa-3bd0-4481-a291-209cbd78cb8b tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)
Nov 06 15:47:24 user nova-compute[75337]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e (non-flash)
Nov 06 15:47:24 user nova-compute[75337]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c5fa35a-1ba5-4390-9102-83ac1dbb790a (non-flash)
Nov 06 15:47:24 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 15:47:24 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-3514b2fa-3bd0-4481-a291-209cbd78cb8b tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)
Nov 06 15:47:24 user nova-compute[75337]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e (non-flash)
Nov 06 15:47:24 user nova-compute[75337]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c5fa35a-1ba5-4390-9102-83ac1dbb790a (non-flash)
Nov 06 15:47:24 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 15:47:24 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-3514b2fa-3bd0-4481-a291-209cbd78cb8b tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0c5fa35a-1ba5-4390-9102-83ac1dbb790a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.318s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 15:47:24 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-3514b2fa-3bd0-4481-a291-209cbd78cb8b tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] Connected to 172.16.0.220:3260 {{(pid=75337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 15:47:24 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-3514b2fa-3bd0-4481-a291-209cbd78cb8b tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] HCTL ('35', '-', '-', 0) found on session 19 with lun 0 {{(pid=75337) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 15:47:24 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-3514b2fa-3bd0-4481-a291-209cbd78cb8b tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75337) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 15:47:24 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:47:24 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:47:24 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[783a5161-1997-4e82-9ecb-2ca1bb8194db]: (4, ('- - 0', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:47:24 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-3514b2fa-3bd0-4481-a291-209cbd78cb8b tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] Searching for a device in session 19 and hctl ['35', '*', '*', 0] yield: None {{(pid=75337) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 15:47:24 user nova-compute[75337]: DEBUG nova.network.neutron [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Successfully updated port: ee068b96-f361-4cb1-afeb-d3db42848f50 {{(pid=75337) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 15:47:25 user nova-compute[75337]: DEBUG nova.compute.manager [req-47a53af8-abf2-49a4-818e-ea74cd14a6a4 req-f24c7cfd-6cdc-4f8d-be7f-c74b23da2276 service nova] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Received event network-changed-ee068b96-f361-4cb1-afeb-d3db42848f50 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:47:25 user nova-compute[75337]: DEBUG nova.compute.manager [req-47a53af8-abf2-49a4-818e-ea74cd14a6a4 req-f24c7cfd-6cdc-4f8d-be7f-c74b23da2276 service nova] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Refreshing instance network info cache due to event network-changed-ee068b96-f361-4cb1-afeb-d3db42848f50. {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 15:47:25 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-47a53af8-abf2-49a4-818e-ea74cd14a6a4 req-f24c7cfd-6cdc-4f8d-be7f-c74b23da2276 service nova] Acquiring lock "refresh_cache-fdda34b5-280f-489d-baf5-bf21ac6dd6c9" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 15:47:25 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-47a53af8-abf2-49a4-818e-ea74cd14a6a4 req-f24c7cfd-6cdc-4f8d-be7f-c74b23da2276 service nova] Acquired lock "refresh_cache-fdda34b5-280f-489d-baf5-bf21ac6dd6c9" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 15:47:25 user nova-compute[75337]: DEBUG nova.network.neutron [req-47a53af8-abf2-49a4-818e-ea74cd14a6a4 req-f24c7cfd-6cdc-4f8d-be7f-c74b23da2276 service nova] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Refreshing network info cache for port ee068b96-f361-4cb1-afeb-d3db42848f50 {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 15:47:25 user nova-compute[75337]: DEBUG nova.network.neutron [req-47a53af8-abf2-49a4-818e-ea74cd14a6a4 req-f24c7cfd-6cdc-4f8d-be7f-c74b23da2276 service nova] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Instance cache missing network info. {{(pid=75337) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 15:47:25 user nova-compute[75337]: DEBUG nova.network.neutron [req-47a53af8-abf2-49a4-818e-ea74cd14a6a4 req-f24c7cfd-6cdc-4f8d-be7f-c74b23da2276 service nova] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Updating instance_info_cache with network_info: [] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:47:25 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-47a53af8-abf2-49a4-818e-ea74cd14a6a4 req-f24c7cfd-6cdc-4f8d-be7f-c74b23da2276 service nova] Releasing lock "refresh_cache-fdda34b5-280f-489d-baf5-bf21ac6dd6c9" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 15:47:25 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-3514b2fa-3bd0-4481-a291-209cbd78cb8b tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] Searching for a device in session 19 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75337) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 15:47:25 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-3514b2fa-3bd0-4481-a291-209cbd78cb8b tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:0c5fa35a-1ba5-4390-9102-83ac1dbb790a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nkapcTJV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 15:47:25 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-3514b2fa-3bd0-4481-a291-209cbd78cb8b tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.351s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 15:47:25 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-3514b2fa-3bd0-4481-a291-209cbd78cb8b tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] <== connect_volume: return (1353ms) {'type': 'block', 'scsi_wwn': '26134383266663230', 'path': '/dev/sdd'} {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 15:47:25 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3514b2fa-3bd0-4481-a291-209cbd78cb8b tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] [instance: 9125364b-332f-4297-815f-3aa1eadaf743] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26134383266663230', 'path': '/dev/sdd'} {{(pid=75337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 15:47:25 user nova-compute[75337]: DEBUG nova.objects.instance [None req-3514b2fa-3bd0-4481-a291-209cbd78cb8b tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] Lazy-loading 'flavor' on Instance uuid 9125364b-332f-4297-815f-3aa1eadaf743 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 15:47:25 user nova-compute[75337]: DEBUG nova.virt.libvirt.guest [None req-3514b2fa-3bd0-4481-a291-209cbd78cb8b tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] attach device xml: <disk type="block" device="disk">
Nov 06 15:47:25 user nova-compute[75337]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 15:47:25 user nova-compute[75337]:   <source dev="/dev/sdd"/>
Nov 06 15:47:25 user nova-compute[75337]:   <target dev="vdb" bus="virtio"/>
Nov 06 15:47:25 user nova-compute[75337]:   <serial>0c5fa35a-1ba5-4390-9102-83ac1dbb790a</serial>
Nov 06 15:47:25 user nova-compute[75337]: </disk>
Nov 06 15:47:25 user nova-compute[75337]:  {{(pid=75337) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 06 15:47:25 user nova-compute[75337]: DEBUG nova.network.neutron [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Successfully updated port: 7359ffbf-b953-480e-ae89-7ce5dda880a3 {{(pid=75337) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 15:47:26 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-3514b2fa-3bd0-4481-a291-209cbd78cb8b tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] No BDM found with device name vda, not building metadata. {{(pid=75337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 15:47:26 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-3514b2fa-3bd0-4481-a291-209cbd78cb8b tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 15:47:26 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-3514b2fa-3bd0-4481-a291-209cbd78cb8b tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] No VIF found with MAC fa:16:3e:d5:76:83, not building metadata {{(pid=75337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 15:47:26 user nova-compute[75337]: DEBUG nova.compute.manager [None req-8fd034d5-a82e-4546-aa95-82702672a404 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: b7ececa5-256f-4a5d-aeda-3d2ee5c01cfe] Instance event wait completed in 0 seconds for  {{(pid=75337) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 15:47:26 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-8fd034d5-a82e-4546-aa95-82702672a404 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: b7ececa5-256f-4a5d-aeda-3d2ee5c01cfe] Guest created on hypervisor {{(pid=75337) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 15:47:26 user nova-compute[75337]: INFO nova.virt.libvirt.driver [-] [instance: b7ececa5-256f-4a5d-aeda-3d2ee5c01cfe] Instance spawned successfully.
Nov 06 15:47:26 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-8fd034d5-a82e-4546-aa95-82702672a404 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: b7ececa5-256f-4a5d-aeda-3d2ee5c01cfe] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 15:47:26 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-8fd034d5-a82e-4546-aa95-82702672a404 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: b7ececa5-256f-4a5d-aeda-3d2ee5c01cfe] Found default for hw_cdrom_bus of ide {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:47:26 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-8fd034d5-a82e-4546-aa95-82702672a404 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: b7ececa5-256f-4a5d-aeda-3d2ee5c01cfe] Found default for hw_disk_bus of virtio {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:47:26 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-8fd034d5-a82e-4546-aa95-82702672a404 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: b7ececa5-256f-4a5d-aeda-3d2ee5c01cfe] Found default for hw_input_bus of None {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:47:26 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-8fd034d5-a82e-4546-aa95-82702672a404 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: b7ececa5-256f-4a5d-aeda-3d2ee5c01cfe] Found default for hw_pointer_model of None {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:47:26 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-8fd034d5-a82e-4546-aa95-82702672a404 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: b7ececa5-256f-4a5d-aeda-3d2ee5c01cfe] Found default for hw_video_model of virtio {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:47:26 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-8fd034d5-a82e-4546-aa95-82702672a404 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: b7ececa5-256f-4a5d-aeda-3d2ee5c01cfe] Found default for hw_vif_model of virtio {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:47:26 user nova-compute[75337]: DEBUG nova.compute.manager [req-982ed396-965a-4cba-bc33-89b39ed15699 req-32760119-bebd-4c68-b50f-735f4deaa3bc service nova] [instance: b7ececa5-256f-4a5d-aeda-3d2ee5c01cfe] Received event network-vif-plugged-282f33e8-b542-4d05-bc4d-35e786dcd7ee {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:47:26 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-982ed396-965a-4cba-bc33-89b39ed15699 req-32760119-bebd-4c68-b50f-735f4deaa3bc service nova] Acquiring lock "b7ececa5-256f-4a5d-aeda-3d2ee5c01cfe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:47:26 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-982ed396-965a-4cba-bc33-89b39ed15699 req-32760119-bebd-4c68-b50f-735f4deaa3bc service nova] Lock "b7ececa5-256f-4a5d-aeda-3d2ee5c01cfe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:47:26 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-982ed396-965a-4cba-bc33-89b39ed15699 req-32760119-bebd-4c68-b50f-735f4deaa3bc service nova] Lock "b7ececa5-256f-4a5d-aeda-3d2ee5c01cfe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:47:26 user nova-compute[75337]: DEBUG nova.compute.manager [req-982ed396-965a-4cba-bc33-89b39ed15699 req-32760119-bebd-4c68-b50f-735f4deaa3bc service nova] [instance: b7ececa5-256f-4a5d-aeda-3d2ee5c01cfe] No waiting events found dispatching network-vif-plugged-282f33e8-b542-4d05-bc4d-35e786dcd7ee {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:47:26 user nova-compute[75337]: WARNING nova.compute.manager [req-982ed396-965a-4cba-bc33-89b39ed15699 req-32760119-bebd-4c68-b50f-735f4deaa3bc service nova] [instance: b7ececa5-256f-4a5d-aeda-3d2ee5c01cfe] Received unexpected event network-vif-plugged-282f33e8-b542-4d05-bc4d-35e786dcd7ee for instance with vm_state building and task_state spawning.
Nov 06 15:47:26 user nova-compute[75337]: INFO nova.compute.manager [None req-8fd034d5-a82e-4546-aa95-82702672a404 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: b7ececa5-256f-4a5d-aeda-3d2ee5c01cfe] Took 5.78 seconds to spawn the instance on the hypervisor.
Nov 06 15:47:26 user nova-compute[75337]: DEBUG nova.compute.manager [None req-8fd034d5-a82e-4546-aa95-82702672a404 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: b7ececa5-256f-4a5d-aeda-3d2ee5c01cfe] Checking state {{(pid=75337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 15:47:26 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-3514b2fa-3bd0-4481-a291-209cbd78cb8b tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] Lock "9125364b-332f-4297-815f-3aa1eadaf743" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 26.701s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:47:26 user nova-compute[75337]: INFO nova.compute.manager [None req-8fd034d5-a82e-4546-aa95-82702672a404 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: b7ececa5-256f-4a5d-aeda-3d2ee5c01cfe] Took 6.58 seconds to build instance.
Nov 06 15:47:26 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-8fd034d5-a82e-4546-aa95-82702672a404 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Lock "b7ececa5-256f-4a5d-aeda-3d2ee5c01cfe" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.672s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:47:26 user nova-compute[75337]: DEBUG nova.network.neutron [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Successfully updated port: 0184ea76-40a1-41f4-9a6f-e2ca6719b7ab {{(pid=75337) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 15:47:27 user nova-compute[75337]: DEBUG nova.compute.manager [req-dd4478d5-06d4-4cd0-8405-17543db15db0 req-4b375844-f935-455f-87ff-3922a70bf483 service nova] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Received event network-changed-7359ffbf-b953-480e-ae89-7ce5dda880a3 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:47:27 user nova-compute[75337]: DEBUG nova.compute.manager [req-dd4478d5-06d4-4cd0-8405-17543db15db0 req-4b375844-f935-455f-87ff-3922a70bf483 service nova] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Refreshing instance network info cache due to event network-changed-7359ffbf-b953-480e-ae89-7ce5dda880a3. {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 15:47:27 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-dd4478d5-06d4-4cd0-8405-17543db15db0 req-4b375844-f935-455f-87ff-3922a70bf483 service nova] Acquiring lock "refresh_cache-fdda34b5-280f-489d-baf5-bf21ac6dd6c9" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 15:47:27 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-dd4478d5-06d4-4cd0-8405-17543db15db0 req-4b375844-f935-455f-87ff-3922a70bf483 service nova] Acquired lock "refresh_cache-fdda34b5-280f-489d-baf5-bf21ac6dd6c9" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 15:47:27 user nova-compute[75337]: DEBUG nova.network.neutron [req-dd4478d5-06d4-4cd0-8405-17543db15db0 req-4b375844-f935-455f-87ff-3922a70bf483 service nova] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Refreshing network info cache for port 7359ffbf-b953-480e-ae89-7ce5dda880a3 {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 15:47:27 user nova-compute[75337]: DEBUG nova.network.neutron [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Successfully updated port: 38a409f9-0fb9-4505-9f74-bf2859e6f66c {{(pid=75337) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 15:47:27 user nova-compute[75337]: DEBUG nova.network.neutron [req-dd4478d5-06d4-4cd0-8405-17543db15db0 req-4b375844-f935-455f-87ff-3922a70bf483 service nova] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Instance cache missing network info. {{(pid=75337) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 15:47:27 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:47:27 user nova-compute[75337]: DEBUG nova.network.neutron [req-dd4478d5-06d4-4cd0-8405-17543db15db0 req-4b375844-f935-455f-87ff-3922a70bf483 service nova] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Updating instance_info_cache with network_info: [] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:47:27 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-dd4478d5-06d4-4cd0-8405-17543db15db0 req-4b375844-f935-455f-87ff-3922a70bf483 service nova] Releasing lock "refresh_cache-fdda34b5-280f-489d-baf5-bf21ac6dd6c9" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 15:47:27 user nova-compute[75337]: DEBUG nova.compute.manager [req-dd4478d5-06d4-4cd0-8405-17543db15db0 req-4b375844-f935-455f-87ff-3922a70bf483 service nova] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Received event network-changed-0184ea76-40a1-41f4-9a6f-e2ca6719b7ab {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:47:27 user nova-compute[75337]: DEBUG nova.compute.manager [req-dd4478d5-06d4-4cd0-8405-17543db15db0 req-4b375844-f935-455f-87ff-3922a70bf483 service nova] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Refreshing instance network info cache due to event network-changed-0184ea76-40a1-41f4-9a6f-e2ca6719b7ab. {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 15:47:27 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-dd4478d5-06d4-4cd0-8405-17543db15db0 req-4b375844-f935-455f-87ff-3922a70bf483 service nova] Acquiring lock "refresh_cache-fdda34b5-280f-489d-baf5-bf21ac6dd6c9" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 15:47:27 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-dd4478d5-06d4-4cd0-8405-17543db15db0 req-4b375844-f935-455f-87ff-3922a70bf483 service nova] Acquired lock "refresh_cache-fdda34b5-280f-489d-baf5-bf21ac6dd6c9" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 15:47:27 user nova-compute[75337]: DEBUG nova.network.neutron [req-dd4478d5-06d4-4cd0-8405-17543db15db0 req-4b375844-f935-455f-87ff-3922a70bf483 service nova] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Refreshing network info cache for port 0184ea76-40a1-41f4-9a6f-e2ca6719b7ab {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 15:47:27 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-f4e88c6d-10cc-4f7a-b79b-2fcda050a895 tempest-TestVolumeSwap-916912695 tempest-TestVolumeSwap-916912695-project-admin] Acquiring lock "9125364b-332f-4297-815f-3aa1eadaf743" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:47:27 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-f4e88c6d-10cc-4f7a-b79b-2fcda050a895 tempest-TestVolumeSwap-916912695 tempest-TestVolumeSwap-916912695-project-admin] Lock "9125364b-332f-4297-815f-3aa1eadaf743" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:47:27 user nova-compute[75337]: DEBUG os_brick.utils [None req-f4e88c6d-10cc-4f7a-b79b-2fcda050a895 tempest-TestVolumeSwap-916912695 tempest-TestVolumeSwap-916912695-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 15:47:27 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:47:27 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:47:27 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a82714a-e7f8-47eb-b5fd-d9266947afe3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4ff6411e45b8\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:47:27 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:47:27 user nova-compute[75337]: DEBUG nova.network.neutron [req-dd4478d5-06d4-4cd0-8405-17543db15db0 req-4b375844-f935-455f-87ff-3922a70bf483 service nova] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Instance cache missing network info. {{(pid=75337) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 15:47:27 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:47:27 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[58738ba0-e6ca-4f2e-97b6-7afeabbd38a6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:47:27 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:47:27 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:47:27 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[1210f6d7-f2ef-4c3c-8e5b-fac1705f4f9f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:47:27 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3fc9a87-ee81-41a8-8c6e-13a31a7772a1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:47:27 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-f4e88c6d-10cc-4f7a-b79b-2fcda050a895 tempest-TestVolumeSwap-916912695 tempest-TestVolumeSwap-916912695-project-admin] Running cmd (subprocess): nvme version {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:47:27 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-f4e88c6d-10cc-4f7a-b79b-2fcda050a895 tempest-TestVolumeSwap-916912695 tempest-TestVolumeSwap-916912695-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 15:47:27 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f4e88c6d-10cc-4f7a-b79b-2fcda050a895 tempest-TestVolumeSwap-916912695 tempest-TestVolumeSwap-916912695-project-admin] nvme not present on system {{(pid=75337) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 15:47:27 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:47:27 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 15:47:27 user nova-compute[75337]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 15:47:27 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce2b2079-d6d4-4e8d-8466-db26a5dbbc49]: (4, '') {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:47:27 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.lightos [None req-f4e88c6d-10cc-4f7a-b79b-2fcda050a895 tempest-TestVolumeSwap-916912695 tempest-TestVolumeSwap-916912695-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75337) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 15:47:27 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.lightos [None req-f4e88c6d-10cc-4f7a-b79b-2fcda050a895 tempest-TestVolumeSwap-916912695 tempest-TestVolumeSwap-916912695-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 15:47:27 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.lightos [None req-f4e88c6d-10cc-4f7a-b79b-2fcda050a895 tempest-TestVolumeSwap-916912695 tempest-TestVolumeSwap-916912695-project-admin] LIGHTOS: no hostnqn found. {{(pid=75337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 15:47:27 user nova-compute[75337]: DEBUG os_brick.utils [None req-f4e88c6d-10cc-4f7a-b79b-2fcda050a895 tempest-TestVolumeSwap-916912695 tempest-TestVolumeSwap-916912695-project-admin] <== get_connector_properties: return (154ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4ff6411e45b8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 15:47:27 user nova-compute[75337]: DEBUG nova.network.neutron [req-dd4478d5-06d4-4cd0-8405-17543db15db0 req-4b375844-f935-455f-87ff-3922a70bf483 service nova] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Updating instance_info_cache with network_info: [] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:47:27 user nova-compute[75337]: INFO nova.compute.manager [None req-f4e88c6d-10cc-4f7a-b79b-2fcda050a895 tempest-TestVolumeSwap-916912695 tempest-TestVolumeSwap-916912695-project-admin] [instance: 9125364b-332f-4297-815f-3aa1eadaf743] Swapping volume 0c5fa35a-1ba5-4390-9102-83ac1dbb790a for b1421f55-d453-441d-bdf7-3743102662b6
Nov 06 15:47:27 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-dd4478d5-06d4-4cd0-8405-17543db15db0 req-4b375844-f935-455f-87ff-3922a70bf483 service nova] Releasing lock "refresh_cache-fdda34b5-280f-489d-baf5-bf21ac6dd6c9" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 15:47:27 user nova-compute[75337]: DEBUG nova.network.neutron [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Successfully updated port: d86aca21-e67b-48e9-b8de-a1d618a5dfc7 {{(pid=75337) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 15:47:27 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-803a08fd-f70a-4399-ae3b-6b7ba368bca8 tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Acquiring lock "581cf468-65e7-42e5-9250-c3d645577011" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:47:27 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-803a08fd-f70a-4399-ae3b-6b7ba368bca8 tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Lock "581cf468-65e7-42e5-9250-c3d645577011" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:47:27 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-803a08fd-f70a-4399-ae3b-6b7ba368bca8 tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Acquiring lock "581cf468-65e7-42e5-9250-c3d645577011-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:47:27 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-803a08fd-f70a-4399-ae3b-6b7ba368bca8 tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Lock "581cf468-65e7-42e5-9250-c3d645577011-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:47:27 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-803a08fd-f70a-4399-ae3b-6b7ba368bca8 tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Lock "581cf468-65e7-42e5-9250-c3d645577011-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:47:27 user nova-compute[75337]: INFO nova.compute.manager [None req-803a08fd-f70a-4399-ae3b-6b7ba368bca8 tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] [instance: 581cf468-65e7-42e5-9250-c3d645577011] Terminating instance
Nov 06 15:47:27 user nova-compute[75337]: DEBUG nova.compute.manager [None req-803a08fd-f70a-4399-ae3b-6b7ba368bca8 tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] [instance: 581cf468-65e7-42e5-9250-c3d645577011] Start destroying the instance on the hypervisor. {{(pid=75337) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 15:47:27 user nova-compute[75337]: DEBUG nova.compute.manager [req-9e271d83-b04b-4463-9fe0-7233e7c00786 req-7f4b1ad9-3757-46d6-9d16-e5d1d7de919c service nova] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Received event network-changed-d86aca21-e67b-48e9-b8de-a1d618a5dfc7 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:47:27 user nova-compute[75337]: DEBUG nova.compute.manager [req-9e271d83-b04b-4463-9fe0-7233e7c00786 req-7f4b1ad9-3757-46d6-9d16-e5d1d7de919c service nova] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Refreshing instance network info cache due to event network-changed-d86aca21-e67b-48e9-b8de-a1d618a5dfc7. {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 15:47:27 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-9e271d83-b04b-4463-9fe0-7233e7c00786 req-7f4b1ad9-3757-46d6-9d16-e5d1d7de919c service nova] Acquiring lock "refresh_cache-fdda34b5-280f-489d-baf5-bf21ac6dd6c9" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 15:47:27 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-9e271d83-b04b-4463-9fe0-7233e7c00786 req-7f4b1ad9-3757-46d6-9d16-e5d1d7de919c service nova] Acquired lock "refresh_cache-fdda34b5-280f-489d-baf5-bf21ac6dd6c9" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 15:47:27 user nova-compute[75337]: DEBUG nova.network.neutron [req-9e271d83-b04b-4463-9fe0-7233e7c00786 req-7f4b1ad9-3757-46d6-9d16-e5d1d7de919c service nova] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Refreshing network info cache for port d86aca21-e67b-48e9-b8de-a1d618a5dfc7 {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 15:47:27 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:47:27 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:47:27 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:47:27 user nova-compute[75337]: DEBUG nova.network.neutron [req-9e271d83-b04b-4463-9fe0-7233e7c00786 req-7f4b1ad9-3757-46d6-9d16-e5d1d7de919c service nova] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Instance cache missing network info. {{(pid=75337) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 15:47:28 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:47:28 user nova-compute[75337]: DEBUG nova.network.neutron [req-9e271d83-b04b-4463-9fe0-7233e7c00786 req-7f4b1ad9-3757-46d6-9d16-e5d1d7de919c service nova] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Updating instance_info_cache with network_info: [] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:47:28 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-9e271d83-b04b-4463-9fe0-7233e7c00786 req-7f4b1ad9-3757-46d6-9d16-e5d1d7de919c service nova] Releasing lock "refresh_cache-fdda34b5-280f-489d-baf5-bf21ac6dd6c9" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 15:47:28 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:47:28 user nova-compute[75337]: INFO nova.virt.libvirt.driver [-] [instance: 581cf468-65e7-42e5-9250-c3d645577011] Instance destroyed successfully.
Nov 06 15:47:28 user nova-compute[75337]: DEBUG nova.objects.instance [None req-803a08fd-f70a-4399-ae3b-6b7ba368bca8 tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Lazy-loading 'resources' on Instance uuid 581cf468-65e7-42e5-9250-c3d645577011 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 15:47:28 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-803a08fd-f70a-4399-ae3b-6b7ba368bca8 tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T15:37:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-143035342',display_name='tempest-ServerActionsTestOtherB-server-143035342',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-143035342',id=4,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGvgawdpwOKUFbYuIfCQHAYAwMkYeyGp/mWnvHMxoikCW6rq7Lc9iVzhCxfsvGYfdcuDE3wf7kwN77XNEdHIhKuYJC28UJSD4qJahdz/1x3pQWmM3jC4aksXmnaw21FVfw==',key_name='tempest-keypair-1619039595',keypairs=<?>,launch_index=0,launched_at=2023-11-06T15:45:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f40165c076e341bba42fb537ce98bbe2',ramdisk_id='',reservation_id='r-w3wq64j4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-464439480',owner_user_name='tempest-ServerActionsTestOtherB-464439480-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T15:45:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2810a15c1608465aa7465eae455eb5c6',uuid=581cf468-65e7-42e5-9250-c3d645577011,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d1c68bac-be37-4645-afcb-2b89f47c1793", "address": "fa:16:3e:00:1c:74", "network": {"id": "2623bcbf-c77c-47b4-abd5-ab538f9a2814", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1497688706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f40165c076e341bba42fb537ce98bbe2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1c68bac-be", "ovs_interfaceid": "d1c68bac-be37-4645-afcb-2b89f47c1793", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 15:47:28 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-803a08fd-f70a-4399-ae3b-6b7ba368bca8 tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Converting VIF {"id": "d1c68bac-be37-4645-afcb-2b89f47c1793", "address": "fa:16:3e:00:1c:74", "network": {"id": "2623bcbf-c77c-47b4-abd5-ab538f9a2814", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1497688706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f40165c076e341bba42fb537ce98bbe2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1c68bac-be", "ovs_interfaceid": "d1c68bac-be37-4645-afcb-2b89f47c1793", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 15:47:28 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-803a08fd-f70a-4399-ae3b-6b7ba368bca8 tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:00:1c:74,bridge_name='br-int',has_traffic_filtering=True,id=d1c68bac-be37-4645-afcb-2b89f47c1793,network=Network(2623bcbf-c77c-47b4-abd5-ab538f9a2814),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1c68bac-be') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 15:47:28 user nova-compute[75337]: DEBUG os_vif [None req-803a08fd-f70a-4399-ae3b-6b7ba368bca8 tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:00:1c:74,bridge_name='br-int',has_traffic_filtering=True,id=d1c68bac-be37-4645-afcb-2b89f47c1793,network=Network(2623bcbf-c77c-47b4-abd5-ab538f9a2814),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1c68bac-be') {{(pid=75337) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 15:47:28 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:47:28 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd1c68bac-be, bridge=br-int, if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:47:28 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:47:28 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:47:28 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0b269b33-8054-4bdb-bb26-ec3cec408e29) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:47:28 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:47:28 user nova-compute[75337]: INFO os_vif [None req-803a08fd-f70a-4399-ae3b-6b7ba368bca8 tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:00:1c:74,bridge_name='br-int',has_traffic_filtering=True,id=d1c68bac-be37-4645-afcb-2b89f47c1793,network=Network(2623bcbf-c77c-47b4-abd5-ab538f9a2814),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1c68bac-be')
Nov 06 15:47:28 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-803a08fd-f70a-4399-ae3b-6b7ba368bca8 tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] [instance: 581cf468-65e7-42e5-9250-c3d645577011] calling os-brick to detach iSCSI Volume {{(pid=75337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 15:47:28 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-803a08fd-f70a-4399-ae3b-6b7ba368bca8 tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2abc33d0c0>, {'target_iqn': 'iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XMEQSsAU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 15:47:28 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-803a08fd-f70a-4399-ae3b-6b7ba368bca8 tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 15:47:28 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-803a08fd-f70a-4399-ae3b-6b7ba368bca8 tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 15:47:28 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-803a08fd-f70a-4399-ae3b-6b7ba368bca8 tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 15:47:28 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:47:28 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.029s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:47:28 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[53b938f9-0812-434f-8534-d06455f60885]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0c5fa35a-1ba5-4390-9102-83ac1dbb790a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:47:28 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-803a08fd-f70a-4399-ae3b-6b7ba368bca8 tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 15:47:28 user nova-compute[75337]: No targets found.
Nov 06 15:47:28 user nova-compute[75337]: iSNS:
Nov 06 15:47:28 user nova-compute[75337]: No targets found.
Nov 06 15:47:28 user nova-compute[75337]: STATIC:
Nov 06 15:47:28 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e
Nov 06 15:47:28 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 15:47:28 user nova-compute[75337]:                 Iface Name: default
Nov 06 15:47:28 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158
Nov 06 15:47:28 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 15:47:28 user nova-compute[75337]:                 Iface Name: default
Nov 06 15:47:28 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:0c5fa35a-1ba5-4390-9102-83ac1dbb790a
Nov 06 15:47:28 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 15:47:28 user nova-compute[75337]:                 Iface Name: default
Nov 06 15:47:28 user nova-compute[75337]: FIRMWARE:
Nov 06 15:47:28 user nova-compute[75337]: No targets found.
Nov 06 15:47:28 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 15:47:28 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-803a08fd-f70a-4399-ae3b-6b7ba368bca8 tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 15:47:28 user nova-compute[75337]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 15:47:28 user nova-compute[75337]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75337) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 15:47:28 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-803a08fd-f70a-4399-ae3b-6b7ba368bca8 tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e', 0)] {{(pid=75337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 15:47:28 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:47:28 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:47:28 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[702f1cb8-01ad-4863-95d9-e9ebebf7e2b5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c5fa35a-1ba5-4390-9102-83ac1dbb790a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:47:28 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:47:28 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:47:28 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[756c8c94-bbf0-4d24-8aeb-e2c3cfcfa20d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c5fa35a-1ba5-4390-9102-83ac1dbb790a (non-flash)\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:47:28 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-803a08fd-f70a-4399-ae3b-6b7ba368bca8 tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)
Nov 06 15:47:28 user nova-compute[75337]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e (non-flash)
Nov 06 15:47:28 user nova-compute[75337]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c5fa35a-1ba5-4390-9102-83ac1dbb790a (non-flash)
Nov 06 15:47:28 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 15:47:28 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-803a08fd-f70a-4399-ae3b-6b7ba368bca8 tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)
Nov 06 15:47:28 user nova-compute[75337]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e (non-flash)
Nov 06 15:47:28 user nova-compute[75337]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c5fa35a-1ba5-4390-9102-83ac1dbb790a (non-flash)
Nov 06 15:47:28 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 15:47:28 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-803a08fd-f70a-4399-ae3b-6b7ba368bca8 tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2abc12acb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e'): ({'sdb'}, set())}) {{(pid=75337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 15:47:28 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-803a08fd-f70a-4399-ae3b-6b7ba368bca8 tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Removing single pathed devices sdb {{(pid=75337) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 15:47:28 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:47:28 user nova-compute[75337]: DEBUG nova.network.neutron [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Successfully updated port: 4c56104b-528f-40b8-931d-7619e413ab07 {{(pid=75337) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 15:47:28 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:47:28 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c14476d-d645-4372-ae37-72a7f65b0188]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:47:28 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:47:28 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:47:28 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[45eef551-a57b-49d0-9654-d698c3429933]: (4, ('ok\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:47:28 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-803a08fd-f70a-4399-ae3b-6b7ba368bca8 tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Flushing IO for device /dev/sdb {{(pid=75337) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 15:47:28 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:47:28 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:47:28 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[218af123-7c3c-4b2e-bda9-7b5f31bc6cbc]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:47:28 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-803a08fd-f70a-4399-ae3b-6b7ba368bca8 tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75337) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 15:47:28 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:47:28 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.058s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:47:28 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[408fb7ac-f714-4f98-9a02-3605c1983362]: (4, ('1', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:47:28 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-803a08fd-f70a-4399-ae3b-6b7ba368bca8 tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 15:47:28 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-803a08fd-f70a-4399-ae3b-6b7ba368bca8 tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] SCSI volumes sdb have been removed. {{(pid=75337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 15:47:28 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-803a08fd-f70a-4399-ae3b-6b7ba368bca8 tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e')] {{(pid=75337) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 15:47:28 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:47:28 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:47:28 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:47:28 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c68c894-d2ea-4847-8245-d7e276c094d8]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:47:28 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-803a08fd-f70a-4399-ae3b-6b7ba368bca8 tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:47:28 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e -p 172.16.0.220:3260 --logout {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:47:29 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:47:29 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa2d5307-f993-4403-b2a7-1a9a257d92f9]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:47:29 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-803a08fd-f70a-4399-ae3b-6b7ba368bca8 tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e, portal: 172.16.0.220,3260]
Nov 06 15:47:29 user nova-compute[75337]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e, portal: 172.16.0.220,3260] successful.
Nov 06 15:47:29 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:47:29 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e -p 172.16.0.220:3260 --op delete {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:47:29 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84119968-a048-41d8-9688-39c01b5f860e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:47:29 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[25b61efe-62e6-450a-ab17-7aedd8503d86]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:47:29 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-803a08fd-f70a-4399-ae3b-6b7ba368bca8 tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:47:29 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-803a08fd-f70a-4399-ae3b-6b7ba368bca8 tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.385s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 15:47:29 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-803a08fd-f70a-4399-ae3b-6b7ba368bca8 tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] <== disconnect_volume: return (387ms) None {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 15:47:29 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-803a08fd-f70a-4399-ae3b-6b7ba368bca8 tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] [instance: 581cf468-65e7-42e5-9250-c3d645577011] Disconnected iSCSI Volume {{(pid=75337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 15:47:29 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-803a08fd-f70a-4399-ae3b-6b7ba368bca8 tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] [instance: 581cf468-65e7-42e5-9250-c3d645577011] Deleting instance files /opt/stack/data/nova/instances/581cf468-65e7-42e5-9250-c3d645577011_del
Nov 06 15:47:29 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-803a08fd-f70a-4399-ae3b-6b7ba368bca8 tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] [instance: 581cf468-65e7-42e5-9250-c3d645577011] Deletion of /opt/stack/data/nova/instances/581cf468-65e7-42e5-9250-c3d645577011_del complete
Nov 06 15:47:29 user nova-compute[75337]: DEBUG nova.compute.manager [req-106f4b5d-f346-4332-92df-fd42b56c332f req-40eaaa9b-bc8e-4425-a2e5-95786e12277f service nova] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Received event network-changed-38a409f9-0fb9-4505-9f74-bf2859e6f66c {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:47:29 user nova-compute[75337]: DEBUG nova.compute.manager [req-106f4b5d-f346-4332-92df-fd42b56c332f req-40eaaa9b-bc8e-4425-a2e5-95786e12277f service nova] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Refreshing instance network info cache due to event network-changed-38a409f9-0fb9-4505-9f74-bf2859e6f66c. {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 15:47:29 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-106f4b5d-f346-4332-92df-fd42b56c332f req-40eaaa9b-bc8e-4425-a2e5-95786e12277f service nova] Acquiring lock "refresh_cache-fdda34b5-280f-489d-baf5-bf21ac6dd6c9" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 15:47:29 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-106f4b5d-f346-4332-92df-fd42b56c332f req-40eaaa9b-bc8e-4425-a2e5-95786e12277f service nova] Acquired lock "refresh_cache-fdda34b5-280f-489d-baf5-bf21ac6dd6c9" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 15:47:29 user nova-compute[75337]: DEBUG nova.network.neutron [req-106f4b5d-f346-4332-92df-fd42b56c332f req-40eaaa9b-bc8e-4425-a2e5-95786e12277f service nova] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Refreshing network info cache for port 38a409f9-0fb9-4505-9f74-bf2859e6f66c {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 15:47:29 user nova-compute[75337]: INFO nova.compute.manager [None req-803a08fd-f70a-4399-ae3b-6b7ba368bca8 tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] [instance: 581cf468-65e7-42e5-9250-c3d645577011] Took 1.39 seconds to destroy the instance on the hypervisor.
Nov 06 15:47:29 user nova-compute[75337]: DEBUG oslo.service.loopingcall [None req-803a08fd-f70a-4399-ae3b-6b7ba368bca8 tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75337) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 15:47:29 user nova-compute[75337]: DEBUG nova.compute.manager [-] [instance: 581cf468-65e7-42e5-9250-c3d645577011] Deallocating network for instance {{(pid=75337) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 15:47:29 user nova-compute[75337]: DEBUG nova.network.neutron [-] [instance: 581cf468-65e7-42e5-9250-c3d645577011] deallocate_for_instance() {{(pid=75337) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 15:47:29 user nova-compute[75337]: DEBUG nova.network.neutron [req-106f4b5d-f346-4332-92df-fd42b56c332f req-40eaaa9b-bc8e-4425-a2e5-95786e12277f service nova] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Instance cache missing network info. {{(pid=75337) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 15:47:29 user nova-compute[75337]: DEBUG nova.network.neutron [req-106f4b5d-f346-4332-92df-fd42b56c332f req-40eaaa9b-bc8e-4425-a2e5-95786e12277f service nova] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Updating instance_info_cache with network_info: [] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:47:29 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-106f4b5d-f346-4332-92df-fd42b56c332f req-40eaaa9b-bc8e-4425-a2e5-95786e12277f service nova] Releasing lock "refresh_cache-fdda34b5-280f-489d-baf5-bf21ac6dd6c9" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 15:47:29 user nova-compute[75337]: DEBUG nova.compute.manager [req-106f4b5d-f346-4332-92df-fd42b56c332f req-40eaaa9b-bc8e-4425-a2e5-95786e12277f service nova] [instance: 581cf468-65e7-42e5-9250-c3d645577011] Received event network-vif-unplugged-d1c68bac-be37-4645-afcb-2b89f47c1793 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:47:29 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-106f4b5d-f346-4332-92df-fd42b56c332f req-40eaaa9b-bc8e-4425-a2e5-95786e12277f service nova] Acquiring lock "581cf468-65e7-42e5-9250-c3d645577011-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:47:29 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-106f4b5d-f346-4332-92df-fd42b56c332f req-40eaaa9b-bc8e-4425-a2e5-95786e12277f service nova] Lock "581cf468-65e7-42e5-9250-c3d645577011-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:47:29 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-106f4b5d-f346-4332-92df-fd42b56c332f req-40eaaa9b-bc8e-4425-a2e5-95786e12277f service nova] Lock "581cf468-65e7-42e5-9250-c3d645577011-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:47:29 user nova-compute[75337]: DEBUG nova.compute.manager [req-106f4b5d-f346-4332-92df-fd42b56c332f req-40eaaa9b-bc8e-4425-a2e5-95786e12277f service nova] [instance: 581cf468-65e7-42e5-9250-c3d645577011] No waiting events found dispatching network-vif-unplugged-d1c68bac-be37-4645-afcb-2b89f47c1793 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:47:29 user nova-compute[75337]: DEBUG nova.compute.manager [req-106f4b5d-f346-4332-92df-fd42b56c332f req-40eaaa9b-bc8e-4425-a2e5-95786e12277f service nova] [instance: 581cf468-65e7-42e5-9250-c3d645577011] Received event network-vif-unplugged-d1c68bac-be37-4645-afcb-2b89f47c1793 for instance with task_state deleting. {{(pid=75337) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 15:47:29 user nova-compute[75337]: DEBUG nova.compute.manager [req-106f4b5d-f346-4332-92df-fd42b56c332f req-40eaaa9b-bc8e-4425-a2e5-95786e12277f service nova] [instance: 581cf468-65e7-42e5-9250-c3d645577011] Received event network-vif-plugged-d1c68bac-be37-4645-afcb-2b89f47c1793 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:47:29 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-106f4b5d-f346-4332-92df-fd42b56c332f req-40eaaa9b-bc8e-4425-a2e5-95786e12277f service nova] Acquiring lock "581cf468-65e7-42e5-9250-c3d645577011-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:47:29 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-106f4b5d-f346-4332-92df-fd42b56c332f req-40eaaa9b-bc8e-4425-a2e5-95786e12277f service nova] Lock "581cf468-65e7-42e5-9250-c3d645577011-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:47:29 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-106f4b5d-f346-4332-92df-fd42b56c332f req-40eaaa9b-bc8e-4425-a2e5-95786e12277f service nova] Lock "581cf468-65e7-42e5-9250-c3d645577011-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:47:29 user nova-compute[75337]: DEBUG nova.compute.manager [req-106f4b5d-f346-4332-92df-fd42b56c332f req-40eaaa9b-bc8e-4425-a2e5-95786e12277f service nova] [instance: 581cf468-65e7-42e5-9250-c3d645577011] No waiting events found dispatching network-vif-plugged-d1c68bac-be37-4645-afcb-2b89f47c1793 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:47:29 user nova-compute[75337]: WARNING nova.compute.manager [req-106f4b5d-f346-4332-92df-fd42b56c332f req-40eaaa9b-bc8e-4425-a2e5-95786e12277f service nova] [instance: 581cf468-65e7-42e5-9250-c3d645577011] Received unexpected event network-vif-plugged-d1c68bac-be37-4645-afcb-2b89f47c1793 for instance with vm_state active and task_state deleting.
Nov 06 15:47:29 user nova-compute[75337]: DEBUG nova.network.neutron [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Successfully updated port: 996e784d-bbe6-447b-8f1f-066ec34be989 {{(pid=75337) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 15:47:29 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Acquiring lock "refresh_cache-fdda34b5-280f-489d-baf5-bf21ac6dd6c9" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 15:47:29 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Acquired lock "refresh_cache-fdda34b5-280f-489d-baf5-bf21ac6dd6c9" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 15:47:29 user nova-compute[75337]: DEBUG nova.network.neutron [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Building network info cache for instance {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 15:47:29 user nova-compute[75337]: DEBUG nova.compute.manager [req-3062ff36-b7f0-4e0a-a44b-c47139ab569d req-a0ae6a66-d167-4daf-a92e-345fb42550fa service nova] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Received event network-changed-4c56104b-528f-40b8-931d-7619e413ab07 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:47:29 user nova-compute[75337]: DEBUG nova.compute.manager [req-3062ff36-b7f0-4e0a-a44b-c47139ab569d req-a0ae6a66-d167-4daf-a92e-345fb42550fa service nova] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Refreshing instance network info cache due to event network-changed-4c56104b-528f-40b8-931d-7619e413ab07. {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 15:47:29 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-3062ff36-b7f0-4e0a-a44b-c47139ab569d req-a0ae6a66-d167-4daf-a92e-345fb42550fa service nova] Acquiring lock "refresh_cache-fdda34b5-280f-489d-baf5-bf21ac6dd6c9" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 15:47:30 user nova-compute[75337]: DEBUG nova.network.neutron [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Instance cache missing network info. {{(pid=75337) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 15:47:30 user nova-compute[75337]: DEBUG nova.network.neutron [-] [instance: 581cf468-65e7-42e5-9250-c3d645577011] Updating instance_info_cache with network_info: [] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:47:30 user nova-compute[75337]: INFO nova.compute.manager [-] [instance: 581cf468-65e7-42e5-9250-c3d645577011] Took 1.27 seconds to deallocate network for instance.
Nov 06 15:47:30 user nova-compute[75337]: DEBUG nova.compute.manager [req-89e96b17-61c2-499e-a97a-e2c2e33e66aa req-ef84698b-30bc-4c2f-954c-e98a41544623 service nova] [instance: 581cf468-65e7-42e5-9250-c3d645577011] Received event network-vif-deleted-d1c68bac-be37-4645-afcb-2b89f47c1793 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:47:30 user nova-compute[75337]: INFO nova.compute.manager [req-89e96b17-61c2-499e-a97a-e2c2e33e66aa req-ef84698b-30bc-4c2f-954c-e98a41544623 service nova] [instance: 581cf468-65e7-42e5-9250-c3d645577011] Neutron deleted interface d1c68bac-be37-4645-afcb-2b89f47c1793; detaching it from the instance and deleting it from the info cache
Nov 06 15:47:30 user nova-compute[75337]: DEBUG nova.network.neutron [req-89e96b17-61c2-499e-a97a-e2c2e33e66aa req-ef84698b-30bc-4c2f-954c-e98a41544623 service nova] [instance: 581cf468-65e7-42e5-9250-c3d645577011] Updating instance_info_cache with network_info: [] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:47:30 user nova-compute[75337]: DEBUG nova.compute.manager [req-89e96b17-61c2-499e-a97a-e2c2e33e66aa req-ef84698b-30bc-4c2f-954c-e98a41544623 service nova] [instance: 581cf468-65e7-42e5-9250-c3d645577011] Detach interface failed, port_id=d1c68bac-be37-4645-afcb-2b89f47c1793, reason: Instance 581cf468-65e7-42e5-9250-c3d645577011 could not be found. {{(pid=75337) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 06 15:47:32 user nova-compute[75337]: DEBUG nova.network.neutron [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Updating instance_info_cache with network_info: [{"id": "ee068b96-f361-4cb1-afeb-d3db42848f50", "address": "fa:16:3e:63:2a:18", "network": {"id": "8a494051-b597-47cd-8d64-76f0be5760cc", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-162490382-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7944be2b6e2047f5a633242809f6f04e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee068b96-f3", "ovs_interfaceid": "ee068b96-f361-4cb1-afeb-d3db42848f50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7359ffbf-b953-480e-ae89-7ce5dda880a3", "address": "fa:16:3e:12:4b:11", "network": {"id": "e17a21e6-be31-4611-8f62-59327c8c4d9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1516543392", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7944be2b6e2047f5a633242809f6f04e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7359ffbf-b9", "ovs_interfaceid": "7359ffbf-b953-480e-ae89-7ce5dda880a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0184ea76-40a1-41f4-9a6f-e2ca6719b7ab", "address": "fa:16:3e:3b:f7:32", "network": {"id": "e17a21e6-be31-4611-8f62-59327c8c4d9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1516543392", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7944be2b6e2047f5a633242809f6f04e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0184ea76-40", "ovs_interfaceid": "0184ea76-40a1-41f4-9a6f-e2ca6719b7ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "38a409f9-0fb9-4505-9f74-bf2859e6f66c", "address": "fa:16:3e:8a:6f:5e", "network": {"id": "e17a21e6-be31-4611-8f62-59327c8c4d9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1516543392", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.115", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7944be2b6e2047f5a633242809f6f04e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38a409f9-0f", "ovs_interfaceid": "38a409f9-0fb9-4505-9f74-bf2859e6f66c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d86aca21-e67b-48e9-b8de-a1d618a5dfc7", "address": "fa:16:3e:bf:c2:bd", "network": {"id": "e17a21e6-be31-4611-8f62-59327c8c4d9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1516543392", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.131", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7944be2b6e2047f5a633242809f6f04e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd86aca21-e6", "ovs_interfaceid": "d86aca21-e67b-48e9-b8de-a1d618a5dfc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4c56104b-528f-40b8-931d-7619e413ab07", "address": "fa:16:3e:4d:d7:97", "network": {"id": "00ad9466-de22-4eb1-86c7-01667b94d2a9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1660110834", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7944be2b6e2047f5a633242809f6f04e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c56104b-52", "ovs_interfaceid": "4c56104b-528f-40b8-931d-7619e413ab07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "996e784d-bbe6-447b-8f1f-066ec34be989", "address": "fa:16:3e:41:c0:e2", "network": {"id": "00ad9466-de22-4eb1-86c7-01667b94d2a9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1660110834", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7944be2b6e2047f5a633242809f6f04e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap996e784d-bb", "ovs_interfaceid": "996e784d-bbe6-447b-8f1f-066ec34be989", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:47:32 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Releasing lock "refresh_cache-fdda34b5-280f-489d-baf5-bf21ac6dd6c9" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 15:47:32 user nova-compute[75337]: DEBUG nova.compute.manager [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Instance network_info: |[{"id": "ee068b96-f361-4cb1-afeb-d3db42848f50", "address": "fa:16:3e:63:2a:18", "network": {"id": "8a494051-b597-47cd-8d64-76f0be5760cc", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-162490382-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7944be2b6e2047f5a633242809f6f04e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee068b96-f3", "ovs_interfaceid": "ee068b96-f361-4cb1-afeb-d3db42848f50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7359ffbf-b953-480e-ae89-7ce5dda880a3", "address": "fa:16:3e:12:4b:11", "network": {"id": "e17a21e6-be31-4611-8f62-59327c8c4d9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1516543392", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7944be2b6e2047f5a633242809f6f04e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7359ffbf-b9", "ovs_interfaceid": "7359ffbf-b953-480e-ae89-7ce5dda880a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0184ea76-40a1-41f4-9a6f-e2ca6719b7ab", "address": "fa:16:3e:3b:f7:32", "network": {"id": "e17a21e6-be31-4611-8f62-59327c8c4d9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1516543392", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7944be2b6e2047f5a633242809f6f04e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0184ea76-40", "ovs_interfaceid": "0184ea76-40a1-41f4-9a6f-e2ca6719b7ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "38a409f9-0fb9-4505-9f74-bf2859e6f66c", "address": "fa:16:3e:8a:6f:5e", "network": {"id": "e17a21e6-be31-4611-8f62-59327c8c4d9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1516543392", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.115", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7944be2b6e2047f5a633242809f6f04e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38a409f9-0f", "ovs_interfaceid": "38a409f9-0fb9-4505-9f74-bf2859e6f66c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d86aca21-e67b-48e9-b8de-a1d618a5dfc7", "address": "fa:16:3e:bf:c2:bd", "network": {"id": "e17a21e6-be31-4611-8f62-59327c8c4d9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1516543392", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.131", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7944be2b6e2047f5a633242809f6f04e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd86aca21-e6", "ovs_interfaceid": "d86aca21-e67b-48e9-b8de-a1d618a5dfc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4c56104b-528f-40b8-931d-7619e413ab07", "address": "fa:16:3e:4d:d7:97", "network": {"id": "00ad9466-de22-4eb1-86c7-01667b94d2a9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1660110834", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7944be2b6e2047f5a633242809f6f04e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c56104b-52", "ovs_interfaceid": "4c56104b-528f-40b8-931d-7619e413ab07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "996e784d-bbe6-447b-8f1f-066ec34be989", "address": "fa:16:3e:41:c0:e2", "network": {"id": "00ad9466-de22-4eb1-86c7-01667b94d2a9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1660110834", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7944be2b6e2047f5a633242809f6f04e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap996e784d-bb", "ovs_interfaceid": "996e784d-bbe6-447b-8f1f-066ec34be989", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 15:47:32 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-3062ff36-b7f0-4e0a-a44b-c47139ab569d req-a0ae6a66-d167-4daf-a92e-345fb42550fa service nova] Acquired lock "refresh_cache-fdda34b5-280f-489d-baf5-bf21ac6dd6c9" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 15:47:32 user nova-compute[75337]: DEBUG nova.network.neutron [req-3062ff36-b7f0-4e0a-a44b-c47139ab569d req-a0ae6a66-d167-4daf-a92e-345fb42550fa service nova] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Refreshing network info cache for port 4c56104b-528f-40b8-931d-7619e413ab07 {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 15:47:33 user nova-compute[75337]: DEBUG nova.network.neutron [req-3062ff36-b7f0-4e0a-a44b-c47139ab569d req-a0ae6a66-d167-4daf-a92e-345fb42550fa service nova] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Updated VIF entry in instance network info cache for port 4c56104b-528f-40b8-931d-7619e413ab07. {{(pid=75337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 15:47:33 user nova-compute[75337]: DEBUG nova.network.neutron [req-3062ff36-b7f0-4e0a-a44b-c47139ab569d req-a0ae6a66-d167-4daf-a92e-345fb42550fa service nova] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Updating instance_info_cache with network_info: [{"id": "ee068b96-f361-4cb1-afeb-d3db42848f50", "address": "fa:16:3e:63:2a:18", "network": {"id": "8a494051-b597-47cd-8d64-76f0be5760cc", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-162490382-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7944be2b6e2047f5a633242809f6f04e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee068b96-f3", "ovs_interfaceid": "ee068b96-f361-4cb1-afeb-d3db42848f50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7359ffbf-b953-480e-ae89-7ce5dda880a3", "address": "fa:16:3e:12:4b:11", "network": {"id": "e17a21e6-be31-4611-8f62-59327c8c4d9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1516543392", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7944be2b6e2047f5a633242809f6f04e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7359ffbf-b9", "ovs_interfaceid": "7359ffbf-b953-480e-ae89-7ce5dda880a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0184ea76-40a1-41f4-9a6f-e2ca6719b7ab", "address": "fa:16:3e:3b:f7:32", "network": {"id": "e17a21e6-be31-4611-8f62-59327c8c4d9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1516543392", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7944be2b6e2047f5a633242809f6f04e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0184ea76-40", "ovs_interfaceid": "0184ea76-40a1-41f4-9a6f-e2ca6719b7ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "38a409f9-0fb9-4505-9f74-bf2859e6f66c", "address": "fa:16:3e:8a:6f:5e", "network": {"id": "e17a21e6-be31-4611-8f62-59327c8c4d9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1516543392", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.115", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7944be2b6e2047f5a633242809f6f04e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38a409f9-0f", "ovs_interfaceid": "38a409f9-0fb9-4505-9f74-bf2859e6f66c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d86aca21-e67b-48e9-b8de-a1d618a5dfc7", "address": "fa:16:3e:bf:c2:bd", "network": {"id": "e17a21e6-be31-4611-8f62-59327c8c4d9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1516543392", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.131", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7944be2b6e2047f5a633242809f6f04e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd86aca21-e6", "ovs_interfaceid": "d86aca21-e67b-48e9-b8de-a1d618a5dfc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4c56104b-528f-40b8-931d-7619e413ab07", "address": "fa:16:3e:4d:d7:97", "network": {"id": "00ad9466-de22-4eb1-86c7-01667b94d2a9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1660110834", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7944be2b6e2047f5a633242809f6f04e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c56104b-52", "ovs_interfaceid": "4c56104b-528f-40b8-931d-7619e413ab07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "996e784d-bbe6-447b-8f1f-066ec34be989", "address": "fa:16:3e:41:c0:e2", "network": {"id": "00ad9466-de22-4eb1-86c7-01667b94d2a9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1660110834", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7944be2b6e2047f5a633242809f6f04e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap996e784d-bb", "ovs_interfaceid": "996e784d-bbe6-447b-8f1f-066ec34be989", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:47:33 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-3062ff36-b7f0-4e0a-a44b-c47139ab569d req-a0ae6a66-d167-4daf-a92e-345fb42550fa service nova] Releasing lock "refresh_cache-fdda34b5-280f-489d-baf5-bf21ac6dd6c9" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 15:47:33 user nova-compute[75337]: DEBUG nova.compute.manager [req-3062ff36-b7f0-4e0a-a44b-c47139ab569d req-a0ae6a66-d167-4daf-a92e-345fb42550fa service nova] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Received event network-changed-996e784d-bbe6-447b-8f1f-066ec34be989 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:47:33 user nova-compute[75337]: DEBUG nova.compute.manager [req-3062ff36-b7f0-4e0a-a44b-c47139ab569d req-a0ae6a66-d167-4daf-a92e-345fb42550fa service nova] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Refreshing instance network info cache due to event network-changed-996e784d-bbe6-447b-8f1f-066ec34be989. {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 15:47:33 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-3062ff36-b7f0-4e0a-a44b-c47139ab569d req-a0ae6a66-d167-4daf-a92e-345fb42550fa service nova] Acquiring lock "refresh_cache-fdda34b5-280f-489d-baf5-bf21ac6dd6c9" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 15:47:33 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-3062ff36-b7f0-4e0a-a44b-c47139ab569d req-a0ae6a66-d167-4daf-a92e-345fb42550fa service nova] Acquired lock "refresh_cache-fdda34b5-280f-489d-baf5-bf21ac6dd6c9" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 15:47:33 user nova-compute[75337]: DEBUG nova.network.neutron [req-3062ff36-b7f0-4e0a-a44b-c47139ab569d req-a0ae6a66-d167-4daf-a92e-345fb42550fa service nova] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Refreshing network info cache for port 996e784d-bbe6-447b-8f1f-066ec34be989 {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 15:47:33 user nova-compute[75337]: DEBUG nova.network.neutron [req-3062ff36-b7f0-4e0a-a44b-c47139ab569d req-a0ae6a66-d167-4daf-a92e-345fb42550fa service nova] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Updated VIF entry in instance network info cache for port 996e784d-bbe6-447b-8f1f-066ec34be989. {{(pid=75337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 15:47:33 user nova-compute[75337]: DEBUG nova.network.neutron [req-3062ff36-b7f0-4e0a-a44b-c47139ab569d req-a0ae6a66-d167-4daf-a92e-345fb42550fa service nova] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Updating instance_info_cache with network_info: [{"id": "ee068b96-f361-4cb1-afeb-d3db42848f50", "address": "fa:16:3e:63:2a:18", "network": {"id": "8a494051-b597-47cd-8d64-76f0be5760cc", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-162490382-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7944be2b6e2047f5a633242809f6f04e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee068b96-f3", "ovs_interfaceid": "ee068b96-f361-4cb1-afeb-d3db42848f50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7359ffbf-b953-480e-ae89-7ce5dda880a3", "address": "fa:16:3e:12:4b:11", "network": {"id": "e17a21e6-be31-4611-8f62-59327c8c4d9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1516543392", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7944be2b6e2047f5a633242809f6f04e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7359ffbf-b9", "ovs_interfaceid": "7359ffbf-b953-480e-ae89-7ce5dda880a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0184ea76-40a1-41f4-9a6f-e2ca6719b7ab", "address": "fa:16:3e:3b:f7:32", "network": {"id": "e17a21e6-be31-4611-8f62-59327c8c4d9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1516543392", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7944be2b6e2047f5a633242809f6f04e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0184ea76-40", "ovs_interfaceid": "0184ea76-40a1-41f4-9a6f-e2ca6719b7ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "38a409f9-0fb9-4505-9f74-bf2859e6f66c", "address": "fa:16:3e:8a:6f:5e", "network": {"id": "e17a21e6-be31-4611-8f62-59327c8c4d9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1516543392", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.115", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7944be2b6e2047f5a633242809f6f04e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38a409f9-0f", "ovs_interfaceid": "38a409f9-0fb9-4505-9f74-bf2859e6f66c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d86aca21-e67b-48e9-b8de-a1d618a5dfc7", "address": "fa:16:3e:bf:c2:bd", "network": {"id": "e17a21e6-be31-4611-8f62-59327c8c4d9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1516543392", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.131", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7944be2b6e2047f5a633242809f6f04e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd86aca21-e6", "ovs_interfaceid": "d86aca21-e67b-48e9-b8de-a1d618a5dfc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4c56104b-528f-40b8-931d-7619e413ab07", "address": "fa:16:3e:4d:d7:97", "network": {"id": "00ad9466-de22-4eb1-86c7-01667b94d2a9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1660110834", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7944be2b6e2047f5a633242809f6f04e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c56104b-52", "ovs_interfaceid": "4c56104b-528f-40b8-931d-7619e413ab07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "996e784d-bbe6-447b-8f1f-066ec34be989", "address": "fa:16:3e:41:c0:e2", "network": {"id": "00ad9466-de22-4eb1-86c7-01667b94d2a9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1660110834", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7944be2b6e2047f5a633242809f6f04e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap996e784d-bb", "ovs_interfaceid": "996e784d-bbe6-447b-8f1f-066ec34be989", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:47:33 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-3062ff36-b7f0-4e0a-a44b-c47139ab569d req-a0ae6a66-d167-4daf-a92e-345fb42550fa service nova] Releasing lock "refresh_cache-fdda34b5-280f-489d-baf5-bf21ac6dd6c9" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 15:47:33 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:47:33 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:47:38 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:47:38 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:47:43 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:47:43 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:47:44 user nova-compute[75337]: DEBUG nova.compute.manager [req-af28426e-8adf-4118-a307-79668cbd99aa req-eb0f4924-2847-4333-8c64-a3a5cff5fdff service nova] [instance: 7a6b16de-4506-432f-97f9-f083243dc047] Received event volume-reimaged-15793a67-283e-461b-b16a-a42e1b3ea8e6 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:47:44 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-af28426e-8adf-4118-a307-79668cbd99aa req-eb0f4924-2847-4333-8c64-a3a5cff5fdff service nova] Acquiring lock "7a6b16de-4506-432f-97f9-f083243dc047-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:47:44 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-af28426e-8adf-4118-a307-79668cbd99aa req-eb0f4924-2847-4333-8c64-a3a5cff5fdff service nova] Lock "7a6b16de-4506-432f-97f9-f083243dc047-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:47:44 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-af28426e-8adf-4118-a307-79668cbd99aa req-eb0f4924-2847-4333-8c64-a3a5cff5fdff service nova] Lock "7a6b16de-4506-432f-97f9-f083243dc047-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:47:44 user nova-compute[75337]: DEBUG nova.compute.manager [req-af28426e-8adf-4118-a307-79668cbd99aa req-eb0f4924-2847-4333-8c64-a3a5cff5fdff service nova] [instance: 7a6b16de-4506-432f-97f9-f083243dc047] Processing event volume-reimaged-15793a67-283e-461b-b16a-a42e1b3ea8e6 {{(pid=75337) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10872}}
Nov 06 15:47:44 user nova-compute[75337]: DEBUG nova.compute.manager [None req-af28426e-8adf-4118-a307-79668cbd99aa tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] [instance: 7a6b16de-4506-432f-97f9-f083243dc047] Instance event wait completed in 34 seconds for volume-reimaged {{(pid=75337) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 15:47:44 user nova-compute[75337]: INFO nova.virt.block_device [None req-af28426e-8adf-4118-a307-79668cbd99aa tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] [instance: 7a6b16de-4506-432f-97f9-f083243dc047] Booting with volume 15793a67-283e-461b-b16a-a42e1b3ea8e6 at /dev/vda
Nov 06 15:47:47 user nova-compute[75337]: INFO nova.compute.manager [None req-803a08fd-f70a-4399-ae3b-6b7ba368bca8 tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] [instance: 581cf468-65e7-42e5-9250-c3d645577011] Took 16.91 seconds to detach 1 volumes for instance.
Nov 06 15:47:47 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-803a08fd-f70a-4399-ae3b-6b7ba368bca8 tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:47:47 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-803a08fd-f70a-4399-ae3b-6b7ba368bca8 tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:47:47 user nova-compute[75337]: DEBUG os_brick.utils [None req-af28426e-8adf-4118-a307-79668cbd99aa tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 15:47:47 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:47:47 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:47:47 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[d90cf197-36ee-42cc-a85a-bfb994d62af2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4ff6411e45b8\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:47:47 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:47:47 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:47:47 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d83c9a6-6f16-4461-9307-d0cda864193d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:47:47 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:47:47 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:47:47 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f49bd6d-7259-4c37-b0bb-e932d6f5bd7b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:47:47 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[872489fa-471e-4ed9-af49-02ecc6760ac1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:47:47 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-af28426e-8adf-4118-a307-79668cbd99aa tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] Running cmd (subprocess): nvme version {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:47:47 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-af28426e-8adf-4118-a307-79668cbd99aa tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] 'nvme version' failed. Not Retrying. {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 15:47:47 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.nvmeof [None req-af28426e-8adf-4118-a307-79668cbd99aa tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] nvme not present on system {{(pid=75337) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 15:47:47 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:47:47 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 15:47:47 user nova-compute[75337]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 15:47:47 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f04d352-e355-4e47-8aad-a4a7de0695ce]: (4, '') {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:47:47 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.lightos [None req-af28426e-8adf-4118-a307-79668cbd99aa tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75337) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 15:47:47 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.lightos [None req-af28426e-8adf-4118-a307-79668cbd99aa tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 15:47:47 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.lightos [None req-af28426e-8adf-4118-a307-79668cbd99aa tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] LIGHTOS: no hostnqn found. {{(pid=75337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 15:47:47 user nova-compute[75337]: DEBUG os_brick.utils [None req-af28426e-8adf-4118-a307-79668cbd99aa tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] <== get_connector_properties: return (157ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4ff6411e45b8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 15:47:47 user nova-compute[75337]: DEBUG nova.virt.block_device [None req-af28426e-8adf-4118-a307-79668cbd99aa tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] [instance: 7a6b16de-4506-432f-97f9-f083243dc047] Updating existing volume attachment record: dc77e98d-d76a-42fc-9341-816d6ebd2c18 {{(pid=75337) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 15:47:47 user nova-compute[75337]: INFO nova.virt.block_device [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Booting with volume 563526a2-6204-4264-91b7-041e6cadab23 at /dev/vdb
Nov 06 15:47:47 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-803a08fd-f70a-4399-ae3b-6b7ba368bca8 tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 15:47:47 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-803a08fd-f70a-4399-ae3b-6b7ba368bca8 tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 15:47:47 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-803a08fd-f70a-4399-ae3b-6b7ba368bca8 tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.523s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:47:47 user nova-compute[75337]: DEBUG os_brick.utils [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 15:47:47 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:47:48 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:47:48 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0b700ee-d096-48c3-b512-d09983c2952f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4ff6411e45b8\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:47:48 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:47:48 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:47:48 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[94c1b47d-5b6c-4aff-bf6f-301586434884]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:47:48 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:47:48 user nova-compute[75337]: INFO nova.scheduler.client.report [None req-803a08fd-f70a-4399-ae3b-6b7ba368bca8 tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Deleted allocations for instance 581cf468-65e7-42e5-9250-c3d645577011
Nov 06 15:47:48 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:47:48 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[99e1b5d6-d601-4bbe-9d71-2833a6e2d240]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:47:48 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b07ea5e-fbd2-47d6-9ded-fe81a73df061]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:47:48 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Running cmd (subprocess): nvme version {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:47:48 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] 'nvme version' failed. Not Retrying. {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 15:47:48 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] nvme not present on system {{(pid=75337) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 15:47:48 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:47:48 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 15:47:48 user nova-compute[75337]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 15:47:48 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[2798adc1-7c55-460c-b3a2-db44868d11ea]: (4, '') {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:47:48 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.lightos [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75337) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 15:47:48 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.lightos [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 15:47:48 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.lightos [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] LIGHTOS: no hostnqn found. {{(pid=75337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 15:47:48 user nova-compute[75337]: DEBUG os_brick.utils [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4ff6411e45b8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 15:47:48 user nova-compute[75337]: DEBUG nova.virt.block_device [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Updating existing volume attachment record: a68ab446-1dd1-4d43-8a95-1a2f76011570 {{(pid=75337) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 15:47:48 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-803a08fd-f70a-4399-ae3b-6b7ba368bca8 tempest-ServerActionsTestOtherB-464439480 tempest-ServerActionsTestOtherB-464439480-project-member] Lock "581cf468-65e7-42e5-9250-c3d645577011" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 20.396s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:47:48 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:47:48 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-7b793290-5c0d-48c3-9035-7930dc6a3ac0 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Acquiring lock "89f0a6eb-b68c-4760-9446-b77e80ebaf99" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:47:48 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-7b793290-5c0d-48c3-9035-7930dc6a3ac0 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Lock "89f0a6eb-b68c-4760-9446-b77e80ebaf99" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:47:48 user nova-compute[75337]: DEBUG nova.compute.manager [None req-7b793290-5c0d-48c3-9035-7930dc6a3ac0 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] [instance: 89f0a6eb-b68c-4760-9446-b77e80ebaf99] Starting instance... {{(pid=75337) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 15:47:48 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:47:49 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-7b793290-5c0d-48c3-9035-7930dc6a3ac0 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:47:49 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-7b793290-5c0d-48c3-9035-7930dc6a3ac0 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:47:49 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-7b793290-5c0d-48c3-9035-7930dc6a3ac0 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75337) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 15:47:49 user nova-compute[75337]: INFO nova.compute.claims [None req-7b793290-5c0d-48c3-9035-7930dc6a3ac0 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] [instance: 89f0a6eb-b68c-4760-9446-b77e80ebaf99] Claim successful on node user
Nov 06 15:47:49 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-7b793290-5c0d-48c3-9035-7930dc6a3ac0 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 15:47:49 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-7b793290-5c0d-48c3-9035-7930dc6a3ac0 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 15:47:49 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-7b793290-5c0d-48c3-9035-7930dc6a3ac0 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.473s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:47:49 user nova-compute[75337]: DEBUG nova.compute.manager [None req-7b793290-5c0d-48c3-9035-7930dc6a3ac0 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] [instance: 89f0a6eb-b68c-4760-9446-b77e80ebaf99] Start building networks asynchronously for instance. {{(pid=75337) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 15:47:49 user nova-compute[75337]: DEBUG nova.compute.manager [None req-7b793290-5c0d-48c3-9035-7930dc6a3ac0 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] [instance: 89f0a6eb-b68c-4760-9446-b77e80ebaf99] Allocating IP information in the background. {{(pid=75337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 15:47:49 user nova-compute[75337]: DEBUG nova.network.neutron [None req-7b793290-5c0d-48c3-9035-7930dc6a3ac0 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] [instance: 89f0a6eb-b68c-4760-9446-b77e80ebaf99] allocate_for_instance() {{(pid=75337) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 15:47:49 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-7b793290-5c0d-48c3-9035-7930dc6a3ac0 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] [instance: 89f0a6eb-b68c-4760-9446-b77e80ebaf99] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 15:47:49 user nova-compute[75337]: DEBUG nova.compute.manager [None req-7b793290-5c0d-48c3-9035-7930dc6a3ac0 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] [instance: 89f0a6eb-b68c-4760-9446-b77e80ebaf99] Start building block device mappings for instance. {{(pid=75337) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 15:47:49 user nova-compute[75337]: DEBUG nova.policy [None req-7b793290-5c0d-48c3-9035-7930dc6a3ac0 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '38d79821f1a8466fa7c925fcc0bfb778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2de62cc51864374a29a5d96584e8dd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75337) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 15:47:49 user nova-compute[75337]: DEBUG nova.compute.manager [None req-7b793290-5c0d-48c3-9035-7930dc6a3ac0 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] [instance: 89f0a6eb-b68c-4760-9446-b77e80ebaf99] Start spawning the instance on the hypervisor. {{(pid=75337) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 15:47:49 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-7b793290-5c0d-48c3-9035-7930dc6a3ac0 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] [instance: 89f0a6eb-b68c-4760-9446-b77e80ebaf99] Creating instance directory {{(pid=75337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 15:47:49 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-7b793290-5c0d-48c3-9035-7930dc6a3ac0 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] [instance: 89f0a6eb-b68c-4760-9446-b77e80ebaf99] Creating image(s)
Nov 06 15:47:49 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-7b793290-5c0d-48c3-9035-7930dc6a3ac0 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Acquiring lock "/opt/stack/data/nova/instances/89f0a6eb-b68c-4760-9446-b77e80ebaf99/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:47:49 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-7b793290-5c0d-48c3-9035-7930dc6a3ac0 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Lock "/opt/stack/data/nova/instances/89f0a6eb-b68c-4760-9446-b77e80ebaf99/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:47:49 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-7b793290-5c0d-48c3-9035-7930dc6a3ac0 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Lock "/opt/stack/data/nova/instances/89f0a6eb-b68c-4760-9446-b77e80ebaf99/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:47:49 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-7b793290-5c0d-48c3-9035-7930dc6a3ac0 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:47:49 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-7b793290-5c0d-48c3-9035-7930dc6a3ac0 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json" returned: 0 in 0.198s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:47:49 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-7b793290-5c0d-48c3-9035-7930dc6a3ac0 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Acquiring lock "06ba3c914798499e686c5ac75886932347225275" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:47:49 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-7b793290-5c0d-48c3-9035-7930dc6a3ac0 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Lock "06ba3c914798499e686c5ac75886932347225275" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:47:49 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-7b793290-5c0d-48c3-9035-7930dc6a3ac0 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:47:50 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-7b793290-5c0d-48c3-9035-7930dc6a3ac0 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json" returned: 0 in 0.230s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:47:50 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-7b793290-5c0d-48c3-9035-7930dc6a3ac0 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275,backing_fmt=raw /opt/stack/data/nova/instances/89f0a6eb-b68c-4760-9446-b77e80ebaf99/disk 1073741824 {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:47:50 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-7b793290-5c0d-48c3-9035-7930dc6a3ac0 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275,backing_fmt=raw /opt/stack/data/nova/instances/89f0a6eb-b68c-4760-9446-b77e80ebaf99/disk 1073741824" returned: 0 in 0.060s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:47:50 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-7b793290-5c0d-48c3-9035-7930dc6a3ac0 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Lock "06ba3c914798499e686c5ac75886932347225275" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.299s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:47:50 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-7b793290-5c0d-48c3-9035-7930dc6a3ac0 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:47:50 user nova-compute[75337]: DEBUG nova.network.neutron [None req-7b793290-5c0d-48c3-9035-7930dc6a3ac0 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] [instance: 89f0a6eb-b68c-4760-9446-b77e80ebaf99] Successfully created port: 3f6ab23d-3925-4cd7-b283-938c84152e65 {{(pid=75337) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 15:47:50 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-7b793290-5c0d-48c3-9035-7930dc6a3ac0 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json" returned: 0 in 0.256s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:47:50 user nova-compute[75337]: DEBUG nova.virt.disk.api [None req-7b793290-5c0d-48c3-9035-7930dc6a3ac0 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Checking if we can resize image /opt/stack/data/nova/instances/89f0a6eb-b68c-4760-9446-b77e80ebaf99/disk. size=1073741824 {{(pid=75337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 15:47:50 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-7b793290-5c0d-48c3-9035-7930dc6a3ac0 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89f0a6eb-b68c-4760-9446-b77e80ebaf99/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:47:50 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-7b793290-5c0d-48c3-9035-7930dc6a3ac0 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89f0a6eb-b68c-4760-9446-b77e80ebaf99/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:47:50 user nova-compute[75337]: DEBUG nova.virt.disk.api [None req-7b793290-5c0d-48c3-9035-7930dc6a3ac0 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Cannot resize image /opt/stack/data/nova/instances/89f0a6eb-b68c-4760-9446-b77e80ebaf99/disk to a smaller size. {{(pid=75337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 06 15:47:50 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-7b793290-5c0d-48c3-9035-7930dc6a3ac0 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] [instance: 89f0a6eb-b68c-4760-9446-b77e80ebaf99] Created local disks {{(pid=75337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 15:47:50 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-7b793290-5c0d-48c3-9035-7930dc6a3ac0 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] [instance: 89f0a6eb-b68c-4760-9446-b77e80ebaf99] Ensure instance console log exists: /opt/stack/data/nova/instances/89f0a6eb-b68c-4760-9446-b77e80ebaf99/console.log {{(pid=75337) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 15:47:50 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-7b793290-5c0d-48c3-9035-7930dc6a3ac0 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:47:50 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-7b793290-5c0d-48c3-9035-7930dc6a3ac0 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:47:50 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-7b793290-5c0d-48c3-9035-7930dc6a3ac0 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:47:51 user nova-compute[75337]: DEBUG nova.network.neutron [None req-7b793290-5c0d-48c3-9035-7930dc6a3ac0 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] [instance: 89f0a6eb-b68c-4760-9446-b77e80ebaf99] Successfully updated port: 3f6ab23d-3925-4cd7-b283-938c84152e65 {{(pid=75337) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 15:47:51 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-7b793290-5c0d-48c3-9035-7930dc6a3ac0 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Acquiring lock "refresh_cache-89f0a6eb-b68c-4760-9446-b77e80ebaf99" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 15:47:51 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-7b793290-5c0d-48c3-9035-7930dc6a3ac0 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Acquired lock "refresh_cache-89f0a6eb-b68c-4760-9446-b77e80ebaf99" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 15:47:51 user nova-compute[75337]: DEBUG nova.network.neutron [None req-7b793290-5c0d-48c3-9035-7930dc6a3ac0 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] [instance: 89f0a6eb-b68c-4760-9446-b77e80ebaf99] Building network info cache for instance {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 15:47:51 user nova-compute[75337]: DEBUG nova.compute.manager [req-7b636b9f-acf2-4591-b6b6-4029da9522c1 req-afd6f0f9-46eb-4679-87b8-9a1064c8e0f1 service nova] [instance: 89f0a6eb-b68c-4760-9446-b77e80ebaf99] Received event network-changed-3f6ab23d-3925-4cd7-b283-938c84152e65 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:47:51 user nova-compute[75337]: DEBUG nova.compute.manager [req-7b636b9f-acf2-4591-b6b6-4029da9522c1 req-afd6f0f9-46eb-4679-87b8-9a1064c8e0f1 service nova] [instance: 89f0a6eb-b68c-4760-9446-b77e80ebaf99] Refreshing instance network info cache due to event network-changed-3f6ab23d-3925-4cd7-b283-938c84152e65. {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 15:47:51 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-7b636b9f-acf2-4591-b6b6-4029da9522c1 req-afd6f0f9-46eb-4679-87b8-9a1064c8e0f1 service nova] Acquiring lock "refresh_cache-89f0a6eb-b68c-4760-9446-b77e80ebaf99" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 15:47:51 user nova-compute[75337]: DEBUG nova.network.neutron [None req-7b793290-5c0d-48c3-9035-7930dc6a3ac0 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] [instance: 89f0a6eb-b68c-4760-9446-b77e80ebaf99] Instance cache missing network info. {{(pid=75337) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 15:47:51 user nova-compute[75337]: DEBUG nova.network.neutron [None req-7b793290-5c0d-48c3-9035-7930dc6a3ac0 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] [instance: 89f0a6eb-b68c-4760-9446-b77e80ebaf99] Updating instance_info_cache with network_info: [{"id": "3f6ab23d-3925-4cd7-b283-938c84152e65", "address": "fa:16:3e:5b:a9:c6", "network": {"id": "c07dbf10-d5b5-40f4-b841-826ca6f505d8", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1886147547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2de62cc51864374a29a5d96584e8dd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f6ab23d-39", "ovs_interfaceid": "3f6ab23d-3925-4cd7-b283-938c84152e65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:47:51 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-7b793290-5c0d-48c3-9035-7930dc6a3ac0 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Releasing lock "refresh_cache-89f0a6eb-b68c-4760-9446-b77e80ebaf99" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 15:47:51 user nova-compute[75337]: DEBUG nova.compute.manager [None req-7b793290-5c0d-48c3-9035-7930dc6a3ac0 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] [instance: 89f0a6eb-b68c-4760-9446-b77e80ebaf99] Instance network_info: |[{"id": "3f6ab23d-3925-4cd7-b283-938c84152e65", "address": "fa:16:3e:5b:a9:c6", "network": {"id": "c07dbf10-d5b5-40f4-b841-826ca6f505d8", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1886147547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2de62cc51864374a29a5d96584e8dd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f6ab23d-39", "ovs_interfaceid": "3f6ab23d-3925-4cd7-b283-938c84152e65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 15:47:51 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-7b636b9f-acf2-4591-b6b6-4029da9522c1 req-afd6f0f9-46eb-4679-87b8-9a1064c8e0f1 service nova] Acquired lock "refresh_cache-89f0a6eb-b68c-4760-9446-b77e80ebaf99" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 15:47:51 user nova-compute[75337]: DEBUG nova.network.neutron [req-7b636b9f-acf2-4591-b6b6-4029da9522c1 req-afd6f0f9-46eb-4679-87b8-9a1064c8e0f1 service nova] [instance: 89f0a6eb-b68c-4760-9446-b77e80ebaf99] Refreshing network info cache for port 3f6ab23d-3925-4cd7-b283-938c84152e65 {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 15:47:51 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-7b793290-5c0d-48c3-9035-7930dc6a3ac0 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] [instance: 89f0a6eb-b68c-4760-9446-b77e80ebaf99] Start _get_guest_xml network_info=[{"id": "3f6ab23d-3925-4cd7-b283-938c84152e65", "address": "fa:16:3e:5b:a9:c6", "network": {"id": "c07dbf10-d5b5-40f4-b841-826ca6f505d8", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1886147547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2de62cc51864374a29a5d96584e8dd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f6ab23d-39", "ovs_interfaceid": "3f6ab23d-3925-4cd7-b283-938c84152e65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T15:34:14Z,direct_url=<?>,disk_format='qcow2',id=16b903ae-a40f-41a7-985b-4804cce92c62,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6549a15819f1469bbd5eeae8190e3d44',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T15:34:15Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'guest_format': None, 'size': 0, 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '16b903ae-a40f-41a7-985b-4804cce92c62'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 15:47:51 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-7b793290-5c0d-48c3-9035-7930dc6a3ac0 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 15:47:51 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-7b793290-5c0d-48c3-9035-7930dc6a3ac0 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 15:47:51 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-7b793290-5c0d-48c3-9035-7930dc6a3ac0 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 15:47:51 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-7b793290-5c0d-48c3-9035-7930dc6a3ac0 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] CPU controller missing on host. {{(pid=75337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 15:47:51 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-7b793290-5c0d-48c3-9035-7930dc6a3ac0 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 15:47:51 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-7b793290-5c0d-48c3-9035-7930dc6a3ac0 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] CPU controller found on host. {{(pid=75337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 15:47:51 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-7b793290-5c0d-48c3-9035-7930dc6a3ac0 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75337) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 15:47:51 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-7b793290-5c0d-48c3-9035-7930dc6a3ac0 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T15:34:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T15:34:14Z,direct_url=<?>,disk_format='qcow2',id=16b903ae-a40f-41a7-985b-4804cce92c62,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6549a15819f1469bbd5eeae8190e3d44',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T15:34:15Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 15:47:51 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-7b793290-5c0d-48c3-9035-7930dc6a3ac0 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Flavor limits 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 15:47:51 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-7b793290-5c0d-48c3-9035-7930dc6a3ac0 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Image limits 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 15:47:51 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-7b793290-5c0d-48c3-9035-7930dc6a3ac0 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Flavor pref 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 15:47:51 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-7b793290-5c0d-48c3-9035-7930dc6a3ac0 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Image pref 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 15:47:51 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-7b793290-5c0d-48c3-9035-7930dc6a3ac0 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 15:47:51 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-7b793290-5c0d-48c3-9035-7930dc6a3ac0 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 15:47:51 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-7b793290-5c0d-48c3-9035-7930dc6a3ac0 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 15:47:51 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-7b793290-5c0d-48c3-9035-7930dc6a3ac0 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Got 1 possible topologies {{(pid=75337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 15:47:51 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-7b793290-5c0d-48c3-9035-7930dc6a3ac0 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 15:47:51 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-7b793290-5c0d-48c3-9035-7930dc6a3ac0 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 15:47:51 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-7b793290-5c0d-48c3-9035-7930dc6a3ac0 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T15:47:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-2016745810',display_name='tempest-VolumesAdminNegativeTest-server-2016745810',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-2016745810',id=22,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f2de62cc51864374a29a5d96584e8dd1',ramdisk_id='',reservation_id='r-2kuld4k8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1559219265',owner_user_name='tempest-VolumesAdminNegativeTest-1559219265-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T15:47:50Z,user_data=None,user_id='38d79821f1a8466fa7c925fcc0bfb778',uuid=89f0a6eb-b68c-4760-9446-b77e80ebaf99,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3f6ab23d-3925-4cd7-b283-938c84152e65", "address": "fa:16:3e:5b:a9:c6", "network": {"id": "c07dbf10-d5b5-40f4-b841-826ca6f505d8", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1886147547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2de62cc51864374a29a5d96584e8dd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f6ab23d-39", "ovs_interfaceid": "3f6ab23d-3925-4cd7-b283-938c84152e65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75337) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 15:47:51 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-7b793290-5c0d-48c3-9035-7930dc6a3ac0 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Converting VIF {"id": "3f6ab23d-3925-4cd7-b283-938c84152e65", "address": "fa:16:3e:5b:a9:c6", "network": {"id": "c07dbf10-d5b5-40f4-b841-826ca6f505d8", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1886147547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2de62cc51864374a29a5d96584e8dd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f6ab23d-39", "ovs_interfaceid": "3f6ab23d-3925-4cd7-b283-938c84152e65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 15:47:51 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-7b793290-5c0d-48c3-9035-7930dc6a3ac0 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:a9:c6,bridge_name='br-int',has_traffic_filtering=True,id=3f6ab23d-3925-4cd7-b283-938c84152e65,network=Network(c07dbf10-d5b5-40f4-b841-826ca6f505d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f6ab23d-39') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 15:47:51 user nova-compute[75337]: DEBUG nova.objects.instance [None req-7b793290-5c0d-48c3-9035-7930dc6a3ac0 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Lazy-loading 'pci_devices' on Instance uuid 89f0a6eb-b68c-4760-9446-b77e80ebaf99 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 15:47:51 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-7b793290-5c0d-48c3-9035-7930dc6a3ac0 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] [instance: 89f0a6eb-b68c-4760-9446-b77e80ebaf99] End _get_guest_xml xml=<domain type="kvm">
Nov 06 15:47:51 user nova-compute[75337]:   <uuid>89f0a6eb-b68c-4760-9446-b77e80ebaf99</uuid>
Nov 06 15:47:51 user nova-compute[75337]:   <name>instance-00000016</name>
Nov 06 15:47:51 user nova-compute[75337]:   <memory>524288</memory>
Nov 06 15:47:51 user nova-compute[75337]:   <vcpu>1</vcpu>
Nov 06 15:47:51 user nova-compute[75337]:   <metadata>
Nov 06 15:47:51 user nova-compute[75337]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 15:47:51 user nova-compute[75337]:       <nova:package version="0.0.0"/>
Nov 06 15:47:51 user nova-compute[75337]:       <nova:name>tempest-VolumesAdminNegativeTest-server-2016745810</nova:name>
Nov 06 15:47:51 user nova-compute[75337]:       <nova:creationTime>2023-11-06 15:47:51</nova:creationTime>
Nov 06 15:47:51 user nova-compute[75337]:       <nova:flavor name="m1.tiny">
Nov 06 15:47:51 user nova-compute[75337]:         <nova:memory>512</nova:memory>
Nov 06 15:47:51 user nova-compute[75337]:         <nova:disk>1</nova:disk>
Nov 06 15:47:51 user nova-compute[75337]:         <nova:swap>0</nova:swap>
Nov 06 15:47:51 user nova-compute[75337]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 15:47:51 user nova-compute[75337]:         <nova:vcpus>1</nova:vcpus>
Nov 06 15:47:51 user nova-compute[75337]:       </nova:flavor>
Nov 06 15:47:51 user nova-compute[75337]:       <nova:owner>
Nov 06 15:47:51 user nova-compute[75337]:         <nova:user uuid="38d79821f1a8466fa7c925fcc0bfb778">tempest-VolumesAdminNegativeTest-1559219265-project-member</nova:user>
Nov 06 15:47:51 user nova-compute[75337]:         <nova:project uuid="f2de62cc51864374a29a5d96584e8dd1">tempest-VolumesAdminNegativeTest-1559219265</nova:project>
Nov 06 15:47:51 user nova-compute[75337]:       </nova:owner>
Nov 06 15:47:51 user nova-compute[75337]:       <nova:root type="image" uuid="16b903ae-a40f-41a7-985b-4804cce92c62"/>
Nov 06 15:47:51 user nova-compute[75337]:       <nova:ports>
Nov 06 15:47:51 user nova-compute[75337]:         <nova:port uuid="3f6ab23d-3925-4cd7-b283-938c84152e65">
Nov 06 15:47:51 user nova-compute[75337]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 06 15:47:51 user nova-compute[75337]:         </nova:port>
Nov 06 15:47:51 user nova-compute[75337]:       </nova:ports>
Nov 06 15:47:51 user nova-compute[75337]:     </nova:instance>
Nov 06 15:47:51 user nova-compute[75337]:   </metadata>
Nov 06 15:47:51 user nova-compute[75337]:   <sysinfo type="smbios">
Nov 06 15:47:51 user nova-compute[75337]:     <system>
Nov 06 15:47:51 user nova-compute[75337]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 15:47:51 user nova-compute[75337]:       <entry name="product">OpenStack Nova</entry>
Nov 06 15:47:51 user nova-compute[75337]:       <entry name="version">0.0.0</entry>
Nov 06 15:47:51 user nova-compute[75337]:       <entry name="serial">89f0a6eb-b68c-4760-9446-b77e80ebaf99</entry>
Nov 06 15:47:51 user nova-compute[75337]:       <entry name="uuid">89f0a6eb-b68c-4760-9446-b77e80ebaf99</entry>
Nov 06 15:47:51 user nova-compute[75337]:       <entry name="family">Virtual Machine</entry>
Nov 06 15:47:51 user nova-compute[75337]:     </system>
Nov 06 15:47:51 user nova-compute[75337]:   </sysinfo>
Nov 06 15:47:51 user nova-compute[75337]:   <os>
Nov 06 15:47:51 user nova-compute[75337]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 15:47:51 user nova-compute[75337]:     <boot dev="hd"/>
Nov 06 15:47:51 user nova-compute[75337]:     <smbios mode="sysinfo"/>
Nov 06 15:47:51 user nova-compute[75337]:   </os>
Nov 06 15:47:51 user nova-compute[75337]:   <features>
Nov 06 15:47:51 user nova-compute[75337]:     <acpi/>
Nov 06 15:47:51 user nova-compute[75337]:     <apic/>
Nov 06 15:47:51 user nova-compute[75337]:     <vmcoreinfo/>
Nov 06 15:47:51 user nova-compute[75337]:   </features>
Nov 06 15:47:51 user nova-compute[75337]:   <clock offset="utc">
Nov 06 15:47:51 user nova-compute[75337]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 15:47:51 user nova-compute[75337]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 15:47:51 user nova-compute[75337]:     <timer name="hpet" present="no"/>
Nov 06 15:47:51 user nova-compute[75337]:   </clock>
Nov 06 15:47:51 user nova-compute[75337]:   <cpu mode="custom" match="exact">
Nov 06 15:47:51 user nova-compute[75337]:     <model>Nehalem</model>
Nov 06 15:47:51 user nova-compute[75337]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 15:47:51 user nova-compute[75337]:   </cpu>
Nov 06 15:47:51 user nova-compute[75337]:   <devices>
Nov 06 15:47:51 user nova-compute[75337]:     <disk type="file" device="disk">
Nov 06 15:47:51 user nova-compute[75337]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 15:47:51 user nova-compute[75337]:       <source file="/opt/stack/data/nova/instances/89f0a6eb-b68c-4760-9446-b77e80ebaf99/disk"/>
Nov 06 15:47:51 user nova-compute[75337]:       <target dev="vda" bus="virtio"/>
Nov 06 15:47:51 user nova-compute[75337]:     </disk>
Nov 06 15:47:51 user nova-compute[75337]:     <interface type="ethernet">
Nov 06 15:47:51 user nova-compute[75337]:       <mac address="fa:16:3e:5b:a9:c6"/>
Nov 06 15:47:51 user nova-compute[75337]:       <model type="virtio"/>
Nov 06 15:47:51 user nova-compute[75337]:       <mtu size="1442"/>
Nov 06 15:47:51 user nova-compute[75337]:       <target dev="tap3f6ab23d-39"/>
Nov 06 15:47:51 user nova-compute[75337]:     </interface>
Nov 06 15:47:51 user nova-compute[75337]:     <serial type="pty">
Nov 06 15:47:51 user nova-compute[75337]:       <log file="/opt/stack/data/nova/instances/89f0a6eb-b68c-4760-9446-b77e80ebaf99/console.log" append="off"/>
Nov 06 15:47:51 user nova-compute[75337]:     </serial>
Nov 06 15:47:51 user nova-compute[75337]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 15:47:51 user nova-compute[75337]:     <video>
Nov 06 15:47:51 user nova-compute[75337]:       <model type="virtio"/>
Nov 06 15:47:51 user nova-compute[75337]:     </video>
Nov 06 15:47:51 user nova-compute[75337]:     <rng model="virtio">
Nov 06 15:47:51 user nova-compute[75337]:       <backend model="random">/dev/urandom</backend>
Nov 06 15:47:51 user nova-compute[75337]:     </rng>
Nov 06 15:47:51 user nova-compute[75337]:     <controller type="usb" index="0" model="none"/>
Nov 06 15:47:51 user nova-compute[75337]:     <memballoon model="virtio">
Nov 06 15:47:51 user nova-compute[75337]:       <stats period="10"/>
Nov 06 15:47:51 user nova-compute[75337]:     </memballoon>
Nov 06 15:47:51 user nova-compute[75337]:   </devices>
Nov 06 15:47:51 user nova-compute[75337]: </domain>
Nov 06 15:47:51 user nova-compute[75337]:  {{(pid=75337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 15:47:51 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-7b793290-5c0d-48c3-9035-7930dc6a3ac0 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T15:47:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-2016745810',display_name='tempest-VolumesAdminNegativeTest-server-2016745810',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-2016745810',id=22,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f2de62cc51864374a29a5d96584e8dd1',ramdisk_id='',reservation_id='r-2kuld4k8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1559219265',owner_user_name='tempest-VolumesAdminNegativeTest-1559219265-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T15:47:50Z,user_data=None,user_id='38d79821f1a8466fa7c925fcc0bfb778',uuid=89f0a6eb-b68c-4760-9446-b77e80ebaf99,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3f6ab23d-3925-4cd7-b283-938c84152e65", "address": "fa:16:3e:5b:a9:c6", "network": {"id": "c07dbf10-d5b5-40f4-b841-826ca6f505d8", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1886147547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2de62cc51864374a29a5d96584e8dd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f6ab23d-39", "ovs_interfaceid": "3f6ab23d-3925-4cd7-b283-938c84152e65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 15:47:51 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-7b793290-5c0d-48c3-9035-7930dc6a3ac0 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Converting VIF {"id": "3f6ab23d-3925-4cd7-b283-938c84152e65", "address": "fa:16:3e:5b:a9:c6", "network": {"id": "c07dbf10-d5b5-40f4-b841-826ca6f505d8", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1886147547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2de62cc51864374a29a5d96584e8dd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f6ab23d-39", "ovs_interfaceid": "3f6ab23d-3925-4cd7-b283-938c84152e65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 15:47:51 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-7b793290-5c0d-48c3-9035-7930dc6a3ac0 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:a9:c6,bridge_name='br-int',has_traffic_filtering=True,id=3f6ab23d-3925-4cd7-b283-938c84152e65,network=Network(c07dbf10-d5b5-40f4-b841-826ca6f505d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f6ab23d-39') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 15:47:51 user nova-compute[75337]: DEBUG os_vif [None req-7b793290-5c0d-48c3-9035-7930dc6a3ac0 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:a9:c6,bridge_name='br-int',has_traffic_filtering=True,id=3f6ab23d-3925-4cd7-b283-938c84152e65,network=Network(c07dbf10-d5b5-40f4-b841-826ca6f505d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f6ab23d-39') {{(pid=75337) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 15:47:51 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:47:51 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:47:51 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 15:47:51 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:47:51 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2d52b4df-0b40-5750-9fd3-e43b4ecf8cf1', '_type': 'linux-noop'}}, row=False) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:47:51 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:47:51 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:47:51 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:47:51 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3f6ab23d-39, may_exist=True, interface_attrs={}) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:47:51 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3f6ab23d-39, col_values=(('qos', UUID('21a58705-f9a5-4aeb-9071-03bf1a83dc98')),), if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:47:51 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3f6ab23d-39, col_values=(('external_ids', {'iface-id': '3f6ab23d-3925-4cd7-b283-938c84152e65', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5b:a9:c6', 'vm-uuid': '89f0a6eb-b68c-4760-9446-b77e80ebaf99'}),), if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:47:51 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:47:51 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:47:51 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:47:51 user nova-compute[75337]: INFO os_vif [None req-7b793290-5c0d-48c3-9035-7930dc6a3ac0 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:a9:c6,bridge_name='br-int',has_traffic_filtering=True,id=3f6ab23d-3925-4cd7-b283-938c84152e65,network=Network(c07dbf10-d5b5-40f4-b841-826ca6f505d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f6ab23d-39')
Nov 06 15:47:52 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-7b793290-5c0d-48c3-9035-7930dc6a3ac0 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] No BDM found with device name vda, not building metadata. {{(pid=75337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 15:47:52 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-7b793290-5c0d-48c3-9035-7930dc6a3ac0 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] No VIF found with MAC fa:16:3e:5b:a9:c6, not building metadata {{(pid=75337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 15:47:52 user nova-compute[75337]: DEBUG nova.network.neutron [req-7b636b9f-acf2-4591-b6b6-4029da9522c1 req-afd6f0f9-46eb-4679-87b8-9a1064c8e0f1 service nova] [instance: 89f0a6eb-b68c-4760-9446-b77e80ebaf99] Updated VIF entry in instance network info cache for port 3f6ab23d-3925-4cd7-b283-938c84152e65. {{(pid=75337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 15:47:52 user nova-compute[75337]: DEBUG nova.network.neutron [req-7b636b9f-acf2-4591-b6b6-4029da9522c1 req-afd6f0f9-46eb-4679-87b8-9a1064c8e0f1 service nova] [instance: 89f0a6eb-b68c-4760-9446-b77e80ebaf99] Updating instance_info_cache with network_info: [{"id": "3f6ab23d-3925-4cd7-b283-938c84152e65", "address": "fa:16:3e:5b:a9:c6", "network": {"id": "c07dbf10-d5b5-40f4-b841-826ca6f505d8", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1886147547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2de62cc51864374a29a5d96584e8dd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f6ab23d-39", "ovs_interfaceid": "3f6ab23d-3925-4cd7-b283-938c84152e65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:47:52 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-7b636b9f-acf2-4591-b6b6-4029da9522c1 req-afd6f0f9-46eb-4679-87b8-9a1064c8e0f1 service nova] Releasing lock "refresh_cache-89f0a6eb-b68c-4760-9446-b77e80ebaf99" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 15:47:52 user nova-compute[75337]: DEBUG nova.compute.manager [None req-f4e88c6d-10cc-4f7a-b79b-2fcda050a895 tempest-TestVolumeSwap-916912695 tempest-TestVolumeSwap-916912695-project-admin] [instance: 9125364b-332f-4297-815f-3aa1eadaf743] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b1421f55-d453-441d-bdf7-3743102662b6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vVbIPGuJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9125364b-332f-4297-815f-3aa1eadaf743', 'attached_at': '', 'detached_at': '', 'volume_id': 'b1421f55-d453-441d-bdf7-3743102662b6', 'serial': 'b1421f55-d453-441d-bdf7-3743102662b6'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0c5fa35a-1ba5-4390-9102-83ac1dbb790a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nkapcTJV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '9125364b-332f-4297-815f-3aa1eadaf743', 'attached_at': '', 'detached_at': '', 'volume_id': '0c5fa35a-1ba5-4390-9102-83ac1dbb790a', 'serial'} {{(pid=75337) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 06 15:47:52 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f4e88c6d-10cc-4f7a-b79b-2fcda050a895 tempest-TestVolumeSwap-916912695 tempest-TestVolumeSwap-916912695-project-admin] [instance: 9125364b-332f-4297-815f-3aa1eadaf743] Calling os-brick to attach iSCSI Volume {{(pid=75337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 15:47:52 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4e88c6d-10cc-4f7a-b79b-2fcda050a895 tempest-TestVolumeSwap-916912695 tempest-TestVolumeSwap-916912695-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2abc33d0c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b1421f55-d453-441d-bdf7-3743102662b6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vVbIPGuJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 15:47:52 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-f4e88c6d-10cc-4f7a-b79b-2fcda050a895 tempest-TestVolumeSwap-916912695 tempest-TestVolumeSwap-916912695-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 15:47:52 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-f4e88c6d-10cc-4f7a-b79b-2fcda050a895 tempest-TestVolumeSwap-916912695 tempest-TestVolumeSwap-916912695-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 15:47:52 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-f4e88c6d-10cc-4f7a-b79b-2fcda050a895 tempest-TestVolumeSwap-916912695 tempest-TestVolumeSwap-916912695-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 15:47:52 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-f4e88c6d-10cc-4f7a-b79b-2fcda050a895 tempest-TestVolumeSwap-916912695 tempest-TestVolumeSwap-916912695-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 15:47:52 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-f4e88c6d-10cc-4f7a-b79b-2fcda050a895 tempest-TestVolumeSwap-916912695 tempest-TestVolumeSwap-916912695-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b1421f55-d453-441d-bdf7-3743102662b6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 15:47:52 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-f4e88c6d-10cc-4f7a-b79b-2fcda050a895 tempest-TestVolumeSwap-916912695 tempest-TestVolumeSwap-916912695-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b1421f55-d453-441d-bdf7-3743102662b6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 15:47:52 user nova-compute[75337]: INFO os_brick.initiator.connectors.iscsi [None req-f4e88c6d-10cc-4f7a-b79b-2fcda050a895 tempest-TestVolumeSwap-916912695 tempest-TestVolumeSwap-916912695-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 15:47:52 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1421f55-d453-441d-bdf7-3743102662b6 -p 172.16.0.220:3260 {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:47:52 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1421f55-d453-441d-bdf7-3743102662b6 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:47:52 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e125e4a-8b33-4927-9873-b109818f4edc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:47:52 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4e88c6d-10cc-4f7a-b79b-2fcda050a895 tempest-TestVolumeSwap-916912695 tempest-TestVolumeSwap-916912695-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 15:47:52 user nova-compute[75337]:  {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:47:52 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1421f55-d453-441d-bdf7-3743102662b6 -p 172.16.0.220:3260 --interface default --op new {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:47:52 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1421f55-d453-441d-bdf7-3743102662b6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:47:52 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[945e194c-78ea-40af-a635-2dfc4d28d0a8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b1421f55-d453-441d-bdf7-3743102662b6] added\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:47:52 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4e88c6d-10cc-4f7a-b79b-2fcda050a895 tempest-TestVolumeSwap-916912695 tempest-TestVolumeSwap-916912695-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b1421f55-d453-441d-bdf7-3743102662b6] added
Nov 06 15:47:52 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:47:52 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1421f55-d453-441d-bdf7-3743102662b6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:47:52 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1421f55-d453-441d-bdf7-3743102662b6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:47:52 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b196ca9-8567-434b-bae1-f83bf5b04845]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:47:52 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4e88c6d-10cc-4f7a-b79b-2fcda050a895 tempest-TestVolumeSwap-916912695 tempest-TestVolumeSwap-916912695-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:47:52 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1421f55-d453-441d-bdf7-3743102662b6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:47:52 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1421f55-d453-441d-bdf7-3743102662b6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:47:52 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[b15ece4b-9dde-4d96-a2e0-ecb81693ff88]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:47:52 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4e88c6d-10cc-4f7a-b79b-2fcda050a895 tempest-TestVolumeSwap-916912695 tempest-TestVolumeSwap-916912695-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:47:52 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1421f55-d453-441d-bdf7-3743102662b6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vVbIPGuJ {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:47:52 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1421f55-d453-441d-bdf7-3743102662b6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vVbIPGuJ" returned: 0 in 0.020s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:47:52 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[14bc99a1-86ca-4124-86c4-b6272e8b1679]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:47:52 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4e88c6d-10cc-4f7a-b79b-2fcda050a895 tempest-TestVolumeSwap-916912695 tempest-TestVolumeSwap-916912695-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vVbIPGuJ'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:47:52 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1421f55-d453-441d-bdf7-3743102662b6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:47:52 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1421f55-d453-441d-bdf7-3743102662b6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:47:52 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[09a522d3-d466-48d1-83cf-474c37042700]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:47:52 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4e88c6d-10cc-4f7a-b79b-2fcda050a895 tempest-TestVolumeSwap-916912695 tempest-TestVolumeSwap-916912695-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:47:52 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:47:52 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:47:52 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce9d5c5e-6a8c-4c0a-8645-f2f064a74452]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c5fa35a-1ba5-4390-9102-83ac1dbb790a (non-flash)\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:47:52 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4e88c6d-10cc-4f7a-b79b-2fcda050a895 tempest-TestVolumeSwap-916912695 tempest-TestVolumeSwap-916912695-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)
Nov 06 15:47:52 user nova-compute[75337]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c5fa35a-1ba5-4390-9102-83ac1dbb790a (non-flash)
Nov 06 15:47:52 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 15:47:52 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4e88c6d-10cc-4f7a-b79b-2fcda050a895 tempest-TestVolumeSwap-916912695 tempest-TestVolumeSwap-916912695-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)
Nov 06 15:47:52 user nova-compute[75337]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c5fa35a-1ba5-4390-9102-83ac1dbb790a (non-flash)
Nov 06 15:47:52 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 15:47:52 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1421f55-d453-441d-bdf7-3743102662b6 -p 172.16.0.220:3260 --login {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:47:52 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1421f55-d453-441d-bdf7-3743102662b6 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:47:52 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[5543e693-d5fe-4d89-90c1-436f6c790a61]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b1421f55-d453-441d-bdf7-3743102662b6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b1421f55-d453-441d-bdf7-3743102662b6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:47:52 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4e88c6d-10cc-4f7a-b79b-2fcda050a895 tempest-TestVolumeSwap-916912695 tempest-TestVolumeSwap-916912695-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b1421f55-d453-441d-bdf7-3743102662b6, portal: 172.16.0.220,3260]
Nov 06 15:47:52 user nova-compute[75337]: Login to [iface: default, target: iqn.2010-10.org.openstack:b1421f55-d453-441d-bdf7-3743102662b6, portal: 172.16.0.220,3260] successful.
Nov 06 15:47:52 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:47:52 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1421f55-d453-441d-bdf7-3743102662b6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:47:52 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1421f55-d453-441d-bdf7-3743102662b6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:47:52 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[e865b1fb-17e2-4901-827c-eb30eb45da49]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:47:52 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4e88c6d-10cc-4f7a-b79b-2fcda050a895 tempest-TestVolumeSwap-916912695 tempest-TestVolumeSwap-916912695-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:47:52 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:47:52 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:47:52 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a2b17de-c664-4e5a-bd36-9e045111ffe2]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c5fa35a-1ba5-4390-9102-83ac1dbb790a (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1421f55-d453-441d-bdf7-3743102662b6 (non-flash)\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:47:52 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4e88c6d-10cc-4f7a-b79b-2fcda050a895 tempest-TestVolumeSwap-916912695 tempest-TestVolumeSwap-916912695-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)
Nov 06 15:47:52 user nova-compute[75337]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c5fa35a-1ba5-4390-9102-83ac1dbb790a (non-flash)
Nov 06 15:47:52 user nova-compute[75337]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1421f55-d453-441d-bdf7-3743102662b6 (non-flash)
Nov 06 15:47:52 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 15:47:52 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4e88c6d-10cc-4f7a-b79b-2fcda050a895 tempest-TestVolumeSwap-916912695 tempest-TestVolumeSwap-916912695-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)
Nov 06 15:47:52 user nova-compute[75337]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c5fa35a-1ba5-4390-9102-83ac1dbb790a (non-flash)
Nov 06 15:47:52 user nova-compute[75337]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1421f55-d453-441d-bdf7-3743102662b6 (non-flash)
Nov 06 15:47:52 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 15:47:52 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-f4e88c6d-10cc-4f7a-b79b-2fcda050a895 tempest-TestVolumeSwap-916912695 tempest-TestVolumeSwap-916912695-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b1421f55-d453-441d-bdf7-3743102662b6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.296s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 15:47:52 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4e88c6d-10cc-4f7a-b79b-2fcda050a895 tempest-TestVolumeSwap-916912695 tempest-TestVolumeSwap-916912695-project-admin] Connected to 172.16.0.220:3260 {{(pid=75337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 15:47:52 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-f4e88c6d-10cc-4f7a-b79b-2fcda050a895 tempest-TestVolumeSwap-916912695 tempest-TestVolumeSwap-916912695-project-admin] HCTL ('33', '-', '-', 0) found on session 21 with lun 0 {{(pid=75337) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 15:47:52 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-f4e88c6d-10cc-4f7a-b79b-2fcda050a895 tempest-TestVolumeSwap-916912695 tempest-TestVolumeSwap-916912695-project-admin] Scanning host 33 c: -, t: -, l: 0) {{(pid=75337) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 15:47:52 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:47:52 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:47:52 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a8d89c9-5c50-4dbb-b22f-af6685e105ba]: (4, ('- - 0', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:47:52 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-f4e88c6d-10cc-4f7a-b79b-2fcda050a895 tempest-TestVolumeSwap-916912695 tempest-TestVolumeSwap-916912695-project-admin] Searching for a device in session 21 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75337) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 15:47:52 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4e88c6d-10cc-4f7a-b79b-2fcda050a895 tempest-TestVolumeSwap-916912695 tempest-TestVolumeSwap-916912695-project-admin] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:b1421f55-d453-441d-bdf7-3743102662b6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vVbIPGuJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 15:47:53 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:47:53 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:47:53 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:47:53 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:47:53 user nova-compute[75337]: DEBUG nova.compute.manager [req-0b1b428b-9bd2-4696-b478-5ff99cb9403c req-a03c9783-7541-4cd5-9070-cc8b6be45ddc service nova] [instance: 89f0a6eb-b68c-4760-9446-b77e80ebaf99] Received event network-vif-plugged-3f6ab23d-3925-4cd7-b283-938c84152e65 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:47:53 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-0b1b428b-9bd2-4696-b478-5ff99cb9403c req-a03c9783-7541-4cd5-9070-cc8b6be45ddc service nova] Acquiring lock "89f0a6eb-b68c-4760-9446-b77e80ebaf99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:47:53 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-0b1b428b-9bd2-4696-b478-5ff99cb9403c req-a03c9783-7541-4cd5-9070-cc8b6be45ddc service nova] Lock "89f0a6eb-b68c-4760-9446-b77e80ebaf99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:47:53 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-0b1b428b-9bd2-4696-b478-5ff99cb9403c req-a03c9783-7541-4cd5-9070-cc8b6be45ddc service nova] Lock "89f0a6eb-b68c-4760-9446-b77e80ebaf99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:47:53 user nova-compute[75337]: DEBUG nova.compute.manager [req-0b1b428b-9bd2-4696-b478-5ff99cb9403c req-a03c9783-7541-4cd5-9070-cc8b6be45ddc service nova] [instance: 89f0a6eb-b68c-4760-9446-b77e80ebaf99] No waiting events found dispatching network-vif-plugged-3f6ab23d-3925-4cd7-b283-938c84152e65 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:47:53 user nova-compute[75337]: WARNING nova.compute.manager [req-0b1b428b-9bd2-4696-b478-5ff99cb9403c req-a03c9783-7541-4cd5-9070-cc8b6be45ddc service nova] [instance: 89f0a6eb-b68c-4760-9446-b77e80ebaf99] Received unexpected event network-vif-plugged-3f6ab23d-3925-4cd7-b283-938c84152e65 for instance with vm_state building and task_state spawning.
Nov 06 15:47:53 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:47:53 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:47:53 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-f4e88c6d-10cc-4f7a-b79b-2fcda050a895 tempest-TestVolumeSwap-916912695 tempest-TestVolumeSwap-916912695-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.329s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 15:47:53 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4e88c6d-10cc-4f7a-b79b-2fcda050a895 tempest-TestVolumeSwap-916912695 tempest-TestVolumeSwap-916912695-project-admin] <== connect_volume: return (1331ms) {'type': 'block', 'scsi_wwn': '23230333432303166', 'path': '/dev/sdb'} {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 15:47:53 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f4e88c6d-10cc-4f7a-b79b-2fcda050a895 tempest-TestVolumeSwap-916912695 tempest-TestVolumeSwap-916912695-project-admin] [instance: 9125364b-332f-4297-815f-3aa1eadaf743] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23230333432303166', 'path': '/dev/sdb'} {{(pid=75337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 15:47:53 user nova-compute[75337]: DEBUG nova.objects.instance [None req-f4e88c6d-10cc-4f7a-b79b-2fcda050a895 tempest-TestVolumeSwap-916912695 tempest-TestVolumeSwap-916912695-project-admin] Lazy-loading 'flavor' on Instance uuid 9125364b-332f-4297-815f-3aa1eadaf743 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 15:47:53 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:47:54 user nova-compute[75337]: DEBUG nova.virt.libvirt.guest [None req-f4e88c6d-10cc-4f7a-b79b-2fcda050a895 tempest-TestVolumeSwap-916912695 tempest-TestVolumeSwap-916912695-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=75337) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 06 15:47:54 user nova-compute[75337]: DEBUG nova.virt.libvirt.guest [None req-f4e88c6d-10cc-4f7a-b79b-2fcda050a895 tempest-TestVolumeSwap-916912695 tempest-TestVolumeSwap-916912695-project-admin] COPY block job progress, current cursor: 82837504 final cursor: 1073741824 {{(pid=75337) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 06 15:47:55 user nova-compute[75337]: DEBUG nova.virt.libvirt.guest [None req-f4e88c6d-10cc-4f7a-b79b-2fcda050a895 tempest-TestVolumeSwap-916912695 tempest-TestVolumeSwap-916912695-project-admin] COPY block job progress, current cursor: 167772160 final cursor: 1073741824 {{(pid=75337) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 06 15:47:55 user nova-compute[75337]: DEBUG nova.compute.manager [req-ec42729c-7179-4c6a-8b6d-306838bbe3ee req-1f4ac709-e285-4447-8241-9d2c226e0f93 service nova] [instance: 89f0a6eb-b68c-4760-9446-b77e80ebaf99] Received event network-vif-plugged-3f6ab23d-3925-4cd7-b283-938c84152e65 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:47:55 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-ec42729c-7179-4c6a-8b6d-306838bbe3ee req-1f4ac709-e285-4447-8241-9d2c226e0f93 service nova] Acquiring lock "89f0a6eb-b68c-4760-9446-b77e80ebaf99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:47:55 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-ec42729c-7179-4c6a-8b6d-306838bbe3ee req-1f4ac709-e285-4447-8241-9d2c226e0f93 service nova] Lock "89f0a6eb-b68c-4760-9446-b77e80ebaf99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:47:55 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-ec42729c-7179-4c6a-8b6d-306838bbe3ee req-1f4ac709-e285-4447-8241-9d2c226e0f93 service nova] Lock "89f0a6eb-b68c-4760-9446-b77e80ebaf99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:47:55 user nova-compute[75337]: DEBUG nova.compute.manager [req-ec42729c-7179-4c6a-8b6d-306838bbe3ee req-1f4ac709-e285-4447-8241-9d2c226e0f93 service nova] [instance: 89f0a6eb-b68c-4760-9446-b77e80ebaf99] No waiting events found dispatching network-vif-plugged-3f6ab23d-3925-4cd7-b283-938c84152e65 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:47:55 user nova-compute[75337]: WARNING nova.compute.manager [req-ec42729c-7179-4c6a-8b6d-306838bbe3ee req-1f4ac709-e285-4447-8241-9d2c226e0f93 service nova] [instance: 89f0a6eb-b68c-4760-9446-b77e80ebaf99] Received unexpected event network-vif-plugged-3f6ab23d-3925-4cd7-b283-938c84152e65 for instance with vm_state building and task_state spawning.
Nov 06 15:47:55 user nova-compute[75337]: DEBUG nova.virt.libvirt.guest [None req-f4e88c6d-10cc-4f7a-b79b-2fcda050a895 tempest-TestVolumeSwap-916912695 tempest-TestVolumeSwap-916912695-project-admin] COPY block job progress, current cursor: 298844160 final cursor: 1073741824 {{(pid=75337) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 06 15:47:55 user nova-compute[75337]: DEBUG nova.compute.manager [None req-7b793290-5c0d-48c3-9035-7930dc6a3ac0 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] [instance: 89f0a6eb-b68c-4760-9446-b77e80ebaf99] Instance event wait completed in 0 seconds for  {{(pid=75337) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 15:47:55 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-7b793290-5c0d-48c3-9035-7930dc6a3ac0 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] [instance: 89f0a6eb-b68c-4760-9446-b77e80ebaf99] Guest created on hypervisor {{(pid=75337) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 15:47:55 user nova-compute[75337]: INFO nova.virt.libvirt.driver [-] [instance: 89f0a6eb-b68c-4760-9446-b77e80ebaf99] Instance spawned successfully.
Nov 06 15:47:55 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-7b793290-5c0d-48c3-9035-7930dc6a3ac0 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] [instance: 89f0a6eb-b68c-4760-9446-b77e80ebaf99] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 15:47:55 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-7b793290-5c0d-48c3-9035-7930dc6a3ac0 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] [instance: 89f0a6eb-b68c-4760-9446-b77e80ebaf99] Found default for hw_cdrom_bus of ide {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:47:55 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-7b793290-5c0d-48c3-9035-7930dc6a3ac0 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] [instance: 89f0a6eb-b68c-4760-9446-b77e80ebaf99] Found default for hw_disk_bus of virtio {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:47:55 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-7b793290-5c0d-48c3-9035-7930dc6a3ac0 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] [instance: 89f0a6eb-b68c-4760-9446-b77e80ebaf99] Found default for hw_input_bus of None {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:47:55 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-7b793290-5c0d-48c3-9035-7930dc6a3ac0 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] [instance: 89f0a6eb-b68c-4760-9446-b77e80ebaf99] Found default for hw_pointer_model of None {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:47:55 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-7b793290-5c0d-48c3-9035-7930dc6a3ac0 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] [instance: 89f0a6eb-b68c-4760-9446-b77e80ebaf99] Found default for hw_video_model of virtio {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:47:55 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-7b793290-5c0d-48c3-9035-7930dc6a3ac0 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] [instance: 89f0a6eb-b68c-4760-9446-b77e80ebaf99] Found default for hw_vif_model of virtio {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:47:56 user nova-compute[75337]: INFO nova.compute.manager [None req-7b793290-5c0d-48c3-9035-7930dc6a3ac0 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] [instance: 89f0a6eb-b68c-4760-9446-b77e80ebaf99] Took 6.32 seconds to spawn the instance on the hypervisor.
Nov 06 15:47:56 user nova-compute[75337]: DEBUG nova.compute.manager [None req-7b793290-5c0d-48c3-9035-7930dc6a3ac0 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] [instance: 89f0a6eb-b68c-4760-9446-b77e80ebaf99] Checking state {{(pid=75337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 15:47:56 user nova-compute[75337]: DEBUG nova.virt.libvirt.guest [None req-f4e88c6d-10cc-4f7a-b79b-2fcda050a895 tempest-TestVolumeSwap-916912695 tempest-TestVolumeSwap-916912695-project-admin] COPY block job progress, current cursor: 368050176 final cursor: 1073741824 {{(pid=75337) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 06 15:47:56 user nova-compute[75337]: INFO nova.compute.manager [None req-7b793290-5c0d-48c3-9035-7930dc6a3ac0 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] [instance: 89f0a6eb-b68c-4760-9446-b77e80ebaf99] Took 7.39 seconds to build instance.
Nov 06 15:47:56 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-7b793290-5c0d-48c3-9035-7930dc6a3ac0 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Lock "89f0a6eb-b68c-4760-9446-b77e80ebaf99" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.510s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:47:56 user nova-compute[75337]: DEBUG nova.virt.libvirt.guest [None req-f4e88c6d-10cc-4f7a-b79b-2fcda050a895 tempest-TestVolumeSwap-916912695 tempest-TestVolumeSwap-916912695-project-admin] COPY block job progress, current cursor: 475004928 final cursor: 1073741824 {{(pid=75337) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 06 15:47:56 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:47:57 user nova-compute[75337]: DEBUG nova.virt.libvirt.guest [None req-f4e88c6d-10cc-4f7a-b79b-2fcda050a895 tempest-TestVolumeSwap-916912695 tempest-TestVolumeSwap-916912695-project-admin] COPY block job progress, current cursor: 596639744 final cursor: 1073741824 {{(pid=75337) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 06 15:47:57 user nova-compute[75337]: DEBUG nova.virt.libvirt.guest [None req-f4e88c6d-10cc-4f7a-b79b-2fcda050a895 tempest-TestVolumeSwap-916912695 tempest-TestVolumeSwap-916912695-project-admin] COPY block job progress, current cursor: 746586112 final cursor: 1073741824 {{(pid=75337) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 06 15:47:58 user nova-compute[75337]: DEBUG nova.virt.libvirt.guest [None req-f4e88c6d-10cc-4f7a-b79b-2fcda050a895 tempest-TestVolumeSwap-916912695 tempest-TestVolumeSwap-916912695-project-admin] COPY block job progress, current cursor: 865075200 final cursor: 1073741824 {{(pid=75337) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 06 15:47:58 user nova-compute[75337]: DEBUG nova.virt.libvirt.guest [None req-f4e88c6d-10cc-4f7a-b79b-2fcda050a895 tempest-TestVolumeSwap-916912695 tempest-TestVolumeSwap-916912695-project-admin] COPY block job progress, current cursor: 993001472 final cursor: 1073741824 {{(pid=75337) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 06 15:47:58 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:47:59 user nova-compute[75337]: DEBUG nova.virt.libvirt.guest [None req-f4e88c6d-10cc-4f7a-b79b-2fcda050a895 tempest-TestVolumeSwap-916912695 tempest-TestVolumeSwap-916912695-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=75337) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 06 15:47:59 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f4e88c6d-10cc-4f7a-b79b-2fcda050a895 tempest-TestVolumeSwap-916912695 tempest-TestVolumeSwap-916912695-project-admin] [instance: 9125364b-332f-4297-815f-3aa1eadaf743] calling os-brick to detach iSCSI Volume {{(pid=75337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 15:47:59 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4e88c6d-10cc-4f7a-b79b-2fcda050a895 tempest-TestVolumeSwap-916912695 tempest-TestVolumeSwap-916912695-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2abc33d0c0>, {'target_iqn': 'iqn.2010-10.org.openstack:0c5fa35a-1ba5-4390-9102-83ac1dbb790a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nkapcTJV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 15:47:59 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-f4e88c6d-10cc-4f7a-b79b-2fcda050a895 tempest-TestVolumeSwap-916912695 tempest-TestVolumeSwap-916912695-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 15:47:59 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-f4e88c6d-10cc-4f7a-b79b-2fcda050a895 tempest-TestVolumeSwap-916912695 tempest-TestVolumeSwap-916912695-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 15:47:59 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-f4e88c6d-10cc-4f7a-b79b-2fcda050a895 tempest-TestVolumeSwap-916912695 tempest-TestVolumeSwap-916912695-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 15:47:59 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:47:59 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:47:59 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[47c80bd9-214e-4038-9515-415b964e4ada]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b1421f55-d453-441d-bdf7-3743102662b6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0c5fa35a-1ba5-4390-9102-83ac1dbb790a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:47:59 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4e88c6d-10cc-4f7a-b79b-2fcda050a895 tempest-TestVolumeSwap-916912695 tempest-TestVolumeSwap-916912695-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 15:47:59 user nova-compute[75337]: No targets found.
Nov 06 15:47:59 user nova-compute[75337]: iSNS:
Nov 06 15:47:59 user nova-compute[75337]: No targets found.
Nov 06 15:47:59 user nova-compute[75337]: STATIC:
Nov 06 15:47:59 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:b1421f55-d453-441d-bdf7-3743102662b6
Nov 06 15:47:59 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 15:47:59 user nova-compute[75337]:                 Iface Name: default
Nov 06 15:47:59 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158
Nov 06 15:47:59 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 15:47:59 user nova-compute[75337]:                 Iface Name: default
Nov 06 15:47:59 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:0c5fa35a-1ba5-4390-9102-83ac1dbb790a
Nov 06 15:47:59 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 15:47:59 user nova-compute[75337]:                 Iface Name: default
Nov 06 15:47:59 user nova-compute[75337]: FIRMWARE:
Nov 06 15:47:59 user nova-compute[75337]: No targets found.
Nov 06 15:47:59 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 15:47:59 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4e88c6d-10cc-4f7a-b79b-2fcda050a895 tempest-TestVolumeSwap-916912695 tempest-TestVolumeSwap-916912695-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 15:47:59 user nova-compute[75337]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 15:47:59 user nova-compute[75337]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75337) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 15:47:59 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4e88c6d-10cc-4f7a-b79b-2fcda050a895 tempest-TestVolumeSwap-916912695 tempest-TestVolumeSwap-916912695-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0c5fa35a-1ba5-4390-9102-83ac1dbb790a', 0)] {{(pid=75337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 15:47:59 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:47:59 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:47:59 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ccfe6e3-9171-48c5-bb1a-eb2b87a71a5f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c5fa35a-1ba5-4390-9102-83ac1dbb790a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b1421f55-d453-441d-bdf7-3743102662b6\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:47:59 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:47:59 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:47:59 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[bba40407-852e-4e51-9862-0711e9ecdbb7]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c5fa35a-1ba5-4390-9102-83ac1dbb790a (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1421f55-d453-441d-bdf7-3743102662b6 (non-flash)\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:47:59 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4e88c6d-10cc-4f7a-b79b-2fcda050a895 tempest-TestVolumeSwap-916912695 tempest-TestVolumeSwap-916912695-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)
Nov 06 15:47:59 user nova-compute[75337]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c5fa35a-1ba5-4390-9102-83ac1dbb790a (non-flash)
Nov 06 15:47:59 user nova-compute[75337]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1421f55-d453-441d-bdf7-3743102662b6 (non-flash)
Nov 06 15:47:59 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 15:47:59 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4e88c6d-10cc-4f7a-b79b-2fcda050a895 tempest-TestVolumeSwap-916912695 tempest-TestVolumeSwap-916912695-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)
Nov 06 15:47:59 user nova-compute[75337]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c5fa35a-1ba5-4390-9102-83ac1dbb790a (non-flash)
Nov 06 15:47:59 user nova-compute[75337]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1421f55-d453-441d-bdf7-3743102662b6 (non-flash)
Nov 06 15:47:59 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 15:47:59 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4e88c6d-10cc-4f7a-b79b-2fcda050a895 tempest-TestVolumeSwap-916912695 tempest-TestVolumeSwap-916912695-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2abc129f30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0c5fa35a-1ba5-4390-9102-83ac1dbb790a'): ({'sdd'}, set())}) {{(pid=75337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 15:47:59 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-f4e88c6d-10cc-4f7a-b79b-2fcda050a895 tempest-TestVolumeSwap-916912695 tempest-TestVolumeSwap-916912695-project-admin] Removing single pathed devices sdd {{(pid=75337) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 15:47:59 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:47:59 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:47:59 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cc75088-6cd1-4b14-bf63-9f161c22d5d9]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:47:59 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:47:59 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.026s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:47:59 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[15c2d196-5c83-4d15-b989-21b6e74f0aed]: (4, ('ok\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:47:59 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-f4e88c6d-10cc-4f7a-b79b-2fcda050a895 tempest-TestVolumeSwap-916912695 tempest-TestVolumeSwap-916912695-project-admin] Flushing IO for device /dev/sdd {{(pid=75337) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 15:47:59 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:47:59 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.019s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:47:59 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a7d51d5-6031-4a00-ad70-e619b2a71f5c]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:47:59 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-f4e88c6d-10cc-4f7a-b79b-2fcda050a895 tempest-TestVolumeSwap-916912695 tempest-TestVolumeSwap-916912695-project-admin] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75337) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 15:47:59 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:47:59 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.054s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:47:59 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0dfca32-8d27-43f3-8ee5-02451717865c]: (4, ('1', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:47:59 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-f4e88c6d-10cc-4f7a-b79b-2fcda050a895 tempest-TestVolumeSwap-916912695 tempest-TestVolumeSwap-916912695-project-admin] Checking to see if SCSI volumes sdd have been removed. {{(pid=75337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 15:47:59 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-f4e88c6d-10cc-4f7a-b79b-2fcda050a895 tempest-TestVolumeSwap-916912695 tempest-TestVolumeSwap-916912695-project-admin] SCSI volumes sdd have been removed. {{(pid=75337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 15:47:59 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4e88c6d-10cc-4f7a-b79b-2fcda050a895 tempest-TestVolumeSwap-916912695 tempest-TestVolumeSwap-916912695-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0c5fa35a-1ba5-4390-9102-83ac1dbb790a')] {{(pid=75337) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 15:47:59 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c5fa35a-1ba5-4390-9102-83ac1dbb790a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:47:59 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c5fa35a-1ba5-4390-9102-83ac1dbb790a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:47:59 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[3529efe7-8ac5-42a0-bf23-620865811b86]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:47:59 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4e88c6d-10cc-4f7a-b79b-2fcda050a895 tempest-TestVolumeSwap-916912695 tempest-TestVolumeSwap-916912695-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:47:59 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c5fa35a-1ba5-4390-9102-83ac1dbb790a -p 172.16.0.220:3260 --logout {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:47:59 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c5fa35a-1ba5-4390-9102-83ac1dbb790a -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:47:59 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a4fd891-34fb-4936-9cf0-c51f65fc505d]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:0c5fa35a-1ba5-4390-9102-83ac1dbb790a, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:0c5fa35a-1ba5-4390-9102-83ac1dbb790a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:47:59 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4e88c6d-10cc-4f7a-b79b-2fcda050a895 tempest-TestVolumeSwap-916912695 tempest-TestVolumeSwap-916912695-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:0c5fa35a-1ba5-4390-9102-83ac1dbb790a, portal: 172.16.0.220,3260]
Nov 06 15:47:59 user nova-compute[75337]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:0c5fa35a-1ba5-4390-9102-83ac1dbb790a, portal: 172.16.0.220,3260] successful.
Nov 06 15:47:59 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:47:59 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c5fa35a-1ba5-4390-9102-83ac1dbb790a -p 172.16.0.220:3260 --op delete {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:47:59 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c5fa35a-1ba5-4390-9102-83ac1dbb790a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:47:59 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7190bce-a38a-4356-b869-472f6aa8965f]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:47:59 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4e88c6d-10cc-4f7a-b79b-2fcda050a895 tempest-TestVolumeSwap-916912695 tempest-TestVolumeSwap-916912695-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:47:59 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-f4e88c6d-10cc-4f7a-b79b-2fcda050a895 tempest-TestVolumeSwap-916912695 tempest-TestVolumeSwap-916912695-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.374s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 15:47:59 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4e88c6d-10cc-4f7a-b79b-2fcda050a895 tempest-TestVolumeSwap-916912695 tempest-TestVolumeSwap-916912695-project-admin] <== disconnect_volume: return (376ms) None {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 15:47:59 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f4e88c6d-10cc-4f7a-b79b-2fcda050a895 tempest-TestVolumeSwap-916912695 tempest-TestVolumeSwap-916912695-project-admin] [instance: 9125364b-332f-4297-815f-3aa1eadaf743] Disconnected iSCSI Volume {{(pid=75337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 15:47:59 user nova-compute[75337]: DEBUG nova.compute.manager [None req-f4e88c6d-10cc-4f7a-b79b-2fcda050a895 tempest-TestVolumeSwap-916912695 tempest-TestVolumeSwap-916912695-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b1421f55-d453-441d-bdf7-3743102662b6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vVbIPGuJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '9125364b-332f-4297-815f-3aa1eadaf743', 'attached_at': '', 'detached_at': '', 'volume_id': 'b1421f55-d453-441d-bdf7-3743102662b6', 'serial'} {{(pid=75337) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 06 15:47:59 user nova-compute[75337]: DEBUG nova.compute.manager [None req-f4e88c6d-10cc-4f7a-b79b-2fcda050a895 tempest-TestVolumeSwap-916912695 tempest-TestVolumeSwap-916912695-project-admin] [instance: 9125364b-332f-4297-815f-3aa1eadaf743] swap_volume: removing Cinder connection for volume 0c5fa35a-1ba5-4390-9102-83ac1dbb790a {{(pid=75337) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 06 15:48:01 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:48:01 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:48:01 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:48:01 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Starting heal instance info cache {{(pid=75337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 15:48:01 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "refresh_cache-1fa4c927-7485-4f34-94bd-9e20358904b6" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 15:48:01 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquired lock "refresh_cache-1fa4c927-7485-4f34-94bd-9e20358904b6" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 15:48:01 user nova-compute[75337]: DEBUG nova.network.neutron [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] [instance: 1fa4c927-7485-4f34-94bd-9e20358904b6] Forcefully refreshing network info cache for instance {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 15:48:01 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:48:02 user nova-compute[75337]: DEBUG nova.compute.manager [req-d5e5cc6e-1475-4b9a-8892-937271f6403d req-c7bc09e8-7a37-422f-b93c-a5a4c6ea58e2 service nova] [instance: 477da5ee-3e03-4aa9-9a88-004c442e617a] Received event network-changed-8e872f2c-9413-4a9e-8a10-606d0d9d0992 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:48:02 user nova-compute[75337]: DEBUG nova.compute.manager [req-d5e5cc6e-1475-4b9a-8892-937271f6403d req-c7bc09e8-7a37-422f-b93c-a5a4c6ea58e2 service nova] [instance: 477da5ee-3e03-4aa9-9a88-004c442e617a] Refreshing instance network info cache due to event network-changed-8e872f2c-9413-4a9e-8a10-606d0d9d0992. {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 15:48:02 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-d5e5cc6e-1475-4b9a-8892-937271f6403d req-c7bc09e8-7a37-422f-b93c-a5a4c6ea58e2 service nova] Acquiring lock "refresh_cache-477da5ee-3e03-4aa9-9a88-004c442e617a" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 15:48:02 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-d5e5cc6e-1475-4b9a-8892-937271f6403d req-c7bc09e8-7a37-422f-b93c-a5a4c6ea58e2 service nova] Acquired lock "refresh_cache-477da5ee-3e03-4aa9-9a88-004c442e617a" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 15:48:02 user nova-compute[75337]: DEBUG nova.network.neutron [req-d5e5cc6e-1475-4b9a-8892-937271f6403d req-c7bc09e8-7a37-422f-b93c-a5a4c6ea58e2 service nova] [instance: 477da5ee-3e03-4aa9-9a88-004c442e617a] Refreshing network info cache for port 8e872f2c-9413-4a9e-8a10-606d0d9d0992 {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 15:48:02 user nova-compute[75337]: DEBUG nova.network.neutron [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] [instance: 1fa4c927-7485-4f34-94bd-9e20358904b6] Updating instance_info_cache with network_info: [{"id": "3812cc74-01db-4b2b-815c-770420051e1b", "address": "fa:16:3e:f4:aa:7b", "network": {"id": "736be000-ee94-41fd-9de0-f2f885ec9be7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1715443852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb76b5b0f2b24f1c84a92403176bcc00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3812cc74-01", "ovs_interfaceid": "3812cc74-01db-4b2b-815c-770420051e1b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:48:02 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Releasing lock "refresh_cache-1fa4c927-7485-4f34-94bd-9e20358904b6" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 15:48:02 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] [instance: 1fa4c927-7485-4f34-94bd-9e20358904b6] Updated the network info_cache for instance {{(pid=75337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 15:48:02 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:48:02 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:48:02 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:48:02 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:48:02 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75337) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 15:48:02 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:48:02 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:48:02 user nova-compute[75337]: DEBUG nova.network.neutron [req-d5e5cc6e-1475-4b9a-8892-937271f6403d req-c7bc09e8-7a37-422f-b93c-a5a4c6ea58e2 service nova] [instance: 477da5ee-3e03-4aa9-9a88-004c442e617a] Updated VIF entry in instance network info cache for port 8e872f2c-9413-4a9e-8a10-606d0d9d0992. {{(pid=75337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 15:48:02 user nova-compute[75337]: DEBUG nova.network.neutron [req-d5e5cc6e-1475-4b9a-8892-937271f6403d req-c7bc09e8-7a37-422f-b93c-a5a4c6ea58e2 service nova] [instance: 477da5ee-3e03-4aa9-9a88-004c442e617a] Updating instance_info_cache with network_info: [{"id": "8e872f2c-9413-4a9e-8a10-606d0d9d0992", "address": "fa:16:3e:77:c1:a2", "network": {"id": "48f1545d-7e80-462f-9dbf-f1102ddcda9a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1210368397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1013e7afbefd4146a3be04587710b1de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e872f2c-94", "ovs_interfaceid": "8e872f2c-9413-4a9e-8a10-606d0d9d0992", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:48:02 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-d5e5cc6e-1475-4b9a-8892-937271f6403d req-c7bc09e8-7a37-422f-b93c-a5a4c6ea58e2 service nova] Releasing lock "refresh_cache-477da5ee-3e03-4aa9-9a88-004c442e617a" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 15:48:03 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager.update_available_resource {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:48:03 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:48:03 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:48:03 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:48:03 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Auditing locally available compute resources for user (node: user) {{(pid=75337) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 15:48:03 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/477da5ee-3e03-4aa9-9a88-004c442e617a/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:48:03 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/477da5ee-3e03-4aa9-9a88-004c442e617a/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:48:03 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/477da5ee-3e03-4aa9-9a88-004c442e617a/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:48:04 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:48:04 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/477da5ee-3e03-4aa9-9a88-004c442e617a/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:48:04 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afa4e52b-af51-45bf-b619-aeca14e7724d/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:48:04 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afa4e52b-af51-45bf-b619-aeca14e7724d/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:48:04 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afa4e52b-af51-45bf-b619-aeca14e7724d/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:48:04 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afa4e52b-af51-45bf-b619-aeca14e7724d/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:48:04 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89f0a6eb-b68c-4760-9446-b77e80ebaf99/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:48:04 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89f0a6eb-b68c-4760-9446-b77e80ebaf99/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:48:04 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89f0a6eb-b68c-4760-9446-b77e80ebaf99/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:48:04 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89f0a6eb-b68c-4760-9446-b77e80ebaf99/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:48:04 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7ececa5-256f-4a5d-aeda-3d2ee5c01cfe/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:48:05 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7ececa5-256f-4a5d-aeda-3d2ee5c01cfe/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:48:05 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7ececa5-256f-4a5d-aeda-3d2ee5c01cfe/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:48:05 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7ececa5-256f-4a5d-aeda-3d2ee5c01cfe/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:48:05 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc0e07f8-2731-4ffa-8446-b71ad3ba7375/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:48:05 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc0e07f8-2731-4ffa-8446-b71ad3ba7375/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:48:05 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc0e07f8-2731-4ffa-8446-b71ad3ba7375/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:48:05 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc0e07f8-2731-4ffa-8446-b71ad3ba7375/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:48:05 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9125364b-332f-4297-815f-3aa1eadaf743/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:48:05 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9125364b-332f-4297-815f-3aa1eadaf743/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:48:05 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9125364b-332f-4297-815f-3aa1eadaf743/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:48:06 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9125364b-332f-4297-815f-3aa1eadaf743/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:48:06 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 15:48:06 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdced0ba-84ff-42af-baab-e2f3412e1676/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:48:06 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdced0ba-84ff-42af-baab-e2f3412e1676/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:48:06 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdced0ba-84ff-42af-baab-e2f3412e1676/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:48:06 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdced0ba-84ff-42af-baab-e2f3412e1676/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:48:06 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83516ff5-c4e7-4e91-a2f9-8af9b51cf475/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:48:06 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83516ff5-c4e7-4e91-a2f9-8af9b51cf475/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:48:06 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83516ff5-c4e7-4e91-a2f9-8af9b51cf475/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:48:06 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:48:06 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83516ff5-c4e7-4e91-a2f9-8af9b51cf475/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:48:06 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 15:48:07 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 15:48:07 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 15:48:07 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Hypervisor/Node resource view: name=user free_ram=7706MB free_disk=25.156696319580078GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75337) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 15:48:07 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:48:07 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:48:07 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 83516ff5-c4e7-4e91-a2f9-8af9b51cf475 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:48:07 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 1fa4c927-7485-4f34-94bd-9e20358904b6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:48:07 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance cdced0ba-84ff-42af-baab-e2f3412e1676 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:48:07 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 7a6b16de-4506-432f-97f9-f083243dc047 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:48:07 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 9125364b-332f-4297-815f-3aa1eadaf743 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:48:07 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 477da5ee-3e03-4aa9-9a88-004c442e617a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:48:07 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance bc0e07f8-2731-4ffa-8446-b71ad3ba7375 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:48:07 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance afa4e52b-af51-45bf-b619-aeca14e7724d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:48:07 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance b7ececa5-256f-4a5d-aeda-3d2ee5c01cfe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:48:07 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance fdda34b5-280f-489d-baf5-bf21ac6dd6c9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:48:07 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 89f0a6eb-b68c-4760-9446-b77e80ebaf99 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:48:07 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 15:48:07 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 15:48:07 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 15:48:07 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 15:48:07 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Compute_service record updated for user:user {{(pid=75337) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 15:48:07 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.500s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:48:09 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:48:11 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:48:14 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:48:14 user nova-compute[75337]: INFO nova.virt.block_device [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Booting with volume 1bebbb46-2250-4511-ba59-f4ce67e0b45d at /dev/vdc
Nov 06 15:48:14 user nova-compute[75337]: DEBUG os_brick.utils [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 15:48:14 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:48:14 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:48:14 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[269023aa-ac53-4899-9414-be72e5742382]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4ff6411e45b8\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:48:14 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:48:14 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:48:14 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eec03b3-2102-4956-a430-d6b0c93bc420]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:48:14 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:48:14 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:48:14 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[428eb5ca-0884-4d51-a8ef-13186037be8f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:48:14 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[caa38e84-8480-41cd-a381-4fddbc5150c4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:48:14 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Running cmd (subprocess): nvme version {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:48:14 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] 'nvme version' failed. Not Retrying. {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 15:48:14 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] nvme not present on system {{(pid=75337) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 15:48:14 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:48:14 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 15:48:14 user nova-compute[75337]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 15:48:14 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdeefca0-b6f5-4788-9b26-d122b6b2b2eb]: (4, '') {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:48:14 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.lightos [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75337) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 15:48:14 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.lightos [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 15:48:14 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.lightos [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] LIGHTOS: no hostnqn found. {{(pid=75337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 15:48:14 user nova-compute[75337]: DEBUG os_brick.utils [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4ff6411e45b8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 15:48:14 user nova-compute[75337]: DEBUG nova.virt.block_device [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Updating existing volume attachment record: 84c11847-bb3f-4ce5-a678-6f28d036659c {{(pid=75337) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 15:48:16 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:48:16 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:48:19 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:48:21 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:48:24 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:48:24 user nova-compute[75337]: DEBUG nova.compute.manager [None req-f4e88c6d-10cc-4f7a-b79b-2fcda050a895 tempest-TestVolumeSwap-916912695 tempest-TestVolumeSwap-916912695-project-admin] [instance: 9125364b-332f-4297-815f-3aa1eadaf743] swap_volume: Updating volume 0c5fa35a-1ba5-4390-9102-83ac1dbb790a BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:b1421f55-d453-441d-bdf7-3743102662b6", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "vVbIPGuJ", "auth_password": "XxtkEdL5MVS9eu", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdb", "volume_id": "b1421f55-d453-441d-bdf7-3743102662b6"}, "status": "reserved", "instance": "9125364b-332f-4297-815f-3aa1eadaf743", "attached_at": "", "detached_at": "", "volume_id": "b1421f55-d453-441d-bdf7-3743102662b6", "serial": "b1421f55-d453-441d-bdf7-3743102662b6"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'b1421f55-d453-441d-bdf7-3743102662b6', 'no_device': None, 'attachment_id': '38c30ca7-498f-4e22-bea5-596476c746ce'} {{(pid=75337) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 06 15:48:24 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-f4e88c6d-10cc-4f7a-b79b-2fcda050a895 tempest-TestVolumeSwap-916912695 tempest-TestVolumeSwap-916912695-project-admin] Lock "9125364b-332f-4297-815f-3aa1eadaf743" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 56.769s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:48:24 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-8d522c86-1736-4bc0-b780-53e8ad01225d tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Acquiring lock "477da5ee-3e03-4aa9-9a88-004c442e617a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:48:24 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-8d522c86-1736-4bc0-b780-53e8ad01225d tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Lock "477da5ee-3e03-4aa9-9a88-004c442e617a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.018s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:48:24 user nova-compute[75337]: DEBUG nova.objects.instance [None req-8d522c86-1736-4bc0-b780-53e8ad01225d tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Lazy-loading 'flavor' on Instance uuid 477da5ee-3e03-4aa9-9a88-004c442e617a {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 15:48:24 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-8d522c86-1736-4bc0-b780-53e8ad01225d tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Lock "477da5ee-3e03-4aa9-9a88-004c442e617a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.067s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:48:24 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-af28426e-8adf-4118-a307-79668cbd99aa tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] [instance: 7a6b16de-4506-432f-97f9-f083243dc047] Creating instance directory {{(pid=75337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 15:48:24 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-af28426e-8adf-4118-a307-79668cbd99aa tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] [instance: 7a6b16de-4506-432f-97f9-f083243dc047] Creating image(s)
Nov 06 15:48:24 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-af28426e-8adf-4118-a307-79668cbd99aa tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] [instance: 7a6b16de-4506-432f-97f9-f083243dc047] Did not create local disks {{(pid=75337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 06 15:48:24 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-af28426e-8adf-4118-a307-79668cbd99aa tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] [instance: 7a6b16de-4506-432f-97f9-f083243dc047] Ensure instance console log exists: /opt/stack/data/nova/instances/7a6b16de-4506-432f-97f9-f083243dc047/console.log {{(pid=75337) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 15:48:24 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-af28426e-8adf-4118-a307-79668cbd99aa tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:48:24 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-af28426e-8adf-4118-a307-79668cbd99aa tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:48:24 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-af28426e-8adf-4118-a307-79668cbd99aa tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:48:24 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-af28426e-8adf-4118-a307-79668cbd99aa tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] [instance: 7a6b16de-4506-432f-97f9-f083243dc047] Start _get_guest_xml network_info=[{"id": "4e4e1bfc-ebf9-41eb-81be-d1c34001dcff", "address": "fa:16:3e:d1:64:1b", "network": {"id": "ffb95242-a859-4479-a4c8-2b8fa68b53fc", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-976415891-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed8fbcf3ad3c42a08501891748de8abc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e4e1bfc-eb", "ovs_interfaceid": "4e4e1bfc-ebf9-41eb-81be-d1c34001dcff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T15:34:14Z,direct_url=<?>,disk_format='qcow2',id=16b903ae-a40f-41a7-985b-4804cce92c62,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6549a15819f1469bbd5eeae8190e3d44',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T15:34:15Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'attachment_id': 'dc77e98d-d76a-42fc-9341-816d6ebd2c18', 'guest_format': None, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'maEwpfvl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7a6b16de-4506-432f-97f9-f083243dc047', 'attached_at': '', 'detached_at': '', 'volume_id': '15793a67-283e-461b-b16a-a42e1b3ea8e6', 'serial': '15793a67-283e-461b-b16a-a42e1b3ea8e6'}, 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=75337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 15:48:24 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-af28426e-8adf-4118-a307-79668cbd99aa tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 06 15:48:24 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-af28426e-8adf-4118-a307-79668cbd99aa tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 06 15:48:24 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-af28426e-8adf-4118-a307-79668cbd99aa tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 15:48:24 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-af28426e-8adf-4118-a307-79668cbd99aa tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] CPU controller missing on host. {{(pid=75337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 15:48:24 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-af28426e-8adf-4118-a307-79668cbd99aa tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 15:48:24 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-af28426e-8adf-4118-a307-79668cbd99aa tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] CPU controller found on host. {{(pid=75337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 15:48:24 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-af28426e-8adf-4118-a307-79668cbd99aa tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75337) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 15:48:24 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-af28426e-8adf-4118-a307-79668cbd99aa tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T15:34:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T15:34:14Z,direct_url=<?>,disk_format='qcow2',id=16b903ae-a40f-41a7-985b-4804cce92c62,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6549a15819f1469bbd5eeae8190e3d44',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T15:34:15Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 15:48:24 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-af28426e-8adf-4118-a307-79668cbd99aa tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] Flavor limits 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 15:48:24 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-af28426e-8adf-4118-a307-79668cbd99aa tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] Image limits 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 15:48:24 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-af28426e-8adf-4118-a307-79668cbd99aa tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] Flavor pref 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 15:48:24 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-af28426e-8adf-4118-a307-79668cbd99aa tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] Image pref 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 15:48:24 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-af28426e-8adf-4118-a307-79668cbd99aa tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 15:48:24 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-af28426e-8adf-4118-a307-79668cbd99aa tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 15:48:24 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-af28426e-8adf-4118-a307-79668cbd99aa tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 15:48:24 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-af28426e-8adf-4118-a307-79668cbd99aa tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] Got 1 possible topologies {{(pid=75337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 15:48:24 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-af28426e-8adf-4118-a307-79668cbd99aa tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 15:48:24 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-af28426e-8adf-4118-a307-79668cbd99aa tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 15:48:24 user nova-compute[75337]: DEBUG nova.objects.instance [None req-af28426e-8adf-4118-a307-79668cbd99aa tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] Lazy-loading 'vcpu_model' on Instance uuid 7a6b16de-4506-432f-97f9-f083243dc047 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 15:48:24 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af28426e-8adf-4118-a307-79668cbd99aa tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] [instance: 7a6b16de-4506-432f-97f9-f083243dc047] Calling os-brick to attach iSCSI Volume {{(pid=75337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 15:48:24 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-af28426e-8adf-4118-a307-79668cbd99aa tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2abc33d0c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'maEwpfvl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 15:48:24 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-af28426e-8adf-4118-a307-79668cbd99aa tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 06 15:48:24 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-af28426e-8adf-4118-a307-79668cbd99aa tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 15:48:24 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-af28426e-8adf-4118-a307-79668cbd99aa tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 15:48:24 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-af28426e-8adf-4118-a307-79668cbd99aa tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 06 15:48:24 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-af28426e-8adf-4118-a307-79668cbd99aa tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 15:48:24 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-af28426e-8adf-4118-a307-79668cbd99aa tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 15:48:24 user nova-compute[75337]: INFO os_brick.initiator.connectors.iscsi [None req-af28426e-8adf-4118-a307-79668cbd99aa tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 15:48:24 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6 -p 172.16.0.220:3260 {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:48:24 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:48:24 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[24e80636-9986-43b4-b464-0a21706ffaf6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:48:24 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-af28426e-8adf-4118-a307-79668cbd99aa tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 15:48:24 user nova-compute[75337]:  {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:48:24 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6 -p 172.16.0.220:3260 --interface default --op new {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:48:24 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.029s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:48:24 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8401b22-5441-49dd-b11c-601d01dcc34d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6] added\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:48:24 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-af28426e-8adf-4118-a307-79668cbd99aa tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6] added
Nov 06 15:48:24 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:48:25 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:48:25 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:48:25 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae8f8d57-3529-439a-8d1b-c9abe22b179a]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:48:25 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-af28426e-8adf-4118-a307-79668cbd99aa tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:48:25 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:48:25 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:48:25 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[17fddd81-cb71-44aa-a996-86b79603be39]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:48:25 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-af28426e-8adf-4118-a307-79668cbd99aa tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:48:25 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v maEwpfvl {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:48:25 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v maEwpfvl" returned: 0 in 0.022s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:48:25 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c242c54-d492-4539-9174-97e561bd99a3]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:48:25 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-af28426e-8adf-4118-a307-79668cbd99aa tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'maEwpfvl'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:48:25 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:48:25 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-8d522c86-1736-4bc0-b780-53e8ad01225d tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Acquiring lock "477da5ee-3e03-4aa9-9a88-004c442e617a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:48:25 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-8d522c86-1736-4bc0-b780-53e8ad01225d tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Lock "477da5ee-3e03-4aa9-9a88-004c442e617a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:48:25 user nova-compute[75337]: INFO nova.compute.manager [None req-8d522c86-1736-4bc0-b780-53e8ad01225d tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] [instance: 477da5ee-3e03-4aa9-9a88-004c442e617a] Attaching volume 4954683e-297c-4bed-94c9-675adb40fb66 to /dev/vdb
Nov 06 15:48:25 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.030s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:48:25 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a794774-208a-4384-962a-38fa518710cd]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:48:25 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-af28426e-8adf-4118-a307-79668cbd99aa tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:48:25 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:48:25 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:48:25 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[4604ff81-a0a6-4077-9b29-6e3dbf3d995a]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1421f55-d453-441d-bdf7-3743102662b6 (non-flash)\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:48:25 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-af28426e-8adf-4118-a307-79668cbd99aa tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)
Nov 06 15:48:25 user nova-compute[75337]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1421f55-d453-441d-bdf7-3743102662b6 (non-flash)
Nov 06 15:48:25 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 15:48:25 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-af28426e-8adf-4118-a307-79668cbd99aa tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)
Nov 06 15:48:25 user nova-compute[75337]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1421f55-d453-441d-bdf7-3743102662b6 (non-flash)
Nov 06 15:48:25 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 15:48:25 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6 -p 172.16.0.220:3260 --login {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:48:25 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6 -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:48:25 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[e348518f-8f11-4fca-98f6-09eb8e304bcb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:48:25 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-af28426e-8adf-4118-a307-79668cbd99aa tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6, portal: 172.16.0.220,3260]
Nov 06 15:48:25 user nova-compute[75337]: Login to [iface: default, target: iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6, portal: 172.16.0.220,3260] successful.
Nov 06 15:48:25 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:48:25 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:48:25 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:48:25 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[21b5a763-bfa3-4717-9547-b5733c0b9645]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:48:25 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-af28426e-8adf-4118-a307-79668cbd99aa tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:48:25 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:48:25 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:48:25 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[92aab385-665f-4021-9fd8-59908cdae800]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1421f55-d453-441d-bdf7-3743102662b6 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6 (non-flash)\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:48:25 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-af28426e-8adf-4118-a307-79668cbd99aa tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)
Nov 06 15:48:25 user nova-compute[75337]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1421f55-d453-441d-bdf7-3743102662b6 (non-flash)
Nov 06 15:48:25 user nova-compute[75337]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6 (non-flash)
Nov 06 15:48:25 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 15:48:25 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-af28426e-8adf-4118-a307-79668cbd99aa tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)
Nov 06 15:48:25 user nova-compute[75337]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1421f55-d453-441d-bdf7-3743102662b6 (non-flash)
Nov 06 15:48:25 user nova-compute[75337]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6 (non-flash)
Nov 06 15:48:25 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 15:48:25 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-af28426e-8adf-4118-a307-79668cbd99aa tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.365s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 15:48:25 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-af28426e-8adf-4118-a307-79668cbd99aa tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] Connected to 172.16.0.220:3260 {{(pid=75337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 15:48:25 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-af28426e-8adf-4118-a307-79668cbd99aa tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] HCTL ('35', '-', '-', 0) found on session 22 with lun 0 {{(pid=75337) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 15:48:25 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-af28426e-8adf-4118-a307-79668cbd99aa tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75337) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 15:48:25 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:48:25 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-9076803f-e56e-41e3-b886-3eb2eb98408e tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Acquiring lock "bc0e07f8-2731-4ffa-8446-b71ad3ba7375" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:48:25 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-9076803f-e56e-41e3-b886-3eb2eb98408e tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Lock "bc0e07f8-2731-4ffa-8446-b71ad3ba7375" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:48:25 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.028s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:48:25 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[e87f9d15-6a4e-4aad-82e4-0ce12aae103d]: (4, ('- - 0', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:48:25 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-af28426e-8adf-4118-a307-79668cbd99aa tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] Searching for a device in session 22 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75337) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 15:48:25 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-af28426e-8adf-4118-a307-79668cbd99aa tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'maEwpfvl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 15:48:25 user nova-compute[75337]: DEBUG nova.objects.instance [None req-9076803f-e56e-41e3-b886-3eb2eb98408e tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Lazy-loading 'flavor' on Instance uuid bc0e07f8-2731-4ffa-8446-b71ad3ba7375 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 15:48:25 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-9076803f-e56e-41e3-b886-3eb2eb98408e tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Lock "bc0e07f8-2731-4ffa-8446-b71ad3ba7375" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.080s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:48:25 user nova-compute[75337]: DEBUG os_brick.utils [None req-8d522c86-1736-4bc0-b780-53e8ad01225d tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 15:48:25 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:48:25 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.022s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:48:25 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[68874410-1ec1-4aa6-aa46-cf801ceeaeb1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4ff6411e45b8\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:48:25 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:48:25 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:48:25 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[cac9e437-ecf7-48a5-9c2e-ebd408599d8c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:48:25 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:48:25 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:48:25 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[32e34720-87d6-4946-b349-5c03fa0c0c22]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:48:25 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8a26001-3816-416d-9e8d-8e57a0ac5c38]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:48:25 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-8d522c86-1736-4bc0-b780-53e8ad01225d tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Running cmd (subprocess): nvme version {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:48:25 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-8d522c86-1736-4bc0-b780-53e8ad01225d tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] 'nvme version' failed. Not Retrying. {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 15:48:25 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8d522c86-1736-4bc0-b780-53e8ad01225d tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] nvme not present on system {{(pid=75337) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 15:48:25 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:48:25 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 15:48:25 user nova-compute[75337]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 15:48:25 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f6f6497-670b-4f88-be45-4741f9e7b767]: (4, '') {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:48:25 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.lightos [None req-8d522c86-1736-4bc0-b780-53e8ad01225d tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75337) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 15:48:25 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.lightos [None req-8d522c86-1736-4bc0-b780-53e8ad01225d tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 15:48:25 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.lightos [None req-8d522c86-1736-4bc0-b780-53e8ad01225d tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] LIGHTOS: no hostnqn found. {{(pid=75337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 15:48:25 user nova-compute[75337]: DEBUG os_brick.utils [None req-8d522c86-1736-4bc0-b780-53e8ad01225d tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] <== get_connector_properties: return (160ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4ff6411e45b8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 15:48:25 user nova-compute[75337]: DEBUG nova.virt.block_device [None req-8d522c86-1736-4bc0-b780-53e8ad01225d tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] [instance: 477da5ee-3e03-4aa9-9a88-004c442e617a] Updating existing volume attachment record: 5c9db931-00db-4f21-a064-036eb29ba305 {{(pid=75337) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 15:48:25 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-9076803f-e56e-41e3-b886-3eb2eb98408e tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Acquiring lock "bc0e07f8-2731-4ffa-8446-b71ad3ba7375" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:48:25 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-9076803f-e56e-41e3-b886-3eb2eb98408e tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Lock "bc0e07f8-2731-4ffa-8446-b71ad3ba7375" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:48:25 user nova-compute[75337]: INFO nova.compute.manager [None req-9076803f-e56e-41e3-b886-3eb2eb98408e tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] [instance: bc0e07f8-2731-4ffa-8446-b71ad3ba7375] Attaching volume dc5eae50-0461-47ca-bc48-cb38087b06e0 to /dev/vdb
Nov 06 15:48:26 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-c05e62de-0cab-45f4-bdae-03cecf76da51 tempest-TestVolumeSwap-916912695 tempest-TestVolumeSwap-916912695-project-admin] Acquiring lock "9125364b-332f-4297-815f-3aa1eadaf743" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:48:26 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-c05e62de-0cab-45f4-bdae-03cecf76da51 tempest-TestVolumeSwap-916912695 tempest-TestVolumeSwap-916912695-project-admin] Lock "9125364b-332f-4297-815f-3aa1eadaf743" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:48:26 user nova-compute[75337]: DEBUG os_brick.utils [None req-c05e62de-0cab-45f4-bdae-03cecf76da51 tempest-TestVolumeSwap-916912695 tempest-TestVolumeSwap-916912695-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 15:48:26 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:48:26 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:48:26 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa54b05c-6f5f-4e7c-ae60-cac7cd216a2d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4ff6411e45b8\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:48:26 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:48:26 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.025s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:48:26 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1e4da4d-9a09-47d1-9c24-cb00b68b4ba2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:48:26 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:48:26 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:48:26 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[26fd290d-a3b3-4750-a8ea-4b962adf2f95]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:48:26 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[617e82d9-37bd-42ef-b022-61d741ef7274]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:48:26 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-c05e62de-0cab-45f4-bdae-03cecf76da51 tempest-TestVolumeSwap-916912695 tempest-TestVolumeSwap-916912695-project-admin] Running cmd (subprocess): nvme version {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:48:26 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-c05e62de-0cab-45f4-bdae-03cecf76da51 tempest-TestVolumeSwap-916912695 tempest-TestVolumeSwap-916912695-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 15:48:26 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-af28426e-8adf-4118-a307-79668cbd99aa tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.448s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 15:48:26 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-af28426e-8adf-4118-a307-79668cbd99aa tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] <== connect_volume: return (1451ms) {'type': 'block', 'scsi_wwn': '23538363530323134', 'path': '/dev/sdd'} {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 15:48:26 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af28426e-8adf-4118-a307-79668cbd99aa tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] [instance: 7a6b16de-4506-432f-97f9-f083243dc047] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23538363530323134', 'path': '/dev/sdd'} {{(pid=75337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 15:48:26 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c05e62de-0cab-45f4-bdae-03cecf76da51 tempest-TestVolumeSwap-916912695 tempest-TestVolumeSwap-916912695-project-admin] nvme not present on system {{(pid=75337) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 15:48:26 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:48:26 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 15:48:26 user nova-compute[75337]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 15:48:26 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fdb003e-a36f-4f8f-876b-8a5313fe7f73]: (4, '') {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:48:26 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.lightos [None req-c05e62de-0cab-45f4-bdae-03cecf76da51 tempest-TestVolumeSwap-916912695 tempest-TestVolumeSwap-916912695-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75337) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 15:48:26 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.lightos [None req-c05e62de-0cab-45f4-bdae-03cecf76da51 tempest-TestVolumeSwap-916912695 tempest-TestVolumeSwap-916912695-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 15:48:26 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.lightos [None req-c05e62de-0cab-45f4-bdae-03cecf76da51 tempest-TestVolumeSwap-916912695 tempest-TestVolumeSwap-916912695-project-admin] LIGHTOS: no hostnqn found. {{(pid=75337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 15:48:26 user nova-compute[75337]: DEBUG os_brick.utils [None req-c05e62de-0cab-45f4-bdae-03cecf76da51 tempest-TestVolumeSwap-916912695 tempest-TestVolumeSwap-916912695-project-admin] <== get_connector_properties: return (161ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4ff6411e45b8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 15:48:26 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-af28426e-8adf-4118-a307-79668cbd99aa tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-06T15:44:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-2022980761',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-154622819',id=14,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOQEIvPwsFtYJCxBuAzGJFBj2NMxdPf9zCY8lR96jqahU4yNb1jUNqLm9D/kbYl6impHm2KGg3eQFdJ96Vvx3tPM5bfUf7AgedT0Ye9qKpHUXm2yidVS0pDcdAVMt/qqDw==',key_name='tempest-keypair-1607456997',keypairs=<?>,launch_index=0,launched_at=2023-11-06T15:45:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ed8fbcf3ad3c42a08501891748de8abc',ramdisk_id='',reservation_id='r-y91vj4ff',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-541966055',owner_user_name='tempest-ServerActionsV293TestJSON-541966055-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T15:47:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='360ca2f8787a424e91dcc73d7c2b5017',uuid=7a6b16de-4506-432f-97f9-f083243dc047,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4e4e1bfc-ebf9-41eb-81be-d1c34001dcff", "address": "fa:16:3e:d1:64:1b", "network": {"id": "ffb95242-a859-4479-a4c8-2b8fa68b53fc", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-976415891-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed8fbcf3ad3c42a08501891748de8abc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e4e1bfc-eb", "ovs_interfaceid": "4e4e1bfc-ebf9-41eb-81be-d1c34001dcff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75337) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 15:48:26 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-af28426e-8adf-4118-a307-79668cbd99aa tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] Converting VIF {"id": "4e4e1bfc-ebf9-41eb-81be-d1c34001dcff", "address": "fa:16:3e:d1:64:1b", "network": {"id": "ffb95242-a859-4479-a4c8-2b8fa68b53fc", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-976415891-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed8fbcf3ad3c42a08501891748de8abc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e4e1bfc-eb", "ovs_interfaceid": "4e4e1bfc-ebf9-41eb-81be-d1c34001dcff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 15:48:26 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-af28426e-8adf-4118-a307-79668cbd99aa tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d1:64:1b,bridge_name='br-int',has_traffic_filtering=True,id=4e4e1bfc-ebf9-41eb-81be-d1c34001dcff,network=Network(ffb95242-a859-4479-a4c8-2b8fa68b53fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e4e1bfc-eb') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 15:48:26 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-af28426e-8adf-4118-a307-79668cbd99aa tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] [instance: 7a6b16de-4506-432f-97f9-f083243dc047] End _get_guest_xml xml=<domain type="kvm">
Nov 06 15:48:26 user nova-compute[75337]:   <uuid>7a6b16de-4506-432f-97f9-f083243dc047</uuid>
Nov 06 15:48:26 user nova-compute[75337]:   <name>instance-0000000e</name>
Nov 06 15:48:26 user nova-compute[75337]:   <memory>524288</memory>
Nov 06 15:48:26 user nova-compute[75337]:   <vcpu>1</vcpu>
Nov 06 15:48:26 user nova-compute[75337]:   <metadata>
Nov 06 15:48:26 user nova-compute[75337]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 15:48:26 user nova-compute[75337]:       <nova:package version="0.0.0"/>
Nov 06 15:48:26 user nova-compute[75337]:       <nova:name>tempest-ServerActionsV293TestJSON-server-2022980761</nova:name>
Nov 06 15:48:26 user nova-compute[75337]:       <nova:creationTime>2023-11-06 15:48:24</nova:creationTime>
Nov 06 15:48:26 user nova-compute[75337]:       <nova:flavor name="m1.tiny">
Nov 06 15:48:26 user nova-compute[75337]:         <nova:memory>512</nova:memory>
Nov 06 15:48:26 user nova-compute[75337]:         <nova:disk>1</nova:disk>
Nov 06 15:48:26 user nova-compute[75337]:         <nova:swap>0</nova:swap>
Nov 06 15:48:26 user nova-compute[75337]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 15:48:26 user nova-compute[75337]:         <nova:vcpus>1</nova:vcpus>
Nov 06 15:48:26 user nova-compute[75337]:       </nova:flavor>
Nov 06 15:48:26 user nova-compute[75337]:       <nova:owner>
Nov 06 15:48:26 user nova-compute[75337]:         <nova:user uuid="360ca2f8787a424e91dcc73d7c2b5017">tempest-ServerActionsV293TestJSON-541966055-project-member</nova:user>
Nov 06 15:48:26 user nova-compute[75337]:         <nova:project uuid="ed8fbcf3ad3c42a08501891748de8abc">tempest-ServerActionsV293TestJSON-541966055</nova:project>
Nov 06 15:48:26 user nova-compute[75337]:       </nova:owner>
Nov 06 15:48:26 user nova-compute[75337]:       <nova:ports>
Nov 06 15:48:26 user nova-compute[75337]:         <nova:port uuid="4e4e1bfc-ebf9-41eb-81be-d1c34001dcff">
Nov 06 15:48:26 user nova-compute[75337]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 06 15:48:26 user nova-compute[75337]:         </nova:port>
Nov 06 15:48:26 user nova-compute[75337]:       </nova:ports>
Nov 06 15:48:26 user nova-compute[75337]:     </nova:instance>
Nov 06 15:48:26 user nova-compute[75337]:   </metadata>
Nov 06 15:48:26 user nova-compute[75337]:   <sysinfo type="smbios">
Nov 06 15:48:26 user nova-compute[75337]:     <system>
Nov 06 15:48:26 user nova-compute[75337]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 15:48:26 user nova-compute[75337]:       <entry name="product">OpenStack Nova</entry>
Nov 06 15:48:26 user nova-compute[75337]:       <entry name="version">0.0.0</entry>
Nov 06 15:48:26 user nova-compute[75337]:       <entry name="serial">7a6b16de-4506-432f-97f9-f083243dc047</entry>
Nov 06 15:48:26 user nova-compute[75337]:       <entry name="uuid">7a6b16de-4506-432f-97f9-f083243dc047</entry>
Nov 06 15:48:26 user nova-compute[75337]:       <entry name="family">Virtual Machine</entry>
Nov 06 15:48:26 user nova-compute[75337]:     </system>
Nov 06 15:48:26 user nova-compute[75337]:   </sysinfo>
Nov 06 15:48:26 user nova-compute[75337]:   <os>
Nov 06 15:48:26 user nova-compute[75337]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 15:48:26 user nova-compute[75337]:     <boot dev="hd"/>
Nov 06 15:48:26 user nova-compute[75337]:     <smbios mode="sysinfo"/>
Nov 06 15:48:26 user nova-compute[75337]:   </os>
Nov 06 15:48:26 user nova-compute[75337]:   <features>
Nov 06 15:48:26 user nova-compute[75337]:     <acpi/>
Nov 06 15:48:26 user nova-compute[75337]:     <apic/>
Nov 06 15:48:26 user nova-compute[75337]:     <vmcoreinfo/>
Nov 06 15:48:26 user nova-compute[75337]:   </features>
Nov 06 15:48:26 user nova-compute[75337]:   <clock offset="utc">
Nov 06 15:48:26 user nova-compute[75337]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 15:48:26 user nova-compute[75337]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 15:48:26 user nova-compute[75337]:     <timer name="hpet" present="no"/>
Nov 06 15:48:26 user nova-compute[75337]:   </clock>
Nov 06 15:48:26 user nova-compute[75337]:   <cpu mode="custom" match="exact">
Nov 06 15:48:26 user nova-compute[75337]:     <model>Nehalem</model>
Nov 06 15:48:26 user nova-compute[75337]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 15:48:26 user nova-compute[75337]:   </cpu>
Nov 06 15:48:26 user nova-compute[75337]:   <devices>
Nov 06 15:48:26 user nova-compute[75337]:     <disk type="block" device="disk">
Nov 06 15:48:26 user nova-compute[75337]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 15:48:26 user nova-compute[75337]:       <source dev="/dev/sdd"/>
Nov 06 15:48:26 user nova-compute[75337]:       <target dev="vda" bus="virtio"/>
Nov 06 15:48:26 user nova-compute[75337]:       <serial>15793a67-283e-461b-b16a-a42e1b3ea8e6</serial>
Nov 06 15:48:26 user nova-compute[75337]:     </disk>
Nov 06 15:48:26 user nova-compute[75337]:     <interface type="ethernet">
Nov 06 15:48:26 user nova-compute[75337]:       <mac address="fa:16:3e:d1:64:1b"/>
Nov 06 15:48:26 user nova-compute[75337]:       <model type="virtio"/>
Nov 06 15:48:26 user nova-compute[75337]:       <mtu size="1442"/>
Nov 06 15:48:26 user nova-compute[75337]:       <target dev="tap4e4e1bfc-eb"/>
Nov 06 15:48:26 user nova-compute[75337]:     </interface>
Nov 06 15:48:26 user nova-compute[75337]:     <serial type="pty">
Nov 06 15:48:26 user nova-compute[75337]:       <log file="/opt/stack/data/nova/instances/7a6b16de-4506-432f-97f9-f083243dc047/console.log" append="off"/>
Nov 06 15:48:26 user nova-compute[75337]:     </serial>
Nov 06 15:48:26 user nova-compute[75337]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 15:48:26 user nova-compute[75337]:     <video>
Nov 06 15:48:26 user nova-compute[75337]:       <model type="virtio"/>
Nov 06 15:48:26 user nova-compute[75337]:     </video>
Nov 06 15:48:26 user nova-compute[75337]:     <rng model="virtio">
Nov 06 15:48:26 user nova-compute[75337]:       <backend model="random">/dev/urandom</backend>
Nov 06 15:48:26 user nova-compute[75337]:     </rng>
Nov 06 15:48:26 user nova-compute[75337]:     <controller type="usb" index="0" model="none"/>
Nov 06 15:48:26 user nova-compute[75337]:     <memballoon model="virtio">
Nov 06 15:48:26 user nova-compute[75337]:       <stats period="10"/>
Nov 06 15:48:26 user nova-compute[75337]:     </memballoon>
Nov 06 15:48:26 user nova-compute[75337]:   </devices>
Nov 06 15:48:26 user nova-compute[75337]: </domain>
Nov 06 15:48:26 user nova-compute[75337]:  {{(pid=75337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 15:48:26 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-af28426e-8adf-4118-a307-79668cbd99aa tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-06T15:44:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-2022980761',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-154622819',id=14,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOQEIvPwsFtYJCxBuAzGJFBj2NMxdPf9zCY8lR96jqahU4yNb1jUNqLm9D/kbYl6impHm2KGg3eQFdJ96Vvx3tPM5bfUf7AgedT0Ye9qKpHUXm2yidVS0pDcdAVMt/qqDw==',key_name='tempest-keypair-1607456997',keypairs=<?>,launch_index=0,launched_at=2023-11-06T15:45:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ed8fbcf3ad3c42a08501891748de8abc',ramdisk_id='',reservation_id='r-y91vj4ff',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-541966055',owner_user_name='tempest-ServerActionsV293TestJSON-541966055-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T15:47:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='360ca2f8787a424e91dcc73d7c2b5017',uuid=7a6b16de-4506-432f-97f9-f083243dc047,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4e4e1bfc-ebf9-41eb-81be-d1c34001dcff", "address": "fa:16:3e:d1:64:1b", "network": {"id": "ffb95242-a859-4479-a4c8-2b8fa68b53fc", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-976415891-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed8fbcf3ad3c42a08501891748de8abc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e4e1bfc-eb", "ovs_interfaceid": "4e4e1bfc-ebf9-41eb-81be-d1c34001dcff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 15:48:26 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-af28426e-8adf-4118-a307-79668cbd99aa tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] Converting VIF {"id": "4e4e1bfc-ebf9-41eb-81be-d1c34001dcff", "address": "fa:16:3e:d1:64:1b", "network": {"id": "ffb95242-a859-4479-a4c8-2b8fa68b53fc", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-976415891-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed8fbcf3ad3c42a08501891748de8abc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e4e1bfc-eb", "ovs_interfaceid": "4e4e1bfc-ebf9-41eb-81be-d1c34001dcff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 15:48:26 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-af28426e-8adf-4118-a307-79668cbd99aa tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d1:64:1b,bridge_name='br-int',has_traffic_filtering=True,id=4e4e1bfc-ebf9-41eb-81be-d1c34001dcff,network=Network(ffb95242-a859-4479-a4c8-2b8fa68b53fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e4e1bfc-eb') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 15:48:26 user nova-compute[75337]: DEBUG os_vif [None req-af28426e-8adf-4118-a307-79668cbd99aa tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d1:64:1b,bridge_name='br-int',has_traffic_filtering=True,id=4e4e1bfc-ebf9-41eb-81be-d1c34001dcff,network=Network(ffb95242-a859-4479-a4c8-2b8fa68b53fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e4e1bfc-eb') {{(pid=75337) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 15:48:26 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:48:26 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:48:26 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 15:48:26 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:48:26 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ac5ee7cb-a84b-5fd8-887c-b8e54ee8c8d9', '_type': 'linux-noop'}}, row=False) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:48:26 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:48:26 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:48:26 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4e4e1bfc-eb, may_exist=True, interface_attrs={}) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:48:26 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4e4e1bfc-eb, col_values=(('qos', UUID('b9c50eb1-31f2-4fb4-9f43-ddd80858035b')),), if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:48:26 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4e4e1bfc-eb, col_values=(('external_ids', {'iface-id': '4e4e1bfc-ebf9-41eb-81be-d1c34001dcff', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d1:64:1b', 'vm-uuid': '7a6b16de-4506-432f-97f9-f083243dc047'}),), if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:48:26 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:48:26 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:48:26 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:48:26 user nova-compute[75337]: INFO os_vif [None req-af28426e-8adf-4118-a307-79668cbd99aa tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d1:64:1b,bridge_name='br-int',has_traffic_filtering=True,id=4e4e1bfc-ebf9-41eb-81be-d1c34001dcff,network=Network(ffb95242-a859-4479-a4c8-2b8fa68b53fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e4e1bfc-eb')
Nov 06 15:48:26 user nova-compute[75337]: DEBUG os_brick.utils [None req-9076803f-e56e-41e3-b886-3eb2eb98408e tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 15:48:26 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:48:26 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:48:26 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[65edff18-fc76-4e81-bd0f-b9c9c45b3e2b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4ff6411e45b8\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:48:26 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:48:26 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:48:26 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c9ebf5b-b14f-4c3a-a0ef-62a0cfab1da2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:48:26 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-af28426e-8adf-4118-a307-79668cbd99aa tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] No BDM found with device name vda, not building metadata. {{(pid=75337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 15:48:26 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-af28426e-8adf-4118-a307-79668cbd99aa tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] No VIF found with MAC fa:16:3e:d1:64:1b, not building metadata {{(pid=75337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 15:48:26 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:48:26 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:48:26 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[470923f8-383c-4f7f-b324-2dcd1a5cbb99]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:48:26 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5e000f5-7d1c-4af2-b51f-c74cda3d0452]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:48:26 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-9076803f-e56e-41e3-b886-3eb2eb98408e tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Running cmd (subprocess): nvme version {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:48:26 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-9076803f-e56e-41e3-b886-3eb2eb98408e tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] 'nvme version' failed. Not Retrying. {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 15:48:26 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9076803f-e56e-41e3-b886-3eb2eb98408e tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] nvme not present on system {{(pid=75337) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 15:48:26 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:48:26 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 15:48:26 user nova-compute[75337]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 15:48:26 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[6866c717-4cac-4b52-ab4a-a946361e650e]: (4, '') {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:48:26 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.lightos [None req-9076803f-e56e-41e3-b886-3eb2eb98408e tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75337) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 15:48:26 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.lightos [None req-9076803f-e56e-41e3-b886-3eb2eb98408e tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 15:48:26 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.lightos [None req-9076803f-e56e-41e3-b886-3eb2eb98408e tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] LIGHTOS: no hostnqn found. {{(pid=75337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 15:48:26 user nova-compute[75337]: DEBUG os_brick.utils [None req-9076803f-e56e-41e3-b886-3eb2eb98408e tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] <== get_connector_properties: return (147ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4ff6411e45b8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 15:48:26 user nova-compute[75337]: DEBUG nova.virt.block_device [None req-9076803f-e56e-41e3-b886-3eb2eb98408e tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] [instance: bc0e07f8-2731-4ffa-8446-b71ad3ba7375] Updating existing volume attachment record: 10c84612-5da2-4a8e-8a57-82c99924cb8a {{(pid=75337) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 15:48:26 user nova-compute[75337]: INFO nova.compute.manager [None req-c05e62de-0cab-45f4-bdae-03cecf76da51 tempest-TestVolumeSwap-916912695 tempest-TestVolumeSwap-916912695-project-admin] [instance: 9125364b-332f-4297-815f-3aa1eadaf743] Swapping volume b1421f55-d453-441d-bdf7-3743102662b6 for 0c5fa35a-1ba5-4390-9102-83ac1dbb790a
Nov 06 15:48:28 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:48:28 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:48:28 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:48:28 user nova-compute[75337]: DEBUG nova.compute.manager [req-b6ad75e8-c98e-4c67-a22a-2ed8745dc74d req-70095253-eda6-46dc-bec7-b05ecc085679 service nova] [instance: 7a6b16de-4506-432f-97f9-f083243dc047] Received event network-vif-plugged-4e4e1bfc-ebf9-41eb-81be-d1c34001dcff {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:48:28 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-b6ad75e8-c98e-4c67-a22a-2ed8745dc74d req-70095253-eda6-46dc-bec7-b05ecc085679 service nova] Acquiring lock "7a6b16de-4506-432f-97f9-f083243dc047-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:48:28 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-b6ad75e8-c98e-4c67-a22a-2ed8745dc74d req-70095253-eda6-46dc-bec7-b05ecc085679 service nova] Lock "7a6b16de-4506-432f-97f9-f083243dc047-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:48:28 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-b6ad75e8-c98e-4c67-a22a-2ed8745dc74d req-70095253-eda6-46dc-bec7-b05ecc085679 service nova] Lock "7a6b16de-4506-432f-97f9-f083243dc047-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:48:28 user nova-compute[75337]: DEBUG nova.compute.manager [req-b6ad75e8-c98e-4c67-a22a-2ed8745dc74d req-70095253-eda6-46dc-bec7-b05ecc085679 service nova] [instance: 7a6b16de-4506-432f-97f9-f083243dc047] No waiting events found dispatching network-vif-plugged-4e4e1bfc-ebf9-41eb-81be-d1c34001dcff {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:48:28 user nova-compute[75337]: WARNING nova.compute.manager [req-b6ad75e8-c98e-4c67-a22a-2ed8745dc74d req-70095253-eda6-46dc-bec7-b05ecc085679 service nova] [instance: 7a6b16de-4506-432f-97f9-f083243dc047] Received unexpected event network-vif-plugged-4e4e1bfc-ebf9-41eb-81be-d1c34001dcff for instance with vm_state active and task_state rebuild_spawning.
Nov 06 15:48:28 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:48:28 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:48:28 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:48:28 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:48:28 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:48:29 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:48:30 user nova-compute[75337]: DEBUG nova.compute.manager [None req-af28426e-8adf-4118-a307-79668cbd99aa tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] [instance: 7a6b16de-4506-432f-97f9-f083243dc047] Instance event wait completed in 0 seconds for  {{(pid=75337) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 15:48:30 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-af28426e-8adf-4118-a307-79668cbd99aa tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] [instance: 7a6b16de-4506-432f-97f9-f083243dc047] Guest created on hypervisor {{(pid=75337) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 15:48:30 user nova-compute[75337]: INFO nova.virt.libvirt.driver [-] [instance: 7a6b16de-4506-432f-97f9-f083243dc047] Instance spawned successfully.
Nov 06 15:48:30 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-af28426e-8adf-4118-a307-79668cbd99aa tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] [instance: 7a6b16de-4506-432f-97f9-f083243dc047] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 15:48:30 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-af28426e-8adf-4118-a307-79668cbd99aa tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] [instance: 7a6b16de-4506-432f-97f9-f083243dc047] Found default for hw_cdrom_bus of ide {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:48:30 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-af28426e-8adf-4118-a307-79668cbd99aa tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] [instance: 7a6b16de-4506-432f-97f9-f083243dc047] Found default for hw_disk_bus of virtio {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:48:30 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-af28426e-8adf-4118-a307-79668cbd99aa tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] [instance: 7a6b16de-4506-432f-97f9-f083243dc047] Found default for hw_input_bus of None {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:48:30 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-af28426e-8adf-4118-a307-79668cbd99aa tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] [instance: 7a6b16de-4506-432f-97f9-f083243dc047] Found default for hw_pointer_model of None {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:48:30 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-af28426e-8adf-4118-a307-79668cbd99aa tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] [instance: 7a6b16de-4506-432f-97f9-f083243dc047] Found default for hw_video_model of virtio {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:48:30 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-af28426e-8adf-4118-a307-79668cbd99aa tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] [instance: 7a6b16de-4506-432f-97f9-f083243dc047] Found default for hw_vif_model of virtio {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:48:30 user nova-compute[75337]: DEBUG nova.compute.manager [req-6c4f2f19-bc74-4548-9b5c-cdf99a2814c7 req-aeb22db1-9dba-4615-99aa-2aa97ea03794 service nova] [instance: 7a6b16de-4506-432f-97f9-f083243dc047] Received event network-vif-plugged-4e4e1bfc-ebf9-41eb-81be-d1c34001dcff {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:48:30 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-6c4f2f19-bc74-4548-9b5c-cdf99a2814c7 req-aeb22db1-9dba-4615-99aa-2aa97ea03794 service nova] Acquiring lock "7a6b16de-4506-432f-97f9-f083243dc047-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:48:30 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-6c4f2f19-bc74-4548-9b5c-cdf99a2814c7 req-aeb22db1-9dba-4615-99aa-2aa97ea03794 service nova] Lock "7a6b16de-4506-432f-97f9-f083243dc047-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:48:30 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-6c4f2f19-bc74-4548-9b5c-cdf99a2814c7 req-aeb22db1-9dba-4615-99aa-2aa97ea03794 service nova] Lock "7a6b16de-4506-432f-97f9-f083243dc047-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:48:30 user nova-compute[75337]: DEBUG nova.compute.manager [req-6c4f2f19-bc74-4548-9b5c-cdf99a2814c7 req-aeb22db1-9dba-4615-99aa-2aa97ea03794 service nova] [instance: 7a6b16de-4506-432f-97f9-f083243dc047] No waiting events found dispatching network-vif-plugged-4e4e1bfc-ebf9-41eb-81be-d1c34001dcff {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:48:30 user nova-compute[75337]: WARNING nova.compute.manager [req-6c4f2f19-bc74-4548-9b5c-cdf99a2814c7 req-aeb22db1-9dba-4615-99aa-2aa97ea03794 service nova] [instance: 7a6b16de-4506-432f-97f9-f083243dc047] Received unexpected event network-vif-plugged-4e4e1bfc-ebf9-41eb-81be-d1c34001dcff for instance with vm_state active and task_state rebuild_spawning.
Nov 06 15:48:30 user nova-compute[75337]: DEBUG nova.compute.manager [None req-af28426e-8adf-4118-a307-79668cbd99aa tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] [instance: 7a6b16de-4506-432f-97f9-f083243dc047] Checking state {{(pid=75337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 15:48:30 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-af28426e-8adf-4118-a307-79668cbd99aa tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:48:30 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-af28426e-8adf-4118-a307-79668cbd99aa tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:48:30 user nova-compute[75337]: DEBUG nova.objects.instance [None req-af28426e-8adf-4118-a307-79668cbd99aa tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] [instance: 7a6b16de-4506-432f-97f9-f083243dc047] Trying to apply a migration context that does not seem to be set for this instance {{(pid=75337) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 06 15:48:30 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-af28426e-8adf-4118-a307-79668cbd99aa tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.079s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:48:31 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:48:33 user nova-compute[75337]: DEBUG nova.compute.manager [req-9401c4b9-3289-42e1-928f-5d1c1a004f7b req-0a04f149-2430-4420-92ef-e3d3072344eb service nova] [instance: afa4e52b-af51-45bf-b619-aeca14e7724d] Received event network-changed-d66c8fee-7efa-49a4-b9c3-2f7ad2ccc71b {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:48:33 user nova-compute[75337]: DEBUG nova.compute.manager [req-9401c4b9-3289-42e1-928f-5d1c1a004f7b req-0a04f149-2430-4420-92ef-e3d3072344eb service nova] [instance: afa4e52b-af51-45bf-b619-aeca14e7724d] Refreshing instance network info cache due to event network-changed-d66c8fee-7efa-49a4-b9c3-2f7ad2ccc71b. {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 15:48:33 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-9401c4b9-3289-42e1-928f-5d1c1a004f7b req-0a04f149-2430-4420-92ef-e3d3072344eb service nova] Acquiring lock "refresh_cache-afa4e52b-af51-45bf-b619-aeca14e7724d" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 15:48:33 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-9401c4b9-3289-42e1-928f-5d1c1a004f7b req-0a04f149-2430-4420-92ef-e3d3072344eb service nova] Acquired lock "refresh_cache-afa4e52b-af51-45bf-b619-aeca14e7724d" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 15:48:33 user nova-compute[75337]: DEBUG nova.network.neutron [req-9401c4b9-3289-42e1-928f-5d1c1a004f7b req-0a04f149-2430-4420-92ef-e3d3072344eb service nova] [instance: afa4e52b-af51-45bf-b619-aeca14e7724d] Refreshing network info cache for port d66c8fee-7efa-49a4-b9c3-2f7ad2ccc71b {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 15:48:34 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:48:34 user nova-compute[75337]: DEBUG nova.network.neutron [req-9401c4b9-3289-42e1-928f-5d1c1a004f7b req-0a04f149-2430-4420-92ef-e3d3072344eb service nova] [instance: afa4e52b-af51-45bf-b619-aeca14e7724d] Updated VIF entry in instance network info cache for port d66c8fee-7efa-49a4-b9c3-2f7ad2ccc71b. {{(pid=75337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 15:48:34 user nova-compute[75337]: DEBUG nova.network.neutron [req-9401c4b9-3289-42e1-928f-5d1c1a004f7b req-0a04f149-2430-4420-92ef-e3d3072344eb service nova] [instance: afa4e52b-af51-45bf-b619-aeca14e7724d] Updating instance_info_cache with network_info: [{"id": "d66c8fee-7efa-49a4-b9c3-2f7ad2ccc71b", "address": "fa:16:3e:17:d2:52", "network": {"id": "f24470c2-ff6f-49fd-b28f-16b8a87ed3b4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-217486733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed09a1def6f0477796404d9bd3357dd0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd66c8fee-7e", "ovs_interfaceid": "d66c8fee-7efa-49a4-b9c3-2f7ad2ccc71b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:48:34 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-9401c4b9-3289-42e1-928f-5d1c1a004f7b req-0a04f149-2430-4420-92ef-e3d3072344eb service nova] Releasing lock "refresh_cache-afa4e52b-af51-45bf-b619-aeca14e7724d" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 15:48:36 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:48:39 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:48:41 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:48:44 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:48:46 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:48:49 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:48:51 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:48:54 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:48:56 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:48:59 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:01 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:01 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d522c86-1736-4bc0-b780-53e8ad01225d tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] [instance: 477da5ee-3e03-4aa9-9a88-004c442e617a] Calling os-brick to attach iSCSI Volume {{(pid=75337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 15:49:01 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d522c86-1736-4bc0-b780-53e8ad01225d tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2abc33d0c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4954683e-297c-4bed-94c9-675adb40fb66', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'daDFkXwb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 15:49:01 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-8d522c86-1736-4bc0-b780-53e8ad01225d tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 15:49:01 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-8d522c86-1736-4bc0-b780-53e8ad01225d tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 15:49:01 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-8d522c86-1736-4bc0-b780-53e8ad01225d tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 15:49:01 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-8d522c86-1736-4bc0-b780-53e8ad01225d tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 15:49:01 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-8d522c86-1736-4bc0-b780-53e8ad01225d tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4954683e-297c-4bed-94c9-675adb40fb66" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 15:49:01 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-8d522c86-1736-4bc0-b780-53e8ad01225d tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4954683e-297c-4bed-94c9-675adb40fb66" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 15:49:01 user nova-compute[75337]: INFO os_brick.initiator.connectors.iscsi [None req-8d522c86-1736-4bc0-b780-53e8ad01225d tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 15:49:01 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4954683e-297c-4bed-94c9-675adb40fb66 -p 172.16.0.220:3260 {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:01 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4954683e-297c-4bed-94c9-675adb40fb66 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:49:01 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[88949b15-966f-4cd0-b61f-bb60d2bf746c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:49:01 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d522c86-1736-4bc0-b780-53e8ad01225d tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 15:49:01 user nova-compute[75337]:  {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:49:02 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4954683e-297c-4bed-94c9-675adb40fb66 -p 172.16.0.220:3260 --interface default --op new {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:02 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4954683e-297c-4bed-94c9-675adb40fb66 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:49:02 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[be7e0082-3307-4831-ba99-7b852a6a8ae3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4954683e-297c-4bed-94c9-675adb40fb66] added\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:49:02 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d522c86-1736-4bc0-b780-53e8ad01225d tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4954683e-297c-4bed-94c9-675adb40fb66] added
Nov 06 15:49:02 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:49:02 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4954683e-297c-4bed-94c9-675adb40fb66 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:02 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4954683e-297c-4bed-94c9-675adb40fb66 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:49:02 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4837a66-4826-43c4-8d0a-c9373261e419]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:49:02 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d522c86-1736-4bc0-b780-53e8ad01225d tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:49:02 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4954683e-297c-4bed-94c9-675adb40fb66 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:02 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4954683e-297c-4bed-94c9-675adb40fb66 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:49:02 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[aac0988f-cf8d-4f9b-b174-8224fbd0e6cc]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:49:02 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d522c86-1736-4bc0-b780-53e8ad01225d tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:49:02 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4954683e-297c-4bed-94c9-675adb40fb66 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v daDFkXwb {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:02 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4954683e-297c-4bed-94c9-675adb40fb66 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v daDFkXwb" returned: 0 in 0.027s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:49:02 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2339adf-2236-4626-988b-e1c718937949]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:49:02 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d522c86-1736-4bc0-b780-53e8ad01225d tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'daDFkXwb'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:49:02 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4954683e-297c-4bed-94c9-675adb40fb66 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:02 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4954683e-297c-4bed-94c9-675adb40fb66 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:49:02 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8c11de1-12d8-4971-9db1-cf7d30ef8201]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:49:02 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d522c86-1736-4bc0-b780-53e8ad01225d tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:49:02 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:02 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:49:02 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce600e96-8918-4024-b060-7eb2d6582947]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1421f55-d453-441d-bdf7-3743102662b6 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6 (non-flash)\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:49:02 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d522c86-1736-4bc0-b780-53e8ad01225d tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)
Nov 06 15:49:02 user nova-compute[75337]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1421f55-d453-441d-bdf7-3743102662b6 (non-flash)
Nov 06 15:49:02 user nova-compute[75337]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6 (non-flash)
Nov 06 15:49:02 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 15:49:02 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d522c86-1736-4bc0-b780-53e8ad01225d tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)
Nov 06 15:49:02 user nova-compute[75337]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1421f55-d453-441d-bdf7-3743102662b6 (non-flash)
Nov 06 15:49:02 user nova-compute[75337]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6 (non-flash)
Nov 06 15:49:02 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 15:49:02 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4954683e-297c-4bed-94c9-675adb40fb66 -p 172.16.0.220:3260 --login {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:02 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4954683e-297c-4bed-94c9-675adb40fb66 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:49:02 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[b97ab014-12a2-4042-bedc-406fff803a19]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4954683e-297c-4bed-94c9-675adb40fb66, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4954683e-297c-4bed-94c9-675adb40fb66, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:49:02 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d522c86-1736-4bc0-b780-53e8ad01225d tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4954683e-297c-4bed-94c9-675adb40fb66, portal: 172.16.0.220,3260]
Nov 06 15:49:02 user nova-compute[75337]: Login to [iface: default, target: iqn.2010-10.org.openstack:4954683e-297c-4bed-94c9-675adb40fb66, portal: 172.16.0.220,3260] successful.
Nov 06 15:49:02 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:49:02 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4954683e-297c-4bed-94c9-675adb40fb66 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:02 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4954683e-297c-4bed-94c9-675adb40fb66 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:49:02 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[a587831f-0726-4b46-848b-b9c03d97c2cd]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:49:02 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d522c86-1736-4bc0-b780-53e8ad01225d tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:49:02 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:02 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:49:02 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[6379239d-a533-49bc-bd9a-4def87d27ac9]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1421f55-d453-441d-bdf7-3743102662b6 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4954683e-297c-4bed-94c9-675adb40fb66 (non-flash)\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:49:02 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d522c86-1736-4bc0-b780-53e8ad01225d tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)
Nov 06 15:49:02 user nova-compute[75337]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1421f55-d453-441d-bdf7-3743102662b6 (non-flash)
Nov 06 15:49:02 user nova-compute[75337]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6 (non-flash)
Nov 06 15:49:02 user nova-compute[75337]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4954683e-297c-4bed-94c9-675adb40fb66 (non-flash)
Nov 06 15:49:02 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 15:49:02 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d522c86-1736-4bc0-b780-53e8ad01225d tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)
Nov 06 15:49:02 user nova-compute[75337]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1421f55-d453-441d-bdf7-3743102662b6 (non-flash)
Nov 06 15:49:02 user nova-compute[75337]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6 (non-flash)
Nov 06 15:49:02 user nova-compute[75337]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4954683e-297c-4bed-94c9-675adb40fb66 (non-flash)
Nov 06 15:49:02 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 15:49:02 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-8d522c86-1736-4bc0-b780-53e8ad01225d tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4954683e-297c-4bed-94c9-675adb40fb66" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.301s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 15:49:02 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d522c86-1736-4bc0-b780-53e8ad01225d tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Connected to 172.16.0.220:3260 {{(pid=75337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 15:49:02 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-8d522c86-1736-4bc0-b780-53e8ad01225d tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] HCTL ('36', '-', '-', 0) found on session 23 with lun 0 {{(pid=75337) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 15:49:02 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-8d522c86-1736-4bc0-b780-53e8ad01225d tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75337) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 15:49:02 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:02 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.022s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:49:02 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[42d1bd34-c4a3-4593-89d4-e38898948b15]: (4, ('- - 0', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:49:02 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-8d522c86-1736-4bc0-b780-53e8ad01225d tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Searching for a device in session 23 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75337) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 15:49:02 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d522c86-1736-4bc0-b780-53e8ad01225d tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:4954683e-297c-4bed-94c9-675adb40fb66', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'daDFkXwb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 15:49:02 user nova-compute[75337]: DEBUG nova.compute.manager [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Start spawning the instance on the hypervisor. {{(pid=75337) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 15:49:02 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Creating instance directory {{(pid=75337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 15:49:02 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Creating image(s)
Nov 06 15:49:02 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Did not create local disks {{(pid=75337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 06 15:49:02 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Ensure instance console log exists: /opt/stack/data/nova/instances/fdda34b5-280f-489d-baf5-bf21ac6dd6c9/console.log {{(pid=75337) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 15:49:02 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:49:02 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:49:02 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:49:02 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Start _get_guest_xml network_info=[{"id": "ee068b96-f361-4cb1-afeb-d3db42848f50", "address": "fa:16:3e:63:2a:18", "network": {"id": "8a494051-b597-47cd-8d64-76f0be5760cc", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-162490382-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7944be2b6e2047f5a633242809f6f04e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee068b96-f3", "ovs_interfaceid": "ee068b96-f361-4cb1-afeb-d3db42848f50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7359ffbf-b953-480e-ae89-7ce5dda880a3", "address": "fa:16:3e:12:4b:11", "network": {"id": "e17a21e6-be31-4611-8f62-59327c8c4d9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1516543392", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7944be2b6e2047f5a633242809f6f04e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7359ffbf-b9", "ovs_interfaceid": "7359ffbf-b953-480e-ae89-7ce5dda880a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0184ea76-40a1-41f4-9a6f-e2ca6719b7ab", "address": "fa:16:3e:3b:f7:32", "network": {"id": "e17a21e6-be31-4611-8f62-59327c8c4d9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1516543392", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7944be2b6e2047f5a633242809f6f04e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0184ea76-40", "ovs_interfaceid": "0184ea76-40a1-41f4-9a6f-e2ca6719b7ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "38a409f9-0fb9-4505-9f74-bf2859e6f66c", "address": "fa:16:3e:8a:6f:5e", "network": {"id": "e17a21e6-be31-4611-8f62-59327c8c4d9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1516543392", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.115", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7944be2b6e2047f5a633242809f6f04e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38a409f9-0f", "ovs_interfaceid": "38a409f9-0fb9-4505-9f74-bf2859e6f66c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d86aca21-e67b-48e9-b8de-a1d618a5dfc7", "address": "fa:16:3e:bf:c2:bd", "network": {"id": "e17a21e6-be31-4611-8f62-59327c8c4d9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1516543392", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.131", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7944be2b6e2047f5a633242809f6f04e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd86aca21-e6", "ovs_interfaceid": "d86aca21-e67b-48e9-b8de-a1d618a5dfc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4c56104b-528f-40b8-931d-7619e413ab07", "address": "fa:16:3e:4d:d7:97", "network": {"id": "00ad9466-de22-4eb1-86c7-01667b94d2a9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1660110834", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7944be2b6e2047f5a633242809f6f04e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c56104b-52", "ovs_interfaceid": "4c56104b-528f-40b8-931d-7619e413ab07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "996e784d-bbe6-447b-8f1f-066ec34be989", "address": "fa:16:3e:41:c0:e2", "network": {"id": "00ad9466-de22-4eb1-86c7-01667b94d2a9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1660110834", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7944be2b6e2047f5a633242809f6f04e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap996e784d-bb", "ovs_interfaceid": "996e784d-bbe6-447b-8f1f-066ec34be989", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T15:34:14Z,direct_url=<?>,disk_format='qcow2',id=16b903ae-a40f-41a7-985b-4804cce92c62,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6549a15819f1469bbd5eeae8190e3d44',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T15:34:15Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'attachment_id': 'ad7b03b5-a814-43a3-9515-0a39e1ed6262', 'guest_format': None, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:06631b49-02a1-4759-8d9b-22b7ebdaa584', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EvnrPMtD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'fdda34b5-280f-489d-baf5-bf21ac6dd6c9', 'attached_at': '', 'detached_at': '', 'volume_id': '06631b49-02a1-4759-8d9b-22b7ebdaa584', 'serial': '06631b49-02a1-4759-8d9b-22b7ebdaa584'}, 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vda', 'volume_type': None}, {'delete_on_termination': False, 'attachment_id': 'a68ab446-1dd1-4d43-8a95-1a2f76011570', 'guest_format': None, 'boot_index': 1, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:563526a2-6204-4264-91b7-041e6cadab23', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RnmGPoqS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'fdda34b5-280f-489d-baf5-bf21ac6dd6c9', 'attached_at': '', 'detached_at': '', 'volume_id': '563526a2-6204-4264-91b7-041e6cadab23', 'serial': '563526a2-6204-4264-91b7-041e6cadab23'}, 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vdb', 'volume_type': None}, {'delete_on_termination': False, 'attachment_id': '84c11847-bb3f-4ce5-a678-6f28d036659c', 'guest_format': None, 'boot_index': 2, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1bebbb46-2250-4511-ba59-f4ce67e0b45d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VGdgTYBv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'fdda34b5-280f-489d-baf5-bf21ac6dd6c9', 'attached_at': '', 'detached_at': '', 'volume_id': '1bebbb46-2250-4511-ba59-f4ce67e0b45d', 'serial': '1bebbb46-2250-4511-ba59-f4ce67e0b45d'}, 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vdc', 'volume_type': None} {{(pid=75337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 15:49:02 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 15:49:02 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 15:49:02 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 15:49:02 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] CPU controller missing on host. {{(pid=75337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 15:49:02 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 15:49:02 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] CPU controller found on host. {{(pid=75337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 15:49:02 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75337) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 15:49:02 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T15:34:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T15:34:14Z,direct_url=<?>,disk_format='qcow2',id=16b903ae-a40f-41a7-985b-4804cce92c62,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6549a15819f1469bbd5eeae8190e3d44',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T15:34:15Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 15:49:02 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Flavor limits 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 15:49:02 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Image limits 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 15:49:02 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Flavor pref 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 15:49:02 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Image pref 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 15:49:02 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 15:49:02 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 15:49:02 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 15:49:02 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Got 1 possible topologies {{(pid=75337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 15:49:02 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 15:49:02 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 15:49:02 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Calling os-brick to attach iSCSI Volume {{(pid=75337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 15:49:02 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2abc33d0c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:06631b49-02a1-4759-8d9b-22b7ebdaa584', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EvnrPMtD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 15:49:02 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 15:49:02 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 15:49:02 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:49:02 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:49:02 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Starting heal instance info cache {{(pid=75337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 15:49:03 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "refresh_cache-cdced0ba-84ff-42af-baab-e2f3412e1676" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 15:49:03 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquired lock "refresh_cache-cdced0ba-84ff-42af-baab-e2f3412e1676" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 15:49:03 user nova-compute[75337]: DEBUG nova.network.neutron [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] [instance: cdced0ba-84ff-42af-baab-e2f3412e1676] Forcefully refreshing network info cache for instance {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 15:49:03 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-8d522c86-1736-4bc0-b780-53e8ad01225d tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.345s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 15:49:03 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d522c86-1736-4bc0-b780-53e8ad01225d tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] <== connect_volume: return (1347ms) {'type': 'block', 'scsi_wwn': '23934663761326137', 'path': '/dev/sde'} {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 15:49:03 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d522c86-1736-4bc0-b780-53e8ad01225d tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] [instance: 477da5ee-3e03-4aa9-9a88-004c442e617a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23934663761326137', 'path': '/dev/sde'} {{(pid=75337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 15:49:03 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.396s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 15:49:03 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 15:49:03 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:06631b49-02a1-4759-8d9b-22b7ebdaa584" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 15:49:03 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:06631b49-02a1-4759-8d9b-22b7ebdaa584" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 15:49:03 user nova-compute[75337]: INFO os_brick.initiator.connectors.iscsi [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 15:49:03 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06631b49-02a1-4759-8d9b-22b7ebdaa584 -p 172.16.0.220:3260 {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:03 user nova-compute[75337]: DEBUG nova.objects.instance [None req-8d522c86-1736-4bc0-b780-53e8ad01225d tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Lazy-loading 'flavor' on Instance uuid 477da5ee-3e03-4aa9-9a88-004c442e617a {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 15:49:03 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06631b49-02a1-4759-8d9b-22b7ebdaa584 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:49:03 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[0848f3a3-23eb-41c4-ab7c-6b5934770226]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:49:03 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 15:49:03 user nova-compute[75337]:  {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:49:03 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06631b49-02a1-4759-8d9b-22b7ebdaa584 -p 172.16.0.220:3260 --interface default --op new {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:03 user nova-compute[75337]: DEBUG nova.virt.libvirt.guest [None req-8d522c86-1736-4bc0-b780-53e8ad01225d tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] attach device xml: <disk type="block" device="disk">
Nov 06 15:49:03 user nova-compute[75337]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 15:49:03 user nova-compute[75337]:   <source dev="/dev/sde"/>
Nov 06 15:49:03 user nova-compute[75337]:   <target dev="vdb" bus="virtio"/>
Nov 06 15:49:03 user nova-compute[75337]:   <serial>4954683e-297c-4bed-94c9-675adb40fb66</serial>
Nov 06 15:49:03 user nova-compute[75337]: </disk>
Nov 06 15:49:03 user nova-compute[75337]:  {{(pid=75337) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 06 15:49:03 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06631b49-02a1-4759-8d9b-22b7ebdaa584 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:49:03 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cbd4838-75a8-43d0-90de-b584ae8faecd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:06631b49-02a1-4759-8d9b-22b7ebdaa584] added\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:49:03 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:06631b49-02a1-4759-8d9b-22b7ebdaa584] added
Nov 06 15:49:03 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:49:03 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06631b49-02a1-4759-8d9b-22b7ebdaa584 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:03 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06631b49-02a1-4759-8d9b-22b7ebdaa584 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:49:03 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[e668ac28-0a3e-43d4-bbd2-fc54f72685c1]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:49:03 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:49:03 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06631b49-02a1-4759-8d9b-22b7ebdaa584 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:03 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06631b49-02a1-4759-8d9b-22b7ebdaa584 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:49:03 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[463a64b8-7b09-42a9-8401-484b917ecb63]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:49:03 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:49:03 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06631b49-02a1-4759-8d9b-22b7ebdaa584 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EvnrPMtD {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:03 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06631b49-02a1-4759-8d9b-22b7ebdaa584 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EvnrPMtD" returned: 0 in 0.023s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:49:03 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[8323b53e-3cb5-4edc-97b0-432fd45e4e0d]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:49:03 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EvnrPMtD'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:49:03 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06631b49-02a1-4759-8d9b-22b7ebdaa584 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:03 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06631b49-02a1-4759-8d9b-22b7ebdaa584 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:49:03 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[e780ff51-283d-48ac-81ed-958078266fd9]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:49:03 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:49:03 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:03 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:49:03 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd852247-35bc-4df4-9c91-0eb8f66e9391]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1421f55-d453-441d-bdf7-3743102662b6 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4954683e-297c-4bed-94c9-675adb40fb66 (non-flash)\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:49:03 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)
Nov 06 15:49:03 user nova-compute[75337]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1421f55-d453-441d-bdf7-3743102662b6 (non-flash)
Nov 06 15:49:03 user nova-compute[75337]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6 (non-flash)
Nov 06 15:49:03 user nova-compute[75337]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4954683e-297c-4bed-94c9-675adb40fb66 (non-flash)
Nov 06 15:49:03 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 15:49:03 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)
Nov 06 15:49:03 user nova-compute[75337]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1421f55-d453-441d-bdf7-3743102662b6 (non-flash)
Nov 06 15:49:03 user nova-compute[75337]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6 (non-flash)
Nov 06 15:49:03 user nova-compute[75337]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4954683e-297c-4bed-94c9-675adb40fb66 (non-flash)
Nov 06 15:49:03 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 15:49:03 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06631b49-02a1-4759-8d9b-22b7ebdaa584 -p 172.16.0.220:3260 --login {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:03 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06631b49-02a1-4759-8d9b-22b7ebdaa584 -p 172.16.0.220:3260 --login" returned: 0 in 0.114s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:49:03 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[eda13d77-49dd-4598-b837-2f6d0f58689d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:06631b49-02a1-4759-8d9b-22b7ebdaa584, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:06631b49-02a1-4759-8d9b-22b7ebdaa584, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:49:03 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:06631b49-02a1-4759-8d9b-22b7ebdaa584, portal: 172.16.0.220,3260]
Nov 06 15:49:03 user nova-compute[75337]: Login to [iface: default, target: iqn.2010-10.org.openstack:06631b49-02a1-4759-8d9b-22b7ebdaa584, portal: 172.16.0.220,3260] successful.
Nov 06 15:49:03 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:49:03 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06631b49-02a1-4759-8d9b-22b7ebdaa584 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:03 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06631b49-02a1-4759-8d9b-22b7ebdaa584 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:49:03 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[cee4a52c-76f9-4dca-a182-b84d37d2b725]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:49:03 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:49:03 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:03 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.044s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:49:03 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[b07a69c0-ba89-4530-b542-8cce30c41c5c]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1421f55-d453-441d-bdf7-3743102662b6 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4954683e-297c-4bed-94c9-675adb40fb66 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06631b49-02a1-4759-8d9b-22b7ebdaa584 (non-flash)\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:49:03 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)
Nov 06 15:49:03 user nova-compute[75337]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1421f55-d453-441d-bdf7-3743102662b6 (non-flash)
Nov 06 15:49:03 user nova-compute[75337]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6 (non-flash)
Nov 06 15:49:03 user nova-compute[75337]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4954683e-297c-4bed-94c9-675adb40fb66 (non-flash)
Nov 06 15:49:03 user nova-compute[75337]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06631b49-02a1-4759-8d9b-22b7ebdaa584 (non-flash)
Nov 06 15:49:03 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 15:49:03 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)
Nov 06 15:49:03 user nova-compute[75337]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1421f55-d453-441d-bdf7-3743102662b6 (non-flash)
Nov 06 15:49:03 user nova-compute[75337]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6 (non-flash)
Nov 06 15:49:03 user nova-compute[75337]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4954683e-297c-4bed-94c9-675adb40fb66 (non-flash)
Nov 06 15:49:03 user nova-compute[75337]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06631b49-02a1-4759-8d9b-22b7ebdaa584 (non-flash)
Nov 06 15:49:03 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 15:49:03 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:06631b49-02a1-4759-8d9b-22b7ebdaa584" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.425s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 15:49:03 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Connected to 172.16.0.220:3260 {{(pid=75337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 15:49:03 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] HCTL ('37', '-', '-', 0) found on session 24 with lun 0 {{(pid=75337) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 15:49:03 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75337) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 15:49:03 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:03 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.020s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:49:03 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eb9512e-af9d-4a64-87ca-efa3940b420e]: (4, ('- - 0', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:49:03 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Searching for a device in session 24 and hctl ['37', '*', '*', 0] yield: None {{(pid=75337) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 15:49:03 user nova-compute[75337]: DEBUG nova.network.neutron [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] [instance: cdced0ba-84ff-42af-baab-e2f3412e1676] Updating instance_info_cache with network_info: [{"id": "6439aebd-fede-4cad-857e-1c44587827ef", "address": "fa:16:3e:cf:ac:79", "network": {"id": "c07dbf10-d5b5-40f4-b841-826ca6f505d8", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1886147547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2de62cc51864374a29a5d96584e8dd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6439aebd-fe", "ovs_interfaceid": "6439aebd-fede-4cad-857e-1c44587827ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:49:03 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Releasing lock "refresh_cache-cdced0ba-84ff-42af-baab-e2f3412e1676" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 15:49:03 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] [instance: cdced0ba-84ff-42af-baab-e2f3412e1676] Updated the network info_cache for instance {{(pid=75337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 15:49:03 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:49:03 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:49:03 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:49:03 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:49:03 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:49:03 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:49:03 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75337) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 15:49:03 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-8d522c86-1736-4bc0-b780-53e8ad01225d tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] No BDM found with device name vda, not building metadata. {{(pid=75337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 15:49:03 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-8d522c86-1736-4bc0-b780-53e8ad01225d tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 15:49:03 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-8d522c86-1736-4bc0-b780-53e8ad01225d tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] No VIF found with MAC fa:16:3e:77:c1:a2, not building metadata {{(pid=75337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 15:49:04 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-8d522c86-1736-4bc0-b780-53e8ad01225d tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Lock "477da5ee-3e03-4aa9-9a88-004c442e617a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 38.926s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:49:04 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:04 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Searching for a device in session 24 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75337) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 15:49:04 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:06631b49-02a1-4759-8d9b-22b7ebdaa584', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EvnrPMtD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 15:49:04 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.464s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 15:49:04 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] <== connect_volume: return (1861ms) {'type': 'block', 'scsi_wwn': '26333653034666162', 'path': '/dev/sdf'} {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 15:49:04 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26333653034666162', 'path': '/dev/sdf'} {{(pid=75337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 15:49:04 user nova-compute[75337]: DEBUG nova.compute.manager [None req-c05e62de-0cab-45f4-bdae-03cecf76da51 tempest-TestVolumeSwap-916912695 tempest-TestVolumeSwap-916912695-project-admin] [instance: 9125364b-332f-4297-815f-3aa1eadaf743] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0c5fa35a-1ba5-4390-9102-83ac1dbb790a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nkapcTJV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9125364b-332f-4297-815f-3aa1eadaf743', 'attached_at': '', 'detached_at': '', 'volume_id': '0c5fa35a-1ba5-4390-9102-83ac1dbb790a', 'serial': '0c5fa35a-1ba5-4390-9102-83ac1dbb790a'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b1421f55-d453-441d-bdf7-3743102662b6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vVbIPGuJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'volume_id': 'b1421f55-d453-441d-bdf7-3743102662b6'}, 'status': 'reserved', 'instance': '9125364b-332f-4297-815f-3aa1eadaf743', 'attached_at': '', 'detached_at': '', 'volume_id': 'b1421f55-d453-441d-bdf7-3743102662b6', 'serial'} {{(pid=75337) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 06 15:49:04 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c05e62de-0cab-45f4-bdae-03cecf76da51 tempest-TestVolumeSwap-916912695 tempest-TestVolumeSwap-916912695-project-admin] [instance: 9125364b-332f-4297-815f-3aa1eadaf743] Calling os-brick to attach iSCSI Volume {{(pid=75337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 15:49:04 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c05e62de-0cab-45f4-bdae-03cecf76da51 tempest-TestVolumeSwap-916912695 tempest-TestVolumeSwap-916912695-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2abc33d0c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0c5fa35a-1ba5-4390-9102-83ac1dbb790a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nkapcTJV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 15:49:04 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-c05e62de-0cab-45f4-bdae-03cecf76da51 tempest-TestVolumeSwap-916912695 tempest-TestVolumeSwap-916912695-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 15:49:04 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-c05e62de-0cab-45f4-bdae-03cecf76da51 tempest-TestVolumeSwap-916912695 tempest-TestVolumeSwap-916912695-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 15:49:04 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-c05e62de-0cab-45f4-bdae-03cecf76da51 tempest-TestVolumeSwap-916912695 tempest-TestVolumeSwap-916912695-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 15:49:04 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-c05e62de-0cab-45f4-bdae-03cecf76da51 tempest-TestVolumeSwap-916912695 tempest-TestVolumeSwap-916912695-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 15:49:04 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-c05e62de-0cab-45f4-bdae-03cecf76da51 tempest-TestVolumeSwap-916912695 tempest-TestVolumeSwap-916912695-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0c5fa35a-1ba5-4390-9102-83ac1dbb790a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 15:49:04 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-c05e62de-0cab-45f4-bdae-03cecf76da51 tempest-TestVolumeSwap-916912695 tempest-TestVolumeSwap-916912695-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0c5fa35a-1ba5-4390-9102-83ac1dbb790a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 15:49:04 user nova-compute[75337]: INFO os_brick.initiator.connectors.iscsi [None req-c05e62de-0cab-45f4-bdae-03cecf76da51 tempest-TestVolumeSwap-916912695 tempest-TestVolumeSwap-916912695-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 15:49:04 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c5fa35a-1ba5-4390-9102-83ac1dbb790a -p 172.16.0.220:3260 {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:04 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Calling os-brick to attach iSCSI Volume {{(pid=75337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 15:49:04 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2abc33d0c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:563526a2-6204-4264-91b7-041e6cadab23', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RnmGPoqS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 15:49:04 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 15:49:04 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 15:49:04 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c5fa35a-1ba5-4390-9102-83ac1dbb790a -p 172.16.0.220:3260" returned: 21 in 0.030s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:49:04 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd3a26cd-a0e5-4d5f-b597-20e29189e620]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:49:04 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c05e62de-0cab-45f4-bdae-03cecf76da51 tempest-TestVolumeSwap-916912695 tempest-TestVolumeSwap-916912695-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 15:49:04 user nova-compute[75337]:  {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:49:04 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c5fa35a-1ba5-4390-9102-83ac1dbb790a -p 172.16.0.220:3260 --interface default --op new {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:04 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c5fa35a-1ba5-4390-9102-83ac1dbb790a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:49:04 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bbb755f-819c-4ccc-b7ae-ff239becb6cc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0c5fa35a-1ba5-4390-9102-83ac1dbb790a] added\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:49:04 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c05e62de-0cab-45f4-bdae-03cecf76da51 tempest-TestVolumeSwap-916912695 tempest-TestVolumeSwap-916912695-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0c5fa35a-1ba5-4390-9102-83ac1dbb790a] added
Nov 06 15:49:04 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:49:04 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c5fa35a-1ba5-4390-9102-83ac1dbb790a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:04 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c5fa35a-1ba5-4390-9102-83ac1dbb790a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:49:04 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[d092e780-7ec3-4fc6-9f75-a04ac3dccc7a]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:49:04 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c05e62de-0cab-45f4-bdae-03cecf76da51 tempest-TestVolumeSwap-916912695 tempest-TestVolumeSwap-916912695-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:49:04 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c5fa35a-1ba5-4390-9102-83ac1dbb790a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:04 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c5fa35a-1ba5-4390-9102-83ac1dbb790a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:49:04 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6f83407-f5b3-4bc4-9034-771d67ca2ff6]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:49:04 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c05e62de-0cab-45f4-bdae-03cecf76da51 tempest-TestVolumeSwap-916912695 tempest-TestVolumeSwap-916912695-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:49:04 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c5fa35a-1ba5-4390-9102-83ac1dbb790a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nkapcTJV {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:04 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c5fa35a-1ba5-4390-9102-83ac1dbb790a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nkapcTJV" returned: 0 in 0.020s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:49:04 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[235be3b2-5a44-4126-b967-6cb183253c5d]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:49:04 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c05e62de-0cab-45f4-bdae-03cecf76da51 tempest-TestVolumeSwap-916912695 tempest-TestVolumeSwap-916912695-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nkapcTJV'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:49:04 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c5fa35a-1ba5-4390-9102-83ac1dbb790a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:04 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c5fa35a-1ba5-4390-9102-83ac1dbb790a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:49:04 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b6da3fd-f55e-4a6e-8a79-d143831bb261]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:49:04 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c05e62de-0cab-45f4-bdae-03cecf76da51 tempest-TestVolumeSwap-916912695 tempest-TestVolumeSwap-916912695-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:49:04 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:05 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:49:05 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[e940d52f-d08c-464b-b280-6439eadb1389]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1421f55-d453-441d-bdf7-3743102662b6 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4954683e-297c-4bed-94c9-675adb40fb66 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06631b49-02a1-4759-8d9b-22b7ebdaa584 (non-flash)\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:49:05 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c05e62de-0cab-45f4-bdae-03cecf76da51 tempest-TestVolumeSwap-916912695 tempest-TestVolumeSwap-916912695-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)
Nov 06 15:49:05 user nova-compute[75337]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1421f55-d453-441d-bdf7-3743102662b6 (non-flash)
Nov 06 15:49:05 user nova-compute[75337]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6 (non-flash)
Nov 06 15:49:05 user nova-compute[75337]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4954683e-297c-4bed-94c9-675adb40fb66 (non-flash)
Nov 06 15:49:05 user nova-compute[75337]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06631b49-02a1-4759-8d9b-22b7ebdaa584 (non-flash)
Nov 06 15:49:05 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 15:49:05 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c05e62de-0cab-45f4-bdae-03cecf76da51 tempest-TestVolumeSwap-916912695 tempest-TestVolumeSwap-916912695-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)
Nov 06 15:49:05 user nova-compute[75337]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1421f55-d453-441d-bdf7-3743102662b6 (non-flash)
Nov 06 15:49:05 user nova-compute[75337]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6 (non-flash)
Nov 06 15:49:05 user nova-compute[75337]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4954683e-297c-4bed-94c9-675adb40fb66 (non-flash)
Nov 06 15:49:05 user nova-compute[75337]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06631b49-02a1-4759-8d9b-22b7ebdaa584 (non-flash)
Nov 06 15:49:05 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 15:49:05 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c5fa35a-1ba5-4390-9102-83ac1dbb790a -p 172.16.0.220:3260 --login {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:05 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager.update_available_resource {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:49:05 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:49:05 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:49:05 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:49:05 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Auditing locally available compute resources for user (node: user) {{(pid=75337) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 15:49:05 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-8acd48fd-c495-4dd2-b61d-2a9f2256f8fb tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Acquiring lock "477da5ee-3e03-4aa9-9a88-004c442e617a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:49:05 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-8acd48fd-c495-4dd2-b61d-2a9f2256f8fb tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Lock "477da5ee-3e03-4aa9-9a88-004c442e617a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:49:05 user nova-compute[75337]: INFO nova.compute.manager [None req-8acd48fd-c495-4dd2-b61d-2a9f2256f8fb tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] [instance: 477da5ee-3e03-4aa9-9a88-004c442e617a] Detaching volume 4954683e-297c-4bed-94c9-675adb40fb66
Nov 06 15:49:05 user nova-compute[75337]: INFO nova.virt.block_device [None req-8acd48fd-c495-4dd2-b61d-2a9f2256f8fb tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] [instance: 477da5ee-3e03-4aa9-9a88-004c442e617a] Attempting to driver detach volume 4954683e-297c-4bed-94c9-675adb40fb66 from mountpoint /dev/vdb
Nov 06 15:49:05 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-8acd48fd-c495-4dd2-b61d-2a9f2256f8fb tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Attempting to detach device vdb from instance 477da5ee-3e03-4aa9-9a88-004c442e617a from the persistent domain config. {{(pid=75337) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 06 15:49:05 user nova-compute[75337]: DEBUG nova.virt.libvirt.guest [None req-8acd48fd-c495-4dd2-b61d-2a9f2256f8fb tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 15:49:05 user nova-compute[75337]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 15:49:05 user nova-compute[75337]:   <source dev="/dev/sde"/>
Nov 06 15:49:05 user nova-compute[75337]:   <target dev="vdb" bus="virtio"/>
Nov 06 15:49:05 user nova-compute[75337]:   <serial>4954683e-297c-4bed-94c9-675adb40fb66</serial>
Nov 06 15:49:05 user nova-compute[75337]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 06 15:49:05 user nova-compute[75337]: </disk>
Nov 06 15:49:05 user nova-compute[75337]:  {{(pid=75337) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 15:49:05 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/477da5ee-3e03-4aa9-9a88-004c442e617a/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:05 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-8acd48fd-c495-4dd2-b61d-2a9f2256f8fb tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Successfully detached device vdb from instance 477da5ee-3e03-4aa9-9a88-004c442e617a from the persistent domain config.
Nov 06 15:49:05 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-8acd48fd-c495-4dd2-b61d-2a9f2256f8fb tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 477da5ee-3e03-4aa9-9a88-004c442e617a from the live domain config. {{(pid=75337) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 06 15:49:05 user nova-compute[75337]: DEBUG nova.virt.libvirt.guest [None req-8acd48fd-c495-4dd2-b61d-2a9f2256f8fb tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 15:49:05 user nova-compute[75337]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 15:49:05 user nova-compute[75337]:   <source dev="/dev/sde"/>
Nov 06 15:49:05 user nova-compute[75337]:   <target dev="vdb" bus="virtio"/>
Nov 06 15:49:05 user nova-compute[75337]:   <serial>4954683e-297c-4bed-94c9-675adb40fb66</serial>
Nov 06 15:49:05 user nova-compute[75337]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 06 15:49:05 user nova-compute[75337]: </disk>
Nov 06 15:49:05 user nova-compute[75337]:  {{(pid=75337) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 15:49:06 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/477da5ee-3e03-4aa9-9a88-004c442e617a/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:49:06 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/477da5ee-3e03-4aa9-9a88-004c442e617a/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:06 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c5fa35a-1ba5-4390-9102-83ac1dbb790a -p 172.16.0.220:3260 --login" returned: 0 in 1.090s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:49:06 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[780f77c8-dbd9-46cd-9a85-8265276286ef]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0c5fa35a-1ba5-4390-9102-83ac1dbb790a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0c5fa35a-1ba5-4390-9102-83ac1dbb790a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:49:06 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c05e62de-0cab-45f4-bdae-03cecf76da51 tempest-TestVolumeSwap-916912695 tempest-TestVolumeSwap-916912695-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0c5fa35a-1ba5-4390-9102-83ac1dbb790a, portal: 172.16.0.220,3260]
Nov 06 15:49:06 user nova-compute[75337]: Login to [iface: default, target: iqn.2010-10.org.openstack:0c5fa35a-1ba5-4390-9102-83ac1dbb790a, portal: 172.16.0.220,3260] successful.
Nov 06 15:49:06 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:49:06 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c5fa35a-1ba5-4390-9102-83ac1dbb790a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:06 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c5fa35a-1ba5-4390-9102-83ac1dbb790a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:49:06 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ff393ea-c03c-415e-b738-3ede5cb29704]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:49:06 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c05e62de-0cab-45f4-bdae-03cecf76da51 tempest-TestVolumeSwap-916912695 tempest-TestVolumeSwap-916912695-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:49:06 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:06 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:49:06 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[cca79ea9-f2f1-40fb-ac3f-f2dff24bc39a]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1421f55-d453-441d-bdf7-3743102662b6 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4954683e-297c-4bed-94c9-675adb40fb66 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06631b49-02a1-4759-8d9b-22b7ebdaa584 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c5fa35a-1ba5-4390-9102-83ac1dbb790a (non-flash)\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:49:06 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c05e62de-0cab-45f4-bdae-03cecf76da51 tempest-TestVolumeSwap-916912695 tempest-TestVolumeSwap-916912695-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)
Nov 06 15:49:06 user nova-compute[75337]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1421f55-d453-441d-bdf7-3743102662b6 (non-flash)
Nov 06 15:49:06 user nova-compute[75337]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6 (non-flash)
Nov 06 15:49:06 user nova-compute[75337]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4954683e-297c-4bed-94c9-675adb40fb66 (non-flash)
Nov 06 15:49:06 user nova-compute[75337]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06631b49-02a1-4759-8d9b-22b7ebdaa584 (non-flash)
Nov 06 15:49:06 user nova-compute[75337]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c5fa35a-1ba5-4390-9102-83ac1dbb790a (non-flash)
Nov 06 15:49:06 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 15:49:06 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c05e62de-0cab-45f4-bdae-03cecf76da51 tempest-TestVolumeSwap-916912695 tempest-TestVolumeSwap-916912695-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)
Nov 06 15:49:06 user nova-compute[75337]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1421f55-d453-441d-bdf7-3743102662b6 (non-flash)
Nov 06 15:49:06 user nova-compute[75337]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6 (non-flash)
Nov 06 15:49:06 user nova-compute[75337]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4954683e-297c-4bed-94c9-675adb40fb66 (non-flash)
Nov 06 15:49:06 user nova-compute[75337]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06631b49-02a1-4759-8d9b-22b7ebdaa584 (non-flash)
Nov 06 15:49:06 user nova-compute[75337]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c5fa35a-1ba5-4390-9102-83ac1dbb790a (non-flash)
Nov 06 15:49:06 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 15:49:06 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-c05e62de-0cab-45f4-bdae-03cecf76da51 tempest-TestVolumeSwap-916912695 tempest-TestVolumeSwap-916912695-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0c5fa35a-1ba5-4390-9102-83ac1dbb790a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.384s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 15:49:06 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c05e62de-0cab-45f4-bdae-03cecf76da51 tempest-TestVolumeSwap-916912695 tempest-TestVolumeSwap-916912695-project-admin] Connected to 172.16.0.220:3260 {{(pid=75337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 15:49:06 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-c05e62de-0cab-45f4-bdae-03cecf76da51 tempest-TestVolumeSwap-916912695 tempest-TestVolumeSwap-916912695-project-admin] HCTL ('38', '-', '-', 0) found on session 25 with lun 0 {{(pid=75337) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 15:49:06 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-c05e62de-0cab-45f4-bdae-03cecf76da51 tempest-TestVolumeSwap-916912695 tempest-TestVolumeSwap-916912695-project-admin] Scanning host 38 c: -, t: -, l: 0) {{(pid=75337) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 15:49:06 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:06 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.021s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:49:06 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[93125aa4-c9ca-43c7-9c3a-bb07b6f7b9d4]: (4, ('- - 0', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:49:06 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-c05e62de-0cab-45f4-bdae-03cecf76da51 tempest-TestVolumeSwap-916912695 tempest-TestVolumeSwap-916912695-project-admin] Searching for a device in session 25 and hctl ['38', '*', '*', 0] yield: None {{(pid=75337) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 15:49:06 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/477da5ee-3e03-4aa9-9a88-004c442e617a/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:49:06 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 15:49:06 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afa4e52b-af51-45bf-b619-aeca14e7724d/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:06 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-8acd48fd-c495-4dd2-b61d-2a9f2256f8fb tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 477da5ee-3e03-4aa9-9a88-004c442e617a {{(pid=75337) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 06 15:49:06 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afa4e52b-af51-45bf-b619-aeca14e7724d/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:49:06 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afa4e52b-af51-45bf-b619-aeca14e7724d/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:06 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:06 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:06 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afa4e52b-af51-45bf-b619-aeca14e7724d/disk --force-share --output=json" returned: 0 in 0.260s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:49:06 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89f0a6eb-b68c-4760-9446-b77e80ebaf99/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:06 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-13d17865-491a-490f-b016-5c740d02f100 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Acquiring lock "493eff79-294e-4259-a6d0-4772c4b45013" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:49:06 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-13d17865-491a-490f-b016-5c740d02f100 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Lock "493eff79-294e-4259-a6d0-4772c4b45013" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:49:06 user nova-compute[75337]: DEBUG nova.compute.manager [None req-13d17865-491a-490f-b016-5c740d02f100 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 493eff79-294e-4259-a6d0-4772c4b45013] Starting instance... {{(pid=75337) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 15:49:06 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89f0a6eb-b68c-4760-9446-b77e80ebaf99/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:49:06 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89f0a6eb-b68c-4760-9446-b77e80ebaf99/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:07 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89f0a6eb-b68c-4760-9446-b77e80ebaf99/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:49:07 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7ececa5-256f-4a5d-aeda-3d2ee5c01cfe/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:07 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-c05e62de-0cab-45f4-bdae-03cecf76da51 tempest-TestVolumeSwap-916912695 tempest-TestVolumeSwap-916912695-project-admin] Searching for a device in session 25 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75337) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 15:49:07 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c05e62de-0cab-45f4-bdae-03cecf76da51 tempest-TestVolumeSwap-916912695 tempest-TestVolumeSwap-916912695-project-admin] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:0c5fa35a-1ba5-4390-9102-83ac1dbb790a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nkapcTJV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 15:49:07 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-c05e62de-0cab-45f4-bdae-03cecf76da51 tempest-TestVolumeSwap-916912695 tempest-TestVolumeSwap-916912695-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.453s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 15:49:07 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c05e62de-0cab-45f4-bdae-03cecf76da51 tempest-TestVolumeSwap-916912695 tempest-TestVolumeSwap-916912695-project-admin] <== connect_volume: return (2454ms) {'type': 'block', 'scsi_wwn': '26134383266663230', 'path': '/dev/sdg'} {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 15:49:07 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c05e62de-0cab-45f4-bdae-03cecf76da51 tempest-TestVolumeSwap-916912695 tempest-TestVolumeSwap-916912695-project-admin] [instance: 9125364b-332f-4297-815f-3aa1eadaf743] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26134383266663230', 'path': '/dev/sdg'} {{(pid=75337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 15:49:07 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.430s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 15:49:07 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 15:49:07 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:563526a2-6204-4264-91b7-041e6cadab23" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 15:49:07 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:563526a2-6204-4264-91b7-041e6cadab23" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 15:49:07 user nova-compute[75337]: INFO os_brick.initiator.connectors.iscsi [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 15:49:07 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:563526a2-6204-4264-91b7-041e6cadab23 -p 172.16.0.220:3260 {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:07 user nova-compute[75337]: DEBUG nova.objects.instance [None req-c05e62de-0cab-45f4-bdae-03cecf76da51 tempest-TestVolumeSwap-916912695 tempest-TestVolumeSwap-916912695-project-admin] Lazy-loading 'flavor' on Instance uuid 9125364b-332f-4297-815f-3aa1eadaf743 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 15:49:07 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:563526a2-6204-4264-91b7-041e6cadab23 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:49:07 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[293bdaa7-7efe-4234-a945-b9f97a5ec232]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:49:07 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 15:49:07 user nova-compute[75337]:  {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:49:07 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:563526a2-6204-4264-91b7-041e6cadab23 -p 172.16.0.220:3260 --interface default --op new {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:07 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:563526a2-6204-4264-91b7-041e6cadab23 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:49:07 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[5386a65d-c11b-4ebf-9208-0dc800108662]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:563526a2-6204-4264-91b7-041e6cadab23] added\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:49:07 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:563526a2-6204-4264-91b7-041e6cadab23] added
Nov 06 15:49:07 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:49:07 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:563526a2-6204-4264-91b7-041e6cadab23 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:07 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:563526a2-6204-4264-91b7-041e6cadab23 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:49:07 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[b252ed97-59c9-4c3b-901a-02900f8ec895]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:49:07 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:49:07 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:563526a2-6204-4264-91b7-041e6cadab23 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:07 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:563526a2-6204-4264-91b7-041e6cadab23 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:49:07 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[17a9b585-90f6-47fa-a827-38c2acb98fe6]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:49:07 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:49:07 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:563526a2-6204-4264-91b7-041e6cadab23 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RnmGPoqS {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:07 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:563526a2-6204-4264-91b7-041e6cadab23 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RnmGPoqS" returned: 0 in 0.023s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:49:07 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3e41711-c114-4755-8ff6-68a79dd94de4]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:49:07 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RnmGPoqS'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:49:07 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:563526a2-6204-4264-91b7-041e6cadab23 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:07 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7ececa5-256f-4a5d-aeda-3d2ee5c01cfe/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:49:07 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7ececa5-256f-4a5d-aeda-3d2ee5c01cfe/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:07 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:563526a2-6204-4264-91b7-041e6cadab23 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:49:07 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebe6204c-ec6c-455f-99f9-7f512e703ead]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:49:07 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-13d17865-491a-490f-b016-5c740d02f100 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:49:07 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-13d17865-491a-490f-b016-5c740d02f100 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:49:07 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:49:07 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:07 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-13d17865-491a-490f-b016-5c740d02f100 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75337) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 15:49:07 user nova-compute[75337]: INFO nova.compute.claims [None req-13d17865-491a-490f-b016-5c740d02f100 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 493eff79-294e-4259-a6d0-4772c4b45013] Claim successful on node user
Nov 06 15:49:07 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:49:07 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[2833232c-1ad3-43fa-94f2-1285759cbbd4]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1421f55-d453-441d-bdf7-3743102662b6 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4954683e-297c-4bed-94c9-675adb40fb66 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06631b49-02a1-4759-8d9b-22b7ebdaa584 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c5fa35a-1ba5-4390-9102-83ac1dbb790a (non-flash)\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:49:07 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)
Nov 06 15:49:07 user nova-compute[75337]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1421f55-d453-441d-bdf7-3743102662b6 (non-flash)
Nov 06 15:49:07 user nova-compute[75337]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6 (non-flash)
Nov 06 15:49:07 user nova-compute[75337]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4954683e-297c-4bed-94c9-675adb40fb66 (non-flash)
Nov 06 15:49:07 user nova-compute[75337]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06631b49-02a1-4759-8d9b-22b7ebdaa584 (non-flash)
Nov 06 15:49:07 user nova-compute[75337]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c5fa35a-1ba5-4390-9102-83ac1dbb790a (non-flash)
Nov 06 15:49:07 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 15:49:07 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)
Nov 06 15:49:07 user nova-compute[75337]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1421f55-d453-441d-bdf7-3743102662b6 (non-flash)
Nov 06 15:49:07 user nova-compute[75337]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6 (non-flash)
Nov 06 15:49:07 user nova-compute[75337]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4954683e-297c-4bed-94c9-675adb40fb66 (non-flash)
Nov 06 15:49:07 user nova-compute[75337]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06631b49-02a1-4759-8d9b-22b7ebdaa584 (non-flash)
Nov 06 15:49:07 user nova-compute[75337]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c5fa35a-1ba5-4390-9102-83ac1dbb790a (non-flash)
Nov 06 15:49:07 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 15:49:07 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:563526a2-6204-4264-91b7-041e6cadab23 -p 172.16.0.220:3260 --login {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:07 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7ececa5-256f-4a5d-aeda-3d2ee5c01cfe/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:49:07 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:563526a2-6204-4264-91b7-041e6cadab23 -p 172.16.0.220:3260 --login" returned: 0 in 0.101s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:49:07 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[6af0ca15-b43e-4bae-950e-3b979e61284a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:563526a2-6204-4264-91b7-041e6cadab23, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:563526a2-6204-4264-91b7-041e6cadab23, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:49:07 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:563526a2-6204-4264-91b7-041e6cadab23, portal: 172.16.0.220,3260]
Nov 06 15:49:07 user nova-compute[75337]: Login to [iface: default, target: iqn.2010-10.org.openstack:563526a2-6204-4264-91b7-041e6cadab23, portal: 172.16.0.220,3260] successful.
Nov 06 15:49:07 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:49:07 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 15:49:07 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:563526a2-6204-4264-91b7-041e6cadab23 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:07 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc0e07f8-2731-4ffa-8446-b71ad3ba7375/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:07 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:563526a2-6204-4264-91b7-041e6cadab23 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:49:07 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8416da1-e998-45d8-92fa-5da68b0938b6]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:49:07 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:49:07 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:07 user nova-compute[75337]: DEBUG nova.virt.libvirt.guest [None req-c05e62de-0cab-45f4-bdae-03cecf76da51 tempest-TestVolumeSwap-916912695 tempest-TestVolumeSwap-916912695-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=75337) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 06 15:49:07 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-13d17865-491a-490f-b016-5c740d02f100 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Refreshing inventories for resource provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 06 15:49:07 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.051s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:49:07 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[09c722b9-5eca-4ccd-a445-0bbe5df81a62]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1421f55-d453-441d-bdf7-3743102662b6 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4954683e-297c-4bed-94c9-675adb40fb66 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06631b49-02a1-4759-8d9b-22b7ebdaa584 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c5fa35a-1ba5-4390-9102-83ac1dbb790a (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:563526a2-6204-4264-91b7-041e6cadab23 (non-flash)\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:49:07 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)
Nov 06 15:49:07 user nova-compute[75337]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1421f55-d453-441d-bdf7-3743102662b6 (non-flash)
Nov 06 15:49:07 user nova-compute[75337]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6 (non-flash)
Nov 06 15:49:07 user nova-compute[75337]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4954683e-297c-4bed-94c9-675adb40fb66 (non-flash)
Nov 06 15:49:07 user nova-compute[75337]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06631b49-02a1-4759-8d9b-22b7ebdaa584 (non-flash)
Nov 06 15:49:07 user nova-compute[75337]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c5fa35a-1ba5-4390-9102-83ac1dbb790a (non-flash)
Nov 06 15:49:07 user nova-compute[75337]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:563526a2-6204-4264-91b7-041e6cadab23 (non-flash)
Nov 06 15:49:07 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 15:49:07 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)
Nov 06 15:49:07 user nova-compute[75337]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1421f55-d453-441d-bdf7-3743102662b6 (non-flash)
Nov 06 15:49:07 user nova-compute[75337]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6 (non-flash)
Nov 06 15:49:07 user nova-compute[75337]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4954683e-297c-4bed-94c9-675adb40fb66 (non-flash)
Nov 06 15:49:07 user nova-compute[75337]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06631b49-02a1-4759-8d9b-22b7ebdaa584 (non-flash)
Nov 06 15:49:07 user nova-compute[75337]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c5fa35a-1ba5-4390-9102-83ac1dbb790a (non-flash)
Nov 06 15:49:07 user nova-compute[75337]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:563526a2-6204-4264-91b7-041e6cadab23 (non-flash)
Nov 06 15:49:07 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 15:49:07 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:563526a2-6204-4264-91b7-041e6cadab23" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.540s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 15:49:07 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Connected to 172.16.0.220:3260 {{(pid=75337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 15:49:07 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] HCTL ('39', '-', '-', 0) found on session 26 with lun 0 {{(pid=75337) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 15:49:07 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=75337) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 15:49:07 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:07 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.031s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:49:07 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[732f924a-a2e7-4edf-8394-84cd9e55ddf4]: (4, ('- - 0', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:49:07 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Searching for a device in session 26 and hctl ['39', '*', '*', 0] yield: None {{(pid=75337) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 15:49:07 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-13d17865-491a-490f-b016-5c740d02f100 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Updating ProviderTree inventory for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 06 15:49:07 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-13d17865-491a-490f-b016-5c740d02f100 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Updating inventory in ProviderTree for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 06 15:49:07 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-13d17865-491a-490f-b016-5c740d02f100 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Refreshing aggregate associations for resource provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7, aggregates: None {{(pid=75337) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 06 15:49:07 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-13d17865-491a-490f-b016-5c740d02f100 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Refreshing trait associations for resource provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7, traits: COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NODE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_IDE,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSSE3,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_USB {{(pid=75337) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 06 15:49:07 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc0e07f8-2731-4ffa-8446-b71ad3ba7375/disk --force-share --output=json" returned: 0 in 0.317s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:49:07 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc0e07f8-2731-4ffa-8446-b71ad3ba7375/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:08 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc0e07f8-2731-4ffa-8446-b71ad3ba7375/disk --force-share --output=json" returned: 0 in 0.296s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:49:08 user nova-compute[75337]: DEBUG nova.virt.libvirt.guest [None req-c05e62de-0cab-45f4-bdae-03cecf76da51 tempest-TestVolumeSwap-916912695 tempest-TestVolumeSwap-916912695-project-admin] COPY block job progress, current cursor: 115343360 final cursor: 1073741824 {{(pid=75337) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 06 15:49:08 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9125364b-332f-4297-815f-3aa1eadaf743/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:08 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9125364b-332f-4297-815f-3aa1eadaf743/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:49:08 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9125364b-332f-4297-815f-3aa1eadaf743/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:08 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9076803f-e56e-41e3-b886-3eb2eb98408e tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] [instance: bc0e07f8-2731-4ffa-8446-b71ad3ba7375] Calling os-brick to attach iSCSI Volume {{(pid=75337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 15:49:08 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-9076803f-e56e-41e3-b886-3eb2eb98408e tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2abc33d0c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:dc5eae50-0461-47ca-bc48-cb38087b06e0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oFQjZJSv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 15:49:08 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-9076803f-e56e-41e3-b886-3eb2eb98408e tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 15:49:08 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-9076803f-e56e-41e3-b886-3eb2eb98408e tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 15:49:08 user nova-compute[75337]: DEBUG nova.virt.libvirt.guest [None req-c05e62de-0cab-45f4-bdae-03cecf76da51 tempest-TestVolumeSwap-916912695 tempest-TestVolumeSwap-916912695-project-admin] COPY block job progress, current cursor: 166723584 final cursor: 1073741824 {{(pid=75337) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 06 15:49:08 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Searching for a device in session 26 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=75337) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 15:49:08 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:563526a2-6204-4264-91b7-041e6cadab23', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RnmGPoqS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 15:49:08 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.591s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 15:49:08 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] <== connect_volume: return (4022ms) {'type': 'block', 'scsi_wwn': '23232363032383938', 'path': '/dev/sdh'} {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 15:49:08 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23232363032383938', 'path': '/dev/sdh'} {{(pid=75337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 15:49:08 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-9076803f-e56e-41e3-b886-3eb2eb98408e tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.080s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 15:49:08 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-9076803f-e56e-41e3-b886-3eb2eb98408e tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 15:49:08 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-9076803f-e56e-41e3-b886-3eb2eb98408e tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dc5eae50-0461-47ca-bc48-cb38087b06e0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 15:49:08 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-9076803f-e56e-41e3-b886-3eb2eb98408e tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dc5eae50-0461-47ca-bc48-cb38087b06e0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.004s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 15:49:08 user nova-compute[75337]: INFO os_brick.initiator.connectors.iscsi [None req-9076803f-e56e-41e3-b886-3eb2eb98408e tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 15:49:08 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc5eae50-0461-47ca-bc48-cb38087b06e0 -p 172.16.0.220:3260 {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:08 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9125364b-332f-4297-815f-3aa1eadaf743/disk --force-share --output=json" returned: 0 in 0.274s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:49:08 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 15:49:08 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdced0ba-84ff-42af-baab-e2f3412e1676/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:08 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc5eae50-0461-47ca-bc48-cb38087b06e0 -p 172.16.0.220:3260" returned: 21 in 0.030s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:49:08 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea80d4b2-763a-4550-9da3-f6d9657c0c4d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:49:08 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-9076803f-e56e-41e3-b886-3eb2eb98408e tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 15:49:08 user nova-compute[75337]:  {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:49:08 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc5eae50-0461-47ca-bc48-cb38087b06e0 -p 172.16.0.220:3260 --interface default --op new {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:08 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-13d17865-491a-490f-b016-5c740d02f100 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 15:49:08 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc5eae50-0461-47ca-bc48-cb38087b06e0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:49:08 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b30b0c8-1164-4ccb-8cce-af9610fe061a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dc5eae50-0461-47ca-bc48-cb38087b06e0] added\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:49:08 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-9076803f-e56e-41e3-b886-3eb2eb98408e tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dc5eae50-0461-47ca-bc48-cb38087b06e0] added
Nov 06 15:49:08 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:49:08 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-13d17865-491a-490f-b016-5c740d02f100 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 15:49:08 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc5eae50-0461-47ca-bc48-cb38087b06e0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:08 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc5eae50-0461-47ca-bc48-cb38087b06e0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:49:08 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[498f1f58-4029-4580-aa7b-e2bee1e92eae]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:49:08 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-9076803f-e56e-41e3-b886-3eb2eb98408e tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:49:08 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Calling os-brick to attach iSCSI Volume {{(pid=75337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 15:49:08 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2abc33d0c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1bebbb46-2250-4511-ba59-f4ce67e0b45d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VGdgTYBv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 15:49:08 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 15:49:08 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 15:49:08 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc5eae50-0461-47ca-bc48-cb38087b06e0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:09 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-13d17865-491a-490f-b016-5c740d02f100 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.517s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:49:09 user nova-compute[75337]: DEBUG nova.compute.manager [None req-13d17865-491a-490f-b016-5c740d02f100 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 493eff79-294e-4259-a6d0-4772c4b45013] Start building networks asynchronously for instance. {{(pid=75337) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 15:49:09 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc5eae50-0461-47ca-bc48-cb38087b06e0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:49:09 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[3766fcbc-974a-4477-ad6d-3c218dd564d7]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:49:09 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-9076803f-e56e-41e3-b886-3eb2eb98408e tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:49:09 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc5eae50-0461-47ca-bc48-cb38087b06e0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oFQjZJSv {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:09 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:09 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc5eae50-0461-47ca-bc48-cb38087b06e0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oFQjZJSv" returned: 0 in 0.028s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:49:09 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5aae23d-c48e-4f8c-b34f-b0b59784ff9a]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:49:09 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-9076803f-e56e-41e3-b886-3eb2eb98408e tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oFQjZJSv'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:49:09 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc5eae50-0461-47ca-bc48-cb38087b06e0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:09 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc5eae50-0461-47ca-bc48-cb38087b06e0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.030s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:49:09 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[796d1b77-0cfa-4e90-8289-0efa9c1e9d6d]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:49:09 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-9076803f-e56e-41e3-b886-3eb2eb98408e tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:49:09 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:09 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdced0ba-84ff-42af-baab-e2f3412e1676/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:49:09 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdced0ba-84ff-42af-baab-e2f3412e1676/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:09 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.047s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:49:09 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b769ed6-5809-4a76-a53a-d609af8ad1d9]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1421f55-d453-441d-bdf7-3743102662b6 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4954683e-297c-4bed-94c9-675adb40fb66 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06631b49-02a1-4759-8d9b-22b7ebdaa584 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c5fa35a-1ba5-4390-9102-83ac1dbb790a (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:563526a2-6204-4264-91b7-041e6cadab23 (non-flash)\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:49:09 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-9076803f-e56e-41e3-b886-3eb2eb98408e tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)
Nov 06 15:49:09 user nova-compute[75337]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1421f55-d453-441d-bdf7-3743102662b6 (non-flash)
Nov 06 15:49:09 user nova-compute[75337]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6 (non-flash)
Nov 06 15:49:09 user nova-compute[75337]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4954683e-297c-4bed-94c9-675adb40fb66 (non-flash)
Nov 06 15:49:09 user nova-compute[75337]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06631b49-02a1-4759-8d9b-22b7ebdaa584 (non-flash)
Nov 06 15:49:09 user nova-compute[75337]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c5fa35a-1ba5-4390-9102-83ac1dbb790a (non-flash)
Nov 06 15:49:09 user nova-compute[75337]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:563526a2-6204-4264-91b7-041e6cadab23 (non-flash)
Nov 06 15:49:09 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 15:49:09 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-9076803f-e56e-41e3-b886-3eb2eb98408e tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)
Nov 06 15:49:09 user nova-compute[75337]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1421f55-d453-441d-bdf7-3743102662b6 (non-flash)
Nov 06 15:49:09 user nova-compute[75337]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6 (non-flash)
Nov 06 15:49:09 user nova-compute[75337]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4954683e-297c-4bed-94c9-675adb40fb66 (non-flash)
Nov 06 15:49:09 user nova-compute[75337]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06631b49-02a1-4759-8d9b-22b7ebdaa584 (non-flash)
Nov 06 15:49:09 user nova-compute[75337]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c5fa35a-1ba5-4390-9102-83ac1dbb790a (non-flash)
Nov 06 15:49:09 user nova-compute[75337]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:563526a2-6204-4264-91b7-041e6cadab23 (non-flash)
Nov 06 15:49:09 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 15:49:09 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc5eae50-0461-47ca-bc48-cb38087b06e0 -p 172.16.0.220:3260 --login {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:09 user nova-compute[75337]: DEBUG nova.compute.manager [None req-13d17865-491a-490f-b016-5c740d02f100 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 493eff79-294e-4259-a6d0-4772c4b45013] Allocating IP information in the background. {{(pid=75337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 15:49:09 user nova-compute[75337]: DEBUG nova.network.neutron [None req-13d17865-491a-490f-b016-5c740d02f100 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 493eff79-294e-4259-a6d0-4772c4b45013] allocate_for_instance() {{(pid=75337) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 15:49:09 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-13d17865-491a-490f-b016-5c740d02f100 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 493eff79-294e-4259-a6d0-4772c4b45013] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 15:49:09 user nova-compute[75337]: DEBUG nova.compute.manager [None req-13d17865-491a-490f-b016-5c740d02f100 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 493eff79-294e-4259-a6d0-4772c4b45013] Start building block device mappings for instance. {{(pid=75337) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 15:49:09 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc5eae50-0461-47ca-bc48-cb38087b06e0 -p 172.16.0.220:3260 --login" returned: 0 in 0.098s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:49:09 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[9228bb51-1479-4ef6-b8f0-e446d0bf2ba3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:dc5eae50-0461-47ca-bc48-cb38087b06e0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:dc5eae50-0461-47ca-bc48-cb38087b06e0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:49:09 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-9076803f-e56e-41e3-b886-3eb2eb98408e tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:dc5eae50-0461-47ca-bc48-cb38087b06e0, portal: 172.16.0.220,3260]
Nov 06 15:49:09 user nova-compute[75337]: Login to [iface: default, target: iqn.2010-10.org.openstack:dc5eae50-0461-47ca-bc48-cb38087b06e0, portal: 172.16.0.220,3260] successful.
Nov 06 15:49:09 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:49:09 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc5eae50-0461-47ca-bc48-cb38087b06e0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:09 user nova-compute[75337]: DEBUG nova.virt.libvirt.guest [None req-c05e62de-0cab-45f4-bdae-03cecf76da51 tempest-TestVolumeSwap-916912695 tempest-TestVolumeSwap-916912695-project-admin] COPY block job progress, current cursor: 290455552 final cursor: 1073741824 {{(pid=75337) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 06 15:49:09 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc5eae50-0461-47ca-bc48-cb38087b06e0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.037s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:49:09 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[14cb3c60-7584-4393-be56-a9b805367360]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:49:09 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-9076803f-e56e-41e3-b886-3eb2eb98408e tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:49:09 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:09 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdced0ba-84ff-42af-baab-e2f3412e1676/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:49:09 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83516ff5-c4e7-4e91-a2f9-8af9b51cf475/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:09 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.050s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:49:09 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[c026d8b3-dac8-42db-bfb5-7e41b17bc21b]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1421f55-d453-441d-bdf7-3743102662b6 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4954683e-297c-4bed-94c9-675adb40fb66 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06631b49-02a1-4759-8d9b-22b7ebdaa584 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c5fa35a-1ba5-4390-9102-83ac1dbb790a (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:563526a2-6204-4264-91b7-041e6cadab23 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc5eae50-0461-47ca-bc48-cb38087b06e0 (non-flash)\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:49:09 user nova-compute[75337]: DEBUG nova.policy [None req-13d17865-491a-490f-b016-5c740d02f100 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bb8d5f0200124588be1cfde107341a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915211c6a2734c36b34ff92a56b085f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75337) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 15:49:09 user nova-compute[75337]: INFO nova.virt.block_device [None req-13d17865-491a-490f-b016-5c740d02f100 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 493eff79-294e-4259-a6d0-4772c4b45013] Booting with volume 2086a611-973d-47a1-bb69-f2ebd144be03 at /dev/vda
Nov 06 15:49:09 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-9076803f-e56e-41e3-b886-3eb2eb98408e tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)
Nov 06 15:49:09 user nova-compute[75337]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1421f55-d453-441d-bdf7-3743102662b6 (non-flash)
Nov 06 15:49:09 user nova-compute[75337]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6 (non-flash)
Nov 06 15:49:09 user nova-compute[75337]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4954683e-297c-4bed-94c9-675adb40fb66 (non-flash)
Nov 06 15:49:09 user nova-compute[75337]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06631b49-02a1-4759-8d9b-22b7ebdaa584 (non-flash)
Nov 06 15:49:09 user nova-compute[75337]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c5fa35a-1ba5-4390-9102-83ac1dbb790a (non-flash)
Nov 06 15:49:09 user nova-compute[75337]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:563526a2-6204-4264-91b7-041e6cadab23 (non-flash)
Nov 06 15:49:09 user nova-compute[75337]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc5eae50-0461-47ca-bc48-cb38087b06e0 (non-flash)
Nov 06 15:49:09 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 15:49:09 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-9076803f-e56e-41e3-b886-3eb2eb98408e tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)
Nov 06 15:49:09 user nova-compute[75337]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1421f55-d453-441d-bdf7-3743102662b6 (non-flash)
Nov 06 15:49:09 user nova-compute[75337]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6 (non-flash)
Nov 06 15:49:09 user nova-compute[75337]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4954683e-297c-4bed-94c9-675adb40fb66 (non-flash)
Nov 06 15:49:09 user nova-compute[75337]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06631b49-02a1-4759-8d9b-22b7ebdaa584 (non-flash)
Nov 06 15:49:09 user nova-compute[75337]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c5fa35a-1ba5-4390-9102-83ac1dbb790a (non-flash)
Nov 06 15:49:09 user nova-compute[75337]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:563526a2-6204-4264-91b7-041e6cadab23 (non-flash)
Nov 06 15:49:09 user nova-compute[75337]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc5eae50-0461-47ca-bc48-cb38087b06e0 (non-flash)
Nov 06 15:49:09 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 15:49:09 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-9076803f-e56e-41e3-b886-3eb2eb98408e tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dc5eae50-0461-47ca-bc48-cb38087b06e0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.611s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 15:49:09 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-9076803f-e56e-41e3-b886-3eb2eb98408e tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Connected to 172.16.0.220:3260 {{(pid=75337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 15:49:09 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-9076803f-e56e-41e3-b886-3eb2eb98408e tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] HCTL ('40', '-', '-', 0) found on session 27 with lun 0 {{(pid=75337) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 15:49:09 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-9076803f-e56e-41e3-b886-3eb2eb98408e tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=75337) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 15:49:09 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:09 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.034s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:49:09 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4a133d6-ccb7-43fa-b7a0-4367608337f4]: (4, ('- - 0', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:49:09 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-9076803f-e56e-41e3-b886-3eb2eb98408e tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Searching for a device in session 27 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=75337) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 15:49:09 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-9076803f-e56e-41e3-b886-3eb2eb98408e tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:dc5eae50-0461-47ca-bc48-cb38087b06e0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oFQjZJSv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 15:49:09 user nova-compute[75337]: DEBUG os_brick.utils [None req-13d17865-491a-490f-b016-5c740d02f100 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 15:49:09 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:09 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.022s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:49:09 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e4374f1-3fdb-41f3-b8b5-b4b8420d7ae6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4ff6411e45b8\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:49:09 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83516ff5-c4e7-4e91-a2f9-8af9b51cf475/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:49:09 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83516ff5-c4e7-4e91-a2f9-8af9b51cf475/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:09 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:09 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.024s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:49:09 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae25c414-6c5f-430b-8629-b6a496b07e08]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:49:09 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:09 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:49:09 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[290ac191-17ad-41ed-8cdf-5a15812d9d8d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:49:09 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7cce304-ae6d-4476-a4d5-ce4d7e578cd8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:49:09 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-13d17865-491a-490f-b016-5c740d02f100 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Running cmd (subprocess): nvme version {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:09 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-13d17865-491a-490f-b016-5c740d02f100 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] 'nvme version' failed. Not Retrying. {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 15:49:09 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.nvmeof [None req-13d17865-491a-490f-b016-5c740d02f100 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] nvme not present on system {{(pid=75337) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 15:49:09 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:09 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 15:49:09 user nova-compute[75337]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 15:49:09 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c8f4216-4859-4213-9fac-0e4e0f031e17]: (4, '') {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:49:09 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.lightos [None req-13d17865-491a-490f-b016-5c740d02f100 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75337) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 15:49:09 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.lightos [None req-13d17865-491a-490f-b016-5c740d02f100 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 15:49:09 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.lightos [None req-13d17865-491a-490f-b016-5c740d02f100 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] LIGHTOS: no hostnqn found. {{(pid=75337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 15:49:09 user nova-compute[75337]: DEBUG os_brick.utils [None req-13d17865-491a-490f-b016-5c740d02f100 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] <== get_connector_properties: return (227ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4ff6411e45b8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 15:49:09 user nova-compute[75337]: DEBUG nova.virt.block_device [None req-13d17865-491a-490f-b016-5c740d02f100 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 493eff79-294e-4259-a6d0-4772c4b45013] Updating existing volume attachment record: 0ca73f20-7cbe-4e26-8fb1-5d6142fe793f {{(pid=75337) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 15:49:09 user nova-compute[75337]: DEBUG nova.virt.libvirt.guest [None req-c05e62de-0cab-45f4-bdae-03cecf76da51 tempest-TestVolumeSwap-916912695 tempest-TestVolumeSwap-916912695-project-admin] COPY block job progress, current cursor: 442499072 final cursor: 1073741824 {{(pid=75337) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 06 15:49:09 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83516ff5-c4e7-4e91-a2f9-8af9b51cf475/disk --force-share --output=json" returned: 0 in 0.290s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:49:09 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 15:49:10 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-9076803f-e56e-41e3-b886-3eb2eb98408e tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.999s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 15:49:10 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-9076803f-e56e-41e3-b886-3eb2eb98408e tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] <== connect_volume: return (2079ms) {'type': 'block', 'scsi_wwn': '23366393165353739', 'path': '/dev/sdi'} {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 15:49:10 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9076803f-e56e-41e3-b886-3eb2eb98408e tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] [instance: bc0e07f8-2731-4ffa-8446-b71ad3ba7375] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23366393165353739', 'path': '/dev/sdi'} {{(pid=75337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 15:49:10 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.861s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 15:49:10 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 15:49:10 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1bebbb46-2250-4511-ba59-f4ce67e0b45d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 15:49:10 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1bebbb46-2250-4511-ba59-f4ce67e0b45d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 15:49:10 user nova-compute[75337]: INFO os_brick.initiator.connectors.iscsi [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 15:49:10 user nova-compute[75337]: DEBUG nova.virt.libvirt.guest [None req-c05e62de-0cab-45f4-bdae-03cecf76da51 tempest-TestVolumeSwap-916912695 tempest-TestVolumeSwap-916912695-project-admin] COPY block job progress, current cursor: 731906048 final cursor: 1073741824 {{(pid=75337) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 06 15:49:10 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bebbb46-2250-4511-ba59-f4ce67e0b45d -p 172.16.0.220:3260 {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:10 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 15:49:10 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 15:49:10 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Hypervisor/Node resource view: name=user free_ram=7507MB free_disk=25.117420196533203GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75337) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 15:49:10 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:49:10 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:49:10 user nova-compute[75337]: DEBUG nova.objects.instance [None req-9076803f-e56e-41e3-b886-3eb2eb98408e tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Lazy-loading 'flavor' on Instance uuid bc0e07f8-2731-4ffa-8446-b71ad3ba7375 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 15:49:10 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bebbb46-2250-4511-ba59-f4ce67e0b45d -p 172.16.0.220:3260" returned: 21 in 0.029s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:49:10 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e66fbdf-81b8-432d-8d19-7dd69ea33536]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:49:10 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 15:49:10 user nova-compute[75337]:  {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:49:10 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bebbb46-2250-4511-ba59-f4ce67e0b45d -p 172.16.0.220:3260 --interface default --op new {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:10 user nova-compute[75337]: DEBUG nova.virt.libvirt.guest [None req-9076803f-e56e-41e3-b886-3eb2eb98408e tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] attach device xml: <disk type="block" device="disk">
Nov 06 15:49:10 user nova-compute[75337]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 15:49:10 user nova-compute[75337]:   <source dev="/dev/sdi"/>
Nov 06 15:49:10 user nova-compute[75337]:   <target dev="vdb" bus="virtio"/>
Nov 06 15:49:10 user nova-compute[75337]:   <serial>dc5eae50-0461-47ca-bc48-cb38087b06e0</serial>
Nov 06 15:49:10 user nova-compute[75337]: </disk>
Nov 06 15:49:10 user nova-compute[75337]:  {{(pid=75337) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 06 15:49:10 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bebbb46-2250-4511-ba59-f4ce67e0b45d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.039s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:49:10 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3ce7c5a-d240-4fa6-bfe9-2cece2e9fe13]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1bebbb46-2250-4511-ba59-f4ce67e0b45d] added\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:49:10 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1bebbb46-2250-4511-ba59-f4ce67e0b45d] added
Nov 06 15:49:10 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:49:10 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bebbb46-2250-4511-ba59-f4ce67e0b45d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:10 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bebbb46-2250-4511-ba59-f4ce67e0b45d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.033s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:49:10 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[e68bdb63-2b01-4b33-97b8-f2e5d90435da]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:49:10 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:49:11 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bebbb46-2250-4511-ba59-f4ce67e0b45d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:11 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bebbb46-2250-4511-ba59-f4ce67e0b45d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.039s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:49:11 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfc217f6-8597-4391-9f13-ee1e3003aed4]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:49:11 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:49:11 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bebbb46-2250-4511-ba59-f4ce67e0b45d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VGdgTYBv {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:11 user nova-compute[75337]: DEBUG nova.network.neutron [None req-13d17865-491a-490f-b016-5c740d02f100 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 493eff79-294e-4259-a6d0-4772c4b45013] Successfully created port: 5e620284-83c1-40a8-91a5-c6b2c8c87a19 {{(pid=75337) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 15:49:11 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bebbb46-2250-4511-ba59-f4ce67e0b45d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VGdgTYBv" returned: 0 in 0.049s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:49:11 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd6b2e75-ea96-41fb-a263-32c8a6d3f102]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:49:11 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VGdgTYBv'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:49:11 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bebbb46-2250-4511-ba59-f4ce67e0b45d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:11 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bebbb46-2250-4511-ba59-f4ce67e0b45d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:49:11 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[89a03dc6-8dd1-4c43-a31c-664e55cf5d7f]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:49:11 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:49:11 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:11 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 83516ff5-c4e7-4e91-a2f9-8af9b51cf475 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:49:11 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 1fa4c927-7485-4f34-94bd-9e20358904b6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:49:11 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance cdced0ba-84ff-42af-baab-e2f3412e1676 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:49:11 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 7a6b16de-4506-432f-97f9-f083243dc047 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:49:11 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 9125364b-332f-4297-815f-3aa1eadaf743 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:49:11 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 477da5ee-3e03-4aa9-9a88-004c442e617a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:49:11 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance bc0e07f8-2731-4ffa-8446-b71ad3ba7375 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:49:11 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance afa4e52b-af51-45bf-b619-aeca14e7724d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:49:11 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance b7ececa5-256f-4a5d-aeda-3d2ee5c01cfe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:49:11 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance fdda34b5-280f-489d-baf5-bf21ac6dd6c9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:49:11 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 89f0a6eb-b68c-4760-9446-b77e80ebaf99 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:49:11 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 493eff79-294e-4259-a6d0-4772c4b45013 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:49:11 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 15:49:11 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 15:49:11 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.064s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:49:11 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[f84cfea3-97a9-4192-a4ca-557da2799e63]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1421f55-d453-441d-bdf7-3743102662b6 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4954683e-297c-4bed-94c9-675adb40fb66 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06631b49-02a1-4759-8d9b-22b7ebdaa584 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c5fa35a-1ba5-4390-9102-83ac1dbb790a (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:563526a2-6204-4264-91b7-041e6cadab23 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc5eae50-0461-47ca-bc48-cb38087b06e0 (non-flash)\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:49:11 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)
Nov 06 15:49:11 user nova-compute[75337]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1421f55-d453-441d-bdf7-3743102662b6 (non-flash)
Nov 06 15:49:11 user nova-compute[75337]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6 (non-flash)
Nov 06 15:49:11 user nova-compute[75337]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4954683e-297c-4bed-94c9-675adb40fb66 (non-flash)
Nov 06 15:49:11 user nova-compute[75337]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06631b49-02a1-4759-8d9b-22b7ebdaa584 (non-flash)
Nov 06 15:49:11 user nova-compute[75337]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c5fa35a-1ba5-4390-9102-83ac1dbb790a (non-flash)
Nov 06 15:49:11 user nova-compute[75337]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:563526a2-6204-4264-91b7-041e6cadab23 (non-flash)
Nov 06 15:49:11 user nova-compute[75337]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc5eae50-0461-47ca-bc48-cb38087b06e0 (non-flash)
Nov 06 15:49:11 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 15:49:11 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)
Nov 06 15:49:11 user nova-compute[75337]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1421f55-d453-441d-bdf7-3743102662b6 (non-flash)
Nov 06 15:49:11 user nova-compute[75337]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6 (non-flash)
Nov 06 15:49:11 user nova-compute[75337]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4954683e-297c-4bed-94c9-675adb40fb66 (non-flash)
Nov 06 15:49:11 user nova-compute[75337]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06631b49-02a1-4759-8d9b-22b7ebdaa584 (non-flash)
Nov 06 15:49:11 user nova-compute[75337]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c5fa35a-1ba5-4390-9102-83ac1dbb790a (non-flash)
Nov 06 15:49:11 user nova-compute[75337]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:563526a2-6204-4264-91b7-041e6cadab23 (non-flash)
Nov 06 15:49:11 user nova-compute[75337]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc5eae50-0461-47ca-bc48-cb38087b06e0 (non-flash)
Nov 06 15:49:11 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 15:49:11 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bebbb46-2250-4511-ba59-f4ce67e0b45d -p 172.16.0.220:3260 --login {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:11 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bebbb46-2250-4511-ba59-f4ce67e0b45d -p 172.16.0.220:3260 --login" returned: 0 in 0.137s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:49:11 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0380971-fcbc-4cd7-bb00-0c985a9d6ee9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1bebbb46-2250-4511-ba59-f4ce67e0b45d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1bebbb46-2250-4511-ba59-f4ce67e0b45d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:49:11 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1bebbb46-2250-4511-ba59-f4ce67e0b45d, portal: 172.16.0.220,3260]
Nov 06 15:49:11 user nova-compute[75337]: Login to [iface: default, target: iqn.2010-10.org.openstack:1bebbb46-2250-4511-ba59-f4ce67e0b45d, portal: 172.16.0.220,3260] successful.
Nov 06 15:49:11 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:49:11 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bebbb46-2250-4511-ba59-f4ce67e0b45d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:11 user nova-compute[75337]: DEBUG nova.virt.libvirt.guest [None req-c05e62de-0cab-45f4-bdae-03cecf76da51 tempest-TestVolumeSwap-916912695 tempest-TestVolumeSwap-916912695-project-admin] COPY block job progress, current cursor: 867172352 final cursor: 1073741824 {{(pid=75337) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 06 15:49:11 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bebbb46-2250-4511-ba59-f4ce67e0b45d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.045s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:49:11 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[5624ff96-e518-454a-bead-158e1584f3aa]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:49:11 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:49:11 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:11 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.058s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:49:11 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[32d2e7d6-9de8-47d5-9903-0ae307cf5c5d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1421f55-d453-441d-bdf7-3743102662b6 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4954683e-297c-4bed-94c9-675adb40fb66 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06631b49-02a1-4759-8d9b-22b7ebdaa584 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c5fa35a-1ba5-4390-9102-83ac1dbb790a (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:563526a2-6204-4264-91b7-041e6cadab23 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc5eae50-0461-47ca-bc48-cb38087b06e0 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bebbb46-2250-4511-ba59-f4ce67e0b45d (non-flash)\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:49:11 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)
Nov 06 15:49:11 user nova-compute[75337]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1421f55-d453-441d-bdf7-3743102662b6 (non-flash)
Nov 06 15:49:11 user nova-compute[75337]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6 (non-flash)
Nov 06 15:49:11 user nova-compute[75337]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4954683e-297c-4bed-94c9-675adb40fb66 (non-flash)
Nov 06 15:49:11 user nova-compute[75337]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06631b49-02a1-4759-8d9b-22b7ebdaa584 (non-flash)
Nov 06 15:49:11 user nova-compute[75337]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c5fa35a-1ba5-4390-9102-83ac1dbb790a (non-flash)
Nov 06 15:49:11 user nova-compute[75337]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:563526a2-6204-4264-91b7-041e6cadab23 (non-flash)
Nov 06 15:49:11 user nova-compute[75337]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc5eae50-0461-47ca-bc48-cb38087b06e0 (non-flash)
Nov 06 15:49:11 user nova-compute[75337]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bebbb46-2250-4511-ba59-f4ce67e0b45d (non-flash)
Nov 06 15:49:11 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 15:49:11 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)
Nov 06 15:49:11 user nova-compute[75337]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1421f55-d453-441d-bdf7-3743102662b6 (non-flash)
Nov 06 15:49:11 user nova-compute[75337]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6 (non-flash)
Nov 06 15:49:11 user nova-compute[75337]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4954683e-297c-4bed-94c9-675adb40fb66 (non-flash)
Nov 06 15:49:11 user nova-compute[75337]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06631b49-02a1-4759-8d9b-22b7ebdaa584 (non-flash)
Nov 06 15:49:11 user nova-compute[75337]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c5fa35a-1ba5-4390-9102-83ac1dbb790a (non-flash)
Nov 06 15:49:11 user nova-compute[75337]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:563526a2-6204-4264-91b7-041e6cadab23 (non-flash)
Nov 06 15:49:11 user nova-compute[75337]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc5eae50-0461-47ca-bc48-cb38087b06e0 (non-flash)
Nov 06 15:49:11 user nova-compute[75337]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bebbb46-2250-4511-ba59-f4ce67e0b45d (non-flash)
Nov 06 15:49:11 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 15:49:11 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1bebbb46-2250-4511-ba59-f4ce67e0b45d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.622s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 15:49:11 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Connected to 172.16.0.220:3260 {{(pid=75337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 15:49:11 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] HCTL ('41', '-', '-', 0) found on session 28 with lun 0 {{(pid=75337) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 15:49:11 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Scanning host 41 c: -, t: -, l: 0) {{(pid=75337) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 15:49:11 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:11 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.035s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:49:11 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac3f95b5-1082-4a7e-ada6-195705df59e4]: (4, ('- - 0', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:49:11 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Searching for a device in session 28 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=75337) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 15:49:11 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Connected to sdj using {'target_iqn': 'iqn.2010-10.org.openstack:1bebbb46-2250-4511-ba59-f4ce67e0b45d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VGdgTYBv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 15:49:11 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:11 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-9076803f-e56e-41e3-b886-3eb2eb98408e tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] No BDM found with device name vda, not building metadata. {{(pid=75337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 15:49:11 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-9076803f-e56e-41e3-b886-3eb2eb98408e tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 15:49:11 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-9076803f-e56e-41e3-b886-3eb2eb98408e tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] No VIF found with MAC fa:16:3e:fe:62:24, not building metadata {{(pid=75337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 15:49:11 user nova-compute[75337]: DEBUG nova.virt.libvirt.guest [None req-c05e62de-0cab-45f4-bdae-03cecf76da51 tempest-TestVolumeSwap-916912695 tempest-TestVolumeSwap-916912695-project-admin] COPY block job progress, current cursor: 1006632960 final cursor: 1073741824 {{(pid=75337) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 06 15:49:11 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 15:49:11 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 15:49:11 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-9076803f-e56e-41e3-b886-3eb2eb98408e tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Lock "bc0e07f8-2731-4ffa-8446-b71ad3ba7375" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 46.041s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:49:11 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-b4c03605-9a5f-458d-b11b-3747919bdc6a tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Acquiring lock "afa4e52b-af51-45bf-b619-aeca14e7724d" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:49:11 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-b4c03605-9a5f-458d-b11b-3747919bdc6a tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Lock "afa4e52b-af51-45bf-b619-aeca14e7724d" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:49:11 user nova-compute[75337]: INFO nova.compute.manager [None req-b4c03605-9a5f-458d-b11b-3747919bdc6a tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] [instance: afa4e52b-af51-45bf-b619-aeca14e7724d] Shelving
Nov 06 15:49:12 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Compute_service record updated for user:user {{(pid=75337) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 15:49:12 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.132s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:49:12 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:49:12 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Cleaning up deleted instances {{(pid=75337) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 06 15:49:12 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] There are 0 instances to clean {{(pid=75337) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 06 15:49:12 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:49:12 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Cleaning up deleted instances with incomplete migration  {{(pid=75337) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 06 15:49:12 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:49:12 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:12 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:12 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:12 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:12 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:12 user nova-compute[75337]: DEBUG nova.virt.libvirt.guest [None req-c05e62de-0cab-45f4-bdae-03cecf76da51 tempest-TestVolumeSwap-916912695 tempest-TestVolumeSwap-916912695-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=75337) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 06 15:49:12 user nova-compute[75337]: DEBUG nova.compute.manager [None req-d09c878c-6e19-419d-9276-e42c6645f9f3 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: b7ececa5-256f-4a5d-aeda-3d2ee5c01cfe] Checking state {{(pid=75337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 15:49:12 user nova-compute[75337]: INFO nova.compute.manager [None req-d09c878c-6e19-419d-9276-e42c6645f9f3 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: b7ececa5-256f-4a5d-aeda-3d2ee5c01cfe] instance snapshotting
Nov 06 15:49:12 user nova-compute[75337]: DEBUG nova.network.neutron [None req-13d17865-491a-490f-b016-5c740d02f100 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 493eff79-294e-4259-a6d0-4772c4b45013] Successfully updated port: 5e620284-83c1-40a8-91a5-c6b2c8c87a19 {{(pid=75337) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 15:49:12 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.703s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 15:49:12 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] <== connect_volume: return (3564ms) {'type': 'block', 'scsi_wwn': '23964393765386138', 'path': '/dev/sdj'} {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 15:49:12 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23964393765386138', 'path': '/dev/sdj'} {{(pid=75337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 15:49:12 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-13d17865-491a-490f-b016-5c740d02f100 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Acquiring lock "refresh_cache-493eff79-294e-4259-a6d0-4772c4b45013" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 15:49:12 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-13d17865-491a-490f-b016-5c740d02f100 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Acquired lock "refresh_cache-493eff79-294e-4259-a6d0-4772c4b45013" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 15:49:12 user nova-compute[75337]: DEBUG nova.network.neutron [None req-13d17865-491a-490f-b016-5c740d02f100 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 493eff79-294e-4259-a6d0-4772c4b45013] Building network info cache for instance {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 15:49:12 user nova-compute[75337]: DEBUG nova.compute.manager [req-dee3db61-cade-4f3e-8f4e-88975f9be623 req-48a97b96-f7b2-403e-b73c-cc6d3245aa9d service nova] [instance: afa4e52b-af51-45bf-b619-aeca14e7724d] Received event network-vif-unplugged-d66c8fee-7efa-49a4-b9c3-2f7ad2ccc71b {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:49:12 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-dee3db61-cade-4f3e-8f4e-88975f9be623 req-48a97b96-f7b2-403e-b73c-cc6d3245aa9d service nova] Acquiring lock "afa4e52b-af51-45bf-b619-aeca14e7724d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:49:12 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-dee3db61-cade-4f3e-8f4e-88975f9be623 req-48a97b96-f7b2-403e-b73c-cc6d3245aa9d service nova] Lock "afa4e52b-af51-45bf-b619-aeca14e7724d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:49:12 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-dee3db61-cade-4f3e-8f4e-88975f9be623 req-48a97b96-f7b2-403e-b73c-cc6d3245aa9d service nova] Lock "afa4e52b-af51-45bf-b619-aeca14e7724d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:49:12 user nova-compute[75337]: DEBUG nova.compute.manager [req-dee3db61-cade-4f3e-8f4e-88975f9be623 req-48a97b96-f7b2-403e-b73c-cc6d3245aa9d service nova] [instance: afa4e52b-af51-45bf-b619-aeca14e7724d] No waiting events found dispatching network-vif-unplugged-d66c8fee-7efa-49a4-b9c3-2f7ad2ccc71b {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:49:12 user nova-compute[75337]: WARNING nova.compute.manager [req-dee3db61-cade-4f3e-8f4e-88975f9be623 req-48a97b96-f7b2-403e-b73c-cc6d3245aa9d service nova] [instance: afa4e52b-af51-45bf-b619-aeca14e7724d] Received unexpected event network-vif-unplugged-d66c8fee-7efa-49a4-b9c3-2f7ad2ccc71b for instance with vm_state active and task_state shelving.
Nov 06 15:49:12 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T15:47:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1443965287',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1443965287',id=21,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG7VkOM3FinTlqOh/5i4bJAlF+JkumoM781rkezhqaf5pWO5EV6o0arddlLxKFWQuRwvULABugSP9UlkuYUV6t6klaf6mpKXNMFKyEPMHCLjo4xOIuyZf+KcTJP3JOed1A==',key_name='tempest-keypair-1747168088',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7944be2b6e2047f5a633242809f6f04e',ramdisk_id='',reservation_id='r-ozdn99kc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1041493160',owner_user_name='tempest-TaggedBootDevicesTest_v242-1041493160-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T15:47:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='65a31270ba05411aab57fe42295b1406',uuid=fdda34b5-280f-489d-baf5-bf21ac6dd6c9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ee068b96-f361-4cb1-afeb-d3db42848f50", "address": "fa:16:3e:63:2a:18", "network": {"id": "8a494051-b597-47cd-8d64-76f0be5760cc", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-162490382-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7944be2b6e2047f5a633242809f6f04e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee068b96-f3", "ovs_interfaceid": "ee068b96-f361-4cb1-afeb-d3db42848f50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75337) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 15:49:12 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Converting VIF {"id": "ee068b96-f361-4cb1-afeb-d3db42848f50", "address": "fa:16:3e:63:2a:18", "network": {"id": "8a494051-b597-47cd-8d64-76f0be5760cc", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-162490382-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7944be2b6e2047f5a633242809f6f04e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee068b96-f3", "ovs_interfaceid": "ee068b96-f361-4cb1-afeb-d3db42848f50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 15:49:12 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:2a:18,bridge_name='br-int',has_traffic_filtering=True,id=ee068b96-f361-4cb1-afeb-d3db42848f50,network=Network(8a494051-b597-47cd-8d64-76f0be5760cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee068b96-f3') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 15:49:12 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T15:47:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1443965287',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1443965287',id=21,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG7VkOM3FinTlqOh/5i4bJAlF+JkumoM781rkezhqaf5pWO5EV6o0arddlLxKFWQuRwvULABugSP9UlkuYUV6t6klaf6mpKXNMFKyEPMHCLjo4xOIuyZf+KcTJP3JOed1A==',key_name='tempest-keypair-1747168088',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7944be2b6e2047f5a633242809f6f04e',ramdisk_id='',reservation_id='r-ozdn99kc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1041493160',owner_user_name='tempest-TaggedBootDevicesTest_v242-1041493160-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T15:47:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='65a31270ba05411aab57fe42295b1406',uuid=fdda34b5-280f-489d-baf5-bf21ac6dd6c9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7359ffbf-b953-480e-ae89-7ce5dda880a3", "address": "fa:16:3e:12:4b:11", "network": {"id": "e17a21e6-be31-4611-8f62-59327c8c4d9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1516543392", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7944be2b6e2047f5a633242809f6f04e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7359ffbf-b9", "ovs_interfaceid": "7359ffbf-b953-480e-ae89-7ce5dda880a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75337) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 15:49:12 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Converting VIF {"id": "7359ffbf-b953-480e-ae89-7ce5dda880a3", "address": "fa:16:3e:12:4b:11", "network": {"id": "e17a21e6-be31-4611-8f62-59327c8c4d9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1516543392", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7944be2b6e2047f5a633242809f6f04e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7359ffbf-b9", "ovs_interfaceid": "7359ffbf-b953-480e-ae89-7ce5dda880a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 15:49:12 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:4b:11,bridge_name='br-int',has_traffic_filtering=True,id=7359ffbf-b953-480e-ae89-7ce5dda880a3,network=Network(e17a21e6-be31-4611-8f62-59327c8c4d9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7359ffbf-b9') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 15:49:12 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T15:47:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1443965287',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1443965287',id=21,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG7VkOM3FinTlqOh/5i4bJAlF+JkumoM781rkezhqaf5pWO5EV6o0arddlLxKFWQuRwvULABugSP9UlkuYUV6t6klaf6mpKXNMFKyEPMHCLjo4xOIuyZf+KcTJP3JOed1A==',key_name='tempest-keypair-1747168088',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7944be2b6e2047f5a633242809f6f04e',ramdisk_id='',reservation_id='r-ozdn99kc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1041493160',owner_user_name='tempest-TaggedBootDevicesTest_v242-1041493160-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T15:47:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='65a31270ba05411aab57fe42295b1406',uuid=fdda34b5-280f-489d-baf5-bf21ac6dd6c9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0184ea76-40a1-41f4-9a6f-e2ca6719b7ab", "address": "fa:16:3e:3b:f7:32", "network": {"id": "e17a21e6-be31-4611-8f62-59327c8c4d9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1516543392", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7944be2b6e2047f5a633242809f6f04e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0184ea76-40", "ovs_interfaceid": "0184ea76-40a1-41f4-9a6f-e2ca6719b7ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75337) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 15:49:12 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Converting VIF {"id": "0184ea76-40a1-41f4-9a6f-e2ca6719b7ab", "address": "fa:16:3e:3b:f7:32", "network": {"id": "e17a21e6-be31-4611-8f62-59327c8c4d9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1516543392", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7944be2b6e2047f5a633242809f6f04e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0184ea76-40", "ovs_interfaceid": "0184ea76-40a1-41f4-9a6f-e2ca6719b7ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 15:49:12 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:f7:32,bridge_name='br-int',has_traffic_filtering=True,id=0184ea76-40a1-41f4-9a6f-e2ca6719b7ab,network=Network(e17a21e6-be31-4611-8f62-59327c8c4d9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0184ea76-40') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 15:49:12 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T15:47:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1443965287',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1443965287',id=21,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG7VkOM3FinTlqOh/5i4bJAlF+JkumoM781rkezhqaf5pWO5EV6o0arddlLxKFWQuRwvULABugSP9UlkuYUV6t6klaf6mpKXNMFKyEPMHCLjo4xOIuyZf+KcTJP3JOed1A==',key_name='tempest-keypair-1747168088',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7944be2b6e2047f5a633242809f6f04e',ramdisk_id='',reservation_id='r-ozdn99kc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1041493160',owner_user_name='tempest-TaggedBootDevicesTest_v242-1041493160-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T15:47:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='65a31270ba05411aab57fe42295b1406',uuid=fdda34b5-280f-489d-baf5-bf21ac6dd6c9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "38a409f9-0fb9-4505-9f74-bf2859e6f66c", "address": "fa:16:3e:8a:6f:5e", "network": {"id": "e17a21e6-be31-4611-8f62-59327c8c4d9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1516543392", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.115", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7944be2b6e2047f5a633242809f6f04e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38a409f9-0f", "ovs_interfaceid": "38a409f9-0fb9-4505-9f74-bf2859e6f66c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75337) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 15:49:12 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Converting VIF {"id": "38a409f9-0fb9-4505-9f74-bf2859e6f66c", "address": "fa:16:3e:8a:6f:5e", "network": {"id": "e17a21e6-be31-4611-8f62-59327c8c4d9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1516543392", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.115", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7944be2b6e2047f5a633242809f6f04e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38a409f9-0f", "ovs_interfaceid": "38a409f9-0fb9-4505-9f74-bf2859e6f66c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 15:49:12 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:6f:5e,bridge_name='br-int',has_traffic_filtering=True,id=38a409f9-0fb9-4505-9f74-bf2859e6f66c,network=Network(e17a21e6-be31-4611-8f62-59327c8c4d9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38a409f9-0f') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 15:49:12 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T15:47:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1443965287',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1443965287',id=21,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG7VkOM3FinTlqOh/5i4bJAlF+JkumoM781rkezhqaf5pWO5EV6o0arddlLxKFWQuRwvULABugSP9UlkuYUV6t6klaf6mpKXNMFKyEPMHCLjo4xOIuyZf+KcTJP3JOed1A==',key_name='tempest-keypair-1747168088',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7944be2b6e2047f5a633242809f6f04e',ramdisk_id='',reservation_id='r-ozdn99kc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1041493160',owner_user_name='tempest-TaggedBootDevicesTest_v242-1041493160-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T15:47:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='65a31270ba05411aab57fe42295b1406',uuid=fdda34b5-280f-489d-baf5-bf21ac6dd6c9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d86aca21-e67b-48e9-b8de-a1d618a5dfc7", "address": "fa:16:3e:bf:c2:bd", "network": {"id": "e17a21e6-be31-4611-8f62-59327c8c4d9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1516543392", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.131", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7944be2b6e2047f5a633242809f6f04e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd86aca21-e6", "ovs_interfaceid": "d86aca21-e67b-48e9-b8de-a1d618a5dfc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75337) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 15:49:12 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Converting VIF {"id": "d86aca21-e67b-48e9-b8de-a1d618a5dfc7", "address": "fa:16:3e:bf:c2:bd", "network": {"id": "e17a21e6-be31-4611-8f62-59327c8c4d9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1516543392", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.131", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7944be2b6e2047f5a633242809f6f04e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd86aca21-e6", "ovs_interfaceid": "d86aca21-e67b-48e9-b8de-a1d618a5dfc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 15:49:12 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:c2:bd,bridge_name='br-int',has_traffic_filtering=True,id=d86aca21-e67b-48e9-b8de-a1d618a5dfc7,network=Network(e17a21e6-be31-4611-8f62-59327c8c4d9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd86aca21-e6') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 15:49:12 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T15:47:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1443965287',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1443965287',id=21,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG7VkOM3FinTlqOh/5i4bJAlF+JkumoM781rkezhqaf5pWO5EV6o0arddlLxKFWQuRwvULABugSP9UlkuYUV6t6klaf6mpKXNMFKyEPMHCLjo4xOIuyZf+KcTJP3JOed1A==',key_name='tempest-keypair-1747168088',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7944be2b6e2047f5a633242809f6f04e',ramdisk_id='',reservation_id='r-ozdn99kc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1041493160',owner_user_name='tempest-TaggedBootDevicesTest_v242-1041493160-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T15:47:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='65a31270ba05411aab57fe42295b1406',uuid=fdda34b5-280f-489d-baf5-bf21ac6dd6c9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4c56104b-528f-40b8-931d-7619e413ab07", "address": "fa:16:3e:4d:d7:97", "network": {"id": "00ad9466-de22-4eb1-86c7-01667b94d2a9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1660110834", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7944be2b6e2047f5a633242809f6f04e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c56104b-52", "ovs_interfaceid": "4c56104b-528f-40b8-931d-7619e413ab07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75337) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 15:49:12 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Converting VIF {"id": "4c56104b-528f-40b8-931d-7619e413ab07", "address": "fa:16:3e:4d:d7:97", "network": {"id": "00ad9466-de22-4eb1-86c7-01667b94d2a9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1660110834", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7944be2b6e2047f5a633242809f6f04e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c56104b-52", "ovs_interfaceid": "4c56104b-528f-40b8-931d-7619e413ab07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 15:49:12 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:d7:97,bridge_name='br-int',has_traffic_filtering=True,id=4c56104b-528f-40b8-931d-7619e413ab07,network=Network(00ad9466-de22-4eb1-86c7-01667b94d2a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c56104b-52') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 15:49:12 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T15:47:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1443965287',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1443965287',id=21,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG7VkOM3FinTlqOh/5i4bJAlF+JkumoM781rkezhqaf5pWO5EV6o0arddlLxKFWQuRwvULABugSP9UlkuYUV6t6klaf6mpKXNMFKyEPMHCLjo4xOIuyZf+KcTJP3JOed1A==',key_name='tempest-keypair-1747168088',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7944be2b6e2047f5a633242809f6f04e',ramdisk_id='',reservation_id='r-ozdn99kc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1041493160',owner_user_name='tempest-TaggedBootDevicesTest_v242-1041493160-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T15:47:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='65a31270ba05411aab57fe42295b1406',uuid=fdda34b5-280f-489d-baf5-bf21ac6dd6c9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "996e784d-bbe6-447b-8f1f-066ec34be989", "address": "fa:16:3e:41:c0:e2", "network": {"id": "00ad9466-de22-4eb1-86c7-01667b94d2a9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1660110834", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7944be2b6e2047f5a633242809f6f04e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap996e784d-bb", "ovs_interfaceid": "996e784d-bbe6-447b-8f1f-066ec34be989", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75337) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 15:49:12 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Converting VIF {"id": "996e784d-bbe6-447b-8f1f-066ec34be989", "address": "fa:16:3e:41:c0:e2", "network": {"id": "00ad9466-de22-4eb1-86c7-01667b94d2a9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1660110834", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7944be2b6e2047f5a633242809f6f04e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap996e784d-bb", "ovs_interfaceid": "996e784d-bbe6-447b-8f1f-066ec34be989", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 15:49:12 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:c0:e2,bridge_name='br-int',has_traffic_filtering=True,id=996e784d-bbe6-447b-8f1f-066ec34be989,network=Network(00ad9466-de22-4eb1-86c7-01667b94d2a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap996e784d-bb') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 15:49:12 user nova-compute[75337]: DEBUG nova.objects.instance [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Lazy-loading 'pci_devices' on Instance uuid fdda34b5-280f-489d-baf5-bf21ac6dd6c9 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 15:49:12 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] End _get_guest_xml xml=<domain type="kvm">
Nov 06 15:49:12 user nova-compute[75337]:   <uuid>fdda34b5-280f-489d-baf5-bf21ac6dd6c9</uuid>
Nov 06 15:49:12 user nova-compute[75337]:   <name>instance-00000015</name>
Nov 06 15:49:12 user nova-compute[75337]:   <memory>524288</memory>
Nov 06 15:49:12 user nova-compute[75337]:   <vcpu>1</vcpu>
Nov 06 15:49:12 user nova-compute[75337]:   <metadata>
Nov 06 15:49:12 user nova-compute[75337]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 15:49:12 user nova-compute[75337]:       <nova:package version="0.0.0"/>
Nov 06 15:49:12 user nova-compute[75337]:       <nova:name>tempest-device-tagging-server-1443965287</nova:name>
Nov 06 15:49:12 user nova-compute[75337]:       <nova:creationTime>2023-11-06 15:49:02</nova:creationTime>
Nov 06 15:49:12 user nova-compute[75337]:       <nova:flavor name="m1.tiny">
Nov 06 15:49:12 user nova-compute[75337]:         <nova:memory>512</nova:memory>
Nov 06 15:49:12 user nova-compute[75337]:         <nova:disk>1</nova:disk>
Nov 06 15:49:12 user nova-compute[75337]:         <nova:swap>0</nova:swap>
Nov 06 15:49:12 user nova-compute[75337]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 15:49:12 user nova-compute[75337]:         <nova:vcpus>1</nova:vcpus>
Nov 06 15:49:12 user nova-compute[75337]:       </nova:flavor>
Nov 06 15:49:12 user nova-compute[75337]:       <nova:owner>
Nov 06 15:49:12 user nova-compute[75337]:         <nova:user uuid="65a31270ba05411aab57fe42295b1406">tempest-TaggedBootDevicesTest_v242-1041493160-project-member</nova:user>
Nov 06 15:49:12 user nova-compute[75337]:         <nova:project uuid="7944be2b6e2047f5a633242809f6f04e">tempest-TaggedBootDevicesTest_v242-1041493160</nova:project>
Nov 06 15:49:12 user nova-compute[75337]:       </nova:owner>
Nov 06 15:49:12 user nova-compute[75337]:       <nova:root type="image" uuid="16b903ae-a40f-41a7-985b-4804cce92c62"/>
Nov 06 15:49:12 user nova-compute[75337]:       <nova:ports>
Nov 06 15:49:12 user nova-compute[75337]:         <nova:port uuid="ee068b96-f361-4cb1-afeb-d3db42848f50">
Nov 06 15:49:12 user nova-compute[75337]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 06 15:49:12 user nova-compute[75337]:         </nova:port>
Nov 06 15:49:12 user nova-compute[75337]:         <nova:port uuid="7359ffbf-b953-480e-ae89-7ce5dda880a3">
Nov 06 15:49:12 user nova-compute[75337]:           <nova:ip type="fixed" address="10.1.1.33" ipVersion="4"/>
Nov 06 15:49:12 user nova-compute[75337]:         </nova:port>
Nov 06 15:49:12 user nova-compute[75337]:         <nova:port uuid="0184ea76-40a1-41f4-9a6f-e2ca6719b7ab">
Nov 06 15:49:12 user nova-compute[75337]:           <nova:ip type="fixed" address="10.1.1.234" ipVersion="4"/>
Nov 06 15:49:12 user nova-compute[75337]:         </nova:port>
Nov 06 15:49:12 user nova-compute[75337]:         <nova:port uuid="38a409f9-0fb9-4505-9f74-bf2859e6f66c">
Nov 06 15:49:12 user nova-compute[75337]:           <nova:ip type="fixed" address="10.1.1.115" ipVersion="4"/>
Nov 06 15:49:12 user nova-compute[75337]:         </nova:port>
Nov 06 15:49:12 user nova-compute[75337]:         <nova:port uuid="d86aca21-e67b-48e9-b8de-a1d618a5dfc7">
Nov 06 15:49:12 user nova-compute[75337]:           <nova:ip type="fixed" address="10.1.1.131" ipVersion="4"/>
Nov 06 15:49:12 user nova-compute[75337]:         </nova:port>
Nov 06 15:49:12 user nova-compute[75337]:         <nova:port uuid="4c56104b-528f-40b8-931d-7619e413ab07">
Nov 06 15:49:12 user nova-compute[75337]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 06 15:49:12 user nova-compute[75337]:         </nova:port>
Nov 06 15:49:12 user nova-compute[75337]:         <nova:port uuid="996e784d-bbe6-447b-8f1f-066ec34be989">
Nov 06 15:49:12 user nova-compute[75337]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 06 15:49:12 user nova-compute[75337]:         </nova:port>
Nov 06 15:49:12 user nova-compute[75337]:       </nova:ports>
Nov 06 15:49:12 user nova-compute[75337]:     </nova:instance>
Nov 06 15:49:12 user nova-compute[75337]:   </metadata>
Nov 06 15:49:12 user nova-compute[75337]:   <sysinfo type="smbios">
Nov 06 15:49:12 user nova-compute[75337]:     <system>
Nov 06 15:49:12 user nova-compute[75337]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 15:49:12 user nova-compute[75337]:       <entry name="product">OpenStack Nova</entry>
Nov 06 15:49:12 user nova-compute[75337]:       <entry name="version">0.0.0</entry>
Nov 06 15:49:12 user nova-compute[75337]:       <entry name="serial">fdda34b5-280f-489d-baf5-bf21ac6dd6c9</entry>
Nov 06 15:49:12 user nova-compute[75337]:       <entry name="uuid">fdda34b5-280f-489d-baf5-bf21ac6dd6c9</entry>
Nov 06 15:49:12 user nova-compute[75337]:       <entry name="family">Virtual Machine</entry>
Nov 06 15:49:12 user nova-compute[75337]:     </system>
Nov 06 15:49:12 user nova-compute[75337]:   </sysinfo>
Nov 06 15:49:12 user nova-compute[75337]:   <os>
Nov 06 15:49:12 user nova-compute[75337]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 15:49:12 user nova-compute[75337]:     <boot dev="hd"/>
Nov 06 15:49:12 user nova-compute[75337]:     <smbios mode="sysinfo"/>
Nov 06 15:49:12 user nova-compute[75337]:   </os>
Nov 06 15:49:12 user nova-compute[75337]:   <features>
Nov 06 15:49:12 user nova-compute[75337]:     <acpi/>
Nov 06 15:49:12 user nova-compute[75337]:     <apic/>
Nov 06 15:49:12 user nova-compute[75337]:     <vmcoreinfo/>
Nov 06 15:49:12 user nova-compute[75337]:   </features>
Nov 06 15:49:12 user nova-compute[75337]:   <clock offset="utc">
Nov 06 15:49:12 user nova-compute[75337]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 15:49:12 user nova-compute[75337]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 15:49:12 user nova-compute[75337]:     <timer name="hpet" present="no"/>
Nov 06 15:49:12 user nova-compute[75337]:   </clock>
Nov 06 15:49:12 user nova-compute[75337]:   <cpu mode="custom" match="exact">
Nov 06 15:49:12 user nova-compute[75337]:     <model>Nehalem</model>
Nov 06 15:49:12 user nova-compute[75337]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 15:49:12 user nova-compute[75337]:   </cpu>
Nov 06 15:49:12 user nova-compute[75337]:   <devices>
Nov 06 15:49:12 user nova-compute[75337]:     <disk type="file" device="cdrom">
Nov 06 15:49:12 user nova-compute[75337]:       <driver name="qemu" type="raw" cache="none"/>
Nov 06 15:49:12 user nova-compute[75337]:       <source file="/opt/stack/data/nova/instances/fdda34b5-280f-489d-baf5-bf21ac6dd6c9/disk.config"/>
Nov 06 15:49:12 user nova-compute[75337]:       <target dev="hda" bus="ide"/>
Nov 06 15:49:12 user nova-compute[75337]:     </disk>
Nov 06 15:49:12 user nova-compute[75337]:     <disk type="block" device="disk">
Nov 06 15:49:12 user nova-compute[75337]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 15:49:12 user nova-compute[75337]:       <source dev="/dev/sdf"/>
Nov 06 15:49:12 user nova-compute[75337]:       <target dev="vda" bus="virtio"/>
Nov 06 15:49:12 user nova-compute[75337]:       <serial>06631b49-02a1-4759-8d9b-22b7ebdaa584</serial>
Nov 06 15:49:12 user nova-compute[75337]:     </disk>
Nov 06 15:49:12 user nova-compute[75337]:     <disk type="block" device="disk">
Nov 06 15:49:12 user nova-compute[75337]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 15:49:12 user nova-compute[75337]:       <source dev="/dev/sdh"/>
Nov 06 15:49:12 user nova-compute[75337]:       <target dev="vdb" bus="virtio"/>
Nov 06 15:49:12 user nova-compute[75337]:       <serial>563526a2-6204-4264-91b7-041e6cadab23</serial>
Nov 06 15:49:12 user nova-compute[75337]:     </disk>
Nov 06 15:49:12 user nova-compute[75337]:     <disk type="block" device="disk">
Nov 06 15:49:12 user nova-compute[75337]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 15:49:12 user nova-compute[75337]:       <source dev="/dev/sdj"/>
Nov 06 15:49:12 user nova-compute[75337]:       <target dev="vdc" bus="virtio"/>
Nov 06 15:49:12 user nova-compute[75337]:       <serial>1bebbb46-2250-4511-ba59-f4ce67e0b45d</serial>
Nov 06 15:49:12 user nova-compute[75337]:     </disk>
Nov 06 15:49:12 user nova-compute[75337]:     <interface type="ethernet">
Nov 06 15:49:12 user nova-compute[75337]:       <mac address="fa:16:3e:63:2a:18"/>
Nov 06 15:49:12 user nova-compute[75337]:       <model type="virtio"/>
Nov 06 15:49:12 user nova-compute[75337]:       <mtu size="1442"/>
Nov 06 15:49:12 user nova-compute[75337]:       <target dev="tapee068b96-f3"/>
Nov 06 15:49:12 user nova-compute[75337]:     </interface>
Nov 06 15:49:12 user nova-compute[75337]:     <interface type="ethernet">
Nov 06 15:49:12 user nova-compute[75337]:       <mac address="fa:16:3e:12:4b:11"/>
Nov 06 15:49:12 user nova-compute[75337]:       <model type="virtio"/>
Nov 06 15:49:12 user nova-compute[75337]:       <mtu size="1442"/>
Nov 06 15:49:12 user nova-compute[75337]:       <target dev="tap7359ffbf-b9"/>
Nov 06 15:49:12 user nova-compute[75337]:     </interface>
Nov 06 15:49:12 user nova-compute[75337]:     <interface type="ethernet">
Nov 06 15:49:12 user nova-compute[75337]:       <mac address="fa:16:3e:3b:f7:32"/>
Nov 06 15:49:12 user nova-compute[75337]:       <model type="virtio"/>
Nov 06 15:49:12 user nova-compute[75337]:       <mtu size="1442"/>
Nov 06 15:49:12 user nova-compute[75337]:       <target dev="tap0184ea76-40"/>
Nov 06 15:49:12 user nova-compute[75337]:     </interface>
Nov 06 15:49:12 user nova-compute[75337]:     <interface type="ethernet">
Nov 06 15:49:12 user nova-compute[75337]:       <mac address="fa:16:3e:8a:6f:5e"/>
Nov 06 15:49:12 user nova-compute[75337]:       <model type="virtio"/>
Nov 06 15:49:12 user nova-compute[75337]:       <mtu size="1442"/>
Nov 06 15:49:12 user nova-compute[75337]:       <target dev="tap38a409f9-0f"/>
Nov 06 15:49:12 user nova-compute[75337]:     </interface>
Nov 06 15:49:12 user nova-compute[75337]:     <interface type="ethernet">
Nov 06 15:49:12 user nova-compute[75337]:       <mac address="fa:16:3e:bf:c2:bd"/>
Nov 06 15:49:12 user nova-compute[75337]:       <model type="virtio"/>
Nov 06 15:49:12 user nova-compute[75337]:       <mtu size="1442"/>
Nov 06 15:49:12 user nova-compute[75337]:       <target dev="tapd86aca21-e6"/>
Nov 06 15:49:12 user nova-compute[75337]:     </interface>
Nov 06 15:49:12 user nova-compute[75337]:     <interface type="ethernet">
Nov 06 15:49:12 user nova-compute[75337]:       <mac address="fa:16:3e:4d:d7:97"/>
Nov 06 15:49:12 user nova-compute[75337]:       <model type="virtio"/>
Nov 06 15:49:12 user nova-compute[75337]:       <mtu size="1442"/>
Nov 06 15:49:12 user nova-compute[75337]:       <target dev="tap4c56104b-52"/>
Nov 06 15:49:12 user nova-compute[75337]:     </interface>
Nov 06 15:49:12 user nova-compute[75337]:     <interface type="ethernet">
Nov 06 15:49:12 user nova-compute[75337]:       <mac address="fa:16:3e:41:c0:e2"/>
Nov 06 15:49:12 user nova-compute[75337]:       <model type="virtio"/>
Nov 06 15:49:12 user nova-compute[75337]:       <mtu size="1442"/>
Nov 06 15:49:12 user nova-compute[75337]:       <target dev="tap996e784d-bb"/>
Nov 06 15:49:12 user nova-compute[75337]:     </interface>
Nov 06 15:49:12 user nova-compute[75337]:     <serial type="pty">
Nov 06 15:49:12 user nova-compute[75337]:       <log file="/opt/stack/data/nova/instances/fdda34b5-280f-489d-baf5-bf21ac6dd6c9/console.log" append="off"/>
Nov 06 15:49:12 user nova-compute[75337]:     </serial>
Nov 06 15:49:12 user nova-compute[75337]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 15:49:12 user nova-compute[75337]:     <video>
Nov 06 15:49:12 user nova-compute[75337]:       <model type="virtio"/>
Nov 06 15:49:12 user nova-compute[75337]:     </video>
Nov 06 15:49:12 user nova-compute[75337]:     <rng model="virtio">
Nov 06 15:49:12 user nova-compute[75337]:       <backend model="random">/dev/urandom</backend>
Nov 06 15:49:12 user nova-compute[75337]:     </rng>
Nov 06 15:49:12 user nova-compute[75337]:     <controller type="usb" index="0" model="none"/>
Nov 06 15:49:12 user nova-compute[75337]:     <memballoon model="virtio">
Nov 06 15:49:12 user nova-compute[75337]:       <stats period="10"/>
Nov 06 15:49:12 user nova-compute[75337]:     </memballoon>
Nov 06 15:49:12 user nova-compute[75337]:   </devices>
Nov 06 15:49:12 user nova-compute[75337]: </domain>
Nov 06 15:49:12 user nova-compute[75337]:  {{(pid=75337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 15:49:12 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T15:47:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1443965287',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1443965287',id=21,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG7VkOM3FinTlqOh/5i4bJAlF+JkumoM781rkezhqaf5pWO5EV6o0arddlLxKFWQuRwvULABugSP9UlkuYUV6t6klaf6mpKXNMFKyEPMHCLjo4xOIuyZf+KcTJP3JOed1A==',key_name='tempest-keypair-1747168088',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7944be2b6e2047f5a633242809f6f04e',ramdisk_id='',reservation_id='r-ozdn99kc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1041493160',owner_user_name='tempest-TaggedBootDevicesTest_v242-1041493160-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T15:47:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='65a31270ba05411aab57fe42295b1406',uuid=fdda34b5-280f-489d-baf5-bf21ac6dd6c9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ee068b96-f361-4cb1-afeb-d3db42848f50", "address": "fa:16:3e:63:2a:18", "network": {"id": "8a494051-b597-47cd-8d64-76f0be5760cc", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-162490382-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7944be2b6e2047f5a633242809f6f04e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee068b96-f3", "ovs_interfaceid": "ee068b96-f361-4cb1-afeb-d3db42848f50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 15:49:12 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Converting VIF {"id": "ee068b96-f361-4cb1-afeb-d3db42848f50", "address": "fa:16:3e:63:2a:18", "network": {"id": "8a494051-b597-47cd-8d64-76f0be5760cc", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-162490382-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7944be2b6e2047f5a633242809f6f04e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee068b96-f3", "ovs_interfaceid": "ee068b96-f361-4cb1-afeb-d3db42848f50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 15:49:12 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:2a:18,bridge_name='br-int',has_traffic_filtering=True,id=ee068b96-f361-4cb1-afeb-d3db42848f50,network=Network(8a494051-b597-47cd-8d64-76f0be5760cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee068b96-f3') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 15:49:12 user nova-compute[75337]: DEBUG os_vif [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:2a:18,bridge_name='br-int',has_traffic_filtering=True,id=ee068b96-f361-4cb1-afeb-d3db42848f50,network=Network(8a494051-b597-47cd-8d64-76f0be5760cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee068b96-f3') {{(pid=75337) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 15:49:12 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:12 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:49:12 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 15:49:12 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:12 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '454d6c60-52ef-5f9d-8c79-716623bf7ee8', '_type': 'linux-noop'}}, row=False) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:49:12 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:12 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:49:12 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-d09c878c-6e19-419d-9276-e42c6645f9f3 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: b7ececa5-256f-4a5d-aeda-3d2ee5c01cfe] Beginning live snapshot process
Nov 06 15:49:12 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:12 user nova-compute[75337]: DEBUG nova.network.neutron [None req-13d17865-491a-490f-b016-5c740d02f100 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 493eff79-294e-4259-a6d0-4772c4b45013] Instance cache missing network info. {{(pid=75337) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 15:49:12 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:12 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapee068b96-f3, may_exist=True, interface_attrs={}) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:49:12 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapee068b96-f3, col_values=(('qos', UUID('d8d49651-15f1-4683-b6b4-2f71e8c1df49')),), if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:49:12 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapee068b96-f3, col_values=(('external_ids', {'iface-id': 'ee068b96-f361-4cb1-afeb-d3db42848f50', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:63:2a:18', 'vm-uuid': 'fdda34b5-280f-489d-baf5-bf21ac6dd6c9'}),), if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:49:12 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:12 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:49:12 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:12 user nova-compute[75337]: INFO os_vif [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:2a:18,bridge_name='br-int',has_traffic_filtering=True,id=ee068b96-f361-4cb1-afeb-d3db42848f50,network=Network(8a494051-b597-47cd-8d64-76f0be5760cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee068b96-f3')
Nov 06 15:49:12 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T15:47:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1443965287',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1443965287',id=21,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG7VkOM3FinTlqOh/5i4bJAlF+JkumoM781rkezhqaf5pWO5EV6o0arddlLxKFWQuRwvULABugSP9UlkuYUV6t6klaf6mpKXNMFKyEPMHCLjo4xOIuyZf+KcTJP3JOed1A==',key_name='tempest-keypair-1747168088',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7944be2b6e2047f5a633242809f6f04e',ramdisk_id='',reservation_id='r-ozdn99kc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1041493160',owner_user_name='tempest-TaggedBootDevicesTest_v242-1041493160-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T15:47:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='65a31270ba05411aab57fe42295b1406',uuid=fdda34b5-280f-489d-baf5-bf21ac6dd6c9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7359ffbf-b953-480e-ae89-7ce5dda880a3", "address": "fa:16:3e:12:4b:11", "network": {"id": "e17a21e6-be31-4611-8f62-59327c8c4d9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1516543392", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7944be2b6e2047f5a633242809f6f04e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7359ffbf-b9", "ovs_interfaceid": "7359ffbf-b953-480e-ae89-7ce5dda880a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75337) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 15:49:12 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Converting VIF {"id": "7359ffbf-b953-480e-ae89-7ce5dda880a3", "address": "fa:16:3e:12:4b:11", "network": {"id": "e17a21e6-be31-4611-8f62-59327c8c4d9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1516543392", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7944be2b6e2047f5a633242809f6f04e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7359ffbf-b9", "ovs_interfaceid": "7359ffbf-b953-480e-ae89-7ce5dda880a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 15:49:12 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:4b:11,bridge_name='br-int',has_traffic_filtering=True,id=7359ffbf-b953-480e-ae89-7ce5dda880a3,network=Network(e17a21e6-be31-4611-8f62-59327c8c4d9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7359ffbf-b9') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 15:49:12 user nova-compute[75337]: DEBUG os_vif [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:4b:11,bridge_name='br-int',has_traffic_filtering=True,id=7359ffbf-b953-480e-ae89-7ce5dda880a3,network=Network(e17a21e6-be31-4611-8f62-59327c8c4d9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7359ffbf-b9') {{(pid=75337) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 15:49:12 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:12 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:49:12 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 15:49:12 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:12 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '35eed695-e845-5119-9b61-0c6dd323bad6', '_type': 'linux-noop'}}, row=False) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:49:12 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:12 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:49:12 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:12 user nova-compute[75337]: DEBUG nova.compute.manager [req-912235bd-c0b0-43ea-ab7f-e6f6ae60d7ba req-dcf9fa86-a071-460a-9681-4d03c590e58b service nova] [instance: 493eff79-294e-4259-a6d0-4772c4b45013] Received event network-changed-5e620284-83c1-40a8-91a5-c6b2c8c87a19 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:49:12 user nova-compute[75337]: DEBUG nova.compute.manager [req-912235bd-c0b0-43ea-ab7f-e6f6ae60d7ba req-dcf9fa86-a071-460a-9681-4d03c590e58b service nova] [instance: 493eff79-294e-4259-a6d0-4772c4b45013] Refreshing instance network info cache due to event network-changed-5e620284-83c1-40a8-91a5-c6b2c8c87a19. {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 15:49:12 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-912235bd-c0b0-43ea-ab7f-e6f6ae60d7ba req-dcf9fa86-a071-460a-9681-4d03c590e58b service nova] Acquiring lock "refresh_cache-493eff79-294e-4259-a6d0-4772c4b45013" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 15:49:12 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:12 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7359ffbf-b9, may_exist=True, interface_attrs={}) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:49:12 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7359ffbf-b9, col_values=(('qos', UUID('c5a41bf0-b8b4-4d0b-bfc7-bda9e977c9e2')),), if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:49:12 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7359ffbf-b9, col_values=(('external_ids', {'iface-id': '7359ffbf-b953-480e-ae89-7ce5dda880a3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:12:4b:11', 'vm-uuid': 'fdda34b5-280f-489d-baf5-bf21ac6dd6c9'}),), if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:49:12 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:12 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:49:12 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:12 user nova-compute[75337]: INFO os_vif [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:4b:11,bridge_name='br-int',has_traffic_filtering=True,id=7359ffbf-b953-480e-ae89-7ce5dda880a3,network=Network(e17a21e6-be31-4611-8f62-59327c8c4d9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7359ffbf-b9')
Nov 06 15:49:12 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T15:47:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1443965287',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1443965287',id=21,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG7VkOM3FinTlqOh/5i4bJAlF+JkumoM781rkezhqaf5pWO5EV6o0arddlLxKFWQuRwvULABugSP9UlkuYUV6t6klaf6mpKXNMFKyEPMHCLjo4xOIuyZf+KcTJP3JOed1A==',key_name='tempest-keypair-1747168088',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7944be2b6e2047f5a633242809f6f04e',ramdisk_id='',reservation_id='r-ozdn99kc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1041493160',owner_user_name='tempest-TaggedBootDevicesTest_v242-1041493160-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T15:47:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='65a31270ba05411aab57fe42295b1406',uuid=fdda34b5-280f-489d-baf5-bf21ac6dd6c9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0184ea76-40a1-41f4-9a6f-e2ca6719b7ab", "address": "fa:16:3e:3b:f7:32", "network": {"id": "e17a21e6-be31-4611-8f62-59327c8c4d9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1516543392", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7944be2b6e2047f5a633242809f6f04e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0184ea76-40", "ovs_interfaceid": "0184ea76-40a1-41f4-9a6f-e2ca6719b7ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75337) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 15:49:12 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Converting VIF {"id": "0184ea76-40a1-41f4-9a6f-e2ca6719b7ab", "address": "fa:16:3e:3b:f7:32", "network": {"id": "e17a21e6-be31-4611-8f62-59327c8c4d9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1516543392", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7944be2b6e2047f5a633242809f6f04e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0184ea76-40", "ovs_interfaceid": "0184ea76-40a1-41f4-9a6f-e2ca6719b7ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 15:49:12 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:f7:32,bridge_name='br-int',has_traffic_filtering=True,id=0184ea76-40a1-41f4-9a6f-e2ca6719b7ab,network=Network(e17a21e6-be31-4611-8f62-59327c8c4d9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0184ea76-40') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 15:49:12 user nova-compute[75337]: DEBUG os_vif [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:f7:32,bridge_name='br-int',has_traffic_filtering=True,id=0184ea76-40a1-41f4-9a6f-e2ca6719b7ab,network=Network(e17a21e6-be31-4611-8f62-59327c8c4d9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0184ea76-40') {{(pid=75337) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 15:49:12 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:12 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:49:12 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 15:49:12 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:12 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '23bc5819-2e8b-5a2b-aa1d-15c13c3350d2', '_type': 'linux-noop'}}, row=False) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:49:12 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:49:12 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:12 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:12 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0184ea76-40, may_exist=True, interface_attrs={}) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:49:12 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0184ea76-40, col_values=(('qos', UUID('483dac13-6887-4533-9847-0c4c7d906082')),), if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:49:12 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0184ea76-40, col_values=(('external_ids', {'iface-id': '0184ea76-40a1-41f4-9a6f-e2ca6719b7ab', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3b:f7:32', 'vm-uuid': 'fdda34b5-280f-489d-baf5-bf21ac6dd6c9'}),), if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:49:12 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:12 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:49:12 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-d09c878c-6e19-419d-9276-e42c6645f9f3 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7ececa5-256f-4a5d-aeda-3d2ee5c01cfe/disk --force-share --output=json -f qcow2 {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:13 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:13 user nova-compute[75337]: INFO os_vif [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:f7:32,bridge_name='br-int',has_traffic_filtering=True,id=0184ea76-40a1-41f4-9a6f-e2ca6719b7ab,network=Network(e17a21e6-be31-4611-8f62-59327c8c4d9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0184ea76-40')
Nov 06 15:49:13 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T15:47:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1443965287',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1443965287',id=21,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG7VkOM3FinTlqOh/5i4bJAlF+JkumoM781rkezhqaf5pWO5EV6o0arddlLxKFWQuRwvULABugSP9UlkuYUV6t6klaf6mpKXNMFKyEPMHCLjo4xOIuyZf+KcTJP3JOed1A==',key_name='tempest-keypair-1747168088',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7944be2b6e2047f5a633242809f6f04e',ramdisk_id='',reservation_id='r-ozdn99kc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1041493160',owner_user_name='tempest-TaggedBootDevicesTest_v242-1041493160-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T15:47:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='65a31270ba05411aab57fe42295b1406',uuid=fdda34b5-280f-489d-baf5-bf21ac6dd6c9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "38a409f9-0fb9-4505-9f74-bf2859e6f66c", "address": "fa:16:3e:8a:6f:5e", "network": {"id": "e17a21e6-be31-4611-8f62-59327c8c4d9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1516543392", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.115", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7944be2b6e2047f5a633242809f6f04e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38a409f9-0f", "ovs_interfaceid": "38a409f9-0fb9-4505-9f74-bf2859e6f66c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 15:49:13 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Converting VIF {"id": "38a409f9-0fb9-4505-9f74-bf2859e6f66c", "address": "fa:16:3e:8a:6f:5e", "network": {"id": "e17a21e6-be31-4611-8f62-59327c8c4d9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1516543392", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.115", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7944be2b6e2047f5a633242809f6f04e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38a409f9-0f", "ovs_interfaceid": "38a409f9-0fb9-4505-9f74-bf2859e6f66c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 15:49:13 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:6f:5e,bridge_name='br-int',has_traffic_filtering=True,id=38a409f9-0fb9-4505-9f74-bf2859e6f66c,network=Network(e17a21e6-be31-4611-8f62-59327c8c4d9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38a409f9-0f') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 15:49:13 user nova-compute[75337]: DEBUG os_vif [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:6f:5e,bridge_name='br-int',has_traffic_filtering=True,id=38a409f9-0fb9-4505-9f74-bf2859e6f66c,network=Network(e17a21e6-be31-4611-8f62-59327c8c4d9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38a409f9-0f') {{(pid=75337) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 15:49:13 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:13 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:49:13 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 15:49:13 user nova-compute[75337]: INFO nova.virt.libvirt.driver [-] [instance: afa4e52b-af51-45bf-b619-aeca14e7724d] Instance destroyed successfully.
Nov 06 15:49:13 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c05e62de-0cab-45f4-bdae-03cecf76da51 tempest-TestVolumeSwap-916912695 tempest-TestVolumeSwap-916912695-project-admin] [instance: 9125364b-332f-4297-815f-3aa1eadaf743] calling os-brick to detach iSCSI Volume {{(pid=75337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 15:49:13 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c05e62de-0cab-45f4-bdae-03cecf76da51 tempest-TestVolumeSwap-916912695 tempest-TestVolumeSwap-916912695-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2abc33d0c0>, {'target_iqn': 'iqn.2010-10.org.openstack:b1421f55-d453-441d-bdf7-3743102662b6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vVbIPGuJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'volume_id': 'b1421f55-d453-441d-bdf7-3743102662b6'}, None), 'kwargs': False}}" {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 15:49:13 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-c05e62de-0cab-45f4-bdae-03cecf76da51 tempest-TestVolumeSwap-916912695 tempest-TestVolumeSwap-916912695-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 15:49:13 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-c05e62de-0cab-45f4-bdae-03cecf76da51 tempest-TestVolumeSwap-916912695 tempest-TestVolumeSwap-916912695-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 15:49:13 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-c05e62de-0cab-45f4-bdae-03cecf76da51 tempest-TestVolumeSwap-916912695 tempest-TestVolumeSwap-916912695-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 15:49:13 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:13 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:13 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4d71597c-d999-58d6-91ad-43f94d35f3b3', '_type': 'linux-noop'}}, row=False) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:49:13 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:13 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:49:13 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.031s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:49:13 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[81b7bbff-05e5-4816-b928-c1206b149f25]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b1421f55-d453-441d-bdf7-3743102662b6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1bebbb46-2250-4511-ba59-f4ce67e0b45d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:563526a2-6204-4264-91b7-041e6cadab23\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dc5eae50-0461-47ca-bc48-cb38087b06e0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:06631b49-02a1-4759-8d9b-22b7ebdaa584\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4954683e-297c-4bed-94c9-675adb40fb66\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0c5fa35a-1ba5-4390-9102-83ac1dbb790a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:49:13 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c05e62de-0cab-45f4-bdae-03cecf76da51 tempest-TestVolumeSwap-916912695 tempest-TestVolumeSwap-916912695-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 15:49:13 user nova-compute[75337]: No targets found.
Nov 06 15:49:13 user nova-compute[75337]: iSNS:
Nov 06 15:49:13 user nova-compute[75337]: No targets found.
Nov 06 15:49:13 user nova-compute[75337]: STATIC:
Nov 06 15:49:13 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:b1421f55-d453-441d-bdf7-3743102662b6
Nov 06 15:49:13 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 15:49:13 user nova-compute[75337]:                 Iface Name: default
Nov 06 15:49:13 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:1bebbb46-2250-4511-ba59-f4ce67e0b45d
Nov 06 15:49:13 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 15:49:13 user nova-compute[75337]:                 Iface Name: default
Nov 06 15:49:13 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158
Nov 06 15:49:13 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 15:49:13 user nova-compute[75337]:                 Iface Name: default
Nov 06 15:49:13 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:563526a2-6204-4264-91b7-041e6cadab23
Nov 06 15:49:13 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 15:49:13 user nova-compute[75337]:                 Iface Name: default
Nov 06 15:49:13 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:dc5eae50-0461-47ca-bc48-cb38087b06e0
Nov 06 15:49:13 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 15:49:13 user nova-compute[75337]:                 Iface Name: default
Nov 06 15:49:13 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6
Nov 06 15:49:13 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 15:49:13 user nova-compute[75337]:                 Iface Name: default
Nov 06 15:49:13 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:06631b49-02a1-4759-8d9b-22b7ebdaa584
Nov 06 15:49:13 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 15:49:13 user nova-compute[75337]:                 Iface Name: default
Nov 06 15:49:13 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:4954683e-297c-4bed-94c9-675adb40fb66
Nov 06 15:49:13 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 15:49:13 user nova-compute[75337]:                 Iface Name: default
Nov 06 15:49:13 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:0c5fa35a-1ba5-4390-9102-83ac1dbb790a
Nov 06 15:49:13 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 15:49:13 user nova-compute[75337]:                 Iface Name: default
Nov 06 15:49:13 user nova-compute[75337]: FIRMWARE:
Nov 06 15:49:13 user nova-compute[75337]: No targets found.
Nov 06 15:49:13 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 15:49:13 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c05e62de-0cab-45f4-bdae-03cecf76da51 tempest-TestVolumeSwap-916912695 tempest-TestVolumeSwap-916912695-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 15:49:13 user nova-compute[75337]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 15:49:13 user nova-compute[75337]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75337) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 15:49:13 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c05e62de-0cab-45f4-bdae-03cecf76da51 tempest-TestVolumeSwap-916912695 tempest-TestVolumeSwap-916912695-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b1421f55-d453-441d-bdf7-3743102662b6', 0)] {{(pid=75337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 15:49:13 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:13 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:13 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:49:13 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb148d46-bb87-4d9e-a201-da7aa80eb201]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:06631b49-02a1-4759-8d9b-22b7ebdaa584\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c5fa35a-1ba5-4390-9102-83ac1dbb790a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1bebbb46-2250-4511-ba59-f4ce67e0b45d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4954683e-297c-4bed-94c9-675adb40fb66\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:563526a2-6204-4264-91b7-041e6cadab23\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b1421f55-d453-441d-bdf7-3743102662b6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dc5eae50-0461-47ca-bc48-cb38087b06e0\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:49:13 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:13 user nova-compute[75337]: DEBUG nova.network.neutron [None req-13d17865-491a-490f-b016-5c740d02f100 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 493eff79-294e-4259-a6d0-4772c4b45013] Updating instance_info_cache with network_info: [{"id": "5e620284-83c1-40a8-91a5-c6b2c8c87a19", "address": "fa:16:3e:09:f0:4b", "network": {"id": "4e47319f-de1d-4dfe-9915-7d2d5131704d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-895093240-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "915211c6a2734c36b34ff92a56b085f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e620284-83", "ovs_interfaceid": "5e620284-83c1-40a8-91a5-c6b2c8c87a19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:49:13 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:13 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap38a409f9-0f, may_exist=True, interface_attrs={}) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:49:13 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap38a409f9-0f, col_values=(('qos', UUID('832cc33c-eaee-4cc2-a698-f4e08423539d')),), if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:49:13 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap38a409f9-0f, col_values=(('external_ids', {'iface-id': '38a409f9-0fb9-4505-9f74-bf2859e6f66c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8a:6f:5e', 'vm-uuid': 'fdda34b5-280f-489d-baf5-bf21ac6dd6c9'}),), if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:49:13 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:13 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:49:13 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-b4c03605-9a5f-458d-b11b-3747919bdc6a tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] [instance: afa4e52b-af51-45bf-b619-aeca14e7724d] Beginning cold snapshot process
Nov 06 15:49:13 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-13d17865-491a-490f-b016-5c740d02f100 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Releasing lock "refresh_cache-493eff79-294e-4259-a6d0-4772c4b45013" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 15:49:13 user nova-compute[75337]: DEBUG nova.compute.manager [None req-13d17865-491a-490f-b016-5c740d02f100 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 493eff79-294e-4259-a6d0-4772c4b45013] Instance network_info: |[{"id": "5e620284-83c1-40a8-91a5-c6b2c8c87a19", "address": "fa:16:3e:09:f0:4b", "network": {"id": "4e47319f-de1d-4dfe-9915-7d2d5131704d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-895093240-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "915211c6a2734c36b34ff92a56b085f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e620284-83", "ovs_interfaceid": "5e620284-83c1-40a8-91a5-c6b2c8c87a19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 15:49:13 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-912235bd-c0b0-43ea-ab7f-e6f6ae60d7ba req-dcf9fa86-a071-460a-9681-4d03c590e58b service nova] Acquired lock "refresh_cache-493eff79-294e-4259-a6d0-4772c4b45013" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 15:49:13 user nova-compute[75337]: DEBUG nova.network.neutron [req-912235bd-c0b0-43ea-ab7f-e6f6ae60d7ba req-dcf9fa86-a071-460a-9681-4d03c590e58b service nova] [instance: 493eff79-294e-4259-a6d0-4772c4b45013] Refreshing network info cache for port 5e620284-83c1-40a8-91a5-c6b2c8c87a19 {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 15:49:13 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:49:13 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad3ede0e-b024-46b4-83d1-e8d73a0275d4]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1421f55-d453-441d-bdf7-3743102662b6 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4954683e-297c-4bed-94c9-675adb40fb66 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06631b49-02a1-4759-8d9b-22b7ebdaa584 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c5fa35a-1ba5-4390-9102-83ac1dbb790a (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:563526a2-6204-4264-91b7-041e6cadab23 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc5eae50-0461-47ca-bc48-cb38087b06e0 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bebbb46-2250-4511-ba59-f4ce67e0b45d (non-flash)\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:49:13 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c05e62de-0cab-45f4-bdae-03cecf76da51 tempest-TestVolumeSwap-916912695 tempest-TestVolumeSwap-916912695-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)
Nov 06 15:49:13 user nova-compute[75337]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1421f55-d453-441d-bdf7-3743102662b6 (non-flash)
Nov 06 15:49:13 user nova-compute[75337]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6 (non-flash)
Nov 06 15:49:13 user nova-compute[75337]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4954683e-297c-4bed-94c9-675adb40fb66 (non-flash)
Nov 06 15:49:13 user nova-compute[75337]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06631b49-02a1-4759-8d9b-22b7ebdaa584 (non-flash)
Nov 06 15:49:13 user nova-compute[75337]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c5fa35a-1ba5-4390-9102-83ac1dbb790a (non-flash)
Nov 06 15:49:13 user nova-compute[75337]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:563526a2-6204-4264-91b7-041e6cadab23 (non-flash)
Nov 06 15:49:13 user nova-compute[75337]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc5eae50-0461-47ca-bc48-cb38087b06e0 (non-flash)
Nov 06 15:49:13 user nova-compute[75337]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bebbb46-2250-4511-ba59-f4ce67e0b45d (non-flash)
Nov 06 15:49:13 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 15:49:13 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c05e62de-0cab-45f4-bdae-03cecf76da51 tempest-TestVolumeSwap-916912695 tempest-TestVolumeSwap-916912695-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)
Nov 06 15:49:13 user nova-compute[75337]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1421f55-d453-441d-bdf7-3743102662b6 (non-flash)
Nov 06 15:49:13 user nova-compute[75337]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6 (non-flash)
Nov 06 15:49:13 user nova-compute[75337]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4954683e-297c-4bed-94c9-675adb40fb66 (non-flash)
Nov 06 15:49:13 user nova-compute[75337]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06631b49-02a1-4759-8d9b-22b7ebdaa584 (non-flash)
Nov 06 15:49:13 user nova-compute[75337]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c5fa35a-1ba5-4390-9102-83ac1dbb790a (non-flash)
Nov 06 15:49:13 user nova-compute[75337]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:563526a2-6204-4264-91b7-041e6cadab23 (non-flash)
Nov 06 15:49:13 user nova-compute[75337]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc5eae50-0461-47ca-bc48-cb38087b06e0 (non-flash)
Nov 06 15:49:13 user nova-compute[75337]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bebbb46-2250-4511-ba59-f4ce67e0b45d (non-flash)
Nov 06 15:49:13 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 15:49:13 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c05e62de-0cab-45f4-bdae-03cecf76da51 tempest-TestVolumeSwap-916912695 tempest-TestVolumeSwap-916912695-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2a9c5ddfc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b1421f55-d453-441d-bdf7-3743102662b6'): ({'sdb'}, set())}) {{(pid=75337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 15:49:13 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-c05e62de-0cab-45f4-bdae-03cecf76da51 tempest-TestVolumeSwap-916912695 tempest-TestVolumeSwap-916912695-project-admin] Removing single pathed devices sdb {{(pid=75337) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 15:49:13 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:13 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:13 user nova-compute[75337]: INFO os_vif [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:6f:5e,bridge_name='br-int',has_traffic_filtering=True,id=38a409f9-0fb9-4505-9f74-bf2859e6f66c,network=Network(e17a21e6-be31-4611-8f62-59327c8c4d9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38a409f9-0f')
Nov 06 15:49:13 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T15:47:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1443965287',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1443965287',id=21,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG7VkOM3FinTlqOh/5i4bJAlF+JkumoM781rkezhqaf5pWO5EV6o0arddlLxKFWQuRwvULABugSP9UlkuYUV6t6klaf6mpKXNMFKyEPMHCLjo4xOIuyZf+KcTJP3JOed1A==',key_name='tempest-keypair-1747168088',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7944be2b6e2047f5a633242809f6f04e',ramdisk_id='',reservation_id='r-ozdn99kc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1041493160',owner_user_name='tempest-TaggedBootDevicesTest_v242-1041493160-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T15:47:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='65a31270ba05411aab57fe42295b1406',uuid=fdda34b5-280f-489d-baf5-bf21ac6dd6c9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d86aca21-e67b-48e9-b8de-a1d618a5dfc7", "address": "fa:16:3e:bf:c2:bd", "network": {"id": "e17a21e6-be31-4611-8f62-59327c8c4d9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1516543392", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.131", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7944be2b6e2047f5a633242809f6f04e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd86aca21-e6", "ovs_interfaceid": "d86aca21-e67b-48e9-b8de-a1d618a5dfc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 15:49:13 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Converting VIF {"id": "d86aca21-e67b-48e9-b8de-a1d618a5dfc7", "address": "fa:16:3e:bf:c2:bd", "network": {"id": "e17a21e6-be31-4611-8f62-59327c8c4d9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1516543392", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.131", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7944be2b6e2047f5a633242809f6f04e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd86aca21-e6", "ovs_interfaceid": "d86aca21-e67b-48e9-b8de-a1d618a5dfc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 15:49:13 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:c2:bd,bridge_name='br-int',has_traffic_filtering=True,id=d86aca21-e67b-48e9-b8de-a1d618a5dfc7,network=Network(e17a21e6-be31-4611-8f62-59327c8c4d9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd86aca21-e6') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 15:49:13 user nova-compute[75337]: DEBUG os_vif [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:c2:bd,bridge_name='br-int',has_traffic_filtering=True,id=d86aca21-e67b-48e9-b8de-a1d618a5dfc7,network=Network(e17a21e6-be31-4611-8f62-59327c8c4d9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd86aca21-e6') {{(pid=75337) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 15:49:13 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:13 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:49:13 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 15:49:13 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-d09c878c-6e19-419d-9276-e42c6645f9f3 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7ececa5-256f-4a5d-aeda-3d2ee5c01cfe/disk --force-share --output=json -f qcow2" returned: 0 in 0.233s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:49:13 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-d09c878c-6e19-419d-9276-e42c6645f9f3 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7ececa5-256f-4a5d-aeda-3d2ee5c01cfe/disk --force-share --output=json -f qcow2 {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:13 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:13 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e31c13ff-e8e8-5000-bcb6-49cbed1871a3', '_type': 'linux-noop'}}, row=False) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:49:13 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:49:13 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[30285b13-3dd1-47b5-95cc-eeac8fe318aa]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:49:13 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:13 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:13 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:49:13 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.025s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:49:13 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e70afe8-80d4-4472-abc9-3a9c3f38ba74]: (4, ('ok\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:49:13 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-c05e62de-0cab-45f4-bdae-03cecf76da51 tempest-TestVolumeSwap-916912695 tempest-TestVolumeSwap-916912695-project-admin] Flushing IO for device /dev/sdb {{(pid=75337) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 15:49:13 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:13 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:13 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.025s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:49:13 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[36fd2a7f-acd8-4e82-8521-4bb901e577c4]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:49:13 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:13 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd86aca21-e6, may_exist=True, interface_attrs={}) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:49:13 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd86aca21-e6, col_values=(('qos', UUID('169f458b-e646-4ce3-ba8d-17ca327c4773')),), if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:49:13 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd86aca21-e6, col_values=(('external_ids', {'iface-id': 'd86aca21-e67b-48e9-b8de-a1d618a5dfc7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bf:c2:bd', 'vm-uuid': 'fdda34b5-280f-489d-baf5-bf21ac6dd6c9'}),), if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:49:13 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-c05e62de-0cab-45f4-bdae-03cecf76da51 tempest-TestVolumeSwap-916912695 tempest-TestVolumeSwap-916912695-project-admin] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75337) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 15:49:13 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:13 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:13 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:49:13 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:49:13 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3dcd814-cd98-4e62-a8af-d24e87094c4a]: (4, ('1', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:49:13 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-c05e62de-0cab-45f4-bdae-03cecf76da51 tempest-TestVolumeSwap-916912695 tempest-TestVolumeSwap-916912695-project-admin] Checking to see if SCSI volumes sdb have been removed. {{(pid=75337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 15:49:13 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-c05e62de-0cab-45f4-bdae-03cecf76da51 tempest-TestVolumeSwap-916912695 tempest-TestVolumeSwap-916912695-project-admin] SCSI volumes sdb have been removed. {{(pid=75337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 15:49:13 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c05e62de-0cab-45f4-bdae-03cecf76da51 tempest-TestVolumeSwap-916912695 tempest-TestVolumeSwap-916912695-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b1421f55-d453-441d-bdf7-3743102662b6')] {{(pid=75337) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 15:49:13 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1421f55-d453-441d-bdf7-3743102662b6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:13 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:13 user nova-compute[75337]: INFO os_vif [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:c2:bd,bridge_name='br-int',has_traffic_filtering=True,id=d86aca21-e67b-48e9-b8de-a1d618a5dfc7,network=Network(e17a21e6-be31-4611-8f62-59327c8c4d9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd86aca21-e6')
Nov 06 15:49:13 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T15:47:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1443965287',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1443965287',id=21,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG7VkOM3FinTlqOh/5i4bJAlF+JkumoM781rkezhqaf5pWO5EV6o0arddlLxKFWQuRwvULABugSP9UlkuYUV6t6klaf6mpKXNMFKyEPMHCLjo4xOIuyZf+KcTJP3JOed1A==',key_name='tempest-keypair-1747168088',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7944be2b6e2047f5a633242809f6f04e',ramdisk_id='',reservation_id='r-ozdn99kc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1041493160',owner_user_name='tempest-TaggedBootDevicesTest_v242-1041493160-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T15:47:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='65a31270ba05411aab57fe42295b1406',uuid=fdda34b5-280f-489d-baf5-bf21ac6dd6c9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4c56104b-528f-40b8-931d-7619e413ab07", "address": "fa:16:3e:4d:d7:97", "network": {"id": "00ad9466-de22-4eb1-86c7-01667b94d2a9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1660110834", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7944be2b6e2047f5a633242809f6f04e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c56104b-52", "ovs_interfaceid": "4c56104b-528f-40b8-931d-7619e413ab07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 15:49:13 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Converting VIF {"id": "4c56104b-528f-40b8-931d-7619e413ab07", "address": "fa:16:3e:4d:d7:97", "network": {"id": "00ad9466-de22-4eb1-86c7-01667b94d2a9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1660110834", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7944be2b6e2047f5a633242809f6f04e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c56104b-52", "ovs_interfaceid": "4c56104b-528f-40b8-931d-7619e413ab07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 15:49:13 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:d7:97,bridge_name='br-int',has_traffic_filtering=True,id=4c56104b-528f-40b8-931d-7619e413ab07,network=Network(00ad9466-de22-4eb1-86c7-01667b94d2a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c56104b-52') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 15:49:13 user nova-compute[75337]: DEBUG os_vif [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:d7:97,bridge_name='br-int',has_traffic_filtering=True,id=4c56104b-528f-40b8-931d-7619e413ab07,network=Network(00ad9466-de22-4eb1-86c7-01667b94d2a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c56104b-52') {{(pid=75337) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 15:49:13 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:13 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:49:13 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 15:49:13 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:13 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '612ad151-5061-5280-9b64-06a86d5b7e4c', '_type': 'linux-noop'}}, row=False) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:49:13 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:49:13 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1421f55-d453-441d-bdf7-3743102662b6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:49:13 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bcd0d4e-f09b-4c3d-acc5-a19578e154a4]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:49:13 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c05e62de-0cab-45f4-bdae-03cecf76da51 tempest-TestVolumeSwap-916912695 tempest-TestVolumeSwap-916912695-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:49:13 user nova-compute[75337]: DEBUG nova.privsep.utils [None req-b4c03605-9a5f-458d-b11b-3747919bdc6a tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75337) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 06 15:49:13 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-b4c03605-9a5f-458d-b11b-3747919bdc6a tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/afa4e52b-af51-45bf-b619-aeca14e7724d/disk /opt/stack/data/nova/instances/snapshots/tmpu1xzjws3/232d88ccaba342f8ab27872b61a5be74 {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:13 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1421f55-d453-441d-bdf7-3743102662b6 -p 172.16.0.220:3260 --logout {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:13 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:13 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-d09c878c-6e19-419d-9276-e42c6645f9f3 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7ececa5-256f-4a5d-aeda-3d2ee5c01cfe/disk --force-share --output=json -f qcow2" returned: 0 in 0.293s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:49:13 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-d09c878c-6e19-419d-9276-e42c6645f9f3 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:13 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:13 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4c56104b-52, may_exist=True, interface_attrs={}) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:49:13 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4c56104b-52, col_values=(('qos', UUID('dc0ab635-e7c6-4b0f-85ee-7531e37e0810')),), if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:49:13 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4c56104b-52, col_values=(('external_ids', {'iface-id': '4c56104b-528f-40b8-931d-7619e413ab07', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4d:d7:97', 'vm-uuid': 'fdda34b5-280f-489d-baf5-bf21ac6dd6c9'}),), if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:49:13 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1421f55-d453-441d-bdf7-3743102662b6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.162s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:49:13 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[49aa9b25-527c-40ab-beb5-26a9b551b441]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:b1421f55-d453-441d-bdf7-3743102662b6, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:b1421f55-d453-441d-bdf7-3743102662b6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:49:13 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:49:13 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c05e62de-0cab-45f4-bdae-03cecf76da51 tempest-TestVolumeSwap-916912695 tempest-TestVolumeSwap-916912695-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:b1421f55-d453-441d-bdf7-3743102662b6, portal: 172.16.0.220,3260]
Nov 06 15:49:13 user nova-compute[75337]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:b1421f55-d453-441d-bdf7-3743102662b6, portal: 172.16.0.220,3260] successful.
Nov 06 15:49:13 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:49:13 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1421f55-d453-441d-bdf7-3743102662b6 -p 172.16.0.220:3260 --op delete {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:13 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1421f55-d453-441d-bdf7-3743102662b6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.054s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:49:13 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ee30ee5-f410-43ad-b1ec-dcbff828bd5d]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:49:13 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c05e62de-0cab-45f4-bdae-03cecf76da51 tempest-TestVolumeSwap-916912695 tempest-TestVolumeSwap-916912695-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:49:13 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-c05e62de-0cab-45f4-bdae-03cecf76da51 tempest-TestVolumeSwap-916912695 tempest-TestVolumeSwap-916912695-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.609s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 15:49:13 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c05e62de-0cab-45f4-bdae-03cecf76da51 tempest-TestVolumeSwap-916912695 tempest-TestVolumeSwap-916912695-project-admin] <== disconnect_volume: return (611ms) None {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 15:49:13 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c05e62de-0cab-45f4-bdae-03cecf76da51 tempest-TestVolumeSwap-916912695 tempest-TestVolumeSwap-916912695-project-admin] [instance: 9125364b-332f-4297-815f-3aa1eadaf743] Disconnected iSCSI Volume {{(pid=75337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 15:49:13 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:13 user nova-compute[75337]: INFO os_vif [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:d7:97,bridge_name='br-int',has_traffic_filtering=True,id=4c56104b-528f-40b8-931d-7619e413ab07,network=Network(00ad9466-de22-4eb1-86c7-01667b94d2a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c56104b-52')
Nov 06 15:49:13 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T15:47:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1443965287',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1443965287',id=21,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG7VkOM3FinTlqOh/5i4bJAlF+JkumoM781rkezhqaf5pWO5EV6o0arddlLxKFWQuRwvULABugSP9UlkuYUV6t6klaf6mpKXNMFKyEPMHCLjo4xOIuyZf+KcTJP3JOed1A==',key_name='tempest-keypair-1747168088',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7944be2b6e2047f5a633242809f6f04e',ramdisk_id='',reservation_id='r-ozdn99kc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1041493160',owner_user_name='tempest-TaggedBootDevicesTest_v242-1041493160-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T15:47:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='65a31270ba05411aab57fe42295b1406',uuid=fdda34b5-280f-489d-baf5-bf21ac6dd6c9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "996e784d-bbe6-447b-8f1f-066ec34be989", "address": "fa:16:3e:41:c0:e2", "network": {"id": "00ad9466-de22-4eb1-86c7-01667b94d2a9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1660110834", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7944be2b6e2047f5a633242809f6f04e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap996e784d-bb", "ovs_interfaceid": "996e784d-bbe6-447b-8f1f-066ec34be989", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 15:49:13 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Converting VIF {"id": "996e784d-bbe6-447b-8f1f-066ec34be989", "address": "fa:16:3e:41:c0:e2", "network": {"id": "00ad9466-de22-4eb1-86c7-01667b94d2a9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1660110834", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7944be2b6e2047f5a633242809f6f04e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap996e784d-bb", "ovs_interfaceid": "996e784d-bbe6-447b-8f1f-066ec34be989", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 15:49:13 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:c0:e2,bridge_name='br-int',has_traffic_filtering=True,id=996e784d-bbe6-447b-8f1f-066ec34be989,network=Network(00ad9466-de22-4eb1-86c7-01667b94d2a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap996e784d-bb') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 15:49:13 user nova-compute[75337]: DEBUG os_vif [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:c0:e2,bridge_name='br-int',has_traffic_filtering=True,id=996e784d-bbe6-447b-8f1f-066ec34be989,network=Network(00ad9466-de22-4eb1-86c7-01667b94d2a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap996e784d-bb') {{(pid=75337) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 15:49:13 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:13 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:49:13 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 15:49:13 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:13 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd04459a0-3b66-512a-bde6-63d99deadbec', '_type': 'linux-noop'}}, row=False) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:49:13 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:13 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:49:13 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-d09c878c-6e19-419d-9276-e42c6645f9f3 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json" returned: 0 in 0.237s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:49:13 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-d09c878c-6e19-419d-9276-e42c6645f9f3 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpug52rb3c/70c14092ce914046a833a070586fa630.delta 1073741824 {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:13 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:13 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-d09c878c-6e19-419d-9276-e42c6645f9f3 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpug52rb3c/70c14092ce914046a833a070586fa630.delta 1073741824" returned: 0 in 0.098s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:49:13 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-d09c878c-6e19-419d-9276-e42c6645f9f3 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: b7ececa5-256f-4a5d-aeda-3d2ee5c01cfe] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 06 15:49:13 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:13 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap996e784d-bb, may_exist=True, interface_attrs={}) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:49:13 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap996e784d-bb, col_values=(('qos', UUID('ff7eb7b9-8eee-457f-aac5-6c808fda3b9f')),), if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:49:13 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap996e784d-bb, col_values=(('external_ids', {'iface-id': '996e784d-bbe6-447b-8f1f-066ec34be989', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:41:c0:e2', 'vm-uuid': 'fdda34b5-280f-489d-baf5-bf21ac6dd6c9'}),), if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:49:13 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:13 user nova-compute[75337]: DEBUG nova.compute.manager [None req-c05e62de-0cab-45f4-bdae-03cecf76da51 tempest-TestVolumeSwap-916912695 tempest-TestVolumeSwap-916912695-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0c5fa35a-1ba5-4390-9102-83ac1dbb790a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nkapcTJV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, 'status': 'reserved', 'instance': '9125364b-332f-4297-815f-3aa1eadaf743', 'attached_at': '', 'detached_at': '', 'volume_id': '0c5fa35a-1ba5-4390-9102-83ac1dbb790a', 'serial'} {{(pid=75337) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 06 15:49:13 user nova-compute[75337]: DEBUG nova.compute.manager [None req-c05e62de-0cab-45f4-bdae-03cecf76da51 tempest-TestVolumeSwap-916912695 tempest-TestVolumeSwap-916912695-project-admin] [instance: 9125364b-332f-4297-815f-3aa1eadaf743] swap_volume: removing Cinder connection for volume b1421f55-d453-441d-bdf7-3743102662b6 {{(pid=75337) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 06 15:49:13 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:49:14 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:14 user nova-compute[75337]: INFO os_vif [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:c0:e2,bridge_name='br-int',has_traffic_filtering=True,id=996e784d-bbe6-447b-8f1f-066ec34be989,network=Network(00ad9466-de22-4eb1-86c7-01667b94d2a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap996e784d-bb')
Nov 06 15:49:14 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:14 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] No BDM found with device name hda, not building metadata. {{(pid=75337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 15:49:14 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 15:49:14 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] No VIF found with MAC fa:16:3e:63:2a:18, not building metadata {{(pid=75337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 15:49:14 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] No VIF found with MAC fa:16:3e:bf:c2:bd, not building metadata {{(pid=75337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 15:49:14 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Using config drive
Nov 06 15:49:14 user nova-compute[75337]: DEBUG nova.network.neutron [req-912235bd-c0b0-43ea-ab7f-e6f6ae60d7ba req-dcf9fa86-a071-460a-9681-4d03c590e58b service nova] [instance: 493eff79-294e-4259-a6d0-4772c4b45013] Updated VIF entry in instance network info cache for port 5e620284-83c1-40a8-91a5-c6b2c8c87a19. {{(pid=75337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 15:49:14 user nova-compute[75337]: DEBUG nova.network.neutron [req-912235bd-c0b0-43ea-ab7f-e6f6ae60d7ba req-dcf9fa86-a071-460a-9681-4d03c590e58b service nova] [instance: 493eff79-294e-4259-a6d0-4772c4b45013] Updating instance_info_cache with network_info: [{"id": "5e620284-83c1-40a8-91a5-c6b2c8c87a19", "address": "fa:16:3e:09:f0:4b", "network": {"id": "4e47319f-de1d-4dfe-9915-7d2d5131704d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-895093240-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "915211c6a2734c36b34ff92a56b085f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e620284-83", "ovs_interfaceid": "5e620284-83c1-40a8-91a5-c6b2c8c87a19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:49:14 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-912235bd-c0b0-43ea-ab7f-e6f6ae60d7ba req-dcf9fa86-a071-460a-9681-4d03c590e58b service nova] Releasing lock "refresh_cache-493eff79-294e-4259-a6d0-4772c4b45013" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 15:49:14 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Creating config drive at /opt/stack/data/nova/instances/fdda34b5-280f-489d-baf5-bf21ac6dd6c9/disk.config
Nov 06 15:49:14 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/fdda34b5-280f-489d-baf5-bf21ac6dd6c9/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpvdhl9ido {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:14 user nova-compute[75337]: DEBUG nova.compute.manager [req-a229c93e-20f3-42b7-a1ec-5a0bffae18c5 req-9f2e50ab-7fd4-4b0b-adaf-378b505a423a service nova] [instance: afa4e52b-af51-45bf-b619-aeca14e7724d] Received event network-vif-plugged-d66c8fee-7efa-49a4-b9c3-2f7ad2ccc71b {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:49:14 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-a229c93e-20f3-42b7-a1ec-5a0bffae18c5 req-9f2e50ab-7fd4-4b0b-adaf-378b505a423a service nova] Acquiring lock "afa4e52b-af51-45bf-b619-aeca14e7724d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:49:14 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-a229c93e-20f3-42b7-a1ec-5a0bffae18c5 req-9f2e50ab-7fd4-4b0b-adaf-378b505a423a service nova] Lock "afa4e52b-af51-45bf-b619-aeca14e7724d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:49:14 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-a229c93e-20f3-42b7-a1ec-5a0bffae18c5 req-9f2e50ab-7fd4-4b0b-adaf-378b505a423a service nova] Lock "afa4e52b-af51-45bf-b619-aeca14e7724d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:49:14 user nova-compute[75337]: DEBUG nova.compute.manager [req-a229c93e-20f3-42b7-a1ec-5a0bffae18c5 req-9f2e50ab-7fd4-4b0b-adaf-378b505a423a service nova] [instance: afa4e52b-af51-45bf-b619-aeca14e7724d] No waiting events found dispatching network-vif-plugged-d66c8fee-7efa-49a4-b9c3-2f7ad2ccc71b {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:49:14 user nova-compute[75337]: WARNING nova.compute.manager [req-a229c93e-20f3-42b7-a1ec-5a0bffae18c5 req-9f2e50ab-7fd4-4b0b-adaf-378b505a423a service nova] [instance: afa4e52b-af51-45bf-b619-aeca14e7724d] Received unexpected event network-vif-plugged-d66c8fee-7efa-49a4-b9c3-2f7ad2ccc71b for instance with vm_state active and task_state shelving_image_pending_upload.
Nov 06 15:49:14 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/fdda34b5-280f-489d-baf5-bf21ac6dd6c9/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpvdhl9ido" returned: 0 in 0.129s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:49:14 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-b4c03605-9a5f-458d-b11b-3747919bdc6a tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/afa4e52b-af51-45bf-b619-aeca14e7724d/disk /opt/stack/data/nova/instances/snapshots/tmpu1xzjws3/232d88ccaba342f8ab27872b61a5be74" returned: 0 in 1.299s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:49:14 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-b4c03605-9a5f-458d-b11b-3747919bdc6a tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] [instance: afa4e52b-af51-45bf-b619-aeca14e7724d] Snapshot extracted, beginning image upload
Nov 06 15:49:14 user nova-compute[75337]: DEBUG nova.virt.libvirt.guest [None req-d09c878c-6e19-419d-9276-e42c6645f9f3 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75337) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 06 15:49:15 user nova-compute[75337]: DEBUG nova.virt.libvirt.guest [None req-d09c878c-6e19-419d-9276-e42c6645f9f3 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75337) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 06 15:49:15 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-d09c878c-6e19-419d-9276-e42c6645f9f3 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: b7ececa5-256f-4a5d-aeda-3d2ee5c01cfe] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 06 15:49:15 user nova-compute[75337]: DEBUG nova.privsep.utils [None req-d09c878c-6e19-419d-9276-e42c6645f9f3 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75337) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 06 15:49:15 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-d09c878c-6e19-419d-9276-e42c6645f9f3 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpug52rb3c/70c14092ce914046a833a070586fa630.delta /opt/stack/data/nova/instances/snapshots/tmpug52rb3c/70c14092ce914046a833a070586fa630 {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:16 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-d09c878c-6e19-419d-9276-e42c6645f9f3 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpug52rb3c/70c14092ce914046a833a070586fa630.delta /opt/stack/data/nova/instances/snapshots/tmpug52rb3c/70c14092ce914046a833a070586fa630" returned: 0 in 0.600s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:49:16 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-d09c878c-6e19-419d-9276-e42c6645f9f3 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: b7ececa5-256f-4a5d-aeda-3d2ee5c01cfe] Snapshot extracted, beginning image upload
Nov 06 15:49:16 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:16 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:16 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:16 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:16 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:16 user nova-compute[75337]: DEBUG nova.compute.manager [req-da87f48e-2302-4cec-850d-e33b86ea3c2c req-89f9cfcf-6711-459b-8373-92a39bcf2e09 service nova] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Received event network-vif-plugged-ee068b96-f361-4cb1-afeb-d3db42848f50 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:49:16 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-da87f48e-2302-4cec-850d-e33b86ea3c2c req-89f9cfcf-6711-459b-8373-92a39bcf2e09 service nova] Acquiring lock "fdda34b5-280f-489d-baf5-bf21ac6dd6c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:49:16 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-da87f48e-2302-4cec-850d-e33b86ea3c2c req-89f9cfcf-6711-459b-8373-92a39bcf2e09 service nova] Lock "fdda34b5-280f-489d-baf5-bf21ac6dd6c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:49:16 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-da87f48e-2302-4cec-850d-e33b86ea3c2c req-89f9cfcf-6711-459b-8373-92a39bcf2e09 service nova] Lock "fdda34b5-280f-489d-baf5-bf21ac6dd6c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:49:16 user nova-compute[75337]: DEBUG nova.compute.manager [req-da87f48e-2302-4cec-850d-e33b86ea3c2c req-89f9cfcf-6711-459b-8373-92a39bcf2e09 service nova] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] No waiting events found dispatching network-vif-plugged-ee068b96-f361-4cb1-afeb-d3db42848f50 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:49:16 user nova-compute[75337]: WARNING nova.compute.manager [req-da87f48e-2302-4cec-850d-e33b86ea3c2c req-89f9cfcf-6711-459b-8373-92a39bcf2e09 service nova] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Received unexpected event network-vif-plugged-ee068b96-f361-4cb1-afeb-d3db42848f50 for instance with vm_state building and task_state spawning.
Nov 06 15:49:16 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:17 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:17 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:17 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:17 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:17 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:17 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:17 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:17 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:17 user nova-compute[75337]: DEBUG nova.compute.manager [req-bd3b2191-9acc-4971-b060-363057e1fb58 req-d54325a2-4da8-4c1f-8e77-87882eca14ba service nova] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Received event network-vif-plugged-0184ea76-40a1-41f4-9a6f-e2ca6719b7ab {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:49:17 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-bd3b2191-9acc-4971-b060-363057e1fb58 req-d54325a2-4da8-4c1f-8e77-87882eca14ba service nova] Acquiring lock "fdda34b5-280f-489d-baf5-bf21ac6dd6c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:49:17 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-bd3b2191-9acc-4971-b060-363057e1fb58 req-d54325a2-4da8-4c1f-8e77-87882eca14ba service nova] Lock "fdda34b5-280f-489d-baf5-bf21ac6dd6c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:49:17 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-bd3b2191-9acc-4971-b060-363057e1fb58 req-d54325a2-4da8-4c1f-8e77-87882eca14ba service nova] Lock "fdda34b5-280f-489d-baf5-bf21ac6dd6c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:49:17 user nova-compute[75337]: DEBUG nova.compute.manager [req-bd3b2191-9acc-4971-b060-363057e1fb58 req-d54325a2-4da8-4c1f-8e77-87882eca14ba service nova] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] No waiting events found dispatching network-vif-plugged-0184ea76-40a1-41f4-9a6f-e2ca6719b7ab {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:49:17 user nova-compute[75337]: WARNING nova.compute.manager [req-bd3b2191-9acc-4971-b060-363057e1fb58 req-d54325a2-4da8-4c1f-8e77-87882eca14ba service nova] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Received unexpected event network-vif-plugged-0184ea76-40a1-41f4-9a6f-e2ca6719b7ab for instance with vm_state building and task_state spawning.
Nov 06 15:49:17 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:17 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:17 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:17 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:18 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:18 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:18 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:18 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:18 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:18 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:18 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:18 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:18 user nova-compute[75337]: DEBUG nova.compute.manager [req-9358d834-1633-412e-b22f-36ae7e8581c8 req-2cb20c3f-1da8-4822-a28c-7e21cfc39344 service nova] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Received event network-vif-plugged-d86aca21-e67b-48e9-b8de-a1d618a5dfc7 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:49:18 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-9358d834-1633-412e-b22f-36ae7e8581c8 req-2cb20c3f-1da8-4822-a28c-7e21cfc39344 service nova] Acquiring lock "fdda34b5-280f-489d-baf5-bf21ac6dd6c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:49:18 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-9358d834-1633-412e-b22f-36ae7e8581c8 req-2cb20c3f-1da8-4822-a28c-7e21cfc39344 service nova] Lock "fdda34b5-280f-489d-baf5-bf21ac6dd6c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:49:18 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-9358d834-1633-412e-b22f-36ae7e8581c8 req-2cb20c3f-1da8-4822-a28c-7e21cfc39344 service nova] Lock "fdda34b5-280f-489d-baf5-bf21ac6dd6c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:49:18 user nova-compute[75337]: DEBUG nova.compute.manager [req-9358d834-1633-412e-b22f-36ae7e8581c8 req-2cb20c3f-1da8-4822-a28c-7e21cfc39344 service nova] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] No waiting events found dispatching network-vif-plugged-d86aca21-e67b-48e9-b8de-a1d618a5dfc7 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:49:18 user nova-compute[75337]: WARNING nova.compute.manager [req-9358d834-1633-412e-b22f-36ae7e8581c8 req-2cb20c3f-1da8-4822-a28c-7e21cfc39344 service nova] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Received unexpected event network-vif-plugged-d86aca21-e67b-48e9-b8de-a1d618a5dfc7 for instance with vm_state building and task_state spawning.
Nov 06 15:49:18 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:18 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:18 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-b4c03605-9a5f-458d-b11b-3747919bdc6a tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] [instance: afa4e52b-af51-45bf-b619-aeca14e7724d] Snapshot image upload complete
Nov 06 15:49:18 user nova-compute[75337]: DEBUG nova.compute.manager [None req-b4c03605-9a5f-458d-b11b-3747919bdc6a tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] [instance: afa4e52b-af51-45bf-b619-aeca14e7724d] Checking state {{(pid=75337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 15:49:18 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:18 user nova-compute[75337]: INFO nova.compute.manager [None req-b4c03605-9a5f-458d-b11b-3747919bdc6a tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] [instance: afa4e52b-af51-45bf-b619-aeca14e7724d] Shelve offloading
Nov 06 15:49:18 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:18 user nova-compute[75337]: INFO nova.virt.libvirt.driver [-] [instance: afa4e52b-af51-45bf-b619-aeca14e7724d] Instance destroyed successfully.
Nov 06 15:49:18 user nova-compute[75337]: DEBUG nova.compute.manager [None req-b4c03605-9a5f-458d-b11b-3747919bdc6a tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] [instance: afa4e52b-af51-45bf-b619-aeca14e7724d] Checking state {{(pid=75337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 15:49:18 user nova-compute[75337]: DEBUG nova.compute.manager [req-96753086-3091-4cb2-ac65-fe0c907282a1 req-a80a2ac9-ed54-44a3-bb13-b32bdbf83eb8 service nova] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Received event network-vif-plugged-ee068b96-f361-4cb1-afeb-d3db42848f50 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:49:18 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-96753086-3091-4cb2-ac65-fe0c907282a1 req-a80a2ac9-ed54-44a3-bb13-b32bdbf83eb8 service nova] Acquiring lock "fdda34b5-280f-489d-baf5-bf21ac6dd6c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:49:18 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-96753086-3091-4cb2-ac65-fe0c907282a1 req-a80a2ac9-ed54-44a3-bb13-b32bdbf83eb8 service nova] Lock "fdda34b5-280f-489d-baf5-bf21ac6dd6c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:49:18 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-96753086-3091-4cb2-ac65-fe0c907282a1 req-a80a2ac9-ed54-44a3-bb13-b32bdbf83eb8 service nova] Lock "fdda34b5-280f-489d-baf5-bf21ac6dd6c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:49:18 user nova-compute[75337]: DEBUG nova.compute.manager [req-96753086-3091-4cb2-ac65-fe0c907282a1 req-a80a2ac9-ed54-44a3-bb13-b32bdbf83eb8 service nova] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] No waiting events found dispatching network-vif-plugged-ee068b96-f361-4cb1-afeb-d3db42848f50 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:49:18 user nova-compute[75337]: WARNING nova.compute.manager [req-96753086-3091-4cb2-ac65-fe0c907282a1 req-a80a2ac9-ed54-44a3-bb13-b32bdbf83eb8 service nova] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Received unexpected event network-vif-plugged-ee068b96-f361-4cb1-afeb-d3db42848f50 for instance with vm_state building and task_state spawning.
Nov 06 15:49:18 user nova-compute[75337]: DEBUG nova.compute.manager [req-96753086-3091-4cb2-ac65-fe0c907282a1 req-a80a2ac9-ed54-44a3-bb13-b32bdbf83eb8 service nova] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Received event network-vif-plugged-7359ffbf-b953-480e-ae89-7ce5dda880a3 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:49:18 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-96753086-3091-4cb2-ac65-fe0c907282a1 req-a80a2ac9-ed54-44a3-bb13-b32bdbf83eb8 service nova] Acquiring lock "fdda34b5-280f-489d-baf5-bf21ac6dd6c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:49:18 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-96753086-3091-4cb2-ac65-fe0c907282a1 req-a80a2ac9-ed54-44a3-bb13-b32bdbf83eb8 service nova] Lock "fdda34b5-280f-489d-baf5-bf21ac6dd6c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:49:18 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-96753086-3091-4cb2-ac65-fe0c907282a1 req-a80a2ac9-ed54-44a3-bb13-b32bdbf83eb8 service nova] Lock "fdda34b5-280f-489d-baf5-bf21ac6dd6c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:49:18 user nova-compute[75337]: DEBUG nova.compute.manager [req-96753086-3091-4cb2-ac65-fe0c907282a1 req-a80a2ac9-ed54-44a3-bb13-b32bdbf83eb8 service nova] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] No waiting events found dispatching network-vif-plugged-7359ffbf-b953-480e-ae89-7ce5dda880a3 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:49:18 user nova-compute[75337]: WARNING nova.compute.manager [req-96753086-3091-4cb2-ac65-fe0c907282a1 req-a80a2ac9-ed54-44a3-bb13-b32bdbf83eb8 service nova] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Received unexpected event network-vif-plugged-7359ffbf-b953-480e-ae89-7ce5dda880a3 for instance with vm_state building and task_state spawning.
Nov 06 15:49:18 user nova-compute[75337]: DEBUG nova.compute.manager [req-96753086-3091-4cb2-ac65-fe0c907282a1 req-a80a2ac9-ed54-44a3-bb13-b32bdbf83eb8 service nova] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Received event network-vif-plugged-7359ffbf-b953-480e-ae89-7ce5dda880a3 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:49:18 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-96753086-3091-4cb2-ac65-fe0c907282a1 req-a80a2ac9-ed54-44a3-bb13-b32bdbf83eb8 service nova] Acquiring lock "fdda34b5-280f-489d-baf5-bf21ac6dd6c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:49:18 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-96753086-3091-4cb2-ac65-fe0c907282a1 req-a80a2ac9-ed54-44a3-bb13-b32bdbf83eb8 service nova] Lock "fdda34b5-280f-489d-baf5-bf21ac6dd6c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:49:18 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-96753086-3091-4cb2-ac65-fe0c907282a1 req-a80a2ac9-ed54-44a3-bb13-b32bdbf83eb8 service nova] Lock "fdda34b5-280f-489d-baf5-bf21ac6dd6c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:49:18 user nova-compute[75337]: DEBUG nova.compute.manager [req-96753086-3091-4cb2-ac65-fe0c907282a1 req-a80a2ac9-ed54-44a3-bb13-b32bdbf83eb8 service nova] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] No waiting events found dispatching network-vif-plugged-7359ffbf-b953-480e-ae89-7ce5dda880a3 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:49:18 user nova-compute[75337]: WARNING nova.compute.manager [req-96753086-3091-4cb2-ac65-fe0c907282a1 req-a80a2ac9-ed54-44a3-bb13-b32bdbf83eb8 service nova] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Received unexpected event network-vif-plugged-7359ffbf-b953-480e-ae89-7ce5dda880a3 for instance with vm_state building and task_state spawning.
Nov 06 15:49:18 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-b4c03605-9a5f-458d-b11b-3747919bdc6a tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Acquiring lock "refresh_cache-afa4e52b-af51-45bf-b619-aeca14e7724d" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 15:49:18 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-b4c03605-9a5f-458d-b11b-3747919bdc6a tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Acquired lock "refresh_cache-afa4e52b-af51-45bf-b619-aeca14e7724d" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 15:49:18 user nova-compute[75337]: DEBUG nova.network.neutron [None req-b4c03605-9a5f-458d-b11b-3747919bdc6a tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] [instance: afa4e52b-af51-45bf-b619-aeca14e7724d] Building network info cache for instance {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 15:49:18 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:18 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:19 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:19 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:19 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:19 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:19 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:19 user nova-compute[75337]: DEBUG nova.compute.manager [req-6fecfb89-eb7a-4f34-927b-aef00f20b75b req-ba8a28a3-117b-4fa2-a6b3-6ec50807c30f service nova] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Received event network-vif-plugged-0184ea76-40a1-41f4-9a6f-e2ca6719b7ab {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:49:19 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-6fecfb89-eb7a-4f34-927b-aef00f20b75b req-ba8a28a3-117b-4fa2-a6b3-6ec50807c30f service nova] Acquiring lock "fdda34b5-280f-489d-baf5-bf21ac6dd6c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:49:19 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-6fecfb89-eb7a-4f34-927b-aef00f20b75b req-ba8a28a3-117b-4fa2-a6b3-6ec50807c30f service nova] Lock "fdda34b5-280f-489d-baf5-bf21ac6dd6c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:49:19 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-6fecfb89-eb7a-4f34-927b-aef00f20b75b req-ba8a28a3-117b-4fa2-a6b3-6ec50807c30f service nova] Lock "fdda34b5-280f-489d-baf5-bf21ac6dd6c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:49:19 user nova-compute[75337]: DEBUG nova.compute.manager [req-6fecfb89-eb7a-4f34-927b-aef00f20b75b req-ba8a28a3-117b-4fa2-a6b3-6ec50807c30f service nova] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] No waiting events found dispatching network-vif-plugged-0184ea76-40a1-41f4-9a6f-e2ca6719b7ab {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:49:19 user nova-compute[75337]: WARNING nova.compute.manager [req-6fecfb89-eb7a-4f34-927b-aef00f20b75b req-ba8a28a3-117b-4fa2-a6b3-6ec50807c30f service nova] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Received unexpected event network-vif-plugged-0184ea76-40a1-41f4-9a6f-e2ca6719b7ab for instance with vm_state building and task_state spawning.
Nov 06 15:49:19 user nova-compute[75337]: DEBUG nova.compute.manager [req-6fecfb89-eb7a-4f34-927b-aef00f20b75b req-ba8a28a3-117b-4fa2-a6b3-6ec50807c30f service nova] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Received event network-vif-plugged-38a409f9-0fb9-4505-9f74-bf2859e6f66c {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:49:19 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-6fecfb89-eb7a-4f34-927b-aef00f20b75b req-ba8a28a3-117b-4fa2-a6b3-6ec50807c30f service nova] Acquiring lock "fdda34b5-280f-489d-baf5-bf21ac6dd6c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:49:19 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-6fecfb89-eb7a-4f34-927b-aef00f20b75b req-ba8a28a3-117b-4fa2-a6b3-6ec50807c30f service nova] Lock "fdda34b5-280f-489d-baf5-bf21ac6dd6c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:49:19 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-6fecfb89-eb7a-4f34-927b-aef00f20b75b req-ba8a28a3-117b-4fa2-a6b3-6ec50807c30f service nova] Lock "fdda34b5-280f-489d-baf5-bf21ac6dd6c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:49:19 user nova-compute[75337]: DEBUG nova.compute.manager [req-6fecfb89-eb7a-4f34-927b-aef00f20b75b req-ba8a28a3-117b-4fa2-a6b3-6ec50807c30f service nova] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] No waiting events found dispatching network-vif-plugged-38a409f9-0fb9-4505-9f74-bf2859e6f66c {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:49:19 user nova-compute[75337]: WARNING nova.compute.manager [req-6fecfb89-eb7a-4f34-927b-aef00f20b75b req-ba8a28a3-117b-4fa2-a6b3-6ec50807c30f service nova] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Received unexpected event network-vif-plugged-38a409f9-0fb9-4505-9f74-bf2859e6f66c for instance with vm_state building and task_state spawning.
Nov 06 15:49:19 user nova-compute[75337]: DEBUG nova.compute.manager [req-6fecfb89-eb7a-4f34-927b-aef00f20b75b req-ba8a28a3-117b-4fa2-a6b3-6ec50807c30f service nova] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Received event network-vif-plugged-38a409f9-0fb9-4505-9f74-bf2859e6f66c {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:49:19 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-6fecfb89-eb7a-4f34-927b-aef00f20b75b req-ba8a28a3-117b-4fa2-a6b3-6ec50807c30f service nova] Acquiring lock "fdda34b5-280f-489d-baf5-bf21ac6dd6c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:49:19 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-6fecfb89-eb7a-4f34-927b-aef00f20b75b req-ba8a28a3-117b-4fa2-a6b3-6ec50807c30f service nova] Lock "fdda34b5-280f-489d-baf5-bf21ac6dd6c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:49:19 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-6fecfb89-eb7a-4f34-927b-aef00f20b75b req-ba8a28a3-117b-4fa2-a6b3-6ec50807c30f service nova] Lock "fdda34b5-280f-489d-baf5-bf21ac6dd6c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:49:19 user nova-compute[75337]: DEBUG nova.compute.manager [req-6fecfb89-eb7a-4f34-927b-aef00f20b75b req-ba8a28a3-117b-4fa2-a6b3-6ec50807c30f service nova] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] No waiting events found dispatching network-vif-plugged-38a409f9-0fb9-4505-9f74-bf2859e6f66c {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:49:19 user nova-compute[75337]: WARNING nova.compute.manager [req-6fecfb89-eb7a-4f34-927b-aef00f20b75b req-ba8a28a3-117b-4fa2-a6b3-6ec50807c30f service nova] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Received unexpected event network-vif-plugged-38a409f9-0fb9-4505-9f74-bf2859e6f66c for instance with vm_state building and task_state spawning.
Nov 06 15:49:19 user nova-compute[75337]: DEBUG nova.compute.manager [req-6fecfb89-eb7a-4f34-927b-aef00f20b75b req-ba8a28a3-117b-4fa2-a6b3-6ec50807c30f service nova] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Received event network-vif-plugged-996e784d-bbe6-447b-8f1f-066ec34be989 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:49:19 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-6fecfb89-eb7a-4f34-927b-aef00f20b75b req-ba8a28a3-117b-4fa2-a6b3-6ec50807c30f service nova] Acquiring lock "fdda34b5-280f-489d-baf5-bf21ac6dd6c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:49:19 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-6fecfb89-eb7a-4f34-927b-aef00f20b75b req-ba8a28a3-117b-4fa2-a6b3-6ec50807c30f service nova] Lock "fdda34b5-280f-489d-baf5-bf21ac6dd6c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:49:19 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-6fecfb89-eb7a-4f34-927b-aef00f20b75b req-ba8a28a3-117b-4fa2-a6b3-6ec50807c30f service nova] Lock "fdda34b5-280f-489d-baf5-bf21ac6dd6c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:49:19 user nova-compute[75337]: DEBUG nova.compute.manager [req-6fecfb89-eb7a-4f34-927b-aef00f20b75b req-ba8a28a3-117b-4fa2-a6b3-6ec50807c30f service nova] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] No waiting events found dispatching network-vif-plugged-996e784d-bbe6-447b-8f1f-066ec34be989 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:49:19 user nova-compute[75337]: WARNING nova.compute.manager [req-6fecfb89-eb7a-4f34-927b-aef00f20b75b req-ba8a28a3-117b-4fa2-a6b3-6ec50807c30f service nova] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Received unexpected event network-vif-plugged-996e784d-bbe6-447b-8f1f-066ec34be989 for instance with vm_state building and task_state spawning.
Nov 06 15:49:19 user nova-compute[75337]: DEBUG nova.compute.manager [req-6fecfb89-eb7a-4f34-927b-aef00f20b75b req-ba8a28a3-117b-4fa2-a6b3-6ec50807c30f service nova] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Received event network-vif-plugged-996e784d-bbe6-447b-8f1f-066ec34be989 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:49:19 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-6fecfb89-eb7a-4f34-927b-aef00f20b75b req-ba8a28a3-117b-4fa2-a6b3-6ec50807c30f service nova] Acquiring lock "fdda34b5-280f-489d-baf5-bf21ac6dd6c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:49:19 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-6fecfb89-eb7a-4f34-927b-aef00f20b75b req-ba8a28a3-117b-4fa2-a6b3-6ec50807c30f service nova] Lock "fdda34b5-280f-489d-baf5-bf21ac6dd6c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:49:19 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-6fecfb89-eb7a-4f34-927b-aef00f20b75b req-ba8a28a3-117b-4fa2-a6b3-6ec50807c30f service nova] Lock "fdda34b5-280f-489d-baf5-bf21ac6dd6c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:49:19 user nova-compute[75337]: DEBUG nova.compute.manager [req-6fecfb89-eb7a-4f34-927b-aef00f20b75b req-ba8a28a3-117b-4fa2-a6b3-6ec50807c30f service nova] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] No waiting events found dispatching network-vif-plugged-996e784d-bbe6-447b-8f1f-066ec34be989 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:49:19 user nova-compute[75337]: WARNING nova.compute.manager [req-6fecfb89-eb7a-4f34-927b-aef00f20b75b req-ba8a28a3-117b-4fa2-a6b3-6ec50807c30f service nova] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Received unexpected event network-vif-plugged-996e784d-bbe6-447b-8f1f-066ec34be989 for instance with vm_state building and task_state spawning.
Nov 06 15:49:19 user nova-compute[75337]: DEBUG nova.network.neutron [None req-b4c03605-9a5f-458d-b11b-3747919bdc6a tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] [instance: afa4e52b-af51-45bf-b619-aeca14e7724d] Updating instance_info_cache with network_info: [{"id": "d66c8fee-7efa-49a4-b9c3-2f7ad2ccc71b", "address": "fa:16:3e:17:d2:52", "network": {"id": "f24470c2-ff6f-49fd-b28f-16b8a87ed3b4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-217486733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed09a1def6f0477796404d9bd3357dd0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd66c8fee-7e", "ovs_interfaceid": "d66c8fee-7efa-49a4-b9c3-2f7ad2ccc71b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:49:19 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-b4c03605-9a5f-458d-b11b-3747919bdc6a tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Releasing lock "refresh_cache-afa4e52b-af51-45bf-b619-aeca14e7724d" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 15:49:19 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-d09c878c-6e19-419d-9276-e42c6645f9f3 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: b7ececa5-256f-4a5d-aeda-3d2ee5c01cfe] Snapshot image upload complete
Nov 06 15:49:19 user nova-compute[75337]: INFO nova.compute.manager [None req-d09c878c-6e19-419d-9276-e42c6645f9f3 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: b7ececa5-256f-4a5d-aeda-3d2ee5c01cfe] Took 7.45 seconds to snapshot the instance on the hypervisor.
Nov 06 15:49:20 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:20 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:20 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:20 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:20 user nova-compute[75337]: INFO nova.virt.libvirt.driver [-] [instance: afa4e52b-af51-45bf-b619-aeca14e7724d] Instance destroyed successfully.
Nov 06 15:49:20 user nova-compute[75337]: DEBUG nova.objects.instance [None req-b4c03605-9a5f-458d-b11b-3747919bdc6a tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Lazy-loading 'resources' on Instance uuid afa4e52b-af51-45bf-b619-aeca14e7724d {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 15:49:20 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-b4c03605-9a5f-458d-b11b-3747919bdc6a tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T15:46:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2034562466',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2034562466',id=19,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF82sEW5O6A3Q2brT3u+9GB1WIf+ebH23UlBANWc3lprOF36lFt5sOZdo4tfIJodY5NMNMTM6BNoWJkWdz/l+/cF+bZRgMJn1cr7pylEs7V4EldcWuCvMKcYzk70ZVi1Bg==',key_name='tempest-keypair-702382784',keypairs=<?>,launch_index=0,launched_at=2023-11-06T15:46:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='ed09a1def6f0477796404d9bd3357dd0',ramdisk_id='',reservation_id='r-1fkdfqnf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-417383725',owner_user_name='tempest-AttachVolumeShelveTestJSON-417383725-project-member',shelved_at='2023-11-06T15:49:18.739920',shelved_host='user',shelved_image_id='9698ec22-ead3-40b9-a865-d2f1b245d360'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T15:49:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9e1c021de4da40518ddc45a57ef79d6f',uuid=afa4e52b-af51-45bf-b619-aeca14e7724d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "d66c8fee-7efa-49a4-b9c3-2f7ad2ccc71b", "address": "fa:16:3e:17:d2:52", "network": {"id": "f24470c2-ff6f-49fd-b28f-16b8a87ed3b4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-217486733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed09a1def6f0477796404d9bd3357dd0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd66c8fee-7e", "ovs_interfaceid": "d66c8fee-7efa-49a4-b9c3-2f7ad2ccc71b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 15:49:20 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-b4c03605-9a5f-458d-b11b-3747919bdc6a tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Converting VIF {"id": "d66c8fee-7efa-49a4-b9c3-2f7ad2ccc71b", "address": "fa:16:3e:17:d2:52", "network": {"id": "f24470c2-ff6f-49fd-b28f-16b8a87ed3b4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-217486733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed09a1def6f0477796404d9bd3357dd0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd66c8fee-7e", "ovs_interfaceid": "d66c8fee-7efa-49a4-b9c3-2f7ad2ccc71b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 15:49:20 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-b4c03605-9a5f-458d-b11b-3747919bdc6a tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:d2:52,bridge_name='br-int',has_traffic_filtering=True,id=d66c8fee-7efa-49a4-b9c3-2f7ad2ccc71b,network=Network(f24470c2-ff6f-49fd-b28f-16b8a87ed3b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd66c8fee-7e') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 15:49:20 user nova-compute[75337]: DEBUG os_vif [None req-b4c03605-9a5f-458d-b11b-3747919bdc6a tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:d2:52,bridge_name='br-int',has_traffic_filtering=True,id=d66c8fee-7efa-49a4-b9c3-2f7ad2ccc71b,network=Network(f24470c2-ff6f-49fd-b28f-16b8a87ed3b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd66c8fee-7e') {{(pid=75337) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 15:49:20 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:20 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd66c8fee-7e, bridge=br-int, if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:49:20 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:20 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:49:20 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:20 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:20 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=143d919c-3af3-463a-9192-9ad9f3b78607) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:49:20 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:20 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:20 user nova-compute[75337]: INFO os_vif [None req-b4c03605-9a5f-458d-b11b-3747919bdc6a tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:d2:52,bridge_name='br-int',has_traffic_filtering=True,id=d66c8fee-7efa-49a4-b9c3-2f7ad2ccc71b,network=Network(f24470c2-ff6f-49fd-b28f-16b8a87ed3b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd66c8fee-7e')
Nov 06 15:49:20 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-b4c03605-9a5f-458d-b11b-3747919bdc6a tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] [instance: afa4e52b-af51-45bf-b619-aeca14e7724d] Deleting instance files /opt/stack/data/nova/instances/afa4e52b-af51-45bf-b619-aeca14e7724d_del
Nov 06 15:49:20 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-b4c03605-9a5f-458d-b11b-3747919bdc6a tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] [instance: afa4e52b-af51-45bf-b619-aeca14e7724d] Deletion of /opt/stack/data/nova/instances/afa4e52b-af51-45bf-b619-aeca14e7724d_del complete
Nov 06 15:49:20 user nova-compute[75337]: DEBUG nova.compute.manager [req-04b0daa9-581d-4fbb-a28d-0d69c62fe17f req-70e81b24-cde5-4666-a31f-6a59b7efc748 service nova] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Received event network-vif-plugged-d86aca21-e67b-48e9-b8de-a1d618a5dfc7 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:49:20 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-04b0daa9-581d-4fbb-a28d-0d69c62fe17f req-70e81b24-cde5-4666-a31f-6a59b7efc748 service nova] Acquiring lock "fdda34b5-280f-489d-baf5-bf21ac6dd6c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:49:20 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-04b0daa9-581d-4fbb-a28d-0d69c62fe17f req-70e81b24-cde5-4666-a31f-6a59b7efc748 service nova] Lock "fdda34b5-280f-489d-baf5-bf21ac6dd6c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:49:20 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-04b0daa9-581d-4fbb-a28d-0d69c62fe17f req-70e81b24-cde5-4666-a31f-6a59b7efc748 service nova] Lock "fdda34b5-280f-489d-baf5-bf21ac6dd6c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:49:20 user nova-compute[75337]: DEBUG nova.compute.manager [req-04b0daa9-581d-4fbb-a28d-0d69c62fe17f req-70e81b24-cde5-4666-a31f-6a59b7efc748 service nova] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] No waiting events found dispatching network-vif-plugged-d86aca21-e67b-48e9-b8de-a1d618a5dfc7 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:49:20 user nova-compute[75337]: WARNING nova.compute.manager [req-04b0daa9-581d-4fbb-a28d-0d69c62fe17f req-70e81b24-cde5-4666-a31f-6a59b7efc748 service nova] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Received unexpected event network-vif-plugged-d86aca21-e67b-48e9-b8de-a1d618a5dfc7 for instance with vm_state building and task_state spawning.
Nov 06 15:49:20 user nova-compute[75337]: DEBUG nova.compute.manager [req-04b0daa9-581d-4fbb-a28d-0d69c62fe17f req-70e81b24-cde5-4666-a31f-6a59b7efc748 service nova] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Received event network-vif-plugged-4c56104b-528f-40b8-931d-7619e413ab07 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:49:20 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-04b0daa9-581d-4fbb-a28d-0d69c62fe17f req-70e81b24-cde5-4666-a31f-6a59b7efc748 service nova] Acquiring lock "fdda34b5-280f-489d-baf5-bf21ac6dd6c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:49:20 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-04b0daa9-581d-4fbb-a28d-0d69c62fe17f req-70e81b24-cde5-4666-a31f-6a59b7efc748 service nova] Lock "fdda34b5-280f-489d-baf5-bf21ac6dd6c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:49:20 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-04b0daa9-581d-4fbb-a28d-0d69c62fe17f req-70e81b24-cde5-4666-a31f-6a59b7efc748 service nova] Lock "fdda34b5-280f-489d-baf5-bf21ac6dd6c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:49:20 user nova-compute[75337]: DEBUG nova.compute.manager [req-04b0daa9-581d-4fbb-a28d-0d69c62fe17f req-70e81b24-cde5-4666-a31f-6a59b7efc748 service nova] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] No waiting events found dispatching network-vif-plugged-4c56104b-528f-40b8-931d-7619e413ab07 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:49:20 user nova-compute[75337]: WARNING nova.compute.manager [req-04b0daa9-581d-4fbb-a28d-0d69c62fe17f req-70e81b24-cde5-4666-a31f-6a59b7efc748 service nova] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Received unexpected event network-vif-plugged-4c56104b-528f-40b8-931d-7619e413ab07 for instance with vm_state building and task_state spawning.
Nov 06 15:49:20 user nova-compute[75337]: DEBUG nova.compute.manager [req-04b0daa9-581d-4fbb-a28d-0d69c62fe17f req-70e81b24-cde5-4666-a31f-6a59b7efc748 service nova] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Received event network-vif-plugged-4c56104b-528f-40b8-931d-7619e413ab07 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:49:20 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-04b0daa9-581d-4fbb-a28d-0d69c62fe17f req-70e81b24-cde5-4666-a31f-6a59b7efc748 service nova] Acquiring lock "fdda34b5-280f-489d-baf5-bf21ac6dd6c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:49:20 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-04b0daa9-581d-4fbb-a28d-0d69c62fe17f req-70e81b24-cde5-4666-a31f-6a59b7efc748 service nova] Lock "fdda34b5-280f-489d-baf5-bf21ac6dd6c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:49:20 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-04b0daa9-581d-4fbb-a28d-0d69c62fe17f req-70e81b24-cde5-4666-a31f-6a59b7efc748 service nova] Lock "fdda34b5-280f-489d-baf5-bf21ac6dd6c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:49:20 user nova-compute[75337]: DEBUG nova.compute.manager [req-04b0daa9-581d-4fbb-a28d-0d69c62fe17f req-70e81b24-cde5-4666-a31f-6a59b7efc748 service nova] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] No waiting events found dispatching network-vif-plugged-4c56104b-528f-40b8-931d-7619e413ab07 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:49:20 user nova-compute[75337]: WARNING nova.compute.manager [req-04b0daa9-581d-4fbb-a28d-0d69c62fe17f req-70e81b24-cde5-4666-a31f-6a59b7efc748 service nova] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Received unexpected event network-vif-plugged-4c56104b-528f-40b8-931d-7619e413ab07 for instance with vm_state building and task_state spawning.
Nov 06 15:49:20 user nova-compute[75337]: DEBUG nova.compute.manager [req-04b0daa9-581d-4fbb-a28d-0d69c62fe17f req-70e81b24-cde5-4666-a31f-6a59b7efc748 service nova] [instance: afa4e52b-af51-45bf-b619-aeca14e7724d] Received event network-changed-d66c8fee-7efa-49a4-b9c3-2f7ad2ccc71b {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:49:20 user nova-compute[75337]: DEBUG nova.compute.manager [req-04b0daa9-581d-4fbb-a28d-0d69c62fe17f req-70e81b24-cde5-4666-a31f-6a59b7efc748 service nova] [instance: afa4e52b-af51-45bf-b619-aeca14e7724d] Refreshing instance network info cache due to event network-changed-d66c8fee-7efa-49a4-b9c3-2f7ad2ccc71b. {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 15:49:20 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-04b0daa9-581d-4fbb-a28d-0d69c62fe17f req-70e81b24-cde5-4666-a31f-6a59b7efc748 service nova] Acquiring lock "refresh_cache-afa4e52b-af51-45bf-b619-aeca14e7724d" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 15:49:20 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-04b0daa9-581d-4fbb-a28d-0d69c62fe17f req-70e81b24-cde5-4666-a31f-6a59b7efc748 service nova] Acquired lock "refresh_cache-afa4e52b-af51-45bf-b619-aeca14e7724d" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 15:49:20 user nova-compute[75337]: DEBUG nova.network.neutron [req-04b0daa9-581d-4fbb-a28d-0d69c62fe17f req-70e81b24-cde5-4666-a31f-6a59b7efc748 service nova] [instance: afa4e52b-af51-45bf-b619-aeca14e7724d] Refreshing network info cache for port d66c8fee-7efa-49a4-b9c3-2f7ad2ccc71b {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 15:49:20 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:20 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:20 user nova-compute[75337]: INFO nova.scheduler.client.report [None req-b4c03605-9a5f-458d-b11b-3747919bdc6a tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Deleted allocations for instance afa4e52b-af51-45bf-b619-aeca14e7724d
Nov 06 15:49:20 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-b4c03605-9a5f-458d-b11b-3747919bdc6a tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:49:20 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-b4c03605-9a5f-458d-b11b-3747919bdc6a tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:49:20 user nova-compute[75337]: DEBUG nova.objects.instance [None req-b4c03605-9a5f-458d-b11b-3747919bdc6a tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Lazy-loading 'numa_topology' on Instance uuid afa4e52b-af51-45bf-b619-aeca14e7724d {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 15:49:20 user nova-compute[75337]: DEBUG nova.objects.base [None req-b4c03605-9a5f-458d-b11b-3747919bdc6a tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Object Instance<afa4e52b-af51-45bf-b619-aeca14e7724d> lazy-loaded attributes: resources,numa_topology {{(pid=75337) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 15:49:21 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-b4c03605-9a5f-458d-b11b-3747919bdc6a tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 15:49:21 user nova-compute[75337]: DEBUG nova.compute.manager [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Instance event wait completed in 0 seconds for  {{(pid=75337) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 15:49:21 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Guest created on hypervisor {{(pid=75337) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 15:49:21 user nova-compute[75337]: INFO nova.virt.libvirt.driver [-] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Instance spawned successfully.
Nov 06 15:49:21 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 15:49:21 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-b4c03605-9a5f-458d-b11b-3747919bdc6a tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 15:49:21 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Found default for hw_cdrom_bus of ide {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:49:21 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Found default for hw_disk_bus of virtio {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:49:21 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Found default for hw_input_bus of None {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:49:21 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Found default for hw_pointer_model of None {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:49:21 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Found default for hw_video_model of virtio {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:49:21 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Found default for hw_vif_model of virtio {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:49:21 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-b4c03605-9a5f-458d-b11b-3747919bdc6a tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.452s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:49:21 user nova-compute[75337]: INFO nova.compute.manager [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Took 18.53 seconds to spawn the instance on the hypervisor.
Nov 06 15:49:21 user nova-compute[75337]: DEBUG nova.compute.manager [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Checking state {{(pid=75337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 15:49:21 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-b4c03605-9a5f-458d-b11b-3747919bdc6a tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Lock "afa4e52b-af51-45bf-b619-aeca14e7724d" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 9.393s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:49:21 user nova-compute[75337]: DEBUG nova.network.neutron [req-04b0daa9-581d-4fbb-a28d-0d69c62fe17f req-70e81b24-cde5-4666-a31f-6a59b7efc748 service nova] [instance: afa4e52b-af51-45bf-b619-aeca14e7724d] Updated VIF entry in instance network info cache for port d66c8fee-7efa-49a4-b9c3-2f7ad2ccc71b. {{(pid=75337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 15:49:21 user nova-compute[75337]: DEBUG nova.network.neutron [req-04b0daa9-581d-4fbb-a28d-0d69c62fe17f req-70e81b24-cde5-4666-a31f-6a59b7efc748 service nova] [instance: afa4e52b-af51-45bf-b619-aeca14e7724d] Updating instance_info_cache with network_info: [{"id": "d66c8fee-7efa-49a4-b9c3-2f7ad2ccc71b", "address": "fa:16:3e:17:d2:52", "network": {"id": "f24470c2-ff6f-49fd-b28f-16b8a87ed3b4", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-217486733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed09a1def6f0477796404d9bd3357dd0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapd66c8fee-7e", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:49:21 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-04b0daa9-581d-4fbb-a28d-0d69c62fe17f req-70e81b24-cde5-4666-a31f-6a59b7efc748 service nova] Releasing lock "refresh_cache-afa4e52b-af51-45bf-b619-aeca14e7724d" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 15:49:21 user nova-compute[75337]: INFO nova.compute.manager [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Took 121.01 seconds to build instance.
Nov 06 15:49:21 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-a3c80234-8c86-4e66-a7be-245710ed4ee6 tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Lock "fdda34b5-280f-489d-baf5-bf21ac6dd6c9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 121.131s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:49:24 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:25 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:26 user nova-compute[75337]: DEBUG nova.compute.manager [None req-c05e62de-0cab-45f4-bdae-03cecf76da51 tempest-TestVolumeSwap-916912695 tempest-TestVolumeSwap-916912695-project-admin] [instance: 9125364b-332f-4297-815f-3aa1eadaf743] swap_volume: Updating volume b1421f55-d453-441d-bdf7-3743102662b6 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:0c5fa35a-1ba5-4390-9102-83ac1dbb790a", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "nkapcTJV", "auth_password": "xKQrynIt8GvMC9", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdg", "volume_id": "0c5fa35a-1ba5-4390-9102-83ac1dbb790a"}, "status": "reserved", "instance": "9125364b-332f-4297-815f-3aa1eadaf743", "attached_at": "", "detached_at": "", "volume_id": "0c5fa35a-1ba5-4390-9102-83ac1dbb790a", "serial": "0c5fa35a-1ba5-4390-9102-83ac1dbb790a"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '0c5fa35a-1ba5-4390-9102-83ac1dbb790a', 'no_device': None, 'attachment_id': '7a1bad93-8b09-40cb-ab1e-b2db3e80e313'} {{(pid=75337) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 06 15:49:26 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-c05e62de-0cab-45f4-bdae-03cecf76da51 tempest-TestVolumeSwap-916912695 tempest-TestVolumeSwap-916912695-project-admin] Lock "9125364b-332f-4297-815f-3aa1eadaf743" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 59.829s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:49:26 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-8acd48fd-c495-4dd2-b61d-2a9f2256f8fb tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 477da5ee-3e03-4aa9-9a88-004c442e617a is timed out.
Nov 06 15:49:26 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-8acd48fd-c495-4dd2-b61d-2a9f2256f8fb tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Successfully detached device vdb from instance 477da5ee-3e03-4aa9-9a88-004c442e617a from the live domain config.
Nov 06 15:49:26 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8acd48fd-c495-4dd2-b61d-2a9f2256f8fb tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] [instance: 477da5ee-3e03-4aa9-9a88-004c442e617a] calling os-brick to detach iSCSI Volume {{(pid=75337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 15:49:26 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-8acd48fd-c495-4dd2-b61d-2a9f2256f8fb tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2abc33d0c0>, {'target_iqn': 'iqn.2010-10.org.openstack:4954683e-297c-4bed-94c9-675adb40fb66', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'daDFkXwb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 15:49:26 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-8acd48fd-c495-4dd2-b61d-2a9f2256f8fb tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 15:49:26 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-8acd48fd-c495-4dd2-b61d-2a9f2256f8fb tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 15:49:26 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-8acd48fd-c495-4dd2-b61d-2a9f2256f8fb tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 15:49:26 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:26 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:49:26 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[da4488ed-2e57-43b1-b63b-0aabe2ef99ec]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1bebbb46-2250-4511-ba59-f4ce67e0b45d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:563526a2-6204-4264-91b7-041e6cadab23\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dc5eae50-0461-47ca-bc48-cb38087b06e0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:06631b49-02a1-4759-8d9b-22b7ebdaa584\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4954683e-297c-4bed-94c9-675adb40fb66\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0c5fa35a-1ba5-4390-9102-83ac1dbb790a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:49:26 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-8acd48fd-c495-4dd2-b61d-2a9f2256f8fb tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 15:49:26 user nova-compute[75337]: No targets found.
Nov 06 15:49:26 user nova-compute[75337]: iSNS:
Nov 06 15:49:26 user nova-compute[75337]: No targets found.
Nov 06 15:49:26 user nova-compute[75337]: STATIC:
Nov 06 15:49:26 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:1bebbb46-2250-4511-ba59-f4ce67e0b45d
Nov 06 15:49:26 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 15:49:26 user nova-compute[75337]:                 Iface Name: default
Nov 06 15:49:26 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158
Nov 06 15:49:26 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 15:49:26 user nova-compute[75337]:                 Iface Name: default
Nov 06 15:49:26 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:563526a2-6204-4264-91b7-041e6cadab23
Nov 06 15:49:26 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 15:49:26 user nova-compute[75337]:                 Iface Name: default
Nov 06 15:49:26 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:dc5eae50-0461-47ca-bc48-cb38087b06e0
Nov 06 15:49:26 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 15:49:26 user nova-compute[75337]:                 Iface Name: default
Nov 06 15:49:26 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6
Nov 06 15:49:26 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 15:49:26 user nova-compute[75337]:                 Iface Name: default
Nov 06 15:49:26 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:06631b49-02a1-4759-8d9b-22b7ebdaa584
Nov 06 15:49:26 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 15:49:26 user nova-compute[75337]:                 Iface Name: default
Nov 06 15:49:26 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:4954683e-297c-4bed-94c9-675adb40fb66
Nov 06 15:49:26 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 15:49:26 user nova-compute[75337]:                 Iface Name: default
Nov 06 15:49:26 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:0c5fa35a-1ba5-4390-9102-83ac1dbb790a
Nov 06 15:49:26 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 15:49:26 user nova-compute[75337]:                 Iface Name: default
Nov 06 15:49:26 user nova-compute[75337]: FIRMWARE:
Nov 06 15:49:26 user nova-compute[75337]: No targets found.
Nov 06 15:49:26 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 15:49:26 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-8acd48fd-c495-4dd2-b61d-2a9f2256f8fb tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 15:49:26 user nova-compute[75337]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 15:49:26 user nova-compute[75337]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75337) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 15:49:26 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-8acd48fd-c495-4dd2-b61d-2a9f2256f8fb tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4954683e-297c-4bed-94c9-675adb40fb66', 0)] {{(pid=75337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 15:49:26 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:26 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:49:26 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[752f310d-ce02-404e-b994-cbe9b04b62a6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:06631b49-02a1-4759-8d9b-22b7ebdaa584\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c5fa35a-1ba5-4390-9102-83ac1dbb790a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1bebbb46-2250-4511-ba59-f4ce67e0b45d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4954683e-297c-4bed-94c9-675adb40fb66\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:563526a2-6204-4264-91b7-041e6cadab23\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dc5eae50-0461-47ca-bc48-cb38087b06e0\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:49:26 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:26 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:49:26 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[063decd2-c1fd-4c50-8eff-ce7d995f92bf]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4954683e-297c-4bed-94c9-675adb40fb66 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06631b49-02a1-4759-8d9b-22b7ebdaa584 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c5fa35a-1ba5-4390-9102-83ac1dbb790a (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:563526a2-6204-4264-91b7-041e6cadab23 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc5eae50-0461-47ca-bc48-cb38087b06e0 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bebbb46-2250-4511-ba59-f4ce67e0b45d (non-flash)\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:49:26 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-8acd48fd-c495-4dd2-b61d-2a9f2256f8fb tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)
Nov 06 15:49:26 user nova-compute[75337]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6 (non-flash)
Nov 06 15:49:26 user nova-compute[75337]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4954683e-297c-4bed-94c9-675adb40fb66 (non-flash)
Nov 06 15:49:26 user nova-compute[75337]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06631b49-02a1-4759-8d9b-22b7ebdaa584 (non-flash)
Nov 06 15:49:26 user nova-compute[75337]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c5fa35a-1ba5-4390-9102-83ac1dbb790a (non-flash)
Nov 06 15:49:26 user nova-compute[75337]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:563526a2-6204-4264-91b7-041e6cadab23 (non-flash)
Nov 06 15:49:26 user nova-compute[75337]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc5eae50-0461-47ca-bc48-cb38087b06e0 (non-flash)
Nov 06 15:49:26 user nova-compute[75337]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bebbb46-2250-4511-ba59-f4ce67e0b45d (non-flash)
Nov 06 15:49:26 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 15:49:26 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-8acd48fd-c495-4dd2-b61d-2a9f2256f8fb tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)
Nov 06 15:49:26 user nova-compute[75337]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6 (non-flash)
Nov 06 15:49:26 user nova-compute[75337]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4954683e-297c-4bed-94c9-675adb40fb66 (non-flash)
Nov 06 15:49:26 user nova-compute[75337]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06631b49-02a1-4759-8d9b-22b7ebdaa584 (non-flash)
Nov 06 15:49:26 user nova-compute[75337]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c5fa35a-1ba5-4390-9102-83ac1dbb790a (non-flash)
Nov 06 15:49:26 user nova-compute[75337]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:563526a2-6204-4264-91b7-041e6cadab23 (non-flash)
Nov 06 15:49:26 user nova-compute[75337]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc5eae50-0461-47ca-bc48-cb38087b06e0 (non-flash)
Nov 06 15:49:26 user nova-compute[75337]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bebbb46-2250-4511-ba59-f4ce67e0b45d (non-flash)
Nov 06 15:49:26 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 15:49:26 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-8acd48fd-c495-4dd2-b61d-2a9f2256f8fb tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2abc413be0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4954683e-297c-4bed-94c9-675adb40fb66'): ({'sde'}, set())}) {{(pid=75337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 15:49:26 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-8acd48fd-c495-4dd2-b61d-2a9f2256f8fb tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Removing single pathed devices sde {{(pid=75337) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 15:49:26 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:26 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:49:26 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1c3fa61-74c0-4070-948d-d589318bd3bc]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:49:26 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:26 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.024s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:49:26 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d4a1feb-443c-4577-add1-6ae956d628c2]: (4, ('ok\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:49:26 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-8acd48fd-c495-4dd2-b61d-2a9f2256f8fb tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Flushing IO for device /dev/sde {{(pid=75337) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 15:49:26 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:26 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:49:26 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[da8f910f-9391-452e-ad08-239cb5e23056]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:49:26 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-8acd48fd-c495-4dd2-b61d-2a9f2256f8fb tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75337) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 15:49:26 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:26 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.059s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:49:26 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[c18e40fb-ad01-4189-acba-31c9beb8eb69]: (4, ('1', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:49:26 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-8acd48fd-c495-4dd2-b61d-2a9f2256f8fb tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 15:49:26 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-8acd48fd-c495-4dd2-b61d-2a9f2256f8fb tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] SCSI volumes sde have been removed. {{(pid=75337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 15:49:26 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-8acd48fd-c495-4dd2-b61d-2a9f2256f8fb tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4954683e-297c-4bed-94c9-675adb40fb66')] {{(pid=75337) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 15:49:26 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4954683e-297c-4bed-94c9-675adb40fb66 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:26 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4954683e-297c-4bed-94c9-675adb40fb66 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:49:26 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[f91d6a6f-061d-4a63-a871-a61414ed7636]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:49:26 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-8acd48fd-c495-4dd2-b61d-2a9f2256f8fb tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:49:26 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4954683e-297c-4bed-94c9-675adb40fb66 -p 172.16.0.220:3260 --logout {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:26 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4954683e-297c-4bed-94c9-675adb40fb66 -p 172.16.0.220:3260 --logout" returned: 0 in 0.105s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:49:26 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbaa93f3-593e-4f3f-8770-f2fc2bb9d834]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:4954683e-297c-4bed-94c9-675adb40fb66, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:4954683e-297c-4bed-94c9-675adb40fb66, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:49:26 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-8acd48fd-c495-4dd2-b61d-2a9f2256f8fb tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:4954683e-297c-4bed-94c9-675adb40fb66, portal: 172.16.0.220,3260]
Nov 06 15:49:26 user nova-compute[75337]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:4954683e-297c-4bed-94c9-675adb40fb66, portal: 172.16.0.220,3260] successful.
Nov 06 15:49:26 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:49:26 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4954683e-297c-4bed-94c9-675adb40fb66 -p 172.16.0.220:3260 --op delete {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:26 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4954683e-297c-4bed-94c9-675adb40fb66 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.048s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:49:26 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca6d9743-ea6b-4537-88b0-e316b2397901]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:49:26 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-8acd48fd-c495-4dd2-b61d-2a9f2256f8fb tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:49:26 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-8acd48fd-c495-4dd2-b61d-2a9f2256f8fb tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.442s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 15:49:26 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-8acd48fd-c495-4dd2-b61d-2a9f2256f8fb tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] <== disconnect_volume: return (444ms) None {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 15:49:26 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8acd48fd-c495-4dd2-b61d-2a9f2256f8fb tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] [instance: 477da5ee-3e03-4aa9-9a88-004c442e617a] Disconnected iSCSI Volume {{(pid=75337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 15:49:27 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-17ccbf7d-ccd3-46cd-be17-4ee8a2de27f7 tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] Acquiring lock "9125364b-332f-4297-815f-3aa1eadaf743" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:49:27 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-17ccbf7d-ccd3-46cd-be17-4ee8a2de27f7 tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] Lock "9125364b-332f-4297-815f-3aa1eadaf743" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:49:27 user nova-compute[75337]: INFO nova.compute.manager [None req-17ccbf7d-ccd3-46cd-be17-4ee8a2de27f7 tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] [instance: 9125364b-332f-4297-815f-3aa1eadaf743] Detaching volume 0c5fa35a-1ba5-4390-9102-83ac1dbb790a
Nov 06 15:49:27 user nova-compute[75337]: INFO nova.virt.block_device [None req-17ccbf7d-ccd3-46cd-be17-4ee8a2de27f7 tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] [instance: 9125364b-332f-4297-815f-3aa1eadaf743] Attempting to driver detach volume 0c5fa35a-1ba5-4390-9102-83ac1dbb790a from mountpoint /dev/vdb
Nov 06 15:49:27 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-17ccbf7d-ccd3-46cd-be17-4ee8a2de27f7 tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] Attempting to detach device vdb from instance 9125364b-332f-4297-815f-3aa1eadaf743 from the persistent domain config. {{(pid=75337) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 06 15:49:27 user nova-compute[75337]: DEBUG nova.virt.libvirt.guest [None req-17ccbf7d-ccd3-46cd-be17-4ee8a2de27f7 tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 15:49:27 user nova-compute[75337]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 15:49:27 user nova-compute[75337]:   <source dev="/dev/sdg"/>
Nov 06 15:49:27 user nova-compute[75337]:   <target dev="vdb" bus="virtio"/>
Nov 06 15:49:27 user nova-compute[75337]:   <serial>0c5fa35a-1ba5-4390-9102-83ac1dbb790a</serial>
Nov 06 15:49:27 user nova-compute[75337]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 06 15:49:27 user nova-compute[75337]: </disk>
Nov 06 15:49:27 user nova-compute[75337]:  {{(pid=75337) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 15:49:27 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-17ccbf7d-ccd3-46cd-be17-4ee8a2de27f7 tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] Successfully detached device vdb from instance 9125364b-332f-4297-815f-3aa1eadaf743 from the persistent domain config.
Nov 06 15:49:27 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-17ccbf7d-ccd3-46cd-be17-4ee8a2de27f7 tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9125364b-332f-4297-815f-3aa1eadaf743 from the live domain config. {{(pid=75337) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 06 15:49:27 user nova-compute[75337]: DEBUG nova.virt.libvirt.guest [None req-17ccbf7d-ccd3-46cd-be17-4ee8a2de27f7 tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 15:49:27 user nova-compute[75337]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 15:49:27 user nova-compute[75337]:   <source dev="/dev/sdg"/>
Nov 06 15:49:27 user nova-compute[75337]:   <target dev="vdb" bus="virtio"/>
Nov 06 15:49:27 user nova-compute[75337]:   <serial>0c5fa35a-1ba5-4390-9102-83ac1dbb790a</serial>
Nov 06 15:49:27 user nova-compute[75337]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 06 15:49:27 user nova-compute[75337]: </disk>
Nov 06 15:49:27 user nova-compute[75337]:  {{(pid=75337) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 15:49:27 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-17ccbf7d-ccd3-46cd-be17-4ee8a2de27f7 tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9125364b-332f-4297-815f-3aa1eadaf743 {{(pid=75337) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 06 15:49:28 user nova-compute[75337]: DEBUG nova.compute.manager [req-7b20d596-443e-4f5c-9f81-3f670f4fe594 req-c95634af-9e1f-4347-b3db-19c626ab9f91 service nova] [instance: bc0e07f8-2731-4ffa-8446-b71ad3ba7375] Received event network-changed-a20e3f62-5387-4f54-b623-d45a0a311da0 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:49:28 user nova-compute[75337]: DEBUG nova.compute.manager [req-7b20d596-443e-4f5c-9f81-3f670f4fe594 req-c95634af-9e1f-4347-b3db-19c626ab9f91 service nova] [instance: bc0e07f8-2731-4ffa-8446-b71ad3ba7375] Refreshing instance network info cache due to event network-changed-a20e3f62-5387-4f54-b623-d45a0a311da0. {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 15:49:28 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-7b20d596-443e-4f5c-9f81-3f670f4fe594 req-c95634af-9e1f-4347-b3db-19c626ab9f91 service nova] Acquiring lock "refresh_cache-bc0e07f8-2731-4ffa-8446-b71ad3ba7375" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 15:49:28 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-7b20d596-443e-4f5c-9f81-3f670f4fe594 req-c95634af-9e1f-4347-b3db-19c626ab9f91 service nova] Acquired lock "refresh_cache-bc0e07f8-2731-4ffa-8446-b71ad3ba7375" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 15:49:28 user nova-compute[75337]: DEBUG nova.network.neutron [req-7b20d596-443e-4f5c-9f81-3f670f4fe594 req-c95634af-9e1f-4347-b3db-19c626ab9f91 service nova] [instance: bc0e07f8-2731-4ffa-8446-b71ad3ba7375] Refreshing network info cache for port a20e3f62-5387-4f54-b623-d45a0a311da0 {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 15:49:28 user nova-compute[75337]: DEBUG nova.network.neutron [req-7b20d596-443e-4f5c-9f81-3f670f4fe594 req-c95634af-9e1f-4347-b3db-19c626ab9f91 service nova] [instance: bc0e07f8-2731-4ffa-8446-b71ad3ba7375] Updated VIF entry in instance network info cache for port a20e3f62-5387-4f54-b623-d45a0a311da0. {{(pid=75337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 15:49:28 user nova-compute[75337]: DEBUG nova.network.neutron [req-7b20d596-443e-4f5c-9f81-3f670f4fe594 req-c95634af-9e1f-4347-b3db-19c626ab9f91 service nova] [instance: bc0e07f8-2731-4ffa-8446-b71ad3ba7375] Updating instance_info_cache with network_info: [{"id": "a20e3f62-5387-4f54-b623-d45a0a311da0", "address": "fa:16:3e:fe:62:24", "network": {"id": "c31b513a-57f0-4bd5-b055-4a363aae9793", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1352256985-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cddccc86bf54fe981667da5ef13fa8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa20e3f62-53", "ovs_interfaceid": "a20e3f62-5387-4f54-b623-d45a0a311da0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:49:28 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-7b20d596-443e-4f5c-9f81-3f670f4fe594 req-c95634af-9e1f-4347-b3db-19c626ab9f91 service nova] Releasing lock "refresh_cache-bc0e07f8-2731-4ffa-8446-b71ad3ba7375" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 15:49:29 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:30 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:30 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:31 user nova-compute[75337]: DEBUG nova.compute.manager [req-7646f7a6-bb46-47de-9ca6-20fcff29514b req-c58a81a1-2d3b-4b95-802f-1dfdc54e81d4 service nova] [instance: bc0e07f8-2731-4ffa-8446-b71ad3ba7375] Received event network-changed-a20e3f62-5387-4f54-b623-d45a0a311da0 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:49:31 user nova-compute[75337]: DEBUG nova.compute.manager [req-7646f7a6-bb46-47de-9ca6-20fcff29514b req-c58a81a1-2d3b-4b95-802f-1dfdc54e81d4 service nova] [instance: bc0e07f8-2731-4ffa-8446-b71ad3ba7375] Refreshing instance network info cache due to event network-changed-a20e3f62-5387-4f54-b623-d45a0a311da0. {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 15:49:31 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-7646f7a6-bb46-47de-9ca6-20fcff29514b req-c58a81a1-2d3b-4b95-802f-1dfdc54e81d4 service nova] Acquiring lock "refresh_cache-bc0e07f8-2731-4ffa-8446-b71ad3ba7375" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 15:49:31 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-7646f7a6-bb46-47de-9ca6-20fcff29514b req-c58a81a1-2d3b-4b95-802f-1dfdc54e81d4 service nova] Acquired lock "refresh_cache-bc0e07f8-2731-4ffa-8446-b71ad3ba7375" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 15:49:31 user nova-compute[75337]: DEBUG nova.network.neutron [req-7646f7a6-bb46-47de-9ca6-20fcff29514b req-c58a81a1-2d3b-4b95-802f-1dfdc54e81d4 service nova] [instance: bc0e07f8-2731-4ffa-8446-b71ad3ba7375] Refreshing network info cache for port a20e3f62-5387-4f54-b623-d45a0a311da0 {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 15:49:31 user nova-compute[75337]: DEBUG nova.network.neutron [req-7646f7a6-bb46-47de-9ca6-20fcff29514b req-c58a81a1-2d3b-4b95-802f-1dfdc54e81d4 service nova] [instance: bc0e07f8-2731-4ffa-8446-b71ad3ba7375] Updated VIF entry in instance network info cache for port a20e3f62-5387-4f54-b623-d45a0a311da0. {{(pid=75337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 15:49:31 user nova-compute[75337]: DEBUG nova.network.neutron [req-7646f7a6-bb46-47de-9ca6-20fcff29514b req-c58a81a1-2d3b-4b95-802f-1dfdc54e81d4 service nova] [instance: bc0e07f8-2731-4ffa-8446-b71ad3ba7375] Updating instance_info_cache with network_info: [{"id": "a20e3f62-5387-4f54-b623-d45a0a311da0", "address": "fa:16:3e:fe:62:24", "network": {"id": "c31b513a-57f0-4bd5-b055-4a363aae9793", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1352256985-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cddccc86bf54fe981667da5ef13fa8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa20e3f62-53", "ovs_interfaceid": "a20e3f62-5387-4f54-b623-d45a0a311da0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:49:31 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-7646f7a6-bb46-47de-9ca6-20fcff29514b req-c58a81a1-2d3b-4b95-802f-1dfdc54e81d4 service nova] Releasing lock "refresh_cache-bc0e07f8-2731-4ffa-8446-b71ad3ba7375" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 15:49:34 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:35 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:38 user nova-compute[75337]: DEBUG nova.objects.instance [None req-8acd48fd-c495-4dd2-b61d-2a9f2256f8fb tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Lazy-loading 'flavor' on Instance uuid 477da5ee-3e03-4aa9-9a88-004c442e617a {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 15:49:38 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-8acd48fd-c495-4dd2-b61d-2a9f2256f8fb tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Lock "477da5ee-3e03-4aa9-9a88-004c442e617a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 32.940s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:49:38 user nova-compute[75337]: DEBUG nova.compute.manager [None req-13d17865-491a-490f-b016-5c740d02f100 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 493eff79-294e-4259-a6d0-4772c4b45013] Start spawning the instance on the hypervisor. {{(pid=75337) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 15:49:38 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-13d17865-491a-490f-b016-5c740d02f100 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 493eff79-294e-4259-a6d0-4772c4b45013] Creating instance directory {{(pid=75337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 15:49:38 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-13d17865-491a-490f-b016-5c740d02f100 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 493eff79-294e-4259-a6d0-4772c4b45013] Creating image(s)
Nov 06 15:49:38 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-13d17865-491a-490f-b016-5c740d02f100 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 493eff79-294e-4259-a6d0-4772c4b45013] Did not create local disks {{(pid=75337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 06 15:49:38 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-13d17865-491a-490f-b016-5c740d02f100 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 493eff79-294e-4259-a6d0-4772c4b45013] Ensure instance console log exists: /opt/stack/data/nova/instances/493eff79-294e-4259-a6d0-4772c4b45013/console.log {{(pid=75337) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 15:49:38 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-13d17865-491a-490f-b016-5c740d02f100 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:49:38 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-13d17865-491a-490f-b016-5c740d02f100 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:49:38 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-13d17865-491a-490f-b016-5c740d02f100 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:49:38 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-13d17865-491a-490f-b016-5c740d02f100 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 493eff79-294e-4259-a6d0-4772c4b45013] Start _get_guest_xml network_info=[{"id": "5e620284-83c1-40a8-91a5-c6b2c8c87a19", "address": "fa:16:3e:09:f0:4b", "network": {"id": "4e47319f-de1d-4dfe-9915-7d2d5131704d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-895093240-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "915211c6a2734c36b34ff92a56b085f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e620284-83", "ovs_interfaceid": "5e620284-83c1-40a8-91a5-c6b2c8c87a19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'attachment_id': '0ca73f20-7cbe-4e26-8fb1-5d6142fe793f', 'guest_format': None, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2086a611-973d-47a1-bb69-f2ebd144be03', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FfsyNLOm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '493eff79-294e-4259-a6d0-4772c4b45013', 'attached_at': '', 'detached_at': '', 'volume_id': '2086a611-973d-47a1-bb69-f2ebd144be03', 'serial': '2086a611-973d-47a1-bb69-f2ebd144be03'}, 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=75337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 15:49:38 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-13d17865-491a-490f-b016-5c740d02f100 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 15:49:38 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-13d17865-491a-490f-b016-5c740d02f100 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 15:49:38 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-13d17865-491a-490f-b016-5c740d02f100 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 15:49:38 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-13d17865-491a-490f-b016-5c740d02f100 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] CPU controller missing on host. {{(pid=75337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 15:49:38 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-13d17865-491a-490f-b016-5c740d02f100 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 15:49:38 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-13d17865-491a-490f-b016-5c740d02f100 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] CPU controller found on host. {{(pid=75337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 15:49:38 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-13d17865-491a-490f-b016-5c740d02f100 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75337) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 15:49:38 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-13d17865-491a-490f-b016-5c740d02f100 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T15:34:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 15:49:38 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-13d17865-491a-490f-b016-5c740d02f100 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Flavor limits 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 15:49:38 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-13d17865-491a-490f-b016-5c740d02f100 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Image limits 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 15:49:38 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-13d17865-491a-490f-b016-5c740d02f100 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Flavor pref 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 15:49:38 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-13d17865-491a-490f-b016-5c740d02f100 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Image pref 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 15:49:38 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-13d17865-491a-490f-b016-5c740d02f100 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 15:49:38 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-13d17865-491a-490f-b016-5c740d02f100 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 15:49:38 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-13d17865-491a-490f-b016-5c740d02f100 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 15:49:38 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-13d17865-491a-490f-b016-5c740d02f100 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Got 1 possible topologies {{(pid=75337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 15:49:38 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-13d17865-491a-490f-b016-5c740d02f100 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 15:49:38 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-13d17865-491a-490f-b016-5c740d02f100 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 15:49:38 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-13d17865-491a-490f-b016-5c740d02f100 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 493eff79-294e-4259-a6d0-4772c4b45013] Calling os-brick to attach iSCSI Volume {{(pid=75337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 15:49:38 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-13d17865-491a-490f-b016-5c740d02f100 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2abc33d0c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2086a611-973d-47a1-bb69-f2ebd144be03', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FfsyNLOm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 15:49:38 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-13d17865-491a-490f-b016-5c740d02f100 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 15:49:38 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-13d17865-491a-490f-b016-5c740d02f100 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 15:49:38 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-13d17865-491a-490f-b016-5c740d02f100 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 15:49:38 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-13d17865-491a-490f-b016-5c740d02f100 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 15:49:38 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-13d17865-491a-490f-b016-5c740d02f100 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2086a611-973d-47a1-bb69-f2ebd144be03" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 15:49:38 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-13d17865-491a-490f-b016-5c740d02f100 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2086a611-973d-47a1-bb69-f2ebd144be03" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 15:49:38 user nova-compute[75337]: INFO os_brick.initiator.connectors.iscsi [None req-13d17865-491a-490f-b016-5c740d02f100 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 15:49:38 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2086a611-973d-47a1-bb69-f2ebd144be03 -p 172.16.0.220:3260 {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:38 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2086a611-973d-47a1-bb69-f2ebd144be03 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:49:38 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5eb2bc7-bb80-4123-8a60-f103f968b442]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:49:38 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-13d17865-491a-490f-b016-5c740d02f100 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 15:49:38 user nova-compute[75337]:  {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:49:38 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2086a611-973d-47a1-bb69-f2ebd144be03 -p 172.16.0.220:3260 --interface default --op new {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:38 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2086a611-973d-47a1-bb69-f2ebd144be03 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:49:38 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[b812694e-994b-4429-a9fe-5b7608086967]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2086a611-973d-47a1-bb69-f2ebd144be03] added\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:49:38 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-13d17865-491a-490f-b016-5c740d02f100 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2086a611-973d-47a1-bb69-f2ebd144be03] added
Nov 06 15:49:38 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:49:38 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2086a611-973d-47a1-bb69-f2ebd144be03 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:39 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2086a611-973d-47a1-bb69-f2ebd144be03 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.110s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:49:39 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3fcd2ca-c570-4053-9f51-7fb786f23d20]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:49:39 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-13d17865-491a-490f-b016-5c740d02f100 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:49:39 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2086a611-973d-47a1-bb69-f2ebd144be03 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:39 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:39 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2086a611-973d-47a1-bb69-f2ebd144be03 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.033s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:49:39 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5654a49-2acf-4d10-8cda-9f9f912349b0]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:49:39 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-13d17865-491a-490f-b016-5c740d02f100 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:49:39 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2086a611-973d-47a1-bb69-f2ebd144be03 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FfsyNLOm {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:39 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2086a611-973d-47a1-bb69-f2ebd144be03 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FfsyNLOm" returned: 0 in 0.027s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:49:39 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[3010ce77-38cd-4599-b676-bd76a213fc48]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:49:39 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-13d17865-491a-490f-b016-5c740d02f100 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FfsyNLOm'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:49:39 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2086a611-973d-47a1-bb69-f2ebd144be03 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:39 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2086a611-973d-47a1-bb69-f2ebd144be03 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:49:39 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[31ee7b30-bb3a-41be-a1d0-250ae47e6aaf]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:49:39 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-13d17865-491a-490f-b016-5c740d02f100 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:49:39 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:39 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.042s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:49:39 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[62e25755-eb1b-4877-a43c-a348e4c01151]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06631b49-02a1-4759-8d9b-22b7ebdaa584 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c5fa35a-1ba5-4390-9102-83ac1dbb790a (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:563526a2-6204-4264-91b7-041e6cadab23 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc5eae50-0461-47ca-bc48-cb38087b06e0 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bebbb46-2250-4511-ba59-f4ce67e0b45d (non-flash)\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:49:39 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-13d17865-491a-490f-b016-5c740d02f100 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)
Nov 06 15:49:39 user nova-compute[75337]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6 (non-flash)
Nov 06 15:49:39 user nova-compute[75337]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06631b49-02a1-4759-8d9b-22b7ebdaa584 (non-flash)
Nov 06 15:49:39 user nova-compute[75337]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c5fa35a-1ba5-4390-9102-83ac1dbb790a (non-flash)
Nov 06 15:49:39 user nova-compute[75337]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:563526a2-6204-4264-91b7-041e6cadab23 (non-flash)
Nov 06 15:49:39 user nova-compute[75337]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc5eae50-0461-47ca-bc48-cb38087b06e0 (non-flash)
Nov 06 15:49:39 user nova-compute[75337]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bebbb46-2250-4511-ba59-f4ce67e0b45d (non-flash)
Nov 06 15:49:39 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 15:49:39 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-13d17865-491a-490f-b016-5c740d02f100 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)
Nov 06 15:49:39 user nova-compute[75337]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6 (non-flash)
Nov 06 15:49:39 user nova-compute[75337]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06631b49-02a1-4759-8d9b-22b7ebdaa584 (non-flash)
Nov 06 15:49:39 user nova-compute[75337]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c5fa35a-1ba5-4390-9102-83ac1dbb790a (non-flash)
Nov 06 15:49:39 user nova-compute[75337]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:563526a2-6204-4264-91b7-041e6cadab23 (non-flash)
Nov 06 15:49:39 user nova-compute[75337]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc5eae50-0461-47ca-bc48-cb38087b06e0 (non-flash)
Nov 06 15:49:39 user nova-compute[75337]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bebbb46-2250-4511-ba59-f4ce67e0b45d (non-flash)
Nov 06 15:49:39 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 15:49:39 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2086a611-973d-47a1-bb69-f2ebd144be03 -p 172.16.0.220:3260 --login {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:39 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2086a611-973d-47a1-bb69-f2ebd144be03 -p 172.16.0.220:3260 --login" returned: 0 in 0.086s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:49:39 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[138c5a9d-db63-433c-8bb9-d65c3c05ec02]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2086a611-973d-47a1-bb69-f2ebd144be03, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2086a611-973d-47a1-bb69-f2ebd144be03, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:49:39 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-13d17865-491a-490f-b016-5c740d02f100 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2086a611-973d-47a1-bb69-f2ebd144be03, portal: 172.16.0.220,3260]
Nov 06 15:49:39 user nova-compute[75337]: Login to [iface: default, target: iqn.2010-10.org.openstack:2086a611-973d-47a1-bb69-f2ebd144be03, portal: 172.16.0.220,3260] successful.
Nov 06 15:49:39 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:49:39 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2086a611-973d-47a1-bb69-f2ebd144be03 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:39 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2086a611-973d-47a1-bb69-f2ebd144be03 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:49:39 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ec1f537-6066-4952-9764-2953a749a677]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:49:39 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-13d17865-491a-490f-b016-5c740d02f100 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:49:39 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:39 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:49:39 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[37be424e-8167-494f-acb9-188ad6b4f2f5]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06631b49-02a1-4759-8d9b-22b7ebdaa584 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c5fa35a-1ba5-4390-9102-83ac1dbb790a (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:563526a2-6204-4264-91b7-041e6cadab23 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc5eae50-0461-47ca-bc48-cb38087b06e0 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bebbb46-2250-4511-ba59-f4ce67e0b45d (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2086a611-973d-47a1-bb69-f2ebd144be03 (non-flash)\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:49:39 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-13d17865-491a-490f-b016-5c740d02f100 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)
Nov 06 15:49:39 user nova-compute[75337]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6 (non-flash)
Nov 06 15:49:39 user nova-compute[75337]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06631b49-02a1-4759-8d9b-22b7ebdaa584 (non-flash)
Nov 06 15:49:39 user nova-compute[75337]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c5fa35a-1ba5-4390-9102-83ac1dbb790a (non-flash)
Nov 06 15:49:39 user nova-compute[75337]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:563526a2-6204-4264-91b7-041e6cadab23 (non-flash)
Nov 06 15:49:39 user nova-compute[75337]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc5eae50-0461-47ca-bc48-cb38087b06e0 (non-flash)
Nov 06 15:49:39 user nova-compute[75337]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bebbb46-2250-4511-ba59-f4ce67e0b45d (non-flash)
Nov 06 15:49:39 user nova-compute[75337]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2086a611-973d-47a1-bb69-f2ebd144be03 (non-flash)
Nov 06 15:49:39 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 15:49:39 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-13d17865-491a-490f-b016-5c740d02f100 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)
Nov 06 15:49:39 user nova-compute[75337]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6 (non-flash)
Nov 06 15:49:39 user nova-compute[75337]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06631b49-02a1-4759-8d9b-22b7ebdaa584 (non-flash)
Nov 06 15:49:39 user nova-compute[75337]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c5fa35a-1ba5-4390-9102-83ac1dbb790a (non-flash)
Nov 06 15:49:39 user nova-compute[75337]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:563526a2-6204-4264-91b7-041e6cadab23 (non-flash)
Nov 06 15:49:39 user nova-compute[75337]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc5eae50-0461-47ca-bc48-cb38087b06e0 (non-flash)
Nov 06 15:49:39 user nova-compute[75337]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bebbb46-2250-4511-ba59-f4ce67e0b45d (non-flash)
Nov 06 15:49:39 user nova-compute[75337]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2086a611-973d-47a1-bb69-f2ebd144be03 (non-flash)
Nov 06 15:49:39 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 15:49:39 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-13d17865-491a-490f-b016-5c740d02f100 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2086a611-973d-47a1-bb69-f2ebd144be03" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.463s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 15:49:39 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-13d17865-491a-490f-b016-5c740d02f100 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Connected to 172.16.0.220:3260 {{(pid=75337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 15:49:39 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-13d17865-491a-490f-b016-5c740d02f100 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] HCTL ('33', '-', '-', 0) found on session 29 with lun 0 {{(pid=75337) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 15:49:39 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-13d17865-491a-490f-b016-5c740d02f100 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75337) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 15:49:39 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:39 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.114s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:49:39 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f9dcb2a-5e7a-4a98-a805-225bbecb2fc2]: (4, ('- - 0', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:49:39 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-13d17865-491a-490f-b016-5c740d02f100 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Searching for a device in session 29 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75337) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 15:49:39 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-13d17865-491a-490f-b016-5c740d02f100 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:2086a611-973d-47a1-bb69-f2ebd144be03', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FfsyNLOm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 15:49:40 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-13d17865-491a-490f-b016-5c740d02f100 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.601s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 15:49:40 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-13d17865-491a-490f-b016-5c740d02f100 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] <== connect_volume: return (1602ms) {'type': 'block', 'scsi_wwn': '23333396438393539', 'path': '/dev/sdb'} {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 15:49:40 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-13d17865-491a-490f-b016-5c740d02f100 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 493eff79-294e-4259-a6d0-4772c4b45013] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23333396438393539', 'path': '/dev/sdb'} {{(pid=75337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 15:49:40 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-13d17865-491a-490f-b016-5c740d02f100 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T15:49:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1453395779',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1453395779',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1453395779',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJXBWFs9rtDtbfmWChuvQ9U2j/Llule54LK+NkbLD4Kvk//UeBtZmPbDLJsTQqt3tEZEAYKACUPbtVhWucUbWh1odsCyeJk59uyjQg08BCHPVspLbW2iUBoVKslwEYv+Bw==',key_name='tempest-keypair-434868357',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='915211c6a2734c36b34ff92a56b085f6',ramdisk_id='',reservation_id='r-yqw0idmm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1055092640',owner_user_name='tempest-TestVolumeBootPattern-1055092640-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T15:49:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bb8d5f0200124588be1cfde107341a45',uuid=493eff79-294e-4259-a6d0-4772c4b45013,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5e620284-83c1-40a8-91a5-c6b2c8c87a19", "address": "fa:16:3e:09:f0:4b", "network": {"id": "4e47319f-de1d-4dfe-9915-7d2d5131704d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-895093240-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "915211c6a2734c36b34ff92a56b085f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e620284-83", "ovs_interfaceid": "5e620284-83c1-40a8-91a5-c6b2c8c87a19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75337) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 15:49:40 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-13d17865-491a-490f-b016-5c740d02f100 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Converting VIF {"id": "5e620284-83c1-40a8-91a5-c6b2c8c87a19", "address": "fa:16:3e:09:f0:4b", "network": {"id": "4e47319f-de1d-4dfe-9915-7d2d5131704d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-895093240-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "915211c6a2734c36b34ff92a56b085f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e620284-83", "ovs_interfaceid": "5e620284-83c1-40a8-91a5-c6b2c8c87a19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 15:49:40 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-13d17865-491a-490f-b016-5c740d02f100 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:f0:4b,bridge_name='br-int',has_traffic_filtering=True,id=5e620284-83c1-40a8-91a5-c6b2c8c87a19,network=Network(4e47319f-de1d-4dfe-9915-7d2d5131704d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e620284-83') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 15:49:40 user nova-compute[75337]: DEBUG nova.objects.instance [None req-13d17865-491a-490f-b016-5c740d02f100 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Lazy-loading 'pci_devices' on Instance uuid 493eff79-294e-4259-a6d0-4772c4b45013 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 15:49:40 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-13d17865-491a-490f-b016-5c740d02f100 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 493eff79-294e-4259-a6d0-4772c4b45013] End _get_guest_xml xml=<domain type="kvm">
Nov 06 15:49:40 user nova-compute[75337]:   <uuid>493eff79-294e-4259-a6d0-4772c4b45013</uuid>
Nov 06 15:49:40 user nova-compute[75337]:   <name>instance-00000017</name>
Nov 06 15:49:40 user nova-compute[75337]:   <memory>524288</memory>
Nov 06 15:49:40 user nova-compute[75337]:   <vcpu>1</vcpu>
Nov 06 15:49:40 user nova-compute[75337]:   <metadata>
Nov 06 15:49:40 user nova-compute[75337]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 15:49:40 user nova-compute[75337]:       <nova:package version="0.0.0"/>
Nov 06 15:49:40 user nova-compute[75337]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-1453395779</nova:name>
Nov 06 15:49:40 user nova-compute[75337]:       <nova:creationTime>2023-11-06 15:49:38</nova:creationTime>
Nov 06 15:49:40 user nova-compute[75337]:       <nova:flavor name="m1.tiny">
Nov 06 15:49:40 user nova-compute[75337]:         <nova:memory>512</nova:memory>
Nov 06 15:49:40 user nova-compute[75337]:         <nova:disk>1</nova:disk>
Nov 06 15:49:40 user nova-compute[75337]:         <nova:swap>0</nova:swap>
Nov 06 15:49:40 user nova-compute[75337]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 15:49:40 user nova-compute[75337]:         <nova:vcpus>1</nova:vcpus>
Nov 06 15:49:40 user nova-compute[75337]:       </nova:flavor>
Nov 06 15:49:40 user nova-compute[75337]:       <nova:owner>
Nov 06 15:49:40 user nova-compute[75337]:         <nova:user uuid="bb8d5f0200124588be1cfde107341a45">tempest-TestVolumeBootPattern-1055092640-project-member</nova:user>
Nov 06 15:49:40 user nova-compute[75337]:         <nova:project uuid="915211c6a2734c36b34ff92a56b085f6">tempest-TestVolumeBootPattern-1055092640</nova:project>
Nov 06 15:49:40 user nova-compute[75337]:       </nova:owner>
Nov 06 15:49:40 user nova-compute[75337]:       <nova:ports>
Nov 06 15:49:40 user nova-compute[75337]:         <nova:port uuid="5e620284-83c1-40a8-91a5-c6b2c8c87a19">
Nov 06 15:49:40 user nova-compute[75337]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 06 15:49:40 user nova-compute[75337]:         </nova:port>
Nov 06 15:49:40 user nova-compute[75337]:       </nova:ports>
Nov 06 15:49:40 user nova-compute[75337]:     </nova:instance>
Nov 06 15:49:40 user nova-compute[75337]:   </metadata>
Nov 06 15:49:40 user nova-compute[75337]:   <sysinfo type="smbios">
Nov 06 15:49:40 user nova-compute[75337]:     <system>
Nov 06 15:49:40 user nova-compute[75337]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 15:49:40 user nova-compute[75337]:       <entry name="product">OpenStack Nova</entry>
Nov 06 15:49:40 user nova-compute[75337]:       <entry name="version">0.0.0</entry>
Nov 06 15:49:40 user nova-compute[75337]:       <entry name="serial">493eff79-294e-4259-a6d0-4772c4b45013</entry>
Nov 06 15:49:40 user nova-compute[75337]:       <entry name="uuid">493eff79-294e-4259-a6d0-4772c4b45013</entry>
Nov 06 15:49:40 user nova-compute[75337]:       <entry name="family">Virtual Machine</entry>
Nov 06 15:49:40 user nova-compute[75337]:     </system>
Nov 06 15:49:40 user nova-compute[75337]:   </sysinfo>
Nov 06 15:49:40 user nova-compute[75337]:   <os>
Nov 06 15:49:40 user nova-compute[75337]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 15:49:40 user nova-compute[75337]:     <boot dev="hd"/>
Nov 06 15:49:40 user nova-compute[75337]:     <smbios mode="sysinfo"/>
Nov 06 15:49:40 user nova-compute[75337]:   </os>
Nov 06 15:49:40 user nova-compute[75337]:   <features>
Nov 06 15:49:40 user nova-compute[75337]:     <acpi/>
Nov 06 15:49:40 user nova-compute[75337]:     <apic/>
Nov 06 15:49:40 user nova-compute[75337]:     <vmcoreinfo/>
Nov 06 15:49:40 user nova-compute[75337]:   </features>
Nov 06 15:49:40 user nova-compute[75337]:   <clock offset="utc">
Nov 06 15:49:40 user nova-compute[75337]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 15:49:40 user nova-compute[75337]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 15:49:40 user nova-compute[75337]:     <timer name="hpet" present="no"/>
Nov 06 15:49:40 user nova-compute[75337]:   </clock>
Nov 06 15:49:40 user nova-compute[75337]:   <cpu mode="custom" match="exact">
Nov 06 15:49:40 user nova-compute[75337]:     <model>Nehalem</model>
Nov 06 15:49:40 user nova-compute[75337]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 15:49:40 user nova-compute[75337]:   </cpu>
Nov 06 15:49:40 user nova-compute[75337]:   <devices>
Nov 06 15:49:40 user nova-compute[75337]:     <disk type="block" device="disk">
Nov 06 15:49:40 user nova-compute[75337]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 15:49:40 user nova-compute[75337]:       <source dev="/dev/sdb"/>
Nov 06 15:49:40 user nova-compute[75337]:       <target dev="vda" bus="virtio"/>
Nov 06 15:49:40 user nova-compute[75337]:       <serial>2086a611-973d-47a1-bb69-f2ebd144be03</serial>
Nov 06 15:49:40 user nova-compute[75337]:     </disk>
Nov 06 15:49:40 user nova-compute[75337]:     <interface type="ethernet">
Nov 06 15:49:40 user nova-compute[75337]:       <mac address="fa:16:3e:09:f0:4b"/>
Nov 06 15:49:40 user nova-compute[75337]:       <model type="virtio"/>
Nov 06 15:49:40 user nova-compute[75337]:       <mtu size="1442"/>
Nov 06 15:49:40 user nova-compute[75337]:       <target dev="tap5e620284-83"/>
Nov 06 15:49:40 user nova-compute[75337]:     </interface>
Nov 06 15:49:40 user nova-compute[75337]:     <serial type="pty">
Nov 06 15:49:40 user nova-compute[75337]:       <log file="/opt/stack/data/nova/instances/493eff79-294e-4259-a6d0-4772c4b45013/console.log" append="off"/>
Nov 06 15:49:40 user nova-compute[75337]:     </serial>
Nov 06 15:49:40 user nova-compute[75337]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 15:49:40 user nova-compute[75337]:     <video>
Nov 06 15:49:40 user nova-compute[75337]:       <model type="virtio"/>
Nov 06 15:49:40 user nova-compute[75337]:     </video>
Nov 06 15:49:40 user nova-compute[75337]:     <rng model="virtio">
Nov 06 15:49:40 user nova-compute[75337]:       <backend model="random">/dev/urandom</backend>
Nov 06 15:49:40 user nova-compute[75337]:     </rng>
Nov 06 15:49:40 user nova-compute[75337]:     <controller type="usb" index="0" model="none"/>
Nov 06 15:49:40 user nova-compute[75337]:     <memballoon model="virtio">
Nov 06 15:49:40 user nova-compute[75337]:       <stats period="10"/>
Nov 06 15:49:40 user nova-compute[75337]:     </memballoon>
Nov 06 15:49:40 user nova-compute[75337]:   </devices>
Nov 06 15:49:40 user nova-compute[75337]: </domain>
Nov 06 15:49:40 user nova-compute[75337]:  {{(pid=75337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 15:49:40 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-13d17865-491a-490f-b016-5c740d02f100 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T15:49:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1453395779',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1453395779',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1453395779',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJXBWFs9rtDtbfmWChuvQ9U2j/Llule54LK+NkbLD4Kvk//UeBtZmPbDLJsTQqt3tEZEAYKACUPbtVhWucUbWh1odsCyeJk59uyjQg08BCHPVspLbW2iUBoVKslwEYv+Bw==',key_name='tempest-keypair-434868357',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='915211c6a2734c36b34ff92a56b085f6',ramdisk_id='',reservation_id='r-yqw0idmm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1055092640',owner_user_name='tempest-TestVolumeBootPattern-1055092640-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T15:49:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bb8d5f0200124588be1cfde107341a45',uuid=493eff79-294e-4259-a6d0-4772c4b45013,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5e620284-83c1-40a8-91a5-c6b2c8c87a19", "address": "fa:16:3e:09:f0:4b", "network": {"id": "4e47319f-de1d-4dfe-9915-7d2d5131704d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-895093240-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "915211c6a2734c36b34ff92a56b085f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e620284-83", "ovs_interfaceid": "5e620284-83c1-40a8-91a5-c6b2c8c87a19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 15:49:40 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-13d17865-491a-490f-b016-5c740d02f100 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Converting VIF {"id": "5e620284-83c1-40a8-91a5-c6b2c8c87a19", "address": "fa:16:3e:09:f0:4b", "network": {"id": "4e47319f-de1d-4dfe-9915-7d2d5131704d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-895093240-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "915211c6a2734c36b34ff92a56b085f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e620284-83", "ovs_interfaceid": "5e620284-83c1-40a8-91a5-c6b2c8c87a19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 15:49:40 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-13d17865-491a-490f-b016-5c740d02f100 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:f0:4b,bridge_name='br-int',has_traffic_filtering=True,id=5e620284-83c1-40a8-91a5-c6b2c8c87a19,network=Network(4e47319f-de1d-4dfe-9915-7d2d5131704d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e620284-83') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 15:49:40 user nova-compute[75337]: DEBUG os_vif [None req-13d17865-491a-490f-b016-5c740d02f100 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:f0:4b,bridge_name='br-int',has_traffic_filtering=True,id=5e620284-83c1-40a8-91a5-c6b2c8c87a19,network=Network(4e47319f-de1d-4dfe-9915-7d2d5131704d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e620284-83') {{(pid=75337) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 15:49:40 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:40 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:49:40 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 15:49:40 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:40 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e09e6fda-e163-54fa-b951-0192cd2e752a', '_type': 'linux-noop'}}, row=False) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:49:40 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:49:40 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:40 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5e620284-83, may_exist=True, interface_attrs={}) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:49:40 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5e620284-83, col_values=(('qos', UUID('d30d2400-fbb7-4bba-8906-6727693aad76')),), if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:49:40 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5e620284-83, col_values=(('external_ids', {'iface-id': '5e620284-83c1-40a8-91a5-c6b2c8c87a19', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:09:f0:4b', 'vm-uuid': '493eff79-294e-4259-a6d0-4772c4b45013'}),), if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:49:40 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:40 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:49:40 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:40 user nova-compute[75337]: INFO os_vif [None req-13d17865-491a-490f-b016-5c740d02f100 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:f0:4b,bridge_name='br-int',has_traffic_filtering=True,id=5e620284-83c1-40a8-91a5-c6b2c8c87a19,network=Network(4e47319f-de1d-4dfe-9915-7d2d5131704d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e620284-83')
Nov 06 15:49:40 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-13d17865-491a-490f-b016-5c740d02f100 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] No BDM found with device name vda, not building metadata. {{(pid=75337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 15:49:40 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-13d17865-491a-490f-b016-5c740d02f100 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] No VIF found with MAC fa:16:3e:09:f0:4b, not building metadata {{(pid=75337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 15:49:41 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:42 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:42 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:42 user nova-compute[75337]: DEBUG nova.compute.manager [req-3dc3fbe0-092e-42bc-9c76-bc33d8c9182f req-44983b4d-5647-4d3a-be2b-1043028e9dc8 service nova] [instance: 493eff79-294e-4259-a6d0-4772c4b45013] Received event network-vif-plugged-5e620284-83c1-40a8-91a5-c6b2c8c87a19 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:49:42 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-3dc3fbe0-092e-42bc-9c76-bc33d8c9182f req-44983b4d-5647-4d3a-be2b-1043028e9dc8 service nova] Acquiring lock "493eff79-294e-4259-a6d0-4772c4b45013-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:49:42 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-3dc3fbe0-092e-42bc-9c76-bc33d8c9182f req-44983b4d-5647-4d3a-be2b-1043028e9dc8 service nova] Lock "493eff79-294e-4259-a6d0-4772c4b45013-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:49:42 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-3dc3fbe0-092e-42bc-9c76-bc33d8c9182f req-44983b4d-5647-4d3a-be2b-1043028e9dc8 service nova] Lock "493eff79-294e-4259-a6d0-4772c4b45013-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:49:42 user nova-compute[75337]: DEBUG nova.compute.manager [req-3dc3fbe0-092e-42bc-9c76-bc33d8c9182f req-44983b4d-5647-4d3a-be2b-1043028e9dc8 service nova] [instance: 493eff79-294e-4259-a6d0-4772c4b45013] No waiting events found dispatching network-vif-plugged-5e620284-83c1-40a8-91a5-c6b2c8c87a19 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:49:42 user nova-compute[75337]: WARNING nova.compute.manager [req-3dc3fbe0-092e-42bc-9c76-bc33d8c9182f req-44983b4d-5647-4d3a-be2b-1043028e9dc8 service nova] [instance: 493eff79-294e-4259-a6d0-4772c4b45013] Received unexpected event network-vif-plugged-5e620284-83c1-40a8-91a5-c6b2c8c87a19 for instance with vm_state building and task_state spawning.
Nov 06 15:49:42 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:42 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:42 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:42 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:44 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:44 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-60ea09e3-1b8a-4acc-8e6a-320ddf88dbad tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Acquiring lock "bc0e07f8-2731-4ffa-8446-b71ad3ba7375" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:49:44 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-60ea09e3-1b8a-4acc-8e6a-320ddf88dbad tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Lock "bc0e07f8-2731-4ffa-8446-b71ad3ba7375" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:49:44 user nova-compute[75337]: INFO nova.compute.manager [None req-60ea09e3-1b8a-4acc-8e6a-320ddf88dbad tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] [instance: bc0e07f8-2731-4ffa-8446-b71ad3ba7375] Rebooting instance
Nov 06 15:49:44 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-60ea09e3-1b8a-4acc-8e6a-320ddf88dbad tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Acquiring lock "refresh_cache-bc0e07f8-2731-4ffa-8446-b71ad3ba7375" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 15:49:44 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-60ea09e3-1b8a-4acc-8e6a-320ddf88dbad tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Acquired lock "refresh_cache-bc0e07f8-2731-4ffa-8446-b71ad3ba7375" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 15:49:44 user nova-compute[75337]: DEBUG nova.network.neutron [None req-60ea09e3-1b8a-4acc-8e6a-320ddf88dbad tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] [instance: bc0e07f8-2731-4ffa-8446-b71ad3ba7375] Building network info cache for instance {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 15:49:44 user nova-compute[75337]: DEBUG nova.compute.manager [req-e4b7c823-8626-4f5f-84f3-d664332d1a68 req-6714e1b4-e300-485b-b35e-dc8b0b1b7c95 service nova] [instance: 493eff79-294e-4259-a6d0-4772c4b45013] Received event network-vif-plugged-5e620284-83c1-40a8-91a5-c6b2c8c87a19 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:49:44 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-e4b7c823-8626-4f5f-84f3-d664332d1a68 req-6714e1b4-e300-485b-b35e-dc8b0b1b7c95 service nova] Acquiring lock "493eff79-294e-4259-a6d0-4772c4b45013-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:49:44 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-e4b7c823-8626-4f5f-84f3-d664332d1a68 req-6714e1b4-e300-485b-b35e-dc8b0b1b7c95 service nova] Lock "493eff79-294e-4259-a6d0-4772c4b45013-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:49:44 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-e4b7c823-8626-4f5f-84f3-d664332d1a68 req-6714e1b4-e300-485b-b35e-dc8b0b1b7c95 service nova] Lock "493eff79-294e-4259-a6d0-4772c4b45013-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:49:44 user nova-compute[75337]: DEBUG nova.compute.manager [req-e4b7c823-8626-4f5f-84f3-d664332d1a68 req-6714e1b4-e300-485b-b35e-dc8b0b1b7c95 service nova] [instance: 493eff79-294e-4259-a6d0-4772c4b45013] No waiting events found dispatching network-vif-plugged-5e620284-83c1-40a8-91a5-c6b2c8c87a19 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:49:44 user nova-compute[75337]: WARNING nova.compute.manager [req-e4b7c823-8626-4f5f-84f3-d664332d1a68 req-6714e1b4-e300-485b-b35e-dc8b0b1b7c95 service nova] [instance: 493eff79-294e-4259-a6d0-4772c4b45013] Received unexpected event network-vif-plugged-5e620284-83c1-40a8-91a5-c6b2c8c87a19 for instance with vm_state building and task_state spawning.
Nov 06 15:49:44 user nova-compute[75337]: DEBUG nova.compute.manager [None req-13d17865-491a-490f-b016-5c740d02f100 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 493eff79-294e-4259-a6d0-4772c4b45013] Instance event wait completed in 0 seconds for  {{(pid=75337) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 15:49:44 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-13d17865-491a-490f-b016-5c740d02f100 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 493eff79-294e-4259-a6d0-4772c4b45013] Guest created on hypervisor {{(pid=75337) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 15:49:44 user nova-compute[75337]: INFO nova.virt.libvirt.driver [-] [instance: 493eff79-294e-4259-a6d0-4772c4b45013] Instance spawned successfully.
Nov 06 15:49:44 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-13d17865-491a-490f-b016-5c740d02f100 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 493eff79-294e-4259-a6d0-4772c4b45013] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 15:49:44 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-13d17865-491a-490f-b016-5c740d02f100 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 493eff79-294e-4259-a6d0-4772c4b45013] Found default for hw_cdrom_bus of ide {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:49:44 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-13d17865-491a-490f-b016-5c740d02f100 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 493eff79-294e-4259-a6d0-4772c4b45013] Found default for hw_disk_bus of virtio {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:49:44 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-13d17865-491a-490f-b016-5c740d02f100 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 493eff79-294e-4259-a6d0-4772c4b45013] Found default for hw_input_bus of None {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:49:44 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-13d17865-491a-490f-b016-5c740d02f100 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 493eff79-294e-4259-a6d0-4772c4b45013] Found default for hw_pointer_model of None {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:49:44 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-13d17865-491a-490f-b016-5c740d02f100 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 493eff79-294e-4259-a6d0-4772c4b45013] Found default for hw_video_model of virtio {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:49:44 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-13d17865-491a-490f-b016-5c740d02f100 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 493eff79-294e-4259-a6d0-4772c4b45013] Found default for hw_vif_model of virtio {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:49:44 user nova-compute[75337]: INFO nova.compute.manager [None req-13d17865-491a-490f-b016-5c740d02f100 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 493eff79-294e-4259-a6d0-4772c4b45013] Took 6.05 seconds to spawn the instance on the hypervisor.
Nov 06 15:49:44 user nova-compute[75337]: DEBUG nova.compute.manager [None req-13d17865-491a-490f-b016-5c740d02f100 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 493eff79-294e-4259-a6d0-4772c4b45013] Checking state {{(pid=75337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 15:49:44 user nova-compute[75337]: INFO nova.compute.manager [None req-13d17865-491a-490f-b016-5c740d02f100 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 493eff79-294e-4259-a6d0-4772c4b45013] Took 37.84 seconds to build instance.
Nov 06 15:49:45 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-13d17865-491a-490f-b016-5c740d02f100 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Lock "493eff79-294e-4259-a6d0-4772c4b45013" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 38.088s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:49:45 user nova-compute[75337]: DEBUG nova.network.neutron [None req-60ea09e3-1b8a-4acc-8e6a-320ddf88dbad tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] [instance: bc0e07f8-2731-4ffa-8446-b71ad3ba7375] Updating instance_info_cache with network_info: [{"id": "a20e3f62-5387-4f54-b623-d45a0a311da0", "address": "fa:16:3e:fe:62:24", "network": {"id": "c31b513a-57f0-4bd5-b055-4a363aae9793", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1352256985-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cddccc86bf54fe981667da5ef13fa8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa20e3f62-53", "ovs_interfaceid": "a20e3f62-5387-4f54-b623-d45a0a311da0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:49:45 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-60ea09e3-1b8a-4acc-8e6a-320ddf88dbad tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Releasing lock "refresh_cache-bc0e07f8-2731-4ffa-8446-b71ad3ba7375" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 15:49:45 user nova-compute[75337]: DEBUG nova.compute.manager [None req-60ea09e3-1b8a-4acc-8e6a-320ddf88dbad tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] [instance: bc0e07f8-2731-4ffa-8446-b71ad3ba7375] Checking state {{(pid=75337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 15:49:45 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:45 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:45 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:45 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:45 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:45 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:45 user nova-compute[75337]: DEBUG nova.compute.manager [req-25ff1c00-aabe-40d4-9665-6840f998ead3 req-84c46cdd-3530-4d78-baae-c7cab3c2b934 service nova] [instance: bc0e07f8-2731-4ffa-8446-b71ad3ba7375] Received event network-vif-unplugged-a20e3f62-5387-4f54-b623-d45a0a311da0 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:49:45 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-25ff1c00-aabe-40d4-9665-6840f998ead3 req-84c46cdd-3530-4d78-baae-c7cab3c2b934 service nova] Acquiring lock "bc0e07f8-2731-4ffa-8446-b71ad3ba7375-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:49:45 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-25ff1c00-aabe-40d4-9665-6840f998ead3 req-84c46cdd-3530-4d78-baae-c7cab3c2b934 service nova] Lock "bc0e07f8-2731-4ffa-8446-b71ad3ba7375-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:49:45 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-25ff1c00-aabe-40d4-9665-6840f998ead3 req-84c46cdd-3530-4d78-baae-c7cab3c2b934 service nova] Lock "bc0e07f8-2731-4ffa-8446-b71ad3ba7375-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:49:45 user nova-compute[75337]: DEBUG nova.compute.manager [req-25ff1c00-aabe-40d4-9665-6840f998ead3 req-84c46cdd-3530-4d78-baae-c7cab3c2b934 service nova] [instance: bc0e07f8-2731-4ffa-8446-b71ad3ba7375] No waiting events found dispatching network-vif-unplugged-a20e3f62-5387-4f54-b623-d45a0a311da0 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:49:45 user nova-compute[75337]: WARNING nova.compute.manager [req-25ff1c00-aabe-40d4-9665-6840f998ead3 req-84c46cdd-3530-4d78-baae-c7cab3c2b934 service nova] [instance: bc0e07f8-2731-4ffa-8446-b71ad3ba7375] Received unexpected event network-vif-unplugged-a20e3f62-5387-4f54-b623-d45a0a311da0 for instance with vm_state active and task_state reboot_started_hard.
Nov 06 15:49:46 user nova-compute[75337]: INFO nova.virt.libvirt.driver [-] [instance: bc0e07f8-2731-4ffa-8446-b71ad3ba7375] Instance destroyed successfully.
Nov 06 15:49:46 user nova-compute[75337]: DEBUG nova.objects.instance [None req-60ea09e3-1b8a-4acc-8e6a-320ddf88dbad tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Lazy-loading 'resources' on Instance uuid bc0e07f8-2731-4ffa-8446-b71ad3ba7375 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 15:49:46 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-60ea09e3-1b8a-4acc-8e6a-320ddf88dbad tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T15:46:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-305187601',display_name='tempest-TestMinimumBasicScenario-server-305187601',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-305187601',id=18,image_ref='34019a0c-32a9-485d-804a-abd50629cecb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLMTKRITbHOLi89utrqUrkdP7dp3D8u9fFIU8oK5Js2SaB/mlBSEFV4qG+zv1B+MrEcRr1Y6SUvYeu3ob8SsC0tPJypxoBps0L8MoitNXMQw8ZATzL/xbi+Lgg+BOq0dGA==',key_name='tempest-TestMinimumBasicScenario-1417411849',keypairs=<?>,launch_index=0,launched_at=2023-11-06T15:46:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2cddccc86bf54fe981667da5ef13fa8a',ramdisk_id='',reservation_id='r-p3ne9skw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='34019a0c-32a9-485d-804a-abd50629cecb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-2098539193',owner_user_name='tempest-TestMinimumBasicScenario-2098539193-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T15:49:46Z,user_data=None,user_id='8c795ee993a944ff89ed544450b90dc2',uuid=bc0e07f8-2731-4ffa-8446-b71ad3ba7375,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a20e3f62-5387-4f54-b623-d45a0a311da0", "address": "fa:16:3e:fe:62:24", "network": {"id": "c31b513a-57f0-4bd5-b055-4a363aae9793", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1352256985-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cddccc86bf54fe981667da5ef13fa8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa20e3f62-53", "ovs_interfaceid": "a20e3f62-5387-4f54-b623-d45a0a311da0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 15:49:46 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-60ea09e3-1b8a-4acc-8e6a-320ddf88dbad tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Converting VIF {"id": "a20e3f62-5387-4f54-b623-d45a0a311da0", "address": "fa:16:3e:fe:62:24", "network": {"id": "c31b513a-57f0-4bd5-b055-4a363aae9793", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1352256985-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cddccc86bf54fe981667da5ef13fa8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa20e3f62-53", "ovs_interfaceid": "a20e3f62-5387-4f54-b623-d45a0a311da0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 15:49:46 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-60ea09e3-1b8a-4acc-8e6a-320ddf88dbad tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fe:62:24,bridge_name='br-int',has_traffic_filtering=True,id=a20e3f62-5387-4f54-b623-d45a0a311da0,network=Network(c31b513a-57f0-4bd5-b055-4a363aae9793),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa20e3f62-53') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 15:49:46 user nova-compute[75337]: DEBUG os_vif [None req-60ea09e3-1b8a-4acc-8e6a-320ddf88dbad tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fe:62:24,bridge_name='br-int',has_traffic_filtering=True,id=a20e3f62-5387-4f54-b623-d45a0a311da0,network=Network(c31b513a-57f0-4bd5-b055-4a363aae9793),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa20e3f62-53') {{(pid=75337) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 15:49:46 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:46 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa20e3f62-53, bridge=br-int, if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:49:46 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:46 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:46 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:46 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=29c45ad1-069e-4f97-8d3e-ea6cbb33a995) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:49:46 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:46 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:46 user nova-compute[75337]: INFO os_vif [None req-60ea09e3-1b8a-4acc-8e6a-320ddf88dbad tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fe:62:24,bridge_name='br-int',has_traffic_filtering=True,id=a20e3f62-5387-4f54-b623-d45a0a311da0,network=Network(c31b513a-57f0-4bd5-b055-4a363aae9793),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa20e3f62-53')
Nov 06 15:49:46 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60ea09e3-1b8a-4acc-8e6a-320ddf88dbad tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] [instance: bc0e07f8-2731-4ffa-8446-b71ad3ba7375] calling os-brick to detach iSCSI Volume {{(pid=75337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 15:49:46 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-60ea09e3-1b8a-4acc-8e6a-320ddf88dbad tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2abc33d0c0>, {'target_iqn': 'iqn.2010-10.org.openstack:dc5eae50-0461-47ca-bc48-cb38087b06e0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oFQjZJSv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': True}}" {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 15:49:46 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-60ea09e3-1b8a-4acc-8e6a-320ddf88dbad tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 15:49:46 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-60ea09e3-1b8a-4acc-8e6a-320ddf88dbad tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 15:49:46 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-60ea09e3-1b8a-4acc-8e6a-320ddf88dbad tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 15:49:46 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:46 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:49:46 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[02f9d361-8bb8-4839-8305-088afd498297]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1bebbb46-2250-4511-ba59-f4ce67e0b45d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:563526a2-6204-4264-91b7-041e6cadab23\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dc5eae50-0461-47ca-bc48-cb38087b06e0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:06631b49-02a1-4759-8d9b-22b7ebdaa584\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2086a611-973d-47a1-bb69-f2ebd144be03\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0c5fa35a-1ba5-4390-9102-83ac1dbb790a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:49:46 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-60ea09e3-1b8a-4acc-8e6a-320ddf88dbad tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 15:49:46 user nova-compute[75337]: No targets found.
Nov 06 15:49:46 user nova-compute[75337]: iSNS:
Nov 06 15:49:46 user nova-compute[75337]: No targets found.
Nov 06 15:49:46 user nova-compute[75337]: STATIC:
Nov 06 15:49:46 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:1bebbb46-2250-4511-ba59-f4ce67e0b45d
Nov 06 15:49:46 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 15:49:46 user nova-compute[75337]:                 Iface Name: default
Nov 06 15:49:46 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158
Nov 06 15:49:46 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 15:49:46 user nova-compute[75337]:                 Iface Name: default
Nov 06 15:49:46 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:563526a2-6204-4264-91b7-041e6cadab23
Nov 06 15:49:46 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 15:49:46 user nova-compute[75337]:                 Iface Name: default
Nov 06 15:49:46 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:dc5eae50-0461-47ca-bc48-cb38087b06e0
Nov 06 15:49:46 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 15:49:46 user nova-compute[75337]:                 Iface Name: default
Nov 06 15:49:46 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6
Nov 06 15:49:46 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 15:49:46 user nova-compute[75337]:                 Iface Name: default
Nov 06 15:49:46 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:06631b49-02a1-4759-8d9b-22b7ebdaa584
Nov 06 15:49:46 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 15:49:46 user nova-compute[75337]:                 Iface Name: default
Nov 06 15:49:46 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:2086a611-973d-47a1-bb69-f2ebd144be03
Nov 06 15:49:46 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 15:49:46 user nova-compute[75337]:                 Iface Name: default
Nov 06 15:49:46 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:0c5fa35a-1ba5-4390-9102-83ac1dbb790a
Nov 06 15:49:46 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 15:49:46 user nova-compute[75337]:                 Iface Name: default
Nov 06 15:49:46 user nova-compute[75337]: FIRMWARE:
Nov 06 15:49:46 user nova-compute[75337]: No targets found.
Nov 06 15:49:46 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 15:49:46 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-60ea09e3-1b8a-4acc-8e6a-320ddf88dbad tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 15:49:46 user nova-compute[75337]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 15:49:46 user nova-compute[75337]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75337) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 15:49:46 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-60ea09e3-1b8a-4acc-8e6a-320ddf88dbad tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dc5eae50-0461-47ca-bc48-cb38087b06e0', 0)] {{(pid=75337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 15:49:46 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:46 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:49:46 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[6035cf63-78d5-4229-9d1d-e04142b3b1dc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:06631b49-02a1-4759-8d9b-22b7ebdaa584\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c5fa35a-1ba5-4390-9102-83ac1dbb790a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1bebbb46-2250-4511-ba59-f4ce67e0b45d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2086a611-973d-47a1-bb69-f2ebd144be03\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:563526a2-6204-4264-91b7-041e6cadab23\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dc5eae50-0461-47ca-bc48-cb38087b06e0\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:49:46 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:46 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:49:46 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[f442dd45-dac7-4fa0-a759-1c02a2e093c5]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06631b49-02a1-4759-8d9b-22b7ebdaa584 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c5fa35a-1ba5-4390-9102-83ac1dbb790a (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:563526a2-6204-4264-91b7-041e6cadab23 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc5eae50-0461-47ca-bc48-cb38087b06e0 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bebbb46-2250-4511-ba59-f4ce67e0b45d (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2086a611-973d-47a1-bb69-f2ebd144be03 (non-flash)\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:49:46 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-60ea09e3-1b8a-4acc-8e6a-320ddf88dbad tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)
Nov 06 15:49:46 user nova-compute[75337]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6 (non-flash)
Nov 06 15:49:46 user nova-compute[75337]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06631b49-02a1-4759-8d9b-22b7ebdaa584 (non-flash)
Nov 06 15:49:46 user nova-compute[75337]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c5fa35a-1ba5-4390-9102-83ac1dbb790a (non-flash)
Nov 06 15:49:46 user nova-compute[75337]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:563526a2-6204-4264-91b7-041e6cadab23 (non-flash)
Nov 06 15:49:46 user nova-compute[75337]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc5eae50-0461-47ca-bc48-cb38087b06e0 (non-flash)
Nov 06 15:49:46 user nova-compute[75337]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bebbb46-2250-4511-ba59-f4ce67e0b45d (non-flash)
Nov 06 15:49:46 user nova-compute[75337]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2086a611-973d-47a1-bb69-f2ebd144be03 (non-flash)
Nov 06 15:49:46 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 15:49:46 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-60ea09e3-1b8a-4acc-8e6a-320ddf88dbad tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)
Nov 06 15:49:46 user nova-compute[75337]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6 (non-flash)
Nov 06 15:49:46 user nova-compute[75337]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06631b49-02a1-4759-8d9b-22b7ebdaa584 (non-flash)
Nov 06 15:49:46 user nova-compute[75337]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c5fa35a-1ba5-4390-9102-83ac1dbb790a (non-flash)
Nov 06 15:49:46 user nova-compute[75337]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:563526a2-6204-4264-91b7-041e6cadab23 (non-flash)
Nov 06 15:49:46 user nova-compute[75337]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc5eae50-0461-47ca-bc48-cb38087b06e0 (non-flash)
Nov 06 15:49:46 user nova-compute[75337]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bebbb46-2250-4511-ba59-f4ce67e0b45d (non-flash)
Nov 06 15:49:46 user nova-compute[75337]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2086a611-973d-47a1-bb69-f2ebd144be03 (non-flash)
Nov 06 15:49:46 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 15:49:46 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-60ea09e3-1b8a-4acc-8e6a-320ddf88dbad tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2a9c429b40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dc5eae50-0461-47ca-bc48-cb38087b06e0'): ({'sdi'}, set())}) {{(pid=75337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 15:49:46 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-60ea09e3-1b8a-4acc-8e6a-320ddf88dbad tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Removing single pathed devices sdi {{(pid=75337) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 15:49:46 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:46 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:49:46 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4880ccc-74a8-4f37-afb4-ec8171db3bd3]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:49:46 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:46 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.022s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:49:46 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[55d9c2c6-ce00-456e-bbb2-2fa5c0811bc6]: (4, ('ok\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:49:46 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-60ea09e3-1b8a-4acc-8e6a-320ddf88dbad tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Flushing IO for device /dev/sdi {{(pid=75337) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 15:49:46 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:46 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.017s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:49:46 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c4455cc-c8df-4477-aa72-44cf95a4a6a0]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:49:46 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-60ea09e3-1b8a-4acc-8e6a-320ddf88dbad tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=75337) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 15:49:46 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:46 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.045s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:49:46 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[5972ec00-d5c0-4d44-8454-b118ba492733]: (4, ('1', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:49:46 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-60ea09e3-1b8a-4acc-8e6a-320ddf88dbad tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=75337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 15:49:46 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-60ea09e3-1b8a-4acc-8e6a-320ddf88dbad tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] SCSI volumes sdi have been removed. {{(pid=75337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 15:49:46 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-60ea09e3-1b8a-4acc-8e6a-320ddf88dbad tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dc5eae50-0461-47ca-bc48-cb38087b06e0')] {{(pid=75337) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 15:49:46 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc5eae50-0461-47ca-bc48-cb38087b06e0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:46 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc5eae50-0461-47ca-bc48-cb38087b06e0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:49:46 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c3dff49-302a-4a4a-a2ec-e0e023fb257e]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:49:46 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-60ea09e3-1b8a-4acc-8e6a-320ddf88dbad tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:49:46 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc5eae50-0461-47ca-bc48-cb38087b06e0 -p 172.16.0.220:3260 --logout {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:46 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc5eae50-0461-47ca-bc48-cb38087b06e0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.081s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:49:46 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0c4e073-ebff-4447-8fe9-897091f2473a]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:dc5eae50-0461-47ca-bc48-cb38087b06e0, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:dc5eae50-0461-47ca-bc48-cb38087b06e0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:49:46 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-60ea09e3-1b8a-4acc-8e6a-320ddf88dbad tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:dc5eae50-0461-47ca-bc48-cb38087b06e0, portal: 172.16.0.220,3260]
Nov 06 15:49:46 user nova-compute[75337]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:dc5eae50-0461-47ca-bc48-cb38087b06e0, portal: 172.16.0.220,3260] successful.
Nov 06 15:49:46 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:49:46 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc5eae50-0461-47ca-bc48-cb38087b06e0 -p 172.16.0.220:3260 --op delete {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:46 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc5eae50-0461-47ca-bc48-cb38087b06e0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:49:46 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[2822b694-e59c-45ba-9d8e-d28e42c93058]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:49:46 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-60ea09e3-1b8a-4acc-8e6a-320ddf88dbad tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:49:46 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-60ea09e3-1b8a-4acc-8e6a-320ddf88dbad tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.400s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 15:49:46 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-60ea09e3-1b8a-4acc-8e6a-320ddf88dbad tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] <== disconnect_volume: return (401ms) None {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 15:49:46 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60ea09e3-1b8a-4acc-8e6a-320ddf88dbad tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] [instance: bc0e07f8-2731-4ffa-8446-b71ad3ba7375] Disconnected iSCSI Volume {{(pid=75337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 15:49:46 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-60ea09e3-1b8a-4acc-8e6a-320ddf88dbad tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] [instance: bc0e07f8-2731-4ffa-8446-b71ad3ba7375] Start _get_guest_xml network_info=[{"id": "a20e3f62-5387-4f54-b623-d45a0a311da0", "address": "fa:16:3e:fe:62:24", "network": {"id": "c31b513a-57f0-4bd5-b055-4a363aae9793", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1352256985-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cddccc86bf54fe981667da5ef13fa8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa20e3f62-53", "ovs_interfaceid": "a20e3f62-5387-4f54-b623-d45a0a311da0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=34019a0c-32a9-485d-804a-abd50629cecb,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'guest_format': None, 'size': 0, 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '34019a0c-32a9-485d-804a-abd50629cecb'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'attachment_id': '10c84612-5da2-4a8e-8a57-82c99924cb8a', 'guest_format': None, 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:dc5eae50-0461-47ca-bc48-cb38087b06e0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oFQjZJSv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, 'status': 'reserved', 'instance': 'bc0e07f8-2731-4ffa-8446-b71ad3ba7375', 'attached_at': '', 'detached_at': '', 'volume_id': 'dc5eae50-0461-47ca-bc48-cb38087b06e0', 'serial': 'dc5eae50-0461-47ca-bc48-cb38087b06e0'}, 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=75337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 15:49:46 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-60ea09e3-1b8a-4acc-8e6a-320ddf88dbad tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 15:49:46 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-60ea09e3-1b8a-4acc-8e6a-320ddf88dbad tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 15:49:46 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-60ea09e3-1b8a-4acc-8e6a-320ddf88dbad tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 15:49:46 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-60ea09e3-1b8a-4acc-8e6a-320ddf88dbad tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] CPU controller missing on host. {{(pid=75337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 15:49:46 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-60ea09e3-1b8a-4acc-8e6a-320ddf88dbad tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 15:49:46 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-60ea09e3-1b8a-4acc-8e6a-320ddf88dbad tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] CPU controller found on host. {{(pid=75337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 15:49:46 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-60ea09e3-1b8a-4acc-8e6a-320ddf88dbad tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75337) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 15:49:46 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-60ea09e3-1b8a-4acc-8e6a-320ddf88dbad tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T15:34:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=34019a0c-32a9-485d-804a-abd50629cecb,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 15:49:46 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-60ea09e3-1b8a-4acc-8e6a-320ddf88dbad tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Flavor limits 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 15:49:46 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-60ea09e3-1b8a-4acc-8e6a-320ddf88dbad tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Image limits 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 15:49:46 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-60ea09e3-1b8a-4acc-8e6a-320ddf88dbad tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Flavor pref 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 15:49:46 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-60ea09e3-1b8a-4acc-8e6a-320ddf88dbad tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Image pref 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 15:49:46 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-60ea09e3-1b8a-4acc-8e6a-320ddf88dbad tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 15:49:46 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-60ea09e3-1b8a-4acc-8e6a-320ddf88dbad tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 15:49:46 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-60ea09e3-1b8a-4acc-8e6a-320ddf88dbad tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 15:49:46 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-60ea09e3-1b8a-4acc-8e6a-320ddf88dbad tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Got 1 possible topologies {{(pid=75337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 15:49:46 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-60ea09e3-1b8a-4acc-8e6a-320ddf88dbad tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 15:49:46 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-60ea09e3-1b8a-4acc-8e6a-320ddf88dbad tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 15:49:46 user nova-compute[75337]: DEBUG nova.objects.instance [None req-60ea09e3-1b8a-4acc-8e6a-320ddf88dbad tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Lazy-loading 'vcpu_model' on Instance uuid bc0e07f8-2731-4ffa-8446-b71ad3ba7375 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 15:49:47 user nova-compute[75337]: DEBUG nova.objects.base [None req-60ea09e3-1b8a-4acc-8e6a-320ddf88dbad tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Object Instance<bc0e07f8-2731-4ffa-8446-b71ad3ba7375> lazy-loaded attributes: resources,vcpu_model {{(pid=75337) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 15:49:47 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60ea09e3-1b8a-4acc-8e6a-320ddf88dbad tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] [instance: bc0e07f8-2731-4ffa-8446-b71ad3ba7375] Calling os-brick to attach iSCSI Volume {{(pid=75337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 15:49:47 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-60ea09e3-1b8a-4acc-8e6a-320ddf88dbad tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2abc33d0c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:dc5eae50-0461-47ca-bc48-cb38087b06e0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oFQjZJSv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 15:49:47 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-60ea09e3-1b8a-4acc-8e6a-320ddf88dbad tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 15:49:47 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-60ea09e3-1b8a-4acc-8e6a-320ddf88dbad tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 15:49:47 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-60ea09e3-1b8a-4acc-8e6a-320ddf88dbad tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 15:49:47 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-60ea09e3-1b8a-4acc-8e6a-320ddf88dbad tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 15:49:47 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-60ea09e3-1b8a-4acc-8e6a-320ddf88dbad tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dc5eae50-0461-47ca-bc48-cb38087b06e0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 15:49:47 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-60ea09e3-1b8a-4acc-8e6a-320ddf88dbad tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dc5eae50-0461-47ca-bc48-cb38087b06e0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 15:49:47 user nova-compute[75337]: INFO os_brick.initiator.connectors.iscsi [None req-60ea09e3-1b8a-4acc-8e6a-320ddf88dbad tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 15:49:47 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc5eae50-0461-47ca-bc48-cb38087b06e0 -p 172.16.0.220:3260 {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:47 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc5eae50-0461-47ca-bc48-cb38087b06e0 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:49:47 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[984f7ef0-fa2e-4273-915d-98868da3658b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:49:47 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-60ea09e3-1b8a-4acc-8e6a-320ddf88dbad tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 15:49:47 user nova-compute[75337]:  {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:49:47 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc5eae50-0461-47ca-bc48-cb38087b06e0 -p 172.16.0.220:3260 --interface default --op new {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:47 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc5eae50-0461-47ca-bc48-cb38087b06e0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:49:47 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff956957-dabf-40f3-807e-9c0f27fd7d83]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dc5eae50-0461-47ca-bc48-cb38087b06e0] added\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:49:47 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-60ea09e3-1b8a-4acc-8e6a-320ddf88dbad tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dc5eae50-0461-47ca-bc48-cb38087b06e0] added
Nov 06 15:49:47 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:49:47 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc5eae50-0461-47ca-bc48-cb38087b06e0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:47 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc5eae50-0461-47ca-bc48-cb38087b06e0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.174s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:49:47 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f9abb77-3ef2-4c6b-ad2b-8c14e898c734]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:49:47 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-60ea09e3-1b8a-4acc-8e6a-320ddf88dbad tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:49:47 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc5eae50-0461-47ca-bc48-cb38087b06e0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:47 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc5eae50-0461-47ca-bc48-cb38087b06e0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.032s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:49:47 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[97e757d2-3aaf-4d73-87a8-d525ff7c39a7]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:49:47 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-60ea09e3-1b8a-4acc-8e6a-320ddf88dbad tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:49:47 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc5eae50-0461-47ca-bc48-cb38087b06e0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oFQjZJSv {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:47 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc5eae50-0461-47ca-bc48-cb38087b06e0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oFQjZJSv" returned: 0 in 0.024s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:49:47 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[29bf3bfc-c67b-4383-a529-1b7a2da9fa79]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:49:47 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-60ea09e3-1b8a-4acc-8e6a-320ddf88dbad tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oFQjZJSv'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:49:47 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc5eae50-0461-47ca-bc48-cb38087b06e0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:47 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc5eae50-0461-47ca-bc48-cb38087b06e0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:49:47 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d07cb79-8e2f-44a7-be6b-a1b9bfa1a8fb]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:49:47 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-60ea09e3-1b8a-4acc-8e6a-320ddf88dbad tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:49:47 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:47 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:49:47 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[0089b063-23d8-442b-865f-a6d5148c2107]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06631b49-02a1-4759-8d9b-22b7ebdaa584 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c5fa35a-1ba5-4390-9102-83ac1dbb790a (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:563526a2-6204-4264-91b7-041e6cadab23 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bebbb46-2250-4511-ba59-f4ce67e0b45d (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2086a611-973d-47a1-bb69-f2ebd144be03 (non-flash)\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:49:47 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-60ea09e3-1b8a-4acc-8e6a-320ddf88dbad tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)
Nov 06 15:49:47 user nova-compute[75337]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6 (non-flash)
Nov 06 15:49:47 user nova-compute[75337]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06631b49-02a1-4759-8d9b-22b7ebdaa584 (non-flash)
Nov 06 15:49:47 user nova-compute[75337]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c5fa35a-1ba5-4390-9102-83ac1dbb790a (non-flash)
Nov 06 15:49:47 user nova-compute[75337]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:563526a2-6204-4264-91b7-041e6cadab23 (non-flash)
Nov 06 15:49:47 user nova-compute[75337]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bebbb46-2250-4511-ba59-f4ce67e0b45d (non-flash)
Nov 06 15:49:47 user nova-compute[75337]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2086a611-973d-47a1-bb69-f2ebd144be03 (non-flash)
Nov 06 15:49:47 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 15:49:47 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-60ea09e3-1b8a-4acc-8e6a-320ddf88dbad tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)
Nov 06 15:49:47 user nova-compute[75337]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6 (non-flash)
Nov 06 15:49:47 user nova-compute[75337]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06631b49-02a1-4759-8d9b-22b7ebdaa584 (non-flash)
Nov 06 15:49:47 user nova-compute[75337]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c5fa35a-1ba5-4390-9102-83ac1dbb790a (non-flash)
Nov 06 15:49:47 user nova-compute[75337]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:563526a2-6204-4264-91b7-041e6cadab23 (non-flash)
Nov 06 15:49:47 user nova-compute[75337]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bebbb46-2250-4511-ba59-f4ce67e0b45d (non-flash)
Nov 06 15:49:47 user nova-compute[75337]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2086a611-973d-47a1-bb69-f2ebd144be03 (non-flash)
Nov 06 15:49:47 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 15:49:47 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc5eae50-0461-47ca-bc48-cb38087b06e0 -p 172.16.0.220:3260 --login {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:47 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc5eae50-0461-47ca-bc48-cb38087b06e0 -p 172.16.0.220:3260 --login" returned: 0 in 0.102s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:49:47 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[1af0a11d-e681-4ba9-b26a-be9d196dff8d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:dc5eae50-0461-47ca-bc48-cb38087b06e0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:dc5eae50-0461-47ca-bc48-cb38087b06e0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:49:47 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-60ea09e3-1b8a-4acc-8e6a-320ddf88dbad tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:dc5eae50-0461-47ca-bc48-cb38087b06e0, portal: 172.16.0.220,3260]
Nov 06 15:49:47 user nova-compute[75337]: Login to [iface: default, target: iqn.2010-10.org.openstack:dc5eae50-0461-47ca-bc48-cb38087b06e0, portal: 172.16.0.220,3260] successful.
Nov 06 15:49:47 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:49:47 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc5eae50-0461-47ca-bc48-cb38087b06e0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:47 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc5eae50-0461-47ca-bc48-cb38087b06e0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:49:47 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[92b05298-a964-4704-97e7-993ff66de2cd]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:49:47 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-60ea09e3-1b8a-4acc-8e6a-320ddf88dbad tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:49:47 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:47 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.042s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:49:47 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dd71d47-761e-4dee-920b-d444278410aa]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06631b49-02a1-4759-8d9b-22b7ebdaa584 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c5fa35a-1ba5-4390-9102-83ac1dbb790a (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:563526a2-6204-4264-91b7-041e6cadab23 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bebbb46-2250-4511-ba59-f4ce67e0b45d (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2086a611-973d-47a1-bb69-f2ebd144be03 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc5eae50-0461-47ca-bc48-cb38087b06e0 (non-flash)\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:49:47 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-60ea09e3-1b8a-4acc-8e6a-320ddf88dbad tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)
Nov 06 15:49:47 user nova-compute[75337]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6 (non-flash)
Nov 06 15:49:47 user nova-compute[75337]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06631b49-02a1-4759-8d9b-22b7ebdaa584 (non-flash)
Nov 06 15:49:47 user nova-compute[75337]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c5fa35a-1ba5-4390-9102-83ac1dbb790a (non-flash)
Nov 06 15:49:47 user nova-compute[75337]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:563526a2-6204-4264-91b7-041e6cadab23 (non-flash)
Nov 06 15:49:47 user nova-compute[75337]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bebbb46-2250-4511-ba59-f4ce67e0b45d (non-flash)
Nov 06 15:49:47 user nova-compute[75337]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2086a611-973d-47a1-bb69-f2ebd144be03 (non-flash)
Nov 06 15:49:47 user nova-compute[75337]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc5eae50-0461-47ca-bc48-cb38087b06e0 (non-flash)
Nov 06 15:49:47 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 15:49:47 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-60ea09e3-1b8a-4acc-8e6a-320ddf88dbad tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)
Nov 06 15:49:47 user nova-compute[75337]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6 (non-flash)
Nov 06 15:49:47 user nova-compute[75337]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06631b49-02a1-4759-8d9b-22b7ebdaa584 (non-flash)
Nov 06 15:49:47 user nova-compute[75337]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c5fa35a-1ba5-4390-9102-83ac1dbb790a (non-flash)
Nov 06 15:49:47 user nova-compute[75337]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:563526a2-6204-4264-91b7-041e6cadab23 (non-flash)
Nov 06 15:49:47 user nova-compute[75337]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bebbb46-2250-4511-ba59-f4ce67e0b45d (non-flash)
Nov 06 15:49:47 user nova-compute[75337]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2086a611-973d-47a1-bb69-f2ebd144be03 (non-flash)
Nov 06 15:49:47 user nova-compute[75337]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc5eae50-0461-47ca-bc48-cb38087b06e0 (non-flash)
Nov 06 15:49:47 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 15:49:47 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-60ea09e3-1b8a-4acc-8e6a-320ddf88dbad tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dc5eae50-0461-47ca-bc48-cb38087b06e0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.559s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 15:49:47 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-60ea09e3-1b8a-4acc-8e6a-320ddf88dbad tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Connected to 172.16.0.220:3260 {{(pid=75337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 15:49:47 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-60ea09e3-1b8a-4acc-8e6a-320ddf88dbad tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] HCTL ('36', '-', '-', 0) found on session 30 with lun 0 {{(pid=75337) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 15:49:47 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-60ea09e3-1b8a-4acc-8e6a-320ddf88dbad tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75337) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 15:49:47 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:47 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.021s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:49:47 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[0125f12f-a198-4135-9b1a-4e984a8cc6c0]: (4, ('- - 0', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:49:47 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-60ea09e3-1b8a-4acc-8e6a-320ddf88dbad tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Searching for a device in session 30 and hctl ['36', '*', '*', 0] yield: None {{(pid=75337) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 15:49:47 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-17ccbf7d-ccd3-46cd-be17-4ee8a2de27f7 tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 9125364b-332f-4297-815f-3aa1eadaf743 is timed out.
Nov 06 15:49:47 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-17ccbf7d-ccd3-46cd-be17-4ee8a2de27f7 tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] Successfully detached device vdb from instance 9125364b-332f-4297-815f-3aa1eadaf743 from the live domain config.
Nov 06 15:49:47 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17ccbf7d-ccd3-46cd-be17-4ee8a2de27f7 tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] [instance: 9125364b-332f-4297-815f-3aa1eadaf743] calling os-brick to detach iSCSI Volume {{(pid=75337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 15:49:48 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-17ccbf7d-ccd3-46cd-be17-4ee8a2de27f7 tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2abc33d0c0>, {'target_iqn': 'iqn.2010-10.org.openstack:0c5fa35a-1ba5-4390-9102-83ac1dbb790a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nkapcTJV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg', 'volume_id': '0c5fa35a-1ba5-4390-9102-83ac1dbb790a'}, None), 'kwargs': False}}" {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 15:49:48 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-17ccbf7d-ccd3-46cd-be17-4ee8a2de27f7 tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 15:49:48 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-17ccbf7d-ccd3-46cd-be17-4ee8a2de27f7 tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 15:49:48 user nova-compute[75337]: DEBUG nova.compute.manager [req-ae51ae19-88a1-4ea9-9f28-1802ca5f3421 req-d02ce23a-6a74-4c97-9669-b050ee5af83e service nova] [instance: bc0e07f8-2731-4ffa-8446-b71ad3ba7375] Received event network-vif-plugged-a20e3f62-5387-4f54-b623-d45a0a311da0 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:49:48 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-ae51ae19-88a1-4ea9-9f28-1802ca5f3421 req-d02ce23a-6a74-4c97-9669-b050ee5af83e service nova] Acquiring lock "bc0e07f8-2731-4ffa-8446-b71ad3ba7375-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:49:48 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-ae51ae19-88a1-4ea9-9f28-1802ca5f3421 req-d02ce23a-6a74-4c97-9669-b050ee5af83e service nova] Lock "bc0e07f8-2731-4ffa-8446-b71ad3ba7375-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:49:48 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-ae51ae19-88a1-4ea9-9f28-1802ca5f3421 req-d02ce23a-6a74-4c97-9669-b050ee5af83e service nova] Lock "bc0e07f8-2731-4ffa-8446-b71ad3ba7375-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:49:48 user nova-compute[75337]: DEBUG nova.compute.manager [req-ae51ae19-88a1-4ea9-9f28-1802ca5f3421 req-d02ce23a-6a74-4c97-9669-b050ee5af83e service nova] [instance: bc0e07f8-2731-4ffa-8446-b71ad3ba7375] No waiting events found dispatching network-vif-plugged-a20e3f62-5387-4f54-b623-d45a0a311da0 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:49:48 user nova-compute[75337]: WARNING nova.compute.manager [req-ae51ae19-88a1-4ea9-9f28-1802ca5f3421 req-d02ce23a-6a74-4c97-9669-b050ee5af83e service nova] [instance: bc0e07f8-2731-4ffa-8446-b71ad3ba7375] Received unexpected event network-vif-plugged-a20e3f62-5387-4f54-b623-d45a0a311da0 for instance with vm_state active and task_state reboot_started_hard.
Nov 06 15:49:48 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-60ea09e3-1b8a-4acc-8e6a-320ddf88dbad tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Searching for a device in session 30 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75337) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 15:49:48 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-60ea09e3-1b8a-4acc-8e6a-320ddf88dbad tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:dc5eae50-0461-47ca-bc48-cb38087b06e0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oFQjZJSv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 15:49:48 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-60ea09e3-1b8a-4acc-8e6a-320ddf88dbad tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.597s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 15:49:48 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-60ea09e3-1b8a-4acc-8e6a-320ddf88dbad tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] <== connect_volume: return (1598ms) {'type': 'block', 'scsi_wwn': '23366393165353739', 'path': '/dev/sde'} {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 15:49:48 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60ea09e3-1b8a-4acc-8e6a-320ddf88dbad tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] [instance: bc0e07f8-2731-4ffa-8446-b71ad3ba7375] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23366393165353739', 'path': '/dev/sde'} {{(pid=75337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 15:49:48 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-17ccbf7d-ccd3-46cd-be17-4ee8a2de27f7 tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.668s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 15:49:48 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:48 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-60ea09e3-1b8a-4acc-8e6a-320ddf88dbad tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T15:46:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-305187601',display_name='tempest-TestMinimumBasicScenario-server-305187601',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-305187601',id=18,image_ref='34019a0c-32a9-485d-804a-abd50629cecb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLMTKRITbHOLi89utrqUrkdP7dp3D8u9fFIU8oK5Js2SaB/mlBSEFV4qG+zv1B+MrEcRr1Y6SUvYeu3ob8SsC0tPJypxoBps0L8MoitNXMQw8ZATzL/xbi+Lgg+BOq0dGA==',key_name='tempest-TestMinimumBasicScenario-1417411849',keypairs=<?>,launch_index=0,launched_at=2023-11-06T15:46:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2cddccc86bf54fe981667da5ef13fa8a',ramdisk_id='',reservation_id='r-p3ne9skw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='34019a0c-32a9-485d-804a-abd50629cecb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-2098539193',owner_user_name='tempest-TestMinimumBasicScenario-2098539193-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T15:49:46Z,user_data=None,user_id='8c795ee993a944ff89ed544450b90dc2',uuid=bc0e07f8-2731-4ffa-8446-b71ad3ba7375,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a20e3f62-5387-4f54-b623-d45a0a311da0", "address": "fa:16:3e:fe:62:24", "network": {"id": "c31b513a-57f0-4bd5-b055-4a363aae9793", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1352256985-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cddccc86bf54fe981667da5ef13fa8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa20e3f62-53", "ovs_interfaceid": "a20e3f62-5387-4f54-b623-d45a0a311da0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75337) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 15:49:48 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-60ea09e3-1b8a-4acc-8e6a-320ddf88dbad tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Converting VIF {"id": "a20e3f62-5387-4f54-b623-d45a0a311da0", "address": "fa:16:3e:fe:62:24", "network": {"id": "c31b513a-57f0-4bd5-b055-4a363aae9793", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1352256985-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cddccc86bf54fe981667da5ef13fa8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa20e3f62-53", "ovs_interfaceid": "a20e3f62-5387-4f54-b623-d45a0a311da0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 15:49:48 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-60ea09e3-1b8a-4acc-8e6a-320ddf88dbad tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fe:62:24,bridge_name='br-int',has_traffic_filtering=True,id=a20e3f62-5387-4f54-b623-d45a0a311da0,network=Network(c31b513a-57f0-4bd5-b055-4a363aae9793),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa20e3f62-53') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 15:49:48 user nova-compute[75337]: DEBUG nova.objects.instance [None req-60ea09e3-1b8a-4acc-8e6a-320ddf88dbad tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Lazy-loading 'pci_devices' on Instance uuid bc0e07f8-2731-4ffa-8446-b71ad3ba7375 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 15:49:48 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:49:48 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff20cd65-6d2c-451e-a955-5a6148d7789d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1bebbb46-2250-4511-ba59-f4ce67e0b45d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:563526a2-6204-4264-91b7-041e6cadab23\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dc5eae50-0461-47ca-bc48-cb38087b06e0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:06631b49-02a1-4759-8d9b-22b7ebdaa584\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2086a611-973d-47a1-bb69-f2ebd144be03\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0c5fa35a-1ba5-4390-9102-83ac1dbb790a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:49:48 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-17ccbf7d-ccd3-46cd-be17-4ee8a2de27f7 tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 15:49:48 user nova-compute[75337]: No targets found.
Nov 06 15:49:48 user nova-compute[75337]: iSNS:
Nov 06 15:49:48 user nova-compute[75337]: No targets found.
Nov 06 15:49:48 user nova-compute[75337]: STATIC:
Nov 06 15:49:48 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:1bebbb46-2250-4511-ba59-f4ce67e0b45d
Nov 06 15:49:48 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 15:49:48 user nova-compute[75337]:                 Iface Name: default
Nov 06 15:49:48 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158
Nov 06 15:49:48 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 15:49:48 user nova-compute[75337]:                 Iface Name: default
Nov 06 15:49:48 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:563526a2-6204-4264-91b7-041e6cadab23
Nov 06 15:49:48 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 15:49:48 user nova-compute[75337]:                 Iface Name: default
Nov 06 15:49:48 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:dc5eae50-0461-47ca-bc48-cb38087b06e0
Nov 06 15:49:48 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 15:49:48 user nova-compute[75337]:                 Iface Name: default
Nov 06 15:49:48 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6
Nov 06 15:49:48 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 15:49:48 user nova-compute[75337]:                 Iface Name: default
Nov 06 15:49:48 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:06631b49-02a1-4759-8d9b-22b7ebdaa584
Nov 06 15:49:48 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 15:49:48 user nova-compute[75337]:                 Iface Name: default
Nov 06 15:49:48 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:2086a611-973d-47a1-bb69-f2ebd144be03
Nov 06 15:49:48 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 15:49:48 user nova-compute[75337]:                 Iface Name: default
Nov 06 15:49:48 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:0c5fa35a-1ba5-4390-9102-83ac1dbb790a
Nov 06 15:49:48 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 15:49:48 user nova-compute[75337]:                 Iface Name: default
Nov 06 15:49:48 user nova-compute[75337]: FIRMWARE:
Nov 06 15:49:48 user nova-compute[75337]: No targets found.
Nov 06 15:49:48 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 15:49:48 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-17ccbf7d-ccd3-46cd-be17-4ee8a2de27f7 tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 15:49:48 user nova-compute[75337]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 15:49:48 user nova-compute[75337]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75337) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 15:49:48 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-17ccbf7d-ccd3-46cd-be17-4ee8a2de27f7 tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0c5fa35a-1ba5-4390-9102-83ac1dbb790a', 0)] {{(pid=75337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 15:49:48 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:48 user nova-compute[75337]: DEBUG nova.objects.base [None req-60ea09e3-1b8a-4acc-8e6a-320ddf88dbad tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Object Instance<bc0e07f8-2731-4ffa-8446-b71ad3ba7375> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=75337) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 15:49:48 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-60ea09e3-1b8a-4acc-8e6a-320ddf88dbad tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] [instance: bc0e07f8-2731-4ffa-8446-b71ad3ba7375] End _get_guest_xml xml=<domain type="kvm">
Nov 06 15:49:48 user nova-compute[75337]:   <uuid>bc0e07f8-2731-4ffa-8446-b71ad3ba7375</uuid>
Nov 06 15:49:48 user nova-compute[75337]:   <name>instance-00000012</name>
Nov 06 15:49:48 user nova-compute[75337]:   <memory>524288</memory>
Nov 06 15:49:48 user nova-compute[75337]:   <vcpu>1</vcpu>
Nov 06 15:49:48 user nova-compute[75337]:   <metadata>
Nov 06 15:49:48 user nova-compute[75337]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 15:49:48 user nova-compute[75337]:       <nova:package version="0.0.0"/>
Nov 06 15:49:48 user nova-compute[75337]:       <nova:name>tempest-TestMinimumBasicScenario-server-305187601</nova:name>
Nov 06 15:49:48 user nova-compute[75337]:       <nova:creationTime>2023-11-06 15:49:46</nova:creationTime>
Nov 06 15:49:48 user nova-compute[75337]:       <nova:flavor name="m1.tiny">
Nov 06 15:49:48 user nova-compute[75337]:         <nova:memory>512</nova:memory>
Nov 06 15:49:48 user nova-compute[75337]:         <nova:disk>1</nova:disk>
Nov 06 15:49:48 user nova-compute[75337]:         <nova:swap>0</nova:swap>
Nov 06 15:49:48 user nova-compute[75337]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 15:49:48 user nova-compute[75337]:         <nova:vcpus>1</nova:vcpus>
Nov 06 15:49:48 user nova-compute[75337]:       </nova:flavor>
Nov 06 15:49:48 user nova-compute[75337]:       <nova:owner>
Nov 06 15:49:48 user nova-compute[75337]:         <nova:user uuid="8c795ee993a944ff89ed544450b90dc2">tempest-TestMinimumBasicScenario-2098539193-project-member</nova:user>
Nov 06 15:49:48 user nova-compute[75337]:         <nova:project uuid="2cddccc86bf54fe981667da5ef13fa8a">tempest-TestMinimumBasicScenario-2098539193</nova:project>
Nov 06 15:49:48 user nova-compute[75337]:       </nova:owner>
Nov 06 15:49:48 user nova-compute[75337]:       <nova:root type="image" uuid="34019a0c-32a9-485d-804a-abd50629cecb"/>
Nov 06 15:49:48 user nova-compute[75337]:       <nova:ports>
Nov 06 15:49:48 user nova-compute[75337]:         <nova:port uuid="a20e3f62-5387-4f54-b623-d45a0a311da0">
Nov 06 15:49:48 user nova-compute[75337]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 06 15:49:48 user nova-compute[75337]:         </nova:port>
Nov 06 15:49:48 user nova-compute[75337]:       </nova:ports>
Nov 06 15:49:48 user nova-compute[75337]:     </nova:instance>
Nov 06 15:49:48 user nova-compute[75337]:   </metadata>
Nov 06 15:49:48 user nova-compute[75337]:   <sysinfo type="smbios">
Nov 06 15:49:48 user nova-compute[75337]:     <system>
Nov 06 15:49:48 user nova-compute[75337]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 15:49:48 user nova-compute[75337]:       <entry name="product">OpenStack Nova</entry>
Nov 06 15:49:48 user nova-compute[75337]:       <entry name="version">0.0.0</entry>
Nov 06 15:49:48 user nova-compute[75337]:       <entry name="serial">bc0e07f8-2731-4ffa-8446-b71ad3ba7375</entry>
Nov 06 15:49:48 user nova-compute[75337]:       <entry name="uuid">bc0e07f8-2731-4ffa-8446-b71ad3ba7375</entry>
Nov 06 15:49:48 user nova-compute[75337]:       <entry name="family">Virtual Machine</entry>
Nov 06 15:49:48 user nova-compute[75337]:     </system>
Nov 06 15:49:48 user nova-compute[75337]:   </sysinfo>
Nov 06 15:49:48 user nova-compute[75337]:   <os>
Nov 06 15:49:48 user nova-compute[75337]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 15:49:48 user nova-compute[75337]:     <boot dev="hd"/>
Nov 06 15:49:48 user nova-compute[75337]:     <smbios mode="sysinfo"/>
Nov 06 15:49:48 user nova-compute[75337]:   </os>
Nov 06 15:49:48 user nova-compute[75337]:   <features>
Nov 06 15:49:48 user nova-compute[75337]:     <acpi/>
Nov 06 15:49:48 user nova-compute[75337]:     <apic/>
Nov 06 15:49:48 user nova-compute[75337]:     <vmcoreinfo/>
Nov 06 15:49:48 user nova-compute[75337]:   </features>
Nov 06 15:49:48 user nova-compute[75337]:   <clock offset="utc">
Nov 06 15:49:48 user nova-compute[75337]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 15:49:48 user nova-compute[75337]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 15:49:48 user nova-compute[75337]:     <timer name="hpet" present="no"/>
Nov 06 15:49:48 user nova-compute[75337]:   </clock>
Nov 06 15:49:48 user nova-compute[75337]:   <cpu mode="custom" match="exact">
Nov 06 15:49:48 user nova-compute[75337]:     <model>Nehalem</model>
Nov 06 15:49:48 user nova-compute[75337]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 15:49:48 user nova-compute[75337]:   </cpu>
Nov 06 15:49:48 user nova-compute[75337]:   <devices>
Nov 06 15:49:48 user nova-compute[75337]:     <disk type="file" device="disk">
Nov 06 15:49:48 user nova-compute[75337]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 15:49:48 user nova-compute[75337]:       <source file="/opt/stack/data/nova/instances/bc0e07f8-2731-4ffa-8446-b71ad3ba7375/disk"/>
Nov 06 15:49:48 user nova-compute[75337]:       <target dev="vda" bus="virtio"/>
Nov 06 15:49:48 user nova-compute[75337]:     </disk>
Nov 06 15:49:48 user nova-compute[75337]:     <disk type="block" device="disk">
Nov 06 15:49:48 user nova-compute[75337]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 15:49:48 user nova-compute[75337]:       <source dev="/dev/sde"/>
Nov 06 15:49:48 user nova-compute[75337]:       <target dev="vdb" bus="virtio"/>
Nov 06 15:49:48 user nova-compute[75337]:       <serial>dc5eae50-0461-47ca-bc48-cb38087b06e0</serial>
Nov 06 15:49:48 user nova-compute[75337]:     </disk>
Nov 06 15:49:48 user nova-compute[75337]:     <interface type="ethernet">
Nov 06 15:49:48 user nova-compute[75337]:       <mac address="fa:16:3e:fe:62:24"/>
Nov 06 15:49:48 user nova-compute[75337]:       <model type="virtio"/>
Nov 06 15:49:48 user nova-compute[75337]:       <mtu size="1442"/>
Nov 06 15:49:48 user nova-compute[75337]:       <target dev="tapa20e3f62-53"/>
Nov 06 15:49:48 user nova-compute[75337]:     </interface>
Nov 06 15:49:48 user nova-compute[75337]:     <serial type="pty">
Nov 06 15:49:48 user nova-compute[75337]:       <log file="/opt/stack/data/nova/instances/bc0e07f8-2731-4ffa-8446-b71ad3ba7375/console.log" append="off"/>
Nov 06 15:49:48 user nova-compute[75337]:     </serial>
Nov 06 15:49:48 user nova-compute[75337]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 15:49:48 user nova-compute[75337]:     <video>
Nov 06 15:49:48 user nova-compute[75337]:       <model type="virtio"/>
Nov 06 15:49:48 user nova-compute[75337]:     </video>
Nov 06 15:49:48 user nova-compute[75337]:     <rng model="virtio">
Nov 06 15:49:48 user nova-compute[75337]:       <backend model="random">/dev/urandom</backend>
Nov 06 15:49:48 user nova-compute[75337]:     </rng>
Nov 06 15:49:48 user nova-compute[75337]:     <controller type="usb" index="0" model="none"/>
Nov 06 15:49:48 user nova-compute[75337]:     <memballoon model="virtio">
Nov 06 15:49:48 user nova-compute[75337]:       <stats period="10"/>
Nov 06 15:49:48 user nova-compute[75337]:     </memballoon>
Nov 06 15:49:48 user nova-compute[75337]:   </devices>
Nov 06 15:49:48 user nova-compute[75337]: </domain>
Nov 06 15:49:48 user nova-compute[75337]:  {{(pid=75337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 15:49:48 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-60ea09e3-1b8a-4acc-8e6a-320ddf88dbad tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc0e07f8-2731-4ffa-8446-b71ad3ba7375/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:48 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:49:48 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[60b45a8f-4d2e-4c44-9489-a4fee8960757]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:06631b49-02a1-4759-8d9b-22b7ebdaa584\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c5fa35a-1ba5-4390-9102-83ac1dbb790a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1bebbb46-2250-4511-ba59-f4ce67e0b45d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2086a611-973d-47a1-bb69-f2ebd144be03\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:563526a2-6204-4264-91b7-041e6cadab23\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dc5eae50-0461-47ca-bc48-cb38087b06e0\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:49:48 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:48 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:49:48 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[8db7a50d-1815-4022-8670-44cb7230a1cb]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06631b49-02a1-4759-8d9b-22b7ebdaa584 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c5fa35a-1ba5-4390-9102-83ac1dbb790a (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:563526a2-6204-4264-91b7-041e6cadab23 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bebbb46-2250-4511-ba59-f4ce67e0b45d (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2086a611-973d-47a1-bb69-f2ebd144be03 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc5eae50-0461-47ca-bc48-cb38087b06e0 (non-flash)\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:49:48 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-17ccbf7d-ccd3-46cd-be17-4ee8a2de27f7 tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)
Nov 06 15:49:48 user nova-compute[75337]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6 (non-flash)
Nov 06 15:49:48 user nova-compute[75337]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06631b49-02a1-4759-8d9b-22b7ebdaa584 (non-flash)
Nov 06 15:49:48 user nova-compute[75337]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c5fa35a-1ba5-4390-9102-83ac1dbb790a (non-flash)
Nov 06 15:49:48 user nova-compute[75337]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:563526a2-6204-4264-91b7-041e6cadab23 (non-flash)
Nov 06 15:49:48 user nova-compute[75337]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bebbb46-2250-4511-ba59-f4ce67e0b45d (non-flash)
Nov 06 15:49:48 user nova-compute[75337]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2086a611-973d-47a1-bb69-f2ebd144be03 (non-flash)
Nov 06 15:49:48 user nova-compute[75337]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc5eae50-0461-47ca-bc48-cb38087b06e0 (non-flash)
Nov 06 15:49:48 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 15:49:48 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-17ccbf7d-ccd3-46cd-be17-4ee8a2de27f7 tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)
Nov 06 15:49:48 user nova-compute[75337]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6 (non-flash)
Nov 06 15:49:48 user nova-compute[75337]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06631b49-02a1-4759-8d9b-22b7ebdaa584 (non-flash)
Nov 06 15:49:48 user nova-compute[75337]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c5fa35a-1ba5-4390-9102-83ac1dbb790a (non-flash)
Nov 06 15:49:48 user nova-compute[75337]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:563526a2-6204-4264-91b7-041e6cadab23 (non-flash)
Nov 06 15:49:48 user nova-compute[75337]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bebbb46-2250-4511-ba59-f4ce67e0b45d (non-flash)
Nov 06 15:49:48 user nova-compute[75337]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2086a611-973d-47a1-bb69-f2ebd144be03 (non-flash)
Nov 06 15:49:48 user nova-compute[75337]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc5eae50-0461-47ca-bc48-cb38087b06e0 (non-flash)
Nov 06 15:49:48 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 15:49:48 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-17ccbf7d-ccd3-46cd-be17-4ee8a2de27f7 tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2a9c3adab0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0c5fa35a-1ba5-4390-9102-83ac1dbb790a'): ({'sdg'}, set())}) {{(pid=75337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 15:49:48 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-17ccbf7d-ccd3-46cd-be17-4ee8a2de27f7 tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] Removing single pathed devices sdg {{(pid=75337) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 15:49:48 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:48 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:49:48 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4e81964-89a3-4ed5-9c6e-41ad0ec66743]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:49:48 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:48 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.021s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:49:48 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[d631a5b7-1b4c-4639-ace1-d6a9892897bf]: (4, ('ok\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:49:48 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-17ccbf7d-ccd3-46cd-be17-4ee8a2de27f7 tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] Flushing IO for device /dev/sdg {{(pid=75337) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 15:49:48 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:48 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.014s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:49:48 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[113a1ca1-4bd6-4ea8-830e-3815e298905c]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:49:48 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-17ccbf7d-ccd3-46cd-be17-4ee8a2de27f7 tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75337) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 15:49:48 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:48 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-60ea09e3-1b8a-4acc-8e6a-320ddf88dbad tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc0e07f8-2731-4ffa-8446-b71ad3ba7375/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:49:48 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-60ea09e3-1b8a-4acc-8e6a-320ddf88dbad tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc0e07f8-2731-4ffa-8446-b71ad3ba7375/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:48 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.051s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:49:48 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f4b3114-b8f3-47a8-85e4-27140aae3b0e]: (4, ('1', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:49:48 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-17ccbf7d-ccd3-46cd-be17-4ee8a2de27f7 tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 15:49:48 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-17ccbf7d-ccd3-46cd-be17-4ee8a2de27f7 tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] SCSI volumes sdg have been removed. {{(pid=75337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 15:49:48 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-17ccbf7d-ccd3-46cd-be17-4ee8a2de27f7 tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0c5fa35a-1ba5-4390-9102-83ac1dbb790a')] {{(pid=75337) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 15:49:48 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c5fa35a-1ba5-4390-9102-83ac1dbb790a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:49 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c5fa35a-1ba5-4390-9102-83ac1dbb790a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:49:49 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[69271bff-f001-4f3f-86df-cdc32f535d10]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:49:49 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-17ccbf7d-ccd3-46cd-be17-4ee8a2de27f7 tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:49:49 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c5fa35a-1ba5-4390-9102-83ac1dbb790a -p 172.16.0.220:3260 --logout {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:49 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c5fa35a-1ba5-4390-9102-83ac1dbb790a -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:49:49 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[d28f27c0-025d-4c23-a788-0eae09131af5]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:0c5fa35a-1ba5-4390-9102-83ac1dbb790a, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:0c5fa35a-1ba5-4390-9102-83ac1dbb790a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:49:49 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-17ccbf7d-ccd3-46cd-be17-4ee8a2de27f7 tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:0c5fa35a-1ba5-4390-9102-83ac1dbb790a, portal: 172.16.0.220,3260]
Nov 06 15:49:49 user nova-compute[75337]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:0c5fa35a-1ba5-4390-9102-83ac1dbb790a, portal: 172.16.0.220,3260] successful.
Nov 06 15:49:49 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:49:49 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:49 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c5fa35a-1ba5-4390-9102-83ac1dbb790a -p 172.16.0.220:3260 --op delete {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:49 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-60ea09e3-1b8a-4acc-8e6a-320ddf88dbad tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc0e07f8-2731-4ffa-8446-b71ad3ba7375/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:49:49 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-60ea09e3-1b8a-4acc-8e6a-320ddf88dbad tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 15:49:49 user nova-compute[75337]: DEBUG nova.objects.instance [None req-60ea09e3-1b8a-4acc-8e6a-320ddf88dbad tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Lazy-loading 'trusted_certs' on Instance uuid bc0e07f8-2731-4ffa-8446-b71ad3ba7375 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 15:49:49 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c5fa35a-1ba5-4390-9102-83ac1dbb790a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.049s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:49:49 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[109fc634-9d48-4db5-b757-4d452e157d2a]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:49:49 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-17ccbf7d-ccd3-46cd-be17-4ee8a2de27f7 tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:49:49 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-17ccbf7d-ccd3-46cd-be17-4ee8a2de27f7 tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.489s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 15:49:49 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-17ccbf7d-ccd3-46cd-be17-4ee8a2de27f7 tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] <== disconnect_volume: return (1158ms) None {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 15:49:49 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17ccbf7d-ccd3-46cd-be17-4ee8a2de27f7 tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] [instance: 9125364b-332f-4297-815f-3aa1eadaf743] Disconnected iSCSI Volume {{(pid=75337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 15:49:49 user nova-compute[75337]: DEBUG nova.objects.base [None req-60ea09e3-1b8a-4acc-8e6a-320ddf88dbad tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Object Instance<bc0e07f8-2731-4ffa-8446-b71ad3ba7375> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=75337) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 15:49:49 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-60ea09e3-1b8a-4acc-8e6a-320ddf88dbad tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7338109fcb7f9221b864c97256563d718cc56c1 --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:49 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-60ea09e3-1b8a-4acc-8e6a-320ddf88dbad tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7338109fcb7f9221b864c97256563d718cc56c1 --force-share --output=json" returned: 0 in 0.251s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:49:49 user nova-compute[75337]: DEBUG nova.virt.disk.api [None req-60ea09e3-1b8a-4acc-8e6a-320ddf88dbad tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bc0e07f8-2731-4ffa-8446-b71ad3ba7375/disk. size=1073741824 {{(pid=75337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 15:49:49 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-60ea09e3-1b8a-4acc-8e6a-320ddf88dbad tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc0e07f8-2731-4ffa-8446-b71ad3ba7375/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:49 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-763f9551-cdcf-4554-8ab6-579f96af3d4a tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] Acquiring lock "7a6b16de-4506-432f-97f9-f083243dc047" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:49:49 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-763f9551-cdcf-4554-8ab6-579f96af3d4a tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] Lock "7a6b16de-4506-432f-97f9-f083243dc047" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:49:49 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-763f9551-cdcf-4554-8ab6-579f96af3d4a tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] Acquiring lock "7a6b16de-4506-432f-97f9-f083243dc047-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:49:49 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-763f9551-cdcf-4554-8ab6-579f96af3d4a tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] Lock "7a6b16de-4506-432f-97f9-f083243dc047-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:49:49 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-763f9551-cdcf-4554-8ab6-579f96af3d4a tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] Lock "7a6b16de-4506-432f-97f9-f083243dc047-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:49:49 user nova-compute[75337]: INFO nova.compute.manager [None req-763f9551-cdcf-4554-8ab6-579f96af3d4a tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] [instance: 7a6b16de-4506-432f-97f9-f083243dc047] Terminating instance
Nov 06 15:49:49 user nova-compute[75337]: DEBUG nova.compute.manager [None req-763f9551-cdcf-4554-8ab6-579f96af3d4a tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] [instance: 7a6b16de-4506-432f-97f9-f083243dc047] Start destroying the instance on the hypervisor. {{(pid=75337) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 15:49:49 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:49 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:49 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-60ea09e3-1b8a-4acc-8e6a-320ddf88dbad tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc0e07f8-2731-4ffa-8446-b71ad3ba7375/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:49:49 user nova-compute[75337]: DEBUG nova.virt.disk.api [None req-60ea09e3-1b8a-4acc-8e6a-320ddf88dbad tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Cannot resize image /opt/stack/data/nova/instances/bc0e07f8-2731-4ffa-8446-b71ad3ba7375/disk to a smaller size. {{(pid=75337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 06 15:49:49 user nova-compute[75337]: DEBUG nova.objects.instance [None req-60ea09e3-1b8a-4acc-8e6a-320ddf88dbad tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Lazy-loading 'migration_context' on Instance uuid bc0e07f8-2731-4ffa-8446-b71ad3ba7375 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 15:49:49 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:49 user nova-compute[75337]: DEBUG nova.objects.base [None req-60ea09e3-1b8a-4acc-8e6a-320ddf88dbad tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Object Instance<bc0e07f8-2731-4ffa-8446-b71ad3ba7375> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75337) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 15:49:49 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-60ea09e3-1b8a-4acc-8e6a-320ddf88dbad tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T15:46:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-305187601',display_name='tempest-TestMinimumBasicScenario-server-305187601',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-305187601',id=18,image_ref='34019a0c-32a9-485d-804a-abd50629cecb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLMTKRITbHOLi89utrqUrkdP7dp3D8u9fFIU8oK5Js2SaB/mlBSEFV4qG+zv1B+MrEcRr1Y6SUvYeu3ob8SsC0tPJypxoBps0L8MoitNXMQw8ZATzL/xbi+Lgg+BOq0dGA==',key_name='tempest-TestMinimumBasicScenario-1417411849',keypairs=<?>,launch_index=0,launched_at=2023-11-06T15:46:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='2cddccc86bf54fe981667da5ef13fa8a',ramdisk_id='',reservation_id='r-p3ne9skw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='34019a0c-32a9-485d-804a-abd50629cecb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-2098539193',owner_user_name='tempest-TestMinimumBasicScenario-2098539193-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T15:49:46Z,user_data=None,user_id='8c795ee993a944ff89ed544450b90dc2',uuid=bc0e07f8-2731-4ffa-8446-b71ad3ba7375,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a20e3f62-5387-4f54-b623-d45a0a311da0", "address": "fa:16:3e:fe:62:24", "network": {"id": "c31b513a-57f0-4bd5-b055-4a363aae9793", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1352256985-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cddccc86bf54fe981667da5ef13fa8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa20e3f62-53", "ovs_interfaceid": "a20e3f62-5387-4f54-b623-d45a0a311da0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 15:49:49 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-60ea09e3-1b8a-4acc-8e6a-320ddf88dbad tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Converting VIF {"id": "a20e3f62-5387-4f54-b623-d45a0a311da0", "address": "fa:16:3e:fe:62:24", "network": {"id": "c31b513a-57f0-4bd5-b055-4a363aae9793", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1352256985-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cddccc86bf54fe981667da5ef13fa8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa20e3f62-53", "ovs_interfaceid": "a20e3f62-5387-4f54-b623-d45a0a311da0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 15:49:49 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-60ea09e3-1b8a-4acc-8e6a-320ddf88dbad tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fe:62:24,bridge_name='br-int',has_traffic_filtering=True,id=a20e3f62-5387-4f54-b623-d45a0a311da0,network=Network(c31b513a-57f0-4bd5-b055-4a363aae9793),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa20e3f62-53') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 15:49:49 user nova-compute[75337]: DEBUG os_vif [None req-60ea09e3-1b8a-4acc-8e6a-320ddf88dbad tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fe:62:24,bridge_name='br-int',has_traffic_filtering=True,id=a20e3f62-5387-4f54-b623-d45a0a311da0,network=Network(c31b513a-57f0-4bd5-b055-4a363aae9793),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa20e3f62-53') {{(pid=75337) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 15:49:49 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:49 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:49:49 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 15:49:49 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:49 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2805d5bf-06e4-539b-9363-4e4c1afc4206', '_type': 'linux-noop'}}, row=False) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:49:49 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:49 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:49:49 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:49 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:49 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:49 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:49 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa20e3f62-53, may_exist=True, interface_attrs={}) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:49:49 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa20e3f62-53, col_values=(('qos', UUID('4cfabb4c-31c4-4cfc-a1ba-e1e9b8cba965')),), if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:49:49 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa20e3f62-53, col_values=(('external_ids', {'iface-id': 'a20e3f62-5387-4f54-b623-d45a0a311da0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fe:62:24', 'vm-uuid': 'bc0e07f8-2731-4ffa-8446-b71ad3ba7375'}),), if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:49:49 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:49:49 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:49 user nova-compute[75337]: INFO os_vif [None req-60ea09e3-1b8a-4acc-8e6a-320ddf88dbad tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fe:62:24,bridge_name='br-int',has_traffic_filtering=True,id=a20e3f62-5387-4f54-b623-d45a0a311da0,network=Network(c31b513a-57f0-4bd5-b055-4a363aae9793),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa20e3f62-53')
Nov 06 15:49:49 user nova-compute[75337]: DEBUG nova.compute.manager [req-609d9431-bcb3-4b5a-a699-00382a638cc9 req-17991d46-3885-40de-b918-4fd3af5268ed service nova] [instance: 7a6b16de-4506-432f-97f9-f083243dc047] Received event network-vif-unplugged-4e4e1bfc-ebf9-41eb-81be-d1c34001dcff {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:49:49 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-609d9431-bcb3-4b5a-a699-00382a638cc9 req-17991d46-3885-40de-b918-4fd3af5268ed service nova] Acquiring lock "7a6b16de-4506-432f-97f9-f083243dc047-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:49:49 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-609d9431-bcb3-4b5a-a699-00382a638cc9 req-17991d46-3885-40de-b918-4fd3af5268ed service nova] Lock "7a6b16de-4506-432f-97f9-f083243dc047-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:49:49 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-609d9431-bcb3-4b5a-a699-00382a638cc9 req-17991d46-3885-40de-b918-4fd3af5268ed service nova] Lock "7a6b16de-4506-432f-97f9-f083243dc047-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:49:49 user nova-compute[75337]: DEBUG nova.compute.manager [req-609d9431-bcb3-4b5a-a699-00382a638cc9 req-17991d46-3885-40de-b918-4fd3af5268ed service nova] [instance: 7a6b16de-4506-432f-97f9-f083243dc047] No waiting events found dispatching network-vif-unplugged-4e4e1bfc-ebf9-41eb-81be-d1c34001dcff {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:49:49 user nova-compute[75337]: DEBUG nova.compute.manager [req-609d9431-bcb3-4b5a-a699-00382a638cc9 req-17991d46-3885-40de-b918-4fd3af5268ed service nova] [instance: 7a6b16de-4506-432f-97f9-f083243dc047] Received event network-vif-unplugged-4e4e1bfc-ebf9-41eb-81be-d1c34001dcff for instance with task_state deleting. {{(pid=75337) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 15:49:50 user nova-compute[75337]: INFO nova.virt.libvirt.driver [-] [instance: 7a6b16de-4506-432f-97f9-f083243dc047] Instance destroyed successfully.
Nov 06 15:49:50 user nova-compute[75337]: DEBUG nova.objects.instance [None req-763f9551-cdcf-4554-8ab6-579f96af3d4a tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] Lazy-loading 'resources' on Instance uuid 7a6b16de-4506-432f-97f9-f083243dc047 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 15:49:50 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-763f9551-cdcf-4554-8ab6-579f96af3d4a tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-06T15:44:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-2022980761',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-154622819',id=14,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOQEIvPwsFtYJCxBuAzGJFBj2NMxdPf9zCY8lR96jqahU4yNb1jUNqLm9D/kbYl6impHm2KGg3eQFdJ96Vvx3tPM5bfUf7AgedT0Ye9qKpHUXm2yidVS0pDcdAVMt/qqDw==',key_name='tempest-keypair-1607456997',keypairs=<?>,launch_index=0,launched_at=2023-11-06T15:48:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ed8fbcf3ad3c42a08501891748de8abc',ramdisk_id='',reservation_id='r-y91vj4ff',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-541966055',owner_user_name='tempest-ServerActionsV293TestJSON-541966055-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T15:48:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='360ca2f8787a424e91dcc73d7c2b5017',uuid=7a6b16de-4506-432f-97f9-f083243dc047,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4e4e1bfc-ebf9-41eb-81be-d1c34001dcff", "address": "fa:16:3e:d1:64:1b", "network": {"id": "ffb95242-a859-4479-a4c8-2b8fa68b53fc", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-976415891-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed8fbcf3ad3c42a08501891748de8abc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e4e1bfc-eb", "ovs_interfaceid": "4e4e1bfc-ebf9-41eb-81be-d1c34001dcff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 15:49:50 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-763f9551-cdcf-4554-8ab6-579f96af3d4a tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] Converting VIF {"id": "4e4e1bfc-ebf9-41eb-81be-d1c34001dcff", "address": "fa:16:3e:d1:64:1b", "network": {"id": "ffb95242-a859-4479-a4c8-2b8fa68b53fc", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-976415891-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed8fbcf3ad3c42a08501891748de8abc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e4e1bfc-eb", "ovs_interfaceid": "4e4e1bfc-ebf9-41eb-81be-d1c34001dcff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 15:49:50 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-763f9551-cdcf-4554-8ab6-579f96af3d4a tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d1:64:1b,bridge_name='br-int',has_traffic_filtering=True,id=4e4e1bfc-ebf9-41eb-81be-d1c34001dcff,network=Network(ffb95242-a859-4479-a4c8-2b8fa68b53fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e4e1bfc-eb') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 15:49:50 user nova-compute[75337]: DEBUG os_vif [None req-763f9551-cdcf-4554-8ab6-579f96af3d4a tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d1:64:1b,bridge_name='br-int',has_traffic_filtering=True,id=4e4e1bfc-ebf9-41eb-81be-d1c34001dcff,network=Network(ffb95242-a859-4479-a4c8-2b8fa68b53fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e4e1bfc-eb') {{(pid=75337) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 15:49:50 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:50 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4e4e1bfc-eb, bridge=br-int, if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:49:50 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:50 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:49:50 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:50 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:50 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b9c50eb1-31f2-4fb4-9f43-ddd80858035b) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:49:50 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:50 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:49:50 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:50 user nova-compute[75337]: INFO os_vif [None req-763f9551-cdcf-4554-8ab6-579f96af3d4a tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d1:64:1b,bridge_name='br-int',has_traffic_filtering=True,id=4e4e1bfc-ebf9-41eb-81be-d1c34001dcff,network=Network(ffb95242-a859-4479-a4c8-2b8fa68b53fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e4e1bfc-eb')
Nov 06 15:49:50 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-763f9551-cdcf-4554-8ab6-579f96af3d4a tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] [instance: 7a6b16de-4506-432f-97f9-f083243dc047] calling os-brick to detach iSCSI Volume {{(pid=75337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 15:49:50 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-763f9551-cdcf-4554-8ab6-579f96af3d4a tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2abc33d0c0>, {'target_iqn': 'iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'maEwpfvl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 15:49:50 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-763f9551-cdcf-4554-8ab6-579f96af3d4a tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 15:49:50 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-763f9551-cdcf-4554-8ab6-579f96af3d4a tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 15:49:50 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-763f9551-cdcf-4554-8ab6-579f96af3d4a tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 15:49:50 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:50 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:49:50 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e61037a-96a6-4471-a13b-a11ff61eeab7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1bebbb46-2250-4511-ba59-f4ce67e0b45d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:563526a2-6204-4264-91b7-041e6cadab23\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dc5eae50-0461-47ca-bc48-cb38087b06e0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:06631b49-02a1-4759-8d9b-22b7ebdaa584\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2086a611-973d-47a1-bb69-f2ebd144be03\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:49:50 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-763f9551-cdcf-4554-8ab6-579f96af3d4a tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 15:49:50 user nova-compute[75337]: No targets found.
Nov 06 15:49:50 user nova-compute[75337]: iSNS:
Nov 06 15:49:50 user nova-compute[75337]: No targets found.
Nov 06 15:49:50 user nova-compute[75337]: STATIC:
Nov 06 15:49:50 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:1bebbb46-2250-4511-ba59-f4ce67e0b45d
Nov 06 15:49:50 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 15:49:50 user nova-compute[75337]:                 Iface Name: default
Nov 06 15:49:50 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158
Nov 06 15:49:50 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 15:49:50 user nova-compute[75337]:                 Iface Name: default
Nov 06 15:49:50 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:563526a2-6204-4264-91b7-041e6cadab23
Nov 06 15:49:50 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 15:49:50 user nova-compute[75337]:                 Iface Name: default
Nov 06 15:49:50 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:dc5eae50-0461-47ca-bc48-cb38087b06e0
Nov 06 15:49:50 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 15:49:50 user nova-compute[75337]:                 Iface Name: default
Nov 06 15:49:50 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6
Nov 06 15:49:50 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 15:49:50 user nova-compute[75337]:                 Iface Name: default
Nov 06 15:49:50 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:06631b49-02a1-4759-8d9b-22b7ebdaa584
Nov 06 15:49:50 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 15:49:50 user nova-compute[75337]:                 Iface Name: default
Nov 06 15:49:50 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:2086a611-973d-47a1-bb69-f2ebd144be03
Nov 06 15:49:50 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 15:49:50 user nova-compute[75337]:                 Iface Name: default
Nov 06 15:49:50 user nova-compute[75337]: FIRMWARE:
Nov 06 15:49:50 user nova-compute[75337]: No targets found.
Nov 06 15:49:50 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 15:49:50 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-763f9551-cdcf-4554-8ab6-579f96af3d4a tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 15:49:50 user nova-compute[75337]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 15:49:50 user nova-compute[75337]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75337) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 15:49:50 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-763f9551-cdcf-4554-8ab6-579f96af3d4a tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6', 0)] {{(pid=75337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 15:49:50 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:51 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:49:51 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[97332e31-c279-40ef-93bd-54afd40f6d26]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:06631b49-02a1-4759-8d9b-22b7ebdaa584\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1bebbb46-2250-4511-ba59-f4ce67e0b45d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2086a611-973d-47a1-bb69-f2ebd144be03\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:563526a2-6204-4264-91b7-041e6cadab23\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dc5eae50-0461-47ca-bc48-cb38087b06e0\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:49:51 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:51 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.045s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:49:51 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[158cb138-3d4a-4d60-833b-db09c0ca0791]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06631b49-02a1-4759-8d9b-22b7ebdaa584 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:563526a2-6204-4264-91b7-041e6cadab23 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bebbb46-2250-4511-ba59-f4ce67e0b45d (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2086a611-973d-47a1-bb69-f2ebd144be03 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc5eae50-0461-47ca-bc48-cb38087b06e0 (non-flash)\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:49:51 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-763f9551-cdcf-4554-8ab6-579f96af3d4a tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)
Nov 06 15:49:51 user nova-compute[75337]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6 (non-flash)
Nov 06 15:49:51 user nova-compute[75337]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06631b49-02a1-4759-8d9b-22b7ebdaa584 (non-flash)
Nov 06 15:49:51 user nova-compute[75337]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:563526a2-6204-4264-91b7-041e6cadab23 (non-flash)
Nov 06 15:49:51 user nova-compute[75337]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bebbb46-2250-4511-ba59-f4ce67e0b45d (non-flash)
Nov 06 15:49:51 user nova-compute[75337]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2086a611-973d-47a1-bb69-f2ebd144be03 (non-flash)
Nov 06 15:49:51 user nova-compute[75337]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc5eae50-0461-47ca-bc48-cb38087b06e0 (non-flash)
Nov 06 15:49:51 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 15:49:51 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-763f9551-cdcf-4554-8ab6-579f96af3d4a tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)
Nov 06 15:49:51 user nova-compute[75337]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6 (non-flash)
Nov 06 15:49:51 user nova-compute[75337]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06631b49-02a1-4759-8d9b-22b7ebdaa584 (non-flash)
Nov 06 15:49:51 user nova-compute[75337]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:563526a2-6204-4264-91b7-041e6cadab23 (non-flash)
Nov 06 15:49:51 user nova-compute[75337]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bebbb46-2250-4511-ba59-f4ce67e0b45d (non-flash)
Nov 06 15:49:51 user nova-compute[75337]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2086a611-973d-47a1-bb69-f2ebd144be03 (non-flash)
Nov 06 15:49:51 user nova-compute[75337]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc5eae50-0461-47ca-bc48-cb38087b06e0 (non-flash)
Nov 06 15:49:51 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 15:49:51 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-763f9551-cdcf-4554-8ab6-579f96af3d4a tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2a9c5d6050>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6'): ({'sdd'}, set())}) {{(pid=75337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 15:49:51 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-763f9551-cdcf-4554-8ab6-579f96af3d4a tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] Removing single pathed devices sdd {{(pid=75337) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 15:49:51 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:51 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:49:51 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff0091ee-fdb8-4837-b1eb-82ed3ca8c770]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:49:51 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:51 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:49:51 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[80278c52-353c-47f5-9e9f-4c3571edba50]: (4, ('ok\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:49:51 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-763f9551-cdcf-4554-8ab6-579f96af3d4a tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] Flushing IO for device /dev/sdd {{(pid=75337) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 15:49:51 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:51 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:49:51 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[92538211-ae05-4633-87f5-9a936019dbcc]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:49:51 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-763f9551-cdcf-4554-8ab6-579f96af3d4a tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75337) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 15:49:51 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:51 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.061s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:49:51 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e0629bc-88ea-46c3-a63e-1e5a38b9816b]: (4, ('1', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:49:51 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-763f9551-cdcf-4554-8ab6-579f96af3d4a tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 15:49:51 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-763f9551-cdcf-4554-8ab6-579f96af3d4a tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] SCSI volumes sdd have been removed. {{(pid=75337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 15:49:51 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-763f9551-cdcf-4554-8ab6-579f96af3d4a tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6')] {{(pid=75337) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 15:49:51 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:51 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:49:51 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff86918b-d7ab-412c-b97c-fc508753b388]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:49:51 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-763f9551-cdcf-4554-8ab6-579f96af3d4a tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:49:51 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6 -p 172.16.0.220:3260 --logout {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:51 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:49:51 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[93fc1953-8cb3-4e75-ae00-1f092138d2fa]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:49:51 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-763f9551-cdcf-4554-8ab6-579f96af3d4a tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6, portal: 172.16.0.220,3260]
Nov 06 15:49:51 user nova-compute[75337]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6, portal: 172.16.0.220,3260] successful.
Nov 06 15:49:51 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:49:51 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6 -p 172.16.0.220:3260 --op delete {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:49:51 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15793a67-283e-461b-b16a-a42e1b3ea8e6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.048s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:49:51 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a0a353a-41e9-49c4-bb0e-ad2e1d61a07c]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:49:51 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-763f9551-cdcf-4554-8ab6-579f96af3d4a tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:49:51 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-763f9551-cdcf-4554-8ab6-579f96af3d4a tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.449s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 15:49:51 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-763f9551-cdcf-4554-8ab6-579f96af3d4a tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] <== disconnect_volume: return (451ms) None {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 15:49:51 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-763f9551-cdcf-4554-8ab6-579f96af3d4a tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] [instance: 7a6b16de-4506-432f-97f9-f083243dc047] Disconnected iSCSI Volume {{(pid=75337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 15:49:51 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-763f9551-cdcf-4554-8ab6-579f96af3d4a tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] [instance: 7a6b16de-4506-432f-97f9-f083243dc047] Deleting instance files /opt/stack/data/nova/instances/7a6b16de-4506-432f-97f9-f083243dc047_del
Nov 06 15:49:51 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-763f9551-cdcf-4554-8ab6-579f96af3d4a tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] [instance: 7a6b16de-4506-432f-97f9-f083243dc047] Deletion of /opt/stack/data/nova/instances/7a6b16de-4506-432f-97f9-f083243dc047_del complete
Nov 06 15:49:51 user nova-compute[75337]: INFO nova.compute.manager [None req-763f9551-cdcf-4554-8ab6-579f96af3d4a tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] [instance: 7a6b16de-4506-432f-97f9-f083243dc047] Took 1.92 seconds to destroy the instance on the hypervisor.
Nov 06 15:49:51 user nova-compute[75337]: DEBUG oslo.service.loopingcall [None req-763f9551-cdcf-4554-8ab6-579f96af3d4a tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75337) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 15:49:51 user nova-compute[75337]: DEBUG nova.compute.manager [-] [instance: 7a6b16de-4506-432f-97f9-f083243dc047] Deallocating network for instance {{(pid=75337) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 15:49:51 user nova-compute[75337]: DEBUG nova.network.neutron [-] [instance: 7a6b16de-4506-432f-97f9-f083243dc047] deallocate_for_instance() {{(pid=75337) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 15:49:51 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:51 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:51 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:51 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:52 user nova-compute[75337]: DEBUG nova.compute.manager [req-22b14b77-cc6e-467b-8605-481f7d3f7d77 req-922c9270-ca1f-4421-80ac-181e90af24e2 service nova] [instance: 7a6b16de-4506-432f-97f9-f083243dc047] Received event network-vif-plugged-4e4e1bfc-ebf9-41eb-81be-d1c34001dcff {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:49:52 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-22b14b77-cc6e-467b-8605-481f7d3f7d77 req-922c9270-ca1f-4421-80ac-181e90af24e2 service nova] Acquiring lock "7a6b16de-4506-432f-97f9-f083243dc047-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:49:52 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-22b14b77-cc6e-467b-8605-481f7d3f7d77 req-922c9270-ca1f-4421-80ac-181e90af24e2 service nova] Lock "7a6b16de-4506-432f-97f9-f083243dc047-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:49:52 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-22b14b77-cc6e-467b-8605-481f7d3f7d77 req-922c9270-ca1f-4421-80ac-181e90af24e2 service nova] Lock "7a6b16de-4506-432f-97f9-f083243dc047-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:49:52 user nova-compute[75337]: DEBUG nova.compute.manager [req-22b14b77-cc6e-467b-8605-481f7d3f7d77 req-922c9270-ca1f-4421-80ac-181e90af24e2 service nova] [instance: 7a6b16de-4506-432f-97f9-f083243dc047] No waiting events found dispatching network-vif-plugged-4e4e1bfc-ebf9-41eb-81be-d1c34001dcff {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:49:52 user nova-compute[75337]: WARNING nova.compute.manager [req-22b14b77-cc6e-467b-8605-481f7d3f7d77 req-922c9270-ca1f-4421-80ac-181e90af24e2 service nova] [instance: 7a6b16de-4506-432f-97f9-f083243dc047] Received unexpected event network-vif-plugged-4e4e1bfc-ebf9-41eb-81be-d1c34001dcff for instance with vm_state active and task_state deleting.
Nov 06 15:49:52 user nova-compute[75337]: DEBUG nova.compute.manager [req-d07892a3-97df-4653-8011-27c6d6d616b4 req-4af24096-64f1-4481-b4ee-ecf6df00b714 service nova] [instance: bc0e07f8-2731-4ffa-8446-b71ad3ba7375] Received event network-vif-plugged-a20e3f62-5387-4f54-b623-d45a0a311da0 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:49:52 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-d07892a3-97df-4653-8011-27c6d6d616b4 req-4af24096-64f1-4481-b4ee-ecf6df00b714 service nova] Acquiring lock "bc0e07f8-2731-4ffa-8446-b71ad3ba7375-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:49:52 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-d07892a3-97df-4653-8011-27c6d6d616b4 req-4af24096-64f1-4481-b4ee-ecf6df00b714 service nova] Lock "bc0e07f8-2731-4ffa-8446-b71ad3ba7375-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:49:52 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-d07892a3-97df-4653-8011-27c6d6d616b4 req-4af24096-64f1-4481-b4ee-ecf6df00b714 service nova] Lock "bc0e07f8-2731-4ffa-8446-b71ad3ba7375-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:49:52 user nova-compute[75337]: DEBUG nova.compute.manager [req-d07892a3-97df-4653-8011-27c6d6d616b4 req-4af24096-64f1-4481-b4ee-ecf6df00b714 service nova] [instance: bc0e07f8-2731-4ffa-8446-b71ad3ba7375] No waiting events found dispatching network-vif-plugged-a20e3f62-5387-4f54-b623-d45a0a311da0 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:49:52 user nova-compute[75337]: WARNING nova.compute.manager [req-d07892a3-97df-4653-8011-27c6d6d616b4 req-4af24096-64f1-4481-b4ee-ecf6df00b714 service nova] [instance: bc0e07f8-2731-4ffa-8446-b71ad3ba7375] Received unexpected event network-vif-plugged-a20e3f62-5387-4f54-b623-d45a0a311da0 for instance with vm_state active and task_state reboot_started_hard.
Nov 06 15:49:52 user nova-compute[75337]: DEBUG nova.network.neutron [-] [instance: 7a6b16de-4506-432f-97f9-f083243dc047] Updating instance_info_cache with network_info: [] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:49:52 user nova-compute[75337]: DEBUG nova.compute.manager [req-4d18b662-ab93-473a-ad19-464d44208b38 req-a776395e-4bbb-4c38-99c0-7e97cc2ad94f service nova] [instance: 7a6b16de-4506-432f-97f9-f083243dc047] Received event network-vif-deleted-4e4e1bfc-ebf9-41eb-81be-d1c34001dcff {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:49:52 user nova-compute[75337]: INFO nova.compute.manager [req-4d18b662-ab93-473a-ad19-464d44208b38 req-a776395e-4bbb-4c38-99c0-7e97cc2ad94f service nova] [instance: 7a6b16de-4506-432f-97f9-f083243dc047] Neutron deleted interface 4e4e1bfc-ebf9-41eb-81be-d1c34001dcff; detaching it from the instance and deleting it from the info cache
Nov 06 15:49:52 user nova-compute[75337]: DEBUG nova.network.neutron [req-4d18b662-ab93-473a-ad19-464d44208b38 req-a776395e-4bbb-4c38-99c0-7e97cc2ad94f service nova] [instance: 7a6b16de-4506-432f-97f9-f083243dc047] Updating instance_info_cache with network_info: [] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:49:52 user nova-compute[75337]: INFO nova.compute.manager [-] [instance: 7a6b16de-4506-432f-97f9-f083243dc047] Took 1.03 seconds to deallocate network for instance.
Nov 06 15:49:52 user nova-compute[75337]: DEBUG nova.compute.manager [req-4d18b662-ab93-473a-ad19-464d44208b38 req-a776395e-4bbb-4c38-99c0-7e97cc2ad94f service nova] [instance: 7a6b16de-4506-432f-97f9-f083243dc047] Detach interface failed, port_id=4e4e1bfc-ebf9-41eb-81be-d1c34001dcff, reason: Instance 7a6b16de-4506-432f-97f9-f083243dc047 could not be found. {{(pid=75337) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 06 15:49:52 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:52 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:53 user nova-compute[75337]: INFO nova.compute.manager [None req-763f9551-cdcf-4554-8ab6-579f96af3d4a tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] [instance: 7a6b16de-4506-432f-97f9-f083243dc047] Took 0.93 seconds to detach 1 volumes for instance.
Nov 06 15:49:53 user nova-compute[75337]: DEBUG nova.compute.manager [None req-763f9551-cdcf-4554-8ab6-579f96af3d4a tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] [instance: 7a6b16de-4506-432f-97f9-f083243dc047] Deleting volume: 15793a67-283e-461b-b16a-a42e1b3ea8e6 {{(pid=75337) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 06 15:49:53 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-763f9551-cdcf-4554-8ab6-579f96af3d4a tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:49:53 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-763f9551-cdcf-4554-8ab6-579f96af3d4a tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:49:53 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-763f9551-cdcf-4554-8ab6-579f96af3d4a tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 15:49:53 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-763f9551-cdcf-4554-8ab6-579f96af3d4a tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 15:49:53 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-763f9551-cdcf-4554-8ab6-579f96af3d4a tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.397s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:49:54 user nova-compute[75337]: INFO nova.scheduler.client.report [None req-763f9551-cdcf-4554-8ab6-579f96af3d4a tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] Deleted allocations for instance 7a6b16de-4506-432f-97f9-f083243dc047
Nov 06 15:49:54 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:54 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-763f9551-cdcf-4554-8ab6-579f96af3d4a tempest-ServerActionsV293TestJSON-541966055 tempest-ServerActionsV293TestJSON-541966055-project-member] Lock "7a6b16de-4506-432f-97f9-f083243dc047" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.581s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:49:54 user nova-compute[75337]: DEBUG nova.compute.manager [None req-60ea09e3-1b8a-4acc-8e6a-320ddf88dbad tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] [instance: bc0e07f8-2731-4ffa-8446-b71ad3ba7375] Instance event wait completed in 0 seconds for  {{(pid=75337) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 15:49:54 user nova-compute[75337]: INFO nova.virt.libvirt.driver [-] [instance: bc0e07f8-2731-4ffa-8446-b71ad3ba7375] Instance rebooted successfully.
Nov 06 15:49:54 user nova-compute[75337]: DEBUG nova.compute.manager [None req-60ea09e3-1b8a-4acc-8e6a-320ddf88dbad tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] [instance: bc0e07f8-2731-4ffa-8446-b71ad3ba7375] Checking state {{(pid=75337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 15:49:54 user nova-compute[75337]: DEBUG nova.compute.manager [req-f1cb88f7-1670-4555-b3f3-ec31180b0361 req-3de035b1-210a-460c-adc3-45744c2070a1 service nova] [instance: bc0e07f8-2731-4ffa-8446-b71ad3ba7375] Received event network-vif-plugged-a20e3f62-5387-4f54-b623-d45a0a311da0 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:49:54 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-f1cb88f7-1670-4555-b3f3-ec31180b0361 req-3de035b1-210a-460c-adc3-45744c2070a1 service nova] Acquiring lock "bc0e07f8-2731-4ffa-8446-b71ad3ba7375-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:49:54 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-f1cb88f7-1670-4555-b3f3-ec31180b0361 req-3de035b1-210a-460c-adc3-45744c2070a1 service nova] Lock "bc0e07f8-2731-4ffa-8446-b71ad3ba7375-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:49:54 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-f1cb88f7-1670-4555-b3f3-ec31180b0361 req-3de035b1-210a-460c-adc3-45744c2070a1 service nova] Lock "bc0e07f8-2731-4ffa-8446-b71ad3ba7375-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:49:54 user nova-compute[75337]: DEBUG nova.compute.manager [req-f1cb88f7-1670-4555-b3f3-ec31180b0361 req-3de035b1-210a-460c-adc3-45744c2070a1 service nova] [instance: bc0e07f8-2731-4ffa-8446-b71ad3ba7375] No waiting events found dispatching network-vif-plugged-a20e3f62-5387-4f54-b623-d45a0a311da0 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:49:54 user nova-compute[75337]: WARNING nova.compute.manager [req-f1cb88f7-1670-4555-b3f3-ec31180b0361 req-3de035b1-210a-460c-adc3-45744c2070a1 service nova] [instance: bc0e07f8-2731-4ffa-8446-b71ad3ba7375] Received unexpected event network-vif-plugged-a20e3f62-5387-4f54-b623-d45a0a311da0 for instance with vm_state active and task_state reboot_started_hard.
Nov 06 15:49:54 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-60ea09e3-1b8a-4acc-8e6a-320ddf88dbad tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Lock "bc0e07f8-2731-4ffa-8446-b71ad3ba7375" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 10.206s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:49:55 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:56 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-e1c86ba7-4312-476e-a955-6c4f1d0b65b5 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Acquiring lock "477da5ee-3e03-4aa9-9a88-004c442e617a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:49:56 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-e1c86ba7-4312-476e-a955-6c4f1d0b65b5 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Lock "477da5ee-3e03-4aa9-9a88-004c442e617a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:49:56 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-e1c86ba7-4312-476e-a955-6c4f1d0b65b5 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Acquiring lock "477da5ee-3e03-4aa9-9a88-004c442e617a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:49:56 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-e1c86ba7-4312-476e-a955-6c4f1d0b65b5 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Lock "477da5ee-3e03-4aa9-9a88-004c442e617a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:49:56 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-e1c86ba7-4312-476e-a955-6c4f1d0b65b5 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Lock "477da5ee-3e03-4aa9-9a88-004c442e617a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:49:56 user nova-compute[75337]: INFO nova.compute.manager [None req-e1c86ba7-4312-476e-a955-6c4f1d0b65b5 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] [instance: 477da5ee-3e03-4aa9-9a88-004c442e617a] Terminating instance
Nov 06 15:49:56 user nova-compute[75337]: DEBUG nova.compute.manager [None req-e1c86ba7-4312-476e-a955-6c4f1d0b65b5 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] [instance: 477da5ee-3e03-4aa9-9a88-004c442e617a] Start destroying the instance on the hypervisor. {{(pid=75337) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 15:49:56 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:56 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:56 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:56 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:56 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:56 user nova-compute[75337]: DEBUG nova.compute.manager [req-aee6799c-a1b8-4b68-a1c5-5b44e7842bf5 req-550c5fff-e442-4474-b0e3-722a1efd8e89 service nova] [instance: 477da5ee-3e03-4aa9-9a88-004c442e617a] Received event network-vif-unplugged-8e872f2c-9413-4a9e-8a10-606d0d9d0992 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:49:56 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-aee6799c-a1b8-4b68-a1c5-5b44e7842bf5 req-550c5fff-e442-4474-b0e3-722a1efd8e89 service nova] Acquiring lock "477da5ee-3e03-4aa9-9a88-004c442e617a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:49:56 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-aee6799c-a1b8-4b68-a1c5-5b44e7842bf5 req-550c5fff-e442-4474-b0e3-722a1efd8e89 service nova] Lock "477da5ee-3e03-4aa9-9a88-004c442e617a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:49:56 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-aee6799c-a1b8-4b68-a1c5-5b44e7842bf5 req-550c5fff-e442-4474-b0e3-722a1efd8e89 service nova] Lock "477da5ee-3e03-4aa9-9a88-004c442e617a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:49:56 user nova-compute[75337]: DEBUG nova.compute.manager [req-aee6799c-a1b8-4b68-a1c5-5b44e7842bf5 req-550c5fff-e442-4474-b0e3-722a1efd8e89 service nova] [instance: 477da5ee-3e03-4aa9-9a88-004c442e617a] No waiting events found dispatching network-vif-unplugged-8e872f2c-9413-4a9e-8a10-606d0d9d0992 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:49:56 user nova-compute[75337]: DEBUG nova.compute.manager [req-aee6799c-a1b8-4b68-a1c5-5b44e7842bf5 req-550c5fff-e442-4474-b0e3-722a1efd8e89 service nova] [instance: 477da5ee-3e03-4aa9-9a88-004c442e617a] Received event network-vif-unplugged-8e872f2c-9413-4a9e-8a10-606d0d9d0992 for instance with task_state deleting. {{(pid=75337) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 15:49:56 user nova-compute[75337]: INFO nova.virt.libvirt.driver [-] [instance: 477da5ee-3e03-4aa9-9a88-004c442e617a] Instance destroyed successfully.
Nov 06 15:49:56 user nova-compute[75337]: DEBUG nova.objects.instance [None req-e1c86ba7-4312-476e-a955-6c4f1d0b65b5 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Lazy-loading 'resources' on Instance uuid 477da5ee-3e03-4aa9-9a88-004c442e617a {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 15:49:56 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-e1c86ba7-4312-476e-a955-6c4f1d0b65b5 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T15:46:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1758736972',display_name='tempest-AttachVolumeNegativeTest-server-1758736972',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1758736972',id=17,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH7dqPvhcfnz1mzEiM9azFogk5BeKGbk1O0PkhvUm2hejpeN3ZNjRmO4JMp/BDPtIIBh3UEc+th3rjiTBNJ7SgN2MuibVvfJd9bRg8igyNzS1HjslOYlCpfj954yLKP+4A==',key_name='tempest-keypair-26215211',keypairs=<?>,launch_index=0,launched_at=2023-11-06T15:46:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1013e7afbefd4146a3be04587710b1de',ramdisk_id='',reservation_id='r-ugao4b8b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1104237961',owner_user_name='tempest-AttachVolumeNegativeTest-1104237961-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T15:46:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aeeea58fcd3e4217a34a4a38be6adf30',uuid=477da5ee-3e03-4aa9-9a88-004c442e617a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8e872f2c-9413-4a9e-8a10-606d0d9d0992", "address": "fa:16:3e:77:c1:a2", "network": {"id": "48f1545d-7e80-462f-9dbf-f1102ddcda9a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1210368397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1013e7afbefd4146a3be04587710b1de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e872f2c-94", "ovs_interfaceid": "8e872f2c-9413-4a9e-8a10-606d0d9d0992", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 15:49:56 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-e1c86ba7-4312-476e-a955-6c4f1d0b65b5 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Converting VIF {"id": "8e872f2c-9413-4a9e-8a10-606d0d9d0992", "address": "fa:16:3e:77:c1:a2", "network": {"id": "48f1545d-7e80-462f-9dbf-f1102ddcda9a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1210368397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1013e7afbefd4146a3be04587710b1de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e872f2c-94", "ovs_interfaceid": "8e872f2c-9413-4a9e-8a10-606d0d9d0992", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 15:49:56 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-e1c86ba7-4312-476e-a955-6c4f1d0b65b5 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:77:c1:a2,bridge_name='br-int',has_traffic_filtering=True,id=8e872f2c-9413-4a9e-8a10-606d0d9d0992,network=Network(48f1545d-7e80-462f-9dbf-f1102ddcda9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e872f2c-94') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 15:49:56 user nova-compute[75337]: DEBUG os_vif [None req-e1c86ba7-4312-476e-a955-6c4f1d0b65b5 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:77:c1:a2,bridge_name='br-int',has_traffic_filtering=True,id=8e872f2c-9413-4a9e-8a10-606d0d9d0992,network=Network(48f1545d-7e80-462f-9dbf-f1102ddcda9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e872f2c-94') {{(pid=75337) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 15:49:56 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:56 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8e872f2c-94, bridge=br-int, if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:49:56 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:56 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:49:56 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:56 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=97bca742-e7f4-4e1e-9231-e4eb19e2860c) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:49:56 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:56 user nova-compute[75337]: INFO os_vif [None req-e1c86ba7-4312-476e-a955-6c4f1d0b65b5 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:77:c1:a2,bridge_name='br-int',has_traffic_filtering=True,id=8e872f2c-9413-4a9e-8a10-606d0d9d0992,network=Network(48f1545d-7e80-462f-9dbf-f1102ddcda9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e872f2c-94')
Nov 06 15:49:56 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-e1c86ba7-4312-476e-a955-6c4f1d0b65b5 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] [instance: 477da5ee-3e03-4aa9-9a88-004c442e617a] Deleting instance files /opt/stack/data/nova/instances/477da5ee-3e03-4aa9-9a88-004c442e617a_del
Nov 06 15:49:56 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-e1c86ba7-4312-476e-a955-6c4f1d0b65b5 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] [instance: 477da5ee-3e03-4aa9-9a88-004c442e617a] Deletion of /opt/stack/data/nova/instances/477da5ee-3e03-4aa9-9a88-004c442e617a_del complete
Nov 06 15:49:57 user nova-compute[75337]: INFO nova.compute.manager [None req-e1c86ba7-4312-476e-a955-6c4f1d0b65b5 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] [instance: 477da5ee-3e03-4aa9-9a88-004c442e617a] Took 0.94 seconds to destroy the instance on the hypervisor.
Nov 06 15:49:57 user nova-compute[75337]: DEBUG oslo.service.loopingcall [None req-e1c86ba7-4312-476e-a955-6c4f1d0b65b5 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75337) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 15:49:57 user nova-compute[75337]: DEBUG nova.compute.manager [-] [instance: 477da5ee-3e03-4aa9-9a88-004c442e617a] Deallocating network for instance {{(pid=75337) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 15:49:57 user nova-compute[75337]: DEBUG nova.network.neutron [-] [instance: 477da5ee-3e03-4aa9-9a88-004c442e617a] deallocate_for_instance() {{(pid=75337) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 15:49:57 user nova-compute[75337]: DEBUG nova.network.neutron [-] [instance: 477da5ee-3e03-4aa9-9a88-004c442e617a] Updating instance_info_cache with network_info: [] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:49:57 user nova-compute[75337]: INFO nova.compute.manager [-] [instance: 477da5ee-3e03-4aa9-9a88-004c442e617a] Took 0.75 seconds to deallocate network for instance.
Nov 06 15:49:57 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-e1c86ba7-4312-476e-a955-6c4f1d0b65b5 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:49:57 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-e1c86ba7-4312-476e-a955-6c4f1d0b65b5 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:49:58 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-e1c86ba7-4312-476e-a955-6c4f1d0b65b5 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 15:49:58 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-e1c86ba7-4312-476e-a955-6c4f1d0b65b5 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 15:49:58 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-e1c86ba7-4312-476e-a955-6c4f1d0b65b5 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.422s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:49:58 user nova-compute[75337]: INFO nova.scheduler.client.report [None req-e1c86ba7-4312-476e-a955-6c4f1d0b65b5 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Deleted allocations for instance 477da5ee-3e03-4aa9-9a88-004c442e617a
Nov 06 15:49:58 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-e1c86ba7-4312-476e-a955-6c4f1d0b65b5 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Lock "477da5ee-3e03-4aa9-9a88-004c442e617a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.357s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:49:58 user nova-compute[75337]: DEBUG nova.compute.manager [req-384b17ba-15c5-4d9a-9708-ccd5d75e7cfc req-11af962c-c998-4f5d-bd56-c150d640b99f service nova] [instance: 477da5ee-3e03-4aa9-9a88-004c442e617a] Received event network-vif-plugged-8e872f2c-9413-4a9e-8a10-606d0d9d0992 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:49:58 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-384b17ba-15c5-4d9a-9708-ccd5d75e7cfc req-11af962c-c998-4f5d-bd56-c150d640b99f service nova] Acquiring lock "477da5ee-3e03-4aa9-9a88-004c442e617a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:49:58 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-384b17ba-15c5-4d9a-9708-ccd5d75e7cfc req-11af962c-c998-4f5d-bd56-c150d640b99f service nova] Lock "477da5ee-3e03-4aa9-9a88-004c442e617a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:49:58 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-384b17ba-15c5-4d9a-9708-ccd5d75e7cfc req-11af962c-c998-4f5d-bd56-c150d640b99f service nova] Lock "477da5ee-3e03-4aa9-9a88-004c442e617a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:49:58 user nova-compute[75337]: DEBUG nova.compute.manager [req-384b17ba-15c5-4d9a-9708-ccd5d75e7cfc req-11af962c-c998-4f5d-bd56-c150d640b99f service nova] [instance: 477da5ee-3e03-4aa9-9a88-004c442e617a] No waiting events found dispatching network-vif-plugged-8e872f2c-9413-4a9e-8a10-606d0d9d0992 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:49:58 user nova-compute[75337]: WARNING nova.compute.manager [req-384b17ba-15c5-4d9a-9708-ccd5d75e7cfc req-11af962c-c998-4f5d-bd56-c150d640b99f service nova] [instance: 477da5ee-3e03-4aa9-9a88-004c442e617a] Received unexpected event network-vif-plugged-8e872f2c-9413-4a9e-8a10-606d0d9d0992 for instance with vm_state deleted and task_state None.
Nov 06 15:49:58 user nova-compute[75337]: DEBUG nova.compute.manager [req-384b17ba-15c5-4d9a-9708-ccd5d75e7cfc req-11af962c-c998-4f5d-bd56-c150d640b99f service nova] [instance: 477da5ee-3e03-4aa9-9a88-004c442e617a] Received event network-vif-deleted-8e872f2c-9413-4a9e-8a10-606d0d9d0992 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:49:59 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:59 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-b1a29a92-f691-4c1e-89af-cb112a466e4d tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Acquiring lock "89f0a6eb-b68c-4760-9446-b77e80ebaf99" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:49:59 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-b1a29a92-f691-4c1e-89af-cb112a466e4d tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Lock "89f0a6eb-b68c-4760-9446-b77e80ebaf99" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:49:59 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-b1a29a92-f691-4c1e-89af-cb112a466e4d tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Acquiring lock "89f0a6eb-b68c-4760-9446-b77e80ebaf99-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:49:59 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-b1a29a92-f691-4c1e-89af-cb112a466e4d tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Lock "89f0a6eb-b68c-4760-9446-b77e80ebaf99-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:49:59 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-b1a29a92-f691-4c1e-89af-cb112a466e4d tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Lock "89f0a6eb-b68c-4760-9446-b77e80ebaf99-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.002s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:49:59 user nova-compute[75337]: INFO nova.compute.manager [None req-b1a29a92-f691-4c1e-89af-cb112a466e4d tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] [instance: 89f0a6eb-b68c-4760-9446-b77e80ebaf99] Terminating instance
Nov 06 15:49:59 user nova-compute[75337]: DEBUG nova.compute.manager [None req-b1a29a92-f691-4c1e-89af-cb112a466e4d tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] [instance: 89f0a6eb-b68c-4760-9446-b77e80ebaf99] Start destroying the instance on the hypervisor. {{(pid=75337) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 15:49:59 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:49:59 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:50:00 user nova-compute[75337]: INFO nova.virt.libvirt.driver [-] [instance: 89f0a6eb-b68c-4760-9446-b77e80ebaf99] Instance destroyed successfully.
Nov 06 15:50:00 user nova-compute[75337]: DEBUG nova.objects.instance [None req-b1a29a92-f691-4c1e-89af-cb112a466e4d tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Lazy-loading 'resources' on Instance uuid 89f0a6eb-b68c-4760-9446-b77e80ebaf99 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 15:50:00 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-b1a29a92-f691-4c1e-89af-cb112a466e4d tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T15:47:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-2016745810',display_name='tempest-VolumesAdminNegativeTest-server-2016745810',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-2016745810',id=22,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-06T15:47:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f2de62cc51864374a29a5d96584e8dd1',ramdisk_id='',reservation_id='r-2kuld4k8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1559219265',owner_user_name='tempest-VolumesAdminNegativeTest-1559219265-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T15:47:56Z,user_data=None,user_id='38d79821f1a8466fa7c925fcc0bfb778',uuid=89f0a6eb-b68c-4760-9446-b77e80ebaf99,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3f6ab23d-3925-4cd7-b283-938c84152e65", "address": "fa:16:3e:5b:a9:c6", "network": {"id": "c07dbf10-d5b5-40f4-b841-826ca6f505d8", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1886147547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2de62cc51864374a29a5d96584e8dd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f6ab23d-39", "ovs_interfaceid": "3f6ab23d-3925-4cd7-b283-938c84152e65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 15:50:00 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-b1a29a92-f691-4c1e-89af-cb112a466e4d tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Converting VIF {"id": "3f6ab23d-3925-4cd7-b283-938c84152e65", "address": "fa:16:3e:5b:a9:c6", "network": {"id": "c07dbf10-d5b5-40f4-b841-826ca6f505d8", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1886147547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2de62cc51864374a29a5d96584e8dd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f6ab23d-39", "ovs_interfaceid": "3f6ab23d-3925-4cd7-b283-938c84152e65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 15:50:00 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-b1a29a92-f691-4c1e-89af-cb112a466e4d tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:a9:c6,bridge_name='br-int',has_traffic_filtering=True,id=3f6ab23d-3925-4cd7-b283-938c84152e65,network=Network(c07dbf10-d5b5-40f4-b841-826ca6f505d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f6ab23d-39') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 15:50:00 user nova-compute[75337]: DEBUG os_vif [None req-b1a29a92-f691-4c1e-89af-cb112a466e4d tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:a9:c6,bridge_name='br-int',has_traffic_filtering=True,id=3f6ab23d-3925-4cd7-b283-938c84152e65,network=Network(c07dbf10-d5b5-40f4-b841-826ca6f505d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f6ab23d-39') {{(pid=75337) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 15:50:00 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:50:00 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3f6ab23d-39, bridge=br-int, if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:50:00 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:50:00 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:50:00 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:50:00 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=21a58705-f9a5-4aeb-9071-03bf1a83dc98) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:50:00 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:50:00 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:50:00 user nova-compute[75337]: INFO os_vif [None req-b1a29a92-f691-4c1e-89af-cb112a466e4d tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:a9:c6,bridge_name='br-int',has_traffic_filtering=True,id=3f6ab23d-3925-4cd7-b283-938c84152e65,network=Network(c07dbf10-d5b5-40f4-b841-826ca6f505d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f6ab23d-39')
Nov 06 15:50:00 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-b1a29a92-f691-4c1e-89af-cb112a466e4d tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] [instance: 89f0a6eb-b68c-4760-9446-b77e80ebaf99] Deleting instance files /opt/stack/data/nova/instances/89f0a6eb-b68c-4760-9446-b77e80ebaf99_del
Nov 06 15:50:00 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-b1a29a92-f691-4c1e-89af-cb112a466e4d tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] [instance: 89f0a6eb-b68c-4760-9446-b77e80ebaf99] Deletion of /opt/stack/data/nova/instances/89f0a6eb-b68c-4760-9446-b77e80ebaf99_del complete
Nov 06 15:50:00 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:50:00 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:50:00 user nova-compute[75337]: INFO nova.compute.manager [None req-b1a29a92-f691-4c1e-89af-cb112a466e4d tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] [instance: 89f0a6eb-b68c-4760-9446-b77e80ebaf99] Took 0.77 seconds to destroy the instance on the hypervisor.
Nov 06 15:50:00 user nova-compute[75337]: DEBUG oslo.service.loopingcall [None req-b1a29a92-f691-4c1e-89af-cb112a466e4d tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75337) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 15:50:00 user nova-compute[75337]: DEBUG nova.compute.manager [-] [instance: 89f0a6eb-b68c-4760-9446-b77e80ebaf99] Deallocating network for instance {{(pid=75337) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 15:50:00 user nova-compute[75337]: DEBUG nova.network.neutron [-] [instance: 89f0a6eb-b68c-4760-9446-b77e80ebaf99] deallocate_for_instance() {{(pid=75337) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 15:50:00 user nova-compute[75337]: DEBUG nova.compute.manager [req-dad90ca3-350e-489d-9b35-349692f3e8f0 req-dd05e23f-a86b-4eb1-a0a5-3f8cc90a8521 service nova] [instance: 89f0a6eb-b68c-4760-9446-b77e80ebaf99] Received event network-vif-unplugged-3f6ab23d-3925-4cd7-b283-938c84152e65 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:50:00 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-dad90ca3-350e-489d-9b35-349692f3e8f0 req-dd05e23f-a86b-4eb1-a0a5-3f8cc90a8521 service nova] Acquiring lock "89f0a6eb-b68c-4760-9446-b77e80ebaf99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:50:00 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-dad90ca3-350e-489d-9b35-349692f3e8f0 req-dd05e23f-a86b-4eb1-a0a5-3f8cc90a8521 service nova] Lock "89f0a6eb-b68c-4760-9446-b77e80ebaf99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:50:00 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-dad90ca3-350e-489d-9b35-349692f3e8f0 req-dd05e23f-a86b-4eb1-a0a5-3f8cc90a8521 service nova] Lock "89f0a6eb-b68c-4760-9446-b77e80ebaf99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:50:00 user nova-compute[75337]: DEBUG nova.compute.manager [req-dad90ca3-350e-489d-9b35-349692f3e8f0 req-dd05e23f-a86b-4eb1-a0a5-3f8cc90a8521 service nova] [instance: 89f0a6eb-b68c-4760-9446-b77e80ebaf99] No waiting events found dispatching network-vif-unplugged-3f6ab23d-3925-4cd7-b283-938c84152e65 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:50:00 user nova-compute[75337]: DEBUG nova.compute.manager [req-dad90ca3-350e-489d-9b35-349692f3e8f0 req-dd05e23f-a86b-4eb1-a0a5-3f8cc90a8521 service nova] [instance: 89f0a6eb-b68c-4760-9446-b77e80ebaf99] Received event network-vif-unplugged-3f6ab23d-3925-4cd7-b283-938c84152e65 for instance with task_state deleting. {{(pid=75337) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 15:50:00 user nova-compute[75337]: DEBUG nova.compute.manager [req-dad90ca3-350e-489d-9b35-349692f3e8f0 req-dd05e23f-a86b-4eb1-a0a5-3f8cc90a8521 service nova] [instance: 89f0a6eb-b68c-4760-9446-b77e80ebaf99] Received event network-vif-plugged-3f6ab23d-3925-4cd7-b283-938c84152e65 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:50:00 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-dad90ca3-350e-489d-9b35-349692f3e8f0 req-dd05e23f-a86b-4eb1-a0a5-3f8cc90a8521 service nova] Acquiring lock "89f0a6eb-b68c-4760-9446-b77e80ebaf99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:50:00 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-dad90ca3-350e-489d-9b35-349692f3e8f0 req-dd05e23f-a86b-4eb1-a0a5-3f8cc90a8521 service nova] Lock "89f0a6eb-b68c-4760-9446-b77e80ebaf99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:50:00 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-dad90ca3-350e-489d-9b35-349692f3e8f0 req-dd05e23f-a86b-4eb1-a0a5-3f8cc90a8521 service nova] Lock "89f0a6eb-b68c-4760-9446-b77e80ebaf99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:50:00 user nova-compute[75337]: DEBUG nova.compute.manager [req-dad90ca3-350e-489d-9b35-349692f3e8f0 req-dd05e23f-a86b-4eb1-a0a5-3f8cc90a8521 service nova] [instance: 89f0a6eb-b68c-4760-9446-b77e80ebaf99] No waiting events found dispatching network-vif-plugged-3f6ab23d-3925-4cd7-b283-938c84152e65 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:50:00 user nova-compute[75337]: WARNING nova.compute.manager [req-dad90ca3-350e-489d-9b35-349692f3e8f0 req-dd05e23f-a86b-4eb1-a0a5-3f8cc90a8521 service nova] [instance: 89f0a6eb-b68c-4760-9446-b77e80ebaf99] Received unexpected event network-vif-plugged-3f6ab23d-3925-4cd7-b283-938c84152e65 for instance with vm_state active and task_state deleting.
Nov 06 15:50:00 user nova-compute[75337]: DEBUG nova.network.neutron [-] [instance: 89f0a6eb-b68c-4760-9446-b77e80ebaf99] Updating instance_info_cache with network_info: [] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:50:00 user nova-compute[75337]: INFO nova.compute.manager [-] [instance: 89f0a6eb-b68c-4760-9446-b77e80ebaf99] Took 0.62 seconds to deallocate network for instance.
Nov 06 15:50:00 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-b1a29a92-f691-4c1e-89af-cb112a466e4d tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:50:00 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-b1a29a92-f691-4c1e-89af-cb112a466e4d tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:50:01 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-b1a29a92-f691-4c1e-89af-cb112a466e4d tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 15:50:01 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-b1a29a92-f691-4c1e-89af-cb112a466e4d tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 15:50:01 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-b1a29a92-f691-4c1e-89af-cb112a466e4d tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.529s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:50:01 user nova-compute[75337]: INFO nova.scheduler.client.report [None req-b1a29a92-f691-4c1e-89af-cb112a466e4d tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Deleted allocations for instance 89f0a6eb-b68c-4760-9446-b77e80ebaf99
Nov 06 15:50:01 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-b1a29a92-f691-4c1e-89af-cb112a466e4d tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Lock "89f0a6eb-b68c-4760-9446-b77e80ebaf99" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.230s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:50:02 user nova-compute[75337]: DEBUG nova.compute.manager [req-45d5199e-6a6f-4891-a8c7-a6ce4cf15262 req-02faa633-0e9b-4f11-8163-688909a50e4b service nova] [instance: 89f0a6eb-b68c-4760-9446-b77e80ebaf99] Received event network-vif-deleted-3f6ab23d-3925-4cd7-b283-938c84152e65 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:50:04 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:50:05 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:50:05 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:50:05 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:50:05 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Starting heal instance info cache {{(pid=75337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 15:50:05 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Didn't find any instances for network info cache update. {{(pid=75337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 06 15:50:05 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:50:05 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:50:05 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:50:05 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:50:05 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:50:05 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:50:05 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75337) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 15:50:05 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:50:07 user nova-compute[75337]: DEBUG nova.objects.instance [None req-17ccbf7d-ccd3-46cd-be17-4ee8a2de27f7 tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] Lazy-loading 'flavor' on Instance uuid 9125364b-332f-4297-815f-3aa1eadaf743 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 15:50:07 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-17ccbf7d-ccd3-46cd-be17-4ee8a2de27f7 tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] Lock "9125364b-332f-4297-815f-3aa1eadaf743" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 40.041s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:50:07 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager.update_available_resource {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:50:07 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:50:07 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:50:07 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:50:07 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Auditing locally available compute resources for user (node: user) {{(pid=75337) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 15:50:07 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7ececa5-256f-4a5d-aeda-3d2ee5c01cfe/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:50:07 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7ececa5-256f-4a5d-aeda-3d2ee5c01cfe/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:50:07 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7ececa5-256f-4a5d-aeda-3d2ee5c01cfe/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:50:08 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7ececa5-256f-4a5d-aeda-3d2ee5c01cfe/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:50:08 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc0e07f8-2731-4ffa-8446-b71ad3ba7375/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:50:08 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc0e07f8-2731-4ffa-8446-b71ad3ba7375/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:50:08 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc0e07f8-2731-4ffa-8446-b71ad3ba7375/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:50:08 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc0e07f8-2731-4ffa-8446-b71ad3ba7375/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:50:08 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 15:50:08 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 15:50:08 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9125364b-332f-4297-815f-3aa1eadaf743/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:50:08 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9125364b-332f-4297-815f-3aa1eadaf743/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:50:08 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9125364b-332f-4297-815f-3aa1eadaf743/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:50:08 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9125364b-332f-4297-815f-3aa1eadaf743/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:50:08 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdced0ba-84ff-42af-baab-e2f3412e1676/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:50:09 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdced0ba-84ff-42af-baab-e2f3412e1676/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:50:09 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdced0ba-84ff-42af-baab-e2f3412e1676/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:50:09 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:50:09 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdced0ba-84ff-42af-baab-e2f3412e1676/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:50:09 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83516ff5-c4e7-4e91-a2f9-8af9b51cf475/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:50:09 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83516ff5-c4e7-4e91-a2f9-8af9b51cf475/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:50:09 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83516ff5-c4e7-4e91-a2f9-8af9b51cf475/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:50:09 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83516ff5-c4e7-4e91-a2f9-8af9b51cf475/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:50:09 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 15:50:09 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 15:50:09 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=75337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 15:50:09 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] skipping disk /dev/sdj (vdc) as it is a volume {{(pid=75337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 15:50:10 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 15:50:10 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 15:50:10 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Hypervisor/Node resource view: name=user free_ram=7726MB free_disk=25.087360382080078GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75337) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 15:50:10 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:50:10 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:50:10 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:50:10 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 83516ff5-c4e7-4e91-a2f9-8af9b51cf475 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:50:10 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 1fa4c927-7485-4f34-94bd-9e20358904b6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:50:10 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance cdced0ba-84ff-42af-baab-e2f3412e1676 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:50:10 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 9125364b-332f-4297-815f-3aa1eadaf743 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:50:10 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance bc0e07f8-2731-4ffa-8446-b71ad3ba7375 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:50:10 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance b7ececa5-256f-4a5d-aeda-3d2ee5c01cfe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:50:10 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance fdda34b5-280f-489d-baf5-bf21ac6dd6c9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:50:10 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 493eff79-294e-4259-a6d0-4772c4b45013 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:50:10 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 15:50:10 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 15:50:10 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 15:50:10 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 15:50:10 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Compute_service record updated for user:user {{(pid=75337) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 15:50:10 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.358s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:50:14 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:50:15 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:50:17 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-b8534bd9-c2d2-4b58-b93d-246bbdad2568 tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] Acquiring lock "9125364b-332f-4297-815f-3aa1eadaf743" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:50:17 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-b8534bd9-c2d2-4b58-b93d-246bbdad2568 tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] Lock "9125364b-332f-4297-815f-3aa1eadaf743" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:50:17 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-b8534bd9-c2d2-4b58-b93d-246bbdad2568 tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] Acquiring lock "9125364b-332f-4297-815f-3aa1eadaf743-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:50:17 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-b8534bd9-c2d2-4b58-b93d-246bbdad2568 tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] Lock "9125364b-332f-4297-815f-3aa1eadaf743-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:50:17 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-b8534bd9-c2d2-4b58-b93d-246bbdad2568 tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] Lock "9125364b-332f-4297-815f-3aa1eadaf743-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:50:17 user nova-compute[75337]: INFO nova.compute.manager [None req-b8534bd9-c2d2-4b58-b93d-246bbdad2568 tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] [instance: 9125364b-332f-4297-815f-3aa1eadaf743] Terminating instance
Nov 06 15:50:17 user nova-compute[75337]: DEBUG nova.compute.manager [None req-b8534bd9-c2d2-4b58-b93d-246bbdad2568 tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] [instance: 9125364b-332f-4297-815f-3aa1eadaf743] Start destroying the instance on the hypervisor. {{(pid=75337) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 15:50:17 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:50:17 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:50:17 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:50:17 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:50:17 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:50:18 user nova-compute[75337]: DEBUG nova.compute.manager [req-39f44bf3-e08a-4d49-acc1-b8c2e2b25fa7 req-01cffc0e-ccf9-4199-992d-03e0fb5f9fb2 service nova] [instance: 9125364b-332f-4297-815f-3aa1eadaf743] Received event network-vif-unplugged-f38ac99b-98f5-4892-9098-71487faa5282 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:50:18 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-39f44bf3-e08a-4d49-acc1-b8c2e2b25fa7 req-01cffc0e-ccf9-4199-992d-03e0fb5f9fb2 service nova] Acquiring lock "9125364b-332f-4297-815f-3aa1eadaf743-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:50:18 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-39f44bf3-e08a-4d49-acc1-b8c2e2b25fa7 req-01cffc0e-ccf9-4199-992d-03e0fb5f9fb2 service nova] Lock "9125364b-332f-4297-815f-3aa1eadaf743-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:50:18 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-39f44bf3-e08a-4d49-acc1-b8c2e2b25fa7 req-01cffc0e-ccf9-4199-992d-03e0fb5f9fb2 service nova] Lock "9125364b-332f-4297-815f-3aa1eadaf743-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:50:18 user nova-compute[75337]: DEBUG nova.compute.manager [req-39f44bf3-e08a-4d49-acc1-b8c2e2b25fa7 req-01cffc0e-ccf9-4199-992d-03e0fb5f9fb2 service nova] [instance: 9125364b-332f-4297-815f-3aa1eadaf743] No waiting events found dispatching network-vif-unplugged-f38ac99b-98f5-4892-9098-71487faa5282 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:50:18 user nova-compute[75337]: DEBUG nova.compute.manager [req-39f44bf3-e08a-4d49-acc1-b8c2e2b25fa7 req-01cffc0e-ccf9-4199-992d-03e0fb5f9fb2 service nova] [instance: 9125364b-332f-4297-815f-3aa1eadaf743] Received event network-vif-unplugged-f38ac99b-98f5-4892-9098-71487faa5282 for instance with task_state deleting. {{(pid=75337) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 15:50:18 user nova-compute[75337]: INFO nova.virt.libvirt.driver [-] [instance: 9125364b-332f-4297-815f-3aa1eadaf743] Instance destroyed successfully.
Nov 06 15:50:18 user nova-compute[75337]: DEBUG nova.objects.instance [None req-b8534bd9-c2d2-4b58-b93d-246bbdad2568 tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] Lazy-loading 'resources' on Instance uuid 9125364b-332f-4297-815f-3aa1eadaf743 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 15:50:18 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-b8534bd9-c2d2-4b58-b93d-246bbdad2568 tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T15:45:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-147418644',display_name='tempest-TestVolumeSwap-server-147418644',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-147418644',id=16,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFTzCDcegbPEDOq1MYT8m/U4fKnrhQleiNetk6N/xJqk153diuOnWfp/E7K9Cg34o9TXvzuplyNTQPO/2neTnFqhpAdvzKLAMqrm205lzETvYPfiQ+ookb40gXOCfhG2mQ==',key_name='tempest-keypair-1845115653',keypairs=<?>,launch_index=0,launched_at=2023-11-06T15:45:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0eca67bcdbde46579049659635e8476b',ramdisk_id='',reservation_id='r-09r0itxm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-899206319',owner_user_name='tempest-TestVolumeSwap-899206319-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T15:45:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='44a35e5af93b4817acae19d471e26463',uuid=9125364b-332f-4297-815f-3aa1eadaf743,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f38ac99b-98f5-4892-9098-71487faa5282", "address": "fa:16:3e:d5:76:83", "network": {"id": "d1def424-b3a7-441d-aee5-0a2465f37ecc", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1418475866-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0eca67bcdbde46579049659635e8476b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf38ac99b-98", "ovs_interfaceid": "f38ac99b-98f5-4892-9098-71487faa5282", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 15:50:18 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-b8534bd9-c2d2-4b58-b93d-246bbdad2568 tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] Converting VIF {"id": "f38ac99b-98f5-4892-9098-71487faa5282", "address": "fa:16:3e:d5:76:83", "network": {"id": "d1def424-b3a7-441d-aee5-0a2465f37ecc", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1418475866-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0eca67bcdbde46579049659635e8476b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf38ac99b-98", "ovs_interfaceid": "f38ac99b-98f5-4892-9098-71487faa5282", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 15:50:18 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-b8534bd9-c2d2-4b58-b93d-246bbdad2568 tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d5:76:83,bridge_name='br-int',has_traffic_filtering=True,id=f38ac99b-98f5-4892-9098-71487faa5282,network=Network(d1def424-b3a7-441d-aee5-0a2465f37ecc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf38ac99b-98') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 15:50:18 user nova-compute[75337]: DEBUG os_vif [None req-b8534bd9-c2d2-4b58-b93d-246bbdad2568 tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d5:76:83,bridge_name='br-int',has_traffic_filtering=True,id=f38ac99b-98f5-4892-9098-71487faa5282,network=Network(d1def424-b3a7-441d-aee5-0a2465f37ecc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf38ac99b-98') {{(pid=75337) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 15:50:18 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:50:18 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf38ac99b-98, bridge=br-int, if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:50:18 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:50:18 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:50:18 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:50:18 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=67002848-fa02-40ce-ad16-298b2d6ad791) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:50:18 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:50:18 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:50:18 user nova-compute[75337]: INFO os_vif [None req-b8534bd9-c2d2-4b58-b93d-246bbdad2568 tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d5:76:83,bridge_name='br-int',has_traffic_filtering=True,id=f38ac99b-98f5-4892-9098-71487faa5282,network=Network(d1def424-b3a7-441d-aee5-0a2465f37ecc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf38ac99b-98')
Nov 06 15:50:18 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-b8534bd9-c2d2-4b58-b93d-246bbdad2568 tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] [instance: 9125364b-332f-4297-815f-3aa1eadaf743] Deleting instance files /opt/stack/data/nova/instances/9125364b-332f-4297-815f-3aa1eadaf743_del
Nov 06 15:50:18 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-b8534bd9-c2d2-4b58-b93d-246bbdad2568 tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] [instance: 9125364b-332f-4297-815f-3aa1eadaf743] Deletion of /opt/stack/data/nova/instances/9125364b-332f-4297-815f-3aa1eadaf743_del complete
Nov 06 15:50:18 user nova-compute[75337]: INFO nova.compute.manager [None req-b8534bd9-c2d2-4b58-b93d-246bbdad2568 tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] [instance: 9125364b-332f-4297-815f-3aa1eadaf743] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 06 15:50:18 user nova-compute[75337]: DEBUG oslo.service.loopingcall [None req-b8534bd9-c2d2-4b58-b93d-246bbdad2568 tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75337) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 15:50:18 user nova-compute[75337]: DEBUG nova.compute.manager [-] [instance: 9125364b-332f-4297-815f-3aa1eadaf743] Deallocating network for instance {{(pid=75337) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 15:50:18 user nova-compute[75337]: DEBUG nova.network.neutron [-] [instance: 9125364b-332f-4297-815f-3aa1eadaf743] deallocate_for_instance() {{(pid=75337) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 15:50:19 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:50:19 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:50:19 user nova-compute[75337]: DEBUG nova.network.neutron [-] [instance: 9125364b-332f-4297-815f-3aa1eadaf743] Updating instance_info_cache with network_info: [] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:50:19 user nova-compute[75337]: INFO nova.compute.manager [-] [instance: 9125364b-332f-4297-815f-3aa1eadaf743] Took 0.77 seconds to deallocate network for instance.
Nov 06 15:50:19 user nova-compute[75337]: DEBUG nova.compute.manager [req-3c3d2e84-d6c9-4af4-8d0b-c408f2598bac req-d38958e9-aae7-4448-bc7f-61b74788ae52 service nova] [instance: 9125364b-332f-4297-815f-3aa1eadaf743] Received event network-vif-deleted-f38ac99b-98f5-4892-9098-71487faa5282 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:50:19 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-b8534bd9-c2d2-4b58-b93d-246bbdad2568 tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:50:19 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-b8534bd9-c2d2-4b58-b93d-246bbdad2568 tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:50:19 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-b8534bd9-c2d2-4b58-b93d-246bbdad2568 tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 15:50:19 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-b8534bd9-c2d2-4b58-b93d-246bbdad2568 tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 15:50:19 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-b8534bd9-c2d2-4b58-b93d-246bbdad2568 tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.277s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:50:19 user nova-compute[75337]: INFO nova.scheduler.client.report [None req-b8534bd9-c2d2-4b58-b93d-246bbdad2568 tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] Deleted allocations for instance 9125364b-332f-4297-815f-3aa1eadaf743
Nov 06 15:50:19 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-b8534bd9-c2d2-4b58-b93d-246bbdad2568 tempest-TestVolumeSwap-899206319 tempest-TestVolumeSwap-899206319-project-member] Lock "9125364b-332f-4297-815f-3aa1eadaf743" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.095s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:50:20 user nova-compute[75337]: DEBUG nova.compute.manager [req-afd0eb42-ea71-48eb-bbc3-b07de1426f74 req-1141d0ec-ccd7-404f-8566-3f60aee70f9c service nova] [instance: 9125364b-332f-4297-815f-3aa1eadaf743] Received event network-vif-plugged-f38ac99b-98f5-4892-9098-71487faa5282 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:50:20 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-afd0eb42-ea71-48eb-bbc3-b07de1426f74 req-1141d0ec-ccd7-404f-8566-3f60aee70f9c service nova] Acquiring lock "9125364b-332f-4297-815f-3aa1eadaf743-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:50:20 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-afd0eb42-ea71-48eb-bbc3-b07de1426f74 req-1141d0ec-ccd7-404f-8566-3f60aee70f9c service nova] Lock "9125364b-332f-4297-815f-3aa1eadaf743-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:50:20 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-afd0eb42-ea71-48eb-bbc3-b07de1426f74 req-1141d0ec-ccd7-404f-8566-3f60aee70f9c service nova] Lock "9125364b-332f-4297-815f-3aa1eadaf743-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:50:20 user nova-compute[75337]: DEBUG nova.compute.manager [req-afd0eb42-ea71-48eb-bbc3-b07de1426f74 req-1141d0ec-ccd7-404f-8566-3f60aee70f9c service nova] [instance: 9125364b-332f-4297-815f-3aa1eadaf743] No waiting events found dispatching network-vif-plugged-f38ac99b-98f5-4892-9098-71487faa5282 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:50:20 user nova-compute[75337]: WARNING nova.compute.manager [req-afd0eb42-ea71-48eb-bbc3-b07de1426f74 req-1141d0ec-ccd7-404f-8566-3f60aee70f9c service nova] [instance: 9125364b-332f-4297-815f-3aa1eadaf743] Received unexpected event network-vif-plugged-f38ac99b-98f5-4892-9098-71487faa5282 for instance with vm_state deleted and task_state None.
Nov 06 15:50:22 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-6c1116f5-f156-445e-ac3f-a65792666fe2 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Acquiring lock "5badd355-5783-41b9-8f01-9fac9ff5d9d6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:50:22 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-6c1116f5-f156-445e-ac3f-a65792666fe2 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Lock "5badd355-5783-41b9-8f01-9fac9ff5d9d6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:50:22 user nova-compute[75337]: DEBUG nova.compute.manager [None req-6c1116f5-f156-445e-ac3f-a65792666fe2 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: 5badd355-5783-41b9-8f01-9fac9ff5d9d6] Starting instance... {{(pid=75337) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 15:50:22 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-6c1116f5-f156-445e-ac3f-a65792666fe2 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:50:22 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-6c1116f5-f156-445e-ac3f-a65792666fe2 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:50:22 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-6c1116f5-f156-445e-ac3f-a65792666fe2 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75337) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 15:50:22 user nova-compute[75337]: INFO nova.compute.claims [None req-6c1116f5-f156-445e-ac3f-a65792666fe2 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: 5badd355-5783-41b9-8f01-9fac9ff5d9d6] Claim successful on node user
Nov 06 15:50:23 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-6c1116f5-f156-445e-ac3f-a65792666fe2 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 15:50:23 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-6c1116f5-f156-445e-ac3f-a65792666fe2 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 15:50:23 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-6c1116f5-f156-445e-ac3f-a65792666fe2 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.373s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:50:23 user nova-compute[75337]: DEBUG nova.compute.manager [None req-6c1116f5-f156-445e-ac3f-a65792666fe2 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: 5badd355-5783-41b9-8f01-9fac9ff5d9d6] Start building networks asynchronously for instance. {{(pid=75337) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 15:50:23 user nova-compute[75337]: DEBUG nova.compute.manager [None req-6c1116f5-f156-445e-ac3f-a65792666fe2 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: 5badd355-5783-41b9-8f01-9fac9ff5d9d6] Allocating IP information in the background. {{(pid=75337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 15:50:23 user nova-compute[75337]: DEBUG nova.network.neutron [None req-6c1116f5-f156-445e-ac3f-a65792666fe2 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: 5badd355-5783-41b9-8f01-9fac9ff5d9d6] allocate_for_instance() {{(pid=75337) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 15:50:23 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-6c1116f5-f156-445e-ac3f-a65792666fe2 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: 5badd355-5783-41b9-8f01-9fac9ff5d9d6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 15:50:23 user nova-compute[75337]: DEBUG nova.compute.manager [None req-6c1116f5-f156-445e-ac3f-a65792666fe2 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: 5badd355-5783-41b9-8f01-9fac9ff5d9d6] Start building block device mappings for instance. {{(pid=75337) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 15:50:23 user nova-compute[75337]: DEBUG nova.policy [None req-6c1116f5-f156-445e-ac3f-a65792666fe2 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '74090d6e5b354d79bf6ded92e6de56aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb76b5b0f2b24f1c84a92403176bcc00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75337) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 15:50:23 user nova-compute[75337]: INFO nova.virt.block_device [None req-6c1116f5-f156-445e-ac3f-a65792666fe2 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: 5badd355-5783-41b9-8f01-9fac9ff5d9d6] Booting with volume-backed-image 16b903ae-a40f-41a7-985b-4804cce92c62 at /dev/vda
Nov 06 15:50:23 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:50:24 user nova-compute[75337]: DEBUG nova.network.neutron [None req-6c1116f5-f156-445e-ac3f-a65792666fe2 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: 5badd355-5783-41b9-8f01-9fac9ff5d9d6] Successfully created port: e029cddb-82d2-48ca-8943-83072e95d71e {{(pid=75337) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 15:50:24 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:50:24 user nova-compute[75337]: DEBUG nova.network.neutron [None req-6c1116f5-f156-445e-ac3f-a65792666fe2 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: 5badd355-5783-41b9-8f01-9fac9ff5d9d6] Successfully updated port: e029cddb-82d2-48ca-8943-83072e95d71e {{(pid=75337) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 15:50:24 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-6c1116f5-f156-445e-ac3f-a65792666fe2 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Acquiring lock "refresh_cache-5badd355-5783-41b9-8f01-9fac9ff5d9d6" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 15:50:24 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-6c1116f5-f156-445e-ac3f-a65792666fe2 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Acquired lock "refresh_cache-5badd355-5783-41b9-8f01-9fac9ff5d9d6" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 15:50:24 user nova-compute[75337]: DEBUG nova.network.neutron [None req-6c1116f5-f156-445e-ac3f-a65792666fe2 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: 5badd355-5783-41b9-8f01-9fac9ff5d9d6] Building network info cache for instance {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 15:50:24 user nova-compute[75337]: DEBUG nova.compute.manager [req-c11692a9-d3ed-4340-974c-b19165ee36aa req-f67d1d00-6e9a-4038-b4a7-329411b6522a service nova] [instance: 5badd355-5783-41b9-8f01-9fac9ff5d9d6] Received event network-changed-e029cddb-82d2-48ca-8943-83072e95d71e {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:50:24 user nova-compute[75337]: DEBUG nova.compute.manager [req-c11692a9-d3ed-4340-974c-b19165ee36aa req-f67d1d00-6e9a-4038-b4a7-329411b6522a service nova] [instance: 5badd355-5783-41b9-8f01-9fac9ff5d9d6] Refreshing instance network info cache due to event network-changed-e029cddb-82d2-48ca-8943-83072e95d71e. {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 15:50:24 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-c11692a9-d3ed-4340-974c-b19165ee36aa req-f67d1d00-6e9a-4038-b4a7-329411b6522a service nova] Acquiring lock "refresh_cache-5badd355-5783-41b9-8f01-9fac9ff5d9d6" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 15:50:24 user nova-compute[75337]: DEBUG nova.network.neutron [None req-6c1116f5-f156-445e-ac3f-a65792666fe2 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: 5badd355-5783-41b9-8f01-9fac9ff5d9d6] Instance cache missing network info. {{(pid=75337) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 15:50:25 user nova-compute[75337]: DEBUG nova.network.neutron [None req-6c1116f5-f156-445e-ac3f-a65792666fe2 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: 5badd355-5783-41b9-8f01-9fac9ff5d9d6] Updating instance_info_cache with network_info: [{"id": "e029cddb-82d2-48ca-8943-83072e95d71e", "address": "fa:16:3e:0f:a2:d7", "network": {"id": "736be000-ee94-41fd-9de0-f2f885ec9be7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1715443852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb76b5b0f2b24f1c84a92403176bcc00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape029cddb-82", "ovs_interfaceid": "e029cddb-82d2-48ca-8943-83072e95d71e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:50:25 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-6c1116f5-f156-445e-ac3f-a65792666fe2 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Releasing lock "refresh_cache-5badd355-5783-41b9-8f01-9fac9ff5d9d6" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 15:50:25 user nova-compute[75337]: DEBUG nova.compute.manager [None req-6c1116f5-f156-445e-ac3f-a65792666fe2 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: 5badd355-5783-41b9-8f01-9fac9ff5d9d6] Instance network_info: |[{"id": "e029cddb-82d2-48ca-8943-83072e95d71e", "address": "fa:16:3e:0f:a2:d7", "network": {"id": "736be000-ee94-41fd-9de0-f2f885ec9be7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1715443852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb76b5b0f2b24f1c84a92403176bcc00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape029cddb-82", "ovs_interfaceid": "e029cddb-82d2-48ca-8943-83072e95d71e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 15:50:25 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-c11692a9-d3ed-4340-974c-b19165ee36aa req-f67d1d00-6e9a-4038-b4a7-329411b6522a service nova] Acquired lock "refresh_cache-5badd355-5783-41b9-8f01-9fac9ff5d9d6" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 15:50:25 user nova-compute[75337]: DEBUG nova.network.neutron [req-c11692a9-d3ed-4340-974c-b19165ee36aa req-f67d1d00-6e9a-4038-b4a7-329411b6522a service nova] [instance: 5badd355-5783-41b9-8f01-9fac9ff5d9d6] Refreshing network info cache for port e029cddb-82d2-48ca-8943-83072e95d71e {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 15:50:26 user nova-compute[75337]: DEBUG nova.network.neutron [req-c11692a9-d3ed-4340-974c-b19165ee36aa req-f67d1d00-6e9a-4038-b4a7-329411b6522a service nova] [instance: 5badd355-5783-41b9-8f01-9fac9ff5d9d6] Updated VIF entry in instance network info cache for port e029cddb-82d2-48ca-8943-83072e95d71e. {{(pid=75337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 15:50:26 user nova-compute[75337]: DEBUG nova.network.neutron [req-c11692a9-d3ed-4340-974c-b19165ee36aa req-f67d1d00-6e9a-4038-b4a7-329411b6522a service nova] [instance: 5badd355-5783-41b9-8f01-9fac9ff5d9d6] Updating instance_info_cache with network_info: [{"id": "e029cddb-82d2-48ca-8943-83072e95d71e", "address": "fa:16:3e:0f:a2:d7", "network": {"id": "736be000-ee94-41fd-9de0-f2f885ec9be7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1715443852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb76b5b0f2b24f1c84a92403176bcc00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape029cddb-82", "ovs_interfaceid": "e029cddb-82d2-48ca-8943-83072e95d71e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:50:26 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-c11692a9-d3ed-4340-974c-b19165ee36aa req-f67d1d00-6e9a-4038-b4a7-329411b6522a service nova] Releasing lock "refresh_cache-5badd355-5783-41b9-8f01-9fac9ff5d9d6" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 15:50:28 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:50:33 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:50:38 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:50:43 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:50:43 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:50:48 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:50:50 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-78b64957-cbd1-4e06-adf7-2aec20a4b055 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Acquiring lock "a293c354-d1e5-4c33-9e7b-d1558235aaf8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:50:50 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-78b64957-cbd1-4e06-adf7-2aec20a4b055 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Lock "a293c354-d1e5-4c33-9e7b-d1558235aaf8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:50:50 user nova-compute[75337]: DEBUG nova.compute.manager [None req-78b64957-cbd1-4e06-adf7-2aec20a4b055 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] [instance: a293c354-d1e5-4c33-9e7b-d1558235aaf8] Starting instance... {{(pid=75337) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 15:50:50 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-78b64957-cbd1-4e06-adf7-2aec20a4b055 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:50:50 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-78b64957-cbd1-4e06-adf7-2aec20a4b055 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:50:50 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-78b64957-cbd1-4e06-adf7-2aec20a4b055 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75337) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 15:50:50 user nova-compute[75337]: INFO nova.compute.claims [None req-78b64957-cbd1-4e06-adf7-2aec20a4b055 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] [instance: a293c354-d1e5-4c33-9e7b-d1558235aaf8] Claim successful on node user
Nov 06 15:50:50 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-78b64957-cbd1-4e06-adf7-2aec20a4b055 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 15:50:50 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-78b64957-cbd1-4e06-adf7-2aec20a4b055 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 15:50:50 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-78b64957-cbd1-4e06-adf7-2aec20a4b055 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.398s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:50:50 user nova-compute[75337]: DEBUG nova.compute.manager [None req-78b64957-cbd1-4e06-adf7-2aec20a4b055 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] [instance: a293c354-d1e5-4c33-9e7b-d1558235aaf8] Start building networks asynchronously for instance. {{(pid=75337) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 15:50:50 user nova-compute[75337]: DEBUG nova.compute.manager [None req-78b64957-cbd1-4e06-adf7-2aec20a4b055 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] [instance: a293c354-d1e5-4c33-9e7b-d1558235aaf8] Allocating IP information in the background. {{(pid=75337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 15:50:50 user nova-compute[75337]: DEBUG nova.network.neutron [None req-78b64957-cbd1-4e06-adf7-2aec20a4b055 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] [instance: a293c354-d1e5-4c33-9e7b-d1558235aaf8] allocate_for_instance() {{(pid=75337) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 15:50:50 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-78b64957-cbd1-4e06-adf7-2aec20a4b055 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] [instance: a293c354-d1e5-4c33-9e7b-d1558235aaf8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 15:50:50 user nova-compute[75337]: DEBUG nova.compute.manager [None req-78b64957-cbd1-4e06-adf7-2aec20a4b055 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] [instance: a293c354-d1e5-4c33-9e7b-d1558235aaf8] Start building block device mappings for instance. {{(pid=75337) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 15:50:50 user nova-compute[75337]: DEBUG nova.policy [None req-78b64957-cbd1-4e06-adf7-2aec20a4b055 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'aeeea58fcd3e4217a34a4a38be6adf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1013e7afbefd4146a3be04587710b1de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75337) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 15:50:50 user nova-compute[75337]: DEBUG nova.compute.manager [None req-78b64957-cbd1-4e06-adf7-2aec20a4b055 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] [instance: a293c354-d1e5-4c33-9e7b-d1558235aaf8] Start spawning the instance on the hypervisor. {{(pid=75337) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 15:50:50 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-78b64957-cbd1-4e06-adf7-2aec20a4b055 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] [instance: a293c354-d1e5-4c33-9e7b-d1558235aaf8] Creating instance directory {{(pid=75337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 15:50:50 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-78b64957-cbd1-4e06-adf7-2aec20a4b055 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] [instance: a293c354-d1e5-4c33-9e7b-d1558235aaf8] Creating image(s)
Nov 06 15:50:50 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-78b64957-cbd1-4e06-adf7-2aec20a4b055 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Acquiring lock "/opt/stack/data/nova/instances/a293c354-d1e5-4c33-9e7b-d1558235aaf8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:50:50 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-78b64957-cbd1-4e06-adf7-2aec20a4b055 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Lock "/opt/stack/data/nova/instances/a293c354-d1e5-4c33-9e7b-d1558235aaf8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:50:50 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-78b64957-cbd1-4e06-adf7-2aec20a4b055 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Lock "/opt/stack/data/nova/instances/a293c354-d1e5-4c33-9e7b-d1558235aaf8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:50:50 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-78b64957-cbd1-4e06-adf7-2aec20a4b055 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:50:51 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-78b64957-cbd1-4e06-adf7-2aec20a4b055 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json" returned: 0 in 0.187s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:50:51 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-78b64957-cbd1-4e06-adf7-2aec20a4b055 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Acquiring lock "06ba3c914798499e686c5ac75886932347225275" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:50:51 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-78b64957-cbd1-4e06-adf7-2aec20a4b055 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Lock "06ba3c914798499e686c5ac75886932347225275" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:50:51 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-78b64957-cbd1-4e06-adf7-2aec20a4b055 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:50:51 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-78b64957-cbd1-4e06-adf7-2aec20a4b055 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json" returned: 0 in 0.180s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:50:51 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-78b64957-cbd1-4e06-adf7-2aec20a4b055 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275,backing_fmt=raw /opt/stack/data/nova/instances/a293c354-d1e5-4c33-9e7b-d1558235aaf8/disk 1073741824 {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:50:51 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-78b64957-cbd1-4e06-adf7-2aec20a4b055 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275,backing_fmt=raw /opt/stack/data/nova/instances/a293c354-d1e5-4c33-9e7b-d1558235aaf8/disk 1073741824" returned: 0 in 0.061s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:50:51 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-78b64957-cbd1-4e06-adf7-2aec20a4b055 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Lock "06ba3c914798499e686c5ac75886932347225275" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.250s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:50:51 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-78b64957-cbd1-4e06-adf7-2aec20a4b055 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:50:51 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-78b64957-cbd1-4e06-adf7-2aec20a4b055 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json" returned: 0 in 0.206s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:50:51 user nova-compute[75337]: DEBUG nova.virt.disk.api [None req-78b64957-cbd1-4e06-adf7-2aec20a4b055 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a293c354-d1e5-4c33-9e7b-d1558235aaf8/disk. size=1073741824 {{(pid=75337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 15:50:51 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-78b64957-cbd1-4e06-adf7-2aec20a4b055 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a293c354-d1e5-4c33-9e7b-d1558235aaf8/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:50:51 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-78b64957-cbd1-4e06-adf7-2aec20a4b055 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a293c354-d1e5-4c33-9e7b-d1558235aaf8/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:50:51 user nova-compute[75337]: DEBUG nova.virt.disk.api [None req-78b64957-cbd1-4e06-adf7-2aec20a4b055 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Cannot resize image /opt/stack/data/nova/instances/a293c354-d1e5-4c33-9e7b-d1558235aaf8/disk to a smaller size. {{(pid=75337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 06 15:50:51 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-78b64957-cbd1-4e06-adf7-2aec20a4b055 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] [instance: a293c354-d1e5-4c33-9e7b-d1558235aaf8] Created local disks {{(pid=75337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 15:50:51 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-78b64957-cbd1-4e06-adf7-2aec20a4b055 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] [instance: a293c354-d1e5-4c33-9e7b-d1558235aaf8] Ensure instance console log exists: /opt/stack/data/nova/instances/a293c354-d1e5-4c33-9e7b-d1558235aaf8/console.log {{(pid=75337) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 15:50:51 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-78b64957-cbd1-4e06-adf7-2aec20a4b055 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:50:51 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-78b64957-cbd1-4e06-adf7-2aec20a4b055 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:50:51 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-78b64957-cbd1-4e06-adf7-2aec20a4b055 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:50:51 user nova-compute[75337]: DEBUG nova.network.neutron [None req-78b64957-cbd1-4e06-adf7-2aec20a4b055 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] [instance: a293c354-d1e5-4c33-9e7b-d1558235aaf8] Successfully created port: 29fff93f-08f1-4e46-91db-84ab16f785e5 {{(pid=75337) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 15:50:52 user nova-compute[75337]: DEBUG nova.network.neutron [None req-78b64957-cbd1-4e06-adf7-2aec20a4b055 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] [instance: a293c354-d1e5-4c33-9e7b-d1558235aaf8] Successfully updated port: 29fff93f-08f1-4e46-91db-84ab16f785e5 {{(pid=75337) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 15:50:52 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-78b64957-cbd1-4e06-adf7-2aec20a4b055 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Acquiring lock "refresh_cache-a293c354-d1e5-4c33-9e7b-d1558235aaf8" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 15:50:52 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-78b64957-cbd1-4e06-adf7-2aec20a4b055 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Acquired lock "refresh_cache-a293c354-d1e5-4c33-9e7b-d1558235aaf8" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 15:50:52 user nova-compute[75337]: DEBUG nova.network.neutron [None req-78b64957-cbd1-4e06-adf7-2aec20a4b055 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] [instance: a293c354-d1e5-4c33-9e7b-d1558235aaf8] Building network info cache for instance {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 15:50:52 user nova-compute[75337]: DEBUG nova.compute.manager [req-c74e2f0f-9bf4-459f-9002-f76d241f6a90 req-1ced8236-7190-45e0-ab98-f4ee70079f33 service nova] [instance: a293c354-d1e5-4c33-9e7b-d1558235aaf8] Received event network-changed-29fff93f-08f1-4e46-91db-84ab16f785e5 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:50:52 user nova-compute[75337]: DEBUG nova.compute.manager [req-c74e2f0f-9bf4-459f-9002-f76d241f6a90 req-1ced8236-7190-45e0-ab98-f4ee70079f33 service nova] [instance: a293c354-d1e5-4c33-9e7b-d1558235aaf8] Refreshing instance network info cache due to event network-changed-29fff93f-08f1-4e46-91db-84ab16f785e5. {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 15:50:52 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-c74e2f0f-9bf4-459f-9002-f76d241f6a90 req-1ced8236-7190-45e0-ab98-f4ee70079f33 service nova] Acquiring lock "refresh_cache-a293c354-d1e5-4c33-9e7b-d1558235aaf8" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 15:50:52 user nova-compute[75337]: DEBUG nova.compute.manager [req-1c84506f-dde4-49fb-9e67-04320dac71c7 req-de1eb226-b6de-423c-9267-b7ac499db6e3 service nova] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Received event network-changed-ee068b96-f361-4cb1-afeb-d3db42848f50 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:50:52 user nova-compute[75337]: DEBUG nova.compute.manager [req-1c84506f-dde4-49fb-9e67-04320dac71c7 req-de1eb226-b6de-423c-9267-b7ac499db6e3 service nova] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Refreshing instance network info cache due to event network-changed-ee068b96-f361-4cb1-afeb-d3db42848f50. {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 15:50:52 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-1c84506f-dde4-49fb-9e67-04320dac71c7 req-de1eb226-b6de-423c-9267-b7ac499db6e3 service nova] Acquiring lock "refresh_cache-fdda34b5-280f-489d-baf5-bf21ac6dd6c9" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 15:50:52 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-1c84506f-dde4-49fb-9e67-04320dac71c7 req-de1eb226-b6de-423c-9267-b7ac499db6e3 service nova] Acquired lock "refresh_cache-fdda34b5-280f-489d-baf5-bf21ac6dd6c9" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 15:50:52 user nova-compute[75337]: DEBUG nova.network.neutron [req-1c84506f-dde4-49fb-9e67-04320dac71c7 req-de1eb226-b6de-423c-9267-b7ac499db6e3 service nova] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Refreshing network info cache for port ee068b96-f361-4cb1-afeb-d3db42848f50 {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 15:50:52 user nova-compute[75337]: DEBUG nova.network.neutron [None req-78b64957-cbd1-4e06-adf7-2aec20a4b055 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] [instance: a293c354-d1e5-4c33-9e7b-d1558235aaf8] Instance cache missing network info. {{(pid=75337) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 15:50:52 user nova-compute[75337]: DEBUG nova.network.neutron [None req-78b64957-cbd1-4e06-adf7-2aec20a4b055 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] [instance: a293c354-d1e5-4c33-9e7b-d1558235aaf8] Updating instance_info_cache with network_info: [{"id": "29fff93f-08f1-4e46-91db-84ab16f785e5", "address": "fa:16:3e:d7:cf:dd", "network": {"id": "48f1545d-7e80-462f-9dbf-f1102ddcda9a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1210368397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1013e7afbefd4146a3be04587710b1de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29fff93f-08", "ovs_interfaceid": "29fff93f-08f1-4e46-91db-84ab16f785e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:50:52 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-78b64957-cbd1-4e06-adf7-2aec20a4b055 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Releasing lock "refresh_cache-a293c354-d1e5-4c33-9e7b-d1558235aaf8" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 15:50:52 user nova-compute[75337]: DEBUG nova.compute.manager [None req-78b64957-cbd1-4e06-adf7-2aec20a4b055 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] [instance: a293c354-d1e5-4c33-9e7b-d1558235aaf8] Instance network_info: |[{"id": "29fff93f-08f1-4e46-91db-84ab16f785e5", "address": "fa:16:3e:d7:cf:dd", "network": {"id": "48f1545d-7e80-462f-9dbf-f1102ddcda9a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1210368397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1013e7afbefd4146a3be04587710b1de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29fff93f-08", "ovs_interfaceid": "29fff93f-08f1-4e46-91db-84ab16f785e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 15:50:52 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-c74e2f0f-9bf4-459f-9002-f76d241f6a90 req-1ced8236-7190-45e0-ab98-f4ee70079f33 service nova] Acquired lock "refresh_cache-a293c354-d1e5-4c33-9e7b-d1558235aaf8" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 15:50:52 user nova-compute[75337]: DEBUG nova.network.neutron [req-c74e2f0f-9bf4-459f-9002-f76d241f6a90 req-1ced8236-7190-45e0-ab98-f4ee70079f33 service nova] [instance: a293c354-d1e5-4c33-9e7b-d1558235aaf8] Refreshing network info cache for port 29fff93f-08f1-4e46-91db-84ab16f785e5 {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 15:50:52 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-78b64957-cbd1-4e06-adf7-2aec20a4b055 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] [instance: a293c354-d1e5-4c33-9e7b-d1558235aaf8] Start _get_guest_xml network_info=[{"id": "29fff93f-08f1-4e46-91db-84ab16f785e5", "address": "fa:16:3e:d7:cf:dd", "network": {"id": "48f1545d-7e80-462f-9dbf-f1102ddcda9a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1210368397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1013e7afbefd4146a3be04587710b1de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29fff93f-08", "ovs_interfaceid": "29fff93f-08f1-4e46-91db-84ab16f785e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T15:34:14Z,direct_url=<?>,disk_format='qcow2',id=16b903ae-a40f-41a7-985b-4804cce92c62,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6549a15819f1469bbd5eeae8190e3d44',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T15:34:15Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'guest_format': None, 'size': 0, 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '16b903ae-a40f-41a7-985b-4804cce92c62'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 15:50:52 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-78b64957-cbd1-4e06-adf7-2aec20a4b055 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 15:50:52 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-78b64957-cbd1-4e06-adf7-2aec20a4b055 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 15:50:52 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-78b64957-cbd1-4e06-adf7-2aec20a4b055 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 15:50:52 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-78b64957-cbd1-4e06-adf7-2aec20a4b055 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] CPU controller missing on host. {{(pid=75337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 15:50:52 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-78b64957-cbd1-4e06-adf7-2aec20a4b055 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 15:50:52 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-78b64957-cbd1-4e06-adf7-2aec20a4b055 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] CPU controller found on host. {{(pid=75337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 15:50:52 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-78b64957-cbd1-4e06-adf7-2aec20a4b055 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75337) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 15:50:52 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-78b64957-cbd1-4e06-adf7-2aec20a4b055 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T15:34:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T15:34:14Z,direct_url=<?>,disk_format='qcow2',id=16b903ae-a40f-41a7-985b-4804cce92c62,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6549a15819f1469bbd5eeae8190e3d44',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T15:34:15Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 15:50:52 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-78b64957-cbd1-4e06-adf7-2aec20a4b055 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Flavor limits 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 15:50:52 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-78b64957-cbd1-4e06-adf7-2aec20a4b055 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Image limits 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 15:50:52 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-78b64957-cbd1-4e06-adf7-2aec20a4b055 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Flavor pref 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 15:50:52 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-78b64957-cbd1-4e06-adf7-2aec20a4b055 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Image pref 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 15:50:52 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-78b64957-cbd1-4e06-adf7-2aec20a4b055 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 15:50:52 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-78b64957-cbd1-4e06-adf7-2aec20a4b055 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 15:50:52 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-78b64957-cbd1-4e06-adf7-2aec20a4b055 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 15:50:52 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-78b64957-cbd1-4e06-adf7-2aec20a4b055 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Got 1 possible topologies {{(pid=75337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 15:50:52 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-78b64957-cbd1-4e06-adf7-2aec20a4b055 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 15:50:52 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-78b64957-cbd1-4e06-adf7-2aec20a4b055 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 15:50:53 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-78b64957-cbd1-4e06-adf7-2aec20a4b055 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T15:50:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2071528491',display_name='tempest-AttachVolumeNegativeTest-server-2071528491',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2071528491',id=25,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJeCBm+mKfrp2FFF+KMPwGkjm+VWInJnfR36kliM38Uo3mljDirzb+qwGiq+h1GdVb+XUzSDCdW/OrAhZFxL2Qta1UBDBswOEF5zPmKbUn4k464MfeSlPqTVcgazYBh9bw==',key_name='tempest-keypair-2018551821',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1013e7afbefd4146a3be04587710b1de',ramdisk_id='',reservation_id='r-b7cg5a97',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1104237961',owner_user_name='tempest-AttachVolumeNegativeTest-1104237961-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T15:50:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aeeea58fcd3e4217a34a4a38be6adf30',uuid=a293c354-d1e5-4c33-9e7b-d1558235aaf8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "29fff93f-08f1-4e46-91db-84ab16f785e5", "address": "fa:16:3e:d7:cf:dd", "network": {"id": "48f1545d-7e80-462f-9dbf-f1102ddcda9a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1210368397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1013e7afbefd4146a3be04587710b1de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29fff93f-08", "ovs_interfaceid": "29fff93f-08f1-4e46-91db-84ab16f785e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75337) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 15:50:53 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-78b64957-cbd1-4e06-adf7-2aec20a4b055 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Converting VIF {"id": "29fff93f-08f1-4e46-91db-84ab16f785e5", "address": "fa:16:3e:d7:cf:dd", "network": {"id": "48f1545d-7e80-462f-9dbf-f1102ddcda9a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1210368397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1013e7afbefd4146a3be04587710b1de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29fff93f-08", "ovs_interfaceid": "29fff93f-08f1-4e46-91db-84ab16f785e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 15:50:53 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-78b64957-cbd1-4e06-adf7-2aec20a4b055 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:cf:dd,bridge_name='br-int',has_traffic_filtering=True,id=29fff93f-08f1-4e46-91db-84ab16f785e5,network=Network(48f1545d-7e80-462f-9dbf-f1102ddcda9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29fff93f-08') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 15:50:53 user nova-compute[75337]: DEBUG nova.objects.instance [None req-78b64957-cbd1-4e06-adf7-2aec20a4b055 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Lazy-loading 'pci_devices' on Instance uuid a293c354-d1e5-4c33-9e7b-d1558235aaf8 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 15:50:53 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-78b64957-cbd1-4e06-adf7-2aec20a4b055 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] [instance: a293c354-d1e5-4c33-9e7b-d1558235aaf8] End _get_guest_xml xml=<domain type="kvm">
Nov 06 15:50:53 user nova-compute[75337]:   <uuid>a293c354-d1e5-4c33-9e7b-d1558235aaf8</uuid>
Nov 06 15:50:53 user nova-compute[75337]:   <name>instance-00000019</name>
Nov 06 15:50:53 user nova-compute[75337]:   <memory>524288</memory>
Nov 06 15:50:53 user nova-compute[75337]:   <vcpu>1</vcpu>
Nov 06 15:50:53 user nova-compute[75337]:   <metadata>
Nov 06 15:50:53 user nova-compute[75337]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 15:50:53 user nova-compute[75337]:       <nova:package version="0.0.0"/>
Nov 06 15:50:53 user nova-compute[75337]:       <nova:name>tempest-AttachVolumeNegativeTest-server-2071528491</nova:name>
Nov 06 15:50:53 user nova-compute[75337]:       <nova:creationTime>2023-11-06 15:50:52</nova:creationTime>
Nov 06 15:50:53 user nova-compute[75337]:       <nova:flavor name="m1.tiny">
Nov 06 15:50:53 user nova-compute[75337]:         <nova:memory>512</nova:memory>
Nov 06 15:50:53 user nova-compute[75337]:         <nova:disk>1</nova:disk>
Nov 06 15:50:53 user nova-compute[75337]:         <nova:swap>0</nova:swap>
Nov 06 15:50:53 user nova-compute[75337]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 15:50:53 user nova-compute[75337]:         <nova:vcpus>1</nova:vcpus>
Nov 06 15:50:53 user nova-compute[75337]:       </nova:flavor>
Nov 06 15:50:53 user nova-compute[75337]:       <nova:owner>
Nov 06 15:50:53 user nova-compute[75337]:         <nova:user uuid="aeeea58fcd3e4217a34a4a38be6adf30">tempest-AttachVolumeNegativeTest-1104237961-project-member</nova:user>
Nov 06 15:50:53 user nova-compute[75337]:         <nova:project uuid="1013e7afbefd4146a3be04587710b1de">tempest-AttachVolumeNegativeTest-1104237961</nova:project>
Nov 06 15:50:53 user nova-compute[75337]:       </nova:owner>
Nov 06 15:50:53 user nova-compute[75337]:       <nova:root type="image" uuid="16b903ae-a40f-41a7-985b-4804cce92c62"/>
Nov 06 15:50:53 user nova-compute[75337]:       <nova:ports>
Nov 06 15:50:53 user nova-compute[75337]:         <nova:port uuid="29fff93f-08f1-4e46-91db-84ab16f785e5">
Nov 06 15:50:53 user nova-compute[75337]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 06 15:50:53 user nova-compute[75337]:         </nova:port>
Nov 06 15:50:53 user nova-compute[75337]:       </nova:ports>
Nov 06 15:50:53 user nova-compute[75337]:     </nova:instance>
Nov 06 15:50:53 user nova-compute[75337]:   </metadata>
Nov 06 15:50:53 user nova-compute[75337]:   <sysinfo type="smbios">
Nov 06 15:50:53 user nova-compute[75337]:     <system>
Nov 06 15:50:53 user nova-compute[75337]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 15:50:53 user nova-compute[75337]:       <entry name="product">OpenStack Nova</entry>
Nov 06 15:50:53 user nova-compute[75337]:       <entry name="version">0.0.0</entry>
Nov 06 15:50:53 user nova-compute[75337]:       <entry name="serial">a293c354-d1e5-4c33-9e7b-d1558235aaf8</entry>
Nov 06 15:50:53 user nova-compute[75337]:       <entry name="uuid">a293c354-d1e5-4c33-9e7b-d1558235aaf8</entry>
Nov 06 15:50:53 user nova-compute[75337]:       <entry name="family">Virtual Machine</entry>
Nov 06 15:50:53 user nova-compute[75337]:     </system>
Nov 06 15:50:53 user nova-compute[75337]:   </sysinfo>
Nov 06 15:50:53 user nova-compute[75337]:   <os>
Nov 06 15:50:53 user nova-compute[75337]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 15:50:53 user nova-compute[75337]:     <boot dev="hd"/>
Nov 06 15:50:53 user nova-compute[75337]:     <smbios mode="sysinfo"/>
Nov 06 15:50:53 user nova-compute[75337]:   </os>
Nov 06 15:50:53 user nova-compute[75337]:   <features>
Nov 06 15:50:53 user nova-compute[75337]:     <acpi/>
Nov 06 15:50:53 user nova-compute[75337]:     <apic/>
Nov 06 15:50:53 user nova-compute[75337]:     <vmcoreinfo/>
Nov 06 15:50:53 user nova-compute[75337]:   </features>
Nov 06 15:50:53 user nova-compute[75337]:   <clock offset="utc">
Nov 06 15:50:53 user nova-compute[75337]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 15:50:53 user nova-compute[75337]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 15:50:53 user nova-compute[75337]:     <timer name="hpet" present="no"/>
Nov 06 15:50:53 user nova-compute[75337]:   </clock>
Nov 06 15:50:53 user nova-compute[75337]:   <cpu mode="custom" match="exact">
Nov 06 15:50:53 user nova-compute[75337]:     <model>Nehalem</model>
Nov 06 15:50:53 user nova-compute[75337]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 15:50:53 user nova-compute[75337]:   </cpu>
Nov 06 15:50:53 user nova-compute[75337]:   <devices>
Nov 06 15:50:53 user nova-compute[75337]:     <disk type="file" device="disk">
Nov 06 15:50:53 user nova-compute[75337]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 15:50:53 user nova-compute[75337]:       <source file="/opt/stack/data/nova/instances/a293c354-d1e5-4c33-9e7b-d1558235aaf8/disk"/>
Nov 06 15:50:53 user nova-compute[75337]:       <target dev="vda" bus="virtio"/>
Nov 06 15:50:53 user nova-compute[75337]:     </disk>
Nov 06 15:50:53 user nova-compute[75337]:     <interface type="ethernet">
Nov 06 15:50:53 user nova-compute[75337]:       <mac address="fa:16:3e:d7:cf:dd"/>
Nov 06 15:50:53 user nova-compute[75337]:       <model type="virtio"/>
Nov 06 15:50:53 user nova-compute[75337]:       <mtu size="1442"/>
Nov 06 15:50:53 user nova-compute[75337]:       <target dev="tap29fff93f-08"/>
Nov 06 15:50:53 user nova-compute[75337]:     </interface>
Nov 06 15:50:53 user nova-compute[75337]:     <serial type="pty">
Nov 06 15:50:53 user nova-compute[75337]:       <log file="/opt/stack/data/nova/instances/a293c354-d1e5-4c33-9e7b-d1558235aaf8/console.log" append="off"/>
Nov 06 15:50:53 user nova-compute[75337]:     </serial>
Nov 06 15:50:53 user nova-compute[75337]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 15:50:53 user nova-compute[75337]:     <video>
Nov 06 15:50:53 user nova-compute[75337]:       <model type="virtio"/>
Nov 06 15:50:53 user nova-compute[75337]:     </video>
Nov 06 15:50:53 user nova-compute[75337]:     <rng model="virtio">
Nov 06 15:50:53 user nova-compute[75337]:       <backend model="random">/dev/urandom</backend>
Nov 06 15:50:53 user nova-compute[75337]:     </rng>
Nov 06 15:50:53 user nova-compute[75337]:     <controller type="usb" index="0" model="none"/>
Nov 06 15:50:53 user nova-compute[75337]:     <memballoon model="virtio">
Nov 06 15:50:53 user nova-compute[75337]:       <stats period="10"/>
Nov 06 15:50:53 user nova-compute[75337]:     </memballoon>
Nov 06 15:50:53 user nova-compute[75337]:   </devices>
Nov 06 15:50:53 user nova-compute[75337]: </domain>
Nov 06 15:50:53 user nova-compute[75337]:  {{(pid=75337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 15:50:53 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-78b64957-cbd1-4e06-adf7-2aec20a4b055 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T15:50:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2071528491',display_name='tempest-AttachVolumeNegativeTest-server-2071528491',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2071528491',id=25,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJeCBm+mKfrp2FFF+KMPwGkjm+VWInJnfR36kliM38Uo3mljDirzb+qwGiq+h1GdVb+XUzSDCdW/OrAhZFxL2Qta1UBDBswOEF5zPmKbUn4k464MfeSlPqTVcgazYBh9bw==',key_name='tempest-keypair-2018551821',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1013e7afbefd4146a3be04587710b1de',ramdisk_id='',reservation_id='r-b7cg5a97',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1104237961',owner_user_name='tempest-AttachVolumeNegativeTest-1104237961-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T15:50:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aeeea58fcd3e4217a34a4a38be6adf30',uuid=a293c354-d1e5-4c33-9e7b-d1558235aaf8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "29fff93f-08f1-4e46-91db-84ab16f785e5", "address": "fa:16:3e:d7:cf:dd", "network": {"id": "48f1545d-7e80-462f-9dbf-f1102ddcda9a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1210368397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1013e7afbefd4146a3be04587710b1de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29fff93f-08", "ovs_interfaceid": "29fff93f-08f1-4e46-91db-84ab16f785e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 15:50:53 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-78b64957-cbd1-4e06-adf7-2aec20a4b055 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Converting VIF {"id": "29fff93f-08f1-4e46-91db-84ab16f785e5", "address": "fa:16:3e:d7:cf:dd", "network": {"id": "48f1545d-7e80-462f-9dbf-f1102ddcda9a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1210368397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1013e7afbefd4146a3be04587710b1de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29fff93f-08", "ovs_interfaceid": "29fff93f-08f1-4e46-91db-84ab16f785e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 15:50:53 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-78b64957-cbd1-4e06-adf7-2aec20a4b055 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:cf:dd,bridge_name='br-int',has_traffic_filtering=True,id=29fff93f-08f1-4e46-91db-84ab16f785e5,network=Network(48f1545d-7e80-462f-9dbf-f1102ddcda9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29fff93f-08') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 15:50:53 user nova-compute[75337]: DEBUG os_vif [None req-78b64957-cbd1-4e06-adf7-2aec20a4b055 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:cf:dd,bridge_name='br-int',has_traffic_filtering=True,id=29fff93f-08f1-4e46-91db-84ab16f785e5,network=Network(48f1545d-7e80-462f-9dbf-f1102ddcda9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29fff93f-08') {{(pid=75337) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 15:50:53 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:50:53 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:50:53 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 15:50:53 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:50:53 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'eaab2bdc-7b0f-5147-94ec-5bd7031af9b3', '_type': 'linux-noop'}}, row=False) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:50:53 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:50:53 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:50:53 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:50:53 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap29fff93f-08, may_exist=True, interface_attrs={}) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:50:53 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap29fff93f-08, col_values=(('qos', UUID('b11026c6-5c65-4c7a-b393-9eb17509c09c')),), if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:50:53 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap29fff93f-08, col_values=(('external_ids', {'iface-id': '29fff93f-08f1-4e46-91db-84ab16f785e5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d7:cf:dd', 'vm-uuid': 'a293c354-d1e5-4c33-9e7b-d1558235aaf8'}),), if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:50:53 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:50:53 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:50:53 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:50:53 user nova-compute[75337]: INFO os_vif [None req-78b64957-cbd1-4e06-adf7-2aec20a4b055 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:cf:dd,bridge_name='br-int',has_traffic_filtering=True,id=29fff93f-08f1-4e46-91db-84ab16f785e5,network=Network(48f1545d-7e80-462f-9dbf-f1102ddcda9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29fff93f-08')
Nov 06 15:50:53 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-78b64957-cbd1-4e06-adf7-2aec20a4b055 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] No BDM found with device name vda, not building metadata. {{(pid=75337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 15:50:53 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-78b64957-cbd1-4e06-adf7-2aec20a4b055 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] No VIF found with MAC fa:16:3e:d7:cf:dd, not building metadata {{(pid=75337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 15:50:53 user nova-compute[75337]: DEBUG nova.network.neutron [req-1c84506f-dde4-49fb-9e67-04320dac71c7 req-de1eb226-b6de-423c-9267-b7ac499db6e3 service nova] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Updated VIF entry in instance network info cache for port ee068b96-f361-4cb1-afeb-d3db42848f50. {{(pid=75337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 15:50:53 user nova-compute[75337]: DEBUG nova.network.neutron [req-1c84506f-dde4-49fb-9e67-04320dac71c7 req-de1eb226-b6de-423c-9267-b7ac499db6e3 service nova] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Updating instance_info_cache with network_info: [{"id": "ee068b96-f361-4cb1-afeb-d3db42848f50", "address": "fa:16:3e:63:2a:18", "network": {"id": "8a494051-b597-47cd-8d64-76f0be5760cc", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-162490382-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7944be2b6e2047f5a633242809f6f04e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee068b96-f3", "ovs_interfaceid": "ee068b96-f361-4cb1-afeb-d3db42848f50", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7359ffbf-b953-480e-ae89-7ce5dda880a3", "address": "fa:16:3e:12:4b:11", "network": {"id": "e17a21e6-be31-4611-8f62-59327c8c4d9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1516543392", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7944be2b6e2047f5a633242809f6f04e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7359ffbf-b9", "ovs_interfaceid": "7359ffbf-b953-480e-ae89-7ce5dda880a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0184ea76-40a1-41f4-9a6f-e2ca6719b7ab", "address": "fa:16:3e:3b:f7:32", "network": {"id": "e17a21e6-be31-4611-8f62-59327c8c4d9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1516543392", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7944be2b6e2047f5a633242809f6f04e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0184ea76-40", "ovs_interfaceid": "0184ea76-40a1-41f4-9a6f-e2ca6719b7ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "38a409f9-0fb9-4505-9f74-bf2859e6f66c", "address": "fa:16:3e:8a:6f:5e", "network": {"id": "e17a21e6-be31-4611-8f62-59327c8c4d9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1516543392", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.115", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7944be2b6e2047f5a633242809f6f04e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38a409f9-0f", "ovs_interfaceid": "38a409f9-0fb9-4505-9f74-bf2859e6f66c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d86aca21-e67b-48e9-b8de-a1d618a5dfc7", "address": "fa:16:3e:bf:c2:bd", "network": {"id": "e17a21e6-be31-4611-8f62-59327c8c4d9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1516543392", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.131", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7944be2b6e2047f5a633242809f6f04e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd86aca21-e6", "ovs_interfaceid": "d86aca21-e67b-48e9-b8de-a1d618a5dfc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4c56104b-528f-40b8-931d-7619e413ab07", "address": "fa:16:3e:4d:d7:97", "network": {"id": "00ad9466-de22-4eb1-86c7-01667b94d2a9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1660110834", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7944be2b6e2047f5a633242809f6f04e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c56104b-52", "ovs_interfaceid": "4c56104b-528f-40b8-931d-7619e413ab07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "996e784d-bbe6-447b-8f1f-066ec34be989", "address": "fa:16:3e:41:c0:e2", "network": {"id": "00ad9466-de22-4eb1-86c7-01667b94d2a9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1660110834", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7944be2b6e2047f5a633242809f6f04e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap996e784d-bb", "ovs_interfaceid": "996e784d-bbe6-447b-8f1f-066ec34be989", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:50:53 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-1c84506f-dde4-49fb-9e67-04320dac71c7 req-de1eb226-b6de-423c-9267-b7ac499db6e3 service nova] Releasing lock "refresh_cache-fdda34b5-280f-489d-baf5-bf21ac6dd6c9" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 15:50:53 user nova-compute[75337]: DEBUG nova.network.neutron [req-c74e2f0f-9bf4-459f-9002-f76d241f6a90 req-1ced8236-7190-45e0-ab98-f4ee70079f33 service nova] [instance: a293c354-d1e5-4c33-9e7b-d1558235aaf8] Updated VIF entry in instance network info cache for port 29fff93f-08f1-4e46-91db-84ab16f785e5. {{(pid=75337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 15:50:53 user nova-compute[75337]: DEBUG nova.network.neutron [req-c74e2f0f-9bf4-459f-9002-f76d241f6a90 req-1ced8236-7190-45e0-ab98-f4ee70079f33 service nova] [instance: a293c354-d1e5-4c33-9e7b-d1558235aaf8] Updating instance_info_cache with network_info: [{"id": "29fff93f-08f1-4e46-91db-84ab16f785e5", "address": "fa:16:3e:d7:cf:dd", "network": {"id": "48f1545d-7e80-462f-9dbf-f1102ddcda9a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1210368397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1013e7afbefd4146a3be04587710b1de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29fff93f-08", "ovs_interfaceid": "29fff93f-08f1-4e46-91db-84ab16f785e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:50:53 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-c74e2f0f-9bf4-459f-9002-f76d241f6a90 req-1ced8236-7190-45e0-ab98-f4ee70079f33 service nova] Releasing lock "refresh_cache-a293c354-d1e5-4c33-9e7b-d1558235aaf8" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 15:50:54 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:50:54 user nova-compute[75337]: DEBUG os_brick.utils [None req-6c1116f5-f156-445e-ac3f-a65792666fe2 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 15:50:54 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:50:54 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:50:54 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6412f5d-69ee-4c7e-98d4-50d02274db7a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4ff6411e45b8\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:50:54 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:50:54 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:50:54 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[705ea96c-d343-4728-b7e4-768294eb5b4f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:50:54 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:50:54 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:50:54 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c260d6a-5fc1-4d61-b9ee-2be6935d018b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:50:54 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[17b77137-c996-488e-8dab-810860366dfe]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:50:54 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-6c1116f5-f156-445e-ac3f-a65792666fe2 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Running cmd (subprocess): nvme version {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:50:54 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-6c1116f5-f156-445e-ac3f-a65792666fe2 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] 'nvme version' failed. Not Retrying. {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 15:50:54 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:50:54 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6c1116f5-f156-445e-ac3f-a65792666fe2 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] nvme not present on system {{(pid=75337) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 15:50:54 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:50:54 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:50:54 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:50:54 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 15:50:54 user nova-compute[75337]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 15:50:54 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[f21b13a7-baef-409e-b492-50aa0bc8f07b]: (4, '') {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:50:54 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.lightos [None req-6c1116f5-f156-445e-ac3f-a65792666fe2 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75337) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 15:50:54 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.lightos [None req-6c1116f5-f156-445e-ac3f-a65792666fe2 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 15:50:54 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.lightos [None req-6c1116f5-f156-445e-ac3f-a65792666fe2 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] LIGHTOS: no hostnqn found. {{(pid=75337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 15:50:54 user nova-compute[75337]: DEBUG os_brick.utils [None req-6c1116f5-f156-445e-ac3f-a65792666fe2 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] <== get_connector_properties: return (174ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4ff6411e45b8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 15:50:54 user nova-compute[75337]: DEBUG nova.virt.block_device [None req-6c1116f5-f156-445e-ac3f-a65792666fe2 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: 5badd355-5783-41b9-8f01-9fac9ff5d9d6] Updating existing volume attachment record: b89f21e7-38e2-4f00-af5c-f108cec4c867 {{(pid=75337) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 15:50:54 user nova-compute[75337]: DEBUG nova.compute.manager [req-b65deb3d-9979-4941-b755-45c263db6baf req-1d5fa9c0-7b27-40ed-8436-f453885f060f service nova] [instance: a293c354-d1e5-4c33-9e7b-d1558235aaf8] Received event network-vif-plugged-29fff93f-08f1-4e46-91db-84ab16f785e5 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:50:54 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-b65deb3d-9979-4941-b755-45c263db6baf req-1d5fa9c0-7b27-40ed-8436-f453885f060f service nova] Acquiring lock "a293c354-d1e5-4c33-9e7b-d1558235aaf8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:50:54 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-b65deb3d-9979-4941-b755-45c263db6baf req-1d5fa9c0-7b27-40ed-8436-f453885f060f service nova] Lock "a293c354-d1e5-4c33-9e7b-d1558235aaf8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:50:54 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-b65deb3d-9979-4941-b755-45c263db6baf req-1d5fa9c0-7b27-40ed-8436-f453885f060f service nova] Lock "a293c354-d1e5-4c33-9e7b-d1558235aaf8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:50:54 user nova-compute[75337]: DEBUG nova.compute.manager [req-b65deb3d-9979-4941-b755-45c263db6baf req-1d5fa9c0-7b27-40ed-8436-f453885f060f service nova] [instance: a293c354-d1e5-4c33-9e7b-d1558235aaf8] No waiting events found dispatching network-vif-plugged-29fff93f-08f1-4e46-91db-84ab16f785e5 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:50:54 user nova-compute[75337]: WARNING nova.compute.manager [req-b65deb3d-9979-4941-b755-45c263db6baf req-1d5fa9c0-7b27-40ed-8436-f453885f060f service nova] [instance: a293c354-d1e5-4c33-9e7b-d1558235aaf8] Received unexpected event network-vif-plugged-29fff93f-08f1-4e46-91db-84ab16f785e5 for instance with vm_state building and task_state spawning.
Nov 06 15:50:55 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:50:55 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:50:55 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:50:55 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-245d911c-a021-43ac-9282-8eee89187d4f tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Acquiring lock "fdda34b5-280f-489d-baf5-bf21ac6dd6c9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:50:55 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-245d911c-a021-43ac-9282-8eee89187d4f tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Lock "fdda34b5-280f-489d-baf5-bf21ac6dd6c9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:50:55 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-245d911c-a021-43ac-9282-8eee89187d4f tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Acquiring lock "fdda34b5-280f-489d-baf5-bf21ac6dd6c9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:50:55 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-245d911c-a021-43ac-9282-8eee89187d4f tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Lock "fdda34b5-280f-489d-baf5-bf21ac6dd6c9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:50:55 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-245d911c-a021-43ac-9282-8eee89187d4f tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Lock "fdda34b5-280f-489d-baf5-bf21ac6dd6c9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:50:55 user nova-compute[75337]: INFO nova.compute.manager [None req-245d911c-a021-43ac-9282-8eee89187d4f tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Terminating instance
Nov 06 15:50:55 user nova-compute[75337]: DEBUG nova.compute.manager [None req-245d911c-a021-43ac-9282-8eee89187d4f tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Start destroying the instance on the hypervisor. {{(pid=75337) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 15:50:55 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:50:55 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:50:55 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:50:55 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:50:55 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:50:55 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:50:55 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:50:55 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:50:55 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:50:55 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:50:55 user nova-compute[75337]: DEBUG nova.compute.manager [req-5241c898-caec-40f3-b081-de07f50dbd76 req-15055a47-6045-4a1f-93bb-4e91888be004 service nova] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Received event network-vif-unplugged-0184ea76-40a1-41f4-9a6f-e2ca6719b7ab {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:50:55 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-5241c898-caec-40f3-b081-de07f50dbd76 req-15055a47-6045-4a1f-93bb-4e91888be004 service nova] Acquiring lock "fdda34b5-280f-489d-baf5-bf21ac6dd6c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:50:55 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-5241c898-caec-40f3-b081-de07f50dbd76 req-15055a47-6045-4a1f-93bb-4e91888be004 service nova] Lock "fdda34b5-280f-489d-baf5-bf21ac6dd6c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:50:55 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-5241c898-caec-40f3-b081-de07f50dbd76 req-15055a47-6045-4a1f-93bb-4e91888be004 service nova] Lock "fdda34b5-280f-489d-baf5-bf21ac6dd6c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:50:55 user nova-compute[75337]: DEBUG nova.compute.manager [req-5241c898-caec-40f3-b081-de07f50dbd76 req-15055a47-6045-4a1f-93bb-4e91888be004 service nova] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] No waiting events found dispatching network-vif-unplugged-0184ea76-40a1-41f4-9a6f-e2ca6719b7ab {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:50:55 user nova-compute[75337]: DEBUG nova.compute.manager [req-5241c898-caec-40f3-b081-de07f50dbd76 req-15055a47-6045-4a1f-93bb-4e91888be004 service nova] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Received event network-vif-unplugged-0184ea76-40a1-41f4-9a6f-e2ca6719b7ab for instance with task_state deleting. {{(pid=75337) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 15:50:55 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:50:56 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:50:56 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:50:56 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:50:56 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:50:56 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:50:56 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:50:56 user nova-compute[75337]: DEBUG nova.compute.manager [req-628f7c52-ab45-49b7-87e8-4c0daef50e74 req-fec45139-d6fa-425e-ae6e-6ef3b2756f43 service nova] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Received event network-vif-unplugged-d86aca21-e67b-48e9-b8de-a1d618a5dfc7 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:50:56 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-628f7c52-ab45-49b7-87e8-4c0daef50e74 req-fec45139-d6fa-425e-ae6e-6ef3b2756f43 service nova] Acquiring lock "fdda34b5-280f-489d-baf5-bf21ac6dd6c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:50:56 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-628f7c52-ab45-49b7-87e8-4c0daef50e74 req-fec45139-d6fa-425e-ae6e-6ef3b2756f43 service nova] Lock "fdda34b5-280f-489d-baf5-bf21ac6dd6c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:50:56 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-628f7c52-ab45-49b7-87e8-4c0daef50e74 req-fec45139-d6fa-425e-ae6e-6ef3b2756f43 service nova] Lock "fdda34b5-280f-489d-baf5-bf21ac6dd6c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:50:56 user nova-compute[75337]: DEBUG nova.compute.manager [req-628f7c52-ab45-49b7-87e8-4c0daef50e74 req-fec45139-d6fa-425e-ae6e-6ef3b2756f43 service nova] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] No waiting events found dispatching network-vif-unplugged-d86aca21-e67b-48e9-b8de-a1d618a5dfc7 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:50:56 user nova-compute[75337]: DEBUG nova.compute.manager [req-628f7c52-ab45-49b7-87e8-4c0daef50e74 req-fec45139-d6fa-425e-ae6e-6ef3b2756f43 service nova] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Received event network-vif-unplugged-d86aca21-e67b-48e9-b8de-a1d618a5dfc7 for instance with task_state deleting. {{(pid=75337) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 15:50:56 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:50:56 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:50:56 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:50:56 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:50:56 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:50:56 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:50:56 user nova-compute[75337]: DEBUG nova.compute.manager [req-ee911685-041c-42c0-a7ee-b99cb2369a2a req-3df11bca-7d9d-4a1b-84e1-2723c3d2d66b service nova] [instance: a293c354-d1e5-4c33-9e7b-d1558235aaf8] Received event network-vif-plugged-29fff93f-08f1-4e46-91db-84ab16f785e5 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:50:56 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-ee911685-041c-42c0-a7ee-b99cb2369a2a req-3df11bca-7d9d-4a1b-84e1-2723c3d2d66b service nova] Acquiring lock "a293c354-d1e5-4c33-9e7b-d1558235aaf8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:50:57 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-ee911685-041c-42c0-a7ee-b99cb2369a2a req-3df11bca-7d9d-4a1b-84e1-2723c3d2d66b service nova] Lock "a293c354-d1e5-4c33-9e7b-d1558235aaf8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:50:57 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-ee911685-041c-42c0-a7ee-b99cb2369a2a req-3df11bca-7d9d-4a1b-84e1-2723c3d2d66b service nova] Lock "a293c354-d1e5-4c33-9e7b-d1558235aaf8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.009s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:50:57 user nova-compute[75337]: DEBUG nova.compute.manager [req-ee911685-041c-42c0-a7ee-b99cb2369a2a req-3df11bca-7d9d-4a1b-84e1-2723c3d2d66b service nova] [instance: a293c354-d1e5-4c33-9e7b-d1558235aaf8] No waiting events found dispatching network-vif-plugged-29fff93f-08f1-4e46-91db-84ab16f785e5 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:50:57 user nova-compute[75337]: WARNING nova.compute.manager [req-ee911685-041c-42c0-a7ee-b99cb2369a2a req-3df11bca-7d9d-4a1b-84e1-2723c3d2d66b service nova] [instance: a293c354-d1e5-4c33-9e7b-d1558235aaf8] Received unexpected event network-vif-plugged-29fff93f-08f1-4e46-91db-84ab16f785e5 for instance with vm_state building and task_state spawning.
Nov 06 15:50:57 user nova-compute[75337]: DEBUG nova.compute.manager [req-ee911685-041c-42c0-a7ee-b99cb2369a2a req-3df11bca-7d9d-4a1b-84e1-2723c3d2d66b service nova] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Received event network-vif-unplugged-ee068b96-f361-4cb1-afeb-d3db42848f50 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:50:57 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-ee911685-041c-42c0-a7ee-b99cb2369a2a req-3df11bca-7d9d-4a1b-84e1-2723c3d2d66b service nova] Acquiring lock "fdda34b5-280f-489d-baf5-bf21ac6dd6c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:50:57 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-ee911685-041c-42c0-a7ee-b99cb2369a2a req-3df11bca-7d9d-4a1b-84e1-2723c3d2d66b service nova] Lock "fdda34b5-280f-489d-baf5-bf21ac6dd6c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:50:57 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-ee911685-041c-42c0-a7ee-b99cb2369a2a req-3df11bca-7d9d-4a1b-84e1-2723c3d2d66b service nova] Lock "fdda34b5-280f-489d-baf5-bf21ac6dd6c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:50:57 user nova-compute[75337]: DEBUG nova.compute.manager [req-ee911685-041c-42c0-a7ee-b99cb2369a2a req-3df11bca-7d9d-4a1b-84e1-2723c3d2d66b service nova] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] No waiting events found dispatching network-vif-unplugged-ee068b96-f361-4cb1-afeb-d3db42848f50 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:50:57 user nova-compute[75337]: DEBUG nova.compute.manager [req-ee911685-041c-42c0-a7ee-b99cb2369a2a req-3df11bca-7d9d-4a1b-84e1-2723c3d2d66b service nova] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Received event network-vif-unplugged-ee068b96-f361-4cb1-afeb-d3db42848f50 for instance with task_state deleting. {{(pid=75337) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 15:50:57 user nova-compute[75337]: DEBUG nova.compute.manager [req-ee911685-041c-42c0-a7ee-b99cb2369a2a req-3df11bca-7d9d-4a1b-84e1-2723c3d2d66b service nova] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Received event network-vif-plugged-ee068b96-f361-4cb1-afeb-d3db42848f50 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:50:57 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-ee911685-041c-42c0-a7ee-b99cb2369a2a req-3df11bca-7d9d-4a1b-84e1-2723c3d2d66b service nova] Acquiring lock "fdda34b5-280f-489d-baf5-bf21ac6dd6c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:50:57 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-ee911685-041c-42c0-a7ee-b99cb2369a2a req-3df11bca-7d9d-4a1b-84e1-2723c3d2d66b service nova] Lock "fdda34b5-280f-489d-baf5-bf21ac6dd6c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:50:57 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-ee911685-041c-42c0-a7ee-b99cb2369a2a req-3df11bca-7d9d-4a1b-84e1-2723c3d2d66b service nova] Lock "fdda34b5-280f-489d-baf5-bf21ac6dd6c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:50:57 user nova-compute[75337]: DEBUG nova.compute.manager [req-ee911685-041c-42c0-a7ee-b99cb2369a2a req-3df11bca-7d9d-4a1b-84e1-2723c3d2d66b service nova] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] No waiting events found dispatching network-vif-plugged-ee068b96-f361-4cb1-afeb-d3db42848f50 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:50:57 user nova-compute[75337]: WARNING nova.compute.manager [req-ee911685-041c-42c0-a7ee-b99cb2369a2a req-3df11bca-7d9d-4a1b-84e1-2723c3d2d66b service nova] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Received unexpected event network-vif-plugged-ee068b96-f361-4cb1-afeb-d3db42848f50 for instance with vm_state active and task_state deleting.
Nov 06 15:50:57 user nova-compute[75337]: DEBUG nova.compute.manager [req-ee911685-041c-42c0-a7ee-b99cb2369a2a req-3df11bca-7d9d-4a1b-84e1-2723c3d2d66b service nova] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Received event network-vif-unplugged-7359ffbf-b953-480e-ae89-7ce5dda880a3 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:50:57 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-ee911685-041c-42c0-a7ee-b99cb2369a2a req-3df11bca-7d9d-4a1b-84e1-2723c3d2d66b service nova] Acquiring lock "fdda34b5-280f-489d-baf5-bf21ac6dd6c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:50:57 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-ee911685-041c-42c0-a7ee-b99cb2369a2a req-3df11bca-7d9d-4a1b-84e1-2723c3d2d66b service nova] Lock "fdda34b5-280f-489d-baf5-bf21ac6dd6c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:50:57 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-ee911685-041c-42c0-a7ee-b99cb2369a2a req-3df11bca-7d9d-4a1b-84e1-2723c3d2d66b service nova] Lock "fdda34b5-280f-489d-baf5-bf21ac6dd6c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:50:57 user nova-compute[75337]: DEBUG nova.compute.manager [req-ee911685-041c-42c0-a7ee-b99cb2369a2a req-3df11bca-7d9d-4a1b-84e1-2723c3d2d66b service nova] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] No waiting events found dispatching network-vif-unplugged-7359ffbf-b953-480e-ae89-7ce5dda880a3 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:50:57 user nova-compute[75337]: DEBUG nova.compute.manager [req-ee911685-041c-42c0-a7ee-b99cb2369a2a req-3df11bca-7d9d-4a1b-84e1-2723c3d2d66b service nova] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Received event network-vif-unplugged-7359ffbf-b953-480e-ae89-7ce5dda880a3 for instance with task_state deleting. {{(pid=75337) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 15:50:57 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:50:57 user nova-compute[75337]: DEBUG nova.compute.manager [None req-78b64957-cbd1-4e06-adf7-2aec20a4b055 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] [instance: a293c354-d1e5-4c33-9e7b-d1558235aaf8] Instance event wait completed in 0 seconds for  {{(pid=75337) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 15:50:57 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-78b64957-cbd1-4e06-adf7-2aec20a4b055 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] [instance: a293c354-d1e5-4c33-9e7b-d1558235aaf8] Guest created on hypervisor {{(pid=75337) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 15:50:57 user nova-compute[75337]: INFO nova.virt.libvirt.driver [-] [instance: a293c354-d1e5-4c33-9e7b-d1558235aaf8] Instance spawned successfully.
Nov 06 15:50:57 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-78b64957-cbd1-4e06-adf7-2aec20a4b055 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] [instance: a293c354-d1e5-4c33-9e7b-d1558235aaf8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 15:50:57 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-78b64957-cbd1-4e06-adf7-2aec20a4b055 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] [instance: a293c354-d1e5-4c33-9e7b-d1558235aaf8] Found default for hw_cdrom_bus of ide {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:50:57 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-78b64957-cbd1-4e06-adf7-2aec20a4b055 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] [instance: a293c354-d1e5-4c33-9e7b-d1558235aaf8] Found default for hw_disk_bus of virtio {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:50:57 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-78b64957-cbd1-4e06-adf7-2aec20a4b055 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] [instance: a293c354-d1e5-4c33-9e7b-d1558235aaf8] Found default for hw_input_bus of None {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:50:57 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-78b64957-cbd1-4e06-adf7-2aec20a4b055 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] [instance: a293c354-d1e5-4c33-9e7b-d1558235aaf8] Found default for hw_pointer_model of None {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:50:57 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-78b64957-cbd1-4e06-adf7-2aec20a4b055 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] [instance: a293c354-d1e5-4c33-9e7b-d1558235aaf8] Found default for hw_video_model of virtio {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:50:57 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-78b64957-cbd1-4e06-adf7-2aec20a4b055 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] [instance: a293c354-d1e5-4c33-9e7b-d1558235aaf8] Found default for hw_vif_model of virtio {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:50:57 user nova-compute[75337]: INFO nova.virt.libvirt.driver [-] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Instance destroyed successfully.
Nov 06 15:50:57 user nova-compute[75337]: DEBUG nova.objects.instance [None req-245d911c-a021-43ac-9282-8eee89187d4f tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Lazy-loading 'resources' on Instance uuid fdda34b5-280f-489d-baf5-bf21ac6dd6c9 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 15:50:57 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-245d911c-a021-43ac-9282-8eee89187d4f tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T15:47:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1443965287',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1443965287',id=21,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG7VkOM3FinTlqOh/5i4bJAlF+JkumoM781rkezhqaf5pWO5EV6o0arddlLxKFWQuRwvULABugSP9UlkuYUV6t6klaf6mpKXNMFKyEPMHCLjo4xOIuyZf+KcTJP3JOed1A==',key_name='tempest-keypair-1747168088',keypairs=<?>,launch_index=0,launched_at=2023-11-06T15:49:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7944be2b6e2047f5a633242809f6f04e',ramdisk_id='',reservation_id='r-ozdn99kc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1041493160',owner_user_name='tempest-TaggedBootDevicesTest_v242-1041493160-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T15:49:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='65a31270ba05411aab57fe42295b1406',uuid=fdda34b5-280f-489d-baf5-bf21ac6dd6c9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ee068b96-f361-4cb1-afeb-d3db42848f50", "address": "fa:16:3e:63:2a:18", "network": {"id": "8a494051-b597-47cd-8d64-76f0be5760cc", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-162490382-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7944be2b6e2047f5a633242809f6f04e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee068b96-f3", "ovs_interfaceid": "ee068b96-f361-4cb1-afeb-d3db42848f50", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 15:50:57 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-245d911c-a021-43ac-9282-8eee89187d4f tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Converting VIF {"id": "ee068b96-f361-4cb1-afeb-d3db42848f50", "address": "fa:16:3e:63:2a:18", "network": {"id": "8a494051-b597-47cd-8d64-76f0be5760cc", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-162490382-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7944be2b6e2047f5a633242809f6f04e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee068b96-f3", "ovs_interfaceid": "ee068b96-f361-4cb1-afeb-d3db42848f50", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 15:50:57 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-245d911c-a021-43ac-9282-8eee89187d4f tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:63:2a:18,bridge_name='br-int',has_traffic_filtering=True,id=ee068b96-f361-4cb1-afeb-d3db42848f50,network=Network(8a494051-b597-47cd-8d64-76f0be5760cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee068b96-f3') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 15:50:57 user nova-compute[75337]: DEBUG os_vif [None req-245d911c-a021-43ac-9282-8eee89187d4f tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:63:2a:18,bridge_name='br-int',has_traffic_filtering=True,id=ee068b96-f361-4cb1-afeb-d3db42848f50,network=Network(8a494051-b597-47cd-8d64-76f0be5760cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee068b96-f3') {{(pid=75337) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 15:50:57 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:50:57 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapee068b96-f3, bridge=br-int, if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:50:57 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:50:57 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:50:57 user nova-compute[75337]: INFO nova.compute.manager [None req-78b64957-cbd1-4e06-adf7-2aec20a4b055 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] [instance: a293c354-d1e5-4c33-9e7b-d1558235aaf8] Took 6.66 seconds to spawn the instance on the hypervisor.
Nov 06 15:50:57 user nova-compute[75337]: DEBUG nova.compute.manager [None req-78b64957-cbd1-4e06-adf7-2aec20a4b055 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] [instance: a293c354-d1e5-4c33-9e7b-d1558235aaf8] Checking state {{(pid=75337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 15:50:57 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:50:57 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d8d49651-15f1-4683-b6b4-2f71e8c1df49) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:50:57 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:50:57 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:50:57 user nova-compute[75337]: INFO os_vif [None req-245d911c-a021-43ac-9282-8eee89187d4f tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:63:2a:18,bridge_name='br-int',has_traffic_filtering=True,id=ee068b96-f361-4cb1-afeb-d3db42848f50,network=Network(8a494051-b597-47cd-8d64-76f0be5760cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee068b96-f3')
Nov 06 15:50:57 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-245d911c-a021-43ac-9282-8eee89187d4f tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T15:47:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1443965287',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1443965287',id=21,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG7VkOM3FinTlqOh/5i4bJAlF+JkumoM781rkezhqaf5pWO5EV6o0arddlLxKFWQuRwvULABugSP9UlkuYUV6t6klaf6mpKXNMFKyEPMHCLjo4xOIuyZf+KcTJP3JOed1A==',key_name='tempest-keypair-1747168088',keypairs=<?>,launch_index=0,launched_at=2023-11-06T15:49:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7944be2b6e2047f5a633242809f6f04e',ramdisk_id='',reservation_id='r-ozdn99kc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1041493160',owner_user_name='tempest-TaggedBootDevicesTest_v242-1041493160-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T15:49:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='65a31270ba05411aab57fe42295b1406',uuid=fdda34b5-280f-489d-baf5-bf21ac6dd6c9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7359ffbf-b953-480e-ae89-7ce5dda880a3", "address": "fa:16:3e:12:4b:11", "network": {"id": "e17a21e6-be31-4611-8f62-59327c8c4d9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1516543392", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7944be2b6e2047f5a633242809f6f04e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7359ffbf-b9", "ovs_interfaceid": "7359ffbf-b953-480e-ae89-7ce5dda880a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75337) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 15:50:57 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-245d911c-a021-43ac-9282-8eee89187d4f tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Converting VIF {"id": "7359ffbf-b953-480e-ae89-7ce5dda880a3", "address": "fa:16:3e:12:4b:11", "network": {"id": "e17a21e6-be31-4611-8f62-59327c8c4d9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1516543392", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7944be2b6e2047f5a633242809f6f04e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7359ffbf-b9", "ovs_interfaceid": "7359ffbf-b953-480e-ae89-7ce5dda880a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 15:50:57 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-245d911c-a021-43ac-9282-8eee89187d4f tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:4b:11,bridge_name='br-int',has_traffic_filtering=True,id=7359ffbf-b953-480e-ae89-7ce5dda880a3,network=Network(e17a21e6-be31-4611-8f62-59327c8c4d9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7359ffbf-b9') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 15:50:57 user nova-compute[75337]: DEBUG os_vif [None req-245d911c-a021-43ac-9282-8eee89187d4f tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:4b:11,bridge_name='br-int',has_traffic_filtering=True,id=7359ffbf-b953-480e-ae89-7ce5dda880a3,network=Network(e17a21e6-be31-4611-8f62-59327c8c4d9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7359ffbf-b9') {{(pid=75337) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 15:50:57 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:50:57 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7359ffbf-b9, bridge=br-int, if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:50:57 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:50:57 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:50:57 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:50:57 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c5a41bf0-b8b4-4d0b-bfc7-bda9e977c9e2) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:50:57 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:50:57 user nova-compute[75337]: INFO nova.compute.manager [None req-78b64957-cbd1-4e06-adf7-2aec20a4b055 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] [instance: a293c354-d1e5-4c33-9e7b-d1558235aaf8] Took 7.49 seconds to build instance.
Nov 06 15:50:57 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-78b64957-cbd1-4e06-adf7-2aec20a4b055 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Lock "a293c354-d1e5-4c33-9e7b-d1558235aaf8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.653s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:50:57 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:50:57 user nova-compute[75337]: INFO os_vif [None req-245d911c-a021-43ac-9282-8eee89187d4f tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:4b:11,bridge_name='br-int',has_traffic_filtering=True,id=7359ffbf-b953-480e-ae89-7ce5dda880a3,network=Network(e17a21e6-be31-4611-8f62-59327c8c4d9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7359ffbf-b9')
Nov 06 15:50:57 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-245d911c-a021-43ac-9282-8eee89187d4f tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T15:47:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1443965287',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1443965287',id=21,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG7VkOM3FinTlqOh/5i4bJAlF+JkumoM781rkezhqaf5pWO5EV6o0arddlLxKFWQuRwvULABugSP9UlkuYUV6t6klaf6mpKXNMFKyEPMHCLjo4xOIuyZf+KcTJP3JOed1A==',key_name='tempest-keypair-1747168088',keypairs=<?>,launch_index=0,launched_at=2023-11-06T15:49:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7944be2b6e2047f5a633242809f6f04e',ramdisk_id='',reservation_id='r-ozdn99kc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1041493160',owner_user_name='tempest-TaggedBootDevicesTest_v242-1041493160-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T15:49:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='65a31270ba05411aab57fe42295b1406',uuid=fdda34b5-280f-489d-baf5-bf21ac6dd6c9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0184ea76-40a1-41f4-9a6f-e2ca6719b7ab", "address": "fa:16:3e:3b:f7:32", "network": {"id": "e17a21e6-be31-4611-8f62-59327c8c4d9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1516543392", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7944be2b6e2047f5a633242809f6f04e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0184ea76-40", "ovs_interfaceid": "0184ea76-40a1-41f4-9a6f-e2ca6719b7ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75337) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 15:50:57 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-245d911c-a021-43ac-9282-8eee89187d4f tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Converting VIF {"id": "0184ea76-40a1-41f4-9a6f-e2ca6719b7ab", "address": "fa:16:3e:3b:f7:32", "network": {"id": "e17a21e6-be31-4611-8f62-59327c8c4d9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1516543392", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7944be2b6e2047f5a633242809f6f04e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0184ea76-40", "ovs_interfaceid": "0184ea76-40a1-41f4-9a6f-e2ca6719b7ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 15:50:57 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-245d911c-a021-43ac-9282-8eee89187d4f tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:f7:32,bridge_name='br-int',has_traffic_filtering=True,id=0184ea76-40a1-41f4-9a6f-e2ca6719b7ab,network=Network(e17a21e6-be31-4611-8f62-59327c8c4d9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0184ea76-40') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 15:50:57 user nova-compute[75337]: DEBUG os_vif [None req-245d911c-a021-43ac-9282-8eee89187d4f tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:f7:32,bridge_name='br-int',has_traffic_filtering=True,id=0184ea76-40a1-41f4-9a6f-e2ca6719b7ab,network=Network(e17a21e6-be31-4611-8f62-59327c8c4d9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0184ea76-40') {{(pid=75337) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 15:50:57 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:50:57 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0184ea76-40, bridge=br-int, if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:50:57 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:50:57 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:50:57 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:50:57 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=483dac13-6887-4533-9847-0c4c7d906082) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:50:57 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:50:57 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:50:57 user nova-compute[75337]: INFO os_vif [None req-245d911c-a021-43ac-9282-8eee89187d4f tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:f7:32,bridge_name='br-int',has_traffic_filtering=True,id=0184ea76-40a1-41f4-9a6f-e2ca6719b7ab,network=Network(e17a21e6-be31-4611-8f62-59327c8c4d9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0184ea76-40')
Nov 06 15:50:57 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-245d911c-a021-43ac-9282-8eee89187d4f tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T15:47:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1443965287',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1443965287',id=21,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG7VkOM3FinTlqOh/5i4bJAlF+JkumoM781rkezhqaf5pWO5EV6o0arddlLxKFWQuRwvULABugSP9UlkuYUV6t6klaf6mpKXNMFKyEPMHCLjo4xOIuyZf+KcTJP3JOed1A==',key_name='tempest-keypair-1747168088',keypairs=<?>,launch_index=0,launched_at=2023-11-06T15:49:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7944be2b6e2047f5a633242809f6f04e',ramdisk_id='',reservation_id='r-ozdn99kc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1041493160',owner_user_name='tempest-TaggedBootDevicesTest_v242-1041493160-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T15:49:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='65a31270ba05411aab57fe42295b1406',uuid=fdda34b5-280f-489d-baf5-bf21ac6dd6c9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "38a409f9-0fb9-4505-9f74-bf2859e6f66c", "address": "fa:16:3e:8a:6f:5e", "network": {"id": "e17a21e6-be31-4611-8f62-59327c8c4d9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1516543392", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.115", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7944be2b6e2047f5a633242809f6f04e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38a409f9-0f", "ovs_interfaceid": "38a409f9-0fb9-4505-9f74-bf2859e6f66c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 15:50:57 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-245d911c-a021-43ac-9282-8eee89187d4f tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Converting VIF {"id": "38a409f9-0fb9-4505-9f74-bf2859e6f66c", "address": "fa:16:3e:8a:6f:5e", "network": {"id": "e17a21e6-be31-4611-8f62-59327c8c4d9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1516543392", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.115", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7944be2b6e2047f5a633242809f6f04e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38a409f9-0f", "ovs_interfaceid": "38a409f9-0fb9-4505-9f74-bf2859e6f66c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 15:50:57 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-245d911c-a021-43ac-9282-8eee89187d4f tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:6f:5e,bridge_name='br-int',has_traffic_filtering=True,id=38a409f9-0fb9-4505-9f74-bf2859e6f66c,network=Network(e17a21e6-be31-4611-8f62-59327c8c4d9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38a409f9-0f') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 15:50:57 user nova-compute[75337]: DEBUG os_vif [None req-245d911c-a021-43ac-9282-8eee89187d4f tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:6f:5e,bridge_name='br-int',has_traffic_filtering=True,id=38a409f9-0fb9-4505-9f74-bf2859e6f66c,network=Network(e17a21e6-be31-4611-8f62-59327c8c4d9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38a409f9-0f') {{(pid=75337) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 15:50:57 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:50:57 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap38a409f9-0f, bridge=br-int, if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:50:57 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:50:57 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:50:57 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:50:57 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=832cc33c-eaee-4cc2-a698-f4e08423539d) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:50:57 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:50:57 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:50:57 user nova-compute[75337]: INFO os_vif [None req-245d911c-a021-43ac-9282-8eee89187d4f tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:6f:5e,bridge_name='br-int',has_traffic_filtering=True,id=38a409f9-0fb9-4505-9f74-bf2859e6f66c,network=Network(e17a21e6-be31-4611-8f62-59327c8c4d9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38a409f9-0f')
Nov 06 15:50:57 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-245d911c-a021-43ac-9282-8eee89187d4f tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T15:47:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1443965287',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1443965287',id=21,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG7VkOM3FinTlqOh/5i4bJAlF+JkumoM781rkezhqaf5pWO5EV6o0arddlLxKFWQuRwvULABugSP9UlkuYUV6t6klaf6mpKXNMFKyEPMHCLjo4xOIuyZf+KcTJP3JOed1A==',key_name='tempest-keypair-1747168088',keypairs=<?>,launch_index=0,launched_at=2023-11-06T15:49:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7944be2b6e2047f5a633242809f6f04e',ramdisk_id='',reservation_id='r-ozdn99kc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1041493160',owner_user_name='tempest-TaggedBootDevicesTest_v242-1041493160-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T15:49:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='65a31270ba05411aab57fe42295b1406',uuid=fdda34b5-280f-489d-baf5-bf21ac6dd6c9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d86aca21-e67b-48e9-b8de-a1d618a5dfc7", "address": "fa:16:3e:bf:c2:bd", "network": {"id": "e17a21e6-be31-4611-8f62-59327c8c4d9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1516543392", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.131", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7944be2b6e2047f5a633242809f6f04e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd86aca21-e6", "ovs_interfaceid": "d86aca21-e67b-48e9-b8de-a1d618a5dfc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 15:50:57 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-245d911c-a021-43ac-9282-8eee89187d4f tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Converting VIF {"id": "d86aca21-e67b-48e9-b8de-a1d618a5dfc7", "address": "fa:16:3e:bf:c2:bd", "network": {"id": "e17a21e6-be31-4611-8f62-59327c8c4d9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1516543392", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.131", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7944be2b6e2047f5a633242809f6f04e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd86aca21-e6", "ovs_interfaceid": "d86aca21-e67b-48e9-b8de-a1d618a5dfc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 15:50:57 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-245d911c-a021-43ac-9282-8eee89187d4f tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:c2:bd,bridge_name='br-int',has_traffic_filtering=True,id=d86aca21-e67b-48e9-b8de-a1d618a5dfc7,network=Network(e17a21e6-be31-4611-8f62-59327c8c4d9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd86aca21-e6') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 15:50:57 user nova-compute[75337]: DEBUG os_vif [None req-245d911c-a021-43ac-9282-8eee89187d4f tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:c2:bd,bridge_name='br-int',has_traffic_filtering=True,id=d86aca21-e67b-48e9-b8de-a1d618a5dfc7,network=Network(e17a21e6-be31-4611-8f62-59327c8c4d9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd86aca21-e6') {{(pid=75337) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 15:50:57 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:50:57 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd86aca21-e6, bridge=br-int, if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG nova.compute.manager [req-d9a98ca1-48bb-423b-9f9e-743c576e54c0 req-de857277-e1e8-453f-bdae-73374aa26986 service nova] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Received event network-vif-plugged-0184ea76-40a1-41f4-9a6f-e2ca6719b7ab {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-d9a98ca1-48bb-423b-9f9e-743c576e54c0 req-de857277-e1e8-453f-bdae-73374aa26986 service nova] Acquiring lock "fdda34b5-280f-489d-baf5-bf21ac6dd6c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-d9a98ca1-48bb-423b-9f9e-743c576e54c0 req-de857277-e1e8-453f-bdae-73374aa26986 service nova] Lock "fdda34b5-280f-489d-baf5-bf21ac6dd6c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-d9a98ca1-48bb-423b-9f9e-743c576e54c0 req-de857277-e1e8-453f-bdae-73374aa26986 service nova] Lock "fdda34b5-280f-489d-baf5-bf21ac6dd6c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG nova.compute.manager [req-d9a98ca1-48bb-423b-9f9e-743c576e54c0 req-de857277-e1e8-453f-bdae-73374aa26986 service nova] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] No waiting events found dispatching network-vif-plugged-0184ea76-40a1-41f4-9a6f-e2ca6719b7ab {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:50:58 user nova-compute[75337]: WARNING nova.compute.manager [req-d9a98ca1-48bb-423b-9f9e-743c576e54c0 req-de857277-e1e8-453f-bdae-73374aa26986 service nova] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Received unexpected event network-vif-plugged-0184ea76-40a1-41f4-9a6f-e2ca6719b7ab for instance with vm_state active and task_state deleting.
Nov 06 15:50:58 user nova-compute[75337]: DEBUG nova.compute.manager [req-d9a98ca1-48bb-423b-9f9e-743c576e54c0 req-de857277-e1e8-453f-bdae-73374aa26986 service nova] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Received event network-vif-unplugged-38a409f9-0fb9-4505-9f74-bf2859e6f66c {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-d9a98ca1-48bb-423b-9f9e-743c576e54c0 req-de857277-e1e8-453f-bdae-73374aa26986 service nova] Acquiring lock "fdda34b5-280f-489d-baf5-bf21ac6dd6c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-d9a98ca1-48bb-423b-9f9e-743c576e54c0 req-de857277-e1e8-453f-bdae-73374aa26986 service nova] Lock "fdda34b5-280f-489d-baf5-bf21ac6dd6c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-d9a98ca1-48bb-423b-9f9e-743c576e54c0 req-de857277-e1e8-453f-bdae-73374aa26986 service nova] Lock "fdda34b5-280f-489d-baf5-bf21ac6dd6c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG nova.compute.manager [req-d9a98ca1-48bb-423b-9f9e-743c576e54c0 req-de857277-e1e8-453f-bdae-73374aa26986 service nova] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] No waiting events found dispatching network-vif-unplugged-38a409f9-0fb9-4505-9f74-bf2859e6f66c {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG nova.compute.manager [req-d9a98ca1-48bb-423b-9f9e-743c576e54c0 req-de857277-e1e8-453f-bdae-73374aa26986 service nova] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Received event network-vif-unplugged-38a409f9-0fb9-4505-9f74-bf2859e6f66c for instance with task_state deleting. {{(pid=75337) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG nova.compute.manager [req-d9a98ca1-48bb-423b-9f9e-743c576e54c0 req-de857277-e1e8-453f-bdae-73374aa26986 service nova] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Received event network-vif-plugged-38a409f9-0fb9-4505-9f74-bf2859e6f66c {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-d9a98ca1-48bb-423b-9f9e-743c576e54c0 req-de857277-e1e8-453f-bdae-73374aa26986 service nova] Acquiring lock "fdda34b5-280f-489d-baf5-bf21ac6dd6c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-d9a98ca1-48bb-423b-9f9e-743c576e54c0 req-de857277-e1e8-453f-bdae-73374aa26986 service nova] Lock "fdda34b5-280f-489d-baf5-bf21ac6dd6c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-d9a98ca1-48bb-423b-9f9e-743c576e54c0 req-de857277-e1e8-453f-bdae-73374aa26986 service nova] Lock "fdda34b5-280f-489d-baf5-bf21ac6dd6c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG nova.compute.manager [req-d9a98ca1-48bb-423b-9f9e-743c576e54c0 req-de857277-e1e8-453f-bdae-73374aa26986 service nova] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] No waiting events found dispatching network-vif-plugged-38a409f9-0fb9-4505-9f74-bf2859e6f66c {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:50:58 user nova-compute[75337]: WARNING nova.compute.manager [req-d9a98ca1-48bb-423b-9f9e-743c576e54c0 req-de857277-e1e8-453f-bdae-73374aa26986 service nova] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Received unexpected event network-vif-plugged-38a409f9-0fb9-4505-9f74-bf2859e6f66c for instance with vm_state active and task_state deleting.
Nov 06 15:50:58 user nova-compute[75337]: DEBUG nova.compute.manager [req-d9a98ca1-48bb-423b-9f9e-743c576e54c0 req-de857277-e1e8-453f-bdae-73374aa26986 service nova] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Received event network-vif-unplugged-996e784d-bbe6-447b-8f1f-066ec34be989 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-d9a98ca1-48bb-423b-9f9e-743c576e54c0 req-de857277-e1e8-453f-bdae-73374aa26986 service nova] Acquiring lock "fdda34b5-280f-489d-baf5-bf21ac6dd6c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-d9a98ca1-48bb-423b-9f9e-743c576e54c0 req-de857277-e1e8-453f-bdae-73374aa26986 service nova] Lock "fdda34b5-280f-489d-baf5-bf21ac6dd6c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-d9a98ca1-48bb-423b-9f9e-743c576e54c0 req-de857277-e1e8-453f-bdae-73374aa26986 service nova] Lock "fdda34b5-280f-489d-baf5-bf21ac6dd6c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG nova.compute.manager [req-d9a98ca1-48bb-423b-9f9e-743c576e54c0 req-de857277-e1e8-453f-bdae-73374aa26986 service nova] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] No waiting events found dispatching network-vif-unplugged-996e784d-bbe6-447b-8f1f-066ec34be989 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG nova.compute.manager [req-d9a98ca1-48bb-423b-9f9e-743c576e54c0 req-de857277-e1e8-453f-bdae-73374aa26986 service nova] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Received event network-vif-unplugged-996e784d-bbe6-447b-8f1f-066ec34be989 for instance with task_state deleting. {{(pid=75337) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG nova.compute.manager [req-d9a98ca1-48bb-423b-9f9e-743c576e54c0 req-de857277-e1e8-453f-bdae-73374aa26986 service nova] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Received event network-vif-plugged-996e784d-bbe6-447b-8f1f-066ec34be989 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-d9a98ca1-48bb-423b-9f9e-743c576e54c0 req-de857277-e1e8-453f-bdae-73374aa26986 service nova] Acquiring lock "fdda34b5-280f-489d-baf5-bf21ac6dd6c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-d9a98ca1-48bb-423b-9f9e-743c576e54c0 req-de857277-e1e8-453f-bdae-73374aa26986 service nova] Lock "fdda34b5-280f-489d-baf5-bf21ac6dd6c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-d9a98ca1-48bb-423b-9f9e-743c576e54c0 req-de857277-e1e8-453f-bdae-73374aa26986 service nova] Lock "fdda34b5-280f-489d-baf5-bf21ac6dd6c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG nova.compute.manager [req-d9a98ca1-48bb-423b-9f9e-743c576e54c0 req-de857277-e1e8-453f-bdae-73374aa26986 service nova] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] No waiting events found dispatching network-vif-plugged-996e784d-bbe6-447b-8f1f-066ec34be989 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:50:58 user nova-compute[75337]: WARNING nova.compute.manager [req-d9a98ca1-48bb-423b-9f9e-743c576e54c0 req-de857277-e1e8-453f-bdae-73374aa26986 service nova] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Received unexpected event network-vif-plugged-996e784d-bbe6-447b-8f1f-066ec34be989 for instance with vm_state active and task_state deleting.
Nov 06 15:50:58 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=169f458b-e646-4ce3-ba8d-17ca327c4773) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:50:58 user nova-compute[75337]: INFO os_vif [None req-245d911c-a021-43ac-9282-8eee89187d4f tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:c2:bd,bridge_name='br-int',has_traffic_filtering=True,id=d86aca21-e67b-48e9-b8de-a1d618a5dfc7,network=Network(e17a21e6-be31-4611-8f62-59327c8c4d9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd86aca21-e6')
Nov 06 15:50:58 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-245d911c-a021-43ac-9282-8eee89187d4f tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T15:47:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1443965287',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1443965287',id=21,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG7VkOM3FinTlqOh/5i4bJAlF+JkumoM781rkezhqaf5pWO5EV6o0arddlLxKFWQuRwvULABugSP9UlkuYUV6t6klaf6mpKXNMFKyEPMHCLjo4xOIuyZf+KcTJP3JOed1A==',key_name='tempest-keypair-1747168088',keypairs=<?>,launch_index=0,launched_at=2023-11-06T15:49:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7944be2b6e2047f5a633242809f6f04e',ramdisk_id='',reservation_id='r-ozdn99kc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1041493160',owner_user_name='tempest-TaggedBootDevicesTest_v242-1041493160-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T15:49:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='65a31270ba05411aab57fe42295b1406',uuid=fdda34b5-280f-489d-baf5-bf21ac6dd6c9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4c56104b-528f-40b8-931d-7619e413ab07", "address": "fa:16:3e:4d:d7:97", "network": {"id": "00ad9466-de22-4eb1-86c7-01667b94d2a9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1660110834", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7944be2b6e2047f5a633242809f6f04e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c56104b-52", "ovs_interfaceid": "4c56104b-528f-40b8-931d-7619e413ab07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-245d911c-a021-43ac-9282-8eee89187d4f tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Converting VIF {"id": "4c56104b-528f-40b8-931d-7619e413ab07", "address": "fa:16:3e:4d:d7:97", "network": {"id": "00ad9466-de22-4eb1-86c7-01667b94d2a9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1660110834", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7944be2b6e2047f5a633242809f6f04e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c56104b-52", "ovs_interfaceid": "4c56104b-528f-40b8-931d-7619e413ab07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-245d911c-a021-43ac-9282-8eee89187d4f tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:d7:97,bridge_name='br-int',has_traffic_filtering=True,id=4c56104b-528f-40b8-931d-7619e413ab07,network=Network(00ad9466-de22-4eb1-86c7-01667b94d2a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c56104b-52') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG os_vif [None req-245d911c-a021-43ac-9282-8eee89187d4f tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:d7:97,bridge_name='br-int',has_traffic_filtering=True,id=4c56104b-528f-40b8-931d-7619e413ab07,network=Network(00ad9466-de22-4eb1-86c7-01667b94d2a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c56104b-52') {{(pid=75337) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4c56104b-52, bridge=br-int, if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=dc0ab635-e7c6-4b0f-85ee-7531e37e0810) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:50:58 user nova-compute[75337]: INFO os_vif [None req-245d911c-a021-43ac-9282-8eee89187d4f tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:d7:97,bridge_name='br-int',has_traffic_filtering=True,id=4c56104b-528f-40b8-931d-7619e413ab07,network=Network(00ad9466-de22-4eb1-86c7-01667b94d2a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c56104b-52')
Nov 06 15:50:58 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-245d911c-a021-43ac-9282-8eee89187d4f tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T15:47:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1443965287',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1443965287',id=21,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG7VkOM3FinTlqOh/5i4bJAlF+JkumoM781rkezhqaf5pWO5EV6o0arddlLxKFWQuRwvULABugSP9UlkuYUV6t6klaf6mpKXNMFKyEPMHCLjo4xOIuyZf+KcTJP3JOed1A==',key_name='tempest-keypair-1747168088',keypairs=<?>,launch_index=0,launched_at=2023-11-06T15:49:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7944be2b6e2047f5a633242809f6f04e',ramdisk_id='',reservation_id='r-ozdn99kc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1041493160',owner_user_name='tempest-TaggedBootDevicesTest_v242-1041493160-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T15:49:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='65a31270ba05411aab57fe42295b1406',uuid=fdda34b5-280f-489d-baf5-bf21ac6dd6c9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "996e784d-bbe6-447b-8f1f-066ec34be989", "address": "fa:16:3e:41:c0:e2", "network": {"id": "00ad9466-de22-4eb1-86c7-01667b94d2a9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1660110834", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7944be2b6e2047f5a633242809f6f04e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap996e784d-bb", "ovs_interfaceid": "996e784d-bbe6-447b-8f1f-066ec34be989", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-245d911c-a021-43ac-9282-8eee89187d4f tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Converting VIF {"id": "996e784d-bbe6-447b-8f1f-066ec34be989", "address": "fa:16:3e:41:c0:e2", "network": {"id": "00ad9466-de22-4eb1-86c7-01667b94d2a9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1660110834", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7944be2b6e2047f5a633242809f6f04e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap996e784d-bb", "ovs_interfaceid": "996e784d-bbe6-447b-8f1f-066ec34be989", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-245d911c-a021-43ac-9282-8eee89187d4f tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:c0:e2,bridge_name='br-int',has_traffic_filtering=True,id=996e784d-bbe6-447b-8f1f-066ec34be989,network=Network(00ad9466-de22-4eb1-86c7-01667b94d2a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap996e784d-bb') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG os_vif [None req-245d911c-a021-43ac-9282-8eee89187d4f tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:c0:e2,bridge_name='br-int',has_traffic_filtering=True,id=996e784d-bbe6-447b-8f1f-066ec34be989,network=Network(00ad9466-de22-4eb1-86c7-01667b94d2a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap996e784d-bb') {{(pid=75337) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap996e784d-bb, bridge=br-int, if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ff7eb7b9-8eee-457f-aac5-6c808fda3b9f) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:50:58 user nova-compute[75337]: INFO os_vif [None req-245d911c-a021-43ac-9282-8eee89187d4f tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:c0:e2,bridge_name='br-int',has_traffic_filtering=True,id=996e784d-bbe6-447b-8f1f-066ec34be989,network=Network(00ad9466-de22-4eb1-86c7-01667b94d2a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap996e784d-bb')
Nov 06 15:50:58 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-245d911c-a021-43ac-9282-8eee89187d4f tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] calling os-brick to detach iSCSI Volume {{(pid=75337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-245d911c-a021-43ac-9282-8eee89187d4f tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2abc33d0c0>, {'target_iqn': 'iqn.2010-10.org.openstack:06631b49-02a1-4759-8d9b-22b7ebdaa584', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EvnrPMtD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 15:50:58 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-245d911c-a021-43ac-9282-8eee89187d4f tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 15:50:58 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-245d911c-a021-43ac-9282-8eee89187d4f tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-245d911c-a021-43ac-9282-8eee89187d4f tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[31beadad-3471-4815-abb6-8e32b0b886c1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1bebbb46-2250-4511-ba59-f4ce67e0b45d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:563526a2-6204-4264-91b7-041e6cadab23\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dc5eae50-0461-47ca-bc48-cb38087b06e0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:06631b49-02a1-4759-8d9b-22b7ebdaa584\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2086a611-973d-47a1-bb69-f2ebd144be03\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-245d911c-a021-43ac-9282-8eee89187d4f tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 15:50:58 user nova-compute[75337]: No targets found.
Nov 06 15:50:58 user nova-compute[75337]: iSNS:
Nov 06 15:50:58 user nova-compute[75337]: No targets found.
Nov 06 15:50:58 user nova-compute[75337]: STATIC:
Nov 06 15:50:58 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:1bebbb46-2250-4511-ba59-f4ce67e0b45d
Nov 06 15:50:58 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 15:50:58 user nova-compute[75337]:                 Iface Name: default
Nov 06 15:50:58 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158
Nov 06 15:50:58 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 15:50:58 user nova-compute[75337]:                 Iface Name: default
Nov 06 15:50:58 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:563526a2-6204-4264-91b7-041e6cadab23
Nov 06 15:50:58 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 15:50:58 user nova-compute[75337]:                 Iface Name: default
Nov 06 15:50:58 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:dc5eae50-0461-47ca-bc48-cb38087b06e0
Nov 06 15:50:58 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 15:50:58 user nova-compute[75337]:                 Iface Name: default
Nov 06 15:50:58 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:06631b49-02a1-4759-8d9b-22b7ebdaa584
Nov 06 15:50:58 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 15:50:58 user nova-compute[75337]:                 Iface Name: default
Nov 06 15:50:58 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:2086a611-973d-47a1-bb69-f2ebd144be03
Nov 06 15:50:58 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 15:50:58 user nova-compute[75337]:                 Iface Name: default
Nov 06 15:50:58 user nova-compute[75337]: FIRMWARE:
Nov 06 15:50:58 user nova-compute[75337]: No targets found.
Nov 06 15:50:58 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-245d911c-a021-43ac-9282-8eee89187d4f tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 15:50:58 user nova-compute[75337]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 15:50:58 user nova-compute[75337]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75337) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-245d911c-a021-43ac-9282-8eee89187d4f tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:06631b49-02a1-4759-8d9b-22b7ebdaa584', 0)] {{(pid=75337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[039143f6-a6cd-41ed-8da0-a260ed9379bb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:06631b49-02a1-4759-8d9b-22b7ebdaa584\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1bebbb46-2250-4511-ba59-f4ce67e0b45d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2086a611-973d-47a1-bb69-f2ebd144be03\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:563526a2-6204-4264-91b7-041e6cadab23\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dc5eae50-0461-47ca-bc48-cb38087b06e0\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[79f3afb0-3bf2-47cd-8036-6ce52133a108]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06631b49-02a1-4759-8d9b-22b7ebdaa584 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:563526a2-6204-4264-91b7-041e6cadab23 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bebbb46-2250-4511-ba59-f4ce67e0b45d (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2086a611-973d-47a1-bb69-f2ebd144be03 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc5eae50-0461-47ca-bc48-cb38087b06e0 (non-flash)\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-245d911c-a021-43ac-9282-8eee89187d4f tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)
Nov 06 15:50:58 user nova-compute[75337]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06631b49-02a1-4759-8d9b-22b7ebdaa584 (non-flash)
Nov 06 15:50:58 user nova-compute[75337]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:563526a2-6204-4264-91b7-041e6cadab23 (non-flash)
Nov 06 15:50:58 user nova-compute[75337]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bebbb46-2250-4511-ba59-f4ce67e0b45d (non-flash)
Nov 06 15:50:58 user nova-compute[75337]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2086a611-973d-47a1-bb69-f2ebd144be03 (non-flash)
Nov 06 15:50:58 user nova-compute[75337]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc5eae50-0461-47ca-bc48-cb38087b06e0 (non-flash)
Nov 06 15:50:58 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-245d911c-a021-43ac-9282-8eee89187d4f tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)
Nov 06 15:50:58 user nova-compute[75337]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06631b49-02a1-4759-8d9b-22b7ebdaa584 (non-flash)
Nov 06 15:50:58 user nova-compute[75337]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:563526a2-6204-4264-91b7-041e6cadab23 (non-flash)
Nov 06 15:50:58 user nova-compute[75337]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bebbb46-2250-4511-ba59-f4ce67e0b45d (non-flash)
Nov 06 15:50:58 user nova-compute[75337]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2086a611-973d-47a1-bb69-f2ebd144be03 (non-flash)
Nov 06 15:50:58 user nova-compute[75337]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc5eae50-0461-47ca-bc48-cb38087b06e0 (non-flash)
Nov 06 15:50:58 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-245d911c-a021-43ac-9282-8eee89187d4f tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2a9c3cb1c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:06631b49-02a1-4759-8d9b-22b7ebdaa584'): ({'sdf'}, set())}) {{(pid=75337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-245d911c-a021-43ac-9282-8eee89187d4f tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Removing single pathed devices sdf {{(pid=75337) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.030s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[04a68be5-660a-4509-a9a9-62edd22d373d]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.028s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[43c9fd36-aae9-47d1-9e5e-ebc676efa447]: (4, ('ok\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-245d911c-a021-43ac-9282-8eee89187d4f tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Flushing IO for device /dev/sdf {{(pid=75337) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.018s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2541a63-8bcd-41c9-91e3-6b4d38ac3a41]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-245d911c-a021-43ac-9282-8eee89187d4f tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75337) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG nova.compute.manager [req-9e2504c5-8122-42c4-882f-3c3763121450 req-13d9e12b-73c7-4be2-a807-02f1852ef5ff service nova] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Received event network-vif-plugged-d86aca21-e67b-48e9-b8de-a1d618a5dfc7 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-9e2504c5-8122-42c4-882f-3c3763121450 req-13d9e12b-73c7-4be2-a807-02f1852ef5ff service nova] Acquiring lock "fdda34b5-280f-489d-baf5-bf21ac6dd6c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-9e2504c5-8122-42c4-882f-3c3763121450 req-13d9e12b-73c7-4be2-a807-02f1852ef5ff service nova] Lock "fdda34b5-280f-489d-baf5-bf21ac6dd6c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-9e2504c5-8122-42c4-882f-3c3763121450 req-13d9e12b-73c7-4be2-a807-02f1852ef5ff service nova] Lock "fdda34b5-280f-489d-baf5-bf21ac6dd6c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG nova.compute.manager [req-9e2504c5-8122-42c4-882f-3c3763121450 req-13d9e12b-73c7-4be2-a807-02f1852ef5ff service nova] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] No waiting events found dispatching network-vif-plugged-d86aca21-e67b-48e9-b8de-a1d618a5dfc7 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:50:58 user nova-compute[75337]: WARNING nova.compute.manager [req-9e2504c5-8122-42c4-882f-3c3763121450 req-13d9e12b-73c7-4be2-a807-02f1852ef5ff service nova] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Received unexpected event network-vif-plugged-d86aca21-e67b-48e9-b8de-a1d618a5dfc7 for instance with vm_state active and task_state deleting.
Nov 06 15:50:58 user nova-compute[75337]: DEBUG nova.compute.manager [req-9e2504c5-8122-42c4-882f-3c3763121450 req-13d9e12b-73c7-4be2-a807-02f1852ef5ff service nova] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Received event network-vif-unplugged-4c56104b-528f-40b8-931d-7619e413ab07 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-9e2504c5-8122-42c4-882f-3c3763121450 req-13d9e12b-73c7-4be2-a807-02f1852ef5ff service nova] Acquiring lock "fdda34b5-280f-489d-baf5-bf21ac6dd6c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-9e2504c5-8122-42c4-882f-3c3763121450 req-13d9e12b-73c7-4be2-a807-02f1852ef5ff service nova] Lock "fdda34b5-280f-489d-baf5-bf21ac6dd6c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-9e2504c5-8122-42c4-882f-3c3763121450 req-13d9e12b-73c7-4be2-a807-02f1852ef5ff service nova] Lock "fdda34b5-280f-489d-baf5-bf21ac6dd6c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG nova.compute.manager [req-9e2504c5-8122-42c4-882f-3c3763121450 req-13d9e12b-73c7-4be2-a807-02f1852ef5ff service nova] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] No waiting events found dispatching network-vif-unplugged-4c56104b-528f-40b8-931d-7619e413ab07 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG nova.compute.manager [req-9e2504c5-8122-42c4-882f-3c3763121450 req-13d9e12b-73c7-4be2-a807-02f1852ef5ff service nova] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Received event network-vif-unplugged-4c56104b-528f-40b8-931d-7619e413ab07 for instance with task_state deleting. {{(pid=75337) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG nova.compute.manager [req-9e2504c5-8122-42c4-882f-3c3763121450 req-13d9e12b-73c7-4be2-a807-02f1852ef5ff service nova] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Received event network-vif-plugged-4c56104b-528f-40b8-931d-7619e413ab07 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-9e2504c5-8122-42c4-882f-3c3763121450 req-13d9e12b-73c7-4be2-a807-02f1852ef5ff service nova] Acquiring lock "fdda34b5-280f-489d-baf5-bf21ac6dd6c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-9e2504c5-8122-42c4-882f-3c3763121450 req-13d9e12b-73c7-4be2-a807-02f1852ef5ff service nova] Lock "fdda34b5-280f-489d-baf5-bf21ac6dd6c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-9e2504c5-8122-42c4-882f-3c3763121450 req-13d9e12b-73c7-4be2-a807-02f1852ef5ff service nova] Lock "fdda34b5-280f-489d-baf5-bf21ac6dd6c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG nova.compute.manager [req-9e2504c5-8122-42c4-882f-3c3763121450 req-13d9e12b-73c7-4be2-a807-02f1852ef5ff service nova] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] No waiting events found dispatching network-vif-plugged-4c56104b-528f-40b8-931d-7619e413ab07 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:50:58 user nova-compute[75337]: WARNING nova.compute.manager [req-9e2504c5-8122-42c4-882f-3c3763121450 req-13d9e12b-73c7-4be2-a807-02f1852ef5ff service nova] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Received unexpected event network-vif-plugged-4c56104b-528f-40b8-931d-7619e413ab07 for instance with vm_state active and task_state deleting.
Nov 06 15:50:58 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.057s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bd8a13e-bef9-4611-b4c2-e94d70b83ee3]: (4, ('1', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-245d911c-a021-43ac-9282-8eee89187d4f tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-245d911c-a021-43ac-9282-8eee89187d4f tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] SCSI volumes sdf have been removed. {{(pid=75337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-245d911c-a021-43ac-9282-8eee89187d4f tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:06631b49-02a1-4759-8d9b-22b7ebdaa584')] {{(pid=75337) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06631b49-02a1-4759-8d9b-22b7ebdaa584 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06631b49-02a1-4759-8d9b-22b7ebdaa584 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[af86018a-7fa8-47e4-a2f3-323bb37a5f70]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-245d911c-a021-43ac-9282-8eee89187d4f tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06631b49-02a1-4759-8d9b-22b7ebdaa584 -p 172.16.0.220:3260 --logout {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06631b49-02a1-4759-8d9b-22b7ebdaa584 -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbb4a984-4f61-4c34-8508-8489ded7de4b]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:06631b49-02a1-4759-8d9b-22b7ebdaa584, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:06631b49-02a1-4759-8d9b-22b7ebdaa584, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-245d911c-a021-43ac-9282-8eee89187d4f tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:06631b49-02a1-4759-8d9b-22b7ebdaa584, portal: 172.16.0.220,3260]
Nov 06 15:50:58 user nova-compute[75337]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:06631b49-02a1-4759-8d9b-22b7ebdaa584, portal: 172.16.0.220,3260] successful.
Nov 06 15:50:58 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06631b49-02a1-4759-8d9b-22b7ebdaa584 -p 172.16.0.220:3260 --op delete {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06631b49-02a1-4759-8d9b-22b7ebdaa584 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[60c031c4-1e98-41de-bf2c-e617f62c9e17]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-245d911c-a021-43ac-9282-8eee89187d4f tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-245d911c-a021-43ac-9282-8eee89187d4f tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.407s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-245d911c-a021-43ac-9282-8eee89187d4f tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] <== disconnect_volume: return (409ms) None {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-245d911c-a021-43ac-9282-8eee89187d4f tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Disconnected iSCSI Volume {{(pid=75337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-245d911c-a021-43ac-9282-8eee89187d4f tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] calling os-brick to detach iSCSI Volume {{(pid=75337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-245d911c-a021-43ac-9282-8eee89187d4f tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2abc33d0c0>, {'target_iqn': 'iqn.2010-10.org.openstack:563526a2-6204-4264-91b7-041e6cadab23', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RnmGPoqS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 15:50:58 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-245d911c-a021-43ac-9282-8eee89187d4f tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 15:50:58 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-245d911c-a021-43ac-9282-8eee89187d4f tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-245d911c-a021-43ac-9282-8eee89187d4f tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.030s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a5c261d-4270-4a27-870a-c98aaad4e5bb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1bebbb46-2250-4511-ba59-f4ce67e0b45d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:563526a2-6204-4264-91b7-041e6cadab23\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dc5eae50-0461-47ca-bc48-cb38087b06e0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2086a611-973d-47a1-bb69-f2ebd144be03\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-245d911c-a021-43ac-9282-8eee89187d4f tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 15:50:58 user nova-compute[75337]: No targets found.
Nov 06 15:50:58 user nova-compute[75337]: iSNS:
Nov 06 15:50:58 user nova-compute[75337]: No targets found.
Nov 06 15:50:58 user nova-compute[75337]: STATIC:
Nov 06 15:50:58 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:1bebbb46-2250-4511-ba59-f4ce67e0b45d
Nov 06 15:50:58 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 15:50:58 user nova-compute[75337]:                 Iface Name: default
Nov 06 15:50:58 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158
Nov 06 15:50:58 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 15:50:58 user nova-compute[75337]:                 Iface Name: default
Nov 06 15:50:58 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:563526a2-6204-4264-91b7-041e6cadab23
Nov 06 15:50:58 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 15:50:58 user nova-compute[75337]:                 Iface Name: default
Nov 06 15:50:58 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:dc5eae50-0461-47ca-bc48-cb38087b06e0
Nov 06 15:50:58 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 15:50:58 user nova-compute[75337]:                 Iface Name: default
Nov 06 15:50:58 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:2086a611-973d-47a1-bb69-f2ebd144be03
Nov 06 15:50:58 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 15:50:58 user nova-compute[75337]:                 Iface Name: default
Nov 06 15:50:58 user nova-compute[75337]: FIRMWARE:
Nov 06 15:50:58 user nova-compute[75337]: No targets found.
Nov 06 15:50:58 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-245d911c-a021-43ac-9282-8eee89187d4f tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 15:50:58 user nova-compute[75337]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 15:50:58 user nova-compute[75337]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75337) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-245d911c-a021-43ac-9282-8eee89187d4f tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:563526a2-6204-4264-91b7-041e6cadab23', 0)] {{(pid=75337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[d72fcce9-3c7a-4d82-9219-1f01a9492936]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1bebbb46-2250-4511-ba59-f4ce67e0b45d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2086a611-973d-47a1-bb69-f2ebd144be03\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:563526a2-6204-4264-91b7-041e6cadab23\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dc5eae50-0461-47ca-bc48-cb38087b06e0\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[e96193b7-0838-4cb4-89cd-beac4504edf6]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:563526a2-6204-4264-91b7-041e6cadab23 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bebbb46-2250-4511-ba59-f4ce67e0b45d (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2086a611-973d-47a1-bb69-f2ebd144be03 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc5eae50-0461-47ca-bc48-cb38087b06e0 (non-flash)\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-245d911c-a021-43ac-9282-8eee89187d4f tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)
Nov 06 15:50:58 user nova-compute[75337]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:563526a2-6204-4264-91b7-041e6cadab23 (non-flash)
Nov 06 15:50:58 user nova-compute[75337]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bebbb46-2250-4511-ba59-f4ce67e0b45d (non-flash)
Nov 06 15:50:58 user nova-compute[75337]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2086a611-973d-47a1-bb69-f2ebd144be03 (non-flash)
Nov 06 15:50:58 user nova-compute[75337]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc5eae50-0461-47ca-bc48-cb38087b06e0 (non-flash)
Nov 06 15:50:58 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-245d911c-a021-43ac-9282-8eee89187d4f tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)
Nov 06 15:50:58 user nova-compute[75337]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:563526a2-6204-4264-91b7-041e6cadab23 (non-flash)
Nov 06 15:50:58 user nova-compute[75337]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bebbb46-2250-4511-ba59-f4ce67e0b45d (non-flash)
Nov 06 15:50:58 user nova-compute[75337]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2086a611-973d-47a1-bb69-f2ebd144be03 (non-flash)
Nov 06 15:50:58 user nova-compute[75337]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc5eae50-0461-47ca-bc48-cb38087b06e0 (non-flash)
Nov 06 15:50:58 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-245d911c-a021-43ac-9282-8eee89187d4f tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2a9c3cb1c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:563526a2-6204-4264-91b7-041e6cadab23'): ({'sdh'}, set())}) {{(pid=75337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-245d911c-a021-43ac-9282-8eee89187d4f tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Removing single pathed devices sdh {{(pid=75337) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b04bd07-9496-4c98-b6e7-589368f4f30b]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.029s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e4f8670-880d-47f3-b900-616fdf52c6e8]: (4, ('ok\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-245d911c-a021-43ac-9282-8eee89187d4f tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Flushing IO for device /dev/sdh {{(pid=75337) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.015s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c4df881-335b-46b9-bbca-383f63f50190]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-245d911c-a021-43ac-9282-8eee89187d4f tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=75337) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.044s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[8131d122-3e99-46c7-8d85-7ca32f1443ee]: (4, ('1', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-245d911c-a021-43ac-9282-8eee89187d4f tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=75337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-245d911c-a021-43ac-9282-8eee89187d4f tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] SCSI volumes sdh have been removed. {{(pid=75337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-245d911c-a021-43ac-9282-8eee89187d4f tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:563526a2-6204-4264-91b7-041e6cadab23')] {{(pid=75337) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:563526a2-6204-4264-91b7-041e6cadab23 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:563526a2-6204-4264-91b7-041e6cadab23 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[f276528b-107b-4699-b5ca-5f13574f65b4]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-245d911c-a021-43ac-9282-8eee89187d4f tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:563526a2-6204-4264-91b7-041e6cadab23 -p 172.16.0.220:3260 --logout {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:563526a2-6204-4264-91b7-041e6cadab23 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b455e18-7fab-4fff-8d28-78153e4699ce]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:563526a2-6204-4264-91b7-041e6cadab23, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:563526a2-6204-4264-91b7-041e6cadab23, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-245d911c-a021-43ac-9282-8eee89187d4f tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:563526a2-6204-4264-91b7-041e6cadab23, portal: 172.16.0.220,3260]
Nov 06 15:50:58 user nova-compute[75337]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:563526a2-6204-4264-91b7-041e6cadab23, portal: 172.16.0.220,3260] successful.
Nov 06 15:50:58 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:563526a2-6204-4264-91b7-041e6cadab23 -p 172.16.0.220:3260 --op delete {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:563526a2-6204-4264-91b7-041e6cadab23 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.041s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[586150fe-e225-4ffb-b6a9-206618036066]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-245d911c-a021-43ac-9282-8eee89187d4f tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-245d911c-a021-43ac-9282-8eee89187d4f tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.388s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-245d911c-a021-43ac-9282-8eee89187d4f tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] <== disconnect_volume: return (389ms) None {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-245d911c-a021-43ac-9282-8eee89187d4f tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Disconnected iSCSI Volume {{(pid=75337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-245d911c-a021-43ac-9282-8eee89187d4f tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] calling os-brick to detach iSCSI Volume {{(pid=75337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-245d911c-a021-43ac-9282-8eee89187d4f tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2abc33d0c0>, {'target_iqn': 'iqn.2010-10.org.openstack:1bebbb46-2250-4511-ba59-f4ce67e0b45d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VGdgTYBv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': True}}" {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 15:50:58 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-245d911c-a021-43ac-9282-8eee89187d4f tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 15:50:58 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-245d911c-a021-43ac-9282-8eee89187d4f tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-245d911c-a021-43ac-9282-8eee89187d4f tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 15:50:58 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:50:59 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.041s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:50:59 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[354bd41a-4616-4aa8-8271-7a730e92f849]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1bebbb46-2250-4511-ba59-f4ce67e0b45d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dc5eae50-0461-47ca-bc48-cb38087b06e0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2086a611-973d-47a1-bb69-f2ebd144be03\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:50:59 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-245d911c-a021-43ac-9282-8eee89187d4f tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 15:50:59 user nova-compute[75337]: No targets found.
Nov 06 15:50:59 user nova-compute[75337]: iSNS:
Nov 06 15:50:59 user nova-compute[75337]: No targets found.
Nov 06 15:50:59 user nova-compute[75337]: STATIC:
Nov 06 15:50:59 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:1bebbb46-2250-4511-ba59-f4ce67e0b45d
Nov 06 15:50:59 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 15:50:59 user nova-compute[75337]:                 Iface Name: default
Nov 06 15:50:59 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158
Nov 06 15:50:59 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 15:50:59 user nova-compute[75337]:                 Iface Name: default
Nov 06 15:50:59 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:dc5eae50-0461-47ca-bc48-cb38087b06e0
Nov 06 15:50:59 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 15:50:59 user nova-compute[75337]:                 Iface Name: default
Nov 06 15:50:59 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:2086a611-973d-47a1-bb69-f2ebd144be03
Nov 06 15:50:59 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 15:50:59 user nova-compute[75337]:                 Iface Name: default
Nov 06 15:50:59 user nova-compute[75337]: FIRMWARE:
Nov 06 15:50:59 user nova-compute[75337]: No targets found.
Nov 06 15:50:59 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 15:50:59 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-245d911c-a021-43ac-9282-8eee89187d4f tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 15:50:59 user nova-compute[75337]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 15:50:59 user nova-compute[75337]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75337) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 15:50:59 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-245d911c-a021-43ac-9282-8eee89187d4f tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1bebbb46-2250-4511-ba59-f4ce67e0b45d', 0)] {{(pid=75337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 15:50:59 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:50:59 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:50:59 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f8a40d8-2f90-4a20-90e3-f950154bd999]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1bebbb46-2250-4511-ba59-f4ce67e0b45d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2086a611-973d-47a1-bb69-f2ebd144be03\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dc5eae50-0461-47ca-bc48-cb38087b06e0\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:50:59 user nova-compute[75337]: DEBUG nova.compute.manager [req-8ccf1a6f-7eee-4136-a614-f89c248104c9 req-0e98ca55-dd2d-4d05-9013-7f804dd0009f service nova] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Received event network-vif-plugged-7359ffbf-b953-480e-ae89-7ce5dda880a3 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:50:59 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-8ccf1a6f-7eee-4136-a614-f89c248104c9 req-0e98ca55-dd2d-4d05-9013-7f804dd0009f service nova] Acquiring lock "fdda34b5-280f-489d-baf5-bf21ac6dd6c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:50:59 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-8ccf1a6f-7eee-4136-a614-f89c248104c9 req-0e98ca55-dd2d-4d05-9013-7f804dd0009f service nova] Lock "fdda34b5-280f-489d-baf5-bf21ac6dd6c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:50:59 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-8ccf1a6f-7eee-4136-a614-f89c248104c9 req-0e98ca55-dd2d-4d05-9013-7f804dd0009f service nova] Lock "fdda34b5-280f-489d-baf5-bf21ac6dd6c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:50:59 user nova-compute[75337]: DEBUG nova.compute.manager [req-8ccf1a6f-7eee-4136-a614-f89c248104c9 req-0e98ca55-dd2d-4d05-9013-7f804dd0009f service nova] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] No waiting events found dispatching network-vif-plugged-7359ffbf-b953-480e-ae89-7ce5dda880a3 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:50:59 user nova-compute[75337]: WARNING nova.compute.manager [req-8ccf1a6f-7eee-4136-a614-f89c248104c9 req-0e98ca55-dd2d-4d05-9013-7f804dd0009f service nova] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Received unexpected event network-vif-plugged-7359ffbf-b953-480e-ae89-7ce5dda880a3 for instance with vm_state active and task_state deleting.
Nov 06 15:50:59 user nova-compute[75337]: DEBUG nova.compute.manager [req-8ccf1a6f-7eee-4136-a614-f89c248104c9 req-0e98ca55-dd2d-4d05-9013-7f804dd0009f service nova] [instance: 493eff79-294e-4259-a6d0-4772c4b45013] Received event network-changed-5e620284-83c1-40a8-91a5-c6b2c8c87a19 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:50:59 user nova-compute[75337]: DEBUG nova.compute.manager [req-8ccf1a6f-7eee-4136-a614-f89c248104c9 req-0e98ca55-dd2d-4d05-9013-7f804dd0009f service nova] [instance: 493eff79-294e-4259-a6d0-4772c4b45013] Refreshing instance network info cache due to event network-changed-5e620284-83c1-40a8-91a5-c6b2c8c87a19. {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 15:50:59 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-8ccf1a6f-7eee-4136-a614-f89c248104c9 req-0e98ca55-dd2d-4d05-9013-7f804dd0009f service nova] Acquiring lock "refresh_cache-493eff79-294e-4259-a6d0-4772c4b45013" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 15:50:59 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-8ccf1a6f-7eee-4136-a614-f89c248104c9 req-0e98ca55-dd2d-4d05-9013-7f804dd0009f service nova] Acquired lock "refresh_cache-493eff79-294e-4259-a6d0-4772c4b45013" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 15:50:59 user nova-compute[75337]: DEBUG nova.network.neutron [req-8ccf1a6f-7eee-4136-a614-f89c248104c9 req-0e98ca55-dd2d-4d05-9013-7f804dd0009f service nova] [instance: 493eff79-294e-4259-a6d0-4772c4b45013] Refreshing network info cache for port 5e620284-83c1-40a8-91a5-c6b2c8c87a19 {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 15:50:59 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:50:59 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:50:59 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef0bca09-c267-4947-b2ad-c5ea037ca7bc]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bebbb46-2250-4511-ba59-f4ce67e0b45d (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2086a611-973d-47a1-bb69-f2ebd144be03 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc5eae50-0461-47ca-bc48-cb38087b06e0 (non-flash)\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:50:59 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-245d911c-a021-43ac-9282-8eee89187d4f tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)
Nov 06 15:50:59 user nova-compute[75337]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bebbb46-2250-4511-ba59-f4ce67e0b45d (non-flash)
Nov 06 15:50:59 user nova-compute[75337]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2086a611-973d-47a1-bb69-f2ebd144be03 (non-flash)
Nov 06 15:50:59 user nova-compute[75337]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc5eae50-0461-47ca-bc48-cb38087b06e0 (non-flash)
Nov 06 15:50:59 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 15:50:59 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-245d911c-a021-43ac-9282-8eee89187d4f tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)
Nov 06 15:50:59 user nova-compute[75337]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bebbb46-2250-4511-ba59-f4ce67e0b45d (non-flash)
Nov 06 15:50:59 user nova-compute[75337]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2086a611-973d-47a1-bb69-f2ebd144be03 (non-flash)
Nov 06 15:50:59 user nova-compute[75337]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc5eae50-0461-47ca-bc48-cb38087b06e0 (non-flash)
Nov 06 15:50:59 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 15:50:59 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-245d911c-a021-43ac-9282-8eee89187d4f tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2a9c5dda20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1bebbb46-2250-4511-ba59-f4ce67e0b45d'): ({'sdj'}, set())}) {{(pid=75337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 15:50:59 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-245d911c-a021-43ac-9282-8eee89187d4f tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Removing single pathed devices sdj {{(pid=75337) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 15:50:59 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:50:59 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:50:59 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcb3b7fd-aaac-41a1-b5f5-dd34bea6c3cb]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:50:59 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:50:59 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:50:59 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.020s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:50:59 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[0763b17d-1bcc-412f-9f10-bee2b21bf122]: (4, ('ok\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:50:59 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-245d911c-a021-43ac-9282-8eee89187d4f tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Flushing IO for device /dev/sdj {{(pid=75337) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 15:50:59 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:50:59 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.015s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:50:59 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[d59d4266-9f61-49de-9dd6-da11cb0d7862]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:50:59 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-245d911c-a021-43ac-9282-8eee89187d4f tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=75337) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 15:50:59 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:50:59 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.069s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:50:59 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[66561f38-a17c-4f7c-bbc9-752ec6fe039f]: (4, ('1', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:50:59 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-245d911c-a021-43ac-9282-8eee89187d4f tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Checking to see if SCSI volumes sdj have been removed. {{(pid=75337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 15:50:59 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-245d911c-a021-43ac-9282-8eee89187d4f tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] SCSI volumes sdj have been removed. {{(pid=75337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 15:50:59 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-245d911c-a021-43ac-9282-8eee89187d4f tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1bebbb46-2250-4511-ba59-f4ce67e0b45d')] {{(pid=75337) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 15:50:59 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bebbb46-2250-4511-ba59-f4ce67e0b45d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:50:59 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bebbb46-2250-4511-ba59-f4ce67e0b45d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:50:59 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2500289-5290-4182-a54e-a02401890f5b]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:50:59 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-245d911c-a021-43ac-9282-8eee89187d4f tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:50:59 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bebbb46-2250-4511-ba59-f4ce67e0b45d -p 172.16.0.220:3260 --logout {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:50:59 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bebbb46-2250-4511-ba59-f4ce67e0b45d -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:50:59 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cc46da7-5b0e-4273-9b1c-f04fb5b19b85]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:1bebbb46-2250-4511-ba59-f4ce67e0b45d, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:1bebbb46-2250-4511-ba59-f4ce67e0b45d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:50:59 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-245d911c-a021-43ac-9282-8eee89187d4f tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:1bebbb46-2250-4511-ba59-f4ce67e0b45d, portal: 172.16.0.220,3260]
Nov 06 15:50:59 user nova-compute[75337]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:1bebbb46-2250-4511-ba59-f4ce67e0b45d, portal: 172.16.0.220,3260] successful.
Nov 06 15:50:59 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:50:59 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bebbb46-2250-4511-ba59-f4ce67e0b45d -p 172.16.0.220:3260 --op delete {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:50:59 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bebbb46-2250-4511-ba59-f4ce67e0b45d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.049s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:50:59 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[2430b726-91c7-4039-8247-15a630ee3e5c]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:50:59 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-245d911c-a021-43ac-9282-8eee89187d4f tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:50:59 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-245d911c-a021-43ac-9282-8eee89187d4f tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.439s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 15:50:59 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-245d911c-a021-43ac-9282-8eee89187d4f tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] <== disconnect_volume: return (441ms) None {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 15:50:59 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-245d911c-a021-43ac-9282-8eee89187d4f tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Disconnected iSCSI Volume {{(pid=75337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 15:50:59 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-245d911c-a021-43ac-9282-8eee89187d4f tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Deleting instance files /opt/stack/data/nova/instances/fdda34b5-280f-489d-baf5-bf21ac6dd6c9_del
Nov 06 15:50:59 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-245d911c-a021-43ac-9282-8eee89187d4f tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Deletion of /opt/stack/data/nova/instances/fdda34b5-280f-489d-baf5-bf21ac6dd6c9_del complete
Nov 06 15:50:59 user nova-compute[75337]: INFO nova.compute.manager [None req-245d911c-a021-43ac-9282-8eee89187d4f tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Took 4.13 seconds to destroy the instance on the hypervisor.
Nov 06 15:50:59 user nova-compute[75337]: DEBUG oslo.service.loopingcall [None req-245d911c-a021-43ac-9282-8eee89187d4f tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75337) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 15:50:59 user nova-compute[75337]: DEBUG nova.compute.manager [-] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Deallocating network for instance {{(pid=75337) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 15:50:59 user nova-compute[75337]: DEBUG nova.network.neutron [-] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] deallocate_for_instance() {{(pid=75337) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 15:50:59 user nova-compute[75337]: DEBUG nova.network.neutron [req-8ccf1a6f-7eee-4136-a614-f89c248104c9 req-0e98ca55-dd2d-4d05-9013-7f804dd0009f service nova] [instance: 493eff79-294e-4259-a6d0-4772c4b45013] Updated VIF entry in instance network info cache for port 5e620284-83c1-40a8-91a5-c6b2c8c87a19. {{(pid=75337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 15:50:59 user nova-compute[75337]: DEBUG nova.network.neutron [req-8ccf1a6f-7eee-4136-a614-f89c248104c9 req-0e98ca55-dd2d-4d05-9013-7f804dd0009f service nova] [instance: 493eff79-294e-4259-a6d0-4772c4b45013] Updating instance_info_cache with network_info: [{"id": "5e620284-83c1-40a8-91a5-c6b2c8c87a19", "address": "fa:16:3e:09:f0:4b", "network": {"id": "4e47319f-de1d-4dfe-9915-7d2d5131704d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-895093240-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "915211c6a2734c36b34ff92a56b085f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e620284-83", "ovs_interfaceid": "5e620284-83c1-40a8-91a5-c6b2c8c87a19", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:50:59 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-8ccf1a6f-7eee-4136-a614-f89c248104c9 req-0e98ca55-dd2d-4d05-9013-7f804dd0009f service nova] Releasing lock "refresh_cache-493eff79-294e-4259-a6d0-4772c4b45013" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 15:51:02 user nova-compute[75337]: DEBUG nova.compute.manager [req-0fe6b25e-33c5-4995-aa9a-3579d087994f req-39dfdd54-b846-464a-88d0-8ef8760e573c service nova] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Received event network-vif-deleted-ee068b96-f361-4cb1-afeb-d3db42848f50 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:51:02 user nova-compute[75337]: INFO nova.compute.manager [req-0fe6b25e-33c5-4995-aa9a-3579d087994f req-39dfdd54-b846-464a-88d0-8ef8760e573c service nova] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Neutron deleted interface ee068b96-f361-4cb1-afeb-d3db42848f50; detaching it from the instance and deleting it from the info cache
Nov 06 15:51:02 user nova-compute[75337]: DEBUG nova.network.neutron [req-0fe6b25e-33c5-4995-aa9a-3579d087994f req-39dfdd54-b846-464a-88d0-8ef8760e573c service nova] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Updating instance_info_cache with network_info: [{"id": "7359ffbf-b953-480e-ae89-7ce5dda880a3", "address": "fa:16:3e:12:4b:11", "network": {"id": "e17a21e6-be31-4611-8f62-59327c8c4d9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1516543392", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7944be2b6e2047f5a633242809f6f04e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7359ffbf-b9", "ovs_interfaceid": "7359ffbf-b953-480e-ae89-7ce5dda880a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0184ea76-40a1-41f4-9a6f-e2ca6719b7ab", "address": "fa:16:3e:3b:f7:32", "network": {"id": "e17a21e6-be31-4611-8f62-59327c8c4d9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1516543392", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7944be2b6e2047f5a633242809f6f04e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0184ea76-40", "ovs_interfaceid": "0184ea76-40a1-41f4-9a6f-e2ca6719b7ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "38a409f9-0fb9-4505-9f74-bf2859e6f66c", "address": "fa:16:3e:8a:6f:5e", "network": {"id": "e17a21e6-be31-4611-8f62-59327c8c4d9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1516543392", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.115", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7944be2b6e2047f5a633242809f6f04e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38a409f9-0f", "ovs_interfaceid": "38a409f9-0fb9-4505-9f74-bf2859e6f66c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d86aca21-e67b-48e9-b8de-a1d618a5dfc7", "address": "fa:16:3e:bf:c2:bd", "network": {"id": "e17a21e6-be31-4611-8f62-59327c8c4d9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1516543392", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.131", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7944be2b6e2047f5a633242809f6f04e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd86aca21-e6", "ovs_interfaceid": "d86aca21-e67b-48e9-b8de-a1d618a5dfc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4c56104b-528f-40b8-931d-7619e413ab07", "address": "fa:16:3e:4d:d7:97", "network": {"id": "00ad9466-de22-4eb1-86c7-01667b94d2a9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1660110834", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7944be2b6e2047f5a633242809f6f04e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c56104b-52", "ovs_interfaceid": "4c56104b-528f-40b8-931d-7619e413ab07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "996e784d-bbe6-447b-8f1f-066ec34be989", "address": "fa:16:3e:41:c0:e2", "network": {"id": "00ad9466-de22-4eb1-86c7-01667b94d2a9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1660110834", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7944be2b6e2047f5a633242809f6f04e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap996e784d-bb", "ovs_interfaceid": "996e784d-bbe6-447b-8f1f-066ec34be989", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:51:02 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:51:02 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:51:02 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:51:02 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:51:02 user nova-compute[75337]: DEBUG nova.compute.manager [req-0fe6b25e-33c5-4995-aa9a-3579d087994f req-39dfdd54-b846-464a-88d0-8ef8760e573c service nova] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Detach interface failed, port_id=ee068b96-f361-4cb1-afeb-d3db42848f50, reason: Instance fdda34b5-280f-489d-baf5-bf21ac6dd6c9 could not be found. {{(pid=75337) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 06 15:51:03 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:51:03 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:51:03 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Starting heal instance info cache {{(pid=75337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 15:51:03 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Rebuilding the list of instances to heal {{(pid=75337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 06 15:51:03 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] [instance: 5badd355-5783-41b9-8f01-9fac9ff5d9d6] Skipping network cache update for instance because it is Building. {{(pid=75337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 06 15:51:03 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Skipping network cache update for instance because it is being deleted. {{(pid=75337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9939}}
Nov 06 15:51:03 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "refresh_cache-83516ff5-c4e7-4e91-a2f9-8af9b51cf475" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 15:51:03 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquired lock "refresh_cache-83516ff5-c4e7-4e91-a2f9-8af9b51cf475" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 15:51:03 user nova-compute[75337]: DEBUG nova.network.neutron [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] [instance: 83516ff5-c4e7-4e91-a2f9-8af9b51cf475] Forcefully refreshing network info cache for instance {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 15:51:03 user nova-compute[75337]: DEBUG nova.objects.instance [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lazy-loading 'info_cache' on Instance uuid 83516ff5-c4e7-4e91-a2f9-8af9b51cf475 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 15:51:03 user nova-compute[75337]: DEBUG nova.network.neutron [-] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Updating instance_info_cache with network_info: [] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:51:03 user nova-compute[75337]: INFO nova.compute.manager [-] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Took 4.45 seconds to deallocate network for instance.
Nov 06 15:51:04 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:51:04 user nova-compute[75337]: DEBUG nova.compute.manager [req-d561140e-85af-426c-af13-bd007291b894 req-f1d43985-5131-4f75-a4f7-bd126cf55c18 service nova] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Received event network-vif-deleted-38a409f9-0fb9-4505-9f74-bf2859e6f66c {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:51:04 user nova-compute[75337]: DEBUG nova.compute.manager [req-d561140e-85af-426c-af13-bd007291b894 req-f1d43985-5131-4f75-a4f7-bd126cf55c18 service nova] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Received event network-vif-deleted-996e784d-bbe6-447b-8f1f-066ec34be989 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:51:04 user nova-compute[75337]: DEBUG nova.compute.manager [req-d561140e-85af-426c-af13-bd007291b894 req-f1d43985-5131-4f75-a4f7-bd126cf55c18 service nova] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Received event network-vif-deleted-4c56104b-528f-40b8-931d-7619e413ab07 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:51:04 user nova-compute[75337]: DEBUG nova.compute.manager [req-d561140e-85af-426c-af13-bd007291b894 req-f1d43985-5131-4f75-a4f7-bd126cf55c18 service nova] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Received event network-vif-deleted-d86aca21-e67b-48e9-b8de-a1d618a5dfc7 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:51:04 user nova-compute[75337]: DEBUG nova.network.neutron [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] [instance: 83516ff5-c4e7-4e91-a2f9-8af9b51cf475] Updating instance_info_cache with network_info: [{"id": "452cb189-f59e-42e1-80e1-9eebb0c65bd7", "address": "fa:16:3e:f6:56:c4", "network": {"id": "736be000-ee94-41fd-9de0-f2f885ec9be7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1715443852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb76b5b0f2b24f1c84a92403176bcc00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap452cb189-f5", "ovs_interfaceid": "452cb189-f59e-42e1-80e1-9eebb0c65bd7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:51:04 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Releasing lock "refresh_cache-83516ff5-c4e7-4e91-a2f9-8af9b51cf475" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 15:51:04 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] [instance: 83516ff5-c4e7-4e91-a2f9-8af9b51cf475] Updated the network info_cache for instance {{(pid=75337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 15:51:04 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:51:04 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:51:04 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75337) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 15:51:05 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:51:05 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-fc4dd639-68e8-4d96-8ddd-da6be188b51b tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Acquiring lock "afa4e52b-af51-45bf-b619-aeca14e7724d" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:51:05 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-fc4dd639-68e8-4d96-8ddd-da6be188b51b tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Lock "afa4e52b-af51-45bf-b619-aeca14e7724d" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:51:05 user nova-compute[75337]: INFO nova.compute.manager [None req-fc4dd639-68e8-4d96-8ddd-da6be188b51b tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] [instance: afa4e52b-af51-45bf-b619-aeca14e7724d] Unshelving
Nov 06 15:51:05 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-fc4dd639-68e8-4d96-8ddd-da6be188b51b tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:51:05 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-fc4dd639-68e8-4d96-8ddd-da6be188b51b tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:51:05 user nova-compute[75337]: DEBUG nova.objects.instance [None req-fc4dd639-68e8-4d96-8ddd-da6be188b51b tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Lazy-loading 'pci_requests' on Instance uuid afa4e52b-af51-45bf-b619-aeca14e7724d {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 15:51:05 user nova-compute[75337]: DEBUG nova.objects.instance [None req-fc4dd639-68e8-4d96-8ddd-da6be188b51b tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Lazy-loading 'numa_topology' on Instance uuid afa4e52b-af51-45bf-b619-aeca14e7724d {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 15:51:05 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-fc4dd639-68e8-4d96-8ddd-da6be188b51b tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75337) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 15:51:05 user nova-compute[75337]: INFO nova.compute.claims [None req-fc4dd639-68e8-4d96-8ddd-da6be188b51b tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] [instance: afa4e52b-af51-45bf-b619-aeca14e7724d] Claim successful on node user
Nov 06 15:51:06 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-fc4dd639-68e8-4d96-8ddd-da6be188b51b tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 15:51:06 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-fc4dd639-68e8-4d96-8ddd-da6be188b51b tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 15:51:06 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-fc4dd639-68e8-4d96-8ddd-da6be188b51b tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.494s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:51:06 user nova-compute[75337]: INFO nova.network.neutron [None req-fc4dd639-68e8-4d96-8ddd-da6be188b51b tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] [instance: afa4e52b-af51-45bf-b619-aeca14e7724d] Updating port d66c8fee-7efa-49a4-b9c3-2f7ad2ccc71b with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 06 15:51:07 user nova-compute[75337]: INFO nova.compute.manager [None req-245d911c-a021-43ac-9282-8eee89187d4f tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] [instance: fdda34b5-280f-489d-baf5-bf21ac6dd6c9] Took 3.75 seconds to detach 3 volumes for instance.
Nov 06 15:51:07 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-fc4dd639-68e8-4d96-8ddd-da6be188b51b tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Acquiring lock "refresh_cache-afa4e52b-af51-45bf-b619-aeca14e7724d" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 15:51:07 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-fc4dd639-68e8-4d96-8ddd-da6be188b51b tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Acquired lock "refresh_cache-afa4e52b-af51-45bf-b619-aeca14e7724d" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 15:51:07 user nova-compute[75337]: DEBUG nova.network.neutron [None req-fc4dd639-68e8-4d96-8ddd-da6be188b51b tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] [instance: afa4e52b-af51-45bf-b619-aeca14e7724d] Building network info cache for instance {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 15:51:07 user nova-compute[75337]: DEBUG nova.compute.manager [req-89aeb3a5-e639-475a-a70f-1772bf347e71 req-8ec81194-d8b6-47d7-80c1-e9844e6eb506 service nova] [instance: afa4e52b-af51-45bf-b619-aeca14e7724d] Received event network-changed-d66c8fee-7efa-49a4-b9c3-2f7ad2ccc71b {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:51:07 user nova-compute[75337]: DEBUG nova.compute.manager [req-89aeb3a5-e639-475a-a70f-1772bf347e71 req-8ec81194-d8b6-47d7-80c1-e9844e6eb506 service nova] [instance: afa4e52b-af51-45bf-b619-aeca14e7724d] Refreshing instance network info cache due to event network-changed-d66c8fee-7efa-49a4-b9c3-2f7ad2ccc71b. {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 15:51:07 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-89aeb3a5-e639-475a-a70f-1772bf347e71 req-8ec81194-d8b6-47d7-80c1-e9844e6eb506 service nova] Acquiring lock "refresh_cache-afa4e52b-af51-45bf-b619-aeca14e7724d" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 15:51:07 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-245d911c-a021-43ac-9282-8eee89187d4f tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:51:07 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-245d911c-a021-43ac-9282-8eee89187d4f tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:51:08 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:51:08 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-245d911c-a021-43ac-9282-8eee89187d4f tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 15:51:08 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-245d911c-a021-43ac-9282-8eee89187d4f tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 15:51:08 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-245d911c-a021-43ac-9282-8eee89187d4f tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.432s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:51:08 user nova-compute[75337]: DEBUG nova.network.neutron [None req-fc4dd639-68e8-4d96-8ddd-da6be188b51b tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] [instance: afa4e52b-af51-45bf-b619-aeca14e7724d] Updating instance_info_cache with network_info: [{"id": "d66c8fee-7efa-49a4-b9c3-2f7ad2ccc71b", "address": "fa:16:3e:17:d2:52", "network": {"id": "f24470c2-ff6f-49fd-b28f-16b8a87ed3b4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-217486733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed09a1def6f0477796404d9bd3357dd0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd66c8fee-7e", "ovs_interfaceid": "d66c8fee-7efa-49a4-b9c3-2f7ad2ccc71b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:51:08 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-fc4dd639-68e8-4d96-8ddd-da6be188b51b tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Releasing lock "refresh_cache-afa4e52b-af51-45bf-b619-aeca14e7724d" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 15:51:08 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-fc4dd639-68e8-4d96-8ddd-da6be188b51b tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] [instance: afa4e52b-af51-45bf-b619-aeca14e7724d] Creating instance directory {{(pid=75337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 15:51:08 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-fc4dd639-68e8-4d96-8ddd-da6be188b51b tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] [instance: afa4e52b-af51-45bf-b619-aeca14e7724d] Creating image(s)
Nov 06 15:51:08 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-fc4dd639-68e8-4d96-8ddd-da6be188b51b tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Acquiring lock "/opt/stack/data/nova/instances/afa4e52b-af51-45bf-b619-aeca14e7724d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:51:08 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-fc4dd639-68e8-4d96-8ddd-da6be188b51b tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Lock "/opt/stack/data/nova/instances/afa4e52b-af51-45bf-b619-aeca14e7724d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:51:08 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-fc4dd639-68e8-4d96-8ddd-da6be188b51b tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Lock "/opt/stack/data/nova/instances/afa4e52b-af51-45bf-b619-aeca14e7724d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:51:08 user nova-compute[75337]: DEBUG nova.objects.instance [None req-fc4dd639-68e8-4d96-8ddd-da6be188b51b tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Lazy-loading 'trusted_certs' on Instance uuid afa4e52b-af51-45bf-b619-aeca14e7724d {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 15:51:08 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-89aeb3a5-e639-475a-a70f-1772bf347e71 req-8ec81194-d8b6-47d7-80c1-e9844e6eb506 service nova] Acquired lock "refresh_cache-afa4e52b-af51-45bf-b619-aeca14e7724d" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 15:51:08 user nova-compute[75337]: DEBUG nova.network.neutron [req-89aeb3a5-e639-475a-a70f-1772bf347e71 req-8ec81194-d8b6-47d7-80c1-e9844e6eb506 service nova] [instance: afa4e52b-af51-45bf-b619-aeca14e7724d] Refreshing network info cache for port d66c8fee-7efa-49a4-b9c3-2f7ad2ccc71b {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 15:51:08 user nova-compute[75337]: INFO nova.scheduler.client.report [None req-245d911c-a021-43ac-9282-8eee89187d4f tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Deleted allocations for instance fdda34b5-280f-489d-baf5-bf21ac6dd6c9
Nov 06 15:51:08 user nova-compute[75337]: DEBUG nova.objects.base [None req-fc4dd639-68e8-4d96-8ddd-da6be188b51b tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Object Instance<afa4e52b-af51-45bf-b619-aeca14e7724d> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=75337) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 15:51:08 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-fc4dd639-68e8-4d96-8ddd-da6be188b51b tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Acquiring lock "640cdf25fe58c72118b9874ee05aa950de4ad567" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:51:08 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-fc4dd639-68e8-4d96-8ddd-da6be188b51b tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Lock "640cdf25fe58c72118b9874ee05aa950de4ad567" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:51:09 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-fc4dd639-68e8-4d96-8ddd-da6be188b51b tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/640cdf25fe58c72118b9874ee05aa950de4ad567.part --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:51:09 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager.update_available_resource {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:51:09 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:51:09 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-245d911c-a021-43ac-9282-8eee89187d4f tempest-TaggedBootDevicesTest_v242-1041493160 tempest-TaggedBootDevicesTest_v242-1041493160-project-member] Lock "fdda34b5-280f-489d-baf5-bf21ac6dd6c9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 14.327s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:51:09 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:51:09 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:51:09 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:51:09 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Auditing locally available compute resources for user (node: user) {{(pid=75337) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 15:51:09 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-fc4dd639-68e8-4d96-8ddd-da6be188b51b tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/640cdf25fe58c72118b9874ee05aa950de4ad567.part --force-share --output=json" returned: 0 in 0.200s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:51:09 user nova-compute[75337]: DEBUG nova.virt.images [None req-fc4dd639-68e8-4d96-8ddd-da6be188b51b tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] 9698ec22-ead3-40b9-a865-d2f1b245d360 was qcow2, converting to raw {{(pid=75337) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 06 15:51:09 user nova-compute[75337]: DEBUG nova.privsep.utils [None req-fc4dd639-68e8-4d96-8ddd-da6be188b51b tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75337) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 06 15:51:09 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-fc4dd639-68e8-4d96-8ddd-da6be188b51b tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/640cdf25fe58c72118b9874ee05aa950de4ad567.part /opt/stack/data/nova/instances/_base/640cdf25fe58c72118b9874ee05aa950de4ad567.converted {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:51:10 user nova-compute[75337]: DEBUG nova.network.neutron [req-89aeb3a5-e639-475a-a70f-1772bf347e71 req-8ec81194-d8b6-47d7-80c1-e9844e6eb506 service nova] [instance: afa4e52b-af51-45bf-b619-aeca14e7724d] Updated VIF entry in instance network info cache for port d66c8fee-7efa-49a4-b9c3-2f7ad2ccc71b. {{(pid=75337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 15:51:10 user nova-compute[75337]: DEBUG nova.network.neutron [req-89aeb3a5-e639-475a-a70f-1772bf347e71 req-8ec81194-d8b6-47d7-80c1-e9844e6eb506 service nova] [instance: afa4e52b-af51-45bf-b619-aeca14e7724d] Updating instance_info_cache with network_info: [{"id": "d66c8fee-7efa-49a4-b9c3-2f7ad2ccc71b", "address": "fa:16:3e:17:d2:52", "network": {"id": "f24470c2-ff6f-49fd-b28f-16b8a87ed3b4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-217486733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed09a1def6f0477796404d9bd3357dd0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd66c8fee-7e", "ovs_interfaceid": "d66c8fee-7efa-49a4-b9c3-2f7ad2ccc71b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:51:10 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a293c354-d1e5-4c33-9e7b-d1558235aaf8/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:51:10 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-89aeb3a5-e639-475a-a70f-1772bf347e71 req-8ec81194-d8b6-47d7-80c1-e9844e6eb506 service nova] Releasing lock "refresh_cache-afa4e52b-af51-45bf-b619-aeca14e7724d" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 15:51:10 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a293c354-d1e5-4c33-9e7b-d1558235aaf8/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:51:10 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a293c354-d1e5-4c33-9e7b-d1558235aaf8/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:51:10 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-fc4dd639-68e8-4d96-8ddd-da6be188b51b tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/640cdf25fe58c72118b9874ee05aa950de4ad567.part /opt/stack/data/nova/instances/_base/640cdf25fe58c72118b9874ee05aa950de4ad567.converted" returned: 0 in 0.577s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:51:10 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-fc4dd639-68e8-4d96-8ddd-da6be188b51b tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/640cdf25fe58c72118b9874ee05aa950de4ad567.converted --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:51:10 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a293c354-d1e5-4c33-9e7b-d1558235aaf8/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:51:10 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7ececa5-256f-4a5d-aeda-3d2ee5c01cfe/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:51:10 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-fc4dd639-68e8-4d96-8ddd-da6be188b51b tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/640cdf25fe58c72118b9874ee05aa950de4ad567.converted --force-share --output=json" returned: 0 in 0.224s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:51:10 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-fc4dd639-68e8-4d96-8ddd-da6be188b51b tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Lock "640cdf25fe58c72118b9874ee05aa950de4ad567" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.350s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:51:10 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-fc4dd639-68e8-4d96-8ddd-da6be188b51b tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/640cdf25fe58c72118b9874ee05aa950de4ad567 --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:51:10 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7ececa5-256f-4a5d-aeda-3d2ee5c01cfe/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:51:10 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7ececa5-256f-4a5d-aeda-3d2ee5c01cfe/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:51:10 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-fc4dd639-68e8-4d96-8ddd-da6be188b51b tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/640cdf25fe58c72118b9874ee05aa950de4ad567 --force-share --output=json" returned: 0 in 0.207s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:51:10 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-fc4dd639-68e8-4d96-8ddd-da6be188b51b tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Acquiring lock "640cdf25fe58c72118b9874ee05aa950de4ad567" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:51:10 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-fc4dd639-68e8-4d96-8ddd-da6be188b51b tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Lock "640cdf25fe58c72118b9874ee05aa950de4ad567" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:51:10 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-fc4dd639-68e8-4d96-8ddd-da6be188b51b tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/640cdf25fe58c72118b9874ee05aa950de4ad567 --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:51:10 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7ececa5-256f-4a5d-aeda-3d2ee5c01cfe/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:51:10 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc0e07f8-2731-4ffa-8446-b71ad3ba7375/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:51:11 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-fc4dd639-68e8-4d96-8ddd-da6be188b51b tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/640cdf25fe58c72118b9874ee05aa950de4ad567 --force-share --output=json" returned: 0 in 0.191s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:51:11 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-fc4dd639-68e8-4d96-8ddd-da6be188b51b tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/640cdf25fe58c72118b9874ee05aa950de4ad567,backing_fmt=raw /opt/stack/data/nova/instances/afa4e52b-af51-45bf-b619-aeca14e7724d/disk 1073741824 {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:51:11 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc0e07f8-2731-4ffa-8446-b71ad3ba7375/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:51:11 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc0e07f8-2731-4ffa-8446-b71ad3ba7375/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:51:11 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-fc4dd639-68e8-4d96-8ddd-da6be188b51b tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/640cdf25fe58c72118b9874ee05aa950de4ad567,backing_fmt=raw /opt/stack/data/nova/instances/afa4e52b-af51-45bf-b619-aeca14e7724d/disk 1073741824" returned: 0 in 0.095s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:51:11 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-fc4dd639-68e8-4d96-8ddd-da6be188b51b tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Lock "640cdf25fe58c72118b9874ee05aa950de4ad567" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.296s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:51:11 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-fc4dd639-68e8-4d96-8ddd-da6be188b51b tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/640cdf25fe58c72118b9874ee05aa950de4ad567 --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:51:11 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc0e07f8-2731-4ffa-8446-b71ad3ba7375/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:51:11 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 15:51:11 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 15:51:11 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdced0ba-84ff-42af-baab-e2f3412e1676/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:51:11 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-fc4dd639-68e8-4d96-8ddd-da6be188b51b tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/640cdf25fe58c72118b9874ee05aa950de4ad567 --force-share --output=json" returned: 0 in 0.270s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:51:11 user nova-compute[75337]: DEBUG nova.objects.instance [None req-fc4dd639-68e8-4d96-8ddd-da6be188b51b tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Lazy-loading 'migration_context' on Instance uuid afa4e52b-af51-45bf-b619-aeca14e7724d {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 15:51:11 user nova-compute[75337]: DEBUG nova.objects.base [None req-fc4dd639-68e8-4d96-8ddd-da6be188b51b tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Object Instance<afa4e52b-af51-45bf-b619-aeca14e7724d> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=75337) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 15:51:11 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-fc4dd639-68e8-4d96-8ddd-da6be188b51b tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] [instance: afa4e52b-af51-45bf-b619-aeca14e7724d] Rebasing disk image.
Nov 06 15:51:11 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-fc4dd639-68e8-4d96-8ddd-da6be188b51b tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:51:11 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdced0ba-84ff-42af-baab-e2f3412e1676/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:51:11 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdced0ba-84ff-42af-baab-e2f3412e1676/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:51:11 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-fc4dd639-68e8-4d96-8ddd-da6be188b51b tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json" returned: 0 in 0.203s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:51:11 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-fc4dd639-68e8-4d96-8ddd-da6be188b51b tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 -F raw /opt/stack/data/nova/instances/afa4e52b-af51-45bf-b619-aeca14e7724d/disk {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:51:11 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdced0ba-84ff-42af-baab-e2f3412e1676/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:51:11 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83516ff5-c4e7-4e91-a2f9-8af9b51cf475/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:51:11 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83516ff5-c4e7-4e91-a2f9-8af9b51cf475/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:51:11 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83516ff5-c4e7-4e91-a2f9-8af9b51cf475/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:51:12 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83516ff5-c4e7-4e91-a2f9-8af9b51cf475/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:51:12 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 15:51:12 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 15:51:12 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 15:51:12 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Hypervisor/Node resource view: name=user free_ram=7883MB free_disk=25.00271987915039GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75337) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 15:51:12 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:51:12 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:51:13 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 83516ff5-c4e7-4e91-a2f9-8af9b51cf475 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:51:13 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 1fa4c927-7485-4f34-94bd-9e20358904b6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:51:13 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance cdced0ba-84ff-42af-baab-e2f3412e1676 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:51:13 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance bc0e07f8-2731-4ffa-8446-b71ad3ba7375 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:51:13 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance b7ececa5-256f-4a5d-aeda-3d2ee5c01cfe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:51:13 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 493eff79-294e-4259-a6d0-4772c4b45013 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:51:13 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 5badd355-5783-41b9-8f01-9fac9ff5d9d6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:51:13 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance a293c354-d1e5-4c33-9e7b-d1558235aaf8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:51:13 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] [instance: afa4e52b-af51-45bf-b619-aeca14e7724d] Instance with task_state "spawning" is not being actively managed by this compute host but has allocations referencing this compute node (4d91090a-92e5-4a8b-957b-2c8ad80bd8f7): {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. Skipping heal of allocations during the task state transition. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1777}}
Nov 06 15:51:13 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 15:51:13 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 15:51:13 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:51:13 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 15:51:13 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 15:51:13 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Compute_service record updated for user:user {{(pid=75337) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 15:51:13 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.772s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:51:13 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-053a18c4-1a80-45c5-aadc-ef3c0557d1d5 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Acquiring lock "cdced0ba-84ff-42af-baab-e2f3412e1676" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:51:13 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-053a18c4-1a80-45c5-aadc-ef3c0557d1d5 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Lock "cdced0ba-84ff-42af-baab-e2f3412e1676" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:51:13 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-053a18c4-1a80-45c5-aadc-ef3c0557d1d5 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Acquiring lock "cdced0ba-84ff-42af-baab-e2f3412e1676-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:51:13 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-053a18c4-1a80-45c5-aadc-ef3c0557d1d5 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Lock "cdced0ba-84ff-42af-baab-e2f3412e1676-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:51:13 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-053a18c4-1a80-45c5-aadc-ef3c0557d1d5 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Lock "cdced0ba-84ff-42af-baab-e2f3412e1676-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:51:13 user nova-compute[75337]: INFO nova.compute.manager [None req-053a18c4-1a80-45c5-aadc-ef3c0557d1d5 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] [instance: cdced0ba-84ff-42af-baab-e2f3412e1676] Terminating instance
Nov 06 15:51:13 user nova-compute[75337]: DEBUG nova.compute.manager [None req-053a18c4-1a80-45c5-aadc-ef3c0557d1d5 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] [instance: cdced0ba-84ff-42af-baab-e2f3412e1676] Start destroying the instance on the hypervisor. {{(pid=75337) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 15:51:13 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:51:13 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:51:13 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:51:14 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:51:14 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:51:14 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:51:14 user nova-compute[75337]: DEBUG nova.compute.manager [req-9d35c5b2-176f-43e1-bf77-ec5ce35707a6 req-bf739d61-c60d-4cf3-9fa5-85b2925a7930 service nova] [instance: cdced0ba-84ff-42af-baab-e2f3412e1676] Received event network-vif-unplugged-6439aebd-fede-4cad-857e-1c44587827ef {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:51:14 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-9d35c5b2-176f-43e1-bf77-ec5ce35707a6 req-bf739d61-c60d-4cf3-9fa5-85b2925a7930 service nova] Acquiring lock "cdced0ba-84ff-42af-baab-e2f3412e1676-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:51:14 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-9d35c5b2-176f-43e1-bf77-ec5ce35707a6 req-bf739d61-c60d-4cf3-9fa5-85b2925a7930 service nova] Lock "cdced0ba-84ff-42af-baab-e2f3412e1676-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:51:14 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-9d35c5b2-176f-43e1-bf77-ec5ce35707a6 req-bf739d61-c60d-4cf3-9fa5-85b2925a7930 service nova] Lock "cdced0ba-84ff-42af-baab-e2f3412e1676-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:51:14 user nova-compute[75337]: DEBUG nova.compute.manager [req-9d35c5b2-176f-43e1-bf77-ec5ce35707a6 req-bf739d61-c60d-4cf3-9fa5-85b2925a7930 service nova] [instance: cdced0ba-84ff-42af-baab-e2f3412e1676] No waiting events found dispatching network-vif-unplugged-6439aebd-fede-4cad-857e-1c44587827ef {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:51:14 user nova-compute[75337]: DEBUG nova.compute.manager [req-9d35c5b2-176f-43e1-bf77-ec5ce35707a6 req-bf739d61-c60d-4cf3-9fa5-85b2925a7930 service nova] [instance: cdced0ba-84ff-42af-baab-e2f3412e1676] Received event network-vif-unplugged-6439aebd-fede-4cad-857e-1c44587827ef for instance with task_state deleting. {{(pid=75337) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 15:51:14 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-fc4dd639-68e8-4d96-8ddd-da6be188b51b tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 -F raw /opt/stack/data/nova/instances/afa4e52b-af51-45bf-b619-aeca14e7724d/disk" returned: 0 in 2.861s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:51:14 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-fc4dd639-68e8-4d96-8ddd-da6be188b51b tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] [instance: afa4e52b-af51-45bf-b619-aeca14e7724d] Created local disks {{(pid=75337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 15:51:14 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-fc4dd639-68e8-4d96-8ddd-da6be188b51b tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] [instance: afa4e52b-af51-45bf-b619-aeca14e7724d] Ensure instance console log exists: /opt/stack/data/nova/instances/afa4e52b-af51-45bf-b619-aeca14e7724d/console.log {{(pid=75337) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 15:51:14 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-fc4dd639-68e8-4d96-8ddd-da6be188b51b tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:51:14 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-fc4dd639-68e8-4d96-8ddd-da6be188b51b tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:51:14 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-fc4dd639-68e8-4d96-8ddd-da6be188b51b tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:51:14 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-fc4dd639-68e8-4d96-8ddd-da6be188b51b tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] [instance: afa4e52b-af51-45bf-b619-aeca14e7724d] Start _get_guest_xml network_info=[{"id": "d66c8fee-7efa-49a4-b9c3-2f7ad2ccc71b", "address": "fa:16:3e:17:d2:52", "network": {"id": "f24470c2-ff6f-49fd-b28f-16b8a87ed3b4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-217486733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed09a1def6f0477796404d9bd3357dd0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd66c8fee-7e", "ovs_interfaceid": "d66c8fee-7efa-49a4-b9c3-2f7ad2ccc71b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='353350432074320a33ceeb77d9084aaa',container_format='bare',created_at=2023-11-06T15:49:12Z,direct_url=<?>,disk_format='qcow2',id=9698ec22-ead3-40b9-a865-d2f1b245d360,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-2034562466-shelved',owner='ed09a1def6f0477796404d9bd3357dd0',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-06T15:49:18Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'guest_format': None, 'size': 0, 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '16b903ae-a40f-41a7-985b-4804cce92c62'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 15:51:14 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-fc4dd639-68e8-4d96-8ddd-da6be188b51b tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 15:51:14 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-fc4dd639-68e8-4d96-8ddd-da6be188b51b tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 15:51:14 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-fc4dd639-68e8-4d96-8ddd-da6be188b51b tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 15:51:14 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-fc4dd639-68e8-4d96-8ddd-da6be188b51b tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] CPU controller missing on host. {{(pid=75337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 15:51:14 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-fc4dd639-68e8-4d96-8ddd-da6be188b51b tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 15:51:14 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-fc4dd639-68e8-4d96-8ddd-da6be188b51b tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] CPU controller found on host. {{(pid=75337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 15:51:14 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-fc4dd639-68e8-4d96-8ddd-da6be188b51b tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75337) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 15:51:14 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-fc4dd639-68e8-4d96-8ddd-da6be188b51b tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T15:34:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='353350432074320a33ceeb77d9084aaa',container_format='bare',created_at=2023-11-06T15:49:12Z,direct_url=<?>,disk_format='qcow2',id=9698ec22-ead3-40b9-a865-d2f1b245d360,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-2034562466-shelved',owner='ed09a1def6f0477796404d9bd3357dd0',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-06T15:49:18Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 15:51:14 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-fc4dd639-68e8-4d96-8ddd-da6be188b51b tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Flavor limits 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 15:51:14 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-fc4dd639-68e8-4d96-8ddd-da6be188b51b tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Image limits 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 15:51:14 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-fc4dd639-68e8-4d96-8ddd-da6be188b51b tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Flavor pref 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 15:51:14 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-fc4dd639-68e8-4d96-8ddd-da6be188b51b tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Image pref 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 15:51:14 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-fc4dd639-68e8-4d96-8ddd-da6be188b51b tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 15:51:14 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-fc4dd639-68e8-4d96-8ddd-da6be188b51b tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 15:51:14 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-fc4dd639-68e8-4d96-8ddd-da6be188b51b tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 15:51:14 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-fc4dd639-68e8-4d96-8ddd-da6be188b51b tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Got 1 possible topologies {{(pid=75337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 15:51:14 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-fc4dd639-68e8-4d96-8ddd-da6be188b51b tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 15:51:14 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-fc4dd639-68e8-4d96-8ddd-da6be188b51b tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 15:51:14 user nova-compute[75337]: DEBUG nova.objects.instance [None req-fc4dd639-68e8-4d96-8ddd-da6be188b51b tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Lazy-loading 'vcpu_model' on Instance uuid afa4e52b-af51-45bf-b619-aeca14e7724d {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 15:51:14 user nova-compute[75337]: DEBUG nova.objects.base [None req-fc4dd639-68e8-4d96-8ddd-da6be188b51b tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Object Instance<afa4e52b-af51-45bf-b619-aeca14e7724d> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=75337) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 15:51:14 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-fc4dd639-68e8-4d96-8ddd-da6be188b51b tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-06T15:46:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2034562466',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2034562466',id=19,image_ref='9698ec22-ead3-40b9-a865-d2f1b245d360',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-702382784',keypairs=<?>,launch_index=0,launched_at=2023-11-06T15:46:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='ed09a1def6f0477796404d9bd3357dd0',ramdisk_id='',reservation_id='r-1fkdfqnf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-417383725',owner_user_name='tempest-AttachVolumeShelveTestJSON-417383725-project-member',shelved_at='2023-11-06T15:49:18.739920',shelved_host='user',shelved_image_id='9698ec22-ead3-40b9-a865-d2f1b245d360'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T15:51:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9e1c021de4da40518ddc45a57ef79d6f',uuid=afa4e52b-af51-45bf-b619-aeca14e7724d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "d66c8fee-7efa-49a4-b9c3-2f7ad2ccc71b", "address": "fa:16:3e:17:d2:52", "network": {"id": "f24470c2-ff6f-49fd-b28f-16b8a87ed3b4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-217486733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed09a1def6f0477796404d9bd3357dd0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd66c8fee-7e", "ovs_interfaceid": "d66c8fee-7efa-49a4-b9c3-2f7ad2ccc71b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75337) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 15:51:14 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-fc4dd639-68e8-4d96-8ddd-da6be188b51b tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Converting VIF {"id": "d66c8fee-7efa-49a4-b9c3-2f7ad2ccc71b", "address": "fa:16:3e:17:d2:52", "network": {"id": "f24470c2-ff6f-49fd-b28f-16b8a87ed3b4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-217486733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed09a1def6f0477796404d9bd3357dd0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd66c8fee-7e", "ovs_interfaceid": "d66c8fee-7efa-49a4-b9c3-2f7ad2ccc71b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 15:51:14 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-fc4dd639-68e8-4d96-8ddd-da6be188b51b tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:d2:52,bridge_name='br-int',has_traffic_filtering=True,id=d66c8fee-7efa-49a4-b9c3-2f7ad2ccc71b,network=Network(f24470c2-ff6f-49fd-b28f-16b8a87ed3b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd66c8fee-7e') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 15:51:14 user nova-compute[75337]: DEBUG nova.objects.instance [None req-fc4dd639-68e8-4d96-8ddd-da6be188b51b tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Lazy-loading 'pci_devices' on Instance uuid afa4e52b-af51-45bf-b619-aeca14e7724d {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 15:51:14 user nova-compute[75337]: DEBUG nova.objects.base [None req-fc4dd639-68e8-4d96-8ddd-da6be188b51b tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Object Instance<afa4e52b-af51-45bf-b619-aeca14e7724d> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=75337) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 15:51:14 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-fc4dd639-68e8-4d96-8ddd-da6be188b51b tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] [instance: afa4e52b-af51-45bf-b619-aeca14e7724d] End _get_guest_xml xml=<domain type="kvm">
Nov 06 15:51:14 user nova-compute[75337]:   <uuid>afa4e52b-af51-45bf-b619-aeca14e7724d</uuid>
Nov 06 15:51:14 user nova-compute[75337]:   <name>instance-00000013</name>
Nov 06 15:51:14 user nova-compute[75337]:   <memory>524288</memory>
Nov 06 15:51:14 user nova-compute[75337]:   <vcpu>1</vcpu>
Nov 06 15:51:14 user nova-compute[75337]:   <metadata>
Nov 06 15:51:14 user nova-compute[75337]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 15:51:14 user nova-compute[75337]:       <nova:package version="0.0.0"/>
Nov 06 15:51:14 user nova-compute[75337]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-2034562466</nova:name>
Nov 06 15:51:14 user nova-compute[75337]:       <nova:creationTime>2023-11-06 15:51:14</nova:creationTime>
Nov 06 15:51:14 user nova-compute[75337]:       <nova:flavor name="m1.tiny">
Nov 06 15:51:14 user nova-compute[75337]:         <nova:memory>512</nova:memory>
Nov 06 15:51:14 user nova-compute[75337]:         <nova:disk>1</nova:disk>
Nov 06 15:51:14 user nova-compute[75337]:         <nova:swap>0</nova:swap>
Nov 06 15:51:14 user nova-compute[75337]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 15:51:14 user nova-compute[75337]:         <nova:vcpus>1</nova:vcpus>
Nov 06 15:51:14 user nova-compute[75337]:       </nova:flavor>
Nov 06 15:51:14 user nova-compute[75337]:       <nova:owner>
Nov 06 15:51:14 user nova-compute[75337]:         <nova:user uuid="9e1c021de4da40518ddc45a57ef79d6f">tempest-AttachVolumeShelveTestJSON-417383725-project-member</nova:user>
Nov 06 15:51:14 user nova-compute[75337]:         <nova:project uuid="ed09a1def6f0477796404d9bd3357dd0">tempest-AttachVolumeShelveTestJSON-417383725</nova:project>
Nov 06 15:51:14 user nova-compute[75337]:       </nova:owner>
Nov 06 15:51:14 user nova-compute[75337]:       <nova:root type="image" uuid="9698ec22-ead3-40b9-a865-d2f1b245d360"/>
Nov 06 15:51:14 user nova-compute[75337]:       <nova:ports>
Nov 06 15:51:14 user nova-compute[75337]:         <nova:port uuid="d66c8fee-7efa-49a4-b9c3-2f7ad2ccc71b">
Nov 06 15:51:14 user nova-compute[75337]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 06 15:51:14 user nova-compute[75337]:         </nova:port>
Nov 06 15:51:14 user nova-compute[75337]:       </nova:ports>
Nov 06 15:51:14 user nova-compute[75337]:     </nova:instance>
Nov 06 15:51:14 user nova-compute[75337]:   </metadata>
Nov 06 15:51:14 user nova-compute[75337]:   <sysinfo type="smbios">
Nov 06 15:51:14 user nova-compute[75337]:     <system>
Nov 06 15:51:14 user nova-compute[75337]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 15:51:14 user nova-compute[75337]:       <entry name="product">OpenStack Nova</entry>
Nov 06 15:51:14 user nova-compute[75337]:       <entry name="version">0.0.0</entry>
Nov 06 15:51:14 user nova-compute[75337]:       <entry name="serial">afa4e52b-af51-45bf-b619-aeca14e7724d</entry>
Nov 06 15:51:14 user nova-compute[75337]:       <entry name="uuid">afa4e52b-af51-45bf-b619-aeca14e7724d</entry>
Nov 06 15:51:14 user nova-compute[75337]:       <entry name="family">Virtual Machine</entry>
Nov 06 15:51:14 user nova-compute[75337]:     </system>
Nov 06 15:51:14 user nova-compute[75337]:   </sysinfo>
Nov 06 15:51:14 user nova-compute[75337]:   <os>
Nov 06 15:51:14 user nova-compute[75337]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 15:51:14 user nova-compute[75337]:     <boot dev="hd"/>
Nov 06 15:51:14 user nova-compute[75337]:     <smbios mode="sysinfo"/>
Nov 06 15:51:14 user nova-compute[75337]:   </os>
Nov 06 15:51:14 user nova-compute[75337]:   <features>
Nov 06 15:51:14 user nova-compute[75337]:     <acpi/>
Nov 06 15:51:14 user nova-compute[75337]:     <apic/>
Nov 06 15:51:14 user nova-compute[75337]:     <vmcoreinfo/>
Nov 06 15:51:14 user nova-compute[75337]:   </features>
Nov 06 15:51:14 user nova-compute[75337]:   <clock offset="utc">
Nov 06 15:51:14 user nova-compute[75337]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 15:51:14 user nova-compute[75337]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 15:51:14 user nova-compute[75337]:     <timer name="hpet" present="no"/>
Nov 06 15:51:14 user nova-compute[75337]:   </clock>
Nov 06 15:51:14 user nova-compute[75337]:   <cpu mode="custom" match="exact">
Nov 06 15:51:14 user nova-compute[75337]:     <model>Nehalem</model>
Nov 06 15:51:14 user nova-compute[75337]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 15:51:14 user nova-compute[75337]:   </cpu>
Nov 06 15:51:14 user nova-compute[75337]:   <devices>
Nov 06 15:51:14 user nova-compute[75337]:     <disk type="file" device="disk">
Nov 06 15:51:14 user nova-compute[75337]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 15:51:14 user nova-compute[75337]:       <source file="/opt/stack/data/nova/instances/afa4e52b-af51-45bf-b619-aeca14e7724d/disk"/>
Nov 06 15:51:14 user nova-compute[75337]:       <target dev="vda" bus="virtio"/>
Nov 06 15:51:14 user nova-compute[75337]:     </disk>
Nov 06 15:51:14 user nova-compute[75337]:     <interface type="ethernet">
Nov 06 15:51:14 user nova-compute[75337]:       <mac address="fa:16:3e:17:d2:52"/>
Nov 06 15:51:14 user nova-compute[75337]:       <model type="virtio"/>
Nov 06 15:51:14 user nova-compute[75337]:       <mtu size="1442"/>
Nov 06 15:51:14 user nova-compute[75337]:       <target dev="tapd66c8fee-7e"/>
Nov 06 15:51:14 user nova-compute[75337]:     </interface>
Nov 06 15:51:14 user nova-compute[75337]:     <serial type="pty">
Nov 06 15:51:14 user nova-compute[75337]:       <log file="/opt/stack/data/nova/instances/afa4e52b-af51-45bf-b619-aeca14e7724d/console.log" append="off"/>
Nov 06 15:51:14 user nova-compute[75337]:     </serial>
Nov 06 15:51:14 user nova-compute[75337]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 15:51:14 user nova-compute[75337]:     <video>
Nov 06 15:51:14 user nova-compute[75337]:       <model type="virtio"/>
Nov 06 15:51:14 user nova-compute[75337]:     </video>
Nov 06 15:51:14 user nova-compute[75337]:     <rng model="virtio">
Nov 06 15:51:14 user nova-compute[75337]:       <backend model="random">/dev/urandom</backend>
Nov 06 15:51:14 user nova-compute[75337]:     </rng>
Nov 06 15:51:14 user nova-compute[75337]:     <controller type="usb" index="0" model="none"/>
Nov 06 15:51:14 user nova-compute[75337]:     <memballoon model="virtio">
Nov 06 15:51:14 user nova-compute[75337]:       <stats period="10"/>
Nov 06 15:51:14 user nova-compute[75337]:     </memballoon>
Nov 06 15:51:14 user nova-compute[75337]:   </devices>
Nov 06 15:51:14 user nova-compute[75337]: </domain>
Nov 06 15:51:14 user nova-compute[75337]:  {{(pid=75337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 15:51:14 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-fc4dd639-68e8-4d96-8ddd-da6be188b51b tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-06T15:46:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2034562466',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2034562466',id=19,image_ref='9698ec22-ead3-40b9-a865-d2f1b245d360',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-702382784',keypairs=<?>,launch_index=0,launched_at=2023-11-06T15:46:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='ed09a1def6f0477796404d9bd3357dd0',ramdisk_id='',reservation_id='r-1fkdfqnf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-417383725',owner_user_name='tempest-AttachVolumeShelveTestJSON-417383725-project-member',shelved_at='2023-11-06T15:49:18.739920',shelved_host='user',shelved_image_id='9698ec22-ead3-40b9-a865-d2f1b245d360'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T15:51:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9e1c021de4da40518ddc45a57ef79d6f',uuid=afa4e52b-af51-45bf-b619-aeca14e7724d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "d66c8fee-7efa-49a4-b9c3-2f7ad2ccc71b", "address": "fa:16:3e:17:d2:52", "network": {"id": "f24470c2-ff6f-49fd-b28f-16b8a87ed3b4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-217486733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed09a1def6f0477796404d9bd3357dd0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd66c8fee-7e", "ovs_interfaceid": "d66c8fee-7efa-49a4-b9c3-2f7ad2ccc71b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 15:51:14 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-fc4dd639-68e8-4d96-8ddd-da6be188b51b tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Converting VIF {"id": "d66c8fee-7efa-49a4-b9c3-2f7ad2ccc71b", "address": "fa:16:3e:17:d2:52", "network": {"id": "f24470c2-ff6f-49fd-b28f-16b8a87ed3b4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-217486733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed09a1def6f0477796404d9bd3357dd0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd66c8fee-7e", "ovs_interfaceid": "d66c8fee-7efa-49a4-b9c3-2f7ad2ccc71b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 15:51:14 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-fc4dd639-68e8-4d96-8ddd-da6be188b51b tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:d2:52,bridge_name='br-int',has_traffic_filtering=True,id=d66c8fee-7efa-49a4-b9c3-2f7ad2ccc71b,network=Network(f24470c2-ff6f-49fd-b28f-16b8a87ed3b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd66c8fee-7e') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 15:51:14 user nova-compute[75337]: DEBUG os_vif [None req-fc4dd639-68e8-4d96-8ddd-da6be188b51b tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:d2:52,bridge_name='br-int',has_traffic_filtering=True,id=d66c8fee-7efa-49a4-b9c3-2f7ad2ccc71b,network=Network(f24470c2-ff6f-49fd-b28f-16b8a87ed3b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd66c8fee-7e') {{(pid=75337) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 15:51:14 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:51:14 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:51:14 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 15:51:14 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:51:14 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '88416cc1-9cac-5576-9cd1-5cd978a0507a', '_type': 'linux-noop'}}, row=False) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:51:14 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:51:14 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:51:14 user nova-compute[75337]: INFO nova.virt.libvirt.driver [-] [instance: cdced0ba-84ff-42af-baab-e2f3412e1676] Instance destroyed successfully.
Nov 06 15:51:14 user nova-compute[75337]: DEBUG nova.objects.instance [None req-053a18c4-1a80-45c5-aadc-ef3c0557d1d5 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Lazy-loading 'resources' on Instance uuid cdced0ba-84ff-42af-baab-e2f3412e1676 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 15:51:14 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:51:14 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-053a18c4-1a80-45c5-aadc-ef3c0557d1d5 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T15:44:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1066788308',display_name='tempest-VolumesAdminNegativeTest-server-1066788308',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1066788308',id=13,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBDvvG1rHj+FOCmF08QnUesYCpiMZYDGXPXH349ApsTwWwh8LFnarOxbvyKb7CAA1JSmXU7OR9l9zSxwXCbNuJ82oNnDWulS1R+NOTAKmnuR4ldeBiBiQouy9eWYkTJp8w==',key_name='tempest-keypair-1863701025',keypairs=<?>,launch_index=0,launched_at=2023-11-06T15:44:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f2de62cc51864374a29a5d96584e8dd1',ramdisk_id='',reservation_id='r-15cwq3e9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1559219265',owner_user_name='tempest-VolumesAdminNegativeTest-1559219265-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T15:44:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='38d79821f1a8466fa7c925fcc0bfb778',uuid=cdced0ba-84ff-42af-baab-e2f3412e1676,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6439aebd-fede-4cad-857e-1c44587827ef", "address": "fa:16:3e:cf:ac:79", "network": {"id": "c07dbf10-d5b5-40f4-b841-826ca6f505d8", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1886147547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2de62cc51864374a29a5d96584e8dd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6439aebd-fe", "ovs_interfaceid": "6439aebd-fede-4cad-857e-1c44587827ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 15:51:14 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-053a18c4-1a80-45c5-aadc-ef3c0557d1d5 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Converting VIF {"id": "6439aebd-fede-4cad-857e-1c44587827ef", "address": "fa:16:3e:cf:ac:79", "network": {"id": "c07dbf10-d5b5-40f4-b841-826ca6f505d8", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1886147547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2de62cc51864374a29a5d96584e8dd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6439aebd-fe", "ovs_interfaceid": "6439aebd-fede-4cad-857e-1c44587827ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 15:51:14 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-053a18c4-1a80-45c5-aadc-ef3c0557d1d5 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cf:ac:79,bridge_name='br-int',has_traffic_filtering=True,id=6439aebd-fede-4cad-857e-1c44587827ef,network=Network(c07dbf10-d5b5-40f4-b841-826ca6f505d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6439aebd-fe') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 15:51:14 user nova-compute[75337]: DEBUG os_vif [None req-053a18c4-1a80-45c5-aadc-ef3c0557d1d5 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cf:ac:79,bridge_name='br-int',has_traffic_filtering=True,id=6439aebd-fede-4cad-857e-1c44587827ef,network=Network(c07dbf10-d5b5-40f4-b841-826ca6f505d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6439aebd-fe') {{(pid=75337) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 15:51:14 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:51:14 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6439aebd-fe, bridge=br-int, if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:51:14 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:51:14 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:51:14 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:51:14 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd66c8fee-7e, may_exist=True, interface_attrs={}) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:51:14 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd66c8fee-7e, col_values=(('qos', UUID('b7a9dda9-b5d4-4f73-b2bb-0851a5b38838')),), if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:51:14 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd66c8fee-7e, col_values=(('external_ids', {'iface-id': 'd66c8fee-7efa-49a4-b9c3-2f7ad2ccc71b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:17:d2:52', 'vm-uuid': 'afa4e52b-af51-45bf-b619-aeca14e7724d'}),), if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:51:14 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:51:14 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:51:14 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:51:14 user nova-compute[75337]: INFO os_vif [None req-fc4dd639-68e8-4d96-8ddd-da6be188b51b tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:d2:52,bridge_name='br-int',has_traffic_filtering=True,id=d66c8fee-7efa-49a4-b9c3-2f7ad2ccc71b,network=Network(f24470c2-ff6f-49fd-b28f-16b8a87ed3b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd66c8fee-7e')
Nov 06 15:51:14 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:51:14 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ff865a4e-faa4-4a94-990f-b8b352527c0b) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:51:14 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:51:14 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:51:14 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:51:14 user nova-compute[75337]: INFO os_vif [None req-053a18c4-1a80-45c5-aadc-ef3c0557d1d5 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cf:ac:79,bridge_name='br-int',has_traffic_filtering=True,id=6439aebd-fede-4cad-857e-1c44587827ef,network=Network(c07dbf10-d5b5-40f4-b841-826ca6f505d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6439aebd-fe')
Nov 06 15:51:14 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-053a18c4-1a80-45c5-aadc-ef3c0557d1d5 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] [instance: cdced0ba-84ff-42af-baab-e2f3412e1676] Deleting instance files /opt/stack/data/nova/instances/cdced0ba-84ff-42af-baab-e2f3412e1676_del
Nov 06 15:51:14 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-053a18c4-1a80-45c5-aadc-ef3c0557d1d5 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] [instance: cdced0ba-84ff-42af-baab-e2f3412e1676] Deletion of /opt/stack/data/nova/instances/cdced0ba-84ff-42af-baab-e2f3412e1676_del complete
Nov 06 15:51:14 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-fc4dd639-68e8-4d96-8ddd-da6be188b51b tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] No BDM found with device name vda, not building metadata. {{(pid=75337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 15:51:14 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-fc4dd639-68e8-4d96-8ddd-da6be188b51b tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] No VIF found with MAC fa:16:3e:17:d2:52, not building metadata {{(pid=75337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 15:51:14 user nova-compute[75337]: INFO nova.compute.manager [None req-053a18c4-1a80-45c5-aadc-ef3c0557d1d5 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] [instance: cdced0ba-84ff-42af-baab-e2f3412e1676] Took 1.06 seconds to destroy the instance on the hypervisor.
Nov 06 15:51:14 user nova-compute[75337]: DEBUG oslo.service.loopingcall [None req-053a18c4-1a80-45c5-aadc-ef3c0557d1d5 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75337) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 15:51:14 user nova-compute[75337]: DEBUG nova.compute.manager [-] [instance: cdced0ba-84ff-42af-baab-e2f3412e1676] Deallocating network for instance {{(pid=75337) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 15:51:14 user nova-compute[75337]: DEBUG nova.network.neutron [-] [instance: cdced0ba-84ff-42af-baab-e2f3412e1676] deallocate_for_instance() {{(pid=75337) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 15:51:16 user nova-compute[75337]: DEBUG nova.network.neutron [-] [instance: cdced0ba-84ff-42af-baab-e2f3412e1676] Updating instance_info_cache with network_info: [] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:51:16 user nova-compute[75337]: INFO nova.compute.manager [-] [instance: cdced0ba-84ff-42af-baab-e2f3412e1676] Took 1.21 seconds to deallocate network for instance.
Nov 06 15:51:16 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-053a18c4-1a80-45c5-aadc-ef3c0557d1d5 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:51:16 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-053a18c4-1a80-45c5-aadc-ef3c0557d1d5 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:51:16 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:51:16 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:51:16 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:51:16 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:51:16 user nova-compute[75337]: DEBUG nova.compute.manager [req-0f2b5032-6feb-4fb8-a1d0-1b70aa61e012 req-6417aab9-9257-4f88-ab29-c61ed68962cc service nova] [instance: cdced0ba-84ff-42af-baab-e2f3412e1676] Received event network-vif-plugged-6439aebd-fede-4cad-857e-1c44587827ef {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:51:16 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-0f2b5032-6feb-4fb8-a1d0-1b70aa61e012 req-6417aab9-9257-4f88-ab29-c61ed68962cc service nova] Acquiring lock "cdced0ba-84ff-42af-baab-e2f3412e1676-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:51:16 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-0f2b5032-6feb-4fb8-a1d0-1b70aa61e012 req-6417aab9-9257-4f88-ab29-c61ed68962cc service nova] Lock "cdced0ba-84ff-42af-baab-e2f3412e1676-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:51:16 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-0f2b5032-6feb-4fb8-a1d0-1b70aa61e012 req-6417aab9-9257-4f88-ab29-c61ed68962cc service nova] Lock "cdced0ba-84ff-42af-baab-e2f3412e1676-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:51:16 user nova-compute[75337]: DEBUG nova.compute.manager [req-0f2b5032-6feb-4fb8-a1d0-1b70aa61e012 req-6417aab9-9257-4f88-ab29-c61ed68962cc service nova] [instance: cdced0ba-84ff-42af-baab-e2f3412e1676] No waiting events found dispatching network-vif-plugged-6439aebd-fede-4cad-857e-1c44587827ef {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:51:16 user nova-compute[75337]: WARNING nova.compute.manager [req-0f2b5032-6feb-4fb8-a1d0-1b70aa61e012 req-6417aab9-9257-4f88-ab29-c61ed68962cc service nova] [instance: cdced0ba-84ff-42af-baab-e2f3412e1676] Received unexpected event network-vif-plugged-6439aebd-fede-4cad-857e-1c44587827ef for instance with vm_state deleted and task_state None.
Nov 06 15:51:16 user nova-compute[75337]: DEBUG nova.compute.manager [req-0f2b5032-6feb-4fb8-a1d0-1b70aa61e012 req-6417aab9-9257-4f88-ab29-c61ed68962cc service nova] [instance: cdced0ba-84ff-42af-baab-e2f3412e1676] Received event network-vif-deleted-6439aebd-fede-4cad-857e-1c44587827ef {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:51:16 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-053a18c4-1a80-45c5-aadc-ef3c0557d1d5 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 15:51:16 user nova-compute[75337]: DEBUG nova.compute.manager [req-e1bf1201-40f3-4d37-b6e4-ead4744a84b8 req-5697eb17-889b-4303-9849-64f383b58508 service nova] [instance: afa4e52b-af51-45bf-b619-aeca14e7724d] Received event network-vif-plugged-d66c8fee-7efa-49a4-b9c3-2f7ad2ccc71b {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:51:16 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-e1bf1201-40f3-4d37-b6e4-ead4744a84b8 req-5697eb17-889b-4303-9849-64f383b58508 service nova] Acquiring lock "afa4e52b-af51-45bf-b619-aeca14e7724d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:51:16 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-e1bf1201-40f3-4d37-b6e4-ead4744a84b8 req-5697eb17-889b-4303-9849-64f383b58508 service nova] Lock "afa4e52b-af51-45bf-b619-aeca14e7724d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:51:16 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-e1bf1201-40f3-4d37-b6e4-ead4744a84b8 req-5697eb17-889b-4303-9849-64f383b58508 service nova] Lock "afa4e52b-af51-45bf-b619-aeca14e7724d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:51:16 user nova-compute[75337]: DEBUG nova.compute.manager [req-e1bf1201-40f3-4d37-b6e4-ead4744a84b8 req-5697eb17-889b-4303-9849-64f383b58508 service nova] [instance: afa4e52b-af51-45bf-b619-aeca14e7724d] No waiting events found dispatching network-vif-plugged-d66c8fee-7efa-49a4-b9c3-2f7ad2ccc71b {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:51:16 user nova-compute[75337]: WARNING nova.compute.manager [req-e1bf1201-40f3-4d37-b6e4-ead4744a84b8 req-5697eb17-889b-4303-9849-64f383b58508 service nova] [instance: afa4e52b-af51-45bf-b619-aeca14e7724d] Received unexpected event network-vif-plugged-d66c8fee-7efa-49a4-b9c3-2f7ad2ccc71b for instance with vm_state shelved_offloaded and task_state spawning.
Nov 06 15:51:16 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-053a18c4-1a80-45c5-aadc-ef3c0557d1d5 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 15:51:16 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-053a18c4-1a80-45c5-aadc-ef3c0557d1d5 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.493s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:51:16 user nova-compute[75337]: INFO nova.scheduler.client.report [None req-053a18c4-1a80-45c5-aadc-ef3c0557d1d5 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Deleted allocations for instance cdced0ba-84ff-42af-baab-e2f3412e1676
Nov 06 15:51:16 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-053a18c4-1a80-45c5-aadc-ef3c0557d1d5 tempest-VolumesAdminNegativeTest-1559219265 tempest-VolumesAdminNegativeTest-1559219265-project-member] Lock "cdced0ba-84ff-42af-baab-e2f3412e1676" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.058s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:51:16 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-0e4ad819-a62e-4b45-bac0-b8d5d7278f5c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Acquiring lock "582702ee-b8f8-49e4-9853-68af15420702" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:51:16 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-0e4ad819-a62e-4b45-bac0-b8d5d7278f5c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Lock "582702ee-b8f8-49e4-9853-68af15420702" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:51:16 user nova-compute[75337]: DEBUG nova.compute.manager [None req-0e4ad819-a62e-4b45-bac0-b8d5d7278f5c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 582702ee-b8f8-49e4-9853-68af15420702] Starting instance... {{(pid=75337) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 15:51:17 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-0e4ad819-a62e-4b45-bac0-b8d5d7278f5c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:51:17 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-0e4ad819-a62e-4b45-bac0-b8d5d7278f5c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:51:17 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-0e4ad819-a62e-4b45-bac0-b8d5d7278f5c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75337) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 15:51:17 user nova-compute[75337]: INFO nova.compute.claims [None req-0e4ad819-a62e-4b45-bac0-b8d5d7278f5c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 582702ee-b8f8-49e4-9853-68af15420702] Claim successful on node user
Nov 06 15:51:17 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:51:17 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:51:17 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:51:17 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-0e4ad819-a62e-4b45-bac0-b8d5d7278f5c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 15:51:17 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-0e4ad819-a62e-4b45-bac0-b8d5d7278f5c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 15:51:17 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-0e4ad819-a62e-4b45-bac0-b8d5d7278f5c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.502s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:51:17 user nova-compute[75337]: DEBUG nova.compute.manager [None req-0e4ad819-a62e-4b45-bac0-b8d5d7278f5c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 582702ee-b8f8-49e4-9853-68af15420702] Start building networks asynchronously for instance. {{(pid=75337) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 15:51:17 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-0e4ad819-a62e-4b45-bac0-b8d5d7278f5c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 582702ee-b8f8-49e4-9853-68af15420702] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 15:51:17 user nova-compute[75337]: DEBUG nova.compute.manager [None req-0e4ad819-a62e-4b45-bac0-b8d5d7278f5c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 582702ee-b8f8-49e4-9853-68af15420702] Allocating IP information in the background. {{(pid=75337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 15:51:17 user nova-compute[75337]: DEBUG nova.network.neutron [None req-0e4ad819-a62e-4b45-bac0-b8d5d7278f5c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 582702ee-b8f8-49e4-9853-68af15420702] allocate_for_instance() {{(pid=75337) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 15:51:17 user nova-compute[75337]: DEBUG nova.compute.manager [None req-0e4ad819-a62e-4b45-bac0-b8d5d7278f5c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 582702ee-b8f8-49e4-9853-68af15420702] Start building block device mappings for instance. {{(pid=75337) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 15:51:17 user nova-compute[75337]: INFO nova.virt.block_device [None req-0e4ad819-a62e-4b45-bac0-b8d5d7278f5c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 582702ee-b8f8-49e4-9853-68af15420702] Booting with volume snapshot 908bab91-1b48-4eca-8a47-fb353e601ed5 at /dev/vda
Nov 06 15:51:17 user nova-compute[75337]: DEBUG nova.policy [None req-0e4ad819-a62e-4b45-bac0-b8d5d7278f5c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bb8d5f0200124588be1cfde107341a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915211c6a2734c36b34ff92a56b085f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75337) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 15:51:18 user nova-compute[75337]: DEBUG nova.network.neutron [None req-0e4ad819-a62e-4b45-bac0-b8d5d7278f5c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 582702ee-b8f8-49e4-9853-68af15420702] Successfully created port: bb02742a-5f8a-4501-95e6-dddfef111f50 {{(pid=75337) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 15:51:18 user nova-compute[75337]: DEBUG nova.compute.manager [req-459e1e76-554f-4811-87fa-b9c8deb24029 req-a18eb3bd-e819-42f9-acb8-6864f993d976 service nova] [instance: afa4e52b-af51-45bf-b619-aeca14e7724d] Received event network-vif-plugged-d66c8fee-7efa-49a4-b9c3-2f7ad2ccc71b {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:51:18 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-459e1e76-554f-4811-87fa-b9c8deb24029 req-a18eb3bd-e819-42f9-acb8-6864f993d976 service nova] Acquiring lock "afa4e52b-af51-45bf-b619-aeca14e7724d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:51:18 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-459e1e76-554f-4811-87fa-b9c8deb24029 req-a18eb3bd-e819-42f9-acb8-6864f993d976 service nova] Lock "afa4e52b-af51-45bf-b619-aeca14e7724d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:51:18 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-459e1e76-554f-4811-87fa-b9c8deb24029 req-a18eb3bd-e819-42f9-acb8-6864f993d976 service nova] Lock "afa4e52b-af51-45bf-b619-aeca14e7724d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:51:18 user nova-compute[75337]: DEBUG nova.compute.manager [req-459e1e76-554f-4811-87fa-b9c8deb24029 req-a18eb3bd-e819-42f9-acb8-6864f993d976 service nova] [instance: afa4e52b-af51-45bf-b619-aeca14e7724d] No waiting events found dispatching network-vif-plugged-d66c8fee-7efa-49a4-b9c3-2f7ad2ccc71b {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:51:18 user nova-compute[75337]: WARNING nova.compute.manager [req-459e1e76-554f-4811-87fa-b9c8deb24029 req-a18eb3bd-e819-42f9-acb8-6864f993d976 service nova] [instance: afa4e52b-af51-45bf-b619-aeca14e7724d] Received unexpected event network-vif-plugged-d66c8fee-7efa-49a4-b9c3-2f7ad2ccc71b for instance with vm_state shelved_offloaded and task_state spawning.
Nov 06 15:51:18 user nova-compute[75337]: DEBUG nova.compute.manager [None req-fc4dd639-68e8-4d96-8ddd-da6be188b51b tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] [instance: afa4e52b-af51-45bf-b619-aeca14e7724d] Instance event wait completed in 0 seconds for  {{(pid=75337) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 15:51:18 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-fc4dd639-68e8-4d96-8ddd-da6be188b51b tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] [instance: afa4e52b-af51-45bf-b619-aeca14e7724d] Guest created on hypervisor {{(pid=75337) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 15:51:18 user nova-compute[75337]: INFO nova.virt.libvirt.driver [-] [instance: afa4e52b-af51-45bf-b619-aeca14e7724d] Instance spawned successfully.
Nov 06 15:51:19 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:51:19 user nova-compute[75337]: DEBUG nova.compute.manager [None req-fc4dd639-68e8-4d96-8ddd-da6be188b51b tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] [instance: afa4e52b-af51-45bf-b619-aeca14e7724d] Checking state {{(pid=75337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 15:51:19 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-fc4dd639-68e8-4d96-8ddd-da6be188b51b tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Lock "afa4e52b-af51-45bf-b619-aeca14e7724d" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 13.801s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:51:19 user nova-compute[75337]: DEBUG nova.network.neutron [None req-0e4ad819-a62e-4b45-bac0-b8d5d7278f5c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 582702ee-b8f8-49e4-9853-68af15420702] Successfully updated port: bb02742a-5f8a-4501-95e6-dddfef111f50 {{(pid=75337) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 15:51:19 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-0e4ad819-a62e-4b45-bac0-b8d5d7278f5c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Acquiring lock "refresh_cache-582702ee-b8f8-49e4-9853-68af15420702" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 15:51:19 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-0e4ad819-a62e-4b45-bac0-b8d5d7278f5c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Acquired lock "refresh_cache-582702ee-b8f8-49e4-9853-68af15420702" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 15:51:19 user nova-compute[75337]: DEBUG nova.network.neutron [None req-0e4ad819-a62e-4b45-bac0-b8d5d7278f5c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 582702ee-b8f8-49e4-9853-68af15420702] Building network info cache for instance {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 15:51:19 user nova-compute[75337]: DEBUG nova.compute.manager [req-f66c8d78-ef2d-4af2-b96c-44a753f02cea req-3a2fa7b8-d8c9-4712-b8ab-6f8b2db5d469 service nova] [instance: 582702ee-b8f8-49e4-9853-68af15420702] Received event network-changed-bb02742a-5f8a-4501-95e6-dddfef111f50 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:51:19 user nova-compute[75337]: DEBUG nova.compute.manager [req-f66c8d78-ef2d-4af2-b96c-44a753f02cea req-3a2fa7b8-d8c9-4712-b8ab-6f8b2db5d469 service nova] [instance: 582702ee-b8f8-49e4-9853-68af15420702] Refreshing instance network info cache due to event network-changed-bb02742a-5f8a-4501-95e6-dddfef111f50. {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 15:51:19 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-f66c8d78-ef2d-4af2-b96c-44a753f02cea req-3a2fa7b8-d8c9-4712-b8ab-6f8b2db5d469 service nova] Acquiring lock "refresh_cache-582702ee-b8f8-49e4-9853-68af15420702" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 15:51:19 user nova-compute[75337]: DEBUG nova.network.neutron [None req-0e4ad819-a62e-4b45-bac0-b8d5d7278f5c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 582702ee-b8f8-49e4-9853-68af15420702] Instance cache missing network info. {{(pid=75337) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 15:51:19 user nova-compute[75337]: ERROR nova.volume.cinder [None req-6c1116f5-f156-445e-ac3f-a65792666fe2 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Update attachment failed for attachment b89f21e7-38e2-4f00-af5c-f108cec4c867. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-df240553-afce-4fc5-8d7d-1eb8e81c2d55) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-df240553-afce-4fc5-8d7d-1eb8e81c2d55)
Nov 06 15:51:19 user nova-compute[75337]: ERROR nova.compute.manager [None req-6c1116f5-f156-445e-ac3f-a65792666fe2 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: 5badd355-5783-41b9-8f01-9fac9ff5d9d6] Instance failed block device setup: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-df240553-afce-4fc5-8d7d-1eb8e81c2d55)
Nov 06 15:51:19 user nova-compute[75337]: ERROR nova.compute.manager [instance: 5badd355-5783-41b9-8f01-9fac9ff5d9d6] Traceback (most recent call last):
Nov 06 15:51:19 user nova-compute[75337]: ERROR nova.compute.manager [instance: 5badd355-5783-41b9-8f01-9fac9ff5d9d6]   File "/opt/stack/nova/nova/compute/manager.py", line 2190, in _prep_block_device
Nov 06 15:51:19 user nova-compute[75337]: ERROR nova.compute.manager [instance: 5badd355-5783-41b9-8f01-9fac9ff5d9d6]     driver_block_device.attach_block_devices(
Nov 06 15:51:19 user nova-compute[75337]: ERROR nova.compute.manager [instance: 5badd355-5783-41b9-8f01-9fac9ff5d9d6]   File "/opt/stack/nova/nova/virt/block_device.py", line 936, in attach_block_devices
Nov 06 15:51:19 user nova-compute[75337]: ERROR nova.compute.manager [instance: 5badd355-5783-41b9-8f01-9fac9ff5d9d6]     _log_and_attach(device)
Nov 06 15:51:19 user nova-compute[75337]: ERROR nova.compute.manager [instance: 5badd355-5783-41b9-8f01-9fac9ff5d9d6]   File "/opt/stack/nova/nova/virt/block_device.py", line 933, in _log_and_attach
Nov 06 15:51:19 user nova-compute[75337]: ERROR nova.compute.manager [instance: 5badd355-5783-41b9-8f01-9fac9ff5d9d6]     bdm.attach(*attach_args, **attach_kwargs)
Nov 06 15:51:19 user nova-compute[75337]: ERROR nova.compute.manager [instance: 5badd355-5783-41b9-8f01-9fac9ff5d9d6]   File "/opt/stack/nova/nova/virt/block_device.py", line 835, in attach
Nov 06 15:51:19 user nova-compute[75337]: ERROR nova.compute.manager [instance: 5badd355-5783-41b9-8f01-9fac9ff5d9d6]     super(DriverVolImageBlockDevice, self).attach(
Nov 06 15:51:19 user nova-compute[75337]: ERROR nova.compute.manager [instance: 5badd355-5783-41b9-8f01-9fac9ff5d9d6]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 06 15:51:19 user nova-compute[75337]: ERROR nova.compute.manager [instance: 5badd355-5783-41b9-8f01-9fac9ff5d9d6]     ret_val = method(obj, context, *args, **kwargs)
Nov 06 15:51:19 user nova-compute[75337]: ERROR nova.compute.manager [instance: 5badd355-5783-41b9-8f01-9fac9ff5d9d6]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 06 15:51:19 user nova-compute[75337]: ERROR nova.compute.manager [instance: 5badd355-5783-41b9-8f01-9fac9ff5d9d6]     self._do_attach(context, instance, volume, volume_api,
Nov 06 15:51:19 user nova-compute[75337]: ERROR nova.compute.manager [instance: 5badd355-5783-41b9-8f01-9fac9ff5d9d6]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 06 15:51:19 user nova-compute[75337]: ERROR nova.compute.manager [instance: 5badd355-5783-41b9-8f01-9fac9ff5d9d6]     self._volume_attach(context, volume, connector, instance,
Nov 06 15:51:19 user nova-compute[75337]: ERROR nova.compute.manager [instance: 5badd355-5783-41b9-8f01-9fac9ff5d9d6]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 06 15:51:19 user nova-compute[75337]: ERROR nova.compute.manager [instance: 5badd355-5783-41b9-8f01-9fac9ff5d9d6]     connection_info = volume_api.attachment_update(
Nov 06 15:51:19 user nova-compute[75337]: ERROR nova.compute.manager [instance: 5badd355-5783-41b9-8f01-9fac9ff5d9d6]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 06 15:51:19 user nova-compute[75337]: ERROR nova.compute.manager [instance: 5badd355-5783-41b9-8f01-9fac9ff5d9d6]     res = method(self, ctx, *args, **kwargs)
Nov 06 15:51:19 user nova-compute[75337]: ERROR nova.compute.manager [instance: 5badd355-5783-41b9-8f01-9fac9ff5d9d6]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 06 15:51:19 user nova-compute[75337]: ERROR nova.compute.manager [instance: 5badd355-5783-41b9-8f01-9fac9ff5d9d6]     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 06 15:51:19 user nova-compute[75337]: ERROR nova.compute.manager [instance: 5badd355-5783-41b9-8f01-9fac9ff5d9d6]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 06 15:51:19 user nova-compute[75337]: ERROR nova.compute.manager [instance: 5badd355-5783-41b9-8f01-9fac9ff5d9d6]     with excutils.save_and_reraise_exception():
Nov 06 15:51:19 user nova-compute[75337]: ERROR nova.compute.manager [instance: 5badd355-5783-41b9-8f01-9fac9ff5d9d6]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 06 15:51:19 user nova-compute[75337]: ERROR nova.compute.manager [instance: 5badd355-5783-41b9-8f01-9fac9ff5d9d6]     self.force_reraise()
Nov 06 15:51:19 user nova-compute[75337]: ERROR nova.compute.manager [instance: 5badd355-5783-41b9-8f01-9fac9ff5d9d6]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 06 15:51:19 user nova-compute[75337]: ERROR nova.compute.manager [instance: 5badd355-5783-41b9-8f01-9fac9ff5d9d6]     raise self.value
Nov 06 15:51:19 user nova-compute[75337]: ERROR nova.compute.manager [instance: 5badd355-5783-41b9-8f01-9fac9ff5d9d6]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 06 15:51:19 user nova-compute[75337]: ERROR nova.compute.manager [instance: 5badd355-5783-41b9-8f01-9fac9ff5d9d6]     context, '3.44', skip_version_check=True).attachments.update(
Nov 06 15:51:19 user nova-compute[75337]: ERROR nova.compute.manager [instance: 5badd355-5783-41b9-8f01-9fac9ff5d9d6]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 06 15:51:19 user nova-compute[75337]: ERROR nova.compute.manager [instance: 5badd355-5783-41b9-8f01-9fac9ff5d9d6]     return method.func(obj, *args, **kwargs)
Nov 06 15:51:19 user nova-compute[75337]: ERROR nova.compute.manager [instance: 5badd355-5783-41b9-8f01-9fac9ff5d9d6]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 06 15:51:19 user nova-compute[75337]: ERROR nova.compute.manager [instance: 5badd355-5783-41b9-8f01-9fac9ff5d9d6]     resp = self._update('/attachments/%s' % id, body)
Nov 06 15:51:19 user nova-compute[75337]: ERROR nova.compute.manager [instance: 5badd355-5783-41b9-8f01-9fac9ff5d9d6]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 06 15:51:19 user nova-compute[75337]: ERROR nova.compute.manager [instance: 5badd355-5783-41b9-8f01-9fac9ff5d9d6]     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 06 15:51:19 user nova-compute[75337]: ERROR nova.compute.manager [instance: 5badd355-5783-41b9-8f01-9fac9ff5d9d6]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 06 15:51:19 user nova-compute[75337]: ERROR nova.compute.manager [instance: 5badd355-5783-41b9-8f01-9fac9ff5d9d6]     return self._cs_request(url, 'PUT', **kwargs)
Nov 06 15:51:19 user nova-compute[75337]: ERROR nova.compute.manager [instance: 5badd355-5783-41b9-8f01-9fac9ff5d9d6]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 06 15:51:19 user nova-compute[75337]: ERROR nova.compute.manager [instance: 5badd355-5783-41b9-8f01-9fac9ff5d9d6]     return self.request(url, method, **kwargs)
Nov 06 15:51:19 user nova-compute[75337]: ERROR nova.compute.manager [instance: 5badd355-5783-41b9-8f01-9fac9ff5d9d6]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 06 15:51:19 user nova-compute[75337]: ERROR nova.compute.manager [instance: 5badd355-5783-41b9-8f01-9fac9ff5d9d6]     raise exceptions.from_response(resp, body)
Nov 06 15:51:19 user nova-compute[75337]: ERROR nova.compute.manager [instance: 5badd355-5783-41b9-8f01-9fac9ff5d9d6] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-df240553-afce-4fc5-8d7d-1eb8e81c2d55)
Nov 06 15:51:19 user nova-compute[75337]: ERROR nova.compute.manager [instance: 5badd355-5783-41b9-8f01-9fac9ff5d9d6] 
Nov 06 15:51:19 user nova-compute[75337]: DEBUG nova.compute.claims [None req-6c1116f5-f156-445e-ac3f-a65792666fe2 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: 5badd355-5783-41b9-8f01-9fac9ff5d9d6] Aborting claim: <nova.compute.claims.Claim object at 0x7f2a9c454670> {{(pid=75337) abort /opt/stack/nova/nova/compute/claims.py:84}}
Nov 06 15:51:19 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-6c1116f5-f156-445e-ac3f-a65792666fe2 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:51:19 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-6c1116f5-f156-445e-ac3f-a65792666fe2 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:51:19 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:51:19 user nova-compute[75337]: DEBUG nova.network.neutron [None req-0e4ad819-a62e-4b45-bac0-b8d5d7278f5c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 582702ee-b8f8-49e4-9853-68af15420702] Updating instance_info_cache with network_info: [{"id": "bb02742a-5f8a-4501-95e6-dddfef111f50", "address": "fa:16:3e:ad:0d:f6", "network": {"id": "4e47319f-de1d-4dfe-9915-7d2d5131704d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-895093240-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "915211c6a2734c36b34ff92a56b085f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb02742a-5f", "ovs_interfaceid": "bb02742a-5f8a-4501-95e6-dddfef111f50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:51:19 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-0e4ad819-a62e-4b45-bac0-b8d5d7278f5c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Releasing lock "refresh_cache-582702ee-b8f8-49e4-9853-68af15420702" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 15:51:19 user nova-compute[75337]: DEBUG nova.compute.manager [None req-0e4ad819-a62e-4b45-bac0-b8d5d7278f5c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 582702ee-b8f8-49e4-9853-68af15420702] Instance network_info: |[{"id": "bb02742a-5f8a-4501-95e6-dddfef111f50", "address": "fa:16:3e:ad:0d:f6", "network": {"id": "4e47319f-de1d-4dfe-9915-7d2d5131704d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-895093240-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "915211c6a2734c36b34ff92a56b085f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb02742a-5f", "ovs_interfaceid": "bb02742a-5f8a-4501-95e6-dddfef111f50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 15:51:19 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-f66c8d78-ef2d-4af2-b96c-44a753f02cea req-3a2fa7b8-d8c9-4712-b8ab-6f8b2db5d469 service nova] Acquired lock "refresh_cache-582702ee-b8f8-49e4-9853-68af15420702" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 15:51:19 user nova-compute[75337]: DEBUG nova.network.neutron [req-f66c8d78-ef2d-4af2-b96c-44a753f02cea req-3a2fa7b8-d8c9-4712-b8ab-6f8b2db5d469 service nova] [instance: 582702ee-b8f8-49e4-9853-68af15420702] Refreshing network info cache for port bb02742a-5f8a-4501-95e6-dddfef111f50 {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 15:51:20 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-6c1116f5-f156-445e-ac3f-a65792666fe2 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 15:51:20 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-6c1116f5-f156-445e-ac3f-a65792666fe2 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 15:51:20 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-6c1116f5-f156-445e-ac3f-a65792666fe2 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.544s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:51:20 user nova-compute[75337]: DEBUG nova.compute.manager [None req-6c1116f5-f156-445e-ac3f-a65792666fe2 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: 5badd355-5783-41b9-8f01-9fac9ff5d9d6] Build of instance 5badd355-5783-41b9-8f01-9fac9ff5d9d6 aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-df240553-afce-4fc5-8d7d-1eb8e81c2d55) {{(pid=75337) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2660}}
Nov 06 15:51:20 user nova-compute[75337]: DEBUG nova.compute.utils [None req-6c1116f5-f156-445e-ac3f-a65792666fe2 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: 5badd355-5783-41b9-8f01-9fac9ff5d9d6] Build of instance 5badd355-5783-41b9-8f01-9fac9ff5d9d6 aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: {{(pid=75337) notify_about_instance_usage /opt/stack/nova/nova/compute/utils.py:430}}
Nov 06 15:51:20 user nova-compute[75337]: ERROR nova.compute.manager [None req-6c1116f5-f156-445e-ac3f-a65792666fe2 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: 5badd355-5783-41b9-8f01-9fac9ff5d9d6] Build of instance 5badd355-5783-41b9-8f01-9fac9ff5d9d6 aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-df240553-afce-4fc5-8d7d-1eb8e81c2d55): nova.exception.BuildAbortException: Build of instance 5badd355-5783-41b9-8f01-9fac9ff5d9d6 aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-df240553-afce-4fc5-8d7d-1eb8e81c2d55)
Nov 06 15:51:20 user nova-compute[75337]: DEBUG nova.compute.manager [None req-6c1116f5-f156-445e-ac3f-a65792666fe2 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: 5badd355-5783-41b9-8f01-9fac9ff5d9d6] Unplugging VIFs for instance {{(pid=75337) _cleanup_allocated_networks /opt/stack/nova/nova/compute/manager.py:2996}}
Nov 06 15:51:20 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-6c1116f5-f156-445e-ac3f-a65792666fe2 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T15:50:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1995407757',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1995407757',id=24,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eb76b5b0f2b24f1c84a92403176bcc00',ramdisk_id='',reservation_id='r-clxcr3n3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2044295020',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T15:50:23Z,user_data=None,user_id='74090d6e5b354d79bf6ded92e6de56aa',uuid=5badd355-5783-41b9-8f01-9fac9ff5d9d6,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e029cddb-82d2-48ca-8943-83072e95d71e", "address": "fa:16:3e:0f:a2:d7", "network": {"id": "736be000-ee94-41fd-9de0-f2f885ec9be7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1715443852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb76b5b0f2b24f1c84a92403176bcc00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape029cddb-82", "ovs_interfaceid": "e029cddb-82d2-48ca-8943-83072e95d71e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 15:51:20 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-6c1116f5-f156-445e-ac3f-a65792666fe2 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Converting VIF {"id": "e029cddb-82d2-48ca-8943-83072e95d71e", "address": "fa:16:3e:0f:a2:d7", "network": {"id": "736be000-ee94-41fd-9de0-f2f885ec9be7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1715443852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb76b5b0f2b24f1c84a92403176bcc00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape029cddb-82", "ovs_interfaceid": "e029cddb-82d2-48ca-8943-83072e95d71e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 15:51:20 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-6c1116f5-f156-445e-ac3f-a65792666fe2 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:a2:d7,bridge_name='br-int',has_traffic_filtering=True,id=e029cddb-82d2-48ca-8943-83072e95d71e,network=Network(736be000-ee94-41fd-9de0-f2f885ec9be7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape029cddb-82') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 15:51:20 user nova-compute[75337]: DEBUG os_vif [None req-6c1116f5-f156-445e-ac3f-a65792666fe2 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:a2:d7,bridge_name='br-int',has_traffic_filtering=True,id=e029cddb-82d2-48ca-8943-83072e95d71e,network=Network(736be000-ee94-41fd-9de0-f2f885ec9be7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape029cddb-82') {{(pid=75337) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 15:51:20 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:51:20 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape029cddb-82, bridge=br-int, if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:51:20 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 15:51:20 user nova-compute[75337]: INFO os_vif [None req-6c1116f5-f156-445e-ac3f-a65792666fe2 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:a2:d7,bridge_name='br-int',has_traffic_filtering=True,id=e029cddb-82d2-48ca-8943-83072e95d71e,network=Network(736be000-ee94-41fd-9de0-f2f885ec9be7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape029cddb-82')
Nov 06 15:51:20 user nova-compute[75337]: DEBUG nova.compute.manager [None req-6c1116f5-f156-445e-ac3f-a65792666fe2 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: 5badd355-5783-41b9-8f01-9fac9ff5d9d6] Unplugged VIFs for instance {{(pid=75337) _cleanup_allocated_networks /opt/stack/nova/nova/compute/manager.py:3032}}
Nov 06 15:51:20 user nova-compute[75337]: DEBUG nova.compute.manager [None req-6c1116f5-f156-445e-ac3f-a65792666fe2 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: 5badd355-5783-41b9-8f01-9fac9ff5d9d6] Deallocating network for instance {{(pid=75337) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 15:51:20 user nova-compute[75337]: DEBUG nova.network.neutron [None req-6c1116f5-f156-445e-ac3f-a65792666fe2 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: 5badd355-5783-41b9-8f01-9fac9ff5d9d6] deallocate_for_instance() {{(pid=75337) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 15:51:20 user nova-compute[75337]: DEBUG nova.network.neutron [req-f66c8d78-ef2d-4af2-b96c-44a753f02cea req-3a2fa7b8-d8c9-4712-b8ab-6f8b2db5d469 service nova] [instance: 582702ee-b8f8-49e4-9853-68af15420702] Updated VIF entry in instance network info cache for port bb02742a-5f8a-4501-95e6-dddfef111f50. {{(pid=75337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 15:51:20 user nova-compute[75337]: DEBUG nova.network.neutron [req-f66c8d78-ef2d-4af2-b96c-44a753f02cea req-3a2fa7b8-d8c9-4712-b8ab-6f8b2db5d469 service nova] [instance: 582702ee-b8f8-49e4-9853-68af15420702] Updating instance_info_cache with network_info: [{"id": "bb02742a-5f8a-4501-95e6-dddfef111f50", "address": "fa:16:3e:ad:0d:f6", "network": {"id": "4e47319f-de1d-4dfe-9915-7d2d5131704d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-895093240-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "915211c6a2734c36b34ff92a56b085f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb02742a-5f", "ovs_interfaceid": "bb02742a-5f8a-4501-95e6-dddfef111f50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:51:20 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-f66c8d78-ef2d-4af2-b96c-44a753f02cea req-3a2fa7b8-d8c9-4712-b8ab-6f8b2db5d469 service nova] Releasing lock "refresh_cache-582702ee-b8f8-49e4-9853-68af15420702" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 15:51:20 user nova-compute[75337]: DEBUG nova.network.neutron [None req-6c1116f5-f156-445e-ac3f-a65792666fe2 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: 5badd355-5783-41b9-8f01-9fac9ff5d9d6] Updating instance_info_cache with network_info: [] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:51:20 user nova-compute[75337]: INFO nova.compute.manager [None req-6c1116f5-f156-445e-ac3f-a65792666fe2 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: 5badd355-5783-41b9-8f01-9fac9ff5d9d6] Took 0.59 seconds to deallocate network for instance.
Nov 06 15:51:21 user nova-compute[75337]: DEBUG nova.compute.manager [None req-6c1116f5-f156-445e-ac3f-a65792666fe2 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: 5badd355-5783-41b9-8f01-9fac9ff5d9d6] Detaching volume: 93581866-eb13-4bc9-8c61-87814cd7d7de {{(pid=75337) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3224}}
Nov 06 15:51:21 user nova-compute[75337]: INFO nova.compute.manager [None req-6c1116f5-f156-445e-ac3f-a65792666fe2 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: 5badd355-5783-41b9-8f01-9fac9ff5d9d6] Detaching volume 93581866-eb13-4bc9-8c61-87814cd7d7de
Nov 06 15:51:21 user nova-compute[75337]: DEBUG nova.virt.block_device [None req-6c1116f5-f156-445e-ac3f-a65792666fe2 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: 5badd355-5783-41b9-8f01-9fac9ff5d9d6] Skipping driver_detach during remote rebuild. {{(pid=75337) _do_detach /opt/stack/nova/nova/virt/block_device.py:461}}
Nov 06 15:51:21 user nova-compute[75337]: INFO nova.scheduler.client.report [None req-6c1116f5-f156-445e-ac3f-a65792666fe2 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Deleted allocations for instance 5badd355-5783-41b9-8f01-9fac9ff5d9d6
Nov 06 15:51:21 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-6c1116f5-f156-445e-ac3f-a65792666fe2 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Lock "5badd355-5783-41b9-8f01-9fac9ff5d9d6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 58.678s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:51:24 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:51:24 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:51:28 user nova-compute[75337]: DEBUG os_brick.utils [None req-0e4ad819-a62e-4b45-bac0-b8d5d7278f5c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 15:51:28 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:51:28 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:51:28 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4ce0b57-5c14-460d-9457-d92cdd89eb2b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4ff6411e45b8\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:51:28 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:51:28 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:51:28 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[77052ae2-d9b2-4c35-b26c-109e61a9fdab]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:51:28 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:51:28 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:51:28 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[66458ebf-aed7-4da8-a630-cb38f7113338]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:51:28 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[5faa0957-f5de-4a94-9073-d938b2f00af2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:51:28 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-0e4ad819-a62e-4b45-bac0-b8d5d7278f5c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Running cmd (subprocess): nvme version {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:51:28 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-0e4ad819-a62e-4b45-bac0-b8d5d7278f5c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] 'nvme version' failed. Not Retrying. {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 15:51:28 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0e4ad819-a62e-4b45-bac0-b8d5d7278f5c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] nvme not present on system {{(pid=75337) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 15:51:28 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:51:28 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 15:51:28 user nova-compute[75337]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 15:51:28 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aa61bca-9830-4df4-84e0-a2c54a069f5b]: (4, '') {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:51:28 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.lightos [None req-0e4ad819-a62e-4b45-bac0-b8d5d7278f5c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75337) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 15:51:28 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.lightos [None req-0e4ad819-a62e-4b45-bac0-b8d5d7278f5c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 15:51:28 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.lightos [None req-0e4ad819-a62e-4b45-bac0-b8d5d7278f5c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] LIGHTOS: no hostnqn found. {{(pid=75337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 15:51:28 user nova-compute[75337]: DEBUG os_brick.utils [None req-0e4ad819-a62e-4b45-bac0-b8d5d7278f5c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4ff6411e45b8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 15:51:28 user nova-compute[75337]: DEBUG nova.virt.block_device [None req-0e4ad819-a62e-4b45-bac0-b8d5d7278f5c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 582702ee-b8f8-49e4-9853-68af15420702] Updating existing volume attachment record: 4e051f49-1f7f-4e89-8e26-d17840b342da {{(pid=75337) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 15:51:29 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:51:29 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:51:34 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:51:34 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:51:34 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75337) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 15:51:34 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 15:51:34 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 15:51:34 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:51:36 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:51:36 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:51:37 user nova-compute[75337]: DEBUG nova.compute.manager [req-ca5f6124-5ef5-4872-b4bf-bf957a70c4a6 req-234248c8-23e1-4bb9-9499-cbe797bd44f5 service nova] [instance: bc0e07f8-2731-4ffa-8446-b71ad3ba7375] Received event network-changed-a20e3f62-5387-4f54-b623-d45a0a311da0 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:51:37 user nova-compute[75337]: DEBUG nova.compute.manager [req-ca5f6124-5ef5-4872-b4bf-bf957a70c4a6 req-234248c8-23e1-4bb9-9499-cbe797bd44f5 service nova] [instance: bc0e07f8-2731-4ffa-8446-b71ad3ba7375] Refreshing instance network info cache due to event network-changed-a20e3f62-5387-4f54-b623-d45a0a311da0. {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 15:51:37 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-ca5f6124-5ef5-4872-b4bf-bf957a70c4a6 req-234248c8-23e1-4bb9-9499-cbe797bd44f5 service nova] Acquiring lock "refresh_cache-bc0e07f8-2731-4ffa-8446-b71ad3ba7375" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 15:51:37 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-ca5f6124-5ef5-4872-b4bf-bf957a70c4a6 req-234248c8-23e1-4bb9-9499-cbe797bd44f5 service nova] Acquired lock "refresh_cache-bc0e07f8-2731-4ffa-8446-b71ad3ba7375" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 15:51:37 user nova-compute[75337]: DEBUG nova.network.neutron [req-ca5f6124-5ef5-4872-b4bf-bf957a70c4a6 req-234248c8-23e1-4bb9-9499-cbe797bd44f5 service nova] [instance: bc0e07f8-2731-4ffa-8446-b71ad3ba7375] Refreshing network info cache for port a20e3f62-5387-4f54-b623-d45a0a311da0 {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 15:51:37 user nova-compute[75337]: DEBUG nova.network.neutron [req-ca5f6124-5ef5-4872-b4bf-bf957a70c4a6 req-234248c8-23e1-4bb9-9499-cbe797bd44f5 service nova] [instance: bc0e07f8-2731-4ffa-8446-b71ad3ba7375] Updated VIF entry in instance network info cache for port a20e3f62-5387-4f54-b623-d45a0a311da0. {{(pid=75337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 15:51:37 user nova-compute[75337]: DEBUG nova.network.neutron [req-ca5f6124-5ef5-4872-b4bf-bf957a70c4a6 req-234248c8-23e1-4bb9-9499-cbe797bd44f5 service nova] [instance: bc0e07f8-2731-4ffa-8446-b71ad3ba7375] Updating instance_info_cache with network_info: [{"id": "a20e3f62-5387-4f54-b623-d45a0a311da0", "address": "fa:16:3e:fe:62:24", "network": {"id": "c31b513a-57f0-4bd5-b055-4a363aae9793", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1352256985-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cddccc86bf54fe981667da5ef13fa8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa20e3f62-53", "ovs_interfaceid": "a20e3f62-5387-4f54-b623-d45a0a311da0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:51:37 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-ca5f6124-5ef5-4872-b4bf-bf957a70c4a6 req-234248c8-23e1-4bb9-9499-cbe797bd44f5 service nova] Releasing lock "refresh_cache-bc0e07f8-2731-4ffa-8446-b71ad3ba7375" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 15:51:38 user nova-compute[75337]: DEBUG nova.compute.manager [req-6ae2dd30-a206-4f55-8eb9-3f65bdd8c9c8 req-e78ac8c7-64ca-4e43-b295-bd85314c9ef5 service nova] [instance: bc0e07f8-2731-4ffa-8446-b71ad3ba7375] Received event network-changed-a20e3f62-5387-4f54-b623-d45a0a311da0 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:51:38 user nova-compute[75337]: DEBUG nova.compute.manager [req-6ae2dd30-a206-4f55-8eb9-3f65bdd8c9c8 req-e78ac8c7-64ca-4e43-b295-bd85314c9ef5 service nova] [instance: bc0e07f8-2731-4ffa-8446-b71ad3ba7375] Refreshing instance network info cache due to event network-changed-a20e3f62-5387-4f54-b623-d45a0a311da0. {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 15:51:38 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-6ae2dd30-a206-4f55-8eb9-3f65bdd8c9c8 req-e78ac8c7-64ca-4e43-b295-bd85314c9ef5 service nova] Acquiring lock "refresh_cache-bc0e07f8-2731-4ffa-8446-b71ad3ba7375" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 15:51:38 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-6ae2dd30-a206-4f55-8eb9-3f65bdd8c9c8 req-e78ac8c7-64ca-4e43-b295-bd85314c9ef5 service nova] Acquired lock "refresh_cache-bc0e07f8-2731-4ffa-8446-b71ad3ba7375" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 15:51:38 user nova-compute[75337]: DEBUG nova.network.neutron [req-6ae2dd30-a206-4f55-8eb9-3f65bdd8c9c8 req-e78ac8c7-64ca-4e43-b295-bd85314c9ef5 service nova] [instance: bc0e07f8-2731-4ffa-8446-b71ad3ba7375] Refreshing network info cache for port a20e3f62-5387-4f54-b623-d45a0a311da0 {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 15:51:38 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-f1dbb214-ac3c-44f5-bace-4c1828ffd612 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Acquiring lock "bc0e07f8-2731-4ffa-8446-b71ad3ba7375" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:51:38 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-f1dbb214-ac3c-44f5-bace-4c1828ffd612 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Lock "bc0e07f8-2731-4ffa-8446-b71ad3ba7375" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:51:38 user nova-compute[75337]: INFO nova.compute.manager [None req-f1dbb214-ac3c-44f5-bace-4c1828ffd612 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] [instance: bc0e07f8-2731-4ffa-8446-b71ad3ba7375] Detaching volume dc5eae50-0461-47ca-bc48-cb38087b06e0
Nov 06 15:51:38 user nova-compute[75337]: INFO nova.virt.block_device [None req-f1dbb214-ac3c-44f5-bace-4c1828ffd612 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] [instance: bc0e07f8-2731-4ffa-8446-b71ad3ba7375] Attempting to driver detach volume dc5eae50-0461-47ca-bc48-cb38087b06e0 from mountpoint /dev/vdb
Nov 06 15:51:38 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-f1dbb214-ac3c-44f5-bace-4c1828ffd612 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Attempting to detach device vdb from instance bc0e07f8-2731-4ffa-8446-b71ad3ba7375 from the persistent domain config. {{(pid=75337) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 06 15:51:38 user nova-compute[75337]: DEBUG nova.virt.libvirt.guest [None req-f1dbb214-ac3c-44f5-bace-4c1828ffd612 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 15:51:38 user nova-compute[75337]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 15:51:38 user nova-compute[75337]:   <source dev="/dev/sde"/>
Nov 06 15:51:38 user nova-compute[75337]:   <target dev="vdb" bus="virtio"/>
Nov 06 15:51:38 user nova-compute[75337]:   <serial>dc5eae50-0461-47ca-bc48-cb38087b06e0</serial>
Nov 06 15:51:38 user nova-compute[75337]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 06 15:51:38 user nova-compute[75337]: </disk>
Nov 06 15:51:38 user nova-compute[75337]:  {{(pid=75337) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 15:51:38 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-f1dbb214-ac3c-44f5-bace-4c1828ffd612 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Successfully detached device vdb from instance bc0e07f8-2731-4ffa-8446-b71ad3ba7375 from the persistent domain config.
Nov 06 15:51:38 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-f1dbb214-ac3c-44f5-bace-4c1828ffd612 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance bc0e07f8-2731-4ffa-8446-b71ad3ba7375 from the live domain config. {{(pid=75337) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 06 15:51:38 user nova-compute[75337]: DEBUG nova.virt.libvirt.guest [None req-f1dbb214-ac3c-44f5-bace-4c1828ffd612 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 15:51:38 user nova-compute[75337]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 15:51:38 user nova-compute[75337]:   <source dev="/dev/sde"/>
Nov 06 15:51:38 user nova-compute[75337]:   <target dev="vdb" bus="virtio"/>
Nov 06 15:51:38 user nova-compute[75337]:   <serial>dc5eae50-0461-47ca-bc48-cb38087b06e0</serial>
Nov 06 15:51:38 user nova-compute[75337]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 06 15:51:38 user nova-compute[75337]: </disk>
Nov 06 15:51:38 user nova-compute[75337]:  {{(pid=75337) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 15:51:38 user nova-compute[75337]: DEBUG nova.network.neutron [req-6ae2dd30-a206-4f55-8eb9-3f65bdd8c9c8 req-e78ac8c7-64ca-4e43-b295-bd85314c9ef5 service nova] [instance: bc0e07f8-2731-4ffa-8446-b71ad3ba7375] Updated VIF entry in instance network info cache for port a20e3f62-5387-4f54-b623-d45a0a311da0. {{(pid=75337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 15:51:38 user nova-compute[75337]: DEBUG nova.network.neutron [req-6ae2dd30-a206-4f55-8eb9-3f65bdd8c9c8 req-e78ac8c7-64ca-4e43-b295-bd85314c9ef5 service nova] [instance: bc0e07f8-2731-4ffa-8446-b71ad3ba7375] Updating instance_info_cache with network_info: [{"id": "a20e3f62-5387-4f54-b623-d45a0a311da0", "address": "fa:16:3e:fe:62:24", "network": {"id": "c31b513a-57f0-4bd5-b055-4a363aae9793", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1352256985-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cddccc86bf54fe981667da5ef13fa8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa20e3f62-53", "ovs_interfaceid": "a20e3f62-5387-4f54-b623-d45a0a311da0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:51:38 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-6ae2dd30-a206-4f55-8eb9-3f65bdd8c9c8 req-e78ac8c7-64ca-4e43-b295-bd85314c9ef5 service nova] Releasing lock "refresh_cache-bc0e07f8-2731-4ffa-8446-b71ad3ba7375" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 15:51:39 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-f1dbb214-ac3c-44f5-bace-4c1828ffd612 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance bc0e07f8-2731-4ffa-8446-b71ad3ba7375 {{(pid=75337) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 06 15:51:39 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:51:39 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:51:40 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:51:44 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:51:44 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:51:47 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:51:49 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:51:49 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:51:50 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:51:52 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-a9071c1e-f8f5-4db1-a8d3-3e46b37c588b tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] Acquiring lock "30c634ff-6999-40aa-a90d-1db6d278b571" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:51:52 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-a9071c1e-f8f5-4db1-a8d3-3e46b37c588b tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] Lock "30c634ff-6999-40aa-a90d-1db6d278b571" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:51:52 user nova-compute[75337]: DEBUG nova.compute.manager [None req-a9071c1e-f8f5-4db1-a8d3-3e46b37c588b tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] [instance: 30c634ff-6999-40aa-a90d-1db6d278b571] Starting instance... {{(pid=75337) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 15:51:52 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-a9071c1e-f8f5-4db1-a8d3-3e46b37c588b tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:51:52 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-a9071c1e-f8f5-4db1-a8d3-3e46b37c588b tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:51:52 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-a9071c1e-f8f5-4db1-a8d3-3e46b37c588b tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75337) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 15:51:52 user nova-compute[75337]: INFO nova.compute.claims [None req-a9071c1e-f8f5-4db1-a8d3-3e46b37c588b tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] [instance: 30c634ff-6999-40aa-a90d-1db6d278b571] Claim successful on node user
Nov 06 15:51:52 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-a9071c1e-f8f5-4db1-a8d3-3e46b37c588b tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 15:51:52 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-a9071c1e-f8f5-4db1-a8d3-3e46b37c588b tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 15:51:52 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-a9071c1e-f8f5-4db1-a8d3-3e46b37c588b tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.479s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:51:52 user nova-compute[75337]: DEBUG nova.compute.manager [None req-a9071c1e-f8f5-4db1-a8d3-3e46b37c588b tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] [instance: 30c634ff-6999-40aa-a90d-1db6d278b571] Start building networks asynchronously for instance. {{(pid=75337) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 15:51:52 user nova-compute[75337]: DEBUG nova.compute.manager [None req-a9071c1e-f8f5-4db1-a8d3-3e46b37c588b tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] [instance: 30c634ff-6999-40aa-a90d-1db6d278b571] Allocating IP information in the background. {{(pid=75337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 15:51:52 user nova-compute[75337]: DEBUG nova.network.neutron [None req-a9071c1e-f8f5-4db1-a8d3-3e46b37c588b tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] [instance: 30c634ff-6999-40aa-a90d-1db6d278b571] allocate_for_instance() {{(pid=75337) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 15:51:52 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-a9071c1e-f8f5-4db1-a8d3-3e46b37c588b tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] [instance: 30c634ff-6999-40aa-a90d-1db6d278b571] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 15:51:52 user nova-compute[75337]: DEBUG nova.compute.manager [None req-a9071c1e-f8f5-4db1-a8d3-3e46b37c588b tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] [instance: 30c634ff-6999-40aa-a90d-1db6d278b571] Start building block device mappings for instance. {{(pid=75337) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 15:51:52 user nova-compute[75337]: DEBUG nova.policy [None req-a9071c1e-f8f5-4db1-a8d3-3e46b37c588b tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5691e9e1923f4f2e9fdd3a39d8d7ff20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e13dfd402b7b4ed1a1092c7388ff5188', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75337) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 15:51:52 user nova-compute[75337]: DEBUG nova.compute.manager [None req-a9071c1e-f8f5-4db1-a8d3-3e46b37c588b tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] [instance: 30c634ff-6999-40aa-a90d-1db6d278b571] Start spawning the instance on the hypervisor. {{(pid=75337) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 15:51:52 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-a9071c1e-f8f5-4db1-a8d3-3e46b37c588b tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] [instance: 30c634ff-6999-40aa-a90d-1db6d278b571] Creating instance directory {{(pid=75337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 15:51:52 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-a9071c1e-f8f5-4db1-a8d3-3e46b37c588b tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] [instance: 30c634ff-6999-40aa-a90d-1db6d278b571] Creating image(s)
Nov 06 15:51:52 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-a9071c1e-f8f5-4db1-a8d3-3e46b37c588b tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] Acquiring lock "/opt/stack/data/nova/instances/30c634ff-6999-40aa-a90d-1db6d278b571/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:51:52 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-a9071c1e-f8f5-4db1-a8d3-3e46b37c588b tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] Lock "/opt/stack/data/nova/instances/30c634ff-6999-40aa-a90d-1db6d278b571/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:51:52 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-a9071c1e-f8f5-4db1-a8d3-3e46b37c588b tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] Lock "/opt/stack/data/nova/instances/30c634ff-6999-40aa-a90d-1db6d278b571/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:51:52 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-a9071c1e-f8f5-4db1-a8d3-3e46b37c588b tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:51:53 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-a9071c1e-f8f5-4db1-a8d3-3e46b37c588b tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json" returned: 0 in 0.211s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:51:53 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-a9071c1e-f8f5-4db1-a8d3-3e46b37c588b tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] Acquiring lock "06ba3c914798499e686c5ac75886932347225275" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:51:53 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-a9071c1e-f8f5-4db1-a8d3-3e46b37c588b tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] Lock "06ba3c914798499e686c5ac75886932347225275" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:51:53 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-a9071c1e-f8f5-4db1-a8d3-3e46b37c588b tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:51:53 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-a9071c1e-f8f5-4db1-a8d3-3e46b37c588b tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json" returned: 0 in 0.210s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:51:53 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-a9071c1e-f8f5-4db1-a8d3-3e46b37c588b tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275,backing_fmt=raw /opt/stack/data/nova/instances/30c634ff-6999-40aa-a90d-1db6d278b571/disk 1073741824 {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:51:53 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-a9071c1e-f8f5-4db1-a8d3-3e46b37c588b tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275,backing_fmt=raw /opt/stack/data/nova/instances/30c634ff-6999-40aa-a90d-1db6d278b571/disk 1073741824" returned: 0 in 0.064s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:51:53 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-a9071c1e-f8f5-4db1-a8d3-3e46b37c588b tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] Lock "06ba3c914798499e686c5ac75886932347225275" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.281s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:51:53 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-a9071c1e-f8f5-4db1-a8d3-3e46b37c588b tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:51:53 user nova-compute[75337]: DEBUG nova.network.neutron [None req-a9071c1e-f8f5-4db1-a8d3-3e46b37c588b tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] [instance: 30c634ff-6999-40aa-a90d-1db6d278b571] Successfully created port: 7b7a4e21-92b6-4854-8c0d-4d9556247a72 {{(pid=75337) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 15:51:53 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-a9071c1e-f8f5-4db1-a8d3-3e46b37c588b tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json" returned: 0 in 0.213s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:51:53 user nova-compute[75337]: DEBUG nova.virt.disk.api [None req-a9071c1e-f8f5-4db1-a8d3-3e46b37c588b tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] Checking if we can resize image /opt/stack/data/nova/instances/30c634ff-6999-40aa-a90d-1db6d278b571/disk. size=1073741824 {{(pid=75337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 15:51:53 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-a9071c1e-f8f5-4db1-a8d3-3e46b37c588b tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30c634ff-6999-40aa-a90d-1db6d278b571/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:51:53 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-a9071c1e-f8f5-4db1-a8d3-3e46b37c588b tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30c634ff-6999-40aa-a90d-1db6d278b571/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:51:53 user nova-compute[75337]: DEBUG nova.virt.disk.api [None req-a9071c1e-f8f5-4db1-a8d3-3e46b37c588b tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] Cannot resize image /opt/stack/data/nova/instances/30c634ff-6999-40aa-a90d-1db6d278b571/disk to a smaller size. {{(pid=75337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 06 15:51:53 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-a9071c1e-f8f5-4db1-a8d3-3e46b37c588b tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] [instance: 30c634ff-6999-40aa-a90d-1db6d278b571] Created local disks {{(pid=75337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 15:51:53 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-a9071c1e-f8f5-4db1-a8d3-3e46b37c588b tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] [instance: 30c634ff-6999-40aa-a90d-1db6d278b571] Ensure instance console log exists: /opt/stack/data/nova/instances/30c634ff-6999-40aa-a90d-1db6d278b571/console.log {{(pid=75337) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 15:51:53 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-a9071c1e-f8f5-4db1-a8d3-3e46b37c588b tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:51:53 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-a9071c1e-f8f5-4db1-a8d3-3e46b37c588b tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:51:53 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-a9071c1e-f8f5-4db1-a8d3-3e46b37c588b tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:51:54 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:51:54 user nova-compute[75337]: DEBUG nova.network.neutron [None req-a9071c1e-f8f5-4db1-a8d3-3e46b37c588b tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] [instance: 30c634ff-6999-40aa-a90d-1db6d278b571] Successfully updated port: 7b7a4e21-92b6-4854-8c0d-4d9556247a72 {{(pid=75337) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 15:51:54 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-a9071c1e-f8f5-4db1-a8d3-3e46b37c588b tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] Acquiring lock "refresh_cache-30c634ff-6999-40aa-a90d-1db6d278b571" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 15:51:54 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-a9071c1e-f8f5-4db1-a8d3-3e46b37c588b tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] Acquired lock "refresh_cache-30c634ff-6999-40aa-a90d-1db6d278b571" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 15:51:54 user nova-compute[75337]: DEBUG nova.network.neutron [None req-a9071c1e-f8f5-4db1-a8d3-3e46b37c588b tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] [instance: 30c634ff-6999-40aa-a90d-1db6d278b571] Building network info cache for instance {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 15:51:54 user nova-compute[75337]: DEBUG nova.compute.manager [req-26695413-ade4-499e-9d4c-a310f2f4822b req-63b4c342-e900-48bb-9190-e8dd06a01c08 service nova] [instance: 30c634ff-6999-40aa-a90d-1db6d278b571] Received event network-changed-7b7a4e21-92b6-4854-8c0d-4d9556247a72 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:51:54 user nova-compute[75337]: DEBUG nova.compute.manager [req-26695413-ade4-499e-9d4c-a310f2f4822b req-63b4c342-e900-48bb-9190-e8dd06a01c08 service nova] [instance: 30c634ff-6999-40aa-a90d-1db6d278b571] Refreshing instance network info cache due to event network-changed-7b7a4e21-92b6-4854-8c0d-4d9556247a72. {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 15:51:54 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-26695413-ade4-499e-9d4c-a310f2f4822b req-63b4c342-e900-48bb-9190-e8dd06a01c08 service nova] Acquiring lock "refresh_cache-30c634ff-6999-40aa-a90d-1db6d278b571" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 15:51:54 user nova-compute[75337]: DEBUG nova.network.neutron [None req-a9071c1e-f8f5-4db1-a8d3-3e46b37c588b tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] [instance: 30c634ff-6999-40aa-a90d-1db6d278b571] Instance cache missing network info. {{(pid=75337) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 15:51:54 user nova-compute[75337]: DEBUG nova.network.neutron [None req-a9071c1e-f8f5-4db1-a8d3-3e46b37c588b tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] [instance: 30c634ff-6999-40aa-a90d-1db6d278b571] Updating instance_info_cache with network_info: [{"id": "7b7a4e21-92b6-4854-8c0d-4d9556247a72", "address": "fa:16:3e:ee:c7:a1", "network": {"id": "6757c3a5-4f6f-48a7-9645-af433fb039de", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1337373982-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e13dfd402b7b4ed1a1092c7388ff5188", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b7a4e21-92", "ovs_interfaceid": "7b7a4e21-92b6-4854-8c0d-4d9556247a72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:51:54 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-a9071c1e-f8f5-4db1-a8d3-3e46b37c588b tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] Releasing lock "refresh_cache-30c634ff-6999-40aa-a90d-1db6d278b571" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 15:51:54 user nova-compute[75337]: DEBUG nova.compute.manager [None req-a9071c1e-f8f5-4db1-a8d3-3e46b37c588b tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] [instance: 30c634ff-6999-40aa-a90d-1db6d278b571] Instance network_info: |[{"id": "7b7a4e21-92b6-4854-8c0d-4d9556247a72", "address": "fa:16:3e:ee:c7:a1", "network": {"id": "6757c3a5-4f6f-48a7-9645-af433fb039de", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1337373982-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e13dfd402b7b4ed1a1092c7388ff5188", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b7a4e21-92", "ovs_interfaceid": "7b7a4e21-92b6-4854-8c0d-4d9556247a72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 15:51:54 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-26695413-ade4-499e-9d4c-a310f2f4822b req-63b4c342-e900-48bb-9190-e8dd06a01c08 service nova] Acquired lock "refresh_cache-30c634ff-6999-40aa-a90d-1db6d278b571" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 15:51:54 user nova-compute[75337]: DEBUG nova.network.neutron [req-26695413-ade4-499e-9d4c-a310f2f4822b req-63b4c342-e900-48bb-9190-e8dd06a01c08 service nova] [instance: 30c634ff-6999-40aa-a90d-1db6d278b571] Refreshing network info cache for port 7b7a4e21-92b6-4854-8c0d-4d9556247a72 {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 15:51:54 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-a9071c1e-f8f5-4db1-a8d3-3e46b37c588b tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] [instance: 30c634ff-6999-40aa-a90d-1db6d278b571] Start _get_guest_xml network_info=[{"id": "7b7a4e21-92b6-4854-8c0d-4d9556247a72", "address": "fa:16:3e:ee:c7:a1", "network": {"id": "6757c3a5-4f6f-48a7-9645-af433fb039de", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1337373982-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e13dfd402b7b4ed1a1092c7388ff5188", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b7a4e21-92", "ovs_interfaceid": "7b7a4e21-92b6-4854-8c0d-4d9556247a72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T15:34:14Z,direct_url=<?>,disk_format='qcow2',id=16b903ae-a40f-41a7-985b-4804cce92c62,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6549a15819f1469bbd5eeae8190e3d44',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T15:34:15Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'guest_format': None, 'size': 0, 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '16b903ae-a40f-41a7-985b-4804cce92c62'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 15:51:54 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-a9071c1e-f8f5-4db1-a8d3-3e46b37c588b tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 15:51:54 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-a9071c1e-f8f5-4db1-a8d3-3e46b37c588b tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 15:51:54 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-a9071c1e-f8f5-4db1-a8d3-3e46b37c588b tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 15:51:54 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-a9071c1e-f8f5-4db1-a8d3-3e46b37c588b tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] CPU controller missing on host. {{(pid=75337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 15:51:54 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-a9071c1e-f8f5-4db1-a8d3-3e46b37c588b tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 15:51:54 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-a9071c1e-f8f5-4db1-a8d3-3e46b37c588b tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] CPU controller found on host. {{(pid=75337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 15:51:54 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-a9071c1e-f8f5-4db1-a8d3-3e46b37c588b tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75337) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 15:51:54 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-a9071c1e-f8f5-4db1-a8d3-3e46b37c588b tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T15:34:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T15:34:14Z,direct_url=<?>,disk_format='qcow2',id=16b903ae-a40f-41a7-985b-4804cce92c62,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6549a15819f1469bbd5eeae8190e3d44',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T15:34:15Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 15:51:54 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-a9071c1e-f8f5-4db1-a8d3-3e46b37c588b tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] Flavor limits 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 15:51:54 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-a9071c1e-f8f5-4db1-a8d3-3e46b37c588b tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] Image limits 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 15:51:54 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-a9071c1e-f8f5-4db1-a8d3-3e46b37c588b tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] Flavor pref 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 15:51:54 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-a9071c1e-f8f5-4db1-a8d3-3e46b37c588b tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] Image pref 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 15:51:54 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-a9071c1e-f8f5-4db1-a8d3-3e46b37c588b tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 15:51:54 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-a9071c1e-f8f5-4db1-a8d3-3e46b37c588b tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 15:51:54 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-a9071c1e-f8f5-4db1-a8d3-3e46b37c588b tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 15:51:54 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-a9071c1e-f8f5-4db1-a8d3-3e46b37c588b tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] Got 1 possible topologies {{(pid=75337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 15:51:54 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-a9071c1e-f8f5-4db1-a8d3-3e46b37c588b tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 15:51:54 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-a9071c1e-f8f5-4db1-a8d3-3e46b37c588b tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 15:51:54 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-a9071c1e-f8f5-4db1-a8d3-3e46b37c588b tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T15:51:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-989606681',display_name='tempest-ServersNegativeTestJSON-server-989606681',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-989606681',id=27,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e13dfd402b7b4ed1a1092c7388ff5188',ramdisk_id='',reservation_id='r-k5gb33hd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-624109021',owner_user_name='tempest-ServersNegativeTestJSON-624109021-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T15:51:53Z,user_data=None,user_id='5691e9e1923f4f2e9fdd3a39d8d7ff20',uuid=30c634ff-6999-40aa-a90d-1db6d278b571,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7b7a4e21-92b6-4854-8c0d-4d9556247a72", "address": "fa:16:3e:ee:c7:a1", "network": {"id": "6757c3a5-4f6f-48a7-9645-af433fb039de", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1337373982-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e13dfd402b7b4ed1a1092c7388ff5188", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b7a4e21-92", "ovs_interfaceid": "7b7a4e21-92b6-4854-8c0d-4d9556247a72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75337) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 15:51:54 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-a9071c1e-f8f5-4db1-a8d3-3e46b37c588b tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] Converting VIF {"id": "7b7a4e21-92b6-4854-8c0d-4d9556247a72", "address": "fa:16:3e:ee:c7:a1", "network": {"id": "6757c3a5-4f6f-48a7-9645-af433fb039de", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1337373982-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e13dfd402b7b4ed1a1092c7388ff5188", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b7a4e21-92", "ovs_interfaceid": "7b7a4e21-92b6-4854-8c0d-4d9556247a72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 15:51:54 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-a9071c1e-f8f5-4db1-a8d3-3e46b37c588b tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:c7:a1,bridge_name='br-int',has_traffic_filtering=True,id=7b7a4e21-92b6-4854-8c0d-4d9556247a72,network=Network(6757c3a5-4f6f-48a7-9645-af433fb039de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b7a4e21-92') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 15:51:54 user nova-compute[75337]: DEBUG nova.objects.instance [None req-a9071c1e-f8f5-4db1-a8d3-3e46b37c588b tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] Lazy-loading 'pci_devices' on Instance uuid 30c634ff-6999-40aa-a90d-1db6d278b571 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 15:51:54 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:51:54 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-a9071c1e-f8f5-4db1-a8d3-3e46b37c588b tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] [instance: 30c634ff-6999-40aa-a90d-1db6d278b571] End _get_guest_xml xml=<domain type="kvm">
Nov 06 15:51:54 user nova-compute[75337]:   <uuid>30c634ff-6999-40aa-a90d-1db6d278b571</uuid>
Nov 06 15:51:54 user nova-compute[75337]:   <name>instance-0000001b</name>
Nov 06 15:51:54 user nova-compute[75337]:   <memory>524288</memory>
Nov 06 15:51:54 user nova-compute[75337]:   <vcpu>1</vcpu>
Nov 06 15:51:54 user nova-compute[75337]:   <metadata>
Nov 06 15:51:54 user nova-compute[75337]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 15:51:54 user nova-compute[75337]:       <nova:package version="0.0.0"/>
Nov 06 15:51:54 user nova-compute[75337]:       <nova:name>tempest-ServersNegativeTestJSON-server-989606681</nova:name>
Nov 06 15:51:54 user nova-compute[75337]:       <nova:creationTime>2023-11-06 15:51:54</nova:creationTime>
Nov 06 15:51:54 user nova-compute[75337]:       <nova:flavor name="m1.tiny">
Nov 06 15:51:54 user nova-compute[75337]:         <nova:memory>512</nova:memory>
Nov 06 15:51:54 user nova-compute[75337]:         <nova:disk>1</nova:disk>
Nov 06 15:51:54 user nova-compute[75337]:         <nova:swap>0</nova:swap>
Nov 06 15:51:54 user nova-compute[75337]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 15:51:54 user nova-compute[75337]:         <nova:vcpus>1</nova:vcpus>
Nov 06 15:51:54 user nova-compute[75337]:       </nova:flavor>
Nov 06 15:51:54 user nova-compute[75337]:       <nova:owner>
Nov 06 15:51:54 user nova-compute[75337]:         <nova:user uuid="5691e9e1923f4f2e9fdd3a39d8d7ff20">tempest-ServersNegativeTestJSON-624109021-project-member</nova:user>
Nov 06 15:51:54 user nova-compute[75337]:         <nova:project uuid="e13dfd402b7b4ed1a1092c7388ff5188">tempest-ServersNegativeTestJSON-624109021</nova:project>
Nov 06 15:51:54 user nova-compute[75337]:       </nova:owner>
Nov 06 15:51:54 user nova-compute[75337]:       <nova:root type="image" uuid="16b903ae-a40f-41a7-985b-4804cce92c62"/>
Nov 06 15:51:54 user nova-compute[75337]:       <nova:ports>
Nov 06 15:51:54 user nova-compute[75337]:         <nova:port uuid="7b7a4e21-92b6-4854-8c0d-4d9556247a72">
Nov 06 15:51:54 user nova-compute[75337]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 06 15:51:54 user nova-compute[75337]:         </nova:port>
Nov 06 15:51:54 user nova-compute[75337]:       </nova:ports>
Nov 06 15:51:54 user nova-compute[75337]:     </nova:instance>
Nov 06 15:51:54 user nova-compute[75337]:   </metadata>
Nov 06 15:51:54 user nova-compute[75337]:   <sysinfo type="smbios">
Nov 06 15:51:54 user nova-compute[75337]:     <system>
Nov 06 15:51:54 user nova-compute[75337]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 15:51:54 user nova-compute[75337]:       <entry name="product">OpenStack Nova</entry>
Nov 06 15:51:54 user nova-compute[75337]:       <entry name="version">0.0.0</entry>
Nov 06 15:51:54 user nova-compute[75337]:       <entry name="serial">30c634ff-6999-40aa-a90d-1db6d278b571</entry>
Nov 06 15:51:54 user nova-compute[75337]:       <entry name="uuid">30c634ff-6999-40aa-a90d-1db6d278b571</entry>
Nov 06 15:51:54 user nova-compute[75337]:       <entry name="family">Virtual Machine</entry>
Nov 06 15:51:54 user nova-compute[75337]:     </system>
Nov 06 15:51:54 user nova-compute[75337]:   </sysinfo>
Nov 06 15:51:54 user nova-compute[75337]:   <os>
Nov 06 15:51:54 user nova-compute[75337]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 15:51:54 user nova-compute[75337]:     <boot dev="hd"/>
Nov 06 15:51:54 user nova-compute[75337]:     <smbios mode="sysinfo"/>
Nov 06 15:51:54 user nova-compute[75337]:   </os>
Nov 06 15:51:54 user nova-compute[75337]:   <features>
Nov 06 15:51:54 user nova-compute[75337]:     <acpi/>
Nov 06 15:51:54 user nova-compute[75337]:     <apic/>
Nov 06 15:51:54 user nova-compute[75337]:     <vmcoreinfo/>
Nov 06 15:51:54 user nova-compute[75337]:   </features>
Nov 06 15:51:54 user nova-compute[75337]:   <clock offset="utc">
Nov 06 15:51:54 user nova-compute[75337]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 15:51:54 user nova-compute[75337]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 15:51:54 user nova-compute[75337]:     <timer name="hpet" present="no"/>
Nov 06 15:51:54 user nova-compute[75337]:   </clock>
Nov 06 15:51:54 user nova-compute[75337]:   <cpu mode="custom" match="exact">
Nov 06 15:51:54 user nova-compute[75337]:     <model>Nehalem</model>
Nov 06 15:51:54 user nova-compute[75337]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 15:51:54 user nova-compute[75337]:   </cpu>
Nov 06 15:51:54 user nova-compute[75337]:   <devices>
Nov 06 15:51:54 user nova-compute[75337]:     <disk type="file" device="disk">
Nov 06 15:51:54 user nova-compute[75337]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 15:51:54 user nova-compute[75337]:       <source file="/opt/stack/data/nova/instances/30c634ff-6999-40aa-a90d-1db6d278b571/disk"/>
Nov 06 15:51:54 user nova-compute[75337]:       <target dev="vda" bus="virtio"/>
Nov 06 15:51:54 user nova-compute[75337]:     </disk>
Nov 06 15:51:54 user nova-compute[75337]:     <interface type="ethernet">
Nov 06 15:51:54 user nova-compute[75337]:       <mac address="fa:16:3e:ee:c7:a1"/>
Nov 06 15:51:54 user nova-compute[75337]:       <model type="virtio"/>
Nov 06 15:51:54 user nova-compute[75337]:       <mtu size="1442"/>
Nov 06 15:51:54 user nova-compute[75337]:       <target dev="tap7b7a4e21-92"/>
Nov 06 15:51:54 user nova-compute[75337]:     </interface>
Nov 06 15:51:54 user nova-compute[75337]:     <serial type="pty">
Nov 06 15:51:54 user nova-compute[75337]:       <log file="/opt/stack/data/nova/instances/30c634ff-6999-40aa-a90d-1db6d278b571/console.log" append="off"/>
Nov 06 15:51:54 user nova-compute[75337]:     </serial>
Nov 06 15:51:54 user nova-compute[75337]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 15:51:54 user nova-compute[75337]:     <video>
Nov 06 15:51:54 user nova-compute[75337]:       <model type="virtio"/>
Nov 06 15:51:54 user nova-compute[75337]:     </video>
Nov 06 15:51:54 user nova-compute[75337]:     <rng model="virtio">
Nov 06 15:51:54 user nova-compute[75337]:       <backend model="random">/dev/urandom</backend>
Nov 06 15:51:54 user nova-compute[75337]:     </rng>
Nov 06 15:51:54 user nova-compute[75337]:     <controller type="usb" index="0" model="none"/>
Nov 06 15:51:54 user nova-compute[75337]:     <memballoon model="virtio">
Nov 06 15:51:54 user nova-compute[75337]:       <stats period="10"/>
Nov 06 15:51:54 user nova-compute[75337]:     </memballoon>
Nov 06 15:51:54 user nova-compute[75337]:   </devices>
Nov 06 15:51:54 user nova-compute[75337]: </domain>
Nov 06 15:51:54 user nova-compute[75337]:  {{(pid=75337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 15:51:54 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-a9071c1e-f8f5-4db1-a8d3-3e46b37c588b tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T15:51:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-989606681',display_name='tempest-ServersNegativeTestJSON-server-989606681',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-989606681',id=27,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e13dfd402b7b4ed1a1092c7388ff5188',ramdisk_id='',reservation_id='r-k5gb33hd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-624109021',owner_user_name='tempest-ServersNegativeTestJSON-624109021-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T15:51:53Z,user_data=None,user_id='5691e9e1923f4f2e9fdd3a39d8d7ff20',uuid=30c634ff-6999-40aa-a90d-1db6d278b571,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7b7a4e21-92b6-4854-8c0d-4d9556247a72", "address": "fa:16:3e:ee:c7:a1", "network": {"id": "6757c3a5-4f6f-48a7-9645-af433fb039de", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1337373982-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e13dfd402b7b4ed1a1092c7388ff5188", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b7a4e21-92", "ovs_interfaceid": "7b7a4e21-92b6-4854-8c0d-4d9556247a72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 15:51:54 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-a9071c1e-f8f5-4db1-a8d3-3e46b37c588b tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] Converting VIF {"id": "7b7a4e21-92b6-4854-8c0d-4d9556247a72", "address": "fa:16:3e:ee:c7:a1", "network": {"id": "6757c3a5-4f6f-48a7-9645-af433fb039de", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1337373982-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e13dfd402b7b4ed1a1092c7388ff5188", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b7a4e21-92", "ovs_interfaceid": "7b7a4e21-92b6-4854-8c0d-4d9556247a72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 15:51:54 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-a9071c1e-f8f5-4db1-a8d3-3e46b37c588b tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:c7:a1,bridge_name='br-int',has_traffic_filtering=True,id=7b7a4e21-92b6-4854-8c0d-4d9556247a72,network=Network(6757c3a5-4f6f-48a7-9645-af433fb039de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b7a4e21-92') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 15:51:54 user nova-compute[75337]: DEBUG os_vif [None req-a9071c1e-f8f5-4db1-a8d3-3e46b37c588b tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:c7:a1,bridge_name='br-int',has_traffic_filtering=True,id=7b7a4e21-92b6-4854-8c0d-4d9556247a72,network=Network(6757c3a5-4f6f-48a7-9645-af433fb039de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b7a4e21-92') {{(pid=75337) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 15:51:54 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:51:54 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:51:54 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 15:51:54 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:51:54 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '51cce9ff-7195-507a-a948-7266e9adbdd3', '_type': 'linux-noop'}}, row=False) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:51:54 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:51:54 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:51:54 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:51:54 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7b7a4e21-92, may_exist=True, interface_attrs={}) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:51:54 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7b7a4e21-92, col_values=(('qos', UUID('c7b905c3-f707-43ca-9800-b672aadb06e8')),), if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:51:54 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7b7a4e21-92, col_values=(('external_ids', {'iface-id': '7b7a4e21-92b6-4854-8c0d-4d9556247a72', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ee:c7:a1', 'vm-uuid': '30c634ff-6999-40aa-a90d-1db6d278b571'}),), if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:51:54 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:51:54 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:51:54 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:51:54 user nova-compute[75337]: INFO os_vif [None req-a9071c1e-f8f5-4db1-a8d3-3e46b37c588b tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:c7:a1,bridge_name='br-int',has_traffic_filtering=True,id=7b7a4e21-92b6-4854-8c0d-4d9556247a72,network=Network(6757c3a5-4f6f-48a7-9645-af433fb039de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b7a4e21-92')
Nov 06 15:51:54 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-a9071c1e-f8f5-4db1-a8d3-3e46b37c588b tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] No BDM found with device name vda, not building metadata. {{(pid=75337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 15:51:54 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-a9071c1e-f8f5-4db1-a8d3-3e46b37c588b tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] No VIF found with MAC fa:16:3e:ee:c7:a1, not building metadata {{(pid=75337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 15:51:55 user nova-compute[75337]: DEBUG nova.network.neutron [req-26695413-ade4-499e-9d4c-a310f2f4822b req-63b4c342-e900-48bb-9190-e8dd06a01c08 service nova] [instance: 30c634ff-6999-40aa-a90d-1db6d278b571] Updated VIF entry in instance network info cache for port 7b7a4e21-92b6-4854-8c0d-4d9556247a72. {{(pid=75337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 15:51:55 user nova-compute[75337]: DEBUG nova.network.neutron [req-26695413-ade4-499e-9d4c-a310f2f4822b req-63b4c342-e900-48bb-9190-e8dd06a01c08 service nova] [instance: 30c634ff-6999-40aa-a90d-1db6d278b571] Updating instance_info_cache with network_info: [{"id": "7b7a4e21-92b6-4854-8c0d-4d9556247a72", "address": "fa:16:3e:ee:c7:a1", "network": {"id": "6757c3a5-4f6f-48a7-9645-af433fb039de", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1337373982-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e13dfd402b7b4ed1a1092c7388ff5188", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b7a4e21-92", "ovs_interfaceid": "7b7a4e21-92b6-4854-8c0d-4d9556247a72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:51:55 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-26695413-ade4-499e-9d4c-a310f2f4822b req-63b4c342-e900-48bb-9190-e8dd06a01c08 service nova] Releasing lock "refresh_cache-30c634ff-6999-40aa-a90d-1db6d278b571" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 15:51:56 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:51:56 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:51:56 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:51:56 user nova-compute[75337]: DEBUG nova.compute.manager [req-ee24794b-1fb2-42a9-b678-901da976c49c req-e8d90faf-3f23-477c-9c0d-b6755e1ad671 service nova] [instance: 30c634ff-6999-40aa-a90d-1db6d278b571] Received event network-vif-plugged-7b7a4e21-92b6-4854-8c0d-4d9556247a72 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:51:56 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-ee24794b-1fb2-42a9-b678-901da976c49c req-e8d90faf-3f23-477c-9c0d-b6755e1ad671 service nova] Acquiring lock "30c634ff-6999-40aa-a90d-1db6d278b571-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:51:56 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-ee24794b-1fb2-42a9-b678-901da976c49c req-e8d90faf-3f23-477c-9c0d-b6755e1ad671 service nova] Lock "30c634ff-6999-40aa-a90d-1db6d278b571-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:51:56 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-ee24794b-1fb2-42a9-b678-901da976c49c req-e8d90faf-3f23-477c-9c0d-b6755e1ad671 service nova] Lock "30c634ff-6999-40aa-a90d-1db6d278b571-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:51:56 user nova-compute[75337]: DEBUG nova.compute.manager [req-ee24794b-1fb2-42a9-b678-901da976c49c req-e8d90faf-3f23-477c-9c0d-b6755e1ad671 service nova] [instance: 30c634ff-6999-40aa-a90d-1db6d278b571] No waiting events found dispatching network-vif-plugged-7b7a4e21-92b6-4854-8c0d-4d9556247a72 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:51:56 user nova-compute[75337]: WARNING nova.compute.manager [req-ee24794b-1fb2-42a9-b678-901da976c49c req-e8d90faf-3f23-477c-9c0d-b6755e1ad671 service nova] [instance: 30c634ff-6999-40aa-a90d-1db6d278b571] Received unexpected event network-vif-plugged-7b7a4e21-92b6-4854-8c0d-4d9556247a72 for instance with vm_state building and task_state spawning.
Nov 06 15:51:57 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:51:57 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:51:57 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:51:58 user nova-compute[75337]: DEBUG nova.compute.manager [None req-0e4ad819-a62e-4b45-bac0-b8d5d7278f5c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 582702ee-b8f8-49e4-9853-68af15420702] Start spawning the instance on the hypervisor. {{(pid=75337) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 15:51:58 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-0e4ad819-a62e-4b45-bac0-b8d5d7278f5c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 582702ee-b8f8-49e4-9853-68af15420702] Creating instance directory {{(pid=75337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 15:51:58 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-0e4ad819-a62e-4b45-bac0-b8d5d7278f5c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 582702ee-b8f8-49e4-9853-68af15420702] Creating image(s)
Nov 06 15:51:58 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-0e4ad819-a62e-4b45-bac0-b8d5d7278f5c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 582702ee-b8f8-49e4-9853-68af15420702] Did not create local disks {{(pid=75337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 06 15:51:58 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-0e4ad819-a62e-4b45-bac0-b8d5d7278f5c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 582702ee-b8f8-49e4-9853-68af15420702] Ensure instance console log exists: /opt/stack/data/nova/instances/582702ee-b8f8-49e4-9853-68af15420702/console.log {{(pid=75337) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 15:51:58 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-0e4ad819-a62e-4b45-bac0-b8d5d7278f5c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:51:58 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-0e4ad819-a62e-4b45-bac0-b8d5d7278f5c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:51:58 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-0e4ad819-a62e-4b45-bac0-b8d5d7278f5c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:51:58 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-0e4ad819-a62e-4b45-bac0-b8d5d7278f5c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 582702ee-b8f8-49e4-9853-68af15420702] Start _get_guest_xml network_info=[{"id": "bb02742a-5f8a-4501-95e6-dddfef111f50", "address": "fa:16:3e:ad:0d:f6", "network": {"id": "4e47319f-de1d-4dfe-9915-7d2d5131704d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-895093240-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "915211c6a2734c36b34ff92a56b085f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb02742a-5f", "ovs_interfaceid": "bb02742a-5f8a-4501-95e6-dddfef111f50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-06T15:51:01Z,direct_url=<?>,disk_format='qcow2',id=2bee7244-800a-42ea-84d9-fd07b594c96b,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1381860465',owner='915211c6a2734c36b34ff92a56b085f6',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-06T15:51:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'attachment_id': '4e051f49-1f7f-4e89-8e26-d17840b342da', 'guest_format': None, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ea7e84b5-25b5-4146-a33b-f23a700deadf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'woWvDGfZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '582702ee-b8f8-49e4-9853-68af15420702', 'attached_at': '', 'detached_at': '', 'volume_id': 'ea7e84b5-25b5-4146-a33b-f23a700deadf', 'serial': 'ea7e84b5-25b5-4146-a33b-f23a700deadf'}, 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=75337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 15:51:58 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-0e4ad819-a62e-4b45-bac0-b8d5d7278f5c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 15:51:58 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-0e4ad819-a62e-4b45-bac0-b8d5d7278f5c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 15:51:58 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-0e4ad819-a62e-4b45-bac0-b8d5d7278f5c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 15:51:58 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-0e4ad819-a62e-4b45-bac0-b8d5d7278f5c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] CPU controller missing on host. {{(pid=75337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 15:51:58 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-0e4ad819-a62e-4b45-bac0-b8d5d7278f5c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 15:51:58 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-0e4ad819-a62e-4b45-bac0-b8d5d7278f5c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] CPU controller found on host. {{(pid=75337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 15:51:58 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-0e4ad819-a62e-4b45-bac0-b8d5d7278f5c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75337) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 15:51:58 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-0e4ad819-a62e-4b45-bac0-b8d5d7278f5c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T15:34:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-06T15:51:01Z,direct_url=<?>,disk_format='qcow2',id=2bee7244-800a-42ea-84d9-fd07b594c96b,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1381860465',owner='915211c6a2734c36b34ff92a56b085f6',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-06T15:51:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 15:51:58 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-0e4ad819-a62e-4b45-bac0-b8d5d7278f5c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Flavor limits 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 15:51:58 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-0e4ad819-a62e-4b45-bac0-b8d5d7278f5c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Image limits 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 15:51:58 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-0e4ad819-a62e-4b45-bac0-b8d5d7278f5c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Flavor pref 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 15:51:58 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-0e4ad819-a62e-4b45-bac0-b8d5d7278f5c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Image pref 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 15:51:58 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-0e4ad819-a62e-4b45-bac0-b8d5d7278f5c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 15:51:58 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-0e4ad819-a62e-4b45-bac0-b8d5d7278f5c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 15:51:58 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-0e4ad819-a62e-4b45-bac0-b8d5d7278f5c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 15:51:58 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-0e4ad819-a62e-4b45-bac0-b8d5d7278f5c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Got 1 possible topologies {{(pid=75337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 15:51:58 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-0e4ad819-a62e-4b45-bac0-b8d5d7278f5c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 15:51:58 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-0e4ad819-a62e-4b45-bac0-b8d5d7278f5c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 15:51:58 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e4ad819-a62e-4b45-bac0-b8d5d7278f5c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 582702ee-b8f8-49e4-9853-68af15420702] Calling os-brick to attach iSCSI Volume {{(pid=75337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 15:51:58 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e4ad819-a62e-4b45-bac0-b8d5d7278f5c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2abc33d0c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ea7e84b5-25b5-4146-a33b-f23a700deadf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'woWvDGfZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 15:51:58 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-0e4ad819-a62e-4b45-bac0-b8d5d7278f5c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 15:51:58 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-0e4ad819-a62e-4b45-bac0-b8d5d7278f5c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 15:51:58 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-0e4ad819-a62e-4b45-bac0-b8d5d7278f5c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 15:51:58 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-0e4ad819-a62e-4b45-bac0-b8d5d7278f5c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 15:51:58 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-0e4ad819-a62e-4b45-bac0-b8d5d7278f5c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ea7e84b5-25b5-4146-a33b-f23a700deadf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 15:51:58 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-0e4ad819-a62e-4b45-bac0-b8d5d7278f5c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ea7e84b5-25b5-4146-a33b-f23a700deadf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 15:51:58 user nova-compute[75337]: INFO os_brick.initiator.connectors.iscsi [None req-0e4ad819-a62e-4b45-bac0-b8d5d7278f5c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 15:51:58 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea7e84b5-25b5-4146-a33b-f23a700deadf -p 172.16.0.220:3260 {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:51:58 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea7e84b5-25b5-4146-a33b-f23a700deadf -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:51:58 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[d13e7cf5-bc86-44aa-8602-66c8ad68d21f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:51:58 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e4ad819-a62e-4b45-bac0-b8d5d7278f5c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 15:51:58 user nova-compute[75337]:  {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:51:58 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea7e84b5-25b5-4146-a33b-f23a700deadf -p 172.16.0.220:3260 --interface default --op new {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:51:58 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea7e84b5-25b5-4146-a33b-f23a700deadf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:51:58 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b4cc378-69ff-4f2c-ac9c-b4084c4b33de]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ea7e84b5-25b5-4146-a33b-f23a700deadf] added\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:51:58 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e4ad819-a62e-4b45-bac0-b8d5d7278f5c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ea7e84b5-25b5-4146-a33b-f23a700deadf] added
Nov 06 15:51:58 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:51:58 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea7e84b5-25b5-4146-a33b-f23a700deadf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:51:58 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea7e84b5-25b5-4146-a33b-f23a700deadf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:51:58 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac2b3e40-bb2c-47b7-9bd0-e4eec7dfc048]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:51:58 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e4ad819-a62e-4b45-bac0-b8d5d7278f5c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:51:58 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea7e84b5-25b5-4146-a33b-f23a700deadf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:51:58 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea7e84b5-25b5-4146-a33b-f23a700deadf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:51:58 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[c157f397-2d09-4149-8a12-81a2f3c9a448]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:51:58 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e4ad819-a62e-4b45-bac0-b8d5d7278f5c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:51:58 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea7e84b5-25b5-4146-a33b-f23a700deadf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v woWvDGfZ {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:51:58 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea7e84b5-25b5-4146-a33b-f23a700deadf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v woWvDGfZ" returned: 0 in 0.019s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:51:58 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a3bdf84-e3e9-41b3-b7c2-c77760ab8971]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:51:58 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e4ad819-a62e-4b45-bac0-b8d5d7278f5c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'woWvDGfZ'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:51:58 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea7e84b5-25b5-4146-a33b-f23a700deadf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:51:58 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea7e84b5-25b5-4146-a33b-f23a700deadf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:51:58 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdf82687-fb39-4c1a-bca5-184eecb79180]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:51:58 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e4ad819-a62e-4b45-bac0-b8d5d7278f5c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:51:58 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:51:58 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:51:58 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[1545e53b-5d0d-44ed-8ec8-f289bc7fc2b2]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2086a611-973d-47a1-bb69-f2ebd144be03 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc5eae50-0461-47ca-bc48-cb38087b06e0 (non-flash)\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:51:58 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e4ad819-a62e-4b45-bac0-b8d5d7278f5c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)
Nov 06 15:51:58 user nova-compute[75337]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2086a611-973d-47a1-bb69-f2ebd144be03 (non-flash)
Nov 06 15:51:58 user nova-compute[75337]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc5eae50-0461-47ca-bc48-cb38087b06e0 (non-flash)
Nov 06 15:51:58 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 15:51:58 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e4ad819-a62e-4b45-bac0-b8d5d7278f5c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)
Nov 06 15:51:58 user nova-compute[75337]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2086a611-973d-47a1-bb69-f2ebd144be03 (non-flash)
Nov 06 15:51:58 user nova-compute[75337]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc5eae50-0461-47ca-bc48-cb38087b06e0 (non-flash)
Nov 06 15:51:58 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 15:51:58 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea7e84b5-25b5-4146-a33b-f23a700deadf -p 172.16.0.220:3260 --login {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:51:58 user nova-compute[75337]: DEBUG nova.compute.manager [req-d7ec9924-d09e-4599-8840-e1f1ab009949 req-204eea77-d0a5-451b-9896-f600c84632e6 service nova] [instance: 30c634ff-6999-40aa-a90d-1db6d278b571] Received event network-vif-plugged-7b7a4e21-92b6-4854-8c0d-4d9556247a72 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:51:58 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-d7ec9924-d09e-4599-8840-e1f1ab009949 req-204eea77-d0a5-451b-9896-f600c84632e6 service nova] Acquiring lock "30c634ff-6999-40aa-a90d-1db6d278b571-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:51:58 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-d7ec9924-d09e-4599-8840-e1f1ab009949 req-204eea77-d0a5-451b-9896-f600c84632e6 service nova] Lock "30c634ff-6999-40aa-a90d-1db6d278b571-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:51:58 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-d7ec9924-d09e-4599-8840-e1f1ab009949 req-204eea77-d0a5-451b-9896-f600c84632e6 service nova] Lock "30c634ff-6999-40aa-a90d-1db6d278b571-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:51:58 user nova-compute[75337]: DEBUG nova.compute.manager [req-d7ec9924-d09e-4599-8840-e1f1ab009949 req-204eea77-d0a5-451b-9896-f600c84632e6 service nova] [instance: 30c634ff-6999-40aa-a90d-1db6d278b571] No waiting events found dispatching network-vif-plugged-7b7a4e21-92b6-4854-8c0d-4d9556247a72 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:51:58 user nova-compute[75337]: WARNING nova.compute.manager [req-d7ec9924-d09e-4599-8840-e1f1ab009949 req-204eea77-d0a5-451b-9896-f600c84632e6 service nova] [instance: 30c634ff-6999-40aa-a90d-1db6d278b571] Received unexpected event network-vif-plugged-7b7a4e21-92b6-4854-8c0d-4d9556247a72 for instance with vm_state building and task_state spawning.
Nov 06 15:51:58 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea7e84b5-25b5-4146-a33b-f23a700deadf -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:51:58 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[068f5b1c-7a98-4b4f-b3d2-4db5efc96f5e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ea7e84b5-25b5-4146-a33b-f23a700deadf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ea7e84b5-25b5-4146-a33b-f23a700deadf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:51:58 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e4ad819-a62e-4b45-bac0-b8d5d7278f5c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ea7e84b5-25b5-4146-a33b-f23a700deadf, portal: 172.16.0.220,3260]
Nov 06 15:51:58 user nova-compute[75337]: Login to [iface: default, target: iqn.2010-10.org.openstack:ea7e84b5-25b5-4146-a33b-f23a700deadf, portal: 172.16.0.220,3260] successful.
Nov 06 15:51:58 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:51:58 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea7e84b5-25b5-4146-a33b-f23a700deadf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:51:58 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea7e84b5-25b5-4146-a33b-f23a700deadf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:51:58 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[284ff0f3-e197-4249-8f9e-f10a80ec6731]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:51:58 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e4ad819-a62e-4b45-bac0-b8d5d7278f5c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:51:58 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:51:58 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:51:58 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[0934a338-dcc9-4271-9edb-497de547cfe9]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2086a611-973d-47a1-bb69-f2ebd144be03 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc5eae50-0461-47ca-bc48-cb38087b06e0 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea7e84b5-25b5-4146-a33b-f23a700deadf (non-flash)\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:51:58 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e4ad819-a62e-4b45-bac0-b8d5d7278f5c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)
Nov 06 15:51:58 user nova-compute[75337]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2086a611-973d-47a1-bb69-f2ebd144be03 (non-flash)
Nov 06 15:51:58 user nova-compute[75337]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc5eae50-0461-47ca-bc48-cb38087b06e0 (non-flash)
Nov 06 15:51:58 user nova-compute[75337]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea7e84b5-25b5-4146-a33b-f23a700deadf (non-flash)
Nov 06 15:51:58 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 15:51:58 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e4ad819-a62e-4b45-bac0-b8d5d7278f5c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)
Nov 06 15:51:58 user nova-compute[75337]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2086a611-973d-47a1-bb69-f2ebd144be03 (non-flash)
Nov 06 15:51:58 user nova-compute[75337]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc5eae50-0461-47ca-bc48-cb38087b06e0 (non-flash)
Nov 06 15:51:58 user nova-compute[75337]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea7e84b5-25b5-4146-a33b-f23a700deadf (non-flash)
Nov 06 15:51:58 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 15:51:58 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-0e4ad819-a62e-4b45-bac0-b8d5d7278f5c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ea7e84b5-25b5-4146-a33b-f23a700deadf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.305s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 15:51:58 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e4ad819-a62e-4b45-bac0-b8d5d7278f5c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Connected to 172.16.0.220:3260 {{(pid=75337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 15:51:58 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-0e4ad819-a62e-4b45-bac0-b8d5d7278f5c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] HCTL ('35', '-', '-', 0) found on session 31 with lun 0 {{(pid=75337) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 15:51:58 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-0e4ad819-a62e-4b45-bac0-b8d5d7278f5c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75337) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 15:51:58 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:51:58 user nova-compute[75337]: DEBUG nova.compute.manager [None req-a9071c1e-f8f5-4db1-a8d3-3e46b37c588b tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] [instance: 30c634ff-6999-40aa-a90d-1db6d278b571] Instance event wait completed in 0 seconds for  {{(pid=75337) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 15:51:58 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-a9071c1e-f8f5-4db1-a8d3-3e46b37c588b tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] [instance: 30c634ff-6999-40aa-a90d-1db6d278b571] Guest created on hypervisor {{(pid=75337) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 15:51:58 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:51:58 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[15eb3232-68bc-4952-ae9e-2695964b3d08]: (4, ('- - 0', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:51:58 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-0e4ad819-a62e-4b45-bac0-b8d5d7278f5c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Searching for a device in session 31 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75337) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 15:51:58 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e4ad819-a62e-4b45-bac0-b8d5d7278f5c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:ea7e84b5-25b5-4146-a33b-f23a700deadf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'woWvDGfZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 15:51:58 user nova-compute[75337]: INFO nova.virt.libvirt.driver [-] [instance: 30c634ff-6999-40aa-a90d-1db6d278b571] Instance spawned successfully.
Nov 06 15:51:58 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-a9071c1e-f8f5-4db1-a8d3-3e46b37c588b tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] [instance: 30c634ff-6999-40aa-a90d-1db6d278b571] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 15:51:58 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-a9071c1e-f8f5-4db1-a8d3-3e46b37c588b tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] [instance: 30c634ff-6999-40aa-a90d-1db6d278b571] Found default for hw_cdrom_bus of ide {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:51:58 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-a9071c1e-f8f5-4db1-a8d3-3e46b37c588b tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] [instance: 30c634ff-6999-40aa-a90d-1db6d278b571] Found default for hw_disk_bus of virtio {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:51:58 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-a9071c1e-f8f5-4db1-a8d3-3e46b37c588b tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] [instance: 30c634ff-6999-40aa-a90d-1db6d278b571] Found default for hw_input_bus of None {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:51:58 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-a9071c1e-f8f5-4db1-a8d3-3e46b37c588b tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] [instance: 30c634ff-6999-40aa-a90d-1db6d278b571] Found default for hw_pointer_model of None {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:51:58 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-a9071c1e-f8f5-4db1-a8d3-3e46b37c588b tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] [instance: 30c634ff-6999-40aa-a90d-1db6d278b571] Found default for hw_video_model of virtio {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:51:58 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-a9071c1e-f8f5-4db1-a8d3-3e46b37c588b tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] [instance: 30c634ff-6999-40aa-a90d-1db6d278b571] Found default for hw_vif_model of virtio {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:51:59 user nova-compute[75337]: INFO nova.compute.manager [None req-a9071c1e-f8f5-4db1-a8d3-3e46b37c588b tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] [instance: 30c634ff-6999-40aa-a90d-1db6d278b571] Took 6.15 seconds to spawn the instance on the hypervisor.
Nov 06 15:51:59 user nova-compute[75337]: DEBUG nova.compute.manager [None req-a9071c1e-f8f5-4db1-a8d3-3e46b37c588b tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] [instance: 30c634ff-6999-40aa-a90d-1db6d278b571] Checking state {{(pid=75337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 15:51:59 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-f1dbb214-ac3c-44f5-bace-4c1828ffd612 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance bc0e07f8-2731-4ffa-8446-b71ad3ba7375 is timed out.
Nov 06 15:51:59 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-f1dbb214-ac3c-44f5-bace-4c1828ffd612 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Successfully detached device vdb from instance bc0e07f8-2731-4ffa-8446-b71ad3ba7375 from the live domain config.
Nov 06 15:51:59 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f1dbb214-ac3c-44f5-bace-4c1828ffd612 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] [instance: bc0e07f8-2731-4ffa-8446-b71ad3ba7375] calling os-brick to detach iSCSI Volume {{(pid=75337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 15:51:59 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1dbb214-ac3c-44f5-bace-4c1828ffd612 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2abc33d0c0>, {'target_iqn': 'iqn.2010-10.org.openstack:dc5eae50-0461-47ca-bc48-cb38087b06e0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oFQjZJSv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 15:51:59 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-f1dbb214-ac3c-44f5-bace-4c1828ffd612 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 15:51:59 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-f1dbb214-ac3c-44f5-bace-4c1828ffd612 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 15:51:59 user nova-compute[75337]: INFO nova.compute.manager [None req-a9071c1e-f8f5-4db1-a8d3-3e46b37c588b tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] [instance: 30c634ff-6999-40aa-a90d-1db6d278b571] Took 6.98 seconds to build instance.
Nov 06 15:51:59 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:51:59 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-a9071c1e-f8f5-4db1-a8d3-3e46b37c588b tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] Lock "30c634ff-6999-40aa-a90d-1db6d278b571" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.091s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:51:59 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-0e4ad819-a62e-4b45-bac0-b8d5d7278f5c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.343s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 15:51:59 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e4ad819-a62e-4b45-bac0-b8d5d7278f5c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] <== connect_volume: return (1345ms) {'type': 'block', 'scsi_wwn': '26632323563326436', 'path': '/dev/sdd'} {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 15:51:59 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e4ad819-a62e-4b45-bac0-b8d5d7278f5c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 582702ee-b8f8-49e4-9853-68af15420702] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26632323563326436', 'path': '/dev/sdd'} {{(pid=75337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 15:51:59 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-f1dbb214-ac3c-44f5-bace-4c1828ffd612 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.649s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 15:51:59 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:51:59 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-0e4ad819-a62e-4b45-bac0-b8d5d7278f5c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T15:51:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-952025564',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-952025564',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-952025564',id=26,image_ref='2bee7244-800a-42ea-84d9-fd07b594c96b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKlScEkzVEQMrehWzpcP7Bc5Ul3eAwFFKSqPfrvuaI3YYtxPPA9nEt6b8+tMM5ow/PMSrbgmuBWSdH2Bjlj8cAbtyksWWE3/81OuURY95MC6TFoP6MMxmwg/TY2kiVLpvw==',key_name='tempest-keypair-1227078778',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='915211c6a2734c36b34ff92a56b085f6',ramdisk_id='',reservation_id='r-2sh003gg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1055092640',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1055092640-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1055092640',owner_user_name='tempest-TestVolumeBootPattern-1055092640-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T15:51:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bb8d5f0200124588be1cfde107341a45',uuid=582702ee-b8f8-49e4-9853-68af15420702,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bb02742a-5f8a-4501-95e6-dddfef111f50", "address": "fa:16:3e:ad:0d:f6", "network": {"id": "4e47319f-de1d-4dfe-9915-7d2d5131704d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-895093240-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "915211c6a2734c36b34ff92a56b085f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb02742a-5f", "ovs_interfaceid": "bb02742a-5f8a-4501-95e6-dddfef111f50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75337) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 15:51:59 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-0e4ad819-a62e-4b45-bac0-b8d5d7278f5c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Converting VIF {"id": "bb02742a-5f8a-4501-95e6-dddfef111f50", "address": "fa:16:3e:ad:0d:f6", "network": {"id": "4e47319f-de1d-4dfe-9915-7d2d5131704d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-895093240-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "915211c6a2734c36b34ff92a56b085f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb02742a-5f", "ovs_interfaceid": "bb02742a-5f8a-4501-95e6-dddfef111f50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 15:51:59 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-0e4ad819-a62e-4b45-bac0-b8d5d7278f5c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:0d:f6,bridge_name='br-int',has_traffic_filtering=True,id=bb02742a-5f8a-4501-95e6-dddfef111f50,network=Network(4e47319f-de1d-4dfe-9915-7d2d5131704d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb02742a-5f') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 15:51:59 user nova-compute[75337]: DEBUG nova.objects.instance [None req-0e4ad819-a62e-4b45-bac0-b8d5d7278f5c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Lazy-loading 'pci_devices' on Instance uuid 582702ee-b8f8-49e4-9853-68af15420702 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 15:51:59 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:51:59 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef60b172-2421-4db1-b3c0-d2443e7278b2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dc5eae50-0461-47ca-bc48-cb38087b06e0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ea7e84b5-25b5-4146-a33b-f23a700deadf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2086a611-973d-47a1-bb69-f2ebd144be03\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:51:59 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1dbb214-ac3c-44f5-bace-4c1828ffd612 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 15:51:59 user nova-compute[75337]: No targets found.
Nov 06 15:51:59 user nova-compute[75337]: iSNS:
Nov 06 15:51:59 user nova-compute[75337]: No targets found.
Nov 06 15:51:59 user nova-compute[75337]: STATIC:
Nov 06 15:51:59 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158
Nov 06 15:51:59 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 15:51:59 user nova-compute[75337]:                 Iface Name: default
Nov 06 15:51:59 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:dc5eae50-0461-47ca-bc48-cb38087b06e0
Nov 06 15:51:59 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 15:51:59 user nova-compute[75337]:                 Iface Name: default
Nov 06 15:51:59 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:ea7e84b5-25b5-4146-a33b-f23a700deadf
Nov 06 15:51:59 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 15:51:59 user nova-compute[75337]:                 Iface Name: default
Nov 06 15:51:59 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:2086a611-973d-47a1-bb69-f2ebd144be03
Nov 06 15:51:59 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 15:51:59 user nova-compute[75337]:                 Iface Name: default
Nov 06 15:51:59 user nova-compute[75337]: FIRMWARE:
Nov 06 15:51:59 user nova-compute[75337]: No targets found.
Nov 06 15:51:59 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 15:51:59 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1dbb214-ac3c-44f5-bace-4c1828ffd612 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 15:51:59 user nova-compute[75337]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 15:51:59 user nova-compute[75337]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75337) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 15:51:59 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1dbb214-ac3c-44f5-bace-4c1828ffd612 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dc5eae50-0461-47ca-bc48-cb38087b06e0', 0)] {{(pid=75337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 15:51:59 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:51:59 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-0e4ad819-a62e-4b45-bac0-b8d5d7278f5c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 582702ee-b8f8-49e4-9853-68af15420702] End _get_guest_xml xml=<domain type="kvm">
Nov 06 15:51:59 user nova-compute[75337]:   <uuid>582702ee-b8f8-49e4-9853-68af15420702</uuid>
Nov 06 15:51:59 user nova-compute[75337]:   <name>instance-0000001a</name>
Nov 06 15:51:59 user nova-compute[75337]:   <memory>524288</memory>
Nov 06 15:51:59 user nova-compute[75337]:   <vcpu>1</vcpu>
Nov 06 15:51:59 user nova-compute[75337]:   <metadata>
Nov 06 15:51:59 user nova-compute[75337]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 15:51:59 user nova-compute[75337]:       <nova:package version="0.0.0"/>
Nov 06 15:51:59 user nova-compute[75337]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-952025564</nova:name>
Nov 06 15:51:59 user nova-compute[75337]:       <nova:creationTime>2023-11-06 15:51:58</nova:creationTime>
Nov 06 15:51:59 user nova-compute[75337]:       <nova:flavor name="m1.tiny">
Nov 06 15:51:59 user nova-compute[75337]:         <nova:memory>512</nova:memory>
Nov 06 15:51:59 user nova-compute[75337]:         <nova:disk>1</nova:disk>
Nov 06 15:51:59 user nova-compute[75337]:         <nova:swap>0</nova:swap>
Nov 06 15:51:59 user nova-compute[75337]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 15:51:59 user nova-compute[75337]:         <nova:vcpus>1</nova:vcpus>
Nov 06 15:51:59 user nova-compute[75337]:       </nova:flavor>
Nov 06 15:51:59 user nova-compute[75337]:       <nova:owner>
Nov 06 15:51:59 user nova-compute[75337]:         <nova:user uuid="bb8d5f0200124588be1cfde107341a45">tempest-TestVolumeBootPattern-1055092640-project-member</nova:user>
Nov 06 15:51:59 user nova-compute[75337]:         <nova:project uuid="915211c6a2734c36b34ff92a56b085f6">tempest-TestVolumeBootPattern-1055092640</nova:project>
Nov 06 15:51:59 user nova-compute[75337]:       </nova:owner>
Nov 06 15:51:59 user nova-compute[75337]:       <nova:root type="image" uuid="2bee7244-800a-42ea-84d9-fd07b594c96b"/>
Nov 06 15:51:59 user nova-compute[75337]:       <nova:ports>
Nov 06 15:51:59 user nova-compute[75337]:         <nova:port uuid="bb02742a-5f8a-4501-95e6-dddfef111f50">
Nov 06 15:51:59 user nova-compute[75337]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 06 15:51:59 user nova-compute[75337]:         </nova:port>
Nov 06 15:51:59 user nova-compute[75337]:       </nova:ports>
Nov 06 15:51:59 user nova-compute[75337]:     </nova:instance>
Nov 06 15:51:59 user nova-compute[75337]:   </metadata>
Nov 06 15:51:59 user nova-compute[75337]:   <sysinfo type="smbios">
Nov 06 15:51:59 user nova-compute[75337]:     <system>
Nov 06 15:51:59 user nova-compute[75337]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 15:51:59 user nova-compute[75337]:       <entry name="product">OpenStack Nova</entry>
Nov 06 15:51:59 user nova-compute[75337]:       <entry name="version">0.0.0</entry>
Nov 06 15:51:59 user nova-compute[75337]:       <entry name="serial">582702ee-b8f8-49e4-9853-68af15420702</entry>
Nov 06 15:51:59 user nova-compute[75337]:       <entry name="uuid">582702ee-b8f8-49e4-9853-68af15420702</entry>
Nov 06 15:51:59 user nova-compute[75337]:       <entry name="family">Virtual Machine</entry>
Nov 06 15:51:59 user nova-compute[75337]:     </system>
Nov 06 15:51:59 user nova-compute[75337]:   </sysinfo>
Nov 06 15:51:59 user nova-compute[75337]:   <os>
Nov 06 15:51:59 user nova-compute[75337]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 15:51:59 user nova-compute[75337]:     <boot dev="hd"/>
Nov 06 15:51:59 user nova-compute[75337]:     <smbios mode="sysinfo"/>
Nov 06 15:51:59 user nova-compute[75337]:   </os>
Nov 06 15:51:59 user nova-compute[75337]:   <features>
Nov 06 15:51:59 user nova-compute[75337]:     <acpi/>
Nov 06 15:51:59 user nova-compute[75337]:     <apic/>
Nov 06 15:51:59 user nova-compute[75337]:     <vmcoreinfo/>
Nov 06 15:51:59 user nova-compute[75337]:   </features>
Nov 06 15:51:59 user nova-compute[75337]:   <clock offset="utc">
Nov 06 15:51:59 user nova-compute[75337]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 15:51:59 user nova-compute[75337]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 15:51:59 user nova-compute[75337]:     <timer name="hpet" present="no"/>
Nov 06 15:51:59 user nova-compute[75337]:   </clock>
Nov 06 15:51:59 user nova-compute[75337]:   <cpu mode="custom" match="exact">
Nov 06 15:51:59 user nova-compute[75337]:     <model>Nehalem</model>
Nov 06 15:51:59 user nova-compute[75337]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 15:51:59 user nova-compute[75337]:   </cpu>
Nov 06 15:51:59 user nova-compute[75337]:   <devices>
Nov 06 15:51:59 user nova-compute[75337]:     <disk type="block" device="disk">
Nov 06 15:51:59 user nova-compute[75337]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 15:51:59 user nova-compute[75337]:       <source dev="/dev/sdd"/>
Nov 06 15:51:59 user nova-compute[75337]:       <target dev="vda" bus="virtio"/>
Nov 06 15:51:59 user nova-compute[75337]:       <serial>ea7e84b5-25b5-4146-a33b-f23a700deadf</serial>
Nov 06 15:51:59 user nova-compute[75337]:     </disk>
Nov 06 15:51:59 user nova-compute[75337]:     <interface type="ethernet">
Nov 06 15:51:59 user nova-compute[75337]:       <mac address="fa:16:3e:ad:0d:f6"/>
Nov 06 15:51:59 user nova-compute[75337]:       <model type="virtio"/>
Nov 06 15:51:59 user nova-compute[75337]:       <mtu size="1442"/>
Nov 06 15:51:59 user nova-compute[75337]:       <target dev="tapbb02742a-5f"/>
Nov 06 15:51:59 user nova-compute[75337]:     </interface>
Nov 06 15:51:59 user nova-compute[75337]:     <serial type="pty">
Nov 06 15:51:59 user nova-compute[75337]:       <log file="/opt/stack/data/nova/instances/582702ee-b8f8-49e4-9853-68af15420702/console.log" append="off"/>
Nov 06 15:51:59 user nova-compute[75337]:     </serial>
Nov 06 15:51:59 user nova-compute[75337]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 15:51:59 user nova-compute[75337]:     <video>
Nov 06 15:51:59 user nova-compute[75337]:       <model type="virtio"/>
Nov 06 15:51:59 user nova-compute[75337]:     </video>
Nov 06 15:51:59 user nova-compute[75337]:     <rng model="virtio">
Nov 06 15:51:59 user nova-compute[75337]:       <backend model="random">/dev/urandom</backend>
Nov 06 15:51:59 user nova-compute[75337]:     </rng>
Nov 06 15:51:59 user nova-compute[75337]:     <controller type="usb" index="0" model="none"/>
Nov 06 15:51:59 user nova-compute[75337]:     <memballoon model="virtio">
Nov 06 15:51:59 user nova-compute[75337]:       <stats period="10"/>
Nov 06 15:51:59 user nova-compute[75337]:     </memballoon>
Nov 06 15:51:59 user nova-compute[75337]:   </devices>
Nov 06 15:51:59 user nova-compute[75337]: </domain>
Nov 06 15:51:59 user nova-compute[75337]:  {{(pid=75337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 15:51:59 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-0e4ad819-a62e-4b45-bac0-b8d5d7278f5c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T15:51:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-952025564',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-952025564',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-952025564',id=26,image_ref='2bee7244-800a-42ea-84d9-fd07b594c96b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKlScEkzVEQMrehWzpcP7Bc5Ul3eAwFFKSqPfrvuaI3YYtxPPA9nEt6b8+tMM5ow/PMSrbgmuBWSdH2Bjlj8cAbtyksWWE3/81OuURY95MC6TFoP6MMxmwg/TY2kiVLpvw==',key_name='tempest-keypair-1227078778',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='915211c6a2734c36b34ff92a56b085f6',ramdisk_id='',reservation_id='r-2sh003gg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1055092640',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1055092640-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1055092640',owner_user_name='tempest-TestVolumeBootPattern-1055092640-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T15:51:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bb8d5f0200124588be1cfde107341a45',uuid=582702ee-b8f8-49e4-9853-68af15420702,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bb02742a-5f8a-4501-95e6-dddfef111f50", "address": "fa:16:3e:ad:0d:f6", "network": {"id": "4e47319f-de1d-4dfe-9915-7d2d5131704d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-895093240-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "915211c6a2734c36b34ff92a56b085f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb02742a-5f", "ovs_interfaceid": "bb02742a-5f8a-4501-95e6-dddfef111f50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 15:51:59 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-0e4ad819-a62e-4b45-bac0-b8d5d7278f5c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Converting VIF {"id": "bb02742a-5f8a-4501-95e6-dddfef111f50", "address": "fa:16:3e:ad:0d:f6", "network": {"id": "4e47319f-de1d-4dfe-9915-7d2d5131704d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-895093240-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "915211c6a2734c36b34ff92a56b085f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb02742a-5f", "ovs_interfaceid": "bb02742a-5f8a-4501-95e6-dddfef111f50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 15:51:59 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-0e4ad819-a62e-4b45-bac0-b8d5d7278f5c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:0d:f6,bridge_name='br-int',has_traffic_filtering=True,id=bb02742a-5f8a-4501-95e6-dddfef111f50,network=Network(4e47319f-de1d-4dfe-9915-7d2d5131704d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb02742a-5f') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 15:51:59 user nova-compute[75337]: DEBUG os_vif [None req-0e4ad819-a62e-4b45-bac0-b8d5d7278f5c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:0d:f6,bridge_name='br-int',has_traffic_filtering=True,id=bb02742a-5f8a-4501-95e6-dddfef111f50,network=Network(4e47319f-de1d-4dfe-9915-7d2d5131704d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb02742a-5f') {{(pid=75337) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 15:51:59 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:51:59 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:51:59 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 15:51:59 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:51:59 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ca8ebb2c-4644-51ba-b027-5e69b0f73a63', '_type': 'linux-noop'}}, row=False) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:51:59 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:51:59 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[25cb3fc0-526a-452c-a84c-eca25fdcb315]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2086a611-973d-47a1-bb69-f2ebd144be03\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dc5eae50-0461-47ca-bc48-cb38087b06e0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ea7e84b5-25b5-4146-a33b-f23a700deadf\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:51:59 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:51:59 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:51:59 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:51:59 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:51:59 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbb02742a-5f, may_exist=True, interface_attrs={}) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:51:59 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbb02742a-5f, col_values=(('qos', UUID('552cb5d4-6511-4f95-a576-57f941356d9e')),), if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:51:59 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbb02742a-5f, col_values=(('external_ids', {'iface-id': 'bb02742a-5f8a-4501-95e6-dddfef111f50', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ad:0d:f6', 'vm-uuid': '582702ee-b8f8-49e4-9853-68af15420702'}),), if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:51:59 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:51:59 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:51:59 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:51:59 user nova-compute[75337]: INFO os_vif [None req-0e4ad819-a62e-4b45-bac0-b8d5d7278f5c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:0d:f6,bridge_name='br-int',has_traffic_filtering=True,id=bb02742a-5f8a-4501-95e6-dddfef111f50,network=Network(4e47319f-de1d-4dfe-9915-7d2d5131704d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb02742a-5f')
Nov 06 15:51:59 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:51:59 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a99fc55-cfd7-41b6-8542-b0ea700f45a3]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2086a611-973d-47a1-bb69-f2ebd144be03 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc5eae50-0461-47ca-bc48-cb38087b06e0 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea7e84b5-25b5-4146-a33b-f23a700deadf (non-flash)\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:51:59 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1dbb214-ac3c-44f5-bace-4c1828ffd612 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)
Nov 06 15:51:59 user nova-compute[75337]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2086a611-973d-47a1-bb69-f2ebd144be03 (non-flash)
Nov 06 15:51:59 user nova-compute[75337]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc5eae50-0461-47ca-bc48-cb38087b06e0 (non-flash)
Nov 06 15:51:59 user nova-compute[75337]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea7e84b5-25b5-4146-a33b-f23a700deadf (non-flash)
Nov 06 15:51:59 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 15:51:59 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1dbb214-ac3c-44f5-bace-4c1828ffd612 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)
Nov 06 15:51:59 user nova-compute[75337]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2086a611-973d-47a1-bb69-f2ebd144be03 (non-flash)
Nov 06 15:51:59 user nova-compute[75337]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc5eae50-0461-47ca-bc48-cb38087b06e0 (non-flash)
Nov 06 15:51:59 user nova-compute[75337]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea7e84b5-25b5-4146-a33b-f23a700deadf (non-flash)
Nov 06 15:51:59 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 15:51:59 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1dbb214-ac3c-44f5-bace-4c1828ffd612 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2abc20a950>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dc5eae50-0461-47ca-bc48-cb38087b06e0'): ({'sde'}, set())}) {{(pid=75337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 15:51:59 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-f1dbb214-ac3c-44f5-bace-4c1828ffd612 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Removing single pathed devices sde {{(pid=75337) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 15:51:59 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:51:59 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:51:59 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[9348b72d-0e5d-4f0f-9944-3a6792be540f]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:51:59 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:51:59 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:51:59 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b10aa3e-62a2-4a2d-ad46-214f9cbcc440]: (4, ('ok\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:51:59 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-f1dbb214-ac3c-44f5-bace-4c1828ffd612 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Flushing IO for device /dev/sde {{(pid=75337) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 15:51:59 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:51:59 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-0e4ad819-a62e-4b45-bac0-b8d5d7278f5c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] No BDM found with device name vda, not building metadata. {{(pid=75337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 15:51:59 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-0e4ad819-a62e-4b45-bac0-b8d5d7278f5c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] No VIF found with MAC fa:16:3e:ad:0d:f6, not building metadata {{(pid=75337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 15:51:59 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:51:59 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ce07635-6b42-443f-9224-d8473a6895ea]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:51:59 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-f1dbb214-ac3c-44f5-bace-4c1828ffd612 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75337) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 15:51:59 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:52:00 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.044s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:52:00 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[33e02902-bc79-4cf5-ae43-7530a72e31c7]: (4, ('1', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:52:00 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-f1dbb214-ac3c-44f5-bace-4c1828ffd612 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 15:52:00 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-f1dbb214-ac3c-44f5-bace-4c1828ffd612 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] SCSI volumes sde have been removed. {{(pid=75337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 15:52:00 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1dbb214-ac3c-44f5-bace-4c1828ffd612 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dc5eae50-0461-47ca-bc48-cb38087b06e0')] {{(pid=75337) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 15:52:00 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc5eae50-0461-47ca-bc48-cb38087b06e0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:52:00 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc5eae50-0461-47ca-bc48-cb38087b06e0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:52:00 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[604d9391-b8f7-421a-8126-0720c104010e]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:52:00 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1dbb214-ac3c-44f5-bace-4c1828ffd612 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:52:00 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc5eae50-0461-47ca-bc48-cb38087b06e0 -p 172.16.0.220:3260 --logout {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:52:00 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc5eae50-0461-47ca-bc48-cb38087b06e0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:52:00 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[5607efe5-cb90-4ad9-8ce7-8c57800a9bbb]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:dc5eae50-0461-47ca-bc48-cb38087b06e0, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:dc5eae50-0461-47ca-bc48-cb38087b06e0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:52:00 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1dbb214-ac3c-44f5-bace-4c1828ffd612 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:dc5eae50-0461-47ca-bc48-cb38087b06e0, portal: 172.16.0.220,3260]
Nov 06 15:52:00 user nova-compute[75337]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:dc5eae50-0461-47ca-bc48-cb38087b06e0, portal: 172.16.0.220,3260] successful.
Nov 06 15:52:00 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:52:00 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc5eae50-0461-47ca-bc48-cb38087b06e0 -p 172.16.0.220:3260 --op delete {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:52:00 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc5eae50-0461-47ca-bc48-cb38087b06e0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:52:00 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fb2effc-0c0f-4fa3-a725-7dba7e4596f8]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:52:00 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1dbb214-ac3c-44f5-bace-4c1828ffd612 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:52:00 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-f1dbb214-ac3c-44f5-bace-4c1828ffd612 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.387s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 15:52:00 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1dbb214-ac3c-44f5-bace-4c1828ffd612 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] <== disconnect_volume: return (1035ms) None {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 15:52:00 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f1dbb214-ac3c-44f5-bace-4c1828ffd612 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] [instance: bc0e07f8-2731-4ffa-8446-b71ad3ba7375] Disconnected iSCSI Volume {{(pid=75337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 15:52:01 user nova-compute[75337]: DEBUG nova.objects.instance [None req-f1dbb214-ac3c-44f5-bace-4c1828ffd612 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Lazy-loading 'flavor' on Instance uuid bc0e07f8-2731-4ffa-8446-b71ad3ba7375 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 15:52:01 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-f1dbb214-ac3c-44f5-bace-4c1828ffd612 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Lock "bc0e07f8-2731-4ffa-8446-b71ad3ba7375" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.810s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:52:01 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:52:01 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:52:01 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:52:01 user nova-compute[75337]: DEBUG nova.compute.manager [req-1f7a9b79-d5c0-4f0e-af11-ef8a47b285f8 req-ee126ed8-49a5-492c-a324-a73f4f2b9937 service nova] [instance: 582702ee-b8f8-49e4-9853-68af15420702] Received event network-vif-plugged-bb02742a-5f8a-4501-95e6-dddfef111f50 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:52:01 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-1f7a9b79-d5c0-4f0e-af11-ef8a47b285f8 req-ee126ed8-49a5-492c-a324-a73f4f2b9937 service nova] Acquiring lock "582702ee-b8f8-49e4-9853-68af15420702-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:52:01 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-1f7a9b79-d5c0-4f0e-af11-ef8a47b285f8 req-ee126ed8-49a5-492c-a324-a73f4f2b9937 service nova] Lock "582702ee-b8f8-49e4-9853-68af15420702-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:52:01 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-1f7a9b79-d5c0-4f0e-af11-ef8a47b285f8 req-ee126ed8-49a5-492c-a324-a73f4f2b9937 service nova] Lock "582702ee-b8f8-49e4-9853-68af15420702-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:52:01 user nova-compute[75337]: DEBUG nova.compute.manager [req-1f7a9b79-d5c0-4f0e-af11-ef8a47b285f8 req-ee126ed8-49a5-492c-a324-a73f4f2b9937 service nova] [instance: 582702ee-b8f8-49e4-9853-68af15420702] No waiting events found dispatching network-vif-plugged-bb02742a-5f8a-4501-95e6-dddfef111f50 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:52:01 user nova-compute[75337]: WARNING nova.compute.manager [req-1f7a9b79-d5c0-4f0e-af11-ef8a47b285f8 req-ee126ed8-49a5-492c-a324-a73f4f2b9937 service nova] [instance: 582702ee-b8f8-49e4-9853-68af15420702] Received unexpected event network-vif-plugged-bb02742a-5f8a-4501-95e6-dddfef111f50 for instance with vm_state building and task_state spawning.
Nov 06 15:52:01 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:52:03 user nova-compute[75337]: DEBUG nova.compute.manager [req-f3ecc67d-3d7e-461f-95cb-465febd5fef4 req-8ef98cf6-fbc4-45fc-b6d9-15a882ccdeee service nova] [instance: 582702ee-b8f8-49e4-9853-68af15420702] Received event network-vif-plugged-bb02742a-5f8a-4501-95e6-dddfef111f50 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:52:03 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-f3ecc67d-3d7e-461f-95cb-465febd5fef4 req-8ef98cf6-fbc4-45fc-b6d9-15a882ccdeee service nova] Acquiring lock "582702ee-b8f8-49e4-9853-68af15420702-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:52:03 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-f3ecc67d-3d7e-461f-95cb-465febd5fef4 req-8ef98cf6-fbc4-45fc-b6d9-15a882ccdeee service nova] Lock "582702ee-b8f8-49e4-9853-68af15420702-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:52:03 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-f3ecc67d-3d7e-461f-95cb-465febd5fef4 req-8ef98cf6-fbc4-45fc-b6d9-15a882ccdeee service nova] Lock "582702ee-b8f8-49e4-9853-68af15420702-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:52:03 user nova-compute[75337]: DEBUG nova.compute.manager [req-f3ecc67d-3d7e-461f-95cb-465febd5fef4 req-8ef98cf6-fbc4-45fc-b6d9-15a882ccdeee service nova] [instance: 582702ee-b8f8-49e4-9853-68af15420702] No waiting events found dispatching network-vif-plugged-bb02742a-5f8a-4501-95e6-dddfef111f50 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:52:03 user nova-compute[75337]: WARNING nova.compute.manager [req-f3ecc67d-3d7e-461f-95cb-465febd5fef4 req-8ef98cf6-fbc4-45fc-b6d9-15a882ccdeee service nova] [instance: 582702ee-b8f8-49e4-9853-68af15420702] Received unexpected event network-vif-plugged-bb02742a-5f8a-4501-95e6-dddfef111f50 for instance with vm_state building and task_state spawning.
Nov 06 15:52:04 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-751ceed4-5edb-4daa-97d8-cd7567928743 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Acquiring lock "b7ececa5-256f-4a5d-aeda-3d2ee5c01cfe" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:52:04 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-751ceed4-5edb-4daa-97d8-cd7567928743 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Lock "b7ececa5-256f-4a5d-aeda-3d2ee5c01cfe" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:52:04 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-751ceed4-5edb-4daa-97d8-cd7567928743 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Acquiring lock "b7ececa5-256f-4a5d-aeda-3d2ee5c01cfe-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:52:04 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-751ceed4-5edb-4daa-97d8-cd7567928743 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Lock "b7ececa5-256f-4a5d-aeda-3d2ee5c01cfe-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:52:04 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-751ceed4-5edb-4daa-97d8-cd7567928743 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Lock "b7ececa5-256f-4a5d-aeda-3d2ee5c01cfe-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:52:04 user nova-compute[75337]: INFO nova.compute.manager [None req-751ceed4-5edb-4daa-97d8-cd7567928743 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: b7ececa5-256f-4a5d-aeda-3d2ee5c01cfe] Terminating instance
Nov 06 15:52:04 user nova-compute[75337]: DEBUG nova.compute.manager [None req-751ceed4-5edb-4daa-97d8-cd7567928743 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: b7ececa5-256f-4a5d-aeda-3d2ee5c01cfe] Start destroying the instance on the hypervisor. {{(pid=75337) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 15:52:04 user nova-compute[75337]: DEBUG nova.compute.manager [None req-0e4ad819-a62e-4b45-bac0-b8d5d7278f5c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 582702ee-b8f8-49e4-9853-68af15420702] Instance event wait completed in 0 seconds for  {{(pid=75337) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 15:52:04 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-0e4ad819-a62e-4b45-bac0-b8d5d7278f5c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 582702ee-b8f8-49e4-9853-68af15420702] Guest created on hypervisor {{(pid=75337) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 15:52:04 user nova-compute[75337]: INFO nova.virt.libvirt.driver [-] [instance: 582702ee-b8f8-49e4-9853-68af15420702] Instance spawned successfully.
Nov 06 15:52:04 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-0e4ad819-a62e-4b45-bac0-b8d5d7278f5c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 582702ee-b8f8-49e4-9853-68af15420702] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 15:52:04 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-0e4ad819-a62e-4b45-bac0-b8d5d7278f5c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 582702ee-b8f8-49e4-9853-68af15420702] Found default for hw_input_bus of None {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:52:04 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-0e4ad819-a62e-4b45-bac0-b8d5d7278f5c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 582702ee-b8f8-49e4-9853-68af15420702] Found default for hw_pointer_model of None {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:52:04 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:52:04 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:52:04 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:52:04 user nova-compute[75337]: INFO nova.compute.manager [None req-0e4ad819-a62e-4b45-bac0-b8d5d7278f5c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 582702ee-b8f8-49e4-9853-68af15420702] Took 5.95 seconds to spawn the instance on the hypervisor.
Nov 06 15:52:04 user nova-compute[75337]: DEBUG nova.compute.manager [None req-0e4ad819-a62e-4b45-bac0-b8d5d7278f5c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 582702ee-b8f8-49e4-9853-68af15420702] Checking state {{(pid=75337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 15:52:04 user nova-compute[75337]: INFO nova.compute.manager [None req-0e4ad819-a62e-4b45-bac0-b8d5d7278f5c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 582702ee-b8f8-49e4-9853-68af15420702] Took 47.46 seconds to build instance.
Nov 06 15:52:04 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-0e4ad819-a62e-4b45-bac0-b8d5d7278f5c tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Lock "582702ee-b8f8-49e4-9853-68af15420702" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 47.617s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:52:04 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:52:04 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:52:04 user nova-compute[75337]: INFO nova.virt.libvirt.driver [-] [instance: b7ececa5-256f-4a5d-aeda-3d2ee5c01cfe] Instance destroyed successfully.
Nov 06 15:52:04 user nova-compute[75337]: DEBUG nova.objects.instance [None req-751ceed4-5edb-4daa-97d8-cd7567928743 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Lazy-loading 'resources' on Instance uuid b7ececa5-256f-4a5d-aeda-3d2ee5c01cfe {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 15:52:04 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-751ceed4-5edb-4daa-97d8-cd7567928743 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T15:47:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1878925471',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1878925471',id=20,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-06T15:47:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='eb76b5b0f2b24f1c84a92403176bcc00',ramdisk_id='',reservation_id='r-e0xj1xrk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2044295020',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T15:49:20Z,user_data=None,user_id='74090d6e5b354d79bf6ded92e6de56aa',uuid=b7ececa5-256f-4a5d-aeda-3d2ee5c01cfe,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "282f33e8-b542-4d05-bc4d-35e786dcd7ee", "address": "fa:16:3e:bb:32:22", "network": {"id": "736be000-ee94-41fd-9de0-f2f885ec9be7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1715443852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb76b5b0f2b24f1c84a92403176bcc00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap282f33e8-b5", "ovs_interfaceid": "282f33e8-b542-4d05-bc4d-35e786dcd7ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 15:52:04 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-751ceed4-5edb-4daa-97d8-cd7567928743 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Converting VIF {"id": "282f33e8-b542-4d05-bc4d-35e786dcd7ee", "address": "fa:16:3e:bb:32:22", "network": {"id": "736be000-ee94-41fd-9de0-f2f885ec9be7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1715443852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb76b5b0f2b24f1c84a92403176bcc00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap282f33e8-b5", "ovs_interfaceid": "282f33e8-b542-4d05-bc4d-35e786dcd7ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 15:52:04 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-751ceed4-5edb-4daa-97d8-cd7567928743 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:32:22,bridge_name='br-int',has_traffic_filtering=True,id=282f33e8-b542-4d05-bc4d-35e786dcd7ee,network=Network(736be000-ee94-41fd-9de0-f2f885ec9be7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap282f33e8-b5') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 15:52:04 user nova-compute[75337]: DEBUG os_vif [None req-751ceed4-5edb-4daa-97d8-cd7567928743 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:32:22,bridge_name='br-int',has_traffic_filtering=True,id=282f33e8-b542-4d05-bc4d-35e786dcd7ee,network=Network(736be000-ee94-41fd-9de0-f2f885ec9be7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap282f33e8-b5') {{(pid=75337) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 15:52:04 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:52:04 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap282f33e8-b5, bridge=br-int, if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:52:04 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:52:04 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:52:04 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:52:04 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6301c862-c15d-4d6c-b9a2-495ac3b37ac8) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:52:04 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:52:04 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:52:04 user nova-compute[75337]: INFO os_vif [None req-751ceed4-5edb-4daa-97d8-cd7567928743 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:32:22,bridge_name='br-int',has_traffic_filtering=True,id=282f33e8-b542-4d05-bc4d-35e786dcd7ee,network=Network(736be000-ee94-41fd-9de0-f2f885ec9be7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap282f33e8-b5')
Nov 06 15:52:04 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-751ceed4-5edb-4daa-97d8-cd7567928743 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: b7ececa5-256f-4a5d-aeda-3d2ee5c01cfe] Deleting instance files /opt/stack/data/nova/instances/b7ececa5-256f-4a5d-aeda-3d2ee5c01cfe_del
Nov 06 15:52:04 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-751ceed4-5edb-4daa-97d8-cd7567928743 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: b7ececa5-256f-4a5d-aeda-3d2ee5c01cfe] Deletion of /opt/stack/data/nova/instances/b7ececa5-256f-4a5d-aeda-3d2ee5c01cfe_del complete
Nov 06 15:52:04 user nova-compute[75337]: INFO nova.compute.manager [None req-751ceed4-5edb-4daa-97d8-cd7567928743 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: b7ececa5-256f-4a5d-aeda-3d2ee5c01cfe] Took 0.75 seconds to destroy the instance on the hypervisor.
Nov 06 15:52:04 user nova-compute[75337]: DEBUG oslo.service.loopingcall [None req-751ceed4-5edb-4daa-97d8-cd7567928743 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75337) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 15:52:04 user nova-compute[75337]: DEBUG nova.compute.manager [-] [instance: b7ececa5-256f-4a5d-aeda-3d2ee5c01cfe] Deallocating network for instance {{(pid=75337) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 15:52:04 user nova-compute[75337]: DEBUG nova.network.neutron [-] [instance: b7ececa5-256f-4a5d-aeda-3d2ee5c01cfe] deallocate_for_instance() {{(pid=75337) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 15:52:05 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:52:05 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:52:05 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Starting heal instance info cache {{(pid=75337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 15:52:05 user nova-compute[75337]: DEBUG nova.compute.manager [req-d27262cc-76b5-4d01-b6ec-32fb9e22d9f6 req-2c48cde2-b1a2-4344-a4f3-7430b95a1b23 service nova] [instance: b7ececa5-256f-4a5d-aeda-3d2ee5c01cfe] Received event network-vif-unplugged-282f33e8-b542-4d05-bc4d-35e786dcd7ee {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:52:05 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-d27262cc-76b5-4d01-b6ec-32fb9e22d9f6 req-2c48cde2-b1a2-4344-a4f3-7430b95a1b23 service nova] Acquiring lock "b7ececa5-256f-4a5d-aeda-3d2ee5c01cfe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:52:05 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-d27262cc-76b5-4d01-b6ec-32fb9e22d9f6 req-2c48cde2-b1a2-4344-a4f3-7430b95a1b23 service nova] Lock "b7ececa5-256f-4a5d-aeda-3d2ee5c01cfe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:52:05 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-d27262cc-76b5-4d01-b6ec-32fb9e22d9f6 req-2c48cde2-b1a2-4344-a4f3-7430b95a1b23 service nova] Lock "b7ececa5-256f-4a5d-aeda-3d2ee5c01cfe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:52:05 user nova-compute[75337]: DEBUG nova.compute.manager [req-d27262cc-76b5-4d01-b6ec-32fb9e22d9f6 req-2c48cde2-b1a2-4344-a4f3-7430b95a1b23 service nova] [instance: b7ececa5-256f-4a5d-aeda-3d2ee5c01cfe] No waiting events found dispatching network-vif-unplugged-282f33e8-b542-4d05-bc4d-35e786dcd7ee {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:52:05 user nova-compute[75337]: DEBUG nova.compute.manager [req-d27262cc-76b5-4d01-b6ec-32fb9e22d9f6 req-2c48cde2-b1a2-4344-a4f3-7430b95a1b23 service nova] [instance: b7ececa5-256f-4a5d-aeda-3d2ee5c01cfe] Received event network-vif-unplugged-282f33e8-b542-4d05-bc4d-35e786dcd7ee for instance with task_state deleting. {{(pid=75337) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 15:52:05 user nova-compute[75337]: DEBUG nova.compute.manager [req-d27262cc-76b5-4d01-b6ec-32fb9e22d9f6 req-2c48cde2-b1a2-4344-a4f3-7430b95a1b23 service nova] [instance: b7ececa5-256f-4a5d-aeda-3d2ee5c01cfe] Received event network-vif-plugged-282f33e8-b542-4d05-bc4d-35e786dcd7ee {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:52:05 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-d27262cc-76b5-4d01-b6ec-32fb9e22d9f6 req-2c48cde2-b1a2-4344-a4f3-7430b95a1b23 service nova] Acquiring lock "b7ececa5-256f-4a5d-aeda-3d2ee5c01cfe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:52:05 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-d27262cc-76b5-4d01-b6ec-32fb9e22d9f6 req-2c48cde2-b1a2-4344-a4f3-7430b95a1b23 service nova] Lock "b7ececa5-256f-4a5d-aeda-3d2ee5c01cfe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:52:05 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-d27262cc-76b5-4d01-b6ec-32fb9e22d9f6 req-2c48cde2-b1a2-4344-a4f3-7430b95a1b23 service nova] Lock "b7ececa5-256f-4a5d-aeda-3d2ee5c01cfe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:52:05 user nova-compute[75337]: DEBUG nova.compute.manager [req-d27262cc-76b5-4d01-b6ec-32fb9e22d9f6 req-2c48cde2-b1a2-4344-a4f3-7430b95a1b23 service nova] [instance: b7ececa5-256f-4a5d-aeda-3d2ee5c01cfe] No waiting events found dispatching network-vif-plugged-282f33e8-b542-4d05-bc4d-35e786dcd7ee {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:52:05 user nova-compute[75337]: WARNING nova.compute.manager [req-d27262cc-76b5-4d01-b6ec-32fb9e22d9f6 req-2c48cde2-b1a2-4344-a4f3-7430b95a1b23 service nova] [instance: b7ececa5-256f-4a5d-aeda-3d2ee5c01cfe] Received unexpected event network-vif-plugged-282f33e8-b542-4d05-bc4d-35e786dcd7ee for instance with vm_state active and task_state deleting.
Nov 06 15:52:05 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "refresh_cache-1fa4c927-7485-4f34-94bd-9e20358904b6" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 15:52:05 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquired lock "refresh_cache-1fa4c927-7485-4f34-94bd-9e20358904b6" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 15:52:05 user nova-compute[75337]: DEBUG nova.network.neutron [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] [instance: 1fa4c927-7485-4f34-94bd-9e20358904b6] Forcefully refreshing network info cache for instance {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 15:52:05 user nova-compute[75337]: DEBUG nova.network.neutron [-] [instance: b7ececa5-256f-4a5d-aeda-3d2ee5c01cfe] Updating instance_info_cache with network_info: [] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:52:05 user nova-compute[75337]: INFO nova.compute.manager [-] [instance: b7ececa5-256f-4a5d-aeda-3d2ee5c01cfe] Took 0.97 seconds to deallocate network for instance.
Nov 06 15:52:05 user nova-compute[75337]: DEBUG nova.compute.manager [req-befaf5fb-5122-4576-8c70-77eefeb6bce9 req-b91f648d-5cc6-407d-8c42-13905b4aa524 service nova] [instance: b7ececa5-256f-4a5d-aeda-3d2ee5c01cfe] Received event network-vif-deleted-282f33e8-b542-4d05-bc4d-35e786dcd7ee {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:52:05 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-751ceed4-5edb-4daa-97d8-cd7567928743 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:52:05 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-751ceed4-5edb-4daa-97d8-cd7567928743 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:52:06 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-751ceed4-5edb-4daa-97d8-cd7567928743 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 15:52:06 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-751ceed4-5edb-4daa-97d8-cd7567928743 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 15:52:06 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-751ceed4-5edb-4daa-97d8-cd7567928743 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.415s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:52:06 user nova-compute[75337]: INFO nova.scheduler.client.report [None req-751ceed4-5edb-4daa-97d8-cd7567928743 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Deleted allocations for instance b7ececa5-256f-4a5d-aeda-3d2ee5c01cfe
Nov 06 15:52:06 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-751ceed4-5edb-4daa-97d8-cd7567928743 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Lock "b7ececa5-256f-4a5d-aeda-3d2ee5c01cfe" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.434s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:52:06 user nova-compute[75337]: DEBUG nova.network.neutron [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] [instance: 1fa4c927-7485-4f34-94bd-9e20358904b6] Updating instance_info_cache with network_info: [{"id": "3812cc74-01db-4b2b-815c-770420051e1b", "address": "fa:16:3e:f4:aa:7b", "network": {"id": "736be000-ee94-41fd-9de0-f2f885ec9be7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1715443852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb76b5b0f2b24f1c84a92403176bcc00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3812cc74-01", "ovs_interfaceid": "3812cc74-01db-4b2b-815c-770420051e1b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:52:06 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Releasing lock "refresh_cache-1fa4c927-7485-4f34-94bd-9e20358904b6" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 15:52:06 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] [instance: 1fa4c927-7485-4f34-94bd-9e20358904b6] Updated the network info_cache for instance {{(pid=75337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 15:52:06 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:52:06 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:52:06 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:52:06 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:52:06 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:52:06 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:52:06 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75337) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 15:52:08 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:52:08 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:52:09 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:52:11 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager.update_available_resource {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:52:11 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:52:11 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:52:11 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:52:11 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Auditing locally available compute resources for user (node: user) {{(pid=75337) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 15:52:11 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afa4e52b-af51-45bf-b619-aeca14e7724d/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:52:11 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afa4e52b-af51-45bf-b619-aeca14e7724d/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:52:11 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afa4e52b-af51-45bf-b619-aeca14e7724d/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:52:12 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afa4e52b-af51-45bf-b619-aeca14e7724d/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:52:12 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a293c354-d1e5-4c33-9e7b-d1558235aaf8/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:52:12 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a293c354-d1e5-4c33-9e7b-d1558235aaf8/disk --force-share --output=json" returned: 0 in 0.270s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:52:12 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a293c354-d1e5-4c33-9e7b-d1558235aaf8/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:52:12 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:52:12 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a293c354-d1e5-4c33-9e7b-d1558235aaf8/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:52:12 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30c634ff-6999-40aa-a90d-1db6d278b571/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:52:12 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30c634ff-6999-40aa-a90d-1db6d278b571/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:52:12 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30c634ff-6999-40aa-a90d-1db6d278b571/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:52:13 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30c634ff-6999-40aa-a90d-1db6d278b571/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:52:13 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc0e07f8-2731-4ffa-8446-b71ad3ba7375/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:52:13 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc0e07f8-2731-4ffa-8446-b71ad3ba7375/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:52:13 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc0e07f8-2731-4ffa-8446-b71ad3ba7375/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:52:13 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc0e07f8-2731-4ffa-8446-b71ad3ba7375/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:52:13 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 15:52:13 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 15:52:13 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83516ff5-c4e7-4e91-a2f9-8af9b51cf475/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:52:13 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83516ff5-c4e7-4e91-a2f9-8af9b51cf475/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:52:13 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83516ff5-c4e7-4e91-a2f9-8af9b51cf475/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:52:13 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83516ff5-c4e7-4e91-a2f9-8af9b51cf475/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:52:13 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 15:52:14 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 15:52:14 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 15:52:14 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Hypervisor/Node resource view: name=user free_ram=7841MB free_disk=25.136634826660156GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75337) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 15:52:14 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:52:14 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:52:14 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:52:14 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 83516ff5-c4e7-4e91-a2f9-8af9b51cf475 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:52:14 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 1fa4c927-7485-4f34-94bd-9e20358904b6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:52:14 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance bc0e07f8-2731-4ffa-8446-b71ad3ba7375 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:52:14 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 493eff79-294e-4259-a6d0-4772c4b45013 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:52:14 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance a293c354-d1e5-4c33-9e7b-d1558235aaf8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:52:14 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance afa4e52b-af51-45bf-b619-aeca14e7724d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:52:14 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 582702ee-b8f8-49e4-9853-68af15420702 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:52:14 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 30c634ff-6999-40aa-a90d-1db6d278b571 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:52:14 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 15:52:14 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 15:52:15 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 15:52:15 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 15:52:15 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Compute_service record updated for user:user {{(pid=75337) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 15:52:15 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.562s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:52:19 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:52:19 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:52:24 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:52:24 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:52:28 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:52:29 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:52:29 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:52:32 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:52:34 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:52:34 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:52:36 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:52:39 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:52:39 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:52:40 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-3cb082bd-050d-44b2-aeac-7eda62dc6478 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Acquiring lock "bc0e07f8-2731-4ffa-8446-b71ad3ba7375" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:52:40 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-3cb082bd-050d-44b2-aeac-7eda62dc6478 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Lock "bc0e07f8-2731-4ffa-8446-b71ad3ba7375" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:52:40 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-3cb082bd-050d-44b2-aeac-7eda62dc6478 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Acquiring lock "bc0e07f8-2731-4ffa-8446-b71ad3ba7375-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:52:40 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-3cb082bd-050d-44b2-aeac-7eda62dc6478 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Lock "bc0e07f8-2731-4ffa-8446-b71ad3ba7375-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:52:40 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-3cb082bd-050d-44b2-aeac-7eda62dc6478 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Lock "bc0e07f8-2731-4ffa-8446-b71ad3ba7375-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:52:40 user nova-compute[75337]: INFO nova.compute.manager [None req-3cb082bd-050d-44b2-aeac-7eda62dc6478 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] [instance: bc0e07f8-2731-4ffa-8446-b71ad3ba7375] Terminating instance
Nov 06 15:52:40 user nova-compute[75337]: DEBUG nova.compute.manager [None req-3cb082bd-050d-44b2-aeac-7eda62dc6478 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] [instance: bc0e07f8-2731-4ffa-8446-b71ad3ba7375] Start destroying the instance on the hypervisor. {{(pid=75337) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 15:52:40 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:52:40 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:52:40 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:52:40 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:52:41 user nova-compute[75337]: INFO nova.virt.libvirt.driver [-] [instance: bc0e07f8-2731-4ffa-8446-b71ad3ba7375] Instance destroyed successfully.
Nov 06 15:52:41 user nova-compute[75337]: DEBUG nova.objects.instance [None req-3cb082bd-050d-44b2-aeac-7eda62dc6478 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Lazy-loading 'resources' on Instance uuid bc0e07f8-2731-4ffa-8446-b71ad3ba7375 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 15:52:41 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-3cb082bd-050d-44b2-aeac-7eda62dc6478 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T15:46:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-305187601',display_name='tempest-TestMinimumBasicScenario-server-305187601',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-305187601',id=18,image_ref='34019a0c-32a9-485d-804a-abd50629cecb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLMTKRITbHOLi89utrqUrkdP7dp3D8u9fFIU8oK5Js2SaB/mlBSEFV4qG+zv1B+MrEcRr1Y6SUvYeu3ob8SsC0tPJypxoBps0L8MoitNXMQw8ZATzL/xbi+Lgg+BOq0dGA==',key_name='tempest-TestMinimumBasicScenario-1417411849',keypairs=<?>,launch_index=0,launched_at=2023-11-06T15:46:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2cddccc86bf54fe981667da5ef13fa8a',ramdisk_id='',reservation_id='r-p3ne9skw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='34019a0c-32a9-485d-804a-abd50629cecb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-2098539193',owner_user_name='tempest-TestMinimumBasicScenario-2098539193-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T15:49:54Z,user_data=None,user_id='8c795ee993a944ff89ed544450b90dc2',uuid=bc0e07f8-2731-4ffa-8446-b71ad3ba7375,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a20e3f62-5387-4f54-b623-d45a0a311da0", "address": "fa:16:3e:fe:62:24", "network": {"id": "c31b513a-57f0-4bd5-b055-4a363aae9793", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1352256985-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cddccc86bf54fe981667da5ef13fa8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa20e3f62-53", "ovs_interfaceid": "a20e3f62-5387-4f54-b623-d45a0a311da0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 15:52:41 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-3cb082bd-050d-44b2-aeac-7eda62dc6478 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Converting VIF {"id": "a20e3f62-5387-4f54-b623-d45a0a311da0", "address": "fa:16:3e:fe:62:24", "network": {"id": "c31b513a-57f0-4bd5-b055-4a363aae9793", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1352256985-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cddccc86bf54fe981667da5ef13fa8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa20e3f62-53", "ovs_interfaceid": "a20e3f62-5387-4f54-b623-d45a0a311da0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 15:52:41 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-3cb082bd-050d-44b2-aeac-7eda62dc6478 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fe:62:24,bridge_name='br-int',has_traffic_filtering=True,id=a20e3f62-5387-4f54-b623-d45a0a311da0,network=Network(c31b513a-57f0-4bd5-b055-4a363aae9793),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa20e3f62-53') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 15:52:41 user nova-compute[75337]: DEBUG os_vif [None req-3cb082bd-050d-44b2-aeac-7eda62dc6478 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fe:62:24,bridge_name='br-int',has_traffic_filtering=True,id=a20e3f62-5387-4f54-b623-d45a0a311da0,network=Network(c31b513a-57f0-4bd5-b055-4a363aae9793),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa20e3f62-53') {{(pid=75337) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 15:52:41 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:52:41 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa20e3f62-53, bridge=br-int, if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:52:41 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:52:41 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:52:41 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:52:41 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4cfabb4c-31c4-4cfc-a1ba-e1e9b8cba965) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:52:41 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:52:41 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:52:41 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:52:41 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:52:41 user nova-compute[75337]: INFO os_vif [None req-3cb082bd-050d-44b2-aeac-7eda62dc6478 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fe:62:24,bridge_name='br-int',has_traffic_filtering=True,id=a20e3f62-5387-4f54-b623-d45a0a311da0,network=Network(c31b513a-57f0-4bd5-b055-4a363aae9793),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa20e3f62-53')
Nov 06 15:52:41 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-3cb082bd-050d-44b2-aeac-7eda62dc6478 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] [instance: bc0e07f8-2731-4ffa-8446-b71ad3ba7375] Deleting instance files /opt/stack/data/nova/instances/bc0e07f8-2731-4ffa-8446-b71ad3ba7375_del
Nov 06 15:52:41 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-3cb082bd-050d-44b2-aeac-7eda62dc6478 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] [instance: bc0e07f8-2731-4ffa-8446-b71ad3ba7375] Deletion of /opt/stack/data/nova/instances/bc0e07f8-2731-4ffa-8446-b71ad3ba7375_del complete
Nov 06 15:52:41 user nova-compute[75337]: DEBUG nova.compute.manager [req-9b57fe62-307a-4d9e-b3f7-89fe8e8baae5 req-9b02c35e-3c07-42dc-ad78-dd134ff4c929 service nova] [instance: a293c354-d1e5-4c33-9e7b-d1558235aaf8] Received event network-changed-29fff93f-08f1-4e46-91db-84ab16f785e5 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:52:41 user nova-compute[75337]: DEBUG nova.compute.manager [req-9b57fe62-307a-4d9e-b3f7-89fe8e8baae5 req-9b02c35e-3c07-42dc-ad78-dd134ff4c929 service nova] [instance: a293c354-d1e5-4c33-9e7b-d1558235aaf8] Refreshing instance network info cache due to event network-changed-29fff93f-08f1-4e46-91db-84ab16f785e5. {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 15:52:41 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-9b57fe62-307a-4d9e-b3f7-89fe8e8baae5 req-9b02c35e-3c07-42dc-ad78-dd134ff4c929 service nova] Acquiring lock "refresh_cache-a293c354-d1e5-4c33-9e7b-d1558235aaf8" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 15:52:41 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-9b57fe62-307a-4d9e-b3f7-89fe8e8baae5 req-9b02c35e-3c07-42dc-ad78-dd134ff4c929 service nova] Acquired lock "refresh_cache-a293c354-d1e5-4c33-9e7b-d1558235aaf8" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 15:52:41 user nova-compute[75337]: DEBUG nova.network.neutron [req-9b57fe62-307a-4d9e-b3f7-89fe8e8baae5 req-9b02c35e-3c07-42dc-ad78-dd134ff4c929 service nova] [instance: a293c354-d1e5-4c33-9e7b-d1558235aaf8] Refreshing network info cache for port 29fff93f-08f1-4e46-91db-84ab16f785e5 {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 15:52:41 user nova-compute[75337]: INFO nova.compute.manager [None req-3cb082bd-050d-44b2-aeac-7eda62dc6478 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] [instance: bc0e07f8-2731-4ffa-8446-b71ad3ba7375] Took 0.96 seconds to destroy the instance on the hypervisor.
Nov 06 15:52:41 user nova-compute[75337]: DEBUG oslo.service.loopingcall [None req-3cb082bd-050d-44b2-aeac-7eda62dc6478 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75337) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 15:52:41 user nova-compute[75337]: DEBUG nova.compute.manager [-] [instance: bc0e07f8-2731-4ffa-8446-b71ad3ba7375] Deallocating network for instance {{(pid=75337) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 15:52:41 user nova-compute[75337]: DEBUG nova.network.neutron [-] [instance: bc0e07f8-2731-4ffa-8446-b71ad3ba7375] deallocate_for_instance() {{(pid=75337) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 15:52:42 user nova-compute[75337]: DEBUG nova.network.neutron [-] [instance: bc0e07f8-2731-4ffa-8446-b71ad3ba7375] Updating instance_info_cache with network_info: [] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:52:42 user nova-compute[75337]: INFO nova.compute.manager [-] [instance: bc0e07f8-2731-4ffa-8446-b71ad3ba7375] Took 0.56 seconds to deallocate network for instance.
Nov 06 15:52:42 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-3cb082bd-050d-44b2-aeac-7eda62dc6478 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:52:42 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-3cb082bd-050d-44b2-aeac-7eda62dc6478 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:52:42 user nova-compute[75337]: DEBUG nova.network.neutron [req-9b57fe62-307a-4d9e-b3f7-89fe8e8baae5 req-9b02c35e-3c07-42dc-ad78-dd134ff4c929 service nova] [instance: a293c354-d1e5-4c33-9e7b-d1558235aaf8] Updated VIF entry in instance network info cache for port 29fff93f-08f1-4e46-91db-84ab16f785e5. {{(pid=75337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 15:52:42 user nova-compute[75337]: DEBUG nova.network.neutron [req-9b57fe62-307a-4d9e-b3f7-89fe8e8baae5 req-9b02c35e-3c07-42dc-ad78-dd134ff4c929 service nova] [instance: a293c354-d1e5-4c33-9e7b-d1558235aaf8] Updating instance_info_cache with network_info: [{"id": "29fff93f-08f1-4e46-91db-84ab16f785e5", "address": "fa:16:3e:d7:cf:dd", "network": {"id": "48f1545d-7e80-462f-9dbf-f1102ddcda9a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1210368397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1013e7afbefd4146a3be04587710b1de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29fff93f-08", "ovs_interfaceid": "29fff93f-08f1-4e46-91db-84ab16f785e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:52:42 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-9b57fe62-307a-4d9e-b3f7-89fe8e8baae5 req-9b02c35e-3c07-42dc-ad78-dd134ff4c929 service nova] Releasing lock "refresh_cache-a293c354-d1e5-4c33-9e7b-d1558235aaf8" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 15:52:42 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-3cb082bd-050d-44b2-aeac-7eda62dc6478 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 15:52:42 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-3cb082bd-050d-44b2-aeac-7eda62dc6478 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 15:52:42 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-3cb082bd-050d-44b2-aeac-7eda62dc6478 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.368s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:52:42 user nova-compute[75337]: INFO nova.scheduler.client.report [None req-3cb082bd-050d-44b2-aeac-7eda62dc6478 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Deleted allocations for instance bc0e07f8-2731-4ffa-8446-b71ad3ba7375
Nov 06 15:52:42 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-3cb082bd-050d-44b2-aeac-7eda62dc6478 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Lock "bc0e07f8-2731-4ffa-8446-b71ad3ba7375" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.116s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:52:43 user nova-compute[75337]: DEBUG nova.compute.manager [req-dbd8d517-8d07-432d-bd1c-51a6ade1d36e req-a0492493-ab8f-4b11-aad0-05a31b5f0402 service nova] [instance: bc0e07f8-2731-4ffa-8446-b71ad3ba7375] Received event network-vif-deleted-a20e3f62-5387-4f54-b623-d45a0a311da0 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:52:44 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:52:45 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-96c45981-a732-4db4-a5fd-f9feddccd92f tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Acquiring lock "6110b34a-6fd3-45fc-911d-4e5d3c7f2d78" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:52:45 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-96c45981-a732-4db4-a5fd-f9feddccd92f tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Lock "6110b34a-6fd3-45fc-911d-4e5d3c7f2d78" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:52:45 user nova-compute[75337]: DEBUG nova.compute.manager [None req-96c45981-a732-4db4-a5fd-f9feddccd92f tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: 6110b34a-6fd3-45fc-911d-4e5d3c7f2d78] Starting instance... {{(pid=75337) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 15:52:45 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-96c45981-a732-4db4-a5fd-f9feddccd92f tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:52:45 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-96c45981-a732-4db4-a5fd-f9feddccd92f tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:52:45 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-96c45981-a732-4db4-a5fd-f9feddccd92f tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75337) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 15:52:45 user nova-compute[75337]: INFO nova.compute.claims [None req-96c45981-a732-4db4-a5fd-f9feddccd92f tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: 6110b34a-6fd3-45fc-911d-4e5d3c7f2d78] Claim successful on node user
Nov 06 15:52:46 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-96c45981-a732-4db4-a5fd-f9feddccd92f tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 15:52:46 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-96c45981-a732-4db4-a5fd-f9feddccd92f tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 15:52:46 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-96c45981-a732-4db4-a5fd-f9feddccd92f tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.468s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:52:46 user nova-compute[75337]: DEBUG nova.compute.manager [None req-96c45981-a732-4db4-a5fd-f9feddccd92f tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: 6110b34a-6fd3-45fc-911d-4e5d3c7f2d78] Start building networks asynchronously for instance. {{(pid=75337) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 15:52:46 user nova-compute[75337]: DEBUG nova.compute.manager [None req-96c45981-a732-4db4-a5fd-f9feddccd92f tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: 6110b34a-6fd3-45fc-911d-4e5d3c7f2d78] Allocating IP information in the background. {{(pid=75337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 15:52:46 user nova-compute[75337]: DEBUG nova.network.neutron [None req-96c45981-a732-4db4-a5fd-f9feddccd92f tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: 6110b34a-6fd3-45fc-911d-4e5d3c7f2d78] allocate_for_instance() {{(pid=75337) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 15:52:46 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-96c45981-a732-4db4-a5fd-f9feddccd92f tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: 6110b34a-6fd3-45fc-911d-4e5d3c7f2d78] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 15:52:46 user nova-compute[75337]: DEBUG nova.compute.manager [None req-96c45981-a732-4db4-a5fd-f9feddccd92f tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: 6110b34a-6fd3-45fc-911d-4e5d3c7f2d78] Start building block device mappings for instance. {{(pid=75337) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 15:52:46 user nova-compute[75337]: DEBUG nova.policy [None req-96c45981-a732-4db4-a5fd-f9feddccd92f tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2e47bf9ad49645deb2c1f834938fa39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243647103fd44f629e0f40be0b56407e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75337) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 15:52:46 user nova-compute[75337]: DEBUG nova.compute.manager [None req-96c45981-a732-4db4-a5fd-f9feddccd92f tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: 6110b34a-6fd3-45fc-911d-4e5d3c7f2d78] Start spawning the instance on the hypervisor. {{(pid=75337) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 15:52:46 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-96c45981-a732-4db4-a5fd-f9feddccd92f tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: 6110b34a-6fd3-45fc-911d-4e5d3c7f2d78] Creating instance directory {{(pid=75337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 15:52:46 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-96c45981-a732-4db4-a5fd-f9feddccd92f tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: 6110b34a-6fd3-45fc-911d-4e5d3c7f2d78] Creating image(s)
Nov 06 15:52:46 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-96c45981-a732-4db4-a5fd-f9feddccd92f tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Acquiring lock "/opt/stack/data/nova/instances/6110b34a-6fd3-45fc-911d-4e5d3c7f2d78/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:52:46 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-96c45981-a732-4db4-a5fd-f9feddccd92f tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Lock "/opt/stack/data/nova/instances/6110b34a-6fd3-45fc-911d-4e5d3c7f2d78/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:52:46 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-96c45981-a732-4db4-a5fd-f9feddccd92f tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Lock "/opt/stack/data/nova/instances/6110b34a-6fd3-45fc-911d-4e5d3c7f2d78/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:52:46 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-96c45981-a732-4db4-a5fd-f9feddccd92f tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:52:46 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:52:46 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-96c45981-a732-4db4-a5fd-f9feddccd92f tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json" returned: 0 in 0.245s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:52:46 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-96c45981-a732-4db4-a5fd-f9feddccd92f tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Acquiring lock "06ba3c914798499e686c5ac75886932347225275" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:52:46 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-96c45981-a732-4db4-a5fd-f9feddccd92f tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Lock "06ba3c914798499e686c5ac75886932347225275" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:52:46 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-96c45981-a732-4db4-a5fd-f9feddccd92f tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:52:47 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-96c45981-a732-4db4-a5fd-f9feddccd92f tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json" returned: 0 in 0.234s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:52:47 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-96c45981-a732-4db4-a5fd-f9feddccd92f tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275,backing_fmt=raw /opt/stack/data/nova/instances/6110b34a-6fd3-45fc-911d-4e5d3c7f2d78/disk 1073741824 {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:52:47 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-96c45981-a732-4db4-a5fd-f9feddccd92f tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275,backing_fmt=raw /opt/stack/data/nova/instances/6110b34a-6fd3-45fc-911d-4e5d3c7f2d78/disk 1073741824" returned: 0 in 0.061s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:52:47 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-96c45981-a732-4db4-a5fd-f9feddccd92f tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Lock "06ba3c914798499e686c5ac75886932347225275" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.305s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:52:47 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-96c45981-a732-4db4-a5fd-f9feddccd92f tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:52:47 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-96c45981-a732-4db4-a5fd-f9feddccd92f tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json" returned: 0 in 0.222s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:52:47 user nova-compute[75337]: DEBUG nova.virt.disk.api [None req-96c45981-a732-4db4-a5fd-f9feddccd92f tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6110b34a-6fd3-45fc-911d-4e5d3c7f2d78/disk. size=1073741824 {{(pid=75337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 15:52:47 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-96c45981-a732-4db4-a5fd-f9feddccd92f tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6110b34a-6fd3-45fc-911d-4e5d3c7f2d78/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:52:47 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-96c45981-a732-4db4-a5fd-f9feddccd92f tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6110b34a-6fd3-45fc-911d-4e5d3c7f2d78/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:52:47 user nova-compute[75337]: DEBUG nova.virt.disk.api [None req-96c45981-a732-4db4-a5fd-f9feddccd92f tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Cannot resize image /opt/stack/data/nova/instances/6110b34a-6fd3-45fc-911d-4e5d3c7f2d78/disk to a smaller size. {{(pid=75337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 06 15:52:47 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-96c45981-a732-4db4-a5fd-f9feddccd92f tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: 6110b34a-6fd3-45fc-911d-4e5d3c7f2d78] Created local disks {{(pid=75337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 15:52:47 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-96c45981-a732-4db4-a5fd-f9feddccd92f tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: 6110b34a-6fd3-45fc-911d-4e5d3c7f2d78] Ensure instance console log exists: /opt/stack/data/nova/instances/6110b34a-6fd3-45fc-911d-4e5d3c7f2d78/console.log {{(pid=75337) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 15:52:47 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-96c45981-a732-4db4-a5fd-f9feddccd92f tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:52:47 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-96c45981-a732-4db4-a5fd-f9feddccd92f tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:52:47 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-96c45981-a732-4db4-a5fd-f9feddccd92f tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:52:47 user nova-compute[75337]: DEBUG nova.network.neutron [None req-96c45981-a732-4db4-a5fd-f9feddccd92f tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: 6110b34a-6fd3-45fc-911d-4e5d3c7f2d78] Successfully created port: fa3c6657-452e-4a95-b9c8-c59002be4e31 {{(pid=75337) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 15:52:48 user nova-compute[75337]: DEBUG nova.network.neutron [None req-96c45981-a732-4db4-a5fd-f9feddccd92f tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: 6110b34a-6fd3-45fc-911d-4e5d3c7f2d78] Successfully updated port: fa3c6657-452e-4a95-b9c8-c59002be4e31 {{(pid=75337) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 15:52:48 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-96c45981-a732-4db4-a5fd-f9feddccd92f tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Acquiring lock "refresh_cache-6110b34a-6fd3-45fc-911d-4e5d3c7f2d78" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 15:52:48 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-96c45981-a732-4db4-a5fd-f9feddccd92f tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Acquired lock "refresh_cache-6110b34a-6fd3-45fc-911d-4e5d3c7f2d78" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 15:52:48 user nova-compute[75337]: DEBUG nova.network.neutron [None req-96c45981-a732-4db4-a5fd-f9feddccd92f tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: 6110b34a-6fd3-45fc-911d-4e5d3c7f2d78] Building network info cache for instance {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 15:52:48 user nova-compute[75337]: DEBUG nova.compute.manager [req-71147e15-5512-4bf2-9803-77f58af567bd req-e8382e38-7427-4147-bd96-545f431c5b33 service nova] [instance: 6110b34a-6fd3-45fc-911d-4e5d3c7f2d78] Received event network-changed-fa3c6657-452e-4a95-b9c8-c59002be4e31 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:52:48 user nova-compute[75337]: DEBUG nova.compute.manager [req-71147e15-5512-4bf2-9803-77f58af567bd req-e8382e38-7427-4147-bd96-545f431c5b33 service nova] [instance: 6110b34a-6fd3-45fc-911d-4e5d3c7f2d78] Refreshing instance network info cache due to event network-changed-fa3c6657-452e-4a95-b9c8-c59002be4e31. {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 15:52:48 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-71147e15-5512-4bf2-9803-77f58af567bd req-e8382e38-7427-4147-bd96-545f431c5b33 service nova] Acquiring lock "refresh_cache-6110b34a-6fd3-45fc-911d-4e5d3c7f2d78" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 15:52:48 user nova-compute[75337]: DEBUG nova.network.neutron [None req-96c45981-a732-4db4-a5fd-f9feddccd92f tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: 6110b34a-6fd3-45fc-911d-4e5d3c7f2d78] Instance cache missing network info. {{(pid=75337) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 15:52:48 user nova-compute[75337]: DEBUG nova.network.neutron [None req-96c45981-a732-4db4-a5fd-f9feddccd92f tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: 6110b34a-6fd3-45fc-911d-4e5d3c7f2d78] Updating instance_info_cache with network_info: [{"id": "fa3c6657-452e-4a95-b9c8-c59002be4e31", "address": "fa:16:3e:18:69:52", "network": {"id": "7f234ecf-bfa6-4316-9dce-c15050ba7914", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1378707892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "243647103fd44f629e0f40be0b56407e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa3c6657-45", "ovs_interfaceid": "fa3c6657-452e-4a95-b9c8-c59002be4e31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:52:48 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-96c45981-a732-4db4-a5fd-f9feddccd92f tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Releasing lock "refresh_cache-6110b34a-6fd3-45fc-911d-4e5d3c7f2d78" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 15:52:48 user nova-compute[75337]: DEBUG nova.compute.manager [None req-96c45981-a732-4db4-a5fd-f9feddccd92f tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: 6110b34a-6fd3-45fc-911d-4e5d3c7f2d78] Instance network_info: |[{"id": "fa3c6657-452e-4a95-b9c8-c59002be4e31", "address": "fa:16:3e:18:69:52", "network": {"id": "7f234ecf-bfa6-4316-9dce-c15050ba7914", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1378707892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "243647103fd44f629e0f40be0b56407e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa3c6657-45", "ovs_interfaceid": "fa3c6657-452e-4a95-b9c8-c59002be4e31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 15:52:48 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-71147e15-5512-4bf2-9803-77f58af567bd req-e8382e38-7427-4147-bd96-545f431c5b33 service nova] Acquired lock "refresh_cache-6110b34a-6fd3-45fc-911d-4e5d3c7f2d78" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 15:52:48 user nova-compute[75337]: DEBUG nova.network.neutron [req-71147e15-5512-4bf2-9803-77f58af567bd req-e8382e38-7427-4147-bd96-545f431c5b33 service nova] [instance: 6110b34a-6fd3-45fc-911d-4e5d3c7f2d78] Refreshing network info cache for port fa3c6657-452e-4a95-b9c8-c59002be4e31 {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 15:52:48 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-96c45981-a732-4db4-a5fd-f9feddccd92f tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: 6110b34a-6fd3-45fc-911d-4e5d3c7f2d78] Start _get_guest_xml network_info=[{"id": "fa3c6657-452e-4a95-b9c8-c59002be4e31", "address": "fa:16:3e:18:69:52", "network": {"id": "7f234ecf-bfa6-4316-9dce-c15050ba7914", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1378707892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "243647103fd44f629e0f40be0b56407e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa3c6657-45", "ovs_interfaceid": "fa3c6657-452e-4a95-b9c8-c59002be4e31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T15:34:14Z,direct_url=<?>,disk_format='qcow2',id=16b903ae-a40f-41a7-985b-4804cce92c62,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6549a15819f1469bbd5eeae8190e3d44',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T15:34:15Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'guest_format': None, 'size': 0, 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '16b903ae-a40f-41a7-985b-4804cce92c62'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 15:52:48 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-96c45981-a732-4db4-a5fd-f9feddccd92f tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 15:52:48 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-96c45981-a732-4db4-a5fd-f9feddccd92f tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 15:52:48 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-96c45981-a732-4db4-a5fd-f9feddccd92f tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 15:52:48 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-96c45981-a732-4db4-a5fd-f9feddccd92f tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] CPU controller missing on host. {{(pid=75337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 15:52:48 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-96c45981-a732-4db4-a5fd-f9feddccd92f tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 15:52:48 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-96c45981-a732-4db4-a5fd-f9feddccd92f tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] CPU controller found on host. {{(pid=75337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 15:52:48 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-96c45981-a732-4db4-a5fd-f9feddccd92f tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75337) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 15:52:48 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-96c45981-a732-4db4-a5fd-f9feddccd92f tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T15:34:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T15:34:14Z,direct_url=<?>,disk_format='qcow2',id=16b903ae-a40f-41a7-985b-4804cce92c62,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6549a15819f1469bbd5eeae8190e3d44',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T15:34:15Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 15:52:48 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-96c45981-a732-4db4-a5fd-f9feddccd92f tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Flavor limits 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 15:52:48 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-96c45981-a732-4db4-a5fd-f9feddccd92f tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Image limits 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 15:52:48 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-96c45981-a732-4db4-a5fd-f9feddccd92f tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Flavor pref 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 15:52:48 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-96c45981-a732-4db4-a5fd-f9feddccd92f tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Image pref 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 15:52:48 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-96c45981-a732-4db4-a5fd-f9feddccd92f tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 15:52:48 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-96c45981-a732-4db4-a5fd-f9feddccd92f tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 15:52:48 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-96c45981-a732-4db4-a5fd-f9feddccd92f tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 15:52:48 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-96c45981-a732-4db4-a5fd-f9feddccd92f tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Got 1 possible topologies {{(pid=75337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 15:52:48 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-96c45981-a732-4db4-a5fd-f9feddccd92f tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 15:52:48 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-96c45981-a732-4db4-a5fd-f9feddccd92f tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 15:52:48 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-96c45981-a732-4db4-a5fd-f9feddccd92f tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T15:52:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-578840654',display_name='tempest-ServerActionsTestOtherA-server-578840654',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-578840654',id=28,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL4qUjCjjdVsflRB1h4DRug41qRThkRpbPytYUyz/XMQHNCLS4P/DapnKkRg0/Jn7/AhFFjdzCG9PxcwwVtb8q/utJpW4U9sbkxfbmmpOTPsJTE2NdIyui4Q27o5JkMUFA==',key_name='tempest-keypair-766127816',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='243647103fd44f629e0f40be0b56407e',ramdisk_id='',reservation_id='r-ctbkz4ay',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-783619975',owner_user_name='tempest-ServerActionsTestOtherA-783619975-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T15:52:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2e47bf9ad49645deb2c1f834938fa39f',uuid=6110b34a-6fd3-45fc-911d-4e5d3c7f2d78,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fa3c6657-452e-4a95-b9c8-c59002be4e31", "address": "fa:16:3e:18:69:52", "network": {"id": "7f234ecf-bfa6-4316-9dce-c15050ba7914", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1378707892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "243647103fd44f629e0f40be0b56407e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa3c6657-45", "ovs_interfaceid": "fa3c6657-452e-4a95-b9c8-c59002be4e31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75337) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 15:52:48 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-96c45981-a732-4db4-a5fd-f9feddccd92f tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Converting VIF {"id": "fa3c6657-452e-4a95-b9c8-c59002be4e31", "address": "fa:16:3e:18:69:52", "network": {"id": "7f234ecf-bfa6-4316-9dce-c15050ba7914", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1378707892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "243647103fd44f629e0f40be0b56407e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa3c6657-45", "ovs_interfaceid": "fa3c6657-452e-4a95-b9c8-c59002be4e31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 15:52:48 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-96c45981-a732-4db4-a5fd-f9feddccd92f tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:69:52,bridge_name='br-int',has_traffic_filtering=True,id=fa3c6657-452e-4a95-b9c8-c59002be4e31,network=Network(7f234ecf-bfa6-4316-9dce-c15050ba7914),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa3c6657-45') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 15:52:48 user nova-compute[75337]: DEBUG nova.objects.instance [None req-96c45981-a732-4db4-a5fd-f9feddccd92f tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Lazy-loading 'pci_devices' on Instance uuid 6110b34a-6fd3-45fc-911d-4e5d3c7f2d78 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 15:52:48 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-96c45981-a732-4db4-a5fd-f9feddccd92f tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: 6110b34a-6fd3-45fc-911d-4e5d3c7f2d78] End _get_guest_xml xml=<domain type="kvm">
Nov 06 15:52:48 user nova-compute[75337]:   <uuid>6110b34a-6fd3-45fc-911d-4e5d3c7f2d78</uuid>
Nov 06 15:52:48 user nova-compute[75337]:   <name>instance-0000001c</name>
Nov 06 15:52:48 user nova-compute[75337]:   <memory>524288</memory>
Nov 06 15:52:48 user nova-compute[75337]:   <vcpu>1</vcpu>
Nov 06 15:52:48 user nova-compute[75337]:   <metadata>
Nov 06 15:52:48 user nova-compute[75337]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 15:52:48 user nova-compute[75337]:       <nova:package version="0.0.0"/>
Nov 06 15:52:48 user nova-compute[75337]:       <nova:name>tempest-ServerActionsTestOtherA-server-578840654</nova:name>
Nov 06 15:52:48 user nova-compute[75337]:       <nova:creationTime>2023-11-06 15:52:48</nova:creationTime>
Nov 06 15:52:48 user nova-compute[75337]:       <nova:flavor name="m1.tiny">
Nov 06 15:52:48 user nova-compute[75337]:         <nova:memory>512</nova:memory>
Nov 06 15:52:48 user nova-compute[75337]:         <nova:disk>1</nova:disk>
Nov 06 15:52:48 user nova-compute[75337]:         <nova:swap>0</nova:swap>
Nov 06 15:52:48 user nova-compute[75337]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 15:52:48 user nova-compute[75337]:         <nova:vcpus>1</nova:vcpus>
Nov 06 15:52:48 user nova-compute[75337]:       </nova:flavor>
Nov 06 15:52:48 user nova-compute[75337]:       <nova:owner>
Nov 06 15:52:48 user nova-compute[75337]:         <nova:user uuid="2e47bf9ad49645deb2c1f834938fa39f">tempest-ServerActionsTestOtherA-783619975-project-member</nova:user>
Nov 06 15:52:48 user nova-compute[75337]:         <nova:project uuid="243647103fd44f629e0f40be0b56407e">tempest-ServerActionsTestOtherA-783619975</nova:project>
Nov 06 15:52:48 user nova-compute[75337]:       </nova:owner>
Nov 06 15:52:48 user nova-compute[75337]:       <nova:root type="image" uuid="16b903ae-a40f-41a7-985b-4804cce92c62"/>
Nov 06 15:52:48 user nova-compute[75337]:       <nova:ports>
Nov 06 15:52:48 user nova-compute[75337]:         <nova:port uuid="fa3c6657-452e-4a95-b9c8-c59002be4e31">
Nov 06 15:52:48 user nova-compute[75337]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 06 15:52:48 user nova-compute[75337]:         </nova:port>
Nov 06 15:52:48 user nova-compute[75337]:       </nova:ports>
Nov 06 15:52:48 user nova-compute[75337]:     </nova:instance>
Nov 06 15:52:48 user nova-compute[75337]:   </metadata>
Nov 06 15:52:48 user nova-compute[75337]:   <sysinfo type="smbios">
Nov 06 15:52:48 user nova-compute[75337]:     <system>
Nov 06 15:52:48 user nova-compute[75337]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 15:52:48 user nova-compute[75337]:       <entry name="product">OpenStack Nova</entry>
Nov 06 15:52:48 user nova-compute[75337]:       <entry name="version">0.0.0</entry>
Nov 06 15:52:48 user nova-compute[75337]:       <entry name="serial">6110b34a-6fd3-45fc-911d-4e5d3c7f2d78</entry>
Nov 06 15:52:48 user nova-compute[75337]:       <entry name="uuid">6110b34a-6fd3-45fc-911d-4e5d3c7f2d78</entry>
Nov 06 15:52:48 user nova-compute[75337]:       <entry name="family">Virtual Machine</entry>
Nov 06 15:52:48 user nova-compute[75337]:     </system>
Nov 06 15:52:48 user nova-compute[75337]:   </sysinfo>
Nov 06 15:52:48 user nova-compute[75337]:   <os>
Nov 06 15:52:48 user nova-compute[75337]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 15:52:48 user nova-compute[75337]:     <boot dev="hd"/>
Nov 06 15:52:48 user nova-compute[75337]:     <smbios mode="sysinfo"/>
Nov 06 15:52:48 user nova-compute[75337]:   </os>
Nov 06 15:52:48 user nova-compute[75337]:   <features>
Nov 06 15:52:48 user nova-compute[75337]:     <acpi/>
Nov 06 15:52:48 user nova-compute[75337]:     <apic/>
Nov 06 15:52:48 user nova-compute[75337]:     <vmcoreinfo/>
Nov 06 15:52:48 user nova-compute[75337]:   </features>
Nov 06 15:52:48 user nova-compute[75337]:   <clock offset="utc">
Nov 06 15:52:48 user nova-compute[75337]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 15:52:48 user nova-compute[75337]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 15:52:48 user nova-compute[75337]:     <timer name="hpet" present="no"/>
Nov 06 15:52:48 user nova-compute[75337]:   </clock>
Nov 06 15:52:48 user nova-compute[75337]:   <cpu mode="custom" match="exact">
Nov 06 15:52:48 user nova-compute[75337]:     <model>Nehalem</model>
Nov 06 15:52:48 user nova-compute[75337]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 15:52:48 user nova-compute[75337]:   </cpu>
Nov 06 15:52:48 user nova-compute[75337]:   <devices>
Nov 06 15:52:48 user nova-compute[75337]:     <disk type="file" device="disk">
Nov 06 15:52:48 user nova-compute[75337]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 15:52:48 user nova-compute[75337]:       <source file="/opt/stack/data/nova/instances/6110b34a-6fd3-45fc-911d-4e5d3c7f2d78/disk"/>
Nov 06 15:52:48 user nova-compute[75337]:       <target dev="vda" bus="virtio"/>
Nov 06 15:52:48 user nova-compute[75337]:     </disk>
Nov 06 15:52:48 user nova-compute[75337]:     <interface type="ethernet">
Nov 06 15:52:48 user nova-compute[75337]:       <mac address="fa:16:3e:18:69:52"/>
Nov 06 15:52:48 user nova-compute[75337]:       <model type="virtio"/>
Nov 06 15:52:48 user nova-compute[75337]:       <mtu size="1442"/>
Nov 06 15:52:48 user nova-compute[75337]:       <target dev="tapfa3c6657-45"/>
Nov 06 15:52:48 user nova-compute[75337]:     </interface>
Nov 06 15:52:48 user nova-compute[75337]:     <serial type="pty">
Nov 06 15:52:48 user nova-compute[75337]:       <log file="/opt/stack/data/nova/instances/6110b34a-6fd3-45fc-911d-4e5d3c7f2d78/console.log" append="off"/>
Nov 06 15:52:48 user nova-compute[75337]:     </serial>
Nov 06 15:52:48 user nova-compute[75337]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 15:52:48 user nova-compute[75337]:     <video>
Nov 06 15:52:48 user nova-compute[75337]:       <model type="virtio"/>
Nov 06 15:52:48 user nova-compute[75337]:     </video>
Nov 06 15:52:48 user nova-compute[75337]:     <rng model="virtio">
Nov 06 15:52:48 user nova-compute[75337]:       <backend model="random">/dev/urandom</backend>
Nov 06 15:52:48 user nova-compute[75337]:     </rng>
Nov 06 15:52:48 user nova-compute[75337]:     <controller type="usb" index="0" model="none"/>
Nov 06 15:52:48 user nova-compute[75337]:     <memballoon model="virtio">
Nov 06 15:52:48 user nova-compute[75337]:       <stats period="10"/>
Nov 06 15:52:48 user nova-compute[75337]:     </memballoon>
Nov 06 15:52:48 user nova-compute[75337]:   </devices>
Nov 06 15:52:48 user nova-compute[75337]: </domain>
Nov 06 15:52:48 user nova-compute[75337]:  {{(pid=75337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 15:52:48 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-96c45981-a732-4db4-a5fd-f9feddccd92f tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T15:52:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-578840654',display_name='tempest-ServerActionsTestOtherA-server-578840654',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-578840654',id=28,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL4qUjCjjdVsflRB1h4DRug41qRThkRpbPytYUyz/XMQHNCLS4P/DapnKkRg0/Jn7/AhFFjdzCG9PxcwwVtb8q/utJpW4U9sbkxfbmmpOTPsJTE2NdIyui4Q27o5JkMUFA==',key_name='tempest-keypair-766127816',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='243647103fd44f629e0f40be0b56407e',ramdisk_id='',reservation_id='r-ctbkz4ay',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-783619975',owner_user_name='tempest-ServerActionsTestOtherA-783619975-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T15:52:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2e47bf9ad49645deb2c1f834938fa39f',uuid=6110b34a-6fd3-45fc-911d-4e5d3c7f2d78,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fa3c6657-452e-4a95-b9c8-c59002be4e31", "address": "fa:16:3e:18:69:52", "network": {"id": "7f234ecf-bfa6-4316-9dce-c15050ba7914", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1378707892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "243647103fd44f629e0f40be0b56407e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa3c6657-45", "ovs_interfaceid": "fa3c6657-452e-4a95-b9c8-c59002be4e31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 15:52:48 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-96c45981-a732-4db4-a5fd-f9feddccd92f tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Converting VIF {"id": "fa3c6657-452e-4a95-b9c8-c59002be4e31", "address": "fa:16:3e:18:69:52", "network": {"id": "7f234ecf-bfa6-4316-9dce-c15050ba7914", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1378707892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "243647103fd44f629e0f40be0b56407e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa3c6657-45", "ovs_interfaceid": "fa3c6657-452e-4a95-b9c8-c59002be4e31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 15:52:48 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-96c45981-a732-4db4-a5fd-f9feddccd92f tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:69:52,bridge_name='br-int',has_traffic_filtering=True,id=fa3c6657-452e-4a95-b9c8-c59002be4e31,network=Network(7f234ecf-bfa6-4316-9dce-c15050ba7914),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa3c6657-45') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 15:52:48 user nova-compute[75337]: DEBUG os_vif [None req-96c45981-a732-4db4-a5fd-f9feddccd92f tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:69:52,bridge_name='br-int',has_traffic_filtering=True,id=fa3c6657-452e-4a95-b9c8-c59002be4e31,network=Network(7f234ecf-bfa6-4316-9dce-c15050ba7914),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa3c6657-45') {{(pid=75337) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 15:52:48 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:52:48 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:52:48 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 15:52:48 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:52:48 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f583d8f2-5699-581a-b68f-02f960244ef3', '_type': 'linux-noop'}}, row=False) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:52:48 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:52:48 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-6b36b833-6eb8-443c-b9b6-17c4df0d1a2c tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Acquiring lock "a293c354-d1e5-4c33-9e7b-d1558235aaf8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:52:48 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-6b36b833-6eb8-443c-b9b6-17c4df0d1a2c tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Lock "a293c354-d1e5-4c33-9e7b-d1558235aaf8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:52:48 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:52:48 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:52:48 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfa3c6657-45, may_exist=True, interface_attrs={}) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:52:48 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfa3c6657-45, col_values=(('qos', UUID('dcc630a3-0330-4781-a630-5e9781f87a8c')),), if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:52:48 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfa3c6657-45, col_values=(('external_ids', {'iface-id': 'fa3c6657-452e-4a95-b9c8-c59002be4e31', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:18:69:52', 'vm-uuid': '6110b34a-6fd3-45fc-911d-4e5d3c7f2d78'}),), if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:52:48 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:52:48 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:52:48 user nova-compute[75337]: DEBUG nova.objects.instance [None req-6b36b833-6eb8-443c-b9b6-17c4df0d1a2c tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Lazy-loading 'flavor' on Instance uuid a293c354-d1e5-4c33-9e7b-d1558235aaf8 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 15:52:48 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:52:48 user nova-compute[75337]: INFO os_vif [None req-96c45981-a732-4db4-a5fd-f9feddccd92f tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:69:52,bridge_name='br-int',has_traffic_filtering=True,id=fa3c6657-452e-4a95-b9c8-c59002be4e31,network=Network(7f234ecf-bfa6-4316-9dce-c15050ba7914),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa3c6657-45')
Nov 06 15:52:49 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-6b36b833-6eb8-443c-b9b6-17c4df0d1a2c tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Lock "a293c354-d1e5-4c33-9e7b-d1558235aaf8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.087s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:52:49 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-96c45981-a732-4db4-a5fd-f9feddccd92f tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] No BDM found with device name vda, not building metadata. {{(pid=75337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 15:52:49 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-96c45981-a732-4db4-a5fd-f9feddccd92f tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] No VIF found with MAC fa:16:3e:18:69:52, not building metadata {{(pid=75337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 15:52:49 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-6b36b833-6eb8-443c-b9b6-17c4df0d1a2c tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Acquiring lock "a293c354-d1e5-4c33-9e7b-d1558235aaf8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:52:49 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-6b36b833-6eb8-443c-b9b6-17c4df0d1a2c tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Lock "a293c354-d1e5-4c33-9e7b-d1558235aaf8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:52:49 user nova-compute[75337]: INFO nova.compute.manager [None req-6b36b833-6eb8-443c-b9b6-17c4df0d1a2c tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] [instance: a293c354-d1e5-4c33-9e7b-d1558235aaf8] Attaching volume 431ec26e-b61f-4971-88c8-2ddcf3b66d3c to /dev/vdb
Nov 06 15:52:49 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:52:49 user nova-compute[75337]: DEBUG os_brick.utils [None req-6b36b833-6eb8-443c-b9b6-17c4df0d1a2c tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 15:52:49 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:52:49 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.022s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:52:49 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ba3691a-0d4d-471b-9ee2-0f3d499563c3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4ff6411e45b8\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:52:49 user nova-compute[75337]: DEBUG nova.network.neutron [req-71147e15-5512-4bf2-9803-77f58af567bd req-e8382e38-7427-4147-bd96-545f431c5b33 service nova] [instance: 6110b34a-6fd3-45fc-911d-4e5d3c7f2d78] Updated VIF entry in instance network info cache for port fa3c6657-452e-4a95-b9c8-c59002be4e31. {{(pid=75337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 15:52:49 user nova-compute[75337]: DEBUG nova.network.neutron [req-71147e15-5512-4bf2-9803-77f58af567bd req-e8382e38-7427-4147-bd96-545f431c5b33 service nova] [instance: 6110b34a-6fd3-45fc-911d-4e5d3c7f2d78] Updating instance_info_cache with network_info: [{"id": "fa3c6657-452e-4a95-b9c8-c59002be4e31", "address": "fa:16:3e:18:69:52", "network": {"id": "7f234ecf-bfa6-4316-9dce-c15050ba7914", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1378707892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "243647103fd44f629e0f40be0b56407e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa3c6657-45", "ovs_interfaceid": "fa3c6657-452e-4a95-b9c8-c59002be4e31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:52:49 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:52:49 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-71147e15-5512-4bf2-9803-77f58af567bd req-e8382e38-7427-4147-bd96-545f431c5b33 service nova] Releasing lock "refresh_cache-6110b34a-6fd3-45fc-911d-4e5d3c7f2d78" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 15:52:49 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:52:49 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[5959a0e4-310c-4905-aa0f-f2874a00cc31]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:52:49 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:52:49 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:52:49 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[d00363f9-ac33-4804-980f-b9250e49068d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:52:49 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[3db06a8a-e143-4054-b997-33482810f0ef]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:52:49 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-6b36b833-6eb8-443c-b9b6-17c4df0d1a2c tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Running cmd (subprocess): nvme version {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:52:49 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-6b36b833-6eb8-443c-b9b6-17c4df0d1a2c tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] 'nvme version' failed. Not Retrying. {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 15:52:49 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6b36b833-6eb8-443c-b9b6-17c4df0d1a2c tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] nvme not present on system {{(pid=75337) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 15:52:49 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:52:49 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 15:52:49 user nova-compute[75337]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 15:52:49 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[36b92fb8-a140-4cd1-b3f1-29f9bf4f8e86]: (4, '') {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:52:49 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.lightos [None req-6b36b833-6eb8-443c-b9b6-17c4df0d1a2c tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75337) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 15:52:49 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.lightos [None req-6b36b833-6eb8-443c-b9b6-17c4df0d1a2c tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 15:52:49 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.lightos [None req-6b36b833-6eb8-443c-b9b6-17c4df0d1a2c tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] LIGHTOS: no hostnqn found. {{(pid=75337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 15:52:49 user nova-compute[75337]: DEBUG os_brick.utils [None req-6b36b833-6eb8-443c-b9b6-17c4df0d1a2c tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] <== get_connector_properties: return (149ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4ff6411e45b8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 15:52:49 user nova-compute[75337]: DEBUG nova.virt.block_device [None req-6b36b833-6eb8-443c-b9b6-17c4df0d1a2c tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] [instance: a293c354-d1e5-4c33-9e7b-d1558235aaf8] Updating existing volume attachment record: fe35a8da-fb3b-4332-84b4-9557bcb8e525 {{(pid=75337) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 15:52:50 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:52:50 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:52:50 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:52:50 user nova-compute[75337]: DEBUG nova.compute.manager [req-64ca7277-133e-4a1d-b03b-ca777121c1d1 req-55b71b87-bb89-4142-af64-7976e7dce9a6 service nova] [instance: 6110b34a-6fd3-45fc-911d-4e5d3c7f2d78] Received event network-vif-plugged-fa3c6657-452e-4a95-b9c8-c59002be4e31 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:52:50 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-64ca7277-133e-4a1d-b03b-ca777121c1d1 req-55b71b87-bb89-4142-af64-7976e7dce9a6 service nova] Acquiring lock "6110b34a-6fd3-45fc-911d-4e5d3c7f2d78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:52:50 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-64ca7277-133e-4a1d-b03b-ca777121c1d1 req-55b71b87-bb89-4142-af64-7976e7dce9a6 service nova] Lock "6110b34a-6fd3-45fc-911d-4e5d3c7f2d78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:52:50 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-64ca7277-133e-4a1d-b03b-ca777121c1d1 req-55b71b87-bb89-4142-af64-7976e7dce9a6 service nova] Lock "6110b34a-6fd3-45fc-911d-4e5d3c7f2d78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:52:50 user nova-compute[75337]: DEBUG nova.compute.manager [req-64ca7277-133e-4a1d-b03b-ca777121c1d1 req-55b71b87-bb89-4142-af64-7976e7dce9a6 service nova] [instance: 6110b34a-6fd3-45fc-911d-4e5d3c7f2d78] No waiting events found dispatching network-vif-plugged-fa3c6657-452e-4a95-b9c8-c59002be4e31 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:52:50 user nova-compute[75337]: WARNING nova.compute.manager [req-64ca7277-133e-4a1d-b03b-ca777121c1d1 req-55b71b87-bb89-4142-af64-7976e7dce9a6 service nova] [instance: 6110b34a-6fd3-45fc-911d-4e5d3c7f2d78] Received unexpected event network-vif-plugged-fa3c6657-452e-4a95-b9c8-c59002be4e31 for instance with vm_state building and task_state spawning.
Nov 06 15:52:51 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:52:51 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:52:52 user nova-compute[75337]: DEBUG nova.compute.manager [req-20cd0668-cffc-4151-97a8-91ddc05a54ad req-9397dcfb-71c6-4704-8dec-b774b27394d7 service nova] [instance: 6110b34a-6fd3-45fc-911d-4e5d3c7f2d78] Received event network-vif-plugged-fa3c6657-452e-4a95-b9c8-c59002be4e31 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:52:52 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-20cd0668-cffc-4151-97a8-91ddc05a54ad req-9397dcfb-71c6-4704-8dec-b774b27394d7 service nova] Acquiring lock "6110b34a-6fd3-45fc-911d-4e5d3c7f2d78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:52:52 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-20cd0668-cffc-4151-97a8-91ddc05a54ad req-9397dcfb-71c6-4704-8dec-b774b27394d7 service nova] Lock "6110b34a-6fd3-45fc-911d-4e5d3c7f2d78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:52:52 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-20cd0668-cffc-4151-97a8-91ddc05a54ad req-9397dcfb-71c6-4704-8dec-b774b27394d7 service nova] Lock "6110b34a-6fd3-45fc-911d-4e5d3c7f2d78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:52:52 user nova-compute[75337]: DEBUG nova.compute.manager [req-20cd0668-cffc-4151-97a8-91ddc05a54ad req-9397dcfb-71c6-4704-8dec-b774b27394d7 service nova] [instance: 6110b34a-6fd3-45fc-911d-4e5d3c7f2d78] No waiting events found dispatching network-vif-plugged-fa3c6657-452e-4a95-b9c8-c59002be4e31 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:52:52 user nova-compute[75337]: WARNING nova.compute.manager [req-20cd0668-cffc-4151-97a8-91ddc05a54ad req-9397dcfb-71c6-4704-8dec-b774b27394d7 service nova] [instance: 6110b34a-6fd3-45fc-911d-4e5d3c7f2d78] Received unexpected event network-vif-plugged-fa3c6657-452e-4a95-b9c8-c59002be4e31 for instance with vm_state building and task_state spawning.
Nov 06 15:52:52 user nova-compute[75337]: DEBUG nova.compute.manager [None req-96c45981-a732-4db4-a5fd-f9feddccd92f tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: 6110b34a-6fd3-45fc-911d-4e5d3c7f2d78] Instance event wait completed in 0 seconds for  {{(pid=75337) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 15:52:52 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-96c45981-a732-4db4-a5fd-f9feddccd92f tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: 6110b34a-6fd3-45fc-911d-4e5d3c7f2d78] Guest created on hypervisor {{(pid=75337) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 15:52:52 user nova-compute[75337]: INFO nova.virt.libvirt.driver [-] [instance: 6110b34a-6fd3-45fc-911d-4e5d3c7f2d78] Instance spawned successfully.
Nov 06 15:52:52 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-96c45981-a732-4db4-a5fd-f9feddccd92f tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: 6110b34a-6fd3-45fc-911d-4e5d3c7f2d78] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 15:52:53 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-96c45981-a732-4db4-a5fd-f9feddccd92f tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: 6110b34a-6fd3-45fc-911d-4e5d3c7f2d78] Found default for hw_cdrom_bus of ide {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:52:53 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-96c45981-a732-4db4-a5fd-f9feddccd92f tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: 6110b34a-6fd3-45fc-911d-4e5d3c7f2d78] Found default for hw_disk_bus of virtio {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:52:53 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-96c45981-a732-4db4-a5fd-f9feddccd92f tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: 6110b34a-6fd3-45fc-911d-4e5d3c7f2d78] Found default for hw_input_bus of None {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:52:53 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-96c45981-a732-4db4-a5fd-f9feddccd92f tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: 6110b34a-6fd3-45fc-911d-4e5d3c7f2d78] Found default for hw_pointer_model of None {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:52:53 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-96c45981-a732-4db4-a5fd-f9feddccd92f tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: 6110b34a-6fd3-45fc-911d-4e5d3c7f2d78] Found default for hw_video_model of virtio {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:52:53 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-96c45981-a732-4db4-a5fd-f9feddccd92f tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: 6110b34a-6fd3-45fc-911d-4e5d3c7f2d78] Found default for hw_vif_model of virtio {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:52:53 user nova-compute[75337]: INFO nova.compute.manager [None req-96c45981-a732-4db4-a5fd-f9feddccd92f tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: 6110b34a-6fd3-45fc-911d-4e5d3c7f2d78] Took 6.57 seconds to spawn the instance on the hypervisor.
Nov 06 15:52:53 user nova-compute[75337]: DEBUG nova.compute.manager [None req-96c45981-a732-4db4-a5fd-f9feddccd92f tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: 6110b34a-6fd3-45fc-911d-4e5d3c7f2d78] Checking state {{(pid=75337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 15:52:53 user nova-compute[75337]: INFO nova.compute.manager [None req-96c45981-a732-4db4-a5fd-f9feddccd92f tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: 6110b34a-6fd3-45fc-911d-4e5d3c7f2d78] Took 7.48 seconds to build instance.
Nov 06 15:52:53 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-96c45981-a732-4db4-a5fd-f9feddccd92f tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Lock "6110b34a-6fd3-45fc-911d-4e5d3c7f2d78" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.613s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:52:53 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:52:54 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:52:54 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-0b9d4c18-2490-4021-afaa-a17a6e6def63 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Acquiring lock "1fa4c927-7485-4f34-94bd-9e20358904b6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:52:54 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-0b9d4c18-2490-4021-afaa-a17a6e6def63 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Lock "1fa4c927-7485-4f34-94bd-9e20358904b6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:52:54 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-0b9d4c18-2490-4021-afaa-a17a6e6def63 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Acquiring lock "1fa4c927-7485-4f34-94bd-9e20358904b6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:52:54 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-0b9d4c18-2490-4021-afaa-a17a6e6def63 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Lock "1fa4c927-7485-4f34-94bd-9e20358904b6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:52:54 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-0b9d4c18-2490-4021-afaa-a17a6e6def63 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Lock "1fa4c927-7485-4f34-94bd-9e20358904b6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:52:54 user nova-compute[75337]: INFO nova.compute.manager [None req-0b9d4c18-2490-4021-afaa-a17a6e6def63 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: 1fa4c927-7485-4f34-94bd-9e20358904b6] Terminating instance
Nov 06 15:52:54 user nova-compute[75337]: DEBUG nova.compute.manager [None req-0b9d4c18-2490-4021-afaa-a17a6e6def63 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: 1fa4c927-7485-4f34-94bd-9e20358904b6] Start destroying the instance on the hypervisor. {{(pid=75337) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 15:52:54 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:52:54 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:52:55 user nova-compute[75337]: DEBUG nova.compute.manager [req-aaba306b-b7c8-43c8-9c8b-a2cbaaf0fa56 req-e1130cb9-4e05-4710-a4da-e11c98687ac6 service nova] [instance: 1fa4c927-7485-4f34-94bd-9e20358904b6] Received event network-vif-unplugged-3812cc74-01db-4b2b-815c-770420051e1b {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:52:55 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-aaba306b-b7c8-43c8-9c8b-a2cbaaf0fa56 req-e1130cb9-4e05-4710-a4da-e11c98687ac6 service nova] Acquiring lock "1fa4c927-7485-4f34-94bd-9e20358904b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:52:55 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-aaba306b-b7c8-43c8-9c8b-a2cbaaf0fa56 req-e1130cb9-4e05-4710-a4da-e11c98687ac6 service nova] Lock "1fa4c927-7485-4f34-94bd-9e20358904b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:52:55 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-aaba306b-b7c8-43c8-9c8b-a2cbaaf0fa56 req-e1130cb9-4e05-4710-a4da-e11c98687ac6 service nova] Lock "1fa4c927-7485-4f34-94bd-9e20358904b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:52:55 user nova-compute[75337]: DEBUG nova.compute.manager [req-aaba306b-b7c8-43c8-9c8b-a2cbaaf0fa56 req-e1130cb9-4e05-4710-a4da-e11c98687ac6 service nova] [instance: 1fa4c927-7485-4f34-94bd-9e20358904b6] No waiting events found dispatching network-vif-unplugged-3812cc74-01db-4b2b-815c-770420051e1b {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:52:55 user nova-compute[75337]: DEBUG nova.compute.manager [req-aaba306b-b7c8-43c8-9c8b-a2cbaaf0fa56 req-e1130cb9-4e05-4710-a4da-e11c98687ac6 service nova] [instance: 1fa4c927-7485-4f34-94bd-9e20358904b6] Received event network-vif-unplugged-3812cc74-01db-4b2b-815c-770420051e1b for instance with task_state deleting. {{(pid=75337) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 15:52:55 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:52:55 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:52:55 user nova-compute[75337]: INFO nova.virt.libvirt.driver [-] [instance: 1fa4c927-7485-4f34-94bd-9e20358904b6] Instance destroyed successfully.
Nov 06 15:52:55 user nova-compute[75337]: DEBUG nova.objects.instance [None req-0b9d4c18-2490-4021-afaa-a17a6e6def63 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Lazy-loading 'resources' on Instance uuid 1fa4c927-7485-4f34-94bd-9e20358904b6 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 15:52:55 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-0b9d4c18-2490-4021-afaa-a17a6e6def63 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T15:40:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-777586837',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-777586837',id=12,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-06T15:43:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='eb76b5b0f2b24f1c84a92403176bcc00',ramdisk_id='',reservation_id='r-hsqdw3vy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2044295020',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T15:45:36Z,user_data=None,user_id='74090d6e5b354d79bf6ded92e6de56aa',uuid=1fa4c927-7485-4f34-94bd-9e20358904b6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3812cc74-01db-4b2b-815c-770420051e1b", "address": "fa:16:3e:f4:aa:7b", "network": {"id": "736be000-ee94-41fd-9de0-f2f885ec9be7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1715443852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb76b5b0f2b24f1c84a92403176bcc00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3812cc74-01", "ovs_interfaceid": "3812cc74-01db-4b2b-815c-770420051e1b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 15:52:55 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-0b9d4c18-2490-4021-afaa-a17a6e6def63 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Converting VIF {"id": "3812cc74-01db-4b2b-815c-770420051e1b", "address": "fa:16:3e:f4:aa:7b", "network": {"id": "736be000-ee94-41fd-9de0-f2f885ec9be7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1715443852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb76b5b0f2b24f1c84a92403176bcc00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3812cc74-01", "ovs_interfaceid": "3812cc74-01db-4b2b-815c-770420051e1b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 15:52:55 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-0b9d4c18-2490-4021-afaa-a17a6e6def63 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f4:aa:7b,bridge_name='br-int',has_traffic_filtering=True,id=3812cc74-01db-4b2b-815c-770420051e1b,network=Network(736be000-ee94-41fd-9de0-f2f885ec9be7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3812cc74-01') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 15:52:55 user nova-compute[75337]: DEBUG os_vif [None req-0b9d4c18-2490-4021-afaa-a17a6e6def63 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f4:aa:7b,bridge_name='br-int',has_traffic_filtering=True,id=3812cc74-01db-4b2b-815c-770420051e1b,network=Network(736be000-ee94-41fd-9de0-f2f885ec9be7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3812cc74-01') {{(pid=75337) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 15:52:55 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:52:55 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3812cc74-01, bridge=br-int, if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:52:55 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:52:55 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:52:55 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:52:55 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a9942ea8-3a87-4bf1-a442-502486bdcef4) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:52:55 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:52:55 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:52:55 user nova-compute[75337]: INFO os_vif [None req-0b9d4c18-2490-4021-afaa-a17a6e6def63 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f4:aa:7b,bridge_name='br-int',has_traffic_filtering=True,id=3812cc74-01db-4b2b-815c-770420051e1b,network=Network(736be000-ee94-41fd-9de0-f2f885ec9be7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3812cc74-01')
Nov 06 15:52:55 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0b9d4c18-2490-4021-afaa-a17a6e6def63 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: 1fa4c927-7485-4f34-94bd-9e20358904b6] calling os-brick to detach iSCSI Volume {{(pid=75337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 15:52:55 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b9d4c18-2490-4021-afaa-a17a6e6def63 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2abc33d0c0>, {'target_iqn': 'iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WUOuHYhT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 15:52:55 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-0b9d4c18-2490-4021-afaa-a17a6e6def63 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 15:52:55 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-0b9d4c18-2490-4021-afaa-a17a6e6def63 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 15:52:55 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-0b9d4c18-2490-4021-afaa-a17a6e6def63 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 15:52:55 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:52:55 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:52:55 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c5dd75e-97f6-421c-b298-ac35abb41ea9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ea7e84b5-25b5-4146-a33b-f23a700deadf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2086a611-973d-47a1-bb69-f2ebd144be03\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:52:55 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b9d4c18-2490-4021-afaa-a17a6e6def63 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 15:52:55 user nova-compute[75337]: No targets found.
Nov 06 15:52:55 user nova-compute[75337]: iSNS:
Nov 06 15:52:55 user nova-compute[75337]: No targets found.
Nov 06 15:52:55 user nova-compute[75337]: STATIC:
Nov 06 15:52:55 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158
Nov 06 15:52:55 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 15:52:55 user nova-compute[75337]:                 Iface Name: default
Nov 06 15:52:55 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:ea7e84b5-25b5-4146-a33b-f23a700deadf
Nov 06 15:52:55 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 15:52:55 user nova-compute[75337]:                 Iface Name: default
Nov 06 15:52:55 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:2086a611-973d-47a1-bb69-f2ebd144be03
Nov 06 15:52:55 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 15:52:55 user nova-compute[75337]:                 Iface Name: default
Nov 06 15:52:55 user nova-compute[75337]: FIRMWARE:
Nov 06 15:52:55 user nova-compute[75337]: No targets found.
Nov 06 15:52:55 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 15:52:55 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b9d4c18-2490-4021-afaa-a17a6e6def63 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 15:52:55 user nova-compute[75337]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 15:52:55 user nova-compute[75337]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75337) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 15:52:55 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b9d4c18-2490-4021-afaa-a17a6e6def63 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158', 0)] {{(pid=75337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 15:52:55 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:52:55 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:52:55 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[94564454-aa93-429b-bede-e08200ec7c72]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2086a611-973d-47a1-bb69-f2ebd144be03\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ea7e84b5-25b5-4146-a33b-f23a700deadf\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:52:55 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:52:55 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:52:55 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd9c9cda-f370-4fa6-bc50-c28cbc65d225]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2086a611-973d-47a1-bb69-f2ebd144be03 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea7e84b5-25b5-4146-a33b-f23a700deadf (non-flash)\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:52:55 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b9d4c18-2490-4021-afaa-a17a6e6def63 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)
Nov 06 15:52:55 user nova-compute[75337]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2086a611-973d-47a1-bb69-f2ebd144be03 (non-flash)
Nov 06 15:52:55 user nova-compute[75337]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea7e84b5-25b5-4146-a33b-f23a700deadf (non-flash)
Nov 06 15:52:55 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 15:52:55 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b9d4c18-2490-4021-afaa-a17a6e6def63 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 (non-flash)
Nov 06 15:52:55 user nova-compute[75337]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2086a611-973d-47a1-bb69-f2ebd144be03 (non-flash)
Nov 06 15:52:55 user nova-compute[75337]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea7e84b5-25b5-4146-a33b-f23a700deadf (non-flash)
Nov 06 15:52:55 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 15:52:55 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b9d4c18-2490-4021-afaa-a17a6e6def63 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2abc128670>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158'): ({'sdc'}, set())}) {{(pid=75337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 15:52:55 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-0b9d4c18-2490-4021-afaa-a17a6e6def63 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Removing single pathed devices sdc {{(pid=75337) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 15:52:55 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:52:55 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:52:55 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[222ea0cc-767f-4ad7-b5ff-f66fc58971ec]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:52:55 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:52:55 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:52:55 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[b761e3d7-62b6-4cbb-9c7e-4e89369eb4af]: (4, ('ok\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:52:55 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-0b9d4c18-2490-4021-afaa-a17a6e6def63 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Flushing IO for device /dev/sdc {{(pid=75337) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 15:52:55 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:52:55 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:52:55 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf96f236-a79f-44e4-bc74-5c658f27500d]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:52:55 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-0b9d4c18-2490-4021-afaa-a17a6e6def63 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75337) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 15:52:55 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:52:55 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.044s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:52:55 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[a594ac1e-4322-431f-b6c7-1ed9bf406e32]: (4, ('1', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:52:55 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-0b9d4c18-2490-4021-afaa-a17a6e6def63 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 15:52:55 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-0b9d4c18-2490-4021-afaa-a17a6e6def63 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] SCSI volumes sdc have been removed. {{(pid=75337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 15:52:55 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b9d4c18-2490-4021-afaa-a17a6e6def63 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158')] {{(pid=75337) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 15:52:55 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:52:55 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:52:55 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a61f7aa-0f6f-4e77-92dc-de8cd862ecf5]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:52:55 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b9d4c18-2490-4021-afaa-a17a6e6def63 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:52:55 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 -p 172.16.0.220:3260 --logout {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:52:55 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-c670d153-2717-41f8-aa01-845a93ff25c0 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Acquiring lock "afa4e52b-af51-45bf-b619-aeca14e7724d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:52:55 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-c670d153-2717-41f8-aa01-845a93ff25c0 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Lock "afa4e52b-af51-45bf-b619-aeca14e7724d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:52:55 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-c670d153-2717-41f8-aa01-845a93ff25c0 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Acquiring lock "afa4e52b-af51-45bf-b619-aeca14e7724d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:52:55 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-c670d153-2717-41f8-aa01-845a93ff25c0 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Lock "afa4e52b-af51-45bf-b619-aeca14e7724d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:52:55 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-c670d153-2717-41f8-aa01-845a93ff25c0 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Lock "afa4e52b-af51-45bf-b619-aeca14e7724d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:52:55 user nova-compute[75337]: INFO nova.compute.manager [None req-c670d153-2717-41f8-aa01-845a93ff25c0 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] [instance: afa4e52b-af51-45bf-b619-aeca14e7724d] Terminating instance
Nov 06 15:52:55 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:52:55 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[74d1a897-6f5d-48d0-8f1b-3179dc6264e8]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:52:55 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b9d4c18-2490-4021-afaa-a17a6e6def63 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158, portal: 172.16.0.220,3260]
Nov 06 15:52:55 user nova-compute[75337]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158, portal: 172.16.0.220,3260] successful.
Nov 06 15:52:55 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:52:55 user nova-compute[75337]: DEBUG nova.compute.manager [None req-c670d153-2717-41f8-aa01-845a93ff25c0 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] [instance: afa4e52b-af51-45bf-b619-aeca14e7724d] Start destroying the instance on the hypervisor. {{(pid=75337) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 15:52:55 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 -p 172.16.0.220:3260 --op delete {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:52:55 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e08ef35-543e-4718-beed-36e2ed8dd158 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:52:55 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[32ac230f-b3d9-4506-af7b-f9c51e488a9d]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:52:55 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b9d4c18-2490-4021-afaa-a17a6e6def63 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:52:55 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-0b9d4c18-2490-4021-afaa-a17a6e6def63 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.365s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 15:52:55 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b9d4c18-2490-4021-afaa-a17a6e6def63 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] <== disconnect_volume: return (366ms) None {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 15:52:55 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0b9d4c18-2490-4021-afaa-a17a6e6def63 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: 1fa4c927-7485-4f34-94bd-9e20358904b6] Disconnected iSCSI Volume {{(pid=75337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 15:52:55 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-0b9d4c18-2490-4021-afaa-a17a6e6def63 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: 1fa4c927-7485-4f34-94bd-9e20358904b6] Deleting instance files /opt/stack/data/nova/instances/1fa4c927-7485-4f34-94bd-9e20358904b6_del
Nov 06 15:52:55 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-0b9d4c18-2490-4021-afaa-a17a6e6def63 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: 1fa4c927-7485-4f34-94bd-9e20358904b6] Deletion of /opt/stack/data/nova/instances/1fa4c927-7485-4f34-94bd-9e20358904b6_del complete
Nov 06 15:52:56 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:52:56 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:52:56 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:52:56 user nova-compute[75337]: INFO nova.compute.manager [None req-0b9d4c18-2490-4021-afaa-a17a6e6def63 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: 1fa4c927-7485-4f34-94bd-9e20358904b6] Took 1.31 seconds to destroy the instance on the hypervisor.
Nov 06 15:52:56 user nova-compute[75337]: DEBUG oslo.service.loopingcall [None req-0b9d4c18-2490-4021-afaa-a17a6e6def63 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75337) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 15:52:56 user nova-compute[75337]: DEBUG nova.compute.manager [-] [instance: 1fa4c927-7485-4f34-94bd-9e20358904b6] Deallocating network for instance {{(pid=75337) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 15:52:56 user nova-compute[75337]: DEBUG nova.network.neutron [-] [instance: 1fa4c927-7485-4f34-94bd-9e20358904b6] deallocate_for_instance() {{(pid=75337) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 15:52:56 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:52:56 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:52:56 user nova-compute[75337]: DEBUG nova.compute.manager [req-024bedd1-1fce-4418-9506-54e515e8e006 req-9c8a457c-5434-4552-96dc-50a4e3e8b8da service nova] [instance: afa4e52b-af51-45bf-b619-aeca14e7724d] Received event network-vif-unplugged-d66c8fee-7efa-49a4-b9c3-2f7ad2ccc71b {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:52:56 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-024bedd1-1fce-4418-9506-54e515e8e006 req-9c8a457c-5434-4552-96dc-50a4e3e8b8da service nova] Acquiring lock "afa4e52b-af51-45bf-b619-aeca14e7724d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:52:56 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-024bedd1-1fce-4418-9506-54e515e8e006 req-9c8a457c-5434-4552-96dc-50a4e3e8b8da service nova] Lock "afa4e52b-af51-45bf-b619-aeca14e7724d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:52:56 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-024bedd1-1fce-4418-9506-54e515e8e006 req-9c8a457c-5434-4552-96dc-50a4e3e8b8da service nova] Lock "afa4e52b-af51-45bf-b619-aeca14e7724d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:52:56 user nova-compute[75337]: DEBUG nova.compute.manager [req-024bedd1-1fce-4418-9506-54e515e8e006 req-9c8a457c-5434-4552-96dc-50a4e3e8b8da service nova] [instance: afa4e52b-af51-45bf-b619-aeca14e7724d] No waiting events found dispatching network-vif-unplugged-d66c8fee-7efa-49a4-b9c3-2f7ad2ccc71b {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:52:56 user nova-compute[75337]: DEBUG nova.compute.manager [req-024bedd1-1fce-4418-9506-54e515e8e006 req-9c8a457c-5434-4552-96dc-50a4e3e8b8da service nova] [instance: afa4e52b-af51-45bf-b619-aeca14e7724d] Received event network-vif-unplugged-d66c8fee-7efa-49a4-b9c3-2f7ad2ccc71b for instance with task_state deleting. {{(pid=75337) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 15:52:56 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:52:56 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:52:56 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:52:56 user nova-compute[75337]: INFO nova.virt.libvirt.driver [-] [instance: afa4e52b-af51-45bf-b619-aeca14e7724d] Instance destroyed successfully.
Nov 06 15:52:56 user nova-compute[75337]: DEBUG nova.objects.instance [None req-c670d153-2717-41f8-aa01-845a93ff25c0 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Lazy-loading 'resources' on Instance uuid afa4e52b-af51-45bf-b619-aeca14e7724d {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 15:52:56 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:52:56 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-c670d153-2717-41f8-aa01-845a93ff25c0 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-06T15:46:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2034562466',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2034562466',id=19,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF82sEW5O6A3Q2brT3u+9GB1WIf+ebH23UlBANWc3lprOF36lFt5sOZdo4tfIJodY5NMNMTM6BNoWJkWdz/l+/cF+bZRgMJn1cr7pylEs7V4EldcWuCvMKcYzk70ZVi1Bg==',key_name='tempest-keypair-702382784',keypairs=<?>,launch_index=0,launched_at=2023-11-06T15:51:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ed09a1def6f0477796404d9bd3357dd0',ramdisk_id='',reservation_id='r-1fkdfqnf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-417383725',owner_user_name='tempest-AttachVolumeShelveTestJSON-417383725-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T15:51:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9e1c021de4da40518ddc45a57ef79d6f',uuid=afa4e52b-af51-45bf-b619-aeca14e7724d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d66c8fee-7efa-49a4-b9c3-2f7ad2ccc71b", "address": "fa:16:3e:17:d2:52", "network": {"id": "f24470c2-ff6f-49fd-b28f-16b8a87ed3b4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-217486733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed09a1def6f0477796404d9bd3357dd0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd66c8fee-7e", "ovs_interfaceid": "d66c8fee-7efa-49a4-b9c3-2f7ad2ccc71b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 15:52:56 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-c670d153-2717-41f8-aa01-845a93ff25c0 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Converting VIF {"id": "d66c8fee-7efa-49a4-b9c3-2f7ad2ccc71b", "address": "fa:16:3e:17:d2:52", "network": {"id": "f24470c2-ff6f-49fd-b28f-16b8a87ed3b4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-217486733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed09a1def6f0477796404d9bd3357dd0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd66c8fee-7e", "ovs_interfaceid": "d66c8fee-7efa-49a4-b9c3-2f7ad2ccc71b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 15:52:56 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-c670d153-2717-41f8-aa01-845a93ff25c0 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:d2:52,bridge_name='br-int',has_traffic_filtering=True,id=d66c8fee-7efa-49a4-b9c3-2f7ad2ccc71b,network=Network(f24470c2-ff6f-49fd-b28f-16b8a87ed3b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd66c8fee-7e') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 15:52:56 user nova-compute[75337]: DEBUG os_vif [None req-c670d153-2717-41f8-aa01-845a93ff25c0 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:d2:52,bridge_name='br-int',has_traffic_filtering=True,id=d66c8fee-7efa-49a4-b9c3-2f7ad2ccc71b,network=Network(f24470c2-ff6f-49fd-b28f-16b8a87ed3b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd66c8fee-7e') {{(pid=75337) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 15:52:56 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:52:56 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd66c8fee-7e, bridge=br-int, if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:52:56 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:52:56 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:52:56 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:52:56 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b7a9dda9-b5d4-4f73-b2bb-0851a5b38838) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:52:56 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:52:56 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:52:56 user nova-compute[75337]: INFO os_vif [None req-c670d153-2717-41f8-aa01-845a93ff25c0 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:d2:52,bridge_name='br-int',has_traffic_filtering=True,id=d66c8fee-7efa-49a4-b9c3-2f7ad2ccc71b,network=Network(f24470c2-ff6f-49fd-b28f-16b8a87ed3b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd66c8fee-7e')
Nov 06 15:52:56 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-c670d153-2717-41f8-aa01-845a93ff25c0 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] [instance: afa4e52b-af51-45bf-b619-aeca14e7724d] Deleting instance files /opt/stack/data/nova/instances/afa4e52b-af51-45bf-b619-aeca14e7724d_del
Nov 06 15:52:56 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-c670d153-2717-41f8-aa01-845a93ff25c0 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] [instance: afa4e52b-af51-45bf-b619-aeca14e7724d] Deletion of /opt/stack/data/nova/instances/afa4e52b-af51-45bf-b619-aeca14e7724d_del complete
Nov 06 15:52:56 user nova-compute[75337]: INFO nova.compute.manager [None req-c670d153-2717-41f8-aa01-845a93ff25c0 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] [instance: afa4e52b-af51-45bf-b619-aeca14e7724d] Took 0.97 seconds to destroy the instance on the hypervisor.
Nov 06 15:52:56 user nova-compute[75337]: DEBUG oslo.service.loopingcall [None req-c670d153-2717-41f8-aa01-845a93ff25c0 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75337) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 15:52:56 user nova-compute[75337]: DEBUG nova.compute.manager [-] [instance: afa4e52b-af51-45bf-b619-aeca14e7724d] Deallocating network for instance {{(pid=75337) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 15:52:56 user nova-compute[75337]: DEBUG nova.network.neutron [-] [instance: afa4e52b-af51-45bf-b619-aeca14e7724d] deallocate_for_instance() {{(pid=75337) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 15:52:57 user nova-compute[75337]: DEBUG nova.compute.manager [req-b57a1d3d-fa92-41c5-92a3-ee3227594616 req-68e15a0f-5c05-4887-b10b-53fb830fcb83 service nova] [instance: 1fa4c927-7485-4f34-94bd-9e20358904b6] Received event network-vif-plugged-3812cc74-01db-4b2b-815c-770420051e1b {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:52:57 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-b57a1d3d-fa92-41c5-92a3-ee3227594616 req-68e15a0f-5c05-4887-b10b-53fb830fcb83 service nova] Acquiring lock "1fa4c927-7485-4f34-94bd-9e20358904b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:52:57 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-b57a1d3d-fa92-41c5-92a3-ee3227594616 req-68e15a0f-5c05-4887-b10b-53fb830fcb83 service nova] Lock "1fa4c927-7485-4f34-94bd-9e20358904b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:52:57 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-b57a1d3d-fa92-41c5-92a3-ee3227594616 req-68e15a0f-5c05-4887-b10b-53fb830fcb83 service nova] Lock "1fa4c927-7485-4f34-94bd-9e20358904b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:52:57 user nova-compute[75337]: DEBUG nova.compute.manager [req-b57a1d3d-fa92-41c5-92a3-ee3227594616 req-68e15a0f-5c05-4887-b10b-53fb830fcb83 service nova] [instance: 1fa4c927-7485-4f34-94bd-9e20358904b6] No waiting events found dispatching network-vif-plugged-3812cc74-01db-4b2b-815c-770420051e1b {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:52:57 user nova-compute[75337]: WARNING nova.compute.manager [req-b57a1d3d-fa92-41c5-92a3-ee3227594616 req-68e15a0f-5c05-4887-b10b-53fb830fcb83 service nova] [instance: 1fa4c927-7485-4f34-94bd-9e20358904b6] Received unexpected event network-vif-plugged-3812cc74-01db-4b2b-815c-770420051e1b for instance with vm_state active and task_state deleting.
Nov 06 15:52:57 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:52:57 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:52:57 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:52:57 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:52:57 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:52:57 user nova-compute[75337]: DEBUG nova.network.neutron [-] [instance: 1fa4c927-7485-4f34-94bd-9e20358904b6] Updating instance_info_cache with network_info: [] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:52:57 user nova-compute[75337]: INFO nova.compute.manager [-] [instance: 1fa4c927-7485-4f34-94bd-9e20358904b6] Took 1.44 seconds to deallocate network for instance.
Nov 06 15:52:57 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:52:57 user nova-compute[75337]: DEBUG nova.compute.manager [req-861135c2-de5b-4e95-b189-427c6718a0d8 req-17d9bdc4-3c03-4655-8314-8287b4efcc0f service nova] [instance: 1fa4c927-7485-4f34-94bd-9e20358904b6] Received event network-vif-deleted-3812cc74-01db-4b2b-815c-770420051e1b {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:52:57 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:52:58 user nova-compute[75337]: DEBUG nova.network.neutron [-] [instance: afa4e52b-af51-45bf-b619-aeca14e7724d] Updating instance_info_cache with network_info: [] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:52:58 user nova-compute[75337]: INFO nova.compute.manager [-] [instance: afa4e52b-af51-45bf-b619-aeca14e7724d] Took 1.36 seconds to deallocate network for instance.
Nov 06 15:52:58 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-c670d153-2717-41f8-aa01-845a93ff25c0 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:52:58 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-c670d153-2717-41f8-aa01-845a93ff25c0 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:52:58 user nova-compute[75337]: DEBUG nova.compute.manager [req-96ca5393-ace1-4c57-b5f8-63dada1ea294 req-c858e63d-c0b9-470b-add8-0d6701a85ada service nova] [instance: afa4e52b-af51-45bf-b619-aeca14e7724d] Received event network-vif-plugged-d66c8fee-7efa-49a4-b9c3-2f7ad2ccc71b {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:52:58 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-96ca5393-ace1-4c57-b5f8-63dada1ea294 req-c858e63d-c0b9-470b-add8-0d6701a85ada service nova] Acquiring lock "afa4e52b-af51-45bf-b619-aeca14e7724d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:52:58 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-96ca5393-ace1-4c57-b5f8-63dada1ea294 req-c858e63d-c0b9-470b-add8-0d6701a85ada service nova] Lock "afa4e52b-af51-45bf-b619-aeca14e7724d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:52:58 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-96ca5393-ace1-4c57-b5f8-63dada1ea294 req-c858e63d-c0b9-470b-add8-0d6701a85ada service nova] Lock "afa4e52b-af51-45bf-b619-aeca14e7724d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:52:58 user nova-compute[75337]: DEBUG nova.compute.manager [req-96ca5393-ace1-4c57-b5f8-63dada1ea294 req-c858e63d-c0b9-470b-add8-0d6701a85ada service nova] [instance: afa4e52b-af51-45bf-b619-aeca14e7724d] No waiting events found dispatching network-vif-plugged-d66c8fee-7efa-49a4-b9c3-2f7ad2ccc71b {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:52:58 user nova-compute[75337]: WARNING nova.compute.manager [req-96ca5393-ace1-4c57-b5f8-63dada1ea294 req-c858e63d-c0b9-470b-add8-0d6701a85ada service nova] [instance: afa4e52b-af51-45bf-b619-aeca14e7724d] Received unexpected event network-vif-plugged-d66c8fee-7efa-49a4-b9c3-2f7ad2ccc71b for instance with vm_state deleted and task_state None.
Nov 06 15:52:58 user nova-compute[75337]: DEBUG nova.compute.manager [req-96ca5393-ace1-4c57-b5f8-63dada1ea294 req-c858e63d-c0b9-470b-add8-0d6701a85ada service nova] [instance: afa4e52b-af51-45bf-b619-aeca14e7724d] Received event network-vif-plugged-d66c8fee-7efa-49a4-b9c3-2f7ad2ccc71b {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:52:58 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-96ca5393-ace1-4c57-b5f8-63dada1ea294 req-c858e63d-c0b9-470b-add8-0d6701a85ada service nova] Acquiring lock "afa4e52b-af51-45bf-b619-aeca14e7724d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:52:58 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-96ca5393-ace1-4c57-b5f8-63dada1ea294 req-c858e63d-c0b9-470b-add8-0d6701a85ada service nova] Lock "afa4e52b-af51-45bf-b619-aeca14e7724d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:52:58 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-96ca5393-ace1-4c57-b5f8-63dada1ea294 req-c858e63d-c0b9-470b-add8-0d6701a85ada service nova] Lock "afa4e52b-af51-45bf-b619-aeca14e7724d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:52:58 user nova-compute[75337]: DEBUG nova.compute.manager [req-96ca5393-ace1-4c57-b5f8-63dada1ea294 req-c858e63d-c0b9-470b-add8-0d6701a85ada service nova] [instance: afa4e52b-af51-45bf-b619-aeca14e7724d] No waiting events found dispatching network-vif-plugged-d66c8fee-7efa-49a4-b9c3-2f7ad2ccc71b {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:52:58 user nova-compute[75337]: WARNING nova.compute.manager [req-96ca5393-ace1-4c57-b5f8-63dada1ea294 req-c858e63d-c0b9-470b-add8-0d6701a85ada service nova] [instance: afa4e52b-af51-45bf-b619-aeca14e7724d] Received unexpected event network-vif-plugged-d66c8fee-7efa-49a4-b9c3-2f7ad2ccc71b for instance with vm_state deleted and task_state None.
Nov 06 15:52:58 user nova-compute[75337]: DEBUG nova.compute.manager [req-96ca5393-ace1-4c57-b5f8-63dada1ea294 req-c858e63d-c0b9-470b-add8-0d6701a85ada service nova] [instance: afa4e52b-af51-45bf-b619-aeca14e7724d] Received event network-vif-plugged-d66c8fee-7efa-49a4-b9c3-2f7ad2ccc71b {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:52:58 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-96ca5393-ace1-4c57-b5f8-63dada1ea294 req-c858e63d-c0b9-470b-add8-0d6701a85ada service nova] Acquiring lock "afa4e52b-af51-45bf-b619-aeca14e7724d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:52:58 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-96ca5393-ace1-4c57-b5f8-63dada1ea294 req-c858e63d-c0b9-470b-add8-0d6701a85ada service nova] Lock "afa4e52b-af51-45bf-b619-aeca14e7724d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:52:58 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-96ca5393-ace1-4c57-b5f8-63dada1ea294 req-c858e63d-c0b9-470b-add8-0d6701a85ada service nova] Lock "afa4e52b-af51-45bf-b619-aeca14e7724d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:52:58 user nova-compute[75337]: DEBUG nova.compute.manager [req-96ca5393-ace1-4c57-b5f8-63dada1ea294 req-c858e63d-c0b9-470b-add8-0d6701a85ada service nova] [instance: afa4e52b-af51-45bf-b619-aeca14e7724d] No waiting events found dispatching network-vif-plugged-d66c8fee-7efa-49a4-b9c3-2f7ad2ccc71b {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:52:58 user nova-compute[75337]: WARNING nova.compute.manager [req-96ca5393-ace1-4c57-b5f8-63dada1ea294 req-c858e63d-c0b9-470b-add8-0d6701a85ada service nova] [instance: afa4e52b-af51-45bf-b619-aeca14e7724d] Received unexpected event network-vif-plugged-d66c8fee-7efa-49a4-b9c3-2f7ad2ccc71b for instance with vm_state deleted and task_state None.
Nov 06 15:52:58 user nova-compute[75337]: DEBUG nova.compute.manager [req-96ca5393-ace1-4c57-b5f8-63dada1ea294 req-c858e63d-c0b9-470b-add8-0d6701a85ada service nova] [instance: afa4e52b-af51-45bf-b619-aeca14e7724d] Received event network-vif-unplugged-d66c8fee-7efa-49a4-b9c3-2f7ad2ccc71b {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:52:58 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-96ca5393-ace1-4c57-b5f8-63dada1ea294 req-c858e63d-c0b9-470b-add8-0d6701a85ada service nova] Acquiring lock "afa4e52b-af51-45bf-b619-aeca14e7724d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:52:58 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-96ca5393-ace1-4c57-b5f8-63dada1ea294 req-c858e63d-c0b9-470b-add8-0d6701a85ada service nova] Lock "afa4e52b-af51-45bf-b619-aeca14e7724d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:52:58 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-96ca5393-ace1-4c57-b5f8-63dada1ea294 req-c858e63d-c0b9-470b-add8-0d6701a85ada service nova] Lock "afa4e52b-af51-45bf-b619-aeca14e7724d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:52:58 user nova-compute[75337]: DEBUG nova.compute.manager [req-96ca5393-ace1-4c57-b5f8-63dada1ea294 req-c858e63d-c0b9-470b-add8-0d6701a85ada service nova] [instance: afa4e52b-af51-45bf-b619-aeca14e7724d] No waiting events found dispatching network-vif-unplugged-d66c8fee-7efa-49a4-b9c3-2f7ad2ccc71b {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:52:58 user nova-compute[75337]: WARNING nova.compute.manager [req-96ca5393-ace1-4c57-b5f8-63dada1ea294 req-c858e63d-c0b9-470b-add8-0d6701a85ada service nova] [instance: afa4e52b-af51-45bf-b619-aeca14e7724d] Received unexpected event network-vif-unplugged-d66c8fee-7efa-49a4-b9c3-2f7ad2ccc71b for instance with vm_state deleted and task_state None.
Nov 06 15:52:58 user nova-compute[75337]: DEBUG nova.compute.manager [req-96ca5393-ace1-4c57-b5f8-63dada1ea294 req-c858e63d-c0b9-470b-add8-0d6701a85ada service nova] [instance: afa4e52b-af51-45bf-b619-aeca14e7724d] Received event network-vif-plugged-d66c8fee-7efa-49a4-b9c3-2f7ad2ccc71b {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:52:58 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-96ca5393-ace1-4c57-b5f8-63dada1ea294 req-c858e63d-c0b9-470b-add8-0d6701a85ada service nova] Acquiring lock "afa4e52b-af51-45bf-b619-aeca14e7724d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:52:58 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-96ca5393-ace1-4c57-b5f8-63dada1ea294 req-c858e63d-c0b9-470b-add8-0d6701a85ada service nova] Lock "afa4e52b-af51-45bf-b619-aeca14e7724d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:52:58 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-96ca5393-ace1-4c57-b5f8-63dada1ea294 req-c858e63d-c0b9-470b-add8-0d6701a85ada service nova] Lock "afa4e52b-af51-45bf-b619-aeca14e7724d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:52:58 user nova-compute[75337]: DEBUG nova.compute.manager [req-96ca5393-ace1-4c57-b5f8-63dada1ea294 req-c858e63d-c0b9-470b-add8-0d6701a85ada service nova] [instance: afa4e52b-af51-45bf-b619-aeca14e7724d] No waiting events found dispatching network-vif-plugged-d66c8fee-7efa-49a4-b9c3-2f7ad2ccc71b {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:52:58 user nova-compute[75337]: WARNING nova.compute.manager [req-96ca5393-ace1-4c57-b5f8-63dada1ea294 req-c858e63d-c0b9-470b-add8-0d6701a85ada service nova] [instance: afa4e52b-af51-45bf-b619-aeca14e7724d] Received unexpected event network-vif-plugged-d66c8fee-7efa-49a4-b9c3-2f7ad2ccc71b for instance with vm_state deleted and task_state None.
Nov 06 15:52:58 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-c670d153-2717-41f8-aa01-845a93ff25c0 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 15:52:58 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-c670d153-2717-41f8-aa01-845a93ff25c0 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 15:52:58 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-c670d153-2717-41f8-aa01-845a93ff25c0 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.344s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:52:58 user nova-compute[75337]: INFO nova.scheduler.client.report [None req-c670d153-2717-41f8-aa01-845a93ff25c0 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Deleted allocations for instance afa4e52b-af51-45bf-b619-aeca14e7724d
Nov 06 15:52:58 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-c670d153-2717-41f8-aa01-845a93ff25c0 tempest-AttachVolumeShelveTestJSON-417383725 tempest-AttachVolumeShelveTestJSON-417383725-project-member] Lock "afa4e52b-af51-45bf-b619-aeca14e7724d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.914s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:52:59 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:52:59 user nova-compute[75337]: DEBUG nova.compute.manager [req-19b79463-82b1-4d94-bc91-38e7f9b58e10 req-5d882542-beaf-484e-9a4d-0034a1167f7c service nova] [instance: afa4e52b-af51-45bf-b619-aeca14e7724d] Received event network-vif-deleted-d66c8fee-7efa-49a4-b9c3-2f7ad2ccc71b {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:52:59 user nova-compute[75337]: INFO nova.compute.manager [None req-0b9d4c18-2490-4021-afaa-a17a6e6def63 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: 1fa4c927-7485-4f34-94bd-9e20358904b6] Took 2.02 seconds to detach 1 volumes for instance.
Nov 06 15:52:59 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-0b9d4c18-2490-4021-afaa-a17a6e6def63 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:52:59 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-0b9d4c18-2490-4021-afaa-a17a6e6def63 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:52:59 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-0b9d4c18-2490-4021-afaa-a17a6e6def63 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 15:52:59 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-0b9d4c18-2490-4021-afaa-a17a6e6def63 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 15:52:59 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-0b9d4c18-2490-4021-afaa-a17a6e6def63 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.274s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:52:59 user nova-compute[75337]: INFO nova.scheduler.client.report [None req-0b9d4c18-2490-4021-afaa-a17a6e6def63 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Deleted allocations for instance 1fa4c927-7485-4f34-94bd-9e20358904b6
Nov 06 15:53:00 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-0b9d4c18-2490-4021-afaa-a17a6e6def63 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Lock "1fa4c927-7485-4f34-94bd-9e20358904b6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.244s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:53:01 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:53:05 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:53:05 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:53:05 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:53:05 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:53:05 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:53:05 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:53:05 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75337) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 15:53:06 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:53:06 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Starting heal instance info cache {{(pid=75337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 15:53:06 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "refresh_cache-493eff79-294e-4259-a6d0-4772c4b45013" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 15:53:06 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquired lock "refresh_cache-493eff79-294e-4259-a6d0-4772c4b45013" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 15:53:06 user nova-compute[75337]: DEBUG nova.network.neutron [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] [instance: 493eff79-294e-4259-a6d0-4772c4b45013] Forcefully refreshing network info cache for instance {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 15:53:06 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:53:06 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:53:06 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75337) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 15:53:06 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 15:53:06 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 15:53:06 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:53:07 user nova-compute[75337]: DEBUG nova.network.neutron [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] [instance: 493eff79-294e-4259-a6d0-4772c4b45013] Updating instance_info_cache with network_info: [{"id": "5e620284-83c1-40a8-91a5-c6b2c8c87a19", "address": "fa:16:3e:09:f0:4b", "network": {"id": "4e47319f-de1d-4dfe-9915-7d2d5131704d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-895093240-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "915211c6a2734c36b34ff92a56b085f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e620284-83", "ovs_interfaceid": "5e620284-83c1-40a8-91a5-c6b2c8c87a19", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:53:07 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Releasing lock "refresh_cache-493eff79-294e-4259-a6d0-4772c4b45013" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 15:53:07 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] [instance: 493eff79-294e-4259-a6d0-4772c4b45013] Updated the network info_cache for instance {{(pid=75337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 15:53:07 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:53:08 user nova-compute[75337]: DEBUG nova.compute.manager [req-8b199b4a-7c06-4cc8-b3ab-533ad3122cdd req-0820a2a5-d268-4dc2-a985-d4fa180ab830 service nova] [instance: 582702ee-b8f8-49e4-9853-68af15420702] Received event network-changed-bb02742a-5f8a-4501-95e6-dddfef111f50 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:53:08 user nova-compute[75337]: DEBUG nova.compute.manager [req-8b199b4a-7c06-4cc8-b3ab-533ad3122cdd req-0820a2a5-d268-4dc2-a985-d4fa180ab830 service nova] [instance: 582702ee-b8f8-49e4-9853-68af15420702] Refreshing instance network info cache due to event network-changed-bb02742a-5f8a-4501-95e6-dddfef111f50. {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 15:53:08 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-8b199b4a-7c06-4cc8-b3ab-533ad3122cdd req-0820a2a5-d268-4dc2-a985-d4fa180ab830 service nova] Acquiring lock "refresh_cache-582702ee-b8f8-49e4-9853-68af15420702" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 15:53:08 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-8b199b4a-7c06-4cc8-b3ab-533ad3122cdd req-0820a2a5-d268-4dc2-a985-d4fa180ab830 service nova] Acquired lock "refresh_cache-582702ee-b8f8-49e4-9853-68af15420702" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 15:53:08 user nova-compute[75337]: DEBUG nova.network.neutron [req-8b199b4a-7c06-4cc8-b3ab-533ad3122cdd req-0820a2a5-d268-4dc2-a985-d4fa180ab830 service nova] [instance: 582702ee-b8f8-49e4-9853-68af15420702] Refreshing network info cache for port bb02742a-5f8a-4501-95e6-dddfef111f50 {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 15:53:08 user nova-compute[75337]: DEBUG nova.network.neutron [req-8b199b4a-7c06-4cc8-b3ab-533ad3122cdd req-0820a2a5-d268-4dc2-a985-d4fa180ab830 service nova] [instance: 582702ee-b8f8-49e4-9853-68af15420702] Updated VIF entry in instance network info cache for port bb02742a-5f8a-4501-95e6-dddfef111f50. {{(pid=75337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 15:53:08 user nova-compute[75337]: DEBUG nova.network.neutron [req-8b199b4a-7c06-4cc8-b3ab-533ad3122cdd req-0820a2a5-d268-4dc2-a985-d4fa180ab830 service nova] [instance: 582702ee-b8f8-49e4-9853-68af15420702] Updating instance_info_cache with network_info: [{"id": "bb02742a-5f8a-4501-95e6-dddfef111f50", "address": "fa:16:3e:ad:0d:f6", "network": {"id": "4e47319f-de1d-4dfe-9915-7d2d5131704d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-895093240-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "915211c6a2734c36b34ff92a56b085f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb02742a-5f", "ovs_interfaceid": "bb02742a-5f8a-4501-95e6-dddfef111f50", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:53:08 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-8b199b4a-7c06-4cc8-b3ab-533ad3122cdd req-0820a2a5-d268-4dc2-a985-d4fa180ab830 service nova] Releasing lock "refresh_cache-582702ee-b8f8-49e4-9853-68af15420702" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 15:53:08 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-de3d9d1b-d7f2-43cd-a249-9c448ec3916b tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Acquiring lock "582702ee-b8f8-49e4-9853-68af15420702" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:53:08 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-de3d9d1b-d7f2-43cd-a249-9c448ec3916b tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Lock "582702ee-b8f8-49e4-9853-68af15420702" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:53:08 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-de3d9d1b-d7f2-43cd-a249-9c448ec3916b tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Acquiring lock "582702ee-b8f8-49e4-9853-68af15420702-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:53:08 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-de3d9d1b-d7f2-43cd-a249-9c448ec3916b tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Lock "582702ee-b8f8-49e4-9853-68af15420702-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:53:08 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-de3d9d1b-d7f2-43cd-a249-9c448ec3916b tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Lock "582702ee-b8f8-49e4-9853-68af15420702-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:53:08 user nova-compute[75337]: INFO nova.compute.manager [None req-de3d9d1b-d7f2-43cd-a249-9c448ec3916b tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 582702ee-b8f8-49e4-9853-68af15420702] Terminating instance
Nov 06 15:53:08 user nova-compute[75337]: DEBUG nova.compute.manager [None req-de3d9d1b-d7f2-43cd-a249-9c448ec3916b tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 582702ee-b8f8-49e4-9853-68af15420702] Start destroying the instance on the hypervisor. {{(pid=75337) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 15:53:08 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:53:08 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:53:09 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:53:09 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:53:09 user nova-compute[75337]: DEBUG nova.compute.manager [req-efecf410-dccd-48a7-b212-eb34baf5ae4e req-d78b6f91-f458-41ee-8be7-b916fe1d7f70 service nova] [instance: 582702ee-b8f8-49e4-9853-68af15420702] Received event network-vif-unplugged-bb02742a-5f8a-4501-95e6-dddfef111f50 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:53:09 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-efecf410-dccd-48a7-b212-eb34baf5ae4e req-d78b6f91-f458-41ee-8be7-b916fe1d7f70 service nova] Acquiring lock "582702ee-b8f8-49e4-9853-68af15420702-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:53:09 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-efecf410-dccd-48a7-b212-eb34baf5ae4e req-d78b6f91-f458-41ee-8be7-b916fe1d7f70 service nova] Lock "582702ee-b8f8-49e4-9853-68af15420702-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:53:09 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-efecf410-dccd-48a7-b212-eb34baf5ae4e req-d78b6f91-f458-41ee-8be7-b916fe1d7f70 service nova] Lock "582702ee-b8f8-49e4-9853-68af15420702-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:53:09 user nova-compute[75337]: DEBUG nova.compute.manager [req-efecf410-dccd-48a7-b212-eb34baf5ae4e req-d78b6f91-f458-41ee-8be7-b916fe1d7f70 service nova] [instance: 582702ee-b8f8-49e4-9853-68af15420702] No waiting events found dispatching network-vif-unplugged-bb02742a-5f8a-4501-95e6-dddfef111f50 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:53:09 user nova-compute[75337]: DEBUG nova.compute.manager [req-efecf410-dccd-48a7-b212-eb34baf5ae4e req-d78b6f91-f458-41ee-8be7-b916fe1d7f70 service nova] [instance: 582702ee-b8f8-49e4-9853-68af15420702] Received event network-vif-unplugged-bb02742a-5f8a-4501-95e6-dddfef111f50 for instance with task_state deleting. {{(pid=75337) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 15:53:09 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:53:09 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:53:09 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:53:09 user nova-compute[75337]: INFO nova.virt.libvirt.driver [-] [instance: 582702ee-b8f8-49e4-9853-68af15420702] Instance destroyed successfully.
Nov 06 15:53:09 user nova-compute[75337]: DEBUG nova.objects.instance [None req-de3d9d1b-d7f2-43cd-a249-9c448ec3916b tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Lazy-loading 'resources' on Instance uuid 582702ee-b8f8-49e4-9853-68af15420702 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 15:53:09 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-de3d9d1b-d7f2-43cd-a249-9c448ec3916b tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T15:51:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-952025564',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-952025564',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-952025564',id=26,image_ref='2bee7244-800a-42ea-84d9-fd07b594c96b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKlScEkzVEQMrehWzpcP7Bc5Ul3eAwFFKSqPfrvuaI3YYtxPPA9nEt6b8+tMM5ow/PMSrbgmuBWSdH2Bjlj8cAbtyksWWE3/81OuURY95MC6TFoP6MMxmwg/TY2kiVLpvw==',key_name='tempest-keypair-1227078778',keypairs=<?>,launch_index=0,launched_at=2023-11-06T15:52:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='915211c6a2734c36b34ff92a56b085f6',ramdisk_id='',reservation_id='r-2sh003gg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1055092640',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1055092640-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-1055092640',owner_user_name='tempest-TestVolumeBootPattern-1055092640-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T15:52:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bb8d5f0200124588be1cfde107341a45',uuid=582702ee-b8f8-49e4-9853-68af15420702,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bb02742a-5f8a-4501-95e6-dddfef111f50", "address": "fa:16:3e:ad:0d:f6", "network": {"id": "4e47319f-de1d-4dfe-9915-7d2d5131704d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-895093240-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "915211c6a2734c36b34ff92a56b085f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb02742a-5f", "ovs_interfaceid": "bb02742a-5f8a-4501-95e6-dddfef111f50", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 15:53:09 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-de3d9d1b-d7f2-43cd-a249-9c448ec3916b tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Converting VIF {"id": "bb02742a-5f8a-4501-95e6-dddfef111f50", "address": "fa:16:3e:ad:0d:f6", "network": {"id": "4e47319f-de1d-4dfe-9915-7d2d5131704d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-895093240-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "915211c6a2734c36b34ff92a56b085f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb02742a-5f", "ovs_interfaceid": "bb02742a-5f8a-4501-95e6-dddfef111f50", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 15:53:09 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-de3d9d1b-d7f2-43cd-a249-9c448ec3916b tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ad:0d:f6,bridge_name='br-int',has_traffic_filtering=True,id=bb02742a-5f8a-4501-95e6-dddfef111f50,network=Network(4e47319f-de1d-4dfe-9915-7d2d5131704d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb02742a-5f') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 15:53:09 user nova-compute[75337]: DEBUG os_vif [None req-de3d9d1b-d7f2-43cd-a249-9c448ec3916b tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ad:0d:f6,bridge_name='br-int',has_traffic_filtering=True,id=bb02742a-5f8a-4501-95e6-dddfef111f50,network=Network(4e47319f-de1d-4dfe-9915-7d2d5131704d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb02742a-5f') {{(pid=75337) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 15:53:09 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:53:09 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbb02742a-5f, bridge=br-int, if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:53:09 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:53:09 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:53:09 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:53:09 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=552cb5d4-6511-4f95-a576-57f941356d9e) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:53:09 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:53:09 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:53:09 user nova-compute[75337]: INFO os_vif [None req-de3d9d1b-d7f2-43cd-a249-9c448ec3916b tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ad:0d:f6,bridge_name='br-int',has_traffic_filtering=True,id=bb02742a-5f8a-4501-95e6-dddfef111f50,network=Network(4e47319f-de1d-4dfe-9915-7d2d5131704d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb02742a-5f')
Nov 06 15:53:09 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de3d9d1b-d7f2-43cd-a249-9c448ec3916b tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 582702ee-b8f8-49e4-9853-68af15420702] calling os-brick to detach iSCSI Volume {{(pid=75337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 15:53:09 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-de3d9d1b-d7f2-43cd-a249-9c448ec3916b tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2abc33d0c0>, {'target_iqn': 'iqn.2010-10.org.openstack:ea7e84b5-25b5-4146-a33b-f23a700deadf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'woWvDGfZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 15:53:09 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-de3d9d1b-d7f2-43cd-a249-9c448ec3916b tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 15:53:09 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-de3d9d1b-d7f2-43cd-a249-9c448ec3916b tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 15:53:09 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-de3d9d1b-d7f2-43cd-a249-9c448ec3916b tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 15:53:09 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:53:09 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:53:09 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[907ad9b6-311f-4fe5-aecc-6a1a6c1a8e43]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ea7e84b5-25b5-4146-a33b-f23a700deadf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2086a611-973d-47a1-bb69-f2ebd144be03\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:53:09 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-de3d9d1b-d7f2-43cd-a249-9c448ec3916b tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 15:53:09 user nova-compute[75337]: No targets found.
Nov 06 15:53:09 user nova-compute[75337]: iSNS:
Nov 06 15:53:09 user nova-compute[75337]: No targets found.
Nov 06 15:53:09 user nova-compute[75337]: STATIC:
Nov 06 15:53:09 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:ea7e84b5-25b5-4146-a33b-f23a700deadf
Nov 06 15:53:09 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 15:53:09 user nova-compute[75337]:                 Iface Name: default
Nov 06 15:53:09 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:2086a611-973d-47a1-bb69-f2ebd144be03
Nov 06 15:53:09 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 15:53:09 user nova-compute[75337]:                 Iface Name: default
Nov 06 15:53:09 user nova-compute[75337]: FIRMWARE:
Nov 06 15:53:09 user nova-compute[75337]: No targets found.
Nov 06 15:53:09 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 15:53:09 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-de3d9d1b-d7f2-43cd-a249-9c448ec3916b tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 15:53:09 user nova-compute[75337]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 15:53:09 user nova-compute[75337]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75337) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 15:53:09 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-de3d9d1b-d7f2-43cd-a249-9c448ec3916b tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ea7e84b5-25b5-4146-a33b-f23a700deadf', 0)] {{(pid=75337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 15:53:09 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:53:09 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:53:09 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[70dc2bb0-1e30-4776-8430-9e05c8fdf7a5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2086a611-973d-47a1-bb69-f2ebd144be03\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ea7e84b5-25b5-4146-a33b-f23a700deadf\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:53:09 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:53:09 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:53:09 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[001be2f0-42a0-488b-955d-873e5e701f91]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2086a611-973d-47a1-bb69-f2ebd144be03 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea7e84b5-25b5-4146-a33b-f23a700deadf (non-flash)\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:53:09 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-de3d9d1b-d7f2-43cd-a249-9c448ec3916b tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2086a611-973d-47a1-bb69-f2ebd144be03 (non-flash)
Nov 06 15:53:09 user nova-compute[75337]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea7e84b5-25b5-4146-a33b-f23a700deadf (non-flash)
Nov 06 15:53:09 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 15:53:09 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-de3d9d1b-d7f2-43cd-a249-9c448ec3916b tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2086a611-973d-47a1-bb69-f2ebd144be03 (non-flash)
Nov 06 15:53:09 user nova-compute[75337]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea7e84b5-25b5-4146-a33b-f23a700deadf (non-flash)
Nov 06 15:53:09 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 15:53:09 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-de3d9d1b-d7f2-43cd-a249-9c448ec3916b tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2a9c3c96c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ea7e84b5-25b5-4146-a33b-f23a700deadf'): ({'sdd'}, set())}) {{(pid=75337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 15:53:09 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-de3d9d1b-d7f2-43cd-a249-9c448ec3916b tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Removing single pathed devices sdd {{(pid=75337) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 15:53:09 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:53:09 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:53:09 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[35487597-fa03-4a22-8c16-9b47d8f9d4b1]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:53:09 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:53:09 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:53:09 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a4571be-e363-4cde-9bf3-c6e99fccec7d]: (4, ('ok\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:53:09 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-de3d9d1b-d7f2-43cd-a249-9c448ec3916b tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Flushing IO for device /dev/sdd {{(pid=75337) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 15:53:09 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:53:09 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:53:09 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[8812a135-533f-4fd6-8be1-ae69b9e05fc1]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:53:09 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-de3d9d1b-d7f2-43cd-a249-9c448ec3916b tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75337) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 15:53:09 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:53:09 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.057s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:53:09 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[abff315d-e1ba-4fe8-aa34-dec44476ab26]: (4, ('1', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:53:09 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-de3d9d1b-d7f2-43cd-a249-9c448ec3916b tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 15:53:09 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-de3d9d1b-d7f2-43cd-a249-9c448ec3916b tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] SCSI volumes sdd have been removed. {{(pid=75337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 15:53:09 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-de3d9d1b-d7f2-43cd-a249-9c448ec3916b tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ea7e84b5-25b5-4146-a33b-f23a700deadf')] {{(pid=75337) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 15:53:09 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea7e84b5-25b5-4146-a33b-f23a700deadf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:53:09 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea7e84b5-25b5-4146-a33b-f23a700deadf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:53:09 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f3f8e90-987f-41f1-8221-ab5ba56efbcf]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:53:09 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-de3d9d1b-d7f2-43cd-a249-9c448ec3916b tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:53:09 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea7e84b5-25b5-4146-a33b-f23a700deadf -p 172.16.0.220:3260 --logout {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:53:09 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea7e84b5-25b5-4146-a33b-f23a700deadf -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:53:09 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6cbf952-b3f3-427b-96de-2511fc4cb938]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:ea7e84b5-25b5-4146-a33b-f23a700deadf, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:ea7e84b5-25b5-4146-a33b-f23a700deadf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:53:09 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-de3d9d1b-d7f2-43cd-a249-9c448ec3916b tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:ea7e84b5-25b5-4146-a33b-f23a700deadf, portal: 172.16.0.220,3260]
Nov 06 15:53:09 user nova-compute[75337]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:ea7e84b5-25b5-4146-a33b-f23a700deadf, portal: 172.16.0.220,3260] successful.
Nov 06 15:53:09 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:53:09 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea7e84b5-25b5-4146-a33b-f23a700deadf -p 172.16.0.220:3260 --op delete {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:53:09 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea7e84b5-25b5-4146-a33b-f23a700deadf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:53:09 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a48093e-b4d0-42a0-bd3b-eb8192016ccf]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:53:09 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-de3d9d1b-d7f2-43cd-a249-9c448ec3916b tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:53:09 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-de3d9d1b-d7f2-43cd-a249-9c448ec3916b tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 15:53:09 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-de3d9d1b-d7f2-43cd-a249-9c448ec3916b tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] <== disconnect_volume: return (322ms) None {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 15:53:09 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de3d9d1b-d7f2-43cd-a249-9c448ec3916b tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 582702ee-b8f8-49e4-9853-68af15420702] Disconnected iSCSI Volume {{(pid=75337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 15:53:09 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-de3d9d1b-d7f2-43cd-a249-9c448ec3916b tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 582702ee-b8f8-49e4-9853-68af15420702] Deleting instance files /opt/stack/data/nova/instances/582702ee-b8f8-49e4-9853-68af15420702_del
Nov 06 15:53:09 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-de3d9d1b-d7f2-43cd-a249-9c448ec3916b tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 582702ee-b8f8-49e4-9853-68af15420702] Deletion of /opt/stack/data/nova/instances/582702ee-b8f8-49e4-9853-68af15420702_del complete
Nov 06 15:53:10 user nova-compute[75337]: INFO nova.compute.manager [None req-de3d9d1b-d7f2-43cd-a249-9c448ec3916b tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 582702ee-b8f8-49e4-9853-68af15420702] Took 1.21 seconds to destroy the instance on the hypervisor.
Nov 06 15:53:10 user nova-compute[75337]: DEBUG oslo.service.loopingcall [None req-de3d9d1b-d7f2-43cd-a249-9c448ec3916b tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75337) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 15:53:10 user nova-compute[75337]: DEBUG nova.compute.manager [-] [instance: 582702ee-b8f8-49e4-9853-68af15420702] Deallocating network for instance {{(pid=75337) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 15:53:10 user nova-compute[75337]: DEBUG nova.network.neutron [-] [instance: 582702ee-b8f8-49e4-9853-68af15420702] deallocate_for_instance() {{(pid=75337) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 15:53:10 user nova-compute[75337]: ERROR nova.volume.cinder [None req-6b36b833-6eb8-443c-b9b6-17c4df0d1a2c tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Update attachment failed for attachment fe35a8da-fb3b-4332-84b4-9557bcb8e525. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-35f4bf8a-c66d-4261-b9bc-f7c9df4eeb71) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-35f4bf8a-c66d-4261-b9bc-f7c9df4eeb71)
Nov 06 15:53:10 user nova-compute[75337]: ERROR nova.compute.manager [None req-6b36b833-6eb8-443c-b9b6-17c4df0d1a2c tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] [instance: a293c354-d1e5-4c33-9e7b-d1558235aaf8] Failed to attach 431ec26e-b61f-4971-88c8-2ddcf3b66d3c at /dev/vdb: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-35f4bf8a-c66d-4261-b9bc-f7c9df4eeb71)
Nov 06 15:53:10 user nova-compute[75337]: ERROR nova.compute.manager [instance: a293c354-d1e5-4c33-9e7b-d1558235aaf8] Traceback (most recent call last):
Nov 06 15:53:10 user nova-compute[75337]: ERROR nova.compute.manager [instance: a293c354-d1e5-4c33-9e7b-d1558235aaf8]   File "/opt/stack/nova/nova/compute/manager.py", line 7567, in _attach_volume
Nov 06 15:53:10 user nova-compute[75337]: ERROR nova.compute.manager [instance: a293c354-d1e5-4c33-9e7b-d1558235aaf8]     bdm.attach(context, instance, self.volume_api, self.driver,
Nov 06 15:53:10 user nova-compute[75337]: ERROR nova.compute.manager [instance: a293c354-d1e5-4c33-9e7b-d1558235aaf8]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 06 15:53:10 user nova-compute[75337]: ERROR nova.compute.manager [instance: a293c354-d1e5-4c33-9e7b-d1558235aaf8]     ret_val = method(obj, context, *args, **kwargs)
Nov 06 15:53:10 user nova-compute[75337]: ERROR nova.compute.manager [instance: a293c354-d1e5-4c33-9e7b-d1558235aaf8]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 06 15:53:10 user nova-compute[75337]: ERROR nova.compute.manager [instance: a293c354-d1e5-4c33-9e7b-d1558235aaf8]     self._do_attach(context, instance, volume, volume_api,
Nov 06 15:53:10 user nova-compute[75337]: ERROR nova.compute.manager [instance: a293c354-d1e5-4c33-9e7b-d1558235aaf8]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 06 15:53:10 user nova-compute[75337]: ERROR nova.compute.manager [instance: a293c354-d1e5-4c33-9e7b-d1558235aaf8]     self._volume_attach(context, volume, connector, instance,
Nov 06 15:53:10 user nova-compute[75337]: ERROR nova.compute.manager [instance: a293c354-d1e5-4c33-9e7b-d1558235aaf8]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 06 15:53:10 user nova-compute[75337]: ERROR nova.compute.manager [instance: a293c354-d1e5-4c33-9e7b-d1558235aaf8]     connection_info = volume_api.attachment_update(
Nov 06 15:53:10 user nova-compute[75337]: ERROR nova.compute.manager [instance: a293c354-d1e5-4c33-9e7b-d1558235aaf8]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 06 15:53:10 user nova-compute[75337]: ERROR nova.compute.manager [instance: a293c354-d1e5-4c33-9e7b-d1558235aaf8]     res = method(self, ctx, *args, **kwargs)
Nov 06 15:53:10 user nova-compute[75337]: ERROR nova.compute.manager [instance: a293c354-d1e5-4c33-9e7b-d1558235aaf8]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 06 15:53:10 user nova-compute[75337]: ERROR nova.compute.manager [instance: a293c354-d1e5-4c33-9e7b-d1558235aaf8]     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 06 15:53:10 user nova-compute[75337]: ERROR nova.compute.manager [instance: a293c354-d1e5-4c33-9e7b-d1558235aaf8]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 06 15:53:10 user nova-compute[75337]: ERROR nova.compute.manager [instance: a293c354-d1e5-4c33-9e7b-d1558235aaf8]     with excutils.save_and_reraise_exception():
Nov 06 15:53:10 user nova-compute[75337]: ERROR nova.compute.manager [instance: a293c354-d1e5-4c33-9e7b-d1558235aaf8]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 06 15:53:10 user nova-compute[75337]: ERROR nova.compute.manager [instance: a293c354-d1e5-4c33-9e7b-d1558235aaf8]     self.force_reraise()
Nov 06 15:53:10 user nova-compute[75337]: ERROR nova.compute.manager [instance: a293c354-d1e5-4c33-9e7b-d1558235aaf8]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 06 15:53:10 user nova-compute[75337]: ERROR nova.compute.manager [instance: a293c354-d1e5-4c33-9e7b-d1558235aaf8]     raise self.value
Nov 06 15:53:10 user nova-compute[75337]: ERROR nova.compute.manager [instance: a293c354-d1e5-4c33-9e7b-d1558235aaf8]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 06 15:53:10 user nova-compute[75337]: ERROR nova.compute.manager [instance: a293c354-d1e5-4c33-9e7b-d1558235aaf8]     context, '3.44', skip_version_check=True).attachments.update(
Nov 06 15:53:10 user nova-compute[75337]: ERROR nova.compute.manager [instance: a293c354-d1e5-4c33-9e7b-d1558235aaf8]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 06 15:53:10 user nova-compute[75337]: ERROR nova.compute.manager [instance: a293c354-d1e5-4c33-9e7b-d1558235aaf8]     return method.func(obj, *args, **kwargs)
Nov 06 15:53:10 user nova-compute[75337]: ERROR nova.compute.manager [instance: a293c354-d1e5-4c33-9e7b-d1558235aaf8]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 06 15:53:10 user nova-compute[75337]: ERROR nova.compute.manager [instance: a293c354-d1e5-4c33-9e7b-d1558235aaf8]     resp = self._update('/attachments/%s' % id, body)
Nov 06 15:53:10 user nova-compute[75337]: ERROR nova.compute.manager [instance: a293c354-d1e5-4c33-9e7b-d1558235aaf8]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 06 15:53:10 user nova-compute[75337]: ERROR nova.compute.manager [instance: a293c354-d1e5-4c33-9e7b-d1558235aaf8]     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 06 15:53:10 user nova-compute[75337]: ERROR nova.compute.manager [instance: a293c354-d1e5-4c33-9e7b-d1558235aaf8]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 06 15:53:10 user nova-compute[75337]: ERROR nova.compute.manager [instance: a293c354-d1e5-4c33-9e7b-d1558235aaf8]     return self._cs_request(url, 'PUT', **kwargs)
Nov 06 15:53:10 user nova-compute[75337]: ERROR nova.compute.manager [instance: a293c354-d1e5-4c33-9e7b-d1558235aaf8]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 06 15:53:10 user nova-compute[75337]: ERROR nova.compute.manager [instance: a293c354-d1e5-4c33-9e7b-d1558235aaf8]     return self.request(url, method, **kwargs)
Nov 06 15:53:10 user nova-compute[75337]: ERROR nova.compute.manager [instance: a293c354-d1e5-4c33-9e7b-d1558235aaf8]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 06 15:53:10 user nova-compute[75337]: ERROR nova.compute.manager [instance: a293c354-d1e5-4c33-9e7b-d1558235aaf8]     raise exceptions.from_response(resp, body)
Nov 06 15:53:10 user nova-compute[75337]: ERROR nova.compute.manager [instance: a293c354-d1e5-4c33-9e7b-d1558235aaf8] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-35f4bf8a-c66d-4261-b9bc-f7c9df4eeb71)
Nov 06 15:53:10 user nova-compute[75337]: ERROR nova.compute.manager [instance: a293c354-d1e5-4c33-9e7b-d1558235aaf8] 
Nov 06 15:53:10 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-6b36b833-6eb8-443c-b9b6-17c4df0d1a2c tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Lock "a293c354-d1e5-4c33-9e7b-d1558235aaf8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.500s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:53:10 user nova-compute[75337]: DEBUG nova.network.neutron [-] [instance: 582702ee-b8f8-49e4-9853-68af15420702] Updating instance_info_cache with network_info: [] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:53:10 user nova-compute[75337]: ERROR oslo_messaging.rpc.server [None req-6b36b833-6eb8-443c-b9b6-17c4df0d1a2c tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Exception during message handling: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-35f4bf8a-c66d-4261-b9bc-f7c9df4eeb71)
Nov 06 15:53:10 user nova-compute[75337]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 06 15:53:10 user nova-compute[75337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 06 15:53:10 user nova-compute[75337]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 06 15:53:10 user nova-compute[75337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 06 15:53:10 user nova-compute[75337]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 06 15:53:10 user nova-compute[75337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 06 15:53:10 user nova-compute[75337]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 06 15:53:10 user nova-compute[75337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 06 15:53:10 user nova-compute[75337]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 06 15:53:10 user nova-compute[75337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 06 15:53:10 user nova-compute[75337]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 06 15:53:10 user nova-compute[75337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 06 15:53:10 user nova-compute[75337]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 06 15:53:10 user nova-compute[75337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 06 15:53:10 user nova-compute[75337]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 06 15:53:10 user nova-compute[75337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Nov 06 15:53:10 user nova-compute[75337]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 06 15:53:10 user nova-compute[75337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Nov 06 15:53:10 user nova-compute[75337]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 06 15:53:10 user nova-compute[75337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 06 15:53:10 user nova-compute[75337]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 06 15:53:10 user nova-compute[75337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 06 15:53:10 user nova-compute[75337]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 06 15:53:10 user nova-compute[75337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Nov 06 15:53:10 user nova-compute[75337]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 06 15:53:10 user nova-compute[75337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7553, in attach_volume
Nov 06 15:53:10 user nova-compute[75337]: ERROR oslo_messaging.rpc.server     do_attach_volume(context, instance, driver_bdm)
Nov 06 15:53:10 user nova-compute[75337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py", line 414, in inner
Nov 06 15:53:10 user nova-compute[75337]: ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
Nov 06 15:53:10 user nova-compute[75337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7550, in do_attach_volume
Nov 06 15:53:10 user nova-compute[75337]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 06 15:53:10 user nova-compute[75337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 06 15:53:10 user nova-compute[75337]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 06 15:53:10 user nova-compute[75337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 06 15:53:10 user nova-compute[75337]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 06 15:53:10 user nova-compute[75337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7548, in do_attach_volume
Nov 06 15:53:10 user nova-compute[75337]: ERROR oslo_messaging.rpc.server     return self._attach_volume(context, instance, driver_bdm)
Nov 06 15:53:10 user nova-compute[75337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7570, in _attach_volume
Nov 06 15:53:10 user nova-compute[75337]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 06 15:53:10 user nova-compute[75337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 06 15:53:10 user nova-compute[75337]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 06 15:53:10 user nova-compute[75337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 06 15:53:10 user nova-compute[75337]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 06 15:53:10 user nova-compute[75337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7567, in _attach_volume
Nov 06 15:53:10 user nova-compute[75337]: ERROR oslo_messaging.rpc.server     bdm.attach(context, instance, self.volume_api, self.driver,
Nov 06 15:53:10 user nova-compute[75337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 06 15:53:10 user nova-compute[75337]: ERROR oslo_messaging.rpc.server     ret_val = method(obj, context, *args, **kwargs)
Nov 06 15:53:10 user nova-compute[75337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 06 15:53:10 user nova-compute[75337]: ERROR oslo_messaging.rpc.server     self._do_attach(context, instance, volume, volume_api,
Nov 06 15:53:10 user nova-compute[75337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 06 15:53:10 user nova-compute[75337]: ERROR oslo_messaging.rpc.server     self._volume_attach(context, volume, connector, instance,
Nov 06 15:53:10 user nova-compute[75337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 06 15:53:10 user nova-compute[75337]: ERROR oslo_messaging.rpc.server     connection_info = volume_api.attachment_update(
Nov 06 15:53:10 user nova-compute[75337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 06 15:53:10 user nova-compute[75337]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Nov 06 15:53:10 user nova-compute[75337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 06 15:53:10 user nova-compute[75337]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 06 15:53:10 user nova-compute[75337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 06 15:53:10 user nova-compute[75337]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 06 15:53:10 user nova-compute[75337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 06 15:53:10 user nova-compute[75337]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 06 15:53:10 user nova-compute[75337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 06 15:53:10 user nova-compute[75337]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 06 15:53:10 user nova-compute[75337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 06 15:53:10 user nova-compute[75337]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Nov 06 15:53:10 user nova-compute[75337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 06 15:53:10 user nova-compute[75337]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Nov 06 15:53:10 user nova-compute[75337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 06 15:53:10 user nova-compute[75337]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Nov 06 15:53:10 user nova-compute[75337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 06 15:53:10 user nova-compute[75337]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 06 15:53:10 user nova-compute[75337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 06 15:53:10 user nova-compute[75337]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Nov 06 15:53:10 user nova-compute[75337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 06 15:53:10 user nova-compute[75337]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Nov 06 15:53:10 user nova-compute[75337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 06 15:53:10 user nova-compute[75337]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Nov 06 15:53:10 user nova-compute[75337]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-35f4bf8a-c66d-4261-b9bc-f7c9df4eeb71)
Nov 06 15:53:10 user nova-compute[75337]: ERROR oslo_messaging.rpc.server 
Nov 06 15:53:10 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-db674126-1cd5-4f91-bf84-e629c93092c5 tempest-VolumesNegativeTest-112990104 tempest-VolumesNegativeTest-112990104-project-member] Acquiring lock "88e07d6a-1202-4703-abf2-5980a7cfa15d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:53:10 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-db674126-1cd5-4f91-bf84-e629c93092c5 tempest-VolumesNegativeTest-112990104 tempest-VolumesNegativeTest-112990104-project-member] Lock "88e07d6a-1202-4703-abf2-5980a7cfa15d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:53:10 user nova-compute[75337]: INFO nova.compute.manager [-] [instance: 582702ee-b8f8-49e4-9853-68af15420702] Took 0.78 seconds to deallocate network for instance.
Nov 06 15:53:10 user nova-compute[75337]: DEBUG nova.compute.manager [None req-db674126-1cd5-4f91-bf84-e629c93092c5 tempest-VolumesNegativeTest-112990104 tempest-VolumesNegativeTest-112990104-project-member] [instance: 88e07d6a-1202-4703-abf2-5980a7cfa15d] Starting instance... {{(pid=75337) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 15:53:10 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-db674126-1cd5-4f91-bf84-e629c93092c5 tempest-VolumesNegativeTest-112990104 tempest-VolumesNegativeTest-112990104-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:53:10 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-db674126-1cd5-4f91-bf84-e629c93092c5 tempest-VolumesNegativeTest-112990104 tempest-VolumesNegativeTest-112990104-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:53:10 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-db674126-1cd5-4f91-bf84-e629c93092c5 tempest-VolumesNegativeTest-112990104 tempest-VolumesNegativeTest-112990104-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75337) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 15:53:10 user nova-compute[75337]: INFO nova.compute.claims [None req-db674126-1cd5-4f91-bf84-e629c93092c5 tempest-VolumesNegativeTest-112990104 tempest-VolumesNegativeTest-112990104-project-member] [instance: 88e07d6a-1202-4703-abf2-5980a7cfa15d] Claim successful on node user
Nov 06 15:53:11 user nova-compute[75337]: DEBUG nova.compute.manager [req-b582df50-0b78-4377-88b9-4adea7bf501d req-1050a3ec-3b37-49b6-be8b-89ea5fe995cf service nova] [instance: 582702ee-b8f8-49e4-9853-68af15420702] Received event network-vif-plugged-bb02742a-5f8a-4501-95e6-dddfef111f50 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:53:11 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-b582df50-0b78-4377-88b9-4adea7bf501d req-1050a3ec-3b37-49b6-be8b-89ea5fe995cf service nova] Acquiring lock "582702ee-b8f8-49e4-9853-68af15420702-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:53:11 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-b582df50-0b78-4377-88b9-4adea7bf501d req-1050a3ec-3b37-49b6-be8b-89ea5fe995cf service nova] Lock "582702ee-b8f8-49e4-9853-68af15420702-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:53:11 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-b582df50-0b78-4377-88b9-4adea7bf501d req-1050a3ec-3b37-49b6-be8b-89ea5fe995cf service nova] Lock "582702ee-b8f8-49e4-9853-68af15420702-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:53:11 user nova-compute[75337]: DEBUG nova.compute.manager [req-b582df50-0b78-4377-88b9-4adea7bf501d req-1050a3ec-3b37-49b6-be8b-89ea5fe995cf service nova] [instance: 582702ee-b8f8-49e4-9853-68af15420702] No waiting events found dispatching network-vif-plugged-bb02742a-5f8a-4501-95e6-dddfef111f50 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:53:11 user nova-compute[75337]: WARNING nova.compute.manager [req-b582df50-0b78-4377-88b9-4adea7bf501d req-1050a3ec-3b37-49b6-be8b-89ea5fe995cf service nova] [instance: 582702ee-b8f8-49e4-9853-68af15420702] Received unexpected event network-vif-plugged-bb02742a-5f8a-4501-95e6-dddfef111f50 for instance with vm_state active and task_state deleting.
Nov 06 15:53:11 user nova-compute[75337]: DEBUG nova.compute.manager [req-b582df50-0b78-4377-88b9-4adea7bf501d req-1050a3ec-3b37-49b6-be8b-89ea5fe995cf service nova] [instance: 582702ee-b8f8-49e4-9853-68af15420702] Received event network-vif-deleted-bb02742a-5f8a-4501-95e6-dddfef111f50 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:53:11 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-db674126-1cd5-4f91-bf84-e629c93092c5 tempest-VolumesNegativeTest-112990104 tempest-VolumesNegativeTest-112990104-project-member] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 15:53:11 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-db674126-1cd5-4f91-bf84-e629c93092c5 tempest-VolumesNegativeTest-112990104 tempest-VolumesNegativeTest-112990104-project-member] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 15:53:11 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-db674126-1cd5-4f91-bf84-e629c93092c5 tempest-VolumesNegativeTest-112990104 tempest-VolumesNegativeTest-112990104-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.512s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:53:11 user nova-compute[75337]: DEBUG nova.compute.manager [None req-db674126-1cd5-4f91-bf84-e629c93092c5 tempest-VolumesNegativeTest-112990104 tempest-VolumesNegativeTest-112990104-project-member] [instance: 88e07d6a-1202-4703-abf2-5980a7cfa15d] Start building networks asynchronously for instance. {{(pid=75337) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 15:53:11 user nova-compute[75337]: DEBUG nova.compute.manager [None req-db674126-1cd5-4f91-bf84-e629c93092c5 tempest-VolumesNegativeTest-112990104 tempest-VolumesNegativeTest-112990104-project-member] [instance: 88e07d6a-1202-4703-abf2-5980a7cfa15d] Allocating IP information in the background. {{(pid=75337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 15:53:11 user nova-compute[75337]: DEBUG nova.network.neutron [None req-db674126-1cd5-4f91-bf84-e629c93092c5 tempest-VolumesNegativeTest-112990104 tempest-VolumesNegativeTest-112990104-project-member] [instance: 88e07d6a-1202-4703-abf2-5980a7cfa15d] allocate_for_instance() {{(pid=75337) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 15:53:11 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-db674126-1cd5-4f91-bf84-e629c93092c5 tempest-VolumesNegativeTest-112990104 tempest-VolumesNegativeTest-112990104-project-member] [instance: 88e07d6a-1202-4703-abf2-5980a7cfa15d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 15:53:11 user nova-compute[75337]: DEBUG nova.compute.manager [None req-db674126-1cd5-4f91-bf84-e629c93092c5 tempest-VolumesNegativeTest-112990104 tempest-VolumesNegativeTest-112990104-project-member] [instance: 88e07d6a-1202-4703-abf2-5980a7cfa15d] Start building block device mappings for instance. {{(pid=75337) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 15:53:11 user nova-compute[75337]: DEBUG nova.compute.manager [None req-db674126-1cd5-4f91-bf84-e629c93092c5 tempest-VolumesNegativeTest-112990104 tempest-VolumesNegativeTest-112990104-project-member] [instance: 88e07d6a-1202-4703-abf2-5980a7cfa15d] Start spawning the instance on the hypervisor. {{(pid=75337) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 15:53:11 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-db674126-1cd5-4f91-bf84-e629c93092c5 tempest-VolumesNegativeTest-112990104 tempest-VolumesNegativeTest-112990104-project-member] [instance: 88e07d6a-1202-4703-abf2-5980a7cfa15d] Creating instance directory {{(pid=75337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 15:53:11 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-db674126-1cd5-4f91-bf84-e629c93092c5 tempest-VolumesNegativeTest-112990104 tempest-VolumesNegativeTest-112990104-project-member] [instance: 88e07d6a-1202-4703-abf2-5980a7cfa15d] Creating image(s)
Nov 06 15:53:11 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-db674126-1cd5-4f91-bf84-e629c93092c5 tempest-VolumesNegativeTest-112990104 tempest-VolumesNegativeTest-112990104-project-member] Acquiring lock "/opt/stack/data/nova/instances/88e07d6a-1202-4703-abf2-5980a7cfa15d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:53:11 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-db674126-1cd5-4f91-bf84-e629c93092c5 tempest-VolumesNegativeTest-112990104 tempest-VolumesNegativeTest-112990104-project-member] Lock "/opt/stack/data/nova/instances/88e07d6a-1202-4703-abf2-5980a7cfa15d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:53:11 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-db674126-1cd5-4f91-bf84-e629c93092c5 tempest-VolumesNegativeTest-112990104 tempest-VolumesNegativeTest-112990104-project-member] Lock "/opt/stack/data/nova/instances/88e07d6a-1202-4703-abf2-5980a7cfa15d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:53:11 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-db674126-1cd5-4f91-bf84-e629c93092c5 tempest-VolumesNegativeTest-112990104 tempest-VolumesNegativeTest-112990104-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:53:11 user nova-compute[75337]: DEBUG nova.policy [None req-db674126-1cd5-4f91-bf84-e629c93092c5 tempest-VolumesNegativeTest-112990104 tempest-VolumesNegativeTest-112990104-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fb6f0b5d6286409bbc658b9dfa1466c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '560875033e144b7388f45682fc334dc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75337) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 15:53:11 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-db674126-1cd5-4f91-bf84-e629c93092c5 tempest-VolumesNegativeTest-112990104 tempest-VolumesNegativeTest-112990104-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json" returned: 0 in 0.215s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:53:11 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-db674126-1cd5-4f91-bf84-e629c93092c5 tempest-VolumesNegativeTest-112990104 tempest-VolumesNegativeTest-112990104-project-member] Acquiring lock "06ba3c914798499e686c5ac75886932347225275" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:53:11 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-db674126-1cd5-4f91-bf84-e629c93092c5 tempest-VolumesNegativeTest-112990104 tempest-VolumesNegativeTest-112990104-project-member] Lock "06ba3c914798499e686c5ac75886932347225275" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:53:11 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-db674126-1cd5-4f91-bf84-e629c93092c5 tempest-VolumesNegativeTest-112990104 tempest-VolumesNegativeTest-112990104-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:53:12 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-db674126-1cd5-4f91-bf84-e629c93092c5 tempest-VolumesNegativeTest-112990104 tempest-VolumesNegativeTest-112990104-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json" returned: 0 in 0.203s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:53:12 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-db674126-1cd5-4f91-bf84-e629c93092c5 tempest-VolumesNegativeTest-112990104 tempest-VolumesNegativeTest-112990104-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275,backing_fmt=raw /opt/stack/data/nova/instances/88e07d6a-1202-4703-abf2-5980a7cfa15d/disk 1073741824 {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:53:12 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-db674126-1cd5-4f91-bf84-e629c93092c5 tempest-VolumesNegativeTest-112990104 tempest-VolumesNegativeTest-112990104-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275,backing_fmt=raw /opt/stack/data/nova/instances/88e07d6a-1202-4703-abf2-5980a7cfa15d/disk 1073741824" returned: 0 in 0.059s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:53:12 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-db674126-1cd5-4f91-bf84-e629c93092c5 tempest-VolumesNegativeTest-112990104 tempest-VolumesNegativeTest-112990104-project-member] Lock "06ba3c914798499e686c5ac75886932347225275" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.269s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:53:12 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-db674126-1cd5-4f91-bf84-e629c93092c5 tempest-VolumesNegativeTest-112990104 tempest-VolumesNegativeTest-112990104-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:53:12 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-db674126-1cd5-4f91-bf84-e629c93092c5 tempest-VolumesNegativeTest-112990104 tempest-VolumesNegativeTest-112990104-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json" returned: 0 in 0.186s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:53:12 user nova-compute[75337]: DEBUG nova.virt.disk.api [None req-db674126-1cd5-4f91-bf84-e629c93092c5 tempest-VolumesNegativeTest-112990104 tempest-VolumesNegativeTest-112990104-project-member] Checking if we can resize image /opt/stack/data/nova/instances/88e07d6a-1202-4703-abf2-5980a7cfa15d/disk. size=1073741824 {{(pid=75337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 15:53:12 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-db674126-1cd5-4f91-bf84-e629c93092c5 tempest-VolumesNegativeTest-112990104 tempest-VolumesNegativeTest-112990104-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88e07d6a-1202-4703-abf2-5980a7cfa15d/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:53:12 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-db674126-1cd5-4f91-bf84-e629c93092c5 tempest-VolumesNegativeTest-112990104 tempest-VolumesNegativeTest-112990104-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88e07d6a-1202-4703-abf2-5980a7cfa15d/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:53:12 user nova-compute[75337]: DEBUG nova.virt.disk.api [None req-db674126-1cd5-4f91-bf84-e629c93092c5 tempest-VolumesNegativeTest-112990104 tempest-VolumesNegativeTest-112990104-project-member] Cannot resize image /opt/stack/data/nova/instances/88e07d6a-1202-4703-abf2-5980a7cfa15d/disk to a smaller size. {{(pid=75337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 06 15:53:12 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-db674126-1cd5-4f91-bf84-e629c93092c5 tempest-VolumesNegativeTest-112990104 tempest-VolumesNegativeTest-112990104-project-member] [instance: 88e07d6a-1202-4703-abf2-5980a7cfa15d] Created local disks {{(pid=75337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 15:53:12 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-db674126-1cd5-4f91-bf84-e629c93092c5 tempest-VolumesNegativeTest-112990104 tempest-VolumesNegativeTest-112990104-project-member] [instance: 88e07d6a-1202-4703-abf2-5980a7cfa15d] Ensure instance console log exists: /opt/stack/data/nova/instances/88e07d6a-1202-4703-abf2-5980a7cfa15d/console.log {{(pid=75337) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 15:53:12 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-db674126-1cd5-4f91-bf84-e629c93092c5 tempest-VolumesNegativeTest-112990104 tempest-VolumesNegativeTest-112990104-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:53:12 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-db674126-1cd5-4f91-bf84-e629c93092c5 tempest-VolumesNegativeTest-112990104 tempest-VolumesNegativeTest-112990104-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:53:12 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-db674126-1cd5-4f91-bf84-e629c93092c5 tempest-VolumesNegativeTest-112990104 tempest-VolumesNegativeTest-112990104-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:53:12 user nova-compute[75337]: DEBUG nova.network.neutron [None req-db674126-1cd5-4f91-bf84-e629c93092c5 tempest-VolumesNegativeTest-112990104 tempest-VolumesNegativeTest-112990104-project-member] [instance: 88e07d6a-1202-4703-abf2-5980a7cfa15d] Successfully created port: 8c31c456-adba-4b37-917e-6148681cfea3 {{(pid=75337) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 15:53:13 user nova-compute[75337]: DEBUG nova.network.neutron [None req-db674126-1cd5-4f91-bf84-e629c93092c5 tempest-VolumesNegativeTest-112990104 tempest-VolumesNegativeTest-112990104-project-member] [instance: 88e07d6a-1202-4703-abf2-5980a7cfa15d] Successfully updated port: 8c31c456-adba-4b37-917e-6148681cfea3 {{(pid=75337) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 15:53:13 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-db674126-1cd5-4f91-bf84-e629c93092c5 tempest-VolumesNegativeTest-112990104 tempest-VolumesNegativeTest-112990104-project-member] Acquiring lock "refresh_cache-88e07d6a-1202-4703-abf2-5980a7cfa15d" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 15:53:13 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-db674126-1cd5-4f91-bf84-e629c93092c5 tempest-VolumesNegativeTest-112990104 tempest-VolumesNegativeTest-112990104-project-member] Acquired lock "refresh_cache-88e07d6a-1202-4703-abf2-5980a7cfa15d" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 15:53:13 user nova-compute[75337]: DEBUG nova.network.neutron [None req-db674126-1cd5-4f91-bf84-e629c93092c5 tempest-VolumesNegativeTest-112990104 tempest-VolumesNegativeTest-112990104-project-member] [instance: 88e07d6a-1202-4703-abf2-5980a7cfa15d] Building network info cache for instance {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 15:53:13 user nova-compute[75337]: DEBUG nova.compute.manager [req-7b306a2c-739a-4916-ab52-9ca0aa81787e req-ebdcad92-acc6-45d1-aa7c-e2012a66e4c9 service nova] [instance: 88e07d6a-1202-4703-abf2-5980a7cfa15d] Received event network-changed-8c31c456-adba-4b37-917e-6148681cfea3 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:53:13 user nova-compute[75337]: DEBUG nova.compute.manager [req-7b306a2c-739a-4916-ab52-9ca0aa81787e req-ebdcad92-acc6-45d1-aa7c-e2012a66e4c9 service nova] [instance: 88e07d6a-1202-4703-abf2-5980a7cfa15d] Refreshing instance network info cache due to event network-changed-8c31c456-adba-4b37-917e-6148681cfea3. {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 15:53:13 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-7b306a2c-739a-4916-ab52-9ca0aa81787e req-ebdcad92-acc6-45d1-aa7c-e2012a66e4c9 service nova] Acquiring lock "refresh_cache-88e07d6a-1202-4703-abf2-5980a7cfa15d" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 15:53:13 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager.update_available_resource {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:53:13 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:53:13 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:53:13 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:53:13 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Auditing locally available compute resources for user (node: user) {{(pid=75337) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 15:53:13 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a293c354-d1e5-4c33-9e7b-d1558235aaf8/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:53:13 user nova-compute[75337]: DEBUG nova.network.neutron [None req-db674126-1cd5-4f91-bf84-e629c93092c5 tempest-VolumesNegativeTest-112990104 tempest-VolumesNegativeTest-112990104-project-member] [instance: 88e07d6a-1202-4703-abf2-5980a7cfa15d] Instance cache missing network info. {{(pid=75337) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 15:53:13 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a293c354-d1e5-4c33-9e7b-d1558235aaf8/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:53:13 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a293c354-d1e5-4c33-9e7b-d1558235aaf8/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:53:14 user nova-compute[75337]: DEBUG nova.network.neutron [None req-db674126-1cd5-4f91-bf84-e629c93092c5 tempest-VolumesNegativeTest-112990104 tempest-VolumesNegativeTest-112990104-project-member] [instance: 88e07d6a-1202-4703-abf2-5980a7cfa15d] Updating instance_info_cache with network_info: [{"id": "8c31c456-adba-4b37-917e-6148681cfea3", "address": "fa:16:3e:4a:93:aa", "network": {"id": "c746d36b-79e9-4682-b70e-db94193d24cf", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.191", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "6549a15819f1469bbd5eeae8190e3d44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c31c456-ad", "ovs_interfaceid": "8c31c456-adba-4b37-917e-6148681cfea3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:53:14 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-db674126-1cd5-4f91-bf84-e629c93092c5 tempest-VolumesNegativeTest-112990104 tempest-VolumesNegativeTest-112990104-project-member] Releasing lock "refresh_cache-88e07d6a-1202-4703-abf2-5980a7cfa15d" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 15:53:14 user nova-compute[75337]: DEBUG nova.compute.manager [None req-db674126-1cd5-4f91-bf84-e629c93092c5 tempest-VolumesNegativeTest-112990104 tempest-VolumesNegativeTest-112990104-project-member] [instance: 88e07d6a-1202-4703-abf2-5980a7cfa15d] Instance network_info: |[{"id": "8c31c456-adba-4b37-917e-6148681cfea3", "address": "fa:16:3e:4a:93:aa", "network": {"id": "c746d36b-79e9-4682-b70e-db94193d24cf", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.191", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "6549a15819f1469bbd5eeae8190e3d44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c31c456-ad", "ovs_interfaceid": "8c31c456-adba-4b37-917e-6148681cfea3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 15:53:14 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-7b306a2c-739a-4916-ab52-9ca0aa81787e req-ebdcad92-acc6-45d1-aa7c-e2012a66e4c9 service nova] Acquired lock "refresh_cache-88e07d6a-1202-4703-abf2-5980a7cfa15d" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 15:53:14 user nova-compute[75337]: DEBUG nova.network.neutron [req-7b306a2c-739a-4916-ab52-9ca0aa81787e req-ebdcad92-acc6-45d1-aa7c-e2012a66e4c9 service nova] [instance: 88e07d6a-1202-4703-abf2-5980a7cfa15d] Refreshing network info cache for port 8c31c456-adba-4b37-917e-6148681cfea3 {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 15:53:14 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-db674126-1cd5-4f91-bf84-e629c93092c5 tempest-VolumesNegativeTest-112990104 tempest-VolumesNegativeTest-112990104-project-member] [instance: 88e07d6a-1202-4703-abf2-5980a7cfa15d] Start _get_guest_xml network_info=[{"id": "8c31c456-adba-4b37-917e-6148681cfea3", "address": "fa:16:3e:4a:93:aa", "network": {"id": "c746d36b-79e9-4682-b70e-db94193d24cf", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.191", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "6549a15819f1469bbd5eeae8190e3d44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c31c456-ad", "ovs_interfaceid": "8c31c456-adba-4b37-917e-6148681cfea3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T15:34:14Z,direct_url=<?>,disk_format='qcow2',id=16b903ae-a40f-41a7-985b-4804cce92c62,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6549a15819f1469bbd5eeae8190e3d44',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T15:34:15Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'guest_format': None, 'size': 0, 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '16b903ae-a40f-41a7-985b-4804cce92c62'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 15:53:14 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a293c354-d1e5-4c33-9e7b-d1558235aaf8/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:53:14 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-db674126-1cd5-4f91-bf84-e629c93092c5 tempest-VolumesNegativeTest-112990104 tempest-VolumesNegativeTest-112990104-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 15:53:14 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-db674126-1cd5-4f91-bf84-e629c93092c5 tempest-VolumesNegativeTest-112990104 tempest-VolumesNegativeTest-112990104-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 15:53:14 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30c634ff-6999-40aa-a90d-1db6d278b571/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:53:14 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-db674126-1cd5-4f91-bf84-e629c93092c5 tempest-VolumesNegativeTest-112990104 tempest-VolumesNegativeTest-112990104-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 15:53:14 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-db674126-1cd5-4f91-bf84-e629c93092c5 tempest-VolumesNegativeTest-112990104 tempest-VolumesNegativeTest-112990104-project-member] CPU controller missing on host. {{(pid=75337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 15:53:14 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-db674126-1cd5-4f91-bf84-e629c93092c5 tempest-VolumesNegativeTest-112990104 tempest-VolumesNegativeTest-112990104-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 15:53:14 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-db674126-1cd5-4f91-bf84-e629c93092c5 tempest-VolumesNegativeTest-112990104 tempest-VolumesNegativeTest-112990104-project-member] CPU controller found on host. {{(pid=75337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 15:53:14 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-db674126-1cd5-4f91-bf84-e629c93092c5 tempest-VolumesNegativeTest-112990104 tempest-VolumesNegativeTest-112990104-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75337) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 15:53:14 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-db674126-1cd5-4f91-bf84-e629c93092c5 tempest-VolumesNegativeTest-112990104 tempest-VolumesNegativeTest-112990104-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T15:34:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T15:34:14Z,direct_url=<?>,disk_format='qcow2',id=16b903ae-a40f-41a7-985b-4804cce92c62,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6549a15819f1469bbd5eeae8190e3d44',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T15:34:15Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 15:53:14 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-db674126-1cd5-4f91-bf84-e629c93092c5 tempest-VolumesNegativeTest-112990104 tempest-VolumesNegativeTest-112990104-project-member] Flavor limits 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 15:53:14 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-db674126-1cd5-4f91-bf84-e629c93092c5 tempest-VolumesNegativeTest-112990104 tempest-VolumesNegativeTest-112990104-project-member] Image limits 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 15:53:14 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-db674126-1cd5-4f91-bf84-e629c93092c5 tempest-VolumesNegativeTest-112990104 tempest-VolumesNegativeTest-112990104-project-member] Flavor pref 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 15:53:14 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-db674126-1cd5-4f91-bf84-e629c93092c5 tempest-VolumesNegativeTest-112990104 tempest-VolumesNegativeTest-112990104-project-member] Image pref 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 15:53:14 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-db674126-1cd5-4f91-bf84-e629c93092c5 tempest-VolumesNegativeTest-112990104 tempest-VolumesNegativeTest-112990104-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 15:53:14 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-db674126-1cd5-4f91-bf84-e629c93092c5 tempest-VolumesNegativeTest-112990104 tempest-VolumesNegativeTest-112990104-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 15:53:14 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-db674126-1cd5-4f91-bf84-e629c93092c5 tempest-VolumesNegativeTest-112990104 tempest-VolumesNegativeTest-112990104-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 15:53:14 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-db674126-1cd5-4f91-bf84-e629c93092c5 tempest-VolumesNegativeTest-112990104 tempest-VolumesNegativeTest-112990104-project-member] Got 1 possible topologies {{(pid=75337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 15:53:14 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-db674126-1cd5-4f91-bf84-e629c93092c5 tempest-VolumesNegativeTest-112990104 tempest-VolumesNegativeTest-112990104-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 15:53:14 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-db674126-1cd5-4f91-bf84-e629c93092c5 tempest-VolumesNegativeTest-112990104 tempest-VolumesNegativeTest-112990104-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 15:53:14 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-db674126-1cd5-4f91-bf84-e629c93092c5 tempest-VolumesNegativeTest-112990104 tempest-VolumesNegativeTest-112990104-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T15:53:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1185446545',display_name='tempest-VolumesNegativeTest-instance-1185446545',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1185446545',id=29,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='560875033e144b7388f45682fc334dc9',ramdisk_id='',reservation_id='r-v0qzyura',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-112990104',owner_user_name='tempest-VolumesNegativeTest-112990104-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T15:53:12Z,user_data=None,user_id='fb6f0b5d6286409bbc658b9dfa1466c5',uuid=88e07d6a-1202-4703-abf2-5980a7cfa15d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8c31c456-adba-4b37-917e-6148681cfea3", "address": "fa:16:3e:4a:93:aa", "network": {"id": "c746d36b-79e9-4682-b70e-db94193d24cf", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.191", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "6549a15819f1469bbd5eeae8190e3d44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c31c456-ad", "ovs_interfaceid": "8c31c456-adba-4b37-917e-6148681cfea3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75337) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 15:53:14 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-db674126-1cd5-4f91-bf84-e629c93092c5 tempest-VolumesNegativeTest-112990104 tempest-VolumesNegativeTest-112990104-project-member] Converting VIF {"id": "8c31c456-adba-4b37-917e-6148681cfea3", "address": "fa:16:3e:4a:93:aa", "network": {"id": "c746d36b-79e9-4682-b70e-db94193d24cf", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.191", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "6549a15819f1469bbd5eeae8190e3d44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c31c456-ad", "ovs_interfaceid": "8c31c456-adba-4b37-917e-6148681cfea3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 15:53:14 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-db674126-1cd5-4f91-bf84-e629c93092c5 tempest-VolumesNegativeTest-112990104 tempest-VolumesNegativeTest-112990104-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:93:aa,bridge_name='br-int',has_traffic_filtering=True,id=8c31c456-adba-4b37-917e-6148681cfea3,network=Network(c746d36b-79e9-4682-b70e-db94193d24cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c31c456-ad') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 15:53:14 user nova-compute[75337]: DEBUG nova.objects.instance [None req-db674126-1cd5-4f91-bf84-e629c93092c5 tempest-VolumesNegativeTest-112990104 tempest-VolumesNegativeTest-112990104-project-member] Lazy-loading 'pci_devices' on Instance uuid 88e07d6a-1202-4703-abf2-5980a7cfa15d {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 15:53:14 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:53:14 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-db674126-1cd5-4f91-bf84-e629c93092c5 tempest-VolumesNegativeTest-112990104 tempest-VolumesNegativeTest-112990104-project-member] [instance: 88e07d6a-1202-4703-abf2-5980a7cfa15d] End _get_guest_xml xml=<domain type="kvm">
Nov 06 15:53:14 user nova-compute[75337]:   <uuid>88e07d6a-1202-4703-abf2-5980a7cfa15d</uuid>
Nov 06 15:53:14 user nova-compute[75337]:   <name>instance-0000001d</name>
Nov 06 15:53:14 user nova-compute[75337]:   <memory>524288</memory>
Nov 06 15:53:14 user nova-compute[75337]:   <vcpu>1</vcpu>
Nov 06 15:53:14 user nova-compute[75337]:   <metadata>
Nov 06 15:53:14 user nova-compute[75337]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 15:53:14 user nova-compute[75337]:       <nova:package version="0.0.0"/>
Nov 06 15:53:14 user nova-compute[75337]:       <nova:name>tempest-VolumesNegativeTest-instance-1185446545</nova:name>
Nov 06 15:53:14 user nova-compute[75337]:       <nova:creationTime>2023-11-06 15:53:14</nova:creationTime>
Nov 06 15:53:14 user nova-compute[75337]:       <nova:flavor name="m1.tiny">
Nov 06 15:53:14 user nova-compute[75337]:         <nova:memory>512</nova:memory>
Nov 06 15:53:14 user nova-compute[75337]:         <nova:disk>1</nova:disk>
Nov 06 15:53:14 user nova-compute[75337]:         <nova:swap>0</nova:swap>
Nov 06 15:53:14 user nova-compute[75337]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 15:53:14 user nova-compute[75337]:         <nova:vcpus>1</nova:vcpus>
Nov 06 15:53:14 user nova-compute[75337]:       </nova:flavor>
Nov 06 15:53:14 user nova-compute[75337]:       <nova:owner>
Nov 06 15:53:14 user nova-compute[75337]:         <nova:user uuid="fb6f0b5d6286409bbc658b9dfa1466c5">tempest-VolumesNegativeTest-112990104-project-member</nova:user>
Nov 06 15:53:14 user nova-compute[75337]:         <nova:project uuid="560875033e144b7388f45682fc334dc9">tempest-VolumesNegativeTest-112990104</nova:project>
Nov 06 15:53:14 user nova-compute[75337]:       </nova:owner>
Nov 06 15:53:14 user nova-compute[75337]:       <nova:root type="image" uuid="16b903ae-a40f-41a7-985b-4804cce92c62"/>
Nov 06 15:53:14 user nova-compute[75337]:       <nova:ports>
Nov 06 15:53:14 user nova-compute[75337]:         <nova:port uuid="8c31c456-adba-4b37-917e-6148681cfea3">
Nov 06 15:53:14 user nova-compute[75337]:           <nova:ip type="fixed" address="192.168.233.191" ipVersion="4"/>
Nov 06 15:53:14 user nova-compute[75337]:         </nova:port>
Nov 06 15:53:14 user nova-compute[75337]:       </nova:ports>
Nov 06 15:53:14 user nova-compute[75337]:     </nova:instance>
Nov 06 15:53:14 user nova-compute[75337]:   </metadata>
Nov 06 15:53:14 user nova-compute[75337]:   <sysinfo type="smbios">
Nov 06 15:53:14 user nova-compute[75337]:     <system>
Nov 06 15:53:14 user nova-compute[75337]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 15:53:14 user nova-compute[75337]:       <entry name="product">OpenStack Nova</entry>
Nov 06 15:53:14 user nova-compute[75337]:       <entry name="version">0.0.0</entry>
Nov 06 15:53:14 user nova-compute[75337]:       <entry name="serial">88e07d6a-1202-4703-abf2-5980a7cfa15d</entry>
Nov 06 15:53:14 user nova-compute[75337]:       <entry name="uuid">88e07d6a-1202-4703-abf2-5980a7cfa15d</entry>
Nov 06 15:53:14 user nova-compute[75337]:       <entry name="family">Virtual Machine</entry>
Nov 06 15:53:14 user nova-compute[75337]:     </system>
Nov 06 15:53:14 user nova-compute[75337]:   </sysinfo>
Nov 06 15:53:14 user nova-compute[75337]:   <os>
Nov 06 15:53:14 user nova-compute[75337]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 15:53:14 user nova-compute[75337]:     <boot dev="hd"/>
Nov 06 15:53:14 user nova-compute[75337]:     <smbios mode="sysinfo"/>
Nov 06 15:53:14 user nova-compute[75337]:   </os>
Nov 06 15:53:14 user nova-compute[75337]:   <features>
Nov 06 15:53:14 user nova-compute[75337]:     <acpi/>
Nov 06 15:53:14 user nova-compute[75337]:     <apic/>
Nov 06 15:53:14 user nova-compute[75337]:     <vmcoreinfo/>
Nov 06 15:53:14 user nova-compute[75337]:   </features>
Nov 06 15:53:14 user nova-compute[75337]:   <clock offset="utc">
Nov 06 15:53:14 user nova-compute[75337]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 15:53:14 user nova-compute[75337]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 15:53:14 user nova-compute[75337]:     <timer name="hpet" present="no"/>
Nov 06 15:53:14 user nova-compute[75337]:   </clock>
Nov 06 15:53:14 user nova-compute[75337]:   <cpu mode="custom" match="exact">
Nov 06 15:53:14 user nova-compute[75337]:     <model>Nehalem</model>
Nov 06 15:53:14 user nova-compute[75337]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 15:53:14 user nova-compute[75337]:   </cpu>
Nov 06 15:53:14 user nova-compute[75337]:   <devices>
Nov 06 15:53:14 user nova-compute[75337]:     <disk type="file" device="disk">
Nov 06 15:53:14 user nova-compute[75337]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 15:53:14 user nova-compute[75337]:       <source file="/opt/stack/data/nova/instances/88e07d6a-1202-4703-abf2-5980a7cfa15d/disk"/>
Nov 06 15:53:14 user nova-compute[75337]:       <target dev="vda" bus="virtio"/>
Nov 06 15:53:14 user nova-compute[75337]:     </disk>
Nov 06 15:53:14 user nova-compute[75337]:     <interface type="ethernet">
Nov 06 15:53:14 user nova-compute[75337]:       <mac address="fa:16:3e:4a:93:aa"/>
Nov 06 15:53:14 user nova-compute[75337]:       <model type="virtio"/>
Nov 06 15:53:14 user nova-compute[75337]:       <mtu size="1442"/>
Nov 06 15:53:14 user nova-compute[75337]:       <target dev="tap8c31c456-ad"/>
Nov 06 15:53:14 user nova-compute[75337]:     </interface>
Nov 06 15:53:14 user nova-compute[75337]:     <serial type="pty">
Nov 06 15:53:14 user nova-compute[75337]:       <log file="/opt/stack/data/nova/instances/88e07d6a-1202-4703-abf2-5980a7cfa15d/console.log" append="off"/>
Nov 06 15:53:14 user nova-compute[75337]:     </serial>
Nov 06 15:53:14 user nova-compute[75337]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 15:53:14 user nova-compute[75337]:     <video>
Nov 06 15:53:14 user nova-compute[75337]:       <model type="virtio"/>
Nov 06 15:53:14 user nova-compute[75337]:     </video>
Nov 06 15:53:14 user nova-compute[75337]:     <rng model="virtio">
Nov 06 15:53:14 user nova-compute[75337]:       <backend model="random">/dev/urandom</backend>
Nov 06 15:53:14 user nova-compute[75337]:     </rng>
Nov 06 15:53:14 user nova-compute[75337]:     <controller type="usb" index="0" model="none"/>
Nov 06 15:53:14 user nova-compute[75337]:     <memballoon model="virtio">
Nov 06 15:53:14 user nova-compute[75337]:       <stats period="10"/>
Nov 06 15:53:14 user nova-compute[75337]:     </memballoon>
Nov 06 15:53:14 user nova-compute[75337]:   </devices>
Nov 06 15:53:14 user nova-compute[75337]: </domain>
Nov 06 15:53:14 user nova-compute[75337]:  {{(pid=75337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 15:53:14 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-db674126-1cd5-4f91-bf84-e629c93092c5 tempest-VolumesNegativeTest-112990104 tempest-VolumesNegativeTest-112990104-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T15:53:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1185446545',display_name='tempest-VolumesNegativeTest-instance-1185446545',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1185446545',id=29,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='560875033e144b7388f45682fc334dc9',ramdisk_id='',reservation_id='r-v0qzyura',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-112990104',owner_user_name='tempest-VolumesNegativeTest-112990104-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T15:53:12Z,user_data=None,user_id='fb6f0b5d6286409bbc658b9dfa1466c5',uuid=88e07d6a-1202-4703-abf2-5980a7cfa15d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8c31c456-adba-4b37-917e-6148681cfea3", "address": "fa:16:3e:4a:93:aa", "network": {"id": "c746d36b-79e9-4682-b70e-db94193d24cf", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.191", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "6549a15819f1469bbd5eeae8190e3d44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c31c456-ad", "ovs_interfaceid": "8c31c456-adba-4b37-917e-6148681cfea3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 15:53:14 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-db674126-1cd5-4f91-bf84-e629c93092c5 tempest-VolumesNegativeTest-112990104 tempest-VolumesNegativeTest-112990104-project-member] Converting VIF {"id": "8c31c456-adba-4b37-917e-6148681cfea3", "address": "fa:16:3e:4a:93:aa", "network": {"id": "c746d36b-79e9-4682-b70e-db94193d24cf", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.191", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "6549a15819f1469bbd5eeae8190e3d44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c31c456-ad", "ovs_interfaceid": "8c31c456-adba-4b37-917e-6148681cfea3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 15:53:14 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-db674126-1cd5-4f91-bf84-e629c93092c5 tempest-VolumesNegativeTest-112990104 tempest-VolumesNegativeTest-112990104-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:93:aa,bridge_name='br-int',has_traffic_filtering=True,id=8c31c456-adba-4b37-917e-6148681cfea3,network=Network(c746d36b-79e9-4682-b70e-db94193d24cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c31c456-ad') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 15:53:14 user nova-compute[75337]: DEBUG os_vif [None req-db674126-1cd5-4f91-bf84-e629c93092c5 tempest-VolumesNegativeTest-112990104 tempest-VolumesNegativeTest-112990104-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:93:aa,bridge_name='br-int',has_traffic_filtering=True,id=8c31c456-adba-4b37-917e-6148681cfea3,network=Network(c746d36b-79e9-4682-b70e-db94193d24cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c31c456-ad') {{(pid=75337) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 15:53:14 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:53:14 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:53:14 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 15:53:14 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:53:14 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8fa855d2-a0e4-52aa-a833-2d2bce625639', '_type': 'linux-noop'}}, row=False) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:53:14 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:53:14 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:53:14 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:53:14 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8c31c456-ad, may_exist=True, interface_attrs={}) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:53:14 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8c31c456-ad, col_values=(('qos', UUID('15a8b348-b1c0-4b91-825f-ecc44c77169d')),), if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:53:14 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8c31c456-ad, col_values=(('external_ids', {'iface-id': '8c31c456-adba-4b37-917e-6148681cfea3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4a:93:aa', 'vm-uuid': '88e07d6a-1202-4703-abf2-5980a7cfa15d'}),), if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:53:14 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:53:14 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:53:14 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:53:14 user nova-compute[75337]: INFO os_vif [None req-db674126-1cd5-4f91-bf84-e629c93092c5 tempest-VolumesNegativeTest-112990104 tempest-VolumesNegativeTest-112990104-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:93:aa,bridge_name='br-int',has_traffic_filtering=True,id=8c31c456-adba-4b37-917e-6148681cfea3,network=Network(c746d36b-79e9-4682-b70e-db94193d24cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c31c456-ad')
Nov 06 15:53:14 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30c634ff-6999-40aa-a90d-1db6d278b571/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:53:14 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30c634ff-6999-40aa-a90d-1db6d278b571/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:53:14 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-db674126-1cd5-4f91-bf84-e629c93092c5 tempest-VolumesNegativeTest-112990104 tempest-VolumesNegativeTest-112990104-project-member] No BDM found with device name vda, not building metadata. {{(pid=75337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 15:53:14 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-db674126-1cd5-4f91-bf84-e629c93092c5 tempest-VolumesNegativeTest-112990104 tempest-VolumesNegativeTest-112990104-project-member] No VIF found with MAC fa:16:3e:4a:93:aa, not building metadata {{(pid=75337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 15:53:14 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30c634ff-6999-40aa-a90d-1db6d278b571/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:53:14 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 15:53:14 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6110b34a-6fd3-45fc-911d-4e5d3c7f2d78/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:53:14 user nova-compute[75337]: DEBUG nova.network.neutron [req-7b306a2c-739a-4916-ab52-9ca0aa81787e req-ebdcad92-acc6-45d1-aa7c-e2012a66e4c9 service nova] [instance: 88e07d6a-1202-4703-abf2-5980a7cfa15d] Updated VIF entry in instance network info cache for port 8c31c456-adba-4b37-917e-6148681cfea3. {{(pid=75337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 15:53:14 user nova-compute[75337]: DEBUG nova.network.neutron [req-7b306a2c-739a-4916-ab52-9ca0aa81787e req-ebdcad92-acc6-45d1-aa7c-e2012a66e4c9 service nova] [instance: 88e07d6a-1202-4703-abf2-5980a7cfa15d] Updating instance_info_cache with network_info: [{"id": "8c31c456-adba-4b37-917e-6148681cfea3", "address": "fa:16:3e:4a:93:aa", "network": {"id": "c746d36b-79e9-4682-b70e-db94193d24cf", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.191", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "6549a15819f1469bbd5eeae8190e3d44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c31c456-ad", "ovs_interfaceid": "8c31c456-adba-4b37-917e-6148681cfea3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:53:14 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-7b306a2c-739a-4916-ab52-9ca0aa81787e req-ebdcad92-acc6-45d1-aa7c-e2012a66e4c9 service nova] Releasing lock "refresh_cache-88e07d6a-1202-4703-abf2-5980a7cfa15d" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 15:53:14 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6110b34a-6fd3-45fc-911d-4e5d3c7f2d78/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:53:14 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6110b34a-6fd3-45fc-911d-4e5d3c7f2d78/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:53:15 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6110b34a-6fd3-45fc-911d-4e5d3c7f2d78/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:53:15 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83516ff5-c4e7-4e91-a2f9-8af9b51cf475/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:53:15 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83516ff5-c4e7-4e91-a2f9-8af9b51cf475/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:53:15 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83516ff5-c4e7-4e91-a2f9-8af9b51cf475/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:53:15 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83516ff5-c4e7-4e91-a2f9-8af9b51cf475/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:53:18 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:53:18 user nova-compute[75337]: DEBUG nova.compute.manager [None req-db674126-1cd5-4f91-bf84-e629c93092c5 tempest-VolumesNegativeTest-112990104 tempest-VolumesNegativeTest-112990104-project-member] [instance: 88e07d6a-1202-4703-abf2-5980a7cfa15d] Instance event wait completed in 0 seconds for  {{(pid=75337) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 15:53:18 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-db674126-1cd5-4f91-bf84-e629c93092c5 tempest-VolumesNegativeTest-112990104 tempest-VolumesNegativeTest-112990104-project-member] [instance: 88e07d6a-1202-4703-abf2-5980a7cfa15d] Guest created on hypervisor {{(pid=75337) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 15:53:18 user nova-compute[75337]: DEBUG nova.compute.manager [req-be12df28-711c-40ca-ab52-6cfc49f854c3 req-3245c2d5-4c77-411e-a6a8-44db513fc211 service nova] [instance: 88e07d6a-1202-4703-abf2-5980a7cfa15d] Received event network-vif-plugged-8c31c456-adba-4b37-917e-6148681cfea3 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:53:18 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-be12df28-711c-40ca-ab52-6cfc49f854c3 req-3245c2d5-4c77-411e-a6a8-44db513fc211 service nova] Acquiring lock "88e07d6a-1202-4703-abf2-5980a7cfa15d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:53:18 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-be12df28-711c-40ca-ab52-6cfc49f854c3 req-3245c2d5-4c77-411e-a6a8-44db513fc211 service nova] Lock "88e07d6a-1202-4703-abf2-5980a7cfa15d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:53:18 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-be12df28-711c-40ca-ab52-6cfc49f854c3 req-3245c2d5-4c77-411e-a6a8-44db513fc211 service nova] Lock "88e07d6a-1202-4703-abf2-5980a7cfa15d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:53:18 user nova-compute[75337]: DEBUG nova.compute.manager [req-be12df28-711c-40ca-ab52-6cfc49f854c3 req-3245c2d5-4c77-411e-a6a8-44db513fc211 service nova] [instance: 88e07d6a-1202-4703-abf2-5980a7cfa15d] No waiting events found dispatching network-vif-plugged-8c31c456-adba-4b37-917e-6148681cfea3 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:53:18 user nova-compute[75337]: WARNING nova.compute.manager [req-be12df28-711c-40ca-ab52-6cfc49f854c3 req-3245c2d5-4c77-411e-a6a8-44db513fc211 service nova] [instance: 88e07d6a-1202-4703-abf2-5980a7cfa15d] Received unexpected event network-vif-plugged-8c31c456-adba-4b37-917e-6148681cfea3 for instance with vm_state building and task_state spawning.
Nov 06 15:53:18 user nova-compute[75337]: DEBUG nova.compute.manager [req-a701e1a3-e615-47e8-8a1d-528f5488619f req-f77210b9-7d07-440c-9463-0ab0390c4a7f service nova] [instance: 88e07d6a-1202-4703-abf2-5980a7cfa15d] Received event network-vif-plugged-8c31c456-adba-4b37-917e-6148681cfea3 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:53:18 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-a701e1a3-e615-47e8-8a1d-528f5488619f req-f77210b9-7d07-440c-9463-0ab0390c4a7f service nova] Acquiring lock "88e07d6a-1202-4703-abf2-5980a7cfa15d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:53:18 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-a701e1a3-e615-47e8-8a1d-528f5488619f req-f77210b9-7d07-440c-9463-0ab0390c4a7f service nova] Lock "88e07d6a-1202-4703-abf2-5980a7cfa15d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:53:18 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-a701e1a3-e615-47e8-8a1d-528f5488619f req-f77210b9-7d07-440c-9463-0ab0390c4a7f service nova] Lock "88e07d6a-1202-4703-abf2-5980a7cfa15d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:53:18 user nova-compute[75337]: DEBUG nova.compute.manager [req-a701e1a3-e615-47e8-8a1d-528f5488619f req-f77210b9-7d07-440c-9463-0ab0390c4a7f service nova] [instance: 88e07d6a-1202-4703-abf2-5980a7cfa15d] No waiting events found dispatching network-vif-plugged-8c31c456-adba-4b37-917e-6148681cfea3 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:53:18 user nova-compute[75337]: WARNING nova.compute.manager [req-a701e1a3-e615-47e8-8a1d-528f5488619f req-f77210b9-7d07-440c-9463-0ab0390c4a7f service nova] [instance: 88e07d6a-1202-4703-abf2-5980a7cfa15d] Received unexpected event network-vif-plugged-8c31c456-adba-4b37-917e-6148681cfea3 for instance with vm_state building and task_state spawning.
Nov 06 15:53:18 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 15:53:18 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 15:53:18 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Hypervisor/Node resource view: name=user free_ram=8004MB free_disk=25.11550521850586GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75337) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 15:53:18 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:53:18 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:53:18 user nova-compute[75337]: INFO nova.virt.libvirt.driver [-] [instance: 88e07d6a-1202-4703-abf2-5980a7cfa15d] Instance spawned successfully.
Nov 06 15:53:18 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-db674126-1cd5-4f91-bf84-e629c93092c5 tempest-VolumesNegativeTest-112990104 tempest-VolumesNegativeTest-112990104-project-member] [instance: 88e07d6a-1202-4703-abf2-5980a7cfa15d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 15:53:18 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-db674126-1cd5-4f91-bf84-e629c93092c5 tempest-VolumesNegativeTest-112990104 tempest-VolumesNegativeTest-112990104-project-member] [instance: 88e07d6a-1202-4703-abf2-5980a7cfa15d] Found default for hw_cdrom_bus of ide {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:53:18 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-db674126-1cd5-4f91-bf84-e629c93092c5 tempest-VolumesNegativeTest-112990104 tempest-VolumesNegativeTest-112990104-project-member] [instance: 88e07d6a-1202-4703-abf2-5980a7cfa15d] Found default for hw_disk_bus of virtio {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:53:18 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-db674126-1cd5-4f91-bf84-e629c93092c5 tempest-VolumesNegativeTest-112990104 tempest-VolumesNegativeTest-112990104-project-member] [instance: 88e07d6a-1202-4703-abf2-5980a7cfa15d] Found default for hw_input_bus of None {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:53:18 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-db674126-1cd5-4f91-bf84-e629c93092c5 tempest-VolumesNegativeTest-112990104 tempest-VolumesNegativeTest-112990104-project-member] [instance: 88e07d6a-1202-4703-abf2-5980a7cfa15d] Found default for hw_pointer_model of None {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:53:18 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-db674126-1cd5-4f91-bf84-e629c93092c5 tempest-VolumesNegativeTest-112990104 tempest-VolumesNegativeTest-112990104-project-member] [instance: 88e07d6a-1202-4703-abf2-5980a7cfa15d] Found default for hw_video_model of virtio {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:53:18 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-db674126-1cd5-4f91-bf84-e629c93092c5 tempest-VolumesNegativeTest-112990104 tempest-VolumesNegativeTest-112990104-project-member] [instance: 88e07d6a-1202-4703-abf2-5980a7cfa15d] Found default for hw_vif_model of virtio {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:53:18 user nova-compute[75337]: INFO nova.compute.manager [None req-db674126-1cd5-4f91-bf84-e629c93092c5 tempest-VolumesNegativeTest-112990104 tempest-VolumesNegativeTest-112990104-project-member] [instance: 88e07d6a-1202-4703-abf2-5980a7cfa15d] Took 6.86 seconds to spawn the instance on the hypervisor.
Nov 06 15:53:18 user nova-compute[75337]: DEBUG nova.compute.manager [None req-db674126-1cd5-4f91-bf84-e629c93092c5 tempest-VolumesNegativeTest-112990104 tempest-VolumesNegativeTest-112990104-project-member] [instance: 88e07d6a-1202-4703-abf2-5980a7cfa15d] Checking state {{(pid=75337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 15:53:18 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 83516ff5-c4e7-4e91-a2f9-8af9b51cf475 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:53:18 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 493eff79-294e-4259-a6d0-4772c4b45013 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:53:18 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance a293c354-d1e5-4c33-9e7b-d1558235aaf8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:53:18 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 582702ee-b8f8-49e4-9853-68af15420702 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:53:18 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 30c634ff-6999-40aa-a90d-1db6d278b571 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:53:18 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 6110b34a-6fd3-45fc-911d-4e5d3c7f2d78 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:53:18 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 88e07d6a-1202-4703-abf2-5980a7cfa15d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:53:18 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 15:53:18 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 15:53:18 user nova-compute[75337]: INFO nova.compute.manager [None req-db674126-1cd5-4f91-bf84-e629c93092c5 tempest-VolumesNegativeTest-112990104 tempest-VolumesNegativeTest-112990104-project-member] [instance: 88e07d6a-1202-4703-abf2-5980a7cfa15d] Took 7.85 seconds to build instance.
Nov 06 15:53:18 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-db674126-1cd5-4f91-bf84-e629c93092c5 tempest-VolumesNegativeTest-112990104 tempest-VolumesNegativeTest-112990104-project-member] Lock "88e07d6a-1202-4703-abf2-5980a7cfa15d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.959s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:53:18 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 15:53:18 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 15:53:18 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Compute_service record updated for user:user {{(pid=75337) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 15:53:18 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.390s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:53:19 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:53:19 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:53:24 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:53:24 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:53:27 user nova-compute[75337]: INFO nova.compute.manager [None req-de3d9d1b-d7f2-43cd-a249-9c448ec3916b tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 582702ee-b8f8-49e4-9853-68af15420702] Took 16.51 seconds to detach 1 volumes for instance.
Nov 06 15:53:27 user nova-compute[75337]: DEBUG nova.compute.manager [None req-de3d9d1b-d7f2-43cd-a249-9c448ec3916b tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 582702ee-b8f8-49e4-9853-68af15420702] Deleting volume: ea7e84b5-25b5-4146-a33b-f23a700deadf {{(pid=75337) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 06 15:53:27 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-de3d9d1b-d7f2-43cd-a249-9c448ec3916b tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:53:27 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-de3d9d1b-d7f2-43cd-a249-9c448ec3916b tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:53:27 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-de3d9d1b-d7f2-43cd-a249-9c448ec3916b tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 15:53:27 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-de3d9d1b-d7f2-43cd-a249-9c448ec3916b tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 15:53:27 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-de3d9d1b-d7f2-43cd-a249-9c448ec3916b tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.329s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:53:27 user nova-compute[75337]: INFO nova.scheduler.client.report [None req-de3d9d1b-d7f2-43cd-a249-9c448ec3916b tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Deleted allocations for instance 582702ee-b8f8-49e4-9853-68af15420702
Nov 06 15:53:27 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-de3d9d1b-d7f2-43cd-a249-9c448ec3916b tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Lock "582702ee-b8f8-49e4-9853-68af15420702" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 19.142s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:53:29 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:53:29 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:53:29 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75337) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 15:53:29 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 15:53:29 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 15:53:29 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:53:34 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:53:34 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:53:35 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-83fcdd44-f024-4b3f-95c1-aed5d3721c67 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Acquiring lock "d10b4a86-8b0d-423f-81e2-87f5f25a2467" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:53:35 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-83fcdd44-f024-4b3f-95c1-aed5d3721c67 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Lock "d10b4a86-8b0d-423f-81e2-87f5f25a2467" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:53:35 user nova-compute[75337]: DEBUG nova.compute.manager [None req-83fcdd44-f024-4b3f-95c1-aed5d3721c67 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] [instance: d10b4a86-8b0d-423f-81e2-87f5f25a2467] Starting instance... {{(pid=75337) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 15:53:35 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-83fcdd44-f024-4b3f-95c1-aed5d3721c67 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:53:35 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-83fcdd44-f024-4b3f-95c1-aed5d3721c67 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:53:35 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-83fcdd44-f024-4b3f-95c1-aed5d3721c67 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75337) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 15:53:35 user nova-compute[75337]: INFO nova.compute.claims [None req-83fcdd44-f024-4b3f-95c1-aed5d3721c67 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] [instance: d10b4a86-8b0d-423f-81e2-87f5f25a2467] Claim successful on node user
Nov 06 15:53:35 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-83fcdd44-f024-4b3f-95c1-aed5d3721c67 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 15:53:35 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-83fcdd44-f024-4b3f-95c1-aed5d3721c67 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 15:53:35 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-83fcdd44-f024-4b3f-95c1-aed5d3721c67 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.325s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:53:35 user nova-compute[75337]: DEBUG nova.compute.manager [None req-83fcdd44-f024-4b3f-95c1-aed5d3721c67 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] [instance: d10b4a86-8b0d-423f-81e2-87f5f25a2467] Start building networks asynchronously for instance. {{(pid=75337) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 15:53:35 user nova-compute[75337]: DEBUG nova.compute.manager [None req-83fcdd44-f024-4b3f-95c1-aed5d3721c67 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] [instance: d10b4a86-8b0d-423f-81e2-87f5f25a2467] Allocating IP information in the background. {{(pid=75337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 15:53:35 user nova-compute[75337]: DEBUG nova.network.neutron [None req-83fcdd44-f024-4b3f-95c1-aed5d3721c67 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] [instance: d10b4a86-8b0d-423f-81e2-87f5f25a2467] allocate_for_instance() {{(pid=75337) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 15:53:35 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-83fcdd44-f024-4b3f-95c1-aed5d3721c67 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] [instance: d10b4a86-8b0d-423f-81e2-87f5f25a2467] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 15:53:35 user nova-compute[75337]: DEBUG nova.compute.manager [None req-83fcdd44-f024-4b3f-95c1-aed5d3721c67 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] [instance: d10b4a86-8b0d-423f-81e2-87f5f25a2467] Start building block device mappings for instance. {{(pid=75337) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 15:53:35 user nova-compute[75337]: DEBUG nova.policy [None req-83fcdd44-f024-4b3f-95c1-aed5d3721c67 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8c795ee993a944ff89ed544450b90dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cddccc86bf54fe981667da5ef13fa8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75337) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 15:53:35 user nova-compute[75337]: DEBUG nova.compute.manager [None req-83fcdd44-f024-4b3f-95c1-aed5d3721c67 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] [instance: d10b4a86-8b0d-423f-81e2-87f5f25a2467] Start spawning the instance on the hypervisor. {{(pid=75337) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 15:53:35 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-83fcdd44-f024-4b3f-95c1-aed5d3721c67 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] [instance: d10b4a86-8b0d-423f-81e2-87f5f25a2467] Creating instance directory {{(pid=75337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 15:53:35 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-83fcdd44-f024-4b3f-95c1-aed5d3721c67 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] [instance: d10b4a86-8b0d-423f-81e2-87f5f25a2467] Creating image(s)
Nov 06 15:53:35 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-83fcdd44-f024-4b3f-95c1-aed5d3721c67 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Acquiring lock "/opt/stack/data/nova/instances/d10b4a86-8b0d-423f-81e2-87f5f25a2467/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:53:35 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-83fcdd44-f024-4b3f-95c1-aed5d3721c67 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Lock "/opt/stack/data/nova/instances/d10b4a86-8b0d-423f-81e2-87f5f25a2467/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:53:35 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-83fcdd44-f024-4b3f-95c1-aed5d3721c67 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Lock "/opt/stack/data/nova/instances/d10b4a86-8b0d-423f-81e2-87f5f25a2467/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:53:36 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-83fcdd44-f024-4b3f-95c1-aed5d3721c67 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Acquiring lock "4dae0f202bb0e6089d0cc3207935c36081a98611" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:53:36 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-83fcdd44-f024-4b3f-95c1-aed5d3721c67 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Lock "4dae0f202bb0e6089d0cc3207935c36081a98611" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:53:36 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-83fcdd44-f024-4b3f-95c1-aed5d3721c67 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4dae0f202bb0e6089d0cc3207935c36081a98611.part --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:53:36 user nova-compute[75337]: DEBUG nova.network.neutron [None req-83fcdd44-f024-4b3f-95c1-aed5d3721c67 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] [instance: d10b4a86-8b0d-423f-81e2-87f5f25a2467] Successfully created port: f9232e10-c7da-42d1-91c6-d72b0a1e0ccb {{(pid=75337) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 15:53:36 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-83fcdd44-f024-4b3f-95c1-aed5d3721c67 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4dae0f202bb0e6089d0cc3207935c36081a98611.part --force-share --output=json" returned: 0 in 0.204s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:53:36 user nova-compute[75337]: DEBUG nova.virt.images [None req-83fcdd44-f024-4b3f-95c1-aed5d3721c67 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] b2bd209c-1854-4296-878e-12b97860cf7e was qcow2, converting to raw {{(pid=75337) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 06 15:53:36 user nova-compute[75337]: DEBUG nova.privsep.utils [None req-83fcdd44-f024-4b3f-95c1-aed5d3721c67 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75337) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 06 15:53:36 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-83fcdd44-f024-4b3f-95c1-aed5d3721c67 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4dae0f202bb0e6089d0cc3207935c36081a98611.part /opt/stack/data/nova/instances/_base/4dae0f202bb0e6089d0cc3207935c36081a98611.converted {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:53:36 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-83fcdd44-f024-4b3f-95c1-aed5d3721c67 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4dae0f202bb0e6089d0cc3207935c36081a98611.part /opt/stack/data/nova/instances/_base/4dae0f202bb0e6089d0cc3207935c36081a98611.converted" returned: 0 in 0.287s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:53:36 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-83fcdd44-f024-4b3f-95c1-aed5d3721c67 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4dae0f202bb0e6089d0cc3207935c36081a98611.converted --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:53:37 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:53:37 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-83fcdd44-f024-4b3f-95c1-aed5d3721c67 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4dae0f202bb0e6089d0cc3207935c36081a98611.converted --force-share --output=json" returned: 0 in 0.182s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:53:37 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-83fcdd44-f024-4b3f-95c1-aed5d3721c67 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Lock "4dae0f202bb0e6089d0cc3207935c36081a98611" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.163s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:53:37 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-83fcdd44-f024-4b3f-95c1-aed5d3721c67 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4dae0f202bb0e6089d0cc3207935c36081a98611 --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:53:37 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-83fcdd44-f024-4b3f-95c1-aed5d3721c67 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4dae0f202bb0e6089d0cc3207935c36081a98611 --force-share --output=json" returned: 0 in 0.178s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:53:37 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-83fcdd44-f024-4b3f-95c1-aed5d3721c67 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Acquiring lock "4dae0f202bb0e6089d0cc3207935c36081a98611" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:53:37 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-83fcdd44-f024-4b3f-95c1-aed5d3721c67 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Lock "4dae0f202bb0e6089d0cc3207935c36081a98611" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:53:37 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-83fcdd44-f024-4b3f-95c1-aed5d3721c67 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4dae0f202bb0e6089d0cc3207935c36081a98611 --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:53:37 user nova-compute[75337]: DEBUG nova.network.neutron [None req-83fcdd44-f024-4b3f-95c1-aed5d3721c67 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] [instance: d10b4a86-8b0d-423f-81e2-87f5f25a2467] Successfully updated port: f9232e10-c7da-42d1-91c6-d72b0a1e0ccb {{(pid=75337) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 15:53:37 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-83fcdd44-f024-4b3f-95c1-aed5d3721c67 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4dae0f202bb0e6089d0cc3207935c36081a98611 --force-share --output=json" returned: 0 in 0.175s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:53:37 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-83fcdd44-f024-4b3f-95c1-aed5d3721c67 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4dae0f202bb0e6089d0cc3207935c36081a98611,backing_fmt=raw /opt/stack/data/nova/instances/d10b4a86-8b0d-423f-81e2-87f5f25a2467/disk 1073741824 {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:53:37 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-83fcdd44-f024-4b3f-95c1-aed5d3721c67 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Acquiring lock "refresh_cache-d10b4a86-8b0d-423f-81e2-87f5f25a2467" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 15:53:37 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-83fcdd44-f024-4b3f-95c1-aed5d3721c67 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Acquired lock "refresh_cache-d10b4a86-8b0d-423f-81e2-87f5f25a2467" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 15:53:37 user nova-compute[75337]: DEBUG nova.network.neutron [None req-83fcdd44-f024-4b3f-95c1-aed5d3721c67 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] [instance: d10b4a86-8b0d-423f-81e2-87f5f25a2467] Building network info cache for instance {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 15:53:37 user nova-compute[75337]: DEBUG nova.compute.manager [req-22791dd4-4724-4346-9a02-8d5a8a9677b0 req-b31cdde0-aaa5-4eeb-a847-e5b7cc4b2156 service nova] [instance: d10b4a86-8b0d-423f-81e2-87f5f25a2467] Received event network-changed-f9232e10-c7da-42d1-91c6-d72b0a1e0ccb {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:53:37 user nova-compute[75337]: DEBUG nova.compute.manager [req-22791dd4-4724-4346-9a02-8d5a8a9677b0 req-b31cdde0-aaa5-4eeb-a847-e5b7cc4b2156 service nova] [instance: d10b4a86-8b0d-423f-81e2-87f5f25a2467] Refreshing instance network info cache due to event network-changed-f9232e10-c7da-42d1-91c6-d72b0a1e0ccb. {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 15:53:37 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-22791dd4-4724-4346-9a02-8d5a8a9677b0 req-b31cdde0-aaa5-4eeb-a847-e5b7cc4b2156 service nova] Acquiring lock "refresh_cache-d10b4a86-8b0d-423f-81e2-87f5f25a2467" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 15:53:37 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-83fcdd44-f024-4b3f-95c1-aed5d3721c67 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4dae0f202bb0e6089d0cc3207935c36081a98611,backing_fmt=raw /opt/stack/data/nova/instances/d10b4a86-8b0d-423f-81e2-87f5f25a2467/disk 1073741824" returned: 0 in 0.071s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:53:37 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-83fcdd44-f024-4b3f-95c1-aed5d3721c67 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Lock "4dae0f202bb0e6089d0cc3207935c36081a98611" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:53:37 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-83fcdd44-f024-4b3f-95c1-aed5d3721c67 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4dae0f202bb0e6089d0cc3207935c36081a98611 --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:53:37 user nova-compute[75337]: DEBUG nova.network.neutron [None req-83fcdd44-f024-4b3f-95c1-aed5d3721c67 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] [instance: d10b4a86-8b0d-423f-81e2-87f5f25a2467] Instance cache missing network info. {{(pid=75337) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 15:53:37 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-83fcdd44-f024-4b3f-95c1-aed5d3721c67 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4dae0f202bb0e6089d0cc3207935c36081a98611 --force-share --output=json" returned: 0 in 0.193s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:53:37 user nova-compute[75337]: DEBUG nova.virt.disk.api [None req-83fcdd44-f024-4b3f-95c1-aed5d3721c67 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d10b4a86-8b0d-423f-81e2-87f5f25a2467/disk. size=1073741824 {{(pid=75337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 15:53:37 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-83fcdd44-f024-4b3f-95c1-aed5d3721c67 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d10b4a86-8b0d-423f-81e2-87f5f25a2467/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:53:37 user nova-compute[75337]: DEBUG nova.network.neutron [None req-83fcdd44-f024-4b3f-95c1-aed5d3721c67 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] [instance: d10b4a86-8b0d-423f-81e2-87f5f25a2467] Updating instance_info_cache with network_info: [{"id": "f9232e10-c7da-42d1-91c6-d72b0a1e0ccb", "address": "fa:16:3e:93:ab:63", "network": {"id": "c31b513a-57f0-4bd5-b055-4a363aae9793", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1352256985-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cddccc86bf54fe981667da5ef13fa8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9232e10-c7", "ovs_interfaceid": "f9232e10-c7da-42d1-91c6-d72b0a1e0ccb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:53:37 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-83fcdd44-f024-4b3f-95c1-aed5d3721c67 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Releasing lock "refresh_cache-d10b4a86-8b0d-423f-81e2-87f5f25a2467" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 15:53:37 user nova-compute[75337]: DEBUG nova.compute.manager [None req-83fcdd44-f024-4b3f-95c1-aed5d3721c67 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] [instance: d10b4a86-8b0d-423f-81e2-87f5f25a2467] Instance network_info: |[{"id": "f9232e10-c7da-42d1-91c6-d72b0a1e0ccb", "address": "fa:16:3e:93:ab:63", "network": {"id": "c31b513a-57f0-4bd5-b055-4a363aae9793", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1352256985-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cddccc86bf54fe981667da5ef13fa8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9232e10-c7", "ovs_interfaceid": "f9232e10-c7da-42d1-91c6-d72b0a1e0ccb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 15:53:37 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-22791dd4-4724-4346-9a02-8d5a8a9677b0 req-b31cdde0-aaa5-4eeb-a847-e5b7cc4b2156 service nova] Acquired lock "refresh_cache-d10b4a86-8b0d-423f-81e2-87f5f25a2467" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 15:53:37 user nova-compute[75337]: DEBUG nova.network.neutron [req-22791dd4-4724-4346-9a02-8d5a8a9677b0 req-b31cdde0-aaa5-4eeb-a847-e5b7cc4b2156 service nova] [instance: d10b4a86-8b0d-423f-81e2-87f5f25a2467] Refreshing network info cache for port f9232e10-c7da-42d1-91c6-d72b0a1e0ccb {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 15:53:38 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-83fcdd44-f024-4b3f-95c1-aed5d3721c67 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d10b4a86-8b0d-423f-81e2-87f5f25a2467/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:53:38 user nova-compute[75337]: DEBUG nova.virt.disk.api [None req-83fcdd44-f024-4b3f-95c1-aed5d3721c67 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Cannot resize image /opt/stack/data/nova/instances/d10b4a86-8b0d-423f-81e2-87f5f25a2467/disk to a smaller size. {{(pid=75337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 06 15:53:38 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-83fcdd44-f024-4b3f-95c1-aed5d3721c67 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] [instance: d10b4a86-8b0d-423f-81e2-87f5f25a2467] Created local disks {{(pid=75337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 15:53:38 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-83fcdd44-f024-4b3f-95c1-aed5d3721c67 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] [instance: d10b4a86-8b0d-423f-81e2-87f5f25a2467] Ensure instance console log exists: /opt/stack/data/nova/instances/d10b4a86-8b0d-423f-81e2-87f5f25a2467/console.log {{(pid=75337) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 15:53:38 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-83fcdd44-f024-4b3f-95c1-aed5d3721c67 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:53:38 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-83fcdd44-f024-4b3f-95c1-aed5d3721c67 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:53:38 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-83fcdd44-f024-4b3f-95c1-aed5d3721c67 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:53:38 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-83fcdd44-f024-4b3f-95c1-aed5d3721c67 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] [instance: d10b4a86-8b0d-423f-81e2-87f5f25a2467] Start _get_guest_xml network_info=[{"id": "f9232e10-c7da-42d1-91c6-d72b0a1e0ccb", "address": "fa:16:3e:93:ab:63", "network": {"id": "c31b513a-57f0-4bd5-b055-4a363aae9793", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1352256985-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cddccc86bf54fe981667da5ef13fa8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9232e10-c7", "ovs_interfaceid": "f9232e10-c7da-42d1-91c6-d72b0a1e0ccb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T15:53:32Z,direct_url=<?>,disk_format='qcow2',id=b2bd209c-1854-4296-878e-12b97860cf7e,min_disk=0,min_ram=0,name='tempest-scenario-img--340479914',owner='2cddccc86bf54fe981667da5ef13fa8a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T15:53:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'guest_format': None, 'size': 0, 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': 'b2bd209c-1854-4296-878e-12b97860cf7e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 15:53:38 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-83fcdd44-f024-4b3f-95c1-aed5d3721c67 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 15:53:38 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-83fcdd44-f024-4b3f-95c1-aed5d3721c67 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 15:53:38 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-83fcdd44-f024-4b3f-95c1-aed5d3721c67 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 15:53:38 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-83fcdd44-f024-4b3f-95c1-aed5d3721c67 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] CPU controller missing on host. {{(pid=75337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 15:53:38 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-83fcdd44-f024-4b3f-95c1-aed5d3721c67 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 15:53:38 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-83fcdd44-f024-4b3f-95c1-aed5d3721c67 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] CPU controller found on host. {{(pid=75337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 15:53:38 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-83fcdd44-f024-4b3f-95c1-aed5d3721c67 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75337) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 15:53:38 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-83fcdd44-f024-4b3f-95c1-aed5d3721c67 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T15:34:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T15:53:32Z,direct_url=<?>,disk_format='qcow2',id=b2bd209c-1854-4296-878e-12b97860cf7e,min_disk=0,min_ram=0,name='tempest-scenario-img--340479914',owner='2cddccc86bf54fe981667da5ef13fa8a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T15:53:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 15:53:38 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-83fcdd44-f024-4b3f-95c1-aed5d3721c67 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Flavor limits 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 15:53:38 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-83fcdd44-f024-4b3f-95c1-aed5d3721c67 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Image limits 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 15:53:38 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-83fcdd44-f024-4b3f-95c1-aed5d3721c67 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Flavor pref 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 15:53:38 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-83fcdd44-f024-4b3f-95c1-aed5d3721c67 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Image pref 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 15:53:38 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-83fcdd44-f024-4b3f-95c1-aed5d3721c67 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 15:53:38 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-83fcdd44-f024-4b3f-95c1-aed5d3721c67 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 15:53:38 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-83fcdd44-f024-4b3f-95c1-aed5d3721c67 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 15:53:38 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-83fcdd44-f024-4b3f-95c1-aed5d3721c67 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Got 1 possible topologies {{(pid=75337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 15:53:38 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-83fcdd44-f024-4b3f-95c1-aed5d3721c67 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 15:53:38 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-83fcdd44-f024-4b3f-95c1-aed5d3721c67 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 15:53:38 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-83fcdd44-f024-4b3f-95c1-aed5d3721c67 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T15:53:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1428152347',display_name='tempest-TestMinimumBasicScenario-server-1428152347',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1428152347',id=30,image_ref='b2bd209c-1854-4296-878e-12b97860cf7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLeGZ0NNG8iDmqfRwynCeGkLkdivVOJUUT+8v5Pk7Ie2vaf+Y7xHcOuUhIU5MfzY1f4/p36cRXZITF1qZCli35Xyvr76yXg1+/gHPr8L3c8kcgm5E40YfNtApHH749OmRA==',key_name='tempest-TestMinimumBasicScenario-1095476101',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2cddccc86bf54fe981667da5ef13fa8a',ramdisk_id='',reservation_id='r-ecwh0mw2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b2bd209c-1854-4296-878e-12b97860cf7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-2098539193',owner_user_name='tempest-TestMinimumBasicScenario-2098539193-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T15:53:36Z,user_data=None,user_id='8c795ee993a944ff89ed544450b90dc2',uuid=d10b4a86-8b0d-423f-81e2-87f5f25a2467,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f9232e10-c7da-42d1-91c6-d72b0a1e0ccb", "address": "fa:16:3e:93:ab:63", "network": {"id": "c31b513a-57f0-4bd5-b055-4a363aae9793", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1352256985-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cddccc86bf54fe981667da5ef13fa8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9232e10-c7", "ovs_interfaceid": "f9232e10-c7da-42d1-91c6-d72b0a1e0ccb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75337) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 15:53:38 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-83fcdd44-f024-4b3f-95c1-aed5d3721c67 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Converting VIF {"id": "f9232e10-c7da-42d1-91c6-d72b0a1e0ccb", "address": "fa:16:3e:93:ab:63", "network": {"id": "c31b513a-57f0-4bd5-b055-4a363aae9793", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1352256985-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cddccc86bf54fe981667da5ef13fa8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9232e10-c7", "ovs_interfaceid": "f9232e10-c7da-42d1-91c6-d72b0a1e0ccb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 15:53:38 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-83fcdd44-f024-4b3f-95c1-aed5d3721c67 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:ab:63,bridge_name='br-int',has_traffic_filtering=True,id=f9232e10-c7da-42d1-91c6-d72b0a1e0ccb,network=Network(c31b513a-57f0-4bd5-b055-4a363aae9793),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9232e10-c7') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 15:53:38 user nova-compute[75337]: DEBUG nova.objects.instance [None req-83fcdd44-f024-4b3f-95c1-aed5d3721c67 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Lazy-loading 'pci_devices' on Instance uuid d10b4a86-8b0d-423f-81e2-87f5f25a2467 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 15:53:38 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-83fcdd44-f024-4b3f-95c1-aed5d3721c67 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] [instance: d10b4a86-8b0d-423f-81e2-87f5f25a2467] End _get_guest_xml xml=<domain type="kvm">
Nov 06 15:53:38 user nova-compute[75337]:   <uuid>d10b4a86-8b0d-423f-81e2-87f5f25a2467</uuid>
Nov 06 15:53:38 user nova-compute[75337]:   <name>instance-0000001e</name>
Nov 06 15:53:38 user nova-compute[75337]:   <memory>524288</memory>
Nov 06 15:53:38 user nova-compute[75337]:   <vcpu>1</vcpu>
Nov 06 15:53:38 user nova-compute[75337]:   <metadata>
Nov 06 15:53:38 user nova-compute[75337]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 15:53:38 user nova-compute[75337]:       <nova:package version="0.0.0"/>
Nov 06 15:53:38 user nova-compute[75337]:       <nova:name>tempest-TestMinimumBasicScenario-server-1428152347</nova:name>
Nov 06 15:53:38 user nova-compute[75337]:       <nova:creationTime>2023-11-06 15:53:38</nova:creationTime>
Nov 06 15:53:38 user nova-compute[75337]:       <nova:flavor name="m1.tiny">
Nov 06 15:53:38 user nova-compute[75337]:         <nova:memory>512</nova:memory>
Nov 06 15:53:38 user nova-compute[75337]:         <nova:disk>1</nova:disk>
Nov 06 15:53:38 user nova-compute[75337]:         <nova:swap>0</nova:swap>
Nov 06 15:53:38 user nova-compute[75337]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 15:53:38 user nova-compute[75337]:         <nova:vcpus>1</nova:vcpus>
Nov 06 15:53:38 user nova-compute[75337]:       </nova:flavor>
Nov 06 15:53:38 user nova-compute[75337]:       <nova:owner>
Nov 06 15:53:38 user nova-compute[75337]:         <nova:user uuid="8c795ee993a944ff89ed544450b90dc2">tempest-TestMinimumBasicScenario-2098539193-project-member</nova:user>
Nov 06 15:53:38 user nova-compute[75337]:         <nova:project uuid="2cddccc86bf54fe981667da5ef13fa8a">tempest-TestMinimumBasicScenario-2098539193</nova:project>
Nov 06 15:53:38 user nova-compute[75337]:       </nova:owner>
Nov 06 15:53:38 user nova-compute[75337]:       <nova:root type="image" uuid="b2bd209c-1854-4296-878e-12b97860cf7e"/>
Nov 06 15:53:38 user nova-compute[75337]:       <nova:ports>
Nov 06 15:53:38 user nova-compute[75337]:         <nova:port uuid="f9232e10-c7da-42d1-91c6-d72b0a1e0ccb">
Nov 06 15:53:38 user nova-compute[75337]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 06 15:53:38 user nova-compute[75337]:         </nova:port>
Nov 06 15:53:38 user nova-compute[75337]:       </nova:ports>
Nov 06 15:53:38 user nova-compute[75337]:     </nova:instance>
Nov 06 15:53:38 user nova-compute[75337]:   </metadata>
Nov 06 15:53:38 user nova-compute[75337]:   <sysinfo type="smbios">
Nov 06 15:53:38 user nova-compute[75337]:     <system>
Nov 06 15:53:38 user nova-compute[75337]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 15:53:38 user nova-compute[75337]:       <entry name="product">OpenStack Nova</entry>
Nov 06 15:53:38 user nova-compute[75337]:       <entry name="version">0.0.0</entry>
Nov 06 15:53:38 user nova-compute[75337]:       <entry name="serial">d10b4a86-8b0d-423f-81e2-87f5f25a2467</entry>
Nov 06 15:53:38 user nova-compute[75337]:       <entry name="uuid">d10b4a86-8b0d-423f-81e2-87f5f25a2467</entry>
Nov 06 15:53:38 user nova-compute[75337]:       <entry name="family">Virtual Machine</entry>
Nov 06 15:53:38 user nova-compute[75337]:     </system>
Nov 06 15:53:38 user nova-compute[75337]:   </sysinfo>
Nov 06 15:53:38 user nova-compute[75337]:   <os>
Nov 06 15:53:38 user nova-compute[75337]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 15:53:38 user nova-compute[75337]:     <boot dev="hd"/>
Nov 06 15:53:38 user nova-compute[75337]:     <smbios mode="sysinfo"/>
Nov 06 15:53:38 user nova-compute[75337]:   </os>
Nov 06 15:53:38 user nova-compute[75337]:   <features>
Nov 06 15:53:38 user nova-compute[75337]:     <acpi/>
Nov 06 15:53:38 user nova-compute[75337]:     <apic/>
Nov 06 15:53:38 user nova-compute[75337]:     <vmcoreinfo/>
Nov 06 15:53:38 user nova-compute[75337]:   </features>
Nov 06 15:53:38 user nova-compute[75337]:   <clock offset="utc">
Nov 06 15:53:38 user nova-compute[75337]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 15:53:38 user nova-compute[75337]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 15:53:38 user nova-compute[75337]:     <timer name="hpet" present="no"/>
Nov 06 15:53:38 user nova-compute[75337]:   </clock>
Nov 06 15:53:38 user nova-compute[75337]:   <cpu mode="custom" match="exact">
Nov 06 15:53:38 user nova-compute[75337]:     <model>Nehalem</model>
Nov 06 15:53:38 user nova-compute[75337]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 15:53:38 user nova-compute[75337]:   </cpu>
Nov 06 15:53:38 user nova-compute[75337]:   <devices>
Nov 06 15:53:38 user nova-compute[75337]:     <disk type="file" device="disk">
Nov 06 15:53:38 user nova-compute[75337]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 15:53:38 user nova-compute[75337]:       <source file="/opt/stack/data/nova/instances/d10b4a86-8b0d-423f-81e2-87f5f25a2467/disk"/>
Nov 06 15:53:38 user nova-compute[75337]:       <target dev="vda" bus="virtio"/>
Nov 06 15:53:38 user nova-compute[75337]:     </disk>
Nov 06 15:53:38 user nova-compute[75337]:     <interface type="ethernet">
Nov 06 15:53:38 user nova-compute[75337]:       <mac address="fa:16:3e:93:ab:63"/>
Nov 06 15:53:38 user nova-compute[75337]:       <model type="virtio"/>
Nov 06 15:53:38 user nova-compute[75337]:       <mtu size="1442"/>
Nov 06 15:53:38 user nova-compute[75337]:       <target dev="tapf9232e10-c7"/>
Nov 06 15:53:38 user nova-compute[75337]:     </interface>
Nov 06 15:53:38 user nova-compute[75337]:     <serial type="pty">
Nov 06 15:53:38 user nova-compute[75337]:       <log file="/opt/stack/data/nova/instances/d10b4a86-8b0d-423f-81e2-87f5f25a2467/console.log" append="off"/>
Nov 06 15:53:38 user nova-compute[75337]:     </serial>
Nov 06 15:53:38 user nova-compute[75337]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 15:53:38 user nova-compute[75337]:     <video>
Nov 06 15:53:38 user nova-compute[75337]:       <model type="virtio"/>
Nov 06 15:53:38 user nova-compute[75337]:     </video>
Nov 06 15:53:38 user nova-compute[75337]:     <rng model="virtio">
Nov 06 15:53:38 user nova-compute[75337]:       <backend model="random">/dev/urandom</backend>
Nov 06 15:53:38 user nova-compute[75337]:     </rng>
Nov 06 15:53:38 user nova-compute[75337]:     <controller type="usb" index="0" model="none"/>
Nov 06 15:53:38 user nova-compute[75337]:     <memballoon model="virtio">
Nov 06 15:53:38 user nova-compute[75337]:       <stats period="10"/>
Nov 06 15:53:38 user nova-compute[75337]:     </memballoon>
Nov 06 15:53:38 user nova-compute[75337]:   </devices>
Nov 06 15:53:38 user nova-compute[75337]: </domain>
Nov 06 15:53:38 user nova-compute[75337]:  {{(pid=75337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 15:53:38 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-83fcdd44-f024-4b3f-95c1-aed5d3721c67 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T15:53:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1428152347',display_name='tempest-TestMinimumBasicScenario-server-1428152347',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1428152347',id=30,image_ref='b2bd209c-1854-4296-878e-12b97860cf7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLeGZ0NNG8iDmqfRwynCeGkLkdivVOJUUT+8v5Pk7Ie2vaf+Y7xHcOuUhIU5MfzY1f4/p36cRXZITF1qZCli35Xyvr76yXg1+/gHPr8L3c8kcgm5E40YfNtApHH749OmRA==',key_name='tempest-TestMinimumBasicScenario-1095476101',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2cddccc86bf54fe981667da5ef13fa8a',ramdisk_id='',reservation_id='r-ecwh0mw2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b2bd209c-1854-4296-878e-12b97860cf7e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-2098539193',owner_user_name='tempest-TestMinimumBasicScenario-2098539193-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T15:53:36Z,user_data=None,user_id='8c795ee993a944ff89ed544450b90dc2',uuid=d10b4a86-8b0d-423f-81e2-87f5f25a2467,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f9232e10-c7da-42d1-91c6-d72b0a1e0ccb", "address": "fa:16:3e:93:ab:63", "network": {"id": "c31b513a-57f0-4bd5-b055-4a363aae9793", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1352256985-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cddccc86bf54fe981667da5ef13fa8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9232e10-c7", "ovs_interfaceid": "f9232e10-c7da-42d1-91c6-d72b0a1e0ccb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 15:53:38 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-83fcdd44-f024-4b3f-95c1-aed5d3721c67 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Converting VIF {"id": "f9232e10-c7da-42d1-91c6-d72b0a1e0ccb", "address": "fa:16:3e:93:ab:63", "network": {"id": "c31b513a-57f0-4bd5-b055-4a363aae9793", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1352256985-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cddccc86bf54fe981667da5ef13fa8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9232e10-c7", "ovs_interfaceid": "f9232e10-c7da-42d1-91c6-d72b0a1e0ccb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 15:53:38 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-83fcdd44-f024-4b3f-95c1-aed5d3721c67 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:ab:63,bridge_name='br-int',has_traffic_filtering=True,id=f9232e10-c7da-42d1-91c6-d72b0a1e0ccb,network=Network(c31b513a-57f0-4bd5-b055-4a363aae9793),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9232e10-c7') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 15:53:38 user nova-compute[75337]: DEBUG os_vif [None req-83fcdd44-f024-4b3f-95c1-aed5d3721c67 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:ab:63,bridge_name='br-int',has_traffic_filtering=True,id=f9232e10-c7da-42d1-91c6-d72b0a1e0ccb,network=Network(c31b513a-57f0-4bd5-b055-4a363aae9793),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9232e10-c7') {{(pid=75337) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 15:53:38 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:53:38 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:53:38 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 15:53:38 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:53:38 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c73927f7-d4a0-5ffe-905f-8427238e9172', '_type': 'linux-noop'}}, row=False) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:53:38 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:53:38 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:53:38 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:53:38 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf9232e10-c7, may_exist=True, interface_attrs={}) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:53:38 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf9232e10-c7, col_values=(('qos', UUID('c743ab7e-a8d3-4340-a1b1-989b909a9405')),), if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:53:38 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf9232e10-c7, col_values=(('external_ids', {'iface-id': 'f9232e10-c7da-42d1-91c6-d72b0a1e0ccb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:93:ab:63', 'vm-uuid': 'd10b4a86-8b0d-423f-81e2-87f5f25a2467'}),), if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:53:38 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:53:38 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:53:38 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:53:38 user nova-compute[75337]: INFO os_vif [None req-83fcdd44-f024-4b3f-95c1-aed5d3721c67 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:ab:63,bridge_name='br-int',has_traffic_filtering=True,id=f9232e10-c7da-42d1-91c6-d72b0a1e0ccb,network=Network(c31b513a-57f0-4bd5-b055-4a363aae9793),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9232e10-c7')
Nov 06 15:53:38 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-83fcdd44-f024-4b3f-95c1-aed5d3721c67 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] No BDM found with device name vda, not building metadata. {{(pid=75337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 15:53:38 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-83fcdd44-f024-4b3f-95c1-aed5d3721c67 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] No VIF found with MAC fa:16:3e:93:ab:63, not building metadata {{(pid=75337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 15:53:38 user nova-compute[75337]: DEBUG nova.network.neutron [req-22791dd4-4724-4346-9a02-8d5a8a9677b0 req-b31cdde0-aaa5-4eeb-a847-e5b7cc4b2156 service nova] [instance: d10b4a86-8b0d-423f-81e2-87f5f25a2467] Updated VIF entry in instance network info cache for port f9232e10-c7da-42d1-91c6-d72b0a1e0ccb. {{(pid=75337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 15:53:38 user nova-compute[75337]: DEBUG nova.network.neutron [req-22791dd4-4724-4346-9a02-8d5a8a9677b0 req-b31cdde0-aaa5-4eeb-a847-e5b7cc4b2156 service nova] [instance: d10b4a86-8b0d-423f-81e2-87f5f25a2467] Updating instance_info_cache with network_info: [{"id": "f9232e10-c7da-42d1-91c6-d72b0a1e0ccb", "address": "fa:16:3e:93:ab:63", "network": {"id": "c31b513a-57f0-4bd5-b055-4a363aae9793", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1352256985-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cddccc86bf54fe981667da5ef13fa8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9232e10-c7", "ovs_interfaceid": "f9232e10-c7da-42d1-91c6-d72b0a1e0ccb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:53:38 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-22791dd4-4724-4346-9a02-8d5a8a9677b0 req-b31cdde0-aaa5-4eeb-a847-e5b7cc4b2156 service nova] Releasing lock "refresh_cache-d10b4a86-8b0d-423f-81e2-87f5f25a2467" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 15:53:39 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:53:39 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:53:39 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:53:39 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:53:39 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:53:39 user nova-compute[75337]: DEBUG nova.compute.manager [req-11bc327a-1d6f-4851-bc65-0d4275c8359f req-d9fe4dcb-4431-4c74-8adc-a7f63d156572 service nova] [instance: d10b4a86-8b0d-423f-81e2-87f5f25a2467] Received event network-vif-plugged-f9232e10-c7da-42d1-91c6-d72b0a1e0ccb {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:53:39 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-11bc327a-1d6f-4851-bc65-0d4275c8359f req-d9fe4dcb-4431-4c74-8adc-a7f63d156572 service nova] Acquiring lock "d10b4a86-8b0d-423f-81e2-87f5f25a2467-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:53:39 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-11bc327a-1d6f-4851-bc65-0d4275c8359f req-d9fe4dcb-4431-4c74-8adc-a7f63d156572 service nova] Lock "d10b4a86-8b0d-423f-81e2-87f5f25a2467-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:53:39 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-11bc327a-1d6f-4851-bc65-0d4275c8359f req-d9fe4dcb-4431-4c74-8adc-a7f63d156572 service nova] Lock "d10b4a86-8b0d-423f-81e2-87f5f25a2467-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:53:39 user nova-compute[75337]: DEBUG nova.compute.manager [req-11bc327a-1d6f-4851-bc65-0d4275c8359f req-d9fe4dcb-4431-4c74-8adc-a7f63d156572 service nova] [instance: d10b4a86-8b0d-423f-81e2-87f5f25a2467] No waiting events found dispatching network-vif-plugged-f9232e10-c7da-42d1-91c6-d72b0a1e0ccb {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:53:39 user nova-compute[75337]: WARNING nova.compute.manager [req-11bc327a-1d6f-4851-bc65-0d4275c8359f req-d9fe4dcb-4431-4c74-8adc-a7f63d156572 service nova] [instance: d10b4a86-8b0d-423f-81e2-87f5f25a2467] Received unexpected event network-vif-plugged-f9232e10-c7da-42d1-91c6-d72b0a1e0ccb for instance with vm_state building and task_state spawning.
Nov 06 15:53:40 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:53:40 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:53:40 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:53:40 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:53:40 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:53:41 user nova-compute[75337]: DEBUG nova.compute.manager [None req-83fcdd44-f024-4b3f-95c1-aed5d3721c67 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] [instance: d10b4a86-8b0d-423f-81e2-87f5f25a2467] Instance event wait completed in 0 seconds for  {{(pid=75337) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 15:53:41 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-83fcdd44-f024-4b3f-95c1-aed5d3721c67 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] [instance: d10b4a86-8b0d-423f-81e2-87f5f25a2467] Guest created on hypervisor {{(pid=75337) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 15:53:41 user nova-compute[75337]: INFO nova.virt.libvirt.driver [-] [instance: d10b4a86-8b0d-423f-81e2-87f5f25a2467] Instance spawned successfully.
Nov 06 15:53:41 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-83fcdd44-f024-4b3f-95c1-aed5d3721c67 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] [instance: d10b4a86-8b0d-423f-81e2-87f5f25a2467] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 15:53:41 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-83fcdd44-f024-4b3f-95c1-aed5d3721c67 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] [instance: d10b4a86-8b0d-423f-81e2-87f5f25a2467] Found default for hw_cdrom_bus of ide {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:53:41 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-83fcdd44-f024-4b3f-95c1-aed5d3721c67 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] [instance: d10b4a86-8b0d-423f-81e2-87f5f25a2467] Found default for hw_disk_bus of virtio {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:53:41 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-83fcdd44-f024-4b3f-95c1-aed5d3721c67 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] [instance: d10b4a86-8b0d-423f-81e2-87f5f25a2467] Found default for hw_input_bus of None {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:53:41 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-83fcdd44-f024-4b3f-95c1-aed5d3721c67 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] [instance: d10b4a86-8b0d-423f-81e2-87f5f25a2467] Found default for hw_pointer_model of None {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:53:41 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-83fcdd44-f024-4b3f-95c1-aed5d3721c67 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] [instance: d10b4a86-8b0d-423f-81e2-87f5f25a2467] Found default for hw_video_model of virtio {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:53:41 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-83fcdd44-f024-4b3f-95c1-aed5d3721c67 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] [instance: d10b4a86-8b0d-423f-81e2-87f5f25a2467] Found default for hw_vif_model of virtio {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:53:41 user nova-compute[75337]: INFO nova.compute.manager [None req-83fcdd44-f024-4b3f-95c1-aed5d3721c67 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] [instance: d10b4a86-8b0d-423f-81e2-87f5f25a2467] Took 5.80 seconds to spawn the instance on the hypervisor.
Nov 06 15:53:41 user nova-compute[75337]: DEBUG nova.compute.manager [None req-83fcdd44-f024-4b3f-95c1-aed5d3721c67 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] [instance: d10b4a86-8b0d-423f-81e2-87f5f25a2467] Checking state {{(pid=75337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 15:53:41 user nova-compute[75337]: INFO nova.compute.manager [None req-83fcdd44-f024-4b3f-95c1-aed5d3721c67 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] [instance: d10b4a86-8b0d-423f-81e2-87f5f25a2467] Took 6.48 seconds to build instance.
Nov 06 15:53:41 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-83fcdd44-f024-4b3f-95c1-aed5d3721c67 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Lock "d10b4a86-8b0d-423f-81e2-87f5f25a2467" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.573s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:53:41 user nova-compute[75337]: DEBUG nova.compute.manager [req-022c3a12-b454-4614-9957-cdc2037dcb0c req-6b295d5a-c85a-4c6e-86a4-3b1971aeb727 service nova] [instance: d10b4a86-8b0d-423f-81e2-87f5f25a2467] Received event network-vif-plugged-f9232e10-c7da-42d1-91c6-d72b0a1e0ccb {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:53:41 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-022c3a12-b454-4614-9957-cdc2037dcb0c req-6b295d5a-c85a-4c6e-86a4-3b1971aeb727 service nova] Acquiring lock "d10b4a86-8b0d-423f-81e2-87f5f25a2467-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:53:41 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-022c3a12-b454-4614-9957-cdc2037dcb0c req-6b295d5a-c85a-4c6e-86a4-3b1971aeb727 service nova] Lock "d10b4a86-8b0d-423f-81e2-87f5f25a2467-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:53:41 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-022c3a12-b454-4614-9957-cdc2037dcb0c req-6b295d5a-c85a-4c6e-86a4-3b1971aeb727 service nova] Lock "d10b4a86-8b0d-423f-81e2-87f5f25a2467-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:53:41 user nova-compute[75337]: DEBUG nova.compute.manager [req-022c3a12-b454-4614-9957-cdc2037dcb0c req-6b295d5a-c85a-4c6e-86a4-3b1971aeb727 service nova] [instance: d10b4a86-8b0d-423f-81e2-87f5f25a2467] No waiting events found dispatching network-vif-plugged-f9232e10-c7da-42d1-91c6-d72b0a1e0ccb {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:53:41 user nova-compute[75337]: WARNING nova.compute.manager [req-022c3a12-b454-4614-9957-cdc2037dcb0c req-6b295d5a-c85a-4c6e-86a4-3b1971aeb727 service nova] [instance: d10b4a86-8b0d-423f-81e2-87f5f25a2467] Received unexpected event network-vif-plugged-f9232e10-c7da-42d1-91c6-d72b0a1e0ccb for instance with vm_state active and task_state None.
Nov 06 15:53:43 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:53:43 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-c42b1d6b-23b6-4221-abf3-bf6b9dd5dfa4 tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] Acquiring lock "453c580f-6028-4ea9-87fc-66f3834f0bee" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:53:43 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-c42b1d6b-23b6-4221-abf3-bf6b9dd5dfa4 tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] Lock "453c580f-6028-4ea9-87fc-66f3834f0bee" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:53:43 user nova-compute[75337]: DEBUG nova.compute.manager [None req-c42b1d6b-23b6-4221-abf3-bf6b9dd5dfa4 tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] [instance: 453c580f-6028-4ea9-87fc-66f3834f0bee] Starting instance... {{(pid=75337) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 15:53:43 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-c42b1d6b-23b6-4221-abf3-bf6b9dd5dfa4 tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:53:43 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-c42b1d6b-23b6-4221-abf3-bf6b9dd5dfa4 tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:53:43 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-c42b1d6b-23b6-4221-abf3-bf6b9dd5dfa4 tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75337) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 15:53:43 user nova-compute[75337]: INFO nova.compute.claims [None req-c42b1d6b-23b6-4221-abf3-bf6b9dd5dfa4 tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] [instance: 453c580f-6028-4ea9-87fc-66f3834f0bee] Claim successful on node user
Nov 06 15:53:43 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-c42b1d6b-23b6-4221-abf3-bf6b9dd5dfa4 tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 15:53:43 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-c42b1d6b-23b6-4221-abf3-bf6b9dd5dfa4 tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 15:53:43 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-c42b1d6b-23b6-4221-abf3-bf6b9dd5dfa4 tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.371s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:53:43 user nova-compute[75337]: DEBUG nova.compute.manager [None req-c42b1d6b-23b6-4221-abf3-bf6b9dd5dfa4 tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] [instance: 453c580f-6028-4ea9-87fc-66f3834f0bee] Start building networks asynchronously for instance. {{(pid=75337) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 15:53:43 user nova-compute[75337]: DEBUG nova.compute.manager [None req-c42b1d6b-23b6-4221-abf3-bf6b9dd5dfa4 tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] [instance: 453c580f-6028-4ea9-87fc-66f3834f0bee] Allocating IP information in the background. {{(pid=75337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 15:53:43 user nova-compute[75337]: DEBUG nova.network.neutron [None req-c42b1d6b-23b6-4221-abf3-bf6b9dd5dfa4 tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] [instance: 453c580f-6028-4ea9-87fc-66f3834f0bee] allocate_for_instance() {{(pid=75337) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 15:53:43 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-c42b1d6b-23b6-4221-abf3-bf6b9dd5dfa4 tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] [instance: 453c580f-6028-4ea9-87fc-66f3834f0bee] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 15:53:43 user nova-compute[75337]: DEBUG nova.compute.manager [None req-c42b1d6b-23b6-4221-abf3-bf6b9dd5dfa4 tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] [instance: 453c580f-6028-4ea9-87fc-66f3834f0bee] Start building block device mappings for instance. {{(pid=75337) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 15:53:44 user nova-compute[75337]: DEBUG nova.policy [None req-c42b1d6b-23b6-4221-abf3-bf6b9dd5dfa4 tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5691e9e1923f4f2e9fdd3a39d8d7ff20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e13dfd402b7b4ed1a1092c7388ff5188', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75337) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 15:53:44 user nova-compute[75337]: DEBUG nova.compute.manager [None req-c42b1d6b-23b6-4221-abf3-bf6b9dd5dfa4 tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] [instance: 453c580f-6028-4ea9-87fc-66f3834f0bee] Start spawning the instance on the hypervisor. {{(pid=75337) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 15:53:44 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-c42b1d6b-23b6-4221-abf3-bf6b9dd5dfa4 tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] [instance: 453c580f-6028-4ea9-87fc-66f3834f0bee] Creating instance directory {{(pid=75337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 15:53:44 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-c42b1d6b-23b6-4221-abf3-bf6b9dd5dfa4 tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] [instance: 453c580f-6028-4ea9-87fc-66f3834f0bee] Creating image(s)
Nov 06 15:53:44 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-c42b1d6b-23b6-4221-abf3-bf6b9dd5dfa4 tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] Acquiring lock "/opt/stack/data/nova/instances/453c580f-6028-4ea9-87fc-66f3834f0bee/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:53:44 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-c42b1d6b-23b6-4221-abf3-bf6b9dd5dfa4 tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] Lock "/opt/stack/data/nova/instances/453c580f-6028-4ea9-87fc-66f3834f0bee/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:53:44 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-c42b1d6b-23b6-4221-abf3-bf6b9dd5dfa4 tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] Lock "/opt/stack/data/nova/instances/453c580f-6028-4ea9-87fc-66f3834f0bee/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:53:44 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-c42b1d6b-23b6-4221-abf3-bf6b9dd5dfa4 tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:53:44 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:53:44 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-c42b1d6b-23b6-4221-abf3-bf6b9dd5dfa4 tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json" returned: 0 in 0.258s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:53:44 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-c42b1d6b-23b6-4221-abf3-bf6b9dd5dfa4 tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] Acquiring lock "06ba3c914798499e686c5ac75886932347225275" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:53:44 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-c42b1d6b-23b6-4221-abf3-bf6b9dd5dfa4 tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] Lock "06ba3c914798499e686c5ac75886932347225275" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:53:44 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-c42b1d6b-23b6-4221-abf3-bf6b9dd5dfa4 tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:53:44 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-c42b1d6b-23b6-4221-abf3-bf6b9dd5dfa4 tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json" returned: 0 in 0.238s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:53:44 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-c42b1d6b-23b6-4221-abf3-bf6b9dd5dfa4 tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275,backing_fmt=raw /opt/stack/data/nova/instances/453c580f-6028-4ea9-87fc-66f3834f0bee/disk 1073741824 {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:53:44 user nova-compute[75337]: DEBUG nova.network.neutron [None req-c42b1d6b-23b6-4221-abf3-bf6b9dd5dfa4 tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] [instance: 453c580f-6028-4ea9-87fc-66f3834f0bee] Successfully created port: c8b8e3bc-c60d-4481-845f-97bfc6e8592d {{(pid=75337) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 15:53:44 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-c42b1d6b-23b6-4221-abf3-bf6b9dd5dfa4 tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275,backing_fmt=raw /opt/stack/data/nova/instances/453c580f-6028-4ea9-87fc-66f3834f0bee/disk 1073741824" returned: 0 in 0.074s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:53:44 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-c42b1d6b-23b6-4221-abf3-bf6b9dd5dfa4 tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] Lock "06ba3c914798499e686c5ac75886932347225275" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.320s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:53:44 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-c42b1d6b-23b6-4221-abf3-bf6b9dd5dfa4 tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:53:44 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-c42b1d6b-23b6-4221-abf3-bf6b9dd5dfa4 tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json" returned: 0 in 0.212s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:53:44 user nova-compute[75337]: DEBUG nova.virt.disk.api [None req-c42b1d6b-23b6-4221-abf3-bf6b9dd5dfa4 tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] Checking if we can resize image /opt/stack/data/nova/instances/453c580f-6028-4ea9-87fc-66f3834f0bee/disk. size=1073741824 {{(pid=75337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 15:53:44 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-c42b1d6b-23b6-4221-abf3-bf6b9dd5dfa4 tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/453c580f-6028-4ea9-87fc-66f3834f0bee/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:53:45 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-c42b1d6b-23b6-4221-abf3-bf6b9dd5dfa4 tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/453c580f-6028-4ea9-87fc-66f3834f0bee/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:53:45 user nova-compute[75337]: DEBUG nova.virt.disk.api [None req-c42b1d6b-23b6-4221-abf3-bf6b9dd5dfa4 tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] Cannot resize image /opt/stack/data/nova/instances/453c580f-6028-4ea9-87fc-66f3834f0bee/disk to a smaller size. {{(pid=75337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 06 15:53:45 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-c42b1d6b-23b6-4221-abf3-bf6b9dd5dfa4 tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] [instance: 453c580f-6028-4ea9-87fc-66f3834f0bee] Created local disks {{(pid=75337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 15:53:45 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-c42b1d6b-23b6-4221-abf3-bf6b9dd5dfa4 tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] [instance: 453c580f-6028-4ea9-87fc-66f3834f0bee] Ensure instance console log exists: /opt/stack/data/nova/instances/453c580f-6028-4ea9-87fc-66f3834f0bee/console.log {{(pid=75337) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 15:53:45 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-c42b1d6b-23b6-4221-abf3-bf6b9dd5dfa4 tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:53:45 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-c42b1d6b-23b6-4221-abf3-bf6b9dd5dfa4 tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:53:45 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-c42b1d6b-23b6-4221-abf3-bf6b9dd5dfa4 tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:53:45 user nova-compute[75337]: DEBUG nova.network.neutron [None req-c42b1d6b-23b6-4221-abf3-bf6b9dd5dfa4 tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] [instance: 453c580f-6028-4ea9-87fc-66f3834f0bee] Successfully updated port: c8b8e3bc-c60d-4481-845f-97bfc6e8592d {{(pid=75337) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 15:53:45 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-c42b1d6b-23b6-4221-abf3-bf6b9dd5dfa4 tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] Acquiring lock "refresh_cache-453c580f-6028-4ea9-87fc-66f3834f0bee" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 15:53:45 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-c42b1d6b-23b6-4221-abf3-bf6b9dd5dfa4 tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] Acquired lock "refresh_cache-453c580f-6028-4ea9-87fc-66f3834f0bee" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 15:53:45 user nova-compute[75337]: DEBUG nova.network.neutron [None req-c42b1d6b-23b6-4221-abf3-bf6b9dd5dfa4 tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] [instance: 453c580f-6028-4ea9-87fc-66f3834f0bee] Building network info cache for instance {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 15:53:45 user nova-compute[75337]: DEBUG nova.compute.manager [req-10f8fb69-f9cc-4516-8632-66426eb4eb1f req-e3fd7f3e-ba32-4690-b13e-5749c216f9ea service nova] [instance: 453c580f-6028-4ea9-87fc-66f3834f0bee] Received event network-changed-c8b8e3bc-c60d-4481-845f-97bfc6e8592d {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:53:45 user nova-compute[75337]: DEBUG nova.compute.manager [req-10f8fb69-f9cc-4516-8632-66426eb4eb1f req-e3fd7f3e-ba32-4690-b13e-5749c216f9ea service nova] [instance: 453c580f-6028-4ea9-87fc-66f3834f0bee] Refreshing instance network info cache due to event network-changed-c8b8e3bc-c60d-4481-845f-97bfc6e8592d. {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 15:53:45 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-10f8fb69-f9cc-4516-8632-66426eb4eb1f req-e3fd7f3e-ba32-4690-b13e-5749c216f9ea service nova] Acquiring lock "refresh_cache-453c580f-6028-4ea9-87fc-66f3834f0bee" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 15:53:45 user nova-compute[75337]: DEBUG nova.network.neutron [None req-c42b1d6b-23b6-4221-abf3-bf6b9dd5dfa4 tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] [instance: 453c580f-6028-4ea9-87fc-66f3834f0bee] Instance cache missing network info. {{(pid=75337) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 15:53:45 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-08f4d433-510e-40ed-b986-c98ff99365e6 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Acquiring lock "83516ff5-c4e7-4e91-a2f9-8af9b51cf475" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:53:45 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-08f4d433-510e-40ed-b986-c98ff99365e6 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Lock "83516ff5-c4e7-4e91-a2f9-8af9b51cf475" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:53:45 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-08f4d433-510e-40ed-b986-c98ff99365e6 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Acquiring lock "83516ff5-c4e7-4e91-a2f9-8af9b51cf475-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:53:45 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-08f4d433-510e-40ed-b986-c98ff99365e6 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Lock "83516ff5-c4e7-4e91-a2f9-8af9b51cf475-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:53:45 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-08f4d433-510e-40ed-b986-c98ff99365e6 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Lock "83516ff5-c4e7-4e91-a2f9-8af9b51cf475-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:53:45 user nova-compute[75337]: INFO nova.compute.manager [None req-08f4d433-510e-40ed-b986-c98ff99365e6 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: 83516ff5-c4e7-4e91-a2f9-8af9b51cf475] Terminating instance
Nov 06 15:53:45 user nova-compute[75337]: DEBUG nova.compute.manager [None req-08f4d433-510e-40ed-b986-c98ff99365e6 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: 83516ff5-c4e7-4e91-a2f9-8af9b51cf475] Start destroying the instance on the hypervisor. {{(pid=75337) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 15:53:45 user nova-compute[75337]: DEBUG nova.network.neutron [None req-c42b1d6b-23b6-4221-abf3-bf6b9dd5dfa4 tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] [instance: 453c580f-6028-4ea9-87fc-66f3834f0bee] Updating instance_info_cache with network_info: [{"id": "c8b8e3bc-c60d-4481-845f-97bfc6e8592d", "address": "fa:16:3e:c6:4d:4d", "network": {"id": "6757c3a5-4f6f-48a7-9645-af433fb039de", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1337373982-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e13dfd402b7b4ed1a1092c7388ff5188", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8b8e3bc-c6", "ovs_interfaceid": "c8b8e3bc-c60d-4481-845f-97bfc6e8592d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:53:45 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-c42b1d6b-23b6-4221-abf3-bf6b9dd5dfa4 tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] Releasing lock "refresh_cache-453c580f-6028-4ea9-87fc-66f3834f0bee" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 15:53:45 user nova-compute[75337]: DEBUG nova.compute.manager [None req-c42b1d6b-23b6-4221-abf3-bf6b9dd5dfa4 tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] [instance: 453c580f-6028-4ea9-87fc-66f3834f0bee] Instance network_info: |[{"id": "c8b8e3bc-c60d-4481-845f-97bfc6e8592d", "address": "fa:16:3e:c6:4d:4d", "network": {"id": "6757c3a5-4f6f-48a7-9645-af433fb039de", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1337373982-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e13dfd402b7b4ed1a1092c7388ff5188", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8b8e3bc-c6", "ovs_interfaceid": "c8b8e3bc-c60d-4481-845f-97bfc6e8592d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 15:53:45 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:53:45 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-10f8fb69-f9cc-4516-8632-66426eb4eb1f req-e3fd7f3e-ba32-4690-b13e-5749c216f9ea service nova] Acquired lock "refresh_cache-453c580f-6028-4ea9-87fc-66f3834f0bee" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 15:53:45 user nova-compute[75337]: DEBUG nova.network.neutron [req-10f8fb69-f9cc-4516-8632-66426eb4eb1f req-e3fd7f3e-ba32-4690-b13e-5749c216f9ea service nova] [instance: 453c580f-6028-4ea9-87fc-66f3834f0bee] Refreshing network info cache for port c8b8e3bc-c60d-4481-845f-97bfc6e8592d {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 15:53:45 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-c42b1d6b-23b6-4221-abf3-bf6b9dd5dfa4 tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] [instance: 453c580f-6028-4ea9-87fc-66f3834f0bee] Start _get_guest_xml network_info=[{"id": "c8b8e3bc-c60d-4481-845f-97bfc6e8592d", "address": "fa:16:3e:c6:4d:4d", "network": {"id": "6757c3a5-4f6f-48a7-9645-af433fb039de", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1337373982-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e13dfd402b7b4ed1a1092c7388ff5188", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8b8e3bc-c6", "ovs_interfaceid": "c8b8e3bc-c60d-4481-845f-97bfc6e8592d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T15:34:14Z,direct_url=<?>,disk_format='qcow2',id=16b903ae-a40f-41a7-985b-4804cce92c62,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6549a15819f1469bbd5eeae8190e3d44',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T15:34:15Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'guest_format': None, 'size': 0, 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '16b903ae-a40f-41a7-985b-4804cce92c62'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 15:53:45 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:53:45 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:53:45 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-c42b1d6b-23b6-4221-abf3-bf6b9dd5dfa4 tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 15:53:45 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-c42b1d6b-23b6-4221-abf3-bf6b9dd5dfa4 tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 15:53:45 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-c42b1d6b-23b6-4221-abf3-bf6b9dd5dfa4 tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 15:53:45 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-c42b1d6b-23b6-4221-abf3-bf6b9dd5dfa4 tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] CPU controller missing on host. {{(pid=75337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 15:53:45 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-c42b1d6b-23b6-4221-abf3-bf6b9dd5dfa4 tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 15:53:45 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-c42b1d6b-23b6-4221-abf3-bf6b9dd5dfa4 tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] CPU controller found on host. {{(pid=75337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 15:53:45 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-c42b1d6b-23b6-4221-abf3-bf6b9dd5dfa4 tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75337) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 15:53:45 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-c42b1d6b-23b6-4221-abf3-bf6b9dd5dfa4 tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T15:34:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T15:34:14Z,direct_url=<?>,disk_format='qcow2',id=16b903ae-a40f-41a7-985b-4804cce92c62,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6549a15819f1469bbd5eeae8190e3d44',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T15:34:15Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 15:53:45 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-c42b1d6b-23b6-4221-abf3-bf6b9dd5dfa4 tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] Flavor limits 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 15:53:45 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-c42b1d6b-23b6-4221-abf3-bf6b9dd5dfa4 tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] Image limits 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 15:53:45 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-c42b1d6b-23b6-4221-abf3-bf6b9dd5dfa4 tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] Flavor pref 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 15:53:45 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-c42b1d6b-23b6-4221-abf3-bf6b9dd5dfa4 tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] Image pref 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 15:53:45 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-c42b1d6b-23b6-4221-abf3-bf6b9dd5dfa4 tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 15:53:45 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-c42b1d6b-23b6-4221-abf3-bf6b9dd5dfa4 tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 15:53:45 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-c42b1d6b-23b6-4221-abf3-bf6b9dd5dfa4 tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 15:53:45 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-c42b1d6b-23b6-4221-abf3-bf6b9dd5dfa4 tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] Got 1 possible topologies {{(pid=75337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 15:53:45 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-c42b1d6b-23b6-4221-abf3-bf6b9dd5dfa4 tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 15:53:45 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-c42b1d6b-23b6-4221-abf3-bf6b9dd5dfa4 tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 15:53:46 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-c42b1d6b-23b6-4221-abf3-bf6b9dd5dfa4 tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T15:53:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1284458469',display_name='tempest-ServersNegativeTestJSON-server-1284458469',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1284458469',id=31,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e13dfd402b7b4ed1a1092c7388ff5188',ramdisk_id='',reservation_id='r-3dwgi04v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-624109021',owner_user_name='tempest-ServersNegativeTestJSON-624109021-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T15:53:44Z,user_data=None,user_id='5691e9e1923f4f2e9fdd3a39d8d7ff20',uuid=453c580f-6028-4ea9-87fc-66f3834f0bee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c8b8e3bc-c60d-4481-845f-97bfc6e8592d", "address": "fa:16:3e:c6:4d:4d", "network": {"id": "6757c3a5-4f6f-48a7-9645-af433fb039de", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1337373982-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e13dfd402b7b4ed1a1092c7388ff5188", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8b8e3bc-c6", "ovs_interfaceid": "c8b8e3bc-c60d-4481-845f-97bfc6e8592d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75337) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 15:53:46 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-c42b1d6b-23b6-4221-abf3-bf6b9dd5dfa4 tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] Converting VIF {"id": "c8b8e3bc-c60d-4481-845f-97bfc6e8592d", "address": "fa:16:3e:c6:4d:4d", "network": {"id": "6757c3a5-4f6f-48a7-9645-af433fb039de", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1337373982-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e13dfd402b7b4ed1a1092c7388ff5188", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8b8e3bc-c6", "ovs_interfaceid": "c8b8e3bc-c60d-4481-845f-97bfc6e8592d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 15:53:46 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-c42b1d6b-23b6-4221-abf3-bf6b9dd5dfa4 tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:4d:4d,bridge_name='br-int',has_traffic_filtering=True,id=c8b8e3bc-c60d-4481-845f-97bfc6e8592d,network=Network(6757c3a5-4f6f-48a7-9645-af433fb039de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8b8e3bc-c6') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 15:53:46 user nova-compute[75337]: DEBUG nova.objects.instance [None req-c42b1d6b-23b6-4221-abf3-bf6b9dd5dfa4 tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] Lazy-loading 'pci_devices' on Instance uuid 453c580f-6028-4ea9-87fc-66f3834f0bee {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 15:53:46 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:53:46 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-c42b1d6b-23b6-4221-abf3-bf6b9dd5dfa4 tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] [instance: 453c580f-6028-4ea9-87fc-66f3834f0bee] End _get_guest_xml xml=<domain type="kvm">
Nov 06 15:53:46 user nova-compute[75337]:   <uuid>453c580f-6028-4ea9-87fc-66f3834f0bee</uuid>
Nov 06 15:53:46 user nova-compute[75337]:   <name>instance-0000001f</name>
Nov 06 15:53:46 user nova-compute[75337]:   <memory>524288</memory>
Nov 06 15:53:46 user nova-compute[75337]:   <vcpu>1</vcpu>
Nov 06 15:53:46 user nova-compute[75337]:   <metadata>
Nov 06 15:53:46 user nova-compute[75337]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 15:53:46 user nova-compute[75337]:       <nova:package version="0.0.0"/>
Nov 06 15:53:46 user nova-compute[75337]:       <nova:name>tempest-ServersNegativeTestJSON-server-1284458469</nova:name>
Nov 06 15:53:46 user nova-compute[75337]:       <nova:creationTime>2023-11-06 15:53:45</nova:creationTime>
Nov 06 15:53:46 user nova-compute[75337]:       <nova:flavor name="m1.tiny">
Nov 06 15:53:46 user nova-compute[75337]:         <nova:memory>512</nova:memory>
Nov 06 15:53:46 user nova-compute[75337]:         <nova:disk>1</nova:disk>
Nov 06 15:53:46 user nova-compute[75337]:         <nova:swap>0</nova:swap>
Nov 06 15:53:46 user nova-compute[75337]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 15:53:46 user nova-compute[75337]:         <nova:vcpus>1</nova:vcpus>
Nov 06 15:53:46 user nova-compute[75337]:       </nova:flavor>
Nov 06 15:53:46 user nova-compute[75337]:       <nova:owner>
Nov 06 15:53:46 user nova-compute[75337]:         <nova:user uuid="5691e9e1923f4f2e9fdd3a39d8d7ff20">tempest-ServersNegativeTestJSON-624109021-project-member</nova:user>
Nov 06 15:53:46 user nova-compute[75337]:         <nova:project uuid="e13dfd402b7b4ed1a1092c7388ff5188">tempest-ServersNegativeTestJSON-624109021</nova:project>
Nov 06 15:53:46 user nova-compute[75337]:       </nova:owner>
Nov 06 15:53:46 user nova-compute[75337]:       <nova:root type="image" uuid="16b903ae-a40f-41a7-985b-4804cce92c62"/>
Nov 06 15:53:46 user nova-compute[75337]:       <nova:ports>
Nov 06 15:53:46 user nova-compute[75337]:         <nova:port uuid="c8b8e3bc-c60d-4481-845f-97bfc6e8592d">
Nov 06 15:53:46 user nova-compute[75337]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 06 15:53:46 user nova-compute[75337]:         </nova:port>
Nov 06 15:53:46 user nova-compute[75337]:       </nova:ports>
Nov 06 15:53:46 user nova-compute[75337]:     </nova:instance>
Nov 06 15:53:46 user nova-compute[75337]:   </metadata>
Nov 06 15:53:46 user nova-compute[75337]:   <sysinfo type="smbios">
Nov 06 15:53:46 user nova-compute[75337]:     <system>
Nov 06 15:53:46 user nova-compute[75337]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 15:53:46 user nova-compute[75337]:       <entry name="product">OpenStack Nova</entry>
Nov 06 15:53:46 user nova-compute[75337]:       <entry name="version">0.0.0</entry>
Nov 06 15:53:46 user nova-compute[75337]:       <entry name="serial">453c580f-6028-4ea9-87fc-66f3834f0bee</entry>
Nov 06 15:53:46 user nova-compute[75337]:       <entry name="uuid">453c580f-6028-4ea9-87fc-66f3834f0bee</entry>
Nov 06 15:53:46 user nova-compute[75337]:       <entry name="family">Virtual Machine</entry>
Nov 06 15:53:46 user nova-compute[75337]:     </system>
Nov 06 15:53:46 user nova-compute[75337]:   </sysinfo>
Nov 06 15:53:46 user nova-compute[75337]:   <os>
Nov 06 15:53:46 user nova-compute[75337]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 15:53:46 user nova-compute[75337]:     <boot dev="hd"/>
Nov 06 15:53:46 user nova-compute[75337]:     <smbios mode="sysinfo"/>
Nov 06 15:53:46 user nova-compute[75337]:   </os>
Nov 06 15:53:46 user nova-compute[75337]:   <features>
Nov 06 15:53:46 user nova-compute[75337]:     <acpi/>
Nov 06 15:53:46 user nova-compute[75337]:     <apic/>
Nov 06 15:53:46 user nova-compute[75337]:     <vmcoreinfo/>
Nov 06 15:53:46 user nova-compute[75337]:   </features>
Nov 06 15:53:46 user nova-compute[75337]:   <clock offset="utc">
Nov 06 15:53:46 user nova-compute[75337]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 15:53:46 user nova-compute[75337]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 15:53:46 user nova-compute[75337]:     <timer name="hpet" present="no"/>
Nov 06 15:53:46 user nova-compute[75337]:   </clock>
Nov 06 15:53:46 user nova-compute[75337]:   <cpu mode="custom" match="exact">
Nov 06 15:53:46 user nova-compute[75337]:     <model>Nehalem</model>
Nov 06 15:53:46 user nova-compute[75337]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 15:53:46 user nova-compute[75337]:   </cpu>
Nov 06 15:53:46 user nova-compute[75337]:   <devices>
Nov 06 15:53:46 user nova-compute[75337]:     <disk type="file" device="disk">
Nov 06 15:53:46 user nova-compute[75337]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 15:53:46 user nova-compute[75337]:       <source file="/opt/stack/data/nova/instances/453c580f-6028-4ea9-87fc-66f3834f0bee/disk"/>
Nov 06 15:53:46 user nova-compute[75337]:       <target dev="vda" bus="virtio"/>
Nov 06 15:53:46 user nova-compute[75337]:     </disk>
Nov 06 15:53:46 user nova-compute[75337]:     <interface type="ethernet">
Nov 06 15:53:46 user nova-compute[75337]:       <mac address="fa:16:3e:c6:4d:4d"/>
Nov 06 15:53:46 user nova-compute[75337]:       <model type="virtio"/>
Nov 06 15:53:46 user nova-compute[75337]:       <mtu size="1442"/>
Nov 06 15:53:46 user nova-compute[75337]:       <target dev="tapc8b8e3bc-c6"/>
Nov 06 15:53:46 user nova-compute[75337]:     </interface>
Nov 06 15:53:46 user nova-compute[75337]:     <serial type="pty">
Nov 06 15:53:46 user nova-compute[75337]:       <log file="/opt/stack/data/nova/instances/453c580f-6028-4ea9-87fc-66f3834f0bee/console.log" append="off"/>
Nov 06 15:53:46 user nova-compute[75337]:     </serial>
Nov 06 15:53:46 user nova-compute[75337]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 15:53:46 user nova-compute[75337]:     <video>
Nov 06 15:53:46 user nova-compute[75337]:       <model type="virtio"/>
Nov 06 15:53:46 user nova-compute[75337]:     </video>
Nov 06 15:53:46 user nova-compute[75337]:     <rng model="virtio">
Nov 06 15:53:46 user nova-compute[75337]:       <backend model="random">/dev/urandom</backend>
Nov 06 15:53:46 user nova-compute[75337]:     </rng>
Nov 06 15:53:46 user nova-compute[75337]:     <controller type="usb" index="0" model="none"/>
Nov 06 15:53:46 user nova-compute[75337]:     <memballoon model="virtio">
Nov 06 15:53:46 user nova-compute[75337]:       <stats period="10"/>
Nov 06 15:53:46 user nova-compute[75337]:     </memballoon>
Nov 06 15:53:46 user nova-compute[75337]:   </devices>
Nov 06 15:53:46 user nova-compute[75337]: </domain>
Nov 06 15:53:46 user nova-compute[75337]:  {{(pid=75337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 15:53:46 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-c42b1d6b-23b6-4221-abf3-bf6b9dd5dfa4 tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T15:53:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1284458469',display_name='tempest-ServersNegativeTestJSON-server-1284458469',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1284458469',id=31,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e13dfd402b7b4ed1a1092c7388ff5188',ramdisk_id='',reservation_id='r-3dwgi04v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-624109021',owner_user_name='tempest-ServersNegativeTestJSON-624109021-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T15:53:44Z,user_data=None,user_id='5691e9e1923f4f2e9fdd3a39d8d7ff20',uuid=453c580f-6028-4ea9-87fc-66f3834f0bee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c8b8e3bc-c60d-4481-845f-97bfc6e8592d", "address": "fa:16:3e:c6:4d:4d", "network": {"id": "6757c3a5-4f6f-48a7-9645-af433fb039de", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1337373982-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e13dfd402b7b4ed1a1092c7388ff5188", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8b8e3bc-c6", "ovs_interfaceid": "c8b8e3bc-c60d-4481-845f-97bfc6e8592d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 15:53:46 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-c42b1d6b-23b6-4221-abf3-bf6b9dd5dfa4 tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] Converting VIF {"id": "c8b8e3bc-c60d-4481-845f-97bfc6e8592d", "address": "fa:16:3e:c6:4d:4d", "network": {"id": "6757c3a5-4f6f-48a7-9645-af433fb039de", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1337373982-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e13dfd402b7b4ed1a1092c7388ff5188", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8b8e3bc-c6", "ovs_interfaceid": "c8b8e3bc-c60d-4481-845f-97bfc6e8592d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 15:53:46 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-c42b1d6b-23b6-4221-abf3-bf6b9dd5dfa4 tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:4d:4d,bridge_name='br-int',has_traffic_filtering=True,id=c8b8e3bc-c60d-4481-845f-97bfc6e8592d,network=Network(6757c3a5-4f6f-48a7-9645-af433fb039de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8b8e3bc-c6') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 15:53:46 user nova-compute[75337]: DEBUG os_vif [None req-c42b1d6b-23b6-4221-abf3-bf6b9dd5dfa4 tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:4d:4d,bridge_name='br-int',has_traffic_filtering=True,id=c8b8e3bc-c60d-4481-845f-97bfc6e8592d,network=Network(6757c3a5-4f6f-48a7-9645-af433fb039de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8b8e3bc-c6') {{(pid=75337) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 15:53:46 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:53:46 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:53:46 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 15:53:46 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:53:46 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7960c2bd-e1d6-5aad-b033-061df350b04f', '_type': 'linux-noop'}}, row=False) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:53:46 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:53:46 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:53:46 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:53:46 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:53:46 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc8b8e3bc-c6, may_exist=True, interface_attrs={}) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:53:46 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc8b8e3bc-c6, col_values=(('qos', UUID('f36d85e9-b2f8-4a6d-9b14-0efacd667b53')),), if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:53:46 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc8b8e3bc-c6, col_values=(('external_ids', {'iface-id': 'c8b8e3bc-c60d-4481-845f-97bfc6e8592d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c6:4d:4d', 'vm-uuid': '453c580f-6028-4ea9-87fc-66f3834f0bee'}),), if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:53:46 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:53:46 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:53:46 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:53:46 user nova-compute[75337]: INFO os_vif [None req-c42b1d6b-23b6-4221-abf3-bf6b9dd5dfa4 tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:4d:4d,bridge_name='br-int',has_traffic_filtering=True,id=c8b8e3bc-c60d-4481-845f-97bfc6e8592d,network=Network(6757c3a5-4f6f-48a7-9645-af433fb039de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8b8e3bc-c6')
Nov 06 15:53:46 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-c42b1d6b-23b6-4221-abf3-bf6b9dd5dfa4 tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] No BDM found with device name vda, not building metadata. {{(pid=75337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 15:53:46 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-c42b1d6b-23b6-4221-abf3-bf6b9dd5dfa4 tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] No VIF found with MAC fa:16:3e:c6:4d:4d, not building metadata {{(pid=75337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 15:53:46 user nova-compute[75337]: DEBUG nova.compute.manager [req-846b5f8c-332a-47ee-a587-eeb492801446 req-de5af10b-8980-4d55-bdd4-6bc12803a8f9 service nova] [instance: 83516ff5-c4e7-4e91-a2f9-8af9b51cf475] Received event network-vif-unplugged-452cb189-f59e-42e1-80e1-9eebb0c65bd7 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:53:46 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-846b5f8c-332a-47ee-a587-eeb492801446 req-de5af10b-8980-4d55-bdd4-6bc12803a8f9 service nova] Acquiring lock "83516ff5-c4e7-4e91-a2f9-8af9b51cf475-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:53:46 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-846b5f8c-332a-47ee-a587-eeb492801446 req-de5af10b-8980-4d55-bdd4-6bc12803a8f9 service nova] Lock "83516ff5-c4e7-4e91-a2f9-8af9b51cf475-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:53:46 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-846b5f8c-332a-47ee-a587-eeb492801446 req-de5af10b-8980-4d55-bdd4-6bc12803a8f9 service nova] Lock "83516ff5-c4e7-4e91-a2f9-8af9b51cf475-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:53:46 user nova-compute[75337]: DEBUG nova.compute.manager [req-846b5f8c-332a-47ee-a587-eeb492801446 req-de5af10b-8980-4d55-bdd4-6bc12803a8f9 service nova] [instance: 83516ff5-c4e7-4e91-a2f9-8af9b51cf475] No waiting events found dispatching network-vif-unplugged-452cb189-f59e-42e1-80e1-9eebb0c65bd7 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:53:46 user nova-compute[75337]: DEBUG nova.compute.manager [req-846b5f8c-332a-47ee-a587-eeb492801446 req-de5af10b-8980-4d55-bdd4-6bc12803a8f9 service nova] [instance: 83516ff5-c4e7-4e91-a2f9-8af9b51cf475] Received event network-vif-unplugged-452cb189-f59e-42e1-80e1-9eebb0c65bd7 for instance with task_state deleting. {{(pid=75337) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 15:53:46 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:53:46 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:53:46 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:53:46 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:53:46 user nova-compute[75337]: DEBUG nova.network.neutron [req-10f8fb69-f9cc-4516-8632-66426eb4eb1f req-e3fd7f3e-ba32-4690-b13e-5749c216f9ea service nova] [instance: 453c580f-6028-4ea9-87fc-66f3834f0bee] Updated VIF entry in instance network info cache for port c8b8e3bc-c60d-4481-845f-97bfc6e8592d. {{(pid=75337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 15:53:46 user nova-compute[75337]: DEBUG nova.network.neutron [req-10f8fb69-f9cc-4516-8632-66426eb4eb1f req-e3fd7f3e-ba32-4690-b13e-5749c216f9ea service nova] [instance: 453c580f-6028-4ea9-87fc-66f3834f0bee] Updating instance_info_cache with network_info: [{"id": "c8b8e3bc-c60d-4481-845f-97bfc6e8592d", "address": "fa:16:3e:c6:4d:4d", "network": {"id": "6757c3a5-4f6f-48a7-9645-af433fb039de", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1337373982-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e13dfd402b7b4ed1a1092c7388ff5188", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8b8e3bc-c6", "ovs_interfaceid": "c8b8e3bc-c60d-4481-845f-97bfc6e8592d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:53:46 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-10f8fb69-f9cc-4516-8632-66426eb4eb1f req-e3fd7f3e-ba32-4690-b13e-5749c216f9ea service nova] Releasing lock "refresh_cache-453c580f-6028-4ea9-87fc-66f3834f0bee" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 15:53:46 user nova-compute[75337]: INFO nova.virt.libvirt.driver [-] [instance: 83516ff5-c4e7-4e91-a2f9-8af9b51cf475] Instance destroyed successfully.
Nov 06 15:53:46 user nova-compute[75337]: DEBUG nova.objects.instance [None req-08f4d433-510e-40ed-b986-c98ff99365e6 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Lazy-loading 'resources' on Instance uuid 83516ff5-c4e7-4e91-a2f9-8af9b51cf475 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 15:53:46 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-08f4d433-510e-40ed-b986-c98ff99365e6 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T15:37:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1396250350',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1396250350',id=1,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-06T15:38:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='eb76b5b0f2b24f1c84a92403176bcc00',ramdisk_id='',reservation_id='r-of23go0w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2044295020',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T15:39:52Z,user_data=None,user_id='74090d6e5b354d79bf6ded92e6de56aa',uuid=83516ff5-c4e7-4e91-a2f9-8af9b51cf475,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "452cb189-f59e-42e1-80e1-9eebb0c65bd7", "address": "fa:16:3e:f6:56:c4", "network": {"id": "736be000-ee94-41fd-9de0-f2f885ec9be7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1715443852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb76b5b0f2b24f1c84a92403176bcc00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap452cb189-f5", "ovs_interfaceid": "452cb189-f59e-42e1-80e1-9eebb0c65bd7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 15:53:46 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-08f4d433-510e-40ed-b986-c98ff99365e6 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Converting VIF {"id": "452cb189-f59e-42e1-80e1-9eebb0c65bd7", "address": "fa:16:3e:f6:56:c4", "network": {"id": "736be000-ee94-41fd-9de0-f2f885ec9be7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1715443852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb76b5b0f2b24f1c84a92403176bcc00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap452cb189-f5", "ovs_interfaceid": "452cb189-f59e-42e1-80e1-9eebb0c65bd7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 15:53:46 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-08f4d433-510e-40ed-b986-c98ff99365e6 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f6:56:c4,bridge_name='br-int',has_traffic_filtering=True,id=452cb189-f59e-42e1-80e1-9eebb0c65bd7,network=Network(736be000-ee94-41fd-9de0-f2f885ec9be7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap452cb189-f5') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 15:53:46 user nova-compute[75337]: DEBUG os_vif [None req-08f4d433-510e-40ed-b986-c98ff99365e6 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f6:56:c4,bridge_name='br-int',has_traffic_filtering=True,id=452cb189-f59e-42e1-80e1-9eebb0c65bd7,network=Network(736be000-ee94-41fd-9de0-f2f885ec9be7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap452cb189-f5') {{(pid=75337) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 15:53:46 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:53:46 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap452cb189-f5, bridge=br-int, if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:53:46 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:53:46 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:53:46 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:53:46 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:53:46 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=50c90e37-292f-4c01-9b6d-af2e93837530) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:53:46 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:53:46 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:53:46 user nova-compute[75337]: INFO os_vif [None req-08f4d433-510e-40ed-b986-c98ff99365e6 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f6:56:c4,bridge_name='br-int',has_traffic_filtering=True,id=452cb189-f59e-42e1-80e1-9eebb0c65bd7,network=Network(736be000-ee94-41fd-9de0-f2f885ec9be7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap452cb189-f5')
Nov 06 15:53:46 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-08f4d433-510e-40ed-b986-c98ff99365e6 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: 83516ff5-c4e7-4e91-a2f9-8af9b51cf475] Deleting instance files /opt/stack/data/nova/instances/83516ff5-c4e7-4e91-a2f9-8af9b51cf475_del
Nov 06 15:53:46 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-08f4d433-510e-40ed-b986-c98ff99365e6 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: 83516ff5-c4e7-4e91-a2f9-8af9b51cf475] Deletion of /opt/stack/data/nova/instances/83516ff5-c4e7-4e91-a2f9-8af9b51cf475_del complete
Nov 06 15:53:46 user nova-compute[75337]: INFO nova.compute.manager [None req-08f4d433-510e-40ed-b986-c98ff99365e6 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] [instance: 83516ff5-c4e7-4e91-a2f9-8af9b51cf475] Took 1.16 seconds to destroy the instance on the hypervisor.
Nov 06 15:53:46 user nova-compute[75337]: DEBUG oslo.service.loopingcall [None req-08f4d433-510e-40ed-b986-c98ff99365e6 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75337) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 15:53:46 user nova-compute[75337]: DEBUG nova.compute.manager [-] [instance: 83516ff5-c4e7-4e91-a2f9-8af9b51cf475] Deallocating network for instance {{(pid=75337) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 15:53:46 user nova-compute[75337]: DEBUG nova.network.neutron [-] [instance: 83516ff5-c4e7-4e91-a2f9-8af9b51cf475] deallocate_for_instance() {{(pid=75337) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 15:53:47 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:53:47 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:53:47 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:53:47 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:53:47 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:53:47 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:53:47 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:53:47 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:53:47 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:53:47 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:53:47 user nova-compute[75337]: DEBUG nova.network.neutron [-] [instance: 83516ff5-c4e7-4e91-a2f9-8af9b51cf475] Updating instance_info_cache with network_info: [] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:53:48 user nova-compute[75337]: DEBUG nova.compute.manager [req-8c36bee4-5112-472c-ab0b-44c843b75769 req-d371a6e9-a7c9-4d7b-bb63-3b81776d7757 service nova] [instance: 83516ff5-c4e7-4e91-a2f9-8af9b51cf475] Received event network-vif-deleted-452cb189-f59e-42e1-80e1-9eebb0c65bd7 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:53:48 user nova-compute[75337]: INFO nova.compute.manager [req-8c36bee4-5112-472c-ab0b-44c843b75769 req-d371a6e9-a7c9-4d7b-bb63-3b81776d7757 service nova] [instance: 83516ff5-c4e7-4e91-a2f9-8af9b51cf475] Neutron deleted interface 452cb189-f59e-42e1-80e1-9eebb0c65bd7; detaching it from the instance and deleting it from the info cache
Nov 06 15:53:48 user nova-compute[75337]: DEBUG nova.network.neutron [req-8c36bee4-5112-472c-ab0b-44c843b75769 req-d371a6e9-a7c9-4d7b-bb63-3b81776d7757 service nova] [instance: 83516ff5-c4e7-4e91-a2f9-8af9b51cf475] Updating instance_info_cache with network_info: [] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:53:48 user nova-compute[75337]: INFO nova.compute.manager [-] [instance: 83516ff5-c4e7-4e91-a2f9-8af9b51cf475] Took 1.04 seconds to deallocate network for instance.
Nov 06 15:53:48 user nova-compute[75337]: DEBUG nova.compute.manager [req-8c36bee4-5112-472c-ab0b-44c843b75769 req-d371a6e9-a7c9-4d7b-bb63-3b81776d7757 service nova] [instance: 83516ff5-c4e7-4e91-a2f9-8af9b51cf475] Detach interface failed, port_id=452cb189-f59e-42e1-80e1-9eebb0c65bd7, reason: Instance 83516ff5-c4e7-4e91-a2f9-8af9b51cf475 could not be found. {{(pid=75337) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 06 15:53:48 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-08f4d433-510e-40ed-b986-c98ff99365e6 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:53:48 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-08f4d433-510e-40ed-b986-c98ff99365e6 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:53:48 user nova-compute[75337]: DEBUG nova.compute.manager [req-5511ccc5-2a7b-4de5-8ee2-c3529151cb74 req-bceb3a55-a80a-498c-9345-734f5b3758d7 service nova] [instance: 453c580f-6028-4ea9-87fc-66f3834f0bee] Received event network-vif-plugged-c8b8e3bc-c60d-4481-845f-97bfc6e8592d {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:53:48 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-5511ccc5-2a7b-4de5-8ee2-c3529151cb74 req-bceb3a55-a80a-498c-9345-734f5b3758d7 service nova] Acquiring lock "453c580f-6028-4ea9-87fc-66f3834f0bee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:53:48 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-5511ccc5-2a7b-4de5-8ee2-c3529151cb74 req-bceb3a55-a80a-498c-9345-734f5b3758d7 service nova] Lock "453c580f-6028-4ea9-87fc-66f3834f0bee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:53:48 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-5511ccc5-2a7b-4de5-8ee2-c3529151cb74 req-bceb3a55-a80a-498c-9345-734f5b3758d7 service nova] Lock "453c580f-6028-4ea9-87fc-66f3834f0bee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:53:48 user nova-compute[75337]: DEBUG nova.compute.manager [req-5511ccc5-2a7b-4de5-8ee2-c3529151cb74 req-bceb3a55-a80a-498c-9345-734f5b3758d7 service nova] [instance: 453c580f-6028-4ea9-87fc-66f3834f0bee] No waiting events found dispatching network-vif-plugged-c8b8e3bc-c60d-4481-845f-97bfc6e8592d {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:53:48 user nova-compute[75337]: WARNING nova.compute.manager [req-5511ccc5-2a7b-4de5-8ee2-c3529151cb74 req-bceb3a55-a80a-498c-9345-734f5b3758d7 service nova] [instance: 453c580f-6028-4ea9-87fc-66f3834f0bee] Received unexpected event network-vif-plugged-c8b8e3bc-c60d-4481-845f-97bfc6e8592d for instance with vm_state building and task_state spawning.
Nov 06 15:53:48 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:53:48 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-08f4d433-510e-40ed-b986-c98ff99365e6 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 15:53:48 user nova-compute[75337]: DEBUG nova.compute.manager [req-3fb22234-3cfb-4991-927a-81d32cce4c6e req-9d7af79e-acf9-4311-aaaf-12402ca1945f service nova] [instance: 83516ff5-c4e7-4e91-a2f9-8af9b51cf475] Received event network-vif-plugged-452cb189-f59e-42e1-80e1-9eebb0c65bd7 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:53:48 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-3fb22234-3cfb-4991-927a-81d32cce4c6e req-9d7af79e-acf9-4311-aaaf-12402ca1945f service nova] Acquiring lock "83516ff5-c4e7-4e91-a2f9-8af9b51cf475-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:53:48 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-3fb22234-3cfb-4991-927a-81d32cce4c6e req-9d7af79e-acf9-4311-aaaf-12402ca1945f service nova] Lock "83516ff5-c4e7-4e91-a2f9-8af9b51cf475-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:53:48 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-3fb22234-3cfb-4991-927a-81d32cce4c6e req-9d7af79e-acf9-4311-aaaf-12402ca1945f service nova] Lock "83516ff5-c4e7-4e91-a2f9-8af9b51cf475-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:53:48 user nova-compute[75337]: DEBUG nova.compute.manager [req-3fb22234-3cfb-4991-927a-81d32cce4c6e req-9d7af79e-acf9-4311-aaaf-12402ca1945f service nova] [instance: 83516ff5-c4e7-4e91-a2f9-8af9b51cf475] No waiting events found dispatching network-vif-plugged-452cb189-f59e-42e1-80e1-9eebb0c65bd7 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:53:48 user nova-compute[75337]: WARNING nova.compute.manager [req-3fb22234-3cfb-4991-927a-81d32cce4c6e req-9d7af79e-acf9-4311-aaaf-12402ca1945f service nova] [instance: 83516ff5-c4e7-4e91-a2f9-8af9b51cf475] Received unexpected event network-vif-plugged-452cb189-f59e-42e1-80e1-9eebb0c65bd7 for instance with vm_state deleted and task_state None.
Nov 06 15:53:48 user nova-compute[75337]: DEBUG nova.compute.manager [req-3fb22234-3cfb-4991-927a-81d32cce4c6e req-9d7af79e-acf9-4311-aaaf-12402ca1945f service nova] [instance: 83516ff5-c4e7-4e91-a2f9-8af9b51cf475] Received event network-vif-plugged-452cb189-f59e-42e1-80e1-9eebb0c65bd7 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:53:48 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-3fb22234-3cfb-4991-927a-81d32cce4c6e req-9d7af79e-acf9-4311-aaaf-12402ca1945f service nova] Acquiring lock "83516ff5-c4e7-4e91-a2f9-8af9b51cf475-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:53:48 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-3fb22234-3cfb-4991-927a-81d32cce4c6e req-9d7af79e-acf9-4311-aaaf-12402ca1945f service nova] Lock "83516ff5-c4e7-4e91-a2f9-8af9b51cf475-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:53:48 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-3fb22234-3cfb-4991-927a-81d32cce4c6e req-9d7af79e-acf9-4311-aaaf-12402ca1945f service nova] Lock "83516ff5-c4e7-4e91-a2f9-8af9b51cf475-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:53:48 user nova-compute[75337]: DEBUG nova.compute.manager [req-3fb22234-3cfb-4991-927a-81d32cce4c6e req-9d7af79e-acf9-4311-aaaf-12402ca1945f service nova] [instance: 83516ff5-c4e7-4e91-a2f9-8af9b51cf475] No waiting events found dispatching network-vif-plugged-452cb189-f59e-42e1-80e1-9eebb0c65bd7 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:53:48 user nova-compute[75337]: WARNING nova.compute.manager [req-3fb22234-3cfb-4991-927a-81d32cce4c6e req-9d7af79e-acf9-4311-aaaf-12402ca1945f service nova] [instance: 83516ff5-c4e7-4e91-a2f9-8af9b51cf475] Received unexpected event network-vif-plugged-452cb189-f59e-42e1-80e1-9eebb0c65bd7 for instance with vm_state deleted and task_state None.
Nov 06 15:53:48 user nova-compute[75337]: DEBUG nova.compute.manager [req-3fb22234-3cfb-4991-927a-81d32cce4c6e req-9d7af79e-acf9-4311-aaaf-12402ca1945f service nova] [instance: 83516ff5-c4e7-4e91-a2f9-8af9b51cf475] Received event network-vif-plugged-452cb189-f59e-42e1-80e1-9eebb0c65bd7 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:53:48 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-3fb22234-3cfb-4991-927a-81d32cce4c6e req-9d7af79e-acf9-4311-aaaf-12402ca1945f service nova] Acquiring lock "83516ff5-c4e7-4e91-a2f9-8af9b51cf475-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:53:48 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-3fb22234-3cfb-4991-927a-81d32cce4c6e req-9d7af79e-acf9-4311-aaaf-12402ca1945f service nova] Lock "83516ff5-c4e7-4e91-a2f9-8af9b51cf475-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:53:48 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-3fb22234-3cfb-4991-927a-81d32cce4c6e req-9d7af79e-acf9-4311-aaaf-12402ca1945f service nova] Lock "83516ff5-c4e7-4e91-a2f9-8af9b51cf475-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:53:48 user nova-compute[75337]: DEBUG nova.compute.manager [req-3fb22234-3cfb-4991-927a-81d32cce4c6e req-9d7af79e-acf9-4311-aaaf-12402ca1945f service nova] [instance: 83516ff5-c4e7-4e91-a2f9-8af9b51cf475] No waiting events found dispatching network-vif-plugged-452cb189-f59e-42e1-80e1-9eebb0c65bd7 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:53:48 user nova-compute[75337]: WARNING nova.compute.manager [req-3fb22234-3cfb-4991-927a-81d32cce4c6e req-9d7af79e-acf9-4311-aaaf-12402ca1945f service nova] [instance: 83516ff5-c4e7-4e91-a2f9-8af9b51cf475] Received unexpected event network-vif-plugged-452cb189-f59e-42e1-80e1-9eebb0c65bd7 for instance with vm_state deleted and task_state None.
Nov 06 15:53:48 user nova-compute[75337]: DEBUG nova.compute.manager [req-3fb22234-3cfb-4991-927a-81d32cce4c6e req-9d7af79e-acf9-4311-aaaf-12402ca1945f service nova] [instance: 83516ff5-c4e7-4e91-a2f9-8af9b51cf475] Received event network-vif-unplugged-452cb189-f59e-42e1-80e1-9eebb0c65bd7 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:53:48 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-3fb22234-3cfb-4991-927a-81d32cce4c6e req-9d7af79e-acf9-4311-aaaf-12402ca1945f service nova] Acquiring lock "83516ff5-c4e7-4e91-a2f9-8af9b51cf475-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:53:48 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-3fb22234-3cfb-4991-927a-81d32cce4c6e req-9d7af79e-acf9-4311-aaaf-12402ca1945f service nova] Lock "83516ff5-c4e7-4e91-a2f9-8af9b51cf475-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:53:48 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-3fb22234-3cfb-4991-927a-81d32cce4c6e req-9d7af79e-acf9-4311-aaaf-12402ca1945f service nova] Lock "83516ff5-c4e7-4e91-a2f9-8af9b51cf475-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:53:48 user nova-compute[75337]: DEBUG nova.compute.manager [req-3fb22234-3cfb-4991-927a-81d32cce4c6e req-9d7af79e-acf9-4311-aaaf-12402ca1945f service nova] [instance: 83516ff5-c4e7-4e91-a2f9-8af9b51cf475] No waiting events found dispatching network-vif-unplugged-452cb189-f59e-42e1-80e1-9eebb0c65bd7 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:53:48 user nova-compute[75337]: WARNING nova.compute.manager [req-3fb22234-3cfb-4991-927a-81d32cce4c6e req-9d7af79e-acf9-4311-aaaf-12402ca1945f service nova] [instance: 83516ff5-c4e7-4e91-a2f9-8af9b51cf475] Received unexpected event network-vif-unplugged-452cb189-f59e-42e1-80e1-9eebb0c65bd7 for instance with vm_state deleted and task_state None.
Nov 06 15:53:48 user nova-compute[75337]: DEBUG nova.compute.manager [req-3fb22234-3cfb-4991-927a-81d32cce4c6e req-9d7af79e-acf9-4311-aaaf-12402ca1945f service nova] [instance: 83516ff5-c4e7-4e91-a2f9-8af9b51cf475] Received event network-vif-plugged-452cb189-f59e-42e1-80e1-9eebb0c65bd7 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:53:48 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-3fb22234-3cfb-4991-927a-81d32cce4c6e req-9d7af79e-acf9-4311-aaaf-12402ca1945f service nova] Acquiring lock "83516ff5-c4e7-4e91-a2f9-8af9b51cf475-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:53:48 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-3fb22234-3cfb-4991-927a-81d32cce4c6e req-9d7af79e-acf9-4311-aaaf-12402ca1945f service nova] Lock "83516ff5-c4e7-4e91-a2f9-8af9b51cf475-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:53:48 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-3fb22234-3cfb-4991-927a-81d32cce4c6e req-9d7af79e-acf9-4311-aaaf-12402ca1945f service nova] Lock "83516ff5-c4e7-4e91-a2f9-8af9b51cf475-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:53:48 user nova-compute[75337]: DEBUG nova.compute.manager [req-3fb22234-3cfb-4991-927a-81d32cce4c6e req-9d7af79e-acf9-4311-aaaf-12402ca1945f service nova] [instance: 83516ff5-c4e7-4e91-a2f9-8af9b51cf475] No waiting events found dispatching network-vif-plugged-452cb189-f59e-42e1-80e1-9eebb0c65bd7 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:53:48 user nova-compute[75337]: WARNING nova.compute.manager [req-3fb22234-3cfb-4991-927a-81d32cce4c6e req-9d7af79e-acf9-4311-aaaf-12402ca1945f service nova] [instance: 83516ff5-c4e7-4e91-a2f9-8af9b51cf475] Received unexpected event network-vif-plugged-452cb189-f59e-42e1-80e1-9eebb0c65bd7 for instance with vm_state deleted and task_state None.
Nov 06 15:53:48 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-08f4d433-510e-40ed-b986-c98ff99365e6 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 15:53:48 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-08f4d433-510e-40ed-b986-c98ff99365e6 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.373s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:53:48 user nova-compute[75337]: INFO nova.scheduler.client.report [None req-08f4d433-510e-40ed-b986-c98ff99365e6 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Deleted allocations for instance 83516ff5-c4e7-4e91-a2f9-8af9b51cf475
Nov 06 15:53:48 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-08f4d433-510e-40ed-b986-c98ff99365e6 tempest-ServerBootFromVolumeStableRescueTest-2044295020 tempest-ServerBootFromVolumeStableRescueTest-2044295020-project-member] Lock "83516ff5-c4e7-4e91-a2f9-8af9b51cf475" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.782s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:53:49 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:53:50 user nova-compute[75337]: DEBUG nova.compute.manager [None req-c42b1d6b-23b6-4221-abf3-bf6b9dd5dfa4 tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] [instance: 453c580f-6028-4ea9-87fc-66f3834f0bee] Instance event wait completed in 0 seconds for  {{(pid=75337) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 15:53:50 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-c42b1d6b-23b6-4221-abf3-bf6b9dd5dfa4 tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] [instance: 453c580f-6028-4ea9-87fc-66f3834f0bee] Guest created on hypervisor {{(pid=75337) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 15:53:50 user nova-compute[75337]: INFO nova.virt.libvirt.driver [-] [instance: 453c580f-6028-4ea9-87fc-66f3834f0bee] Instance spawned successfully.
Nov 06 15:53:50 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-c42b1d6b-23b6-4221-abf3-bf6b9dd5dfa4 tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] [instance: 453c580f-6028-4ea9-87fc-66f3834f0bee] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 15:53:50 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-c42b1d6b-23b6-4221-abf3-bf6b9dd5dfa4 tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] [instance: 453c580f-6028-4ea9-87fc-66f3834f0bee] Found default for hw_cdrom_bus of ide {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:53:50 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-c42b1d6b-23b6-4221-abf3-bf6b9dd5dfa4 tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] [instance: 453c580f-6028-4ea9-87fc-66f3834f0bee] Found default for hw_disk_bus of virtio {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:53:50 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-c42b1d6b-23b6-4221-abf3-bf6b9dd5dfa4 tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] [instance: 453c580f-6028-4ea9-87fc-66f3834f0bee] Found default for hw_input_bus of None {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:53:50 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-c42b1d6b-23b6-4221-abf3-bf6b9dd5dfa4 tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] [instance: 453c580f-6028-4ea9-87fc-66f3834f0bee] Found default for hw_pointer_model of None {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:53:50 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-c42b1d6b-23b6-4221-abf3-bf6b9dd5dfa4 tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] [instance: 453c580f-6028-4ea9-87fc-66f3834f0bee] Found default for hw_video_model of virtio {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:53:50 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-c42b1d6b-23b6-4221-abf3-bf6b9dd5dfa4 tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] [instance: 453c580f-6028-4ea9-87fc-66f3834f0bee] Found default for hw_vif_model of virtio {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:53:50 user nova-compute[75337]: DEBUG nova.compute.manager [req-3f613475-a6d3-431a-9105-bf7202d8eca1 req-7b801adf-449b-4a88-94f8-71791ee6a72e service nova] [instance: 453c580f-6028-4ea9-87fc-66f3834f0bee] Received event network-vif-plugged-c8b8e3bc-c60d-4481-845f-97bfc6e8592d {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:53:50 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-3f613475-a6d3-431a-9105-bf7202d8eca1 req-7b801adf-449b-4a88-94f8-71791ee6a72e service nova] Acquiring lock "453c580f-6028-4ea9-87fc-66f3834f0bee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:53:50 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-3f613475-a6d3-431a-9105-bf7202d8eca1 req-7b801adf-449b-4a88-94f8-71791ee6a72e service nova] Lock "453c580f-6028-4ea9-87fc-66f3834f0bee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:53:50 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-3f613475-a6d3-431a-9105-bf7202d8eca1 req-7b801adf-449b-4a88-94f8-71791ee6a72e service nova] Lock "453c580f-6028-4ea9-87fc-66f3834f0bee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:53:50 user nova-compute[75337]: DEBUG nova.compute.manager [req-3f613475-a6d3-431a-9105-bf7202d8eca1 req-7b801adf-449b-4a88-94f8-71791ee6a72e service nova] [instance: 453c580f-6028-4ea9-87fc-66f3834f0bee] No waiting events found dispatching network-vif-plugged-c8b8e3bc-c60d-4481-845f-97bfc6e8592d {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:53:50 user nova-compute[75337]: WARNING nova.compute.manager [req-3f613475-a6d3-431a-9105-bf7202d8eca1 req-7b801adf-449b-4a88-94f8-71791ee6a72e service nova] [instance: 453c580f-6028-4ea9-87fc-66f3834f0bee] Received unexpected event network-vif-plugged-c8b8e3bc-c60d-4481-845f-97bfc6e8592d for instance with vm_state building and task_state spawning.
Nov 06 15:53:50 user nova-compute[75337]: INFO nova.compute.manager [None req-c42b1d6b-23b6-4221-abf3-bf6b9dd5dfa4 tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] [instance: 453c580f-6028-4ea9-87fc-66f3834f0bee] Took 6.27 seconds to spawn the instance on the hypervisor.
Nov 06 15:53:50 user nova-compute[75337]: DEBUG nova.compute.manager [None req-c42b1d6b-23b6-4221-abf3-bf6b9dd5dfa4 tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] [instance: 453c580f-6028-4ea9-87fc-66f3834f0bee] Checking state {{(pid=75337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 15:53:50 user nova-compute[75337]: INFO nova.compute.manager [None req-c42b1d6b-23b6-4221-abf3-bf6b9dd5dfa4 tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] [instance: 453c580f-6028-4ea9-87fc-66f3834f0bee] Took 6.96 seconds to build instance.
Nov 06 15:53:50 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-c42b1d6b-23b6-4221-abf3-bf6b9dd5dfa4 tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] Lock "453c580f-6028-4ea9-87fc-66f3834f0bee" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.061s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:53:51 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:53:54 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:53:56 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:53:59 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:54:01 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:54:04 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:54:06 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:54:07 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:54:07 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:54:07 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:54:07 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:54:07 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:54:07 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:54:07 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:54:07 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75337) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 15:54:08 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:54:08 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Starting heal instance info cache {{(pid=75337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 15:54:08 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "refresh_cache-a293c354-d1e5-4c33-9e7b-d1558235aaf8" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 15:54:08 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquired lock "refresh_cache-a293c354-d1e5-4c33-9e7b-d1558235aaf8" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 15:54:08 user nova-compute[75337]: DEBUG nova.network.neutron [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] [instance: a293c354-d1e5-4c33-9e7b-d1558235aaf8] Forcefully refreshing network info cache for instance {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 15:54:09 user nova-compute[75337]: DEBUG nova.network.neutron [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] [instance: a293c354-d1e5-4c33-9e7b-d1558235aaf8] Updating instance_info_cache with network_info: [{"id": "29fff93f-08f1-4e46-91db-84ab16f785e5", "address": "fa:16:3e:d7:cf:dd", "network": {"id": "48f1545d-7e80-462f-9dbf-f1102ddcda9a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1210368397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1013e7afbefd4146a3be04587710b1de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29fff93f-08", "ovs_interfaceid": "29fff93f-08f1-4e46-91db-84ab16f785e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:54:09 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Releasing lock "refresh_cache-a293c354-d1e5-4c33-9e7b-d1558235aaf8" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 15:54:09 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] [instance: a293c354-d1e5-4c33-9e7b-d1558235aaf8] Updated the network info_cache for instance {{(pid=75337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 15:54:09 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:54:11 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:54:11 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:54:14 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:54:15 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager.update_available_resource {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:54:15 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:54:15 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:54:15 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:54:15 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Auditing locally available compute resources for user (node: user) {{(pid=75337) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 15:54:15 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/453c580f-6028-4ea9-87fc-66f3834f0bee/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:54:15 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/453c580f-6028-4ea9-87fc-66f3834f0bee/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:54:15 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/453c580f-6028-4ea9-87fc-66f3834f0bee/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:54:16 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/453c580f-6028-4ea9-87fc-66f3834f0bee/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:54:16 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a293c354-d1e5-4c33-9e7b-d1558235aaf8/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:54:16 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a293c354-d1e5-4c33-9e7b-d1558235aaf8/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:54:16 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a293c354-d1e5-4c33-9e7b-d1558235aaf8/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:54:16 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a293c354-d1e5-4c33-9e7b-d1558235aaf8/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:54:16 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30c634ff-6999-40aa-a90d-1db6d278b571/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:54:16 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30c634ff-6999-40aa-a90d-1db6d278b571/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:54:16 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30c634ff-6999-40aa-a90d-1db6d278b571/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:54:16 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:54:16 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30c634ff-6999-40aa-a90d-1db6d278b571/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:54:16 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 15:54:16 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6110b34a-6fd3-45fc-911d-4e5d3c7f2d78/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:54:17 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6110b34a-6fd3-45fc-911d-4e5d3c7f2d78/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:54:17 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6110b34a-6fd3-45fc-911d-4e5d3c7f2d78/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:54:17 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6110b34a-6fd3-45fc-911d-4e5d3c7f2d78/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:54:17 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d10b4a86-8b0d-423f-81e2-87f5f25a2467/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:54:17 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d10b4a86-8b0d-423f-81e2-87f5f25a2467/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:54:17 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d10b4a86-8b0d-423f-81e2-87f5f25a2467/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:54:17 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d10b4a86-8b0d-423f-81e2-87f5f25a2467/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:54:17 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88e07d6a-1202-4703-abf2-5980a7cfa15d/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:54:17 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88e07d6a-1202-4703-abf2-5980a7cfa15d/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:54:17 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88e07d6a-1202-4703-abf2-5980a7cfa15d/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:54:18 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88e07d6a-1202-4703-abf2-5980a7cfa15d/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:54:18 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 15:54:18 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 15:54:18 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Hypervisor/Node resource view: name=user free_ram=7779MB free_disk=25.129268646240234GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75337) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 15:54:18 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:54:18 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:54:18 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 493eff79-294e-4259-a6d0-4772c4b45013 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:54:18 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance a293c354-d1e5-4c33-9e7b-d1558235aaf8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:54:18 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 30c634ff-6999-40aa-a90d-1db6d278b571 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:54:18 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 6110b34a-6fd3-45fc-911d-4e5d3c7f2d78 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:54:18 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 88e07d6a-1202-4703-abf2-5980a7cfa15d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:54:18 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance d10b4a86-8b0d-423f-81e2-87f5f25a2467 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:54:18 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 453c580f-6028-4ea9-87fc-66f3834f0bee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:54:18 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 15:54:18 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 15:54:18 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Refreshing inventories for resource provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 06 15:54:18 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Updating ProviderTree inventory for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 06 15:54:18 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Updating inventory in ProviderTree for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 06 15:54:18 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Refreshing aggregate associations for resource provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7, aggregates: None {{(pid=75337) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 06 15:54:18 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Refreshing trait associations for resource provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7, traits: COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NODE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_IDE,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSSE3,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_USB {{(pid=75337) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 06 15:54:19 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 15:54:19 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 15:54:19 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Compute_service record updated for user:user {{(pid=75337) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 15:54:19 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.733s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:54:19 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:54:19 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Cleaning up deleted instances {{(pid=75337) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 06 15:54:19 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] There are 0 instances to clean {{(pid=75337) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 06 15:54:19 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:54:19 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:54:19 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Cleaning up deleted instances with incomplete migration  {{(pid=75337) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 06 15:54:20 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:54:21 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:54:24 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:54:24 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:54:26 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:54:31 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:54:34 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-e70030c6-6b25-4e7c-929d-843bc1b7cdb0 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Acquiring lock "493eff79-294e-4259-a6d0-4772c4b45013" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:54:34 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-e70030c6-6b25-4e7c-929d-843bc1b7cdb0 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Lock "493eff79-294e-4259-a6d0-4772c4b45013" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:54:34 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-e70030c6-6b25-4e7c-929d-843bc1b7cdb0 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Acquiring lock "493eff79-294e-4259-a6d0-4772c4b45013-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:54:34 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-e70030c6-6b25-4e7c-929d-843bc1b7cdb0 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Lock "493eff79-294e-4259-a6d0-4772c4b45013-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:54:34 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-e70030c6-6b25-4e7c-929d-843bc1b7cdb0 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Lock "493eff79-294e-4259-a6d0-4772c4b45013-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:54:34 user nova-compute[75337]: INFO nova.compute.manager [None req-e70030c6-6b25-4e7c-929d-843bc1b7cdb0 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 493eff79-294e-4259-a6d0-4772c4b45013] Terminating instance
Nov 06 15:54:34 user nova-compute[75337]: DEBUG nova.compute.manager [None req-e70030c6-6b25-4e7c-929d-843bc1b7cdb0 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 493eff79-294e-4259-a6d0-4772c4b45013] Start destroying the instance on the hypervisor. {{(pid=75337) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 15:54:34 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:54:34 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:54:34 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:54:34 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:54:34 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:54:34 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:54:34 user nova-compute[75337]: DEBUG nova.compute.manager [req-4ef0ec0c-a57d-4e60-8f21-b99a462cbd0f req-bb3c035e-7f83-4f83-801c-678ff2bfabe4 service nova] [instance: 493eff79-294e-4259-a6d0-4772c4b45013] Received event network-vif-unplugged-5e620284-83c1-40a8-91a5-c6b2c8c87a19 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:54:34 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-4ef0ec0c-a57d-4e60-8f21-b99a462cbd0f req-bb3c035e-7f83-4f83-801c-678ff2bfabe4 service nova] Acquiring lock "493eff79-294e-4259-a6d0-4772c4b45013-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:54:34 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-4ef0ec0c-a57d-4e60-8f21-b99a462cbd0f req-bb3c035e-7f83-4f83-801c-678ff2bfabe4 service nova] Lock "493eff79-294e-4259-a6d0-4772c4b45013-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:54:34 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-4ef0ec0c-a57d-4e60-8f21-b99a462cbd0f req-bb3c035e-7f83-4f83-801c-678ff2bfabe4 service nova] Lock "493eff79-294e-4259-a6d0-4772c4b45013-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:54:34 user nova-compute[75337]: DEBUG nova.compute.manager [req-4ef0ec0c-a57d-4e60-8f21-b99a462cbd0f req-bb3c035e-7f83-4f83-801c-678ff2bfabe4 service nova] [instance: 493eff79-294e-4259-a6d0-4772c4b45013] No waiting events found dispatching network-vif-unplugged-5e620284-83c1-40a8-91a5-c6b2c8c87a19 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:54:34 user nova-compute[75337]: DEBUG nova.compute.manager [req-4ef0ec0c-a57d-4e60-8f21-b99a462cbd0f req-bb3c035e-7f83-4f83-801c-678ff2bfabe4 service nova] [instance: 493eff79-294e-4259-a6d0-4772c4b45013] Received event network-vif-unplugged-5e620284-83c1-40a8-91a5-c6b2c8c87a19 for instance with task_state deleting. {{(pid=75337) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 15:54:34 user nova-compute[75337]: INFO nova.virt.libvirt.driver [-] [instance: 493eff79-294e-4259-a6d0-4772c4b45013] Instance destroyed successfully.
Nov 06 15:54:34 user nova-compute[75337]: DEBUG nova.objects.instance [None req-e70030c6-6b25-4e7c-929d-843bc1b7cdb0 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Lazy-loading 'resources' on Instance uuid 493eff79-294e-4259-a6d0-4772c4b45013 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 15:54:34 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-e70030c6-6b25-4e7c-929d-843bc1b7cdb0 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T15:49:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1453395779',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1453395779',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1453395779',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJXBWFs9rtDtbfmWChuvQ9U2j/Llule54LK+NkbLD4Kvk//UeBtZmPbDLJsTQqt3tEZEAYKACUPbtVhWucUbWh1odsCyeJk59uyjQg08BCHPVspLbW2iUBoVKslwEYv+Bw==',key_name='tempest-keypair-434868357',keypairs=<?>,launch_index=0,launched_at=2023-11-06T15:49:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='915211c6a2734c36b34ff92a56b085f6',ramdisk_id='',reservation_id='r-yqw0idmm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1055092640',owner_user_name='tempest-TestVolumeBootPattern-1055092640-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T15:49:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bb8d5f0200124588be1cfde107341a45',uuid=493eff79-294e-4259-a6d0-4772c4b45013,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5e620284-83c1-40a8-91a5-c6b2c8c87a19", "address": "fa:16:3e:09:f0:4b", "network": {"id": "4e47319f-de1d-4dfe-9915-7d2d5131704d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-895093240-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "915211c6a2734c36b34ff92a56b085f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e620284-83", "ovs_interfaceid": "5e620284-83c1-40a8-91a5-c6b2c8c87a19", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 15:54:34 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-e70030c6-6b25-4e7c-929d-843bc1b7cdb0 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Converting VIF {"id": "5e620284-83c1-40a8-91a5-c6b2c8c87a19", "address": "fa:16:3e:09:f0:4b", "network": {"id": "4e47319f-de1d-4dfe-9915-7d2d5131704d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-895093240-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "915211c6a2734c36b34ff92a56b085f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e620284-83", "ovs_interfaceid": "5e620284-83c1-40a8-91a5-c6b2c8c87a19", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 15:54:34 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-e70030c6-6b25-4e7c-929d-843bc1b7cdb0 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:09:f0:4b,bridge_name='br-int',has_traffic_filtering=True,id=5e620284-83c1-40a8-91a5-c6b2c8c87a19,network=Network(4e47319f-de1d-4dfe-9915-7d2d5131704d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e620284-83') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 15:54:34 user nova-compute[75337]: DEBUG os_vif [None req-e70030c6-6b25-4e7c-929d-843bc1b7cdb0 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:09:f0:4b,bridge_name='br-int',has_traffic_filtering=True,id=5e620284-83c1-40a8-91a5-c6b2c8c87a19,network=Network(4e47319f-de1d-4dfe-9915-7d2d5131704d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e620284-83') {{(pid=75337) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 15:54:34 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:54:34 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5e620284-83, bridge=br-int, if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:54:34 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:54:34 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:54:34 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:54:34 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d30d2400-fbb7-4bba-8906-6727693aad76) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:54:34 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:54:34 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:54:34 user nova-compute[75337]: INFO os_vif [None req-e70030c6-6b25-4e7c-929d-843bc1b7cdb0 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:09:f0:4b,bridge_name='br-int',has_traffic_filtering=True,id=5e620284-83c1-40a8-91a5-c6b2c8c87a19,network=Network(4e47319f-de1d-4dfe-9915-7d2d5131704d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e620284-83')
Nov 06 15:54:34 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e70030c6-6b25-4e7c-929d-843bc1b7cdb0 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 493eff79-294e-4259-a6d0-4772c4b45013] calling os-brick to detach iSCSI Volume {{(pid=75337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 15:54:34 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e70030c6-6b25-4e7c-929d-843bc1b7cdb0 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2abc33d0c0>, {'target_iqn': 'iqn.2010-10.org.openstack:2086a611-973d-47a1-bb69-f2ebd144be03', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FfsyNLOm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 15:54:34 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-e70030c6-6b25-4e7c-929d-843bc1b7cdb0 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 15:54:34 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-e70030c6-6b25-4e7c-929d-843bc1b7cdb0 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 15:54:34 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-e70030c6-6b25-4e7c-929d-843bc1b7cdb0 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 15:54:34 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:54:34 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:54:34 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[738f0c3e-7a48-49d8-8be0-02dd9a28b4df]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2086a611-973d-47a1-bb69-f2ebd144be03\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:54:34 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e70030c6-6b25-4e7c-929d-843bc1b7cdb0 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 15:54:34 user nova-compute[75337]: No targets found.
Nov 06 15:54:34 user nova-compute[75337]: iSNS:
Nov 06 15:54:34 user nova-compute[75337]: No targets found.
Nov 06 15:54:34 user nova-compute[75337]: STATIC:
Nov 06 15:54:34 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:2086a611-973d-47a1-bb69-f2ebd144be03
Nov 06 15:54:34 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 15:54:34 user nova-compute[75337]:                 Iface Name: default
Nov 06 15:54:34 user nova-compute[75337]: FIRMWARE:
Nov 06 15:54:34 user nova-compute[75337]: No targets found.
Nov 06 15:54:34 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 15:54:34 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e70030c6-6b25-4e7c-929d-843bc1b7cdb0 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 15:54:34 user nova-compute[75337]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 15:54:34 user nova-compute[75337]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75337) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 15:54:34 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e70030c6-6b25-4e7c-929d-843bc1b7cdb0 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2086a611-973d-47a1-bb69-f2ebd144be03', 0)] {{(pid=75337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 15:54:34 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:54:34 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:54:34 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[faf676b7-afa2-46fb-b438-30c604024468]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2086a611-973d-47a1-bb69-f2ebd144be03\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:54:34 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:54:34 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:54:34 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[48240b5e-1af8-4c12-831b-dea079ac7c9b]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2086a611-973d-47a1-bb69-f2ebd144be03 (non-flash)\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:54:34 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e70030c6-6b25-4e7c-929d-843bc1b7cdb0 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2086a611-973d-47a1-bb69-f2ebd144be03 (non-flash)
Nov 06 15:54:34 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 15:54:34 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e70030c6-6b25-4e7c-929d-843bc1b7cdb0 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2086a611-973d-47a1-bb69-f2ebd144be03 (non-flash)
Nov 06 15:54:34 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 15:54:34 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e70030c6-6b25-4e7c-929d-843bc1b7cdb0 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2abc34d750>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2086a611-973d-47a1-bb69-f2ebd144be03'): ({'sdb'}, set())}) {{(pid=75337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 15:54:34 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-e70030c6-6b25-4e7c-929d-843bc1b7cdb0 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Removing single pathed devices sdb {{(pid=75337) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 15:54:34 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:54:34 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:54:34 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[69558403-8250-45c6-a8b0-6e99816ce9ca]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:54:34 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:54:34 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:54:34 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ff95c74-e00c-47e9-8e78-e4b9e73a7245]: (4, ('ok\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:54:34 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-e70030c6-6b25-4e7c-929d-843bc1b7cdb0 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Flushing IO for device /dev/sdb {{(pid=75337) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 15:54:34 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:54:34 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:54:34 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb158939-fde6-485d-8dee-b14ac9f19f58]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:54:34 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-e70030c6-6b25-4e7c-929d-843bc1b7cdb0 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75337) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 15:54:34 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:54:35 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:54:35 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3c569cf-106e-4256-b263-5198f259a9a9]: (4, ('1', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:54:35 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-e70030c6-6b25-4e7c-929d-843bc1b7cdb0 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 15:54:35 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-e70030c6-6b25-4e7c-929d-843bc1b7cdb0 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] SCSI volumes sdb have been removed. {{(pid=75337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 15:54:35 user nova-compute[75337]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_564f7198', '/dev/disk/by-id/scsi-23333396438393539', '/dev/disk/by-id/scsi-1SCST_BIO564f7198-339d895901e396c7') {{(pid=86696) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 06 15:54:35 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[cda9b49e-ad78-41c0-82f8-001a439fdc20]: (4, None) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:54:35 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e70030c6-6b25-4e7c-929d-843bc1b7cdb0 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2086a611-973d-47a1-bb69-f2ebd144be03')] {{(pid=75337) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 15:54:35 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2086a611-973d-47a1-bb69-f2ebd144be03 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:54:35 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2086a611-973d-47a1-bb69-f2ebd144be03 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:54:35 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[be7cecd3-2565-4eb5-be8a-c0a5c3243356]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:54:35 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e70030c6-6b25-4e7c-929d-843bc1b7cdb0 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:54:35 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2086a611-973d-47a1-bb69-f2ebd144be03 -p 172.16.0.220:3260 --logout {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:54:35 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2086a611-973d-47a1-bb69-f2ebd144be03 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:54:35 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[092b40ad-ee61-4e27-a8b0-e9a1cddaef97]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:2086a611-973d-47a1-bb69-f2ebd144be03, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:2086a611-973d-47a1-bb69-f2ebd144be03, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:54:35 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e70030c6-6b25-4e7c-929d-843bc1b7cdb0 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:2086a611-973d-47a1-bb69-f2ebd144be03, portal: 172.16.0.220,3260]
Nov 06 15:54:35 user nova-compute[75337]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:2086a611-973d-47a1-bb69-f2ebd144be03, portal: 172.16.0.220,3260] successful.
Nov 06 15:54:35 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:54:35 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2086a611-973d-47a1-bb69-f2ebd144be03 -p 172.16.0.220:3260 --op delete {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:54:35 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2086a611-973d-47a1-bb69-f2ebd144be03 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:54:35 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[c88a50b6-fca4-40a9-9928-41a274bb4895]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:54:35 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e70030c6-6b25-4e7c-929d-843bc1b7cdb0 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:54:35 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-e70030c6-6b25-4e7c-929d-843bc1b7cdb0 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.300s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 15:54:35 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e70030c6-6b25-4e7c-929d-843bc1b7cdb0 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] <== disconnect_volume: return (301ms) None {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 15:54:35 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e70030c6-6b25-4e7c-929d-843bc1b7cdb0 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 493eff79-294e-4259-a6d0-4772c4b45013] Disconnected iSCSI Volume {{(pid=75337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 15:54:35 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-e70030c6-6b25-4e7c-929d-843bc1b7cdb0 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 493eff79-294e-4259-a6d0-4772c4b45013] Deleting instance files /opt/stack/data/nova/instances/493eff79-294e-4259-a6d0-4772c4b45013_del
Nov 06 15:54:35 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-e70030c6-6b25-4e7c-929d-843bc1b7cdb0 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 493eff79-294e-4259-a6d0-4772c4b45013] Deletion of /opt/stack/data/nova/instances/493eff79-294e-4259-a6d0-4772c4b45013_del complete
Nov 06 15:54:35 user nova-compute[75337]: INFO nova.compute.manager [None req-e70030c6-6b25-4e7c-929d-843bc1b7cdb0 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 493eff79-294e-4259-a6d0-4772c4b45013] Took 1.19 seconds to destroy the instance on the hypervisor.
Nov 06 15:54:35 user nova-compute[75337]: DEBUG oslo.service.loopingcall [None req-e70030c6-6b25-4e7c-929d-843bc1b7cdb0 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75337) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 15:54:35 user nova-compute[75337]: DEBUG nova.compute.manager [-] [instance: 493eff79-294e-4259-a6d0-4772c4b45013] Deallocating network for instance {{(pid=75337) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 15:54:35 user nova-compute[75337]: DEBUG nova.network.neutron [-] [instance: 493eff79-294e-4259-a6d0-4772c4b45013] deallocate_for_instance() {{(pid=75337) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 15:54:36 user nova-compute[75337]: DEBUG nova.network.neutron [-] [instance: 493eff79-294e-4259-a6d0-4772c4b45013] Updating instance_info_cache with network_info: [] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:54:36 user nova-compute[75337]: INFO nova.compute.manager [-] [instance: 493eff79-294e-4259-a6d0-4772c4b45013] Took 1.18 seconds to deallocate network for instance.
Nov 06 15:54:36 user nova-compute[75337]: DEBUG nova.compute.manager [req-0de9f213-5ccb-4fbf-838e-eb9767f73aa0 req-ad006c19-546c-41a6-8da7-2f62c6e16982 service nova] [instance: 493eff79-294e-4259-a6d0-4772c4b45013] Received event network-vif-plugged-5e620284-83c1-40a8-91a5-c6b2c8c87a19 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:54:36 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-0de9f213-5ccb-4fbf-838e-eb9767f73aa0 req-ad006c19-546c-41a6-8da7-2f62c6e16982 service nova] Acquiring lock "493eff79-294e-4259-a6d0-4772c4b45013-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:54:36 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-0de9f213-5ccb-4fbf-838e-eb9767f73aa0 req-ad006c19-546c-41a6-8da7-2f62c6e16982 service nova] Lock "493eff79-294e-4259-a6d0-4772c4b45013-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:54:36 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-0de9f213-5ccb-4fbf-838e-eb9767f73aa0 req-ad006c19-546c-41a6-8da7-2f62c6e16982 service nova] Lock "493eff79-294e-4259-a6d0-4772c4b45013-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:54:36 user nova-compute[75337]: DEBUG nova.compute.manager [req-0de9f213-5ccb-4fbf-838e-eb9767f73aa0 req-ad006c19-546c-41a6-8da7-2f62c6e16982 service nova] [instance: 493eff79-294e-4259-a6d0-4772c4b45013] No waiting events found dispatching network-vif-plugged-5e620284-83c1-40a8-91a5-c6b2c8c87a19 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:54:36 user nova-compute[75337]: WARNING nova.compute.manager [req-0de9f213-5ccb-4fbf-838e-eb9767f73aa0 req-ad006c19-546c-41a6-8da7-2f62c6e16982 service nova] [instance: 493eff79-294e-4259-a6d0-4772c4b45013] Received unexpected event network-vif-plugged-5e620284-83c1-40a8-91a5-c6b2c8c87a19 for instance with vm_state active and task_state deleting.
Nov 06 15:54:36 user nova-compute[75337]: DEBUG nova.compute.manager [req-0de9f213-5ccb-4fbf-838e-eb9767f73aa0 req-ad006c19-546c-41a6-8da7-2f62c6e16982 service nova] [instance: 6110b34a-6fd3-45fc-911d-4e5d3c7f2d78] Received event network-changed-fa3c6657-452e-4a95-b9c8-c59002be4e31 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:54:36 user nova-compute[75337]: DEBUG nova.compute.manager [req-0de9f213-5ccb-4fbf-838e-eb9767f73aa0 req-ad006c19-546c-41a6-8da7-2f62c6e16982 service nova] [instance: 6110b34a-6fd3-45fc-911d-4e5d3c7f2d78] Refreshing instance network info cache due to event network-changed-fa3c6657-452e-4a95-b9c8-c59002be4e31. {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 15:54:36 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-0de9f213-5ccb-4fbf-838e-eb9767f73aa0 req-ad006c19-546c-41a6-8da7-2f62c6e16982 service nova] Acquiring lock "refresh_cache-6110b34a-6fd3-45fc-911d-4e5d3c7f2d78" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 15:54:36 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-0de9f213-5ccb-4fbf-838e-eb9767f73aa0 req-ad006c19-546c-41a6-8da7-2f62c6e16982 service nova] Acquired lock "refresh_cache-6110b34a-6fd3-45fc-911d-4e5d3c7f2d78" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 15:54:36 user nova-compute[75337]: DEBUG nova.network.neutron [req-0de9f213-5ccb-4fbf-838e-eb9767f73aa0 req-ad006c19-546c-41a6-8da7-2f62c6e16982 service nova] [instance: 6110b34a-6fd3-45fc-911d-4e5d3c7f2d78] Refreshing network info cache for port fa3c6657-452e-4a95-b9c8-c59002be4e31 {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 15:54:36 user nova-compute[75337]: DEBUG nova.compute.manager [req-25877f0b-559d-4f6a-ae29-96f4dd1ccc00 req-44206ed7-dc11-40f0-999f-e497924032a7 service nova] [instance: 493eff79-294e-4259-a6d0-4772c4b45013] Received event network-vif-deleted-5e620284-83c1-40a8-91a5-c6b2c8c87a19 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:54:37 user nova-compute[75337]: DEBUG nova.network.neutron [req-0de9f213-5ccb-4fbf-838e-eb9767f73aa0 req-ad006c19-546c-41a6-8da7-2f62c6e16982 service nova] [instance: 6110b34a-6fd3-45fc-911d-4e5d3c7f2d78] Updated VIF entry in instance network info cache for port fa3c6657-452e-4a95-b9c8-c59002be4e31. {{(pid=75337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 15:54:37 user nova-compute[75337]: DEBUG nova.network.neutron [req-0de9f213-5ccb-4fbf-838e-eb9767f73aa0 req-ad006c19-546c-41a6-8da7-2f62c6e16982 service nova] [instance: 6110b34a-6fd3-45fc-911d-4e5d3c7f2d78] Updating instance_info_cache with network_info: [{"id": "fa3c6657-452e-4a95-b9c8-c59002be4e31", "address": "fa:16:3e:18:69:52", "network": {"id": "7f234ecf-bfa6-4316-9dce-c15050ba7914", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1378707892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "243647103fd44f629e0f40be0b56407e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa3c6657-45", "ovs_interfaceid": "fa3c6657-452e-4a95-b9c8-c59002be4e31", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:54:37 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-0de9f213-5ccb-4fbf-838e-eb9767f73aa0 req-ad006c19-546c-41a6-8da7-2f62c6e16982 service nova] Releasing lock "refresh_cache-6110b34a-6fd3-45fc-911d-4e5d3c7f2d78" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 15:54:37 user nova-compute[75337]: INFO nova.compute.manager [None req-e70030c6-6b25-4e7c-929d-843bc1b7cdb0 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 493eff79-294e-4259-a6d0-4772c4b45013] Took 1.04 seconds to detach 1 volumes for instance.
Nov 06 15:54:37 user nova-compute[75337]: DEBUG nova.compute.manager [None req-e70030c6-6b25-4e7c-929d-843bc1b7cdb0 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 493eff79-294e-4259-a6d0-4772c4b45013] Deleting volume: 2086a611-973d-47a1-bb69-f2ebd144be03 {{(pid=75337) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 06 15:54:37 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-e70030c6-6b25-4e7c-929d-843bc1b7cdb0 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:54:37 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-e70030c6-6b25-4e7c-929d-843bc1b7cdb0 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:54:37 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-e70030c6-6b25-4e7c-929d-843bc1b7cdb0 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 15:54:37 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-e70030c6-6b25-4e7c-929d-843bc1b7cdb0 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 15:54:37 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-e70030c6-6b25-4e7c-929d-843bc1b7cdb0 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.362s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:54:37 user nova-compute[75337]: INFO nova.scheduler.client.report [None req-e70030c6-6b25-4e7c-929d-843bc1b7cdb0 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Deleted allocations for instance 493eff79-294e-4259-a6d0-4772c4b45013
Nov 06 15:54:38 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-e70030c6-6b25-4e7c-929d-843bc1b7cdb0 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Lock "493eff79-294e-4259-a6d0-4772c4b45013" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.095s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:54:39 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:54:39 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:54:39 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:54:41 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:54:43 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:54:44 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:54:44 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:54:46 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-0b019cdf-eba8-45d4-bdd1-8ce111b3d028 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Acquiring lock "69df3824-b28c-43c0-9f20-52fa956642cc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:54:46 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-0b019cdf-eba8-45d4-bdd1-8ce111b3d028 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Lock "69df3824-b28c-43c0-9f20-52fa956642cc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:54:46 user nova-compute[75337]: DEBUG nova.compute.manager [None req-0b019cdf-eba8-45d4-bdd1-8ce111b3d028 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] [instance: 69df3824-b28c-43c0-9f20-52fa956642cc] Starting instance... {{(pid=75337) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 15:54:46 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-0b019cdf-eba8-45d4-bdd1-8ce111b3d028 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:54:46 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-0b019cdf-eba8-45d4-bdd1-8ce111b3d028 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:54:46 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-0b019cdf-eba8-45d4-bdd1-8ce111b3d028 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75337) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 15:54:46 user nova-compute[75337]: INFO nova.compute.claims [None req-0b019cdf-eba8-45d4-bdd1-8ce111b3d028 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] [instance: 69df3824-b28c-43c0-9f20-52fa956642cc] Claim successful on node user
Nov 06 15:54:47 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-0b019cdf-eba8-45d4-bdd1-8ce111b3d028 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 15:54:47 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-0b019cdf-eba8-45d4-bdd1-8ce111b3d028 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 15:54:47 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-0b019cdf-eba8-45d4-bdd1-8ce111b3d028 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.378s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:54:47 user nova-compute[75337]: DEBUG nova.compute.manager [None req-0b019cdf-eba8-45d4-bdd1-8ce111b3d028 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] [instance: 69df3824-b28c-43c0-9f20-52fa956642cc] Start building networks asynchronously for instance. {{(pid=75337) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 15:54:47 user nova-compute[75337]: DEBUG nova.compute.manager [None req-0b019cdf-eba8-45d4-bdd1-8ce111b3d028 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] [instance: 69df3824-b28c-43c0-9f20-52fa956642cc] Allocating IP information in the background. {{(pid=75337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 15:54:47 user nova-compute[75337]: DEBUG nova.network.neutron [None req-0b019cdf-eba8-45d4-bdd1-8ce111b3d028 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] [instance: 69df3824-b28c-43c0-9f20-52fa956642cc] allocate_for_instance() {{(pid=75337) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 15:54:47 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-0b019cdf-eba8-45d4-bdd1-8ce111b3d028 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] [instance: 69df3824-b28c-43c0-9f20-52fa956642cc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 15:54:47 user nova-compute[75337]: DEBUG nova.compute.manager [None req-0b019cdf-eba8-45d4-bdd1-8ce111b3d028 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] [instance: 69df3824-b28c-43c0-9f20-52fa956642cc] Start building block device mappings for instance. {{(pid=75337) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 15:54:47 user nova-compute[75337]: DEBUG nova.policy [None req-0b019cdf-eba8-45d4-bdd1-8ce111b3d028 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ef1008574bea4cfca8a20b2edcf0aacd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98fac9096a3b4f21ba805ba1437d9d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75337) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 15:54:47 user nova-compute[75337]: DEBUG nova.compute.manager [None req-0b019cdf-eba8-45d4-bdd1-8ce111b3d028 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] [instance: 69df3824-b28c-43c0-9f20-52fa956642cc] Start spawning the instance on the hypervisor. {{(pid=75337) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 15:54:47 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-0b019cdf-eba8-45d4-bdd1-8ce111b3d028 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] [instance: 69df3824-b28c-43c0-9f20-52fa956642cc] Creating instance directory {{(pid=75337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 15:54:47 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-0b019cdf-eba8-45d4-bdd1-8ce111b3d028 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] [instance: 69df3824-b28c-43c0-9f20-52fa956642cc] Creating image(s)
Nov 06 15:54:47 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-0b019cdf-eba8-45d4-bdd1-8ce111b3d028 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Acquiring lock "/opt/stack/data/nova/instances/69df3824-b28c-43c0-9f20-52fa956642cc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:54:47 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-0b019cdf-eba8-45d4-bdd1-8ce111b3d028 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Lock "/opt/stack/data/nova/instances/69df3824-b28c-43c0-9f20-52fa956642cc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:54:47 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-0b019cdf-eba8-45d4-bdd1-8ce111b3d028 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Lock "/opt/stack/data/nova/instances/69df3824-b28c-43c0-9f20-52fa956642cc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:54:47 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-0b019cdf-eba8-45d4-bdd1-8ce111b3d028 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:54:47 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-0b019cdf-eba8-45d4-bdd1-8ce111b3d028 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json" returned: 0 in 0.228s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:54:47 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-0b019cdf-eba8-45d4-bdd1-8ce111b3d028 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Acquiring lock "06ba3c914798499e686c5ac75886932347225275" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:54:47 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-0b019cdf-eba8-45d4-bdd1-8ce111b3d028 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Lock "06ba3c914798499e686c5ac75886932347225275" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:54:47 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-0b019cdf-eba8-45d4-bdd1-8ce111b3d028 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:54:47 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-0b019cdf-eba8-45d4-bdd1-8ce111b3d028 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json" returned: 0 in 0.200s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:54:47 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-0b019cdf-eba8-45d4-bdd1-8ce111b3d028 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275,backing_fmt=raw /opt/stack/data/nova/instances/69df3824-b28c-43c0-9f20-52fa956642cc/disk 1073741824 {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:54:48 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-0b019cdf-eba8-45d4-bdd1-8ce111b3d028 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275,backing_fmt=raw /opt/stack/data/nova/instances/69df3824-b28c-43c0-9f20-52fa956642cc/disk 1073741824" returned: 0 in 0.061s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:54:48 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-0b019cdf-eba8-45d4-bdd1-8ce111b3d028 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Lock "06ba3c914798499e686c5ac75886932347225275" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.269s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:54:48 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-0b019cdf-eba8-45d4-bdd1-8ce111b3d028 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:54:48 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-0b019cdf-eba8-45d4-bdd1-8ce111b3d028 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json" returned: 0 in 0.221s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:54:48 user nova-compute[75337]: DEBUG nova.virt.disk.api [None req-0b019cdf-eba8-45d4-bdd1-8ce111b3d028 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Checking if we can resize image /opt/stack/data/nova/instances/69df3824-b28c-43c0-9f20-52fa956642cc/disk. size=1073741824 {{(pid=75337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 15:54:48 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-0b019cdf-eba8-45d4-bdd1-8ce111b3d028 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69df3824-b28c-43c0-9f20-52fa956642cc/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:54:48 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-0b019cdf-eba8-45d4-bdd1-8ce111b3d028 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69df3824-b28c-43c0-9f20-52fa956642cc/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:54:48 user nova-compute[75337]: DEBUG nova.virt.disk.api [None req-0b019cdf-eba8-45d4-bdd1-8ce111b3d028 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Cannot resize image /opt/stack/data/nova/instances/69df3824-b28c-43c0-9f20-52fa956642cc/disk to a smaller size. {{(pid=75337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 06 15:54:48 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-0b019cdf-eba8-45d4-bdd1-8ce111b3d028 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] [instance: 69df3824-b28c-43c0-9f20-52fa956642cc] Created local disks {{(pid=75337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 15:54:48 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-0b019cdf-eba8-45d4-bdd1-8ce111b3d028 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] [instance: 69df3824-b28c-43c0-9f20-52fa956642cc] Ensure instance console log exists: /opt/stack/data/nova/instances/69df3824-b28c-43c0-9f20-52fa956642cc/console.log {{(pid=75337) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 15:54:48 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-0b019cdf-eba8-45d4-bdd1-8ce111b3d028 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:54:48 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-0b019cdf-eba8-45d4-bdd1-8ce111b3d028 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:54:48 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-0b019cdf-eba8-45d4-bdd1-8ce111b3d028 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:54:48 user nova-compute[75337]: DEBUG nova.network.neutron [None req-0b019cdf-eba8-45d4-bdd1-8ce111b3d028 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] [instance: 69df3824-b28c-43c0-9f20-52fa956642cc] Successfully created port: c3d051e2-c3b7-4ee0-aab0-dcf3c0d1d578 {{(pid=75337) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 15:54:49 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:54:49 user nova-compute[75337]: DEBUG nova.network.neutron [None req-0b019cdf-eba8-45d4-bdd1-8ce111b3d028 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] [instance: 69df3824-b28c-43c0-9f20-52fa956642cc] Successfully updated port: c3d051e2-c3b7-4ee0-aab0-dcf3c0d1d578 {{(pid=75337) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 15:54:49 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:54:49 user nova-compute[75337]: DEBUG nova.compute.manager [req-a988aebf-8aa8-4c55-9b46-d3e3fd6b7722 req-5ad2ace8-3c57-4e8c-8352-951eaeb383c4 service nova] [instance: 69df3824-b28c-43c0-9f20-52fa956642cc] Received event network-changed-c3d051e2-c3b7-4ee0-aab0-dcf3c0d1d578 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:54:49 user nova-compute[75337]: DEBUG nova.compute.manager [req-a988aebf-8aa8-4c55-9b46-d3e3fd6b7722 req-5ad2ace8-3c57-4e8c-8352-951eaeb383c4 service nova] [instance: 69df3824-b28c-43c0-9f20-52fa956642cc] Refreshing instance network info cache due to event network-changed-c3d051e2-c3b7-4ee0-aab0-dcf3c0d1d578. {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 15:54:49 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-a988aebf-8aa8-4c55-9b46-d3e3fd6b7722 req-5ad2ace8-3c57-4e8c-8352-951eaeb383c4 service nova] Acquiring lock "refresh_cache-69df3824-b28c-43c0-9f20-52fa956642cc" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 15:54:49 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-a988aebf-8aa8-4c55-9b46-d3e3fd6b7722 req-5ad2ace8-3c57-4e8c-8352-951eaeb383c4 service nova] Acquired lock "refresh_cache-69df3824-b28c-43c0-9f20-52fa956642cc" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 15:54:49 user nova-compute[75337]: DEBUG nova.network.neutron [req-a988aebf-8aa8-4c55-9b46-d3e3fd6b7722 req-5ad2ace8-3c57-4e8c-8352-951eaeb383c4 service nova] [instance: 69df3824-b28c-43c0-9f20-52fa956642cc] Refreshing network info cache for port c3d051e2-c3b7-4ee0-aab0-dcf3c0d1d578 {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 15:54:49 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-0b019cdf-eba8-45d4-bdd1-8ce111b3d028 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Acquiring lock "refresh_cache-69df3824-b28c-43c0-9f20-52fa956642cc" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 15:54:49 user nova-compute[75337]: DEBUG nova.network.neutron [req-a988aebf-8aa8-4c55-9b46-d3e3fd6b7722 req-5ad2ace8-3c57-4e8c-8352-951eaeb383c4 service nova] [instance: 69df3824-b28c-43c0-9f20-52fa956642cc] Instance cache missing network info. {{(pid=75337) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 15:54:50 user nova-compute[75337]: DEBUG nova.network.neutron [req-a988aebf-8aa8-4c55-9b46-d3e3fd6b7722 req-5ad2ace8-3c57-4e8c-8352-951eaeb383c4 service nova] [instance: 69df3824-b28c-43c0-9f20-52fa956642cc] Updating instance_info_cache with network_info: [] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:54:50 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-a988aebf-8aa8-4c55-9b46-d3e3fd6b7722 req-5ad2ace8-3c57-4e8c-8352-951eaeb383c4 service nova] Releasing lock "refresh_cache-69df3824-b28c-43c0-9f20-52fa956642cc" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 15:54:50 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-0b019cdf-eba8-45d4-bdd1-8ce111b3d028 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Acquired lock "refresh_cache-69df3824-b28c-43c0-9f20-52fa956642cc" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 15:54:50 user nova-compute[75337]: DEBUG nova.network.neutron [None req-0b019cdf-eba8-45d4-bdd1-8ce111b3d028 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] [instance: 69df3824-b28c-43c0-9f20-52fa956642cc] Building network info cache for instance {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 15:54:50 user nova-compute[75337]: DEBUG nova.network.neutron [None req-0b019cdf-eba8-45d4-bdd1-8ce111b3d028 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] [instance: 69df3824-b28c-43c0-9f20-52fa956642cc] Instance cache missing network info. {{(pid=75337) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 15:54:50 user nova-compute[75337]: DEBUG nova.network.neutron [None req-0b019cdf-eba8-45d4-bdd1-8ce111b3d028 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] [instance: 69df3824-b28c-43c0-9f20-52fa956642cc] Updating instance_info_cache with network_info: [{"id": "c3d051e2-c3b7-4ee0-aab0-dcf3c0d1d578", "address": "fa:16:3e:7e:b4:bf", "network": {"id": "8b217731-de9e-49bc-84bb-130fd42ede51", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-314618758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98fac9096a3b4f21ba805ba1437d9d38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3d051e2-c3", "ovs_interfaceid": "c3d051e2-c3b7-4ee0-aab0-dcf3c0d1d578", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:54:50 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-0b019cdf-eba8-45d4-bdd1-8ce111b3d028 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Releasing lock "refresh_cache-69df3824-b28c-43c0-9f20-52fa956642cc" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 15:54:50 user nova-compute[75337]: DEBUG nova.compute.manager [None req-0b019cdf-eba8-45d4-bdd1-8ce111b3d028 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] [instance: 69df3824-b28c-43c0-9f20-52fa956642cc] Instance network_info: |[{"id": "c3d051e2-c3b7-4ee0-aab0-dcf3c0d1d578", "address": "fa:16:3e:7e:b4:bf", "network": {"id": "8b217731-de9e-49bc-84bb-130fd42ede51", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-314618758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98fac9096a3b4f21ba805ba1437d9d38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3d051e2-c3", "ovs_interfaceid": "c3d051e2-c3b7-4ee0-aab0-dcf3c0d1d578", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 15:54:50 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-0b019cdf-eba8-45d4-bdd1-8ce111b3d028 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] [instance: 69df3824-b28c-43c0-9f20-52fa956642cc] Start _get_guest_xml network_info=[{"id": "c3d051e2-c3b7-4ee0-aab0-dcf3c0d1d578", "address": "fa:16:3e:7e:b4:bf", "network": {"id": "8b217731-de9e-49bc-84bb-130fd42ede51", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-314618758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98fac9096a3b4f21ba805ba1437d9d38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3d051e2-c3", "ovs_interfaceid": "c3d051e2-c3b7-4ee0-aab0-dcf3c0d1d578", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T15:34:14Z,direct_url=<?>,disk_format='qcow2',id=16b903ae-a40f-41a7-985b-4804cce92c62,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6549a15819f1469bbd5eeae8190e3d44',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T15:34:15Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'guest_format': None, 'size': 0, 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '16b903ae-a40f-41a7-985b-4804cce92c62'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 15:54:50 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-0b019cdf-eba8-45d4-bdd1-8ce111b3d028 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 15:54:50 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-0b019cdf-eba8-45d4-bdd1-8ce111b3d028 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 15:54:50 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-0b019cdf-eba8-45d4-bdd1-8ce111b3d028 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 15:54:50 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-0b019cdf-eba8-45d4-bdd1-8ce111b3d028 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] CPU controller missing on host. {{(pid=75337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 15:54:50 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-0b019cdf-eba8-45d4-bdd1-8ce111b3d028 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 15:54:50 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-0b019cdf-eba8-45d4-bdd1-8ce111b3d028 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] CPU controller found on host. {{(pid=75337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 15:54:50 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-0b019cdf-eba8-45d4-bdd1-8ce111b3d028 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75337) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 15:54:50 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-0b019cdf-eba8-45d4-bdd1-8ce111b3d028 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T15:34:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T15:34:14Z,direct_url=<?>,disk_format='qcow2',id=16b903ae-a40f-41a7-985b-4804cce92c62,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6549a15819f1469bbd5eeae8190e3d44',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T15:34:15Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 15:54:50 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-0b019cdf-eba8-45d4-bdd1-8ce111b3d028 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Flavor limits 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 15:54:50 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-0b019cdf-eba8-45d4-bdd1-8ce111b3d028 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Image limits 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 15:54:50 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-0b019cdf-eba8-45d4-bdd1-8ce111b3d028 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Flavor pref 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 15:54:50 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-0b019cdf-eba8-45d4-bdd1-8ce111b3d028 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Image pref 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 15:54:50 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-0b019cdf-eba8-45d4-bdd1-8ce111b3d028 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 15:54:50 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-0b019cdf-eba8-45d4-bdd1-8ce111b3d028 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 15:54:50 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-0b019cdf-eba8-45d4-bdd1-8ce111b3d028 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 15:54:50 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-0b019cdf-eba8-45d4-bdd1-8ce111b3d028 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Got 1 possible topologies {{(pid=75337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 15:54:50 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-0b019cdf-eba8-45d4-bdd1-8ce111b3d028 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 15:54:50 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-0b019cdf-eba8-45d4-bdd1-8ce111b3d028 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 15:54:50 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-0b019cdf-eba8-45d4-bdd1-8ce111b3d028 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T15:54:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1515449710',display_name='tempest-AttachVolumeTestJSON-server-1515449710',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1515449710',id=32,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOuljMPp9i9MDAKWBD5G58tmj+9Tb6PUeli8EGD2jPfBvIyOYYOj/xbR7lXnFQzbgbAGvrz08EfcDEZH0CAoflAb7Id49fT3SM4gKBFBAbvsmqhfX3tP82mW2VMhPkafYg==',key_name='tempest-keypair-396223312',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='98fac9096a3b4f21ba805ba1437d9d38',ramdisk_id='',reservation_id='r-ynykuy84',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-636759182',owner_user_name='tempest-AttachVolumeTestJSON-636759182-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T15:54:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ef1008574bea4cfca8a20b2edcf0aacd',uuid=69df3824-b28c-43c0-9f20-52fa956642cc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c3d051e2-c3b7-4ee0-aab0-dcf3c0d1d578", "address": "fa:16:3e:7e:b4:bf", "network": {"id": "8b217731-de9e-49bc-84bb-130fd42ede51", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-314618758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98fac9096a3b4f21ba805ba1437d9d38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3d051e2-c3", "ovs_interfaceid": "c3d051e2-c3b7-4ee0-aab0-dcf3c0d1d578", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75337) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 15:54:50 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-0b019cdf-eba8-45d4-bdd1-8ce111b3d028 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Converting VIF {"id": "c3d051e2-c3b7-4ee0-aab0-dcf3c0d1d578", "address": "fa:16:3e:7e:b4:bf", "network": {"id": "8b217731-de9e-49bc-84bb-130fd42ede51", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-314618758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98fac9096a3b4f21ba805ba1437d9d38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3d051e2-c3", "ovs_interfaceid": "c3d051e2-c3b7-4ee0-aab0-dcf3c0d1d578", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 15:54:50 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-0b019cdf-eba8-45d4-bdd1-8ce111b3d028 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:b4:bf,bridge_name='br-int',has_traffic_filtering=True,id=c3d051e2-c3b7-4ee0-aab0-dcf3c0d1d578,network=Network(8b217731-de9e-49bc-84bb-130fd42ede51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3d051e2-c3') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 15:54:50 user nova-compute[75337]: DEBUG nova.objects.instance [None req-0b019cdf-eba8-45d4-bdd1-8ce111b3d028 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Lazy-loading 'pci_devices' on Instance uuid 69df3824-b28c-43c0-9f20-52fa956642cc {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 15:54:50 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-0b019cdf-eba8-45d4-bdd1-8ce111b3d028 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] [instance: 69df3824-b28c-43c0-9f20-52fa956642cc] End _get_guest_xml xml=<domain type="kvm">
Nov 06 15:54:50 user nova-compute[75337]:   <uuid>69df3824-b28c-43c0-9f20-52fa956642cc</uuid>
Nov 06 15:54:50 user nova-compute[75337]:   <name>instance-00000020</name>
Nov 06 15:54:50 user nova-compute[75337]:   <memory>524288</memory>
Nov 06 15:54:50 user nova-compute[75337]:   <vcpu>1</vcpu>
Nov 06 15:54:50 user nova-compute[75337]:   <metadata>
Nov 06 15:54:50 user nova-compute[75337]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 15:54:50 user nova-compute[75337]:       <nova:package version="0.0.0"/>
Nov 06 15:54:50 user nova-compute[75337]:       <nova:name>tempest-AttachVolumeTestJSON-server-1515449710</nova:name>
Nov 06 15:54:50 user nova-compute[75337]:       <nova:creationTime>2023-11-06 15:54:50</nova:creationTime>
Nov 06 15:54:50 user nova-compute[75337]:       <nova:flavor name="m1.tiny">
Nov 06 15:54:50 user nova-compute[75337]:         <nova:memory>512</nova:memory>
Nov 06 15:54:50 user nova-compute[75337]:         <nova:disk>1</nova:disk>
Nov 06 15:54:50 user nova-compute[75337]:         <nova:swap>0</nova:swap>
Nov 06 15:54:50 user nova-compute[75337]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 15:54:50 user nova-compute[75337]:         <nova:vcpus>1</nova:vcpus>
Nov 06 15:54:50 user nova-compute[75337]:       </nova:flavor>
Nov 06 15:54:50 user nova-compute[75337]:       <nova:owner>
Nov 06 15:54:50 user nova-compute[75337]:         <nova:user uuid="ef1008574bea4cfca8a20b2edcf0aacd">tempest-AttachVolumeTestJSON-636759182-project-member</nova:user>
Nov 06 15:54:50 user nova-compute[75337]:         <nova:project uuid="98fac9096a3b4f21ba805ba1437d9d38">tempest-AttachVolumeTestJSON-636759182</nova:project>
Nov 06 15:54:50 user nova-compute[75337]:       </nova:owner>
Nov 06 15:54:50 user nova-compute[75337]:       <nova:root type="image" uuid="16b903ae-a40f-41a7-985b-4804cce92c62"/>
Nov 06 15:54:50 user nova-compute[75337]:       <nova:ports>
Nov 06 15:54:50 user nova-compute[75337]:         <nova:port uuid="c3d051e2-c3b7-4ee0-aab0-dcf3c0d1d578">
Nov 06 15:54:50 user nova-compute[75337]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 06 15:54:50 user nova-compute[75337]:         </nova:port>
Nov 06 15:54:50 user nova-compute[75337]:       </nova:ports>
Nov 06 15:54:50 user nova-compute[75337]:     </nova:instance>
Nov 06 15:54:50 user nova-compute[75337]:   </metadata>
Nov 06 15:54:50 user nova-compute[75337]:   <sysinfo type="smbios">
Nov 06 15:54:50 user nova-compute[75337]:     <system>
Nov 06 15:54:50 user nova-compute[75337]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 15:54:50 user nova-compute[75337]:       <entry name="product">OpenStack Nova</entry>
Nov 06 15:54:50 user nova-compute[75337]:       <entry name="version">0.0.0</entry>
Nov 06 15:54:50 user nova-compute[75337]:       <entry name="serial">69df3824-b28c-43c0-9f20-52fa956642cc</entry>
Nov 06 15:54:50 user nova-compute[75337]:       <entry name="uuid">69df3824-b28c-43c0-9f20-52fa956642cc</entry>
Nov 06 15:54:50 user nova-compute[75337]:       <entry name="family">Virtual Machine</entry>
Nov 06 15:54:50 user nova-compute[75337]:     </system>
Nov 06 15:54:50 user nova-compute[75337]:   </sysinfo>
Nov 06 15:54:50 user nova-compute[75337]:   <os>
Nov 06 15:54:50 user nova-compute[75337]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 15:54:50 user nova-compute[75337]:     <boot dev="hd"/>
Nov 06 15:54:50 user nova-compute[75337]:     <smbios mode="sysinfo"/>
Nov 06 15:54:50 user nova-compute[75337]:   </os>
Nov 06 15:54:50 user nova-compute[75337]:   <features>
Nov 06 15:54:50 user nova-compute[75337]:     <acpi/>
Nov 06 15:54:50 user nova-compute[75337]:     <apic/>
Nov 06 15:54:50 user nova-compute[75337]:     <vmcoreinfo/>
Nov 06 15:54:50 user nova-compute[75337]:   </features>
Nov 06 15:54:50 user nova-compute[75337]:   <clock offset="utc">
Nov 06 15:54:50 user nova-compute[75337]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 15:54:50 user nova-compute[75337]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 15:54:50 user nova-compute[75337]:     <timer name="hpet" present="no"/>
Nov 06 15:54:50 user nova-compute[75337]:   </clock>
Nov 06 15:54:50 user nova-compute[75337]:   <cpu mode="custom" match="exact">
Nov 06 15:54:50 user nova-compute[75337]:     <model>Nehalem</model>
Nov 06 15:54:50 user nova-compute[75337]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 15:54:50 user nova-compute[75337]:   </cpu>
Nov 06 15:54:50 user nova-compute[75337]:   <devices>
Nov 06 15:54:50 user nova-compute[75337]:     <disk type="file" device="disk">
Nov 06 15:54:50 user nova-compute[75337]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 15:54:50 user nova-compute[75337]:       <source file="/opt/stack/data/nova/instances/69df3824-b28c-43c0-9f20-52fa956642cc/disk"/>
Nov 06 15:54:50 user nova-compute[75337]:       <target dev="vda" bus="virtio"/>
Nov 06 15:54:50 user nova-compute[75337]:     </disk>
Nov 06 15:54:50 user nova-compute[75337]:     <interface type="ethernet">
Nov 06 15:54:50 user nova-compute[75337]:       <mac address="fa:16:3e:7e:b4:bf"/>
Nov 06 15:54:50 user nova-compute[75337]:       <model type="virtio"/>
Nov 06 15:54:50 user nova-compute[75337]:       <mtu size="1442"/>
Nov 06 15:54:50 user nova-compute[75337]:       <target dev="tapc3d051e2-c3"/>
Nov 06 15:54:50 user nova-compute[75337]:     </interface>
Nov 06 15:54:50 user nova-compute[75337]:     <serial type="pty">
Nov 06 15:54:50 user nova-compute[75337]:       <log file="/opt/stack/data/nova/instances/69df3824-b28c-43c0-9f20-52fa956642cc/console.log" append="off"/>
Nov 06 15:54:50 user nova-compute[75337]:     </serial>
Nov 06 15:54:50 user nova-compute[75337]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 15:54:50 user nova-compute[75337]:     <video>
Nov 06 15:54:50 user nova-compute[75337]:       <model type="virtio"/>
Nov 06 15:54:50 user nova-compute[75337]:     </video>
Nov 06 15:54:50 user nova-compute[75337]:     <rng model="virtio">
Nov 06 15:54:50 user nova-compute[75337]:       <backend model="random">/dev/urandom</backend>
Nov 06 15:54:50 user nova-compute[75337]:     </rng>
Nov 06 15:54:50 user nova-compute[75337]:     <controller type="usb" index="0" model="none"/>
Nov 06 15:54:50 user nova-compute[75337]:     <memballoon model="virtio">
Nov 06 15:54:50 user nova-compute[75337]:       <stats period="10"/>
Nov 06 15:54:50 user nova-compute[75337]:     </memballoon>
Nov 06 15:54:50 user nova-compute[75337]:   </devices>
Nov 06 15:54:50 user nova-compute[75337]: </domain>
Nov 06 15:54:50 user nova-compute[75337]:  {{(pid=75337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 15:54:50 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-0b019cdf-eba8-45d4-bdd1-8ce111b3d028 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T15:54:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1515449710',display_name='tempest-AttachVolumeTestJSON-server-1515449710',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1515449710',id=32,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOuljMPp9i9MDAKWBD5G58tmj+9Tb6PUeli8EGD2jPfBvIyOYYOj/xbR7lXnFQzbgbAGvrz08EfcDEZH0CAoflAb7Id49fT3SM4gKBFBAbvsmqhfX3tP82mW2VMhPkafYg==',key_name='tempest-keypair-396223312',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='98fac9096a3b4f21ba805ba1437d9d38',ramdisk_id='',reservation_id='r-ynykuy84',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-636759182',owner_user_name='tempest-AttachVolumeTestJSON-636759182-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T15:54:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ef1008574bea4cfca8a20b2edcf0aacd',uuid=69df3824-b28c-43c0-9f20-52fa956642cc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c3d051e2-c3b7-4ee0-aab0-dcf3c0d1d578", "address": "fa:16:3e:7e:b4:bf", "network": {"id": "8b217731-de9e-49bc-84bb-130fd42ede51", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-314618758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98fac9096a3b4f21ba805ba1437d9d38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3d051e2-c3", "ovs_interfaceid": "c3d051e2-c3b7-4ee0-aab0-dcf3c0d1d578", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 15:54:50 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-0b019cdf-eba8-45d4-bdd1-8ce111b3d028 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Converting VIF {"id": "c3d051e2-c3b7-4ee0-aab0-dcf3c0d1d578", "address": "fa:16:3e:7e:b4:bf", "network": {"id": "8b217731-de9e-49bc-84bb-130fd42ede51", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-314618758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98fac9096a3b4f21ba805ba1437d9d38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3d051e2-c3", "ovs_interfaceid": "c3d051e2-c3b7-4ee0-aab0-dcf3c0d1d578", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 15:54:50 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-0b019cdf-eba8-45d4-bdd1-8ce111b3d028 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:b4:bf,bridge_name='br-int',has_traffic_filtering=True,id=c3d051e2-c3b7-4ee0-aab0-dcf3c0d1d578,network=Network(8b217731-de9e-49bc-84bb-130fd42ede51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3d051e2-c3') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 15:54:50 user nova-compute[75337]: DEBUG os_vif [None req-0b019cdf-eba8-45d4-bdd1-8ce111b3d028 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:b4:bf,bridge_name='br-int',has_traffic_filtering=True,id=c3d051e2-c3b7-4ee0-aab0-dcf3c0d1d578,network=Network(8b217731-de9e-49bc-84bb-130fd42ede51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3d051e2-c3') {{(pid=75337) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 15:54:50 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:54:50 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:54:50 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 15:54:50 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:54:50 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a1c5462e-d3d3-518f-b0be-d8b7089a6f60', '_type': 'linux-noop'}}, row=False) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:54:50 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:54:50 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:54:50 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:54:50 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc3d051e2-c3, may_exist=True, interface_attrs={}) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:54:50 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc3d051e2-c3, col_values=(('qos', UUID('3fc3e8f3-033d-4cce-a1c5-e0e8aa65b217')),), if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:54:50 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc3d051e2-c3, col_values=(('external_ids', {'iface-id': 'c3d051e2-c3b7-4ee0-aab0-dcf3c0d1d578', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7e:b4:bf', 'vm-uuid': '69df3824-b28c-43c0-9f20-52fa956642cc'}),), if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:54:50 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:54:50 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:54:50 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:54:50 user nova-compute[75337]: INFO os_vif [None req-0b019cdf-eba8-45d4-bdd1-8ce111b3d028 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:b4:bf,bridge_name='br-int',has_traffic_filtering=True,id=c3d051e2-c3b7-4ee0-aab0-dcf3c0d1d578,network=Network(8b217731-de9e-49bc-84bb-130fd42ede51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3d051e2-c3')
Nov 06 15:54:50 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-0b019cdf-eba8-45d4-bdd1-8ce111b3d028 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] No BDM found with device name vda, not building metadata. {{(pid=75337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 15:54:50 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-0b019cdf-eba8-45d4-bdd1-8ce111b3d028 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] No VIF found with MAC fa:16:3e:7e:b4:bf, not building metadata {{(pid=75337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 15:54:52 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:54:52 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:54:52 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:54:52 user nova-compute[75337]: DEBUG nova.compute.manager [req-3571b4ec-21fd-4d1f-9932-dfd91b783129 req-c7fe2545-a8f7-411b-8297-d9d526ee3515 service nova] [instance: 69df3824-b28c-43c0-9f20-52fa956642cc] Received event network-vif-plugged-c3d051e2-c3b7-4ee0-aab0-dcf3c0d1d578 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:54:52 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-3571b4ec-21fd-4d1f-9932-dfd91b783129 req-c7fe2545-a8f7-411b-8297-d9d526ee3515 service nova] Acquiring lock "69df3824-b28c-43c0-9f20-52fa956642cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:54:52 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-3571b4ec-21fd-4d1f-9932-dfd91b783129 req-c7fe2545-a8f7-411b-8297-d9d526ee3515 service nova] Lock "69df3824-b28c-43c0-9f20-52fa956642cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:54:52 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-3571b4ec-21fd-4d1f-9932-dfd91b783129 req-c7fe2545-a8f7-411b-8297-d9d526ee3515 service nova] Lock "69df3824-b28c-43c0-9f20-52fa956642cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:54:52 user nova-compute[75337]: DEBUG nova.compute.manager [req-3571b4ec-21fd-4d1f-9932-dfd91b783129 req-c7fe2545-a8f7-411b-8297-d9d526ee3515 service nova] [instance: 69df3824-b28c-43c0-9f20-52fa956642cc] No waiting events found dispatching network-vif-plugged-c3d051e2-c3b7-4ee0-aab0-dcf3c0d1d578 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:54:52 user nova-compute[75337]: WARNING nova.compute.manager [req-3571b4ec-21fd-4d1f-9932-dfd91b783129 req-c7fe2545-a8f7-411b-8297-d9d526ee3515 service nova] [instance: 69df3824-b28c-43c0-9f20-52fa956642cc] Received unexpected event network-vif-plugged-c3d051e2-c3b7-4ee0-aab0-dcf3c0d1d578 for instance with vm_state building and task_state spawning.
Nov 06 15:54:52 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:54:52 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:54:54 user nova-compute[75337]: DEBUG nova.compute.manager [None req-0b019cdf-eba8-45d4-bdd1-8ce111b3d028 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] [instance: 69df3824-b28c-43c0-9f20-52fa956642cc] Instance event wait completed in 0 seconds for  {{(pid=75337) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 15:54:54 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-0b019cdf-eba8-45d4-bdd1-8ce111b3d028 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] [instance: 69df3824-b28c-43c0-9f20-52fa956642cc] Guest created on hypervisor {{(pid=75337) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 15:54:54 user nova-compute[75337]: INFO nova.virt.libvirt.driver [-] [instance: 69df3824-b28c-43c0-9f20-52fa956642cc] Instance spawned successfully.
Nov 06 15:54:54 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-0b019cdf-eba8-45d4-bdd1-8ce111b3d028 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] [instance: 69df3824-b28c-43c0-9f20-52fa956642cc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 15:54:54 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:54:54 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-0b019cdf-eba8-45d4-bdd1-8ce111b3d028 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] [instance: 69df3824-b28c-43c0-9f20-52fa956642cc] Found default for hw_cdrom_bus of ide {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:54:54 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-0b019cdf-eba8-45d4-bdd1-8ce111b3d028 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] [instance: 69df3824-b28c-43c0-9f20-52fa956642cc] Found default for hw_disk_bus of virtio {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:54:54 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-0b019cdf-eba8-45d4-bdd1-8ce111b3d028 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] [instance: 69df3824-b28c-43c0-9f20-52fa956642cc] Found default for hw_input_bus of None {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:54:54 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-0b019cdf-eba8-45d4-bdd1-8ce111b3d028 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] [instance: 69df3824-b28c-43c0-9f20-52fa956642cc] Found default for hw_pointer_model of None {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:54:54 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-0b019cdf-eba8-45d4-bdd1-8ce111b3d028 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] [instance: 69df3824-b28c-43c0-9f20-52fa956642cc] Found default for hw_video_model of virtio {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:54:54 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-0b019cdf-eba8-45d4-bdd1-8ce111b3d028 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] [instance: 69df3824-b28c-43c0-9f20-52fa956642cc] Found default for hw_vif_model of virtio {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:54:54 user nova-compute[75337]: INFO nova.compute.manager [None req-0b019cdf-eba8-45d4-bdd1-8ce111b3d028 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] [instance: 69df3824-b28c-43c0-9f20-52fa956642cc] Took 6.96 seconds to spawn the instance on the hypervisor.
Nov 06 15:54:54 user nova-compute[75337]: DEBUG nova.compute.manager [None req-0b019cdf-eba8-45d4-bdd1-8ce111b3d028 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] [instance: 69df3824-b28c-43c0-9f20-52fa956642cc] Checking state {{(pid=75337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 15:54:54 user nova-compute[75337]: DEBUG nova.compute.manager [req-3c22c37b-011d-45f2-b1d8-3de647649a22 req-4814f1f5-fb82-4981-9dd0-38c73a500eb9 service nova] [instance: 69df3824-b28c-43c0-9f20-52fa956642cc] Received event network-vif-plugged-c3d051e2-c3b7-4ee0-aab0-dcf3c0d1d578 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:54:54 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-3c22c37b-011d-45f2-b1d8-3de647649a22 req-4814f1f5-fb82-4981-9dd0-38c73a500eb9 service nova] Acquiring lock "69df3824-b28c-43c0-9f20-52fa956642cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:54:54 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-3c22c37b-011d-45f2-b1d8-3de647649a22 req-4814f1f5-fb82-4981-9dd0-38c73a500eb9 service nova] Lock "69df3824-b28c-43c0-9f20-52fa956642cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:54:54 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-3c22c37b-011d-45f2-b1d8-3de647649a22 req-4814f1f5-fb82-4981-9dd0-38c73a500eb9 service nova] Lock "69df3824-b28c-43c0-9f20-52fa956642cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:54:54 user nova-compute[75337]: DEBUG nova.compute.manager [req-3c22c37b-011d-45f2-b1d8-3de647649a22 req-4814f1f5-fb82-4981-9dd0-38c73a500eb9 service nova] [instance: 69df3824-b28c-43c0-9f20-52fa956642cc] No waiting events found dispatching network-vif-plugged-c3d051e2-c3b7-4ee0-aab0-dcf3c0d1d578 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:54:54 user nova-compute[75337]: WARNING nova.compute.manager [req-3c22c37b-011d-45f2-b1d8-3de647649a22 req-4814f1f5-fb82-4981-9dd0-38c73a500eb9 service nova] [instance: 69df3824-b28c-43c0-9f20-52fa956642cc] Received unexpected event network-vif-plugged-c3d051e2-c3b7-4ee0-aab0-dcf3c0d1d578 for instance with vm_state building and task_state spawning.
Nov 06 15:54:54 user nova-compute[75337]: INFO nova.compute.manager [None req-0b019cdf-eba8-45d4-bdd1-8ce111b3d028 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] [instance: 69df3824-b28c-43c0-9f20-52fa956642cc] Took 7.71 seconds to build instance.
Nov 06 15:54:54 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-0b019cdf-eba8-45d4-bdd1-8ce111b3d028 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Lock "69df3824-b28c-43c0-9f20-52fa956642cc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.831s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:54:55 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:54:59 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._sync_power_states {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:54:59 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Triggering sync for uuid a293c354-d1e5-4c33-9e7b-d1558235aaf8 {{(pid=75337) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 06 15:54:59 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Triggering sync for uuid 30c634ff-6999-40aa-a90d-1db6d278b571 {{(pid=75337) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 06 15:54:59 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Triggering sync for uuid 6110b34a-6fd3-45fc-911d-4e5d3c7f2d78 {{(pid=75337) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 06 15:54:59 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Triggering sync for uuid 88e07d6a-1202-4703-abf2-5980a7cfa15d {{(pid=75337) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 06 15:54:59 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Triggering sync for uuid d10b4a86-8b0d-423f-81e2-87f5f25a2467 {{(pid=75337) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 06 15:54:59 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Triggering sync for uuid 453c580f-6028-4ea9-87fc-66f3834f0bee {{(pid=75337) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 06 15:54:59 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Triggering sync for uuid 69df3824-b28c-43c0-9f20-52fa956642cc {{(pid=75337) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 06 15:54:59 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "a293c354-d1e5-4c33-9e7b-d1558235aaf8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:54:59 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "a293c354-d1e5-4c33-9e7b-d1558235aaf8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:54:59 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "30c634ff-6999-40aa-a90d-1db6d278b571" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:54:59 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "30c634ff-6999-40aa-a90d-1db6d278b571" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:54:59 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "6110b34a-6fd3-45fc-911d-4e5d3c7f2d78" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:54:59 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "6110b34a-6fd3-45fc-911d-4e5d3c7f2d78" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:54:59 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "88e07d6a-1202-4703-abf2-5980a7cfa15d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:54:59 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "88e07d6a-1202-4703-abf2-5980a7cfa15d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:54:59 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "d10b4a86-8b0d-423f-81e2-87f5f25a2467" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:54:59 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "d10b4a86-8b0d-423f-81e2-87f5f25a2467" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:54:59 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "453c580f-6028-4ea9-87fc-66f3834f0bee" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:54:59 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "453c580f-6028-4ea9-87fc-66f3834f0bee" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:54:59 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "69df3824-b28c-43c0-9f20-52fa956642cc" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:54:59 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "69df3824-b28c-43c0-9f20-52fa956642cc" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:54:59 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "a293c354-d1e5-4c33-9e7b-d1558235aaf8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.050s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:54:59 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "30c634ff-6999-40aa-a90d-1db6d278b571" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.053s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:54:59 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "6110b34a-6fd3-45fc-911d-4e5d3c7f2d78" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.053s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:54:59 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "88e07d6a-1202-4703-abf2-5980a7cfa15d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.059s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:54:59 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "d10b4a86-8b0d-423f-81e2-87f5f25a2467" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.084s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:54:59 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "453c580f-6028-4ea9-87fc-66f3834f0bee" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.097s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:54:59 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "69df3824-b28c-43c0-9f20-52fa956642cc" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.115s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:54:59 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:55:00 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:55:00 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-0d367e28-b15e-49dd-88e8-326795a56078 tempest-VolumesNegativeTest-112990104 tempest-VolumesNegativeTest-112990104-project-member] Acquiring lock "88e07d6a-1202-4703-abf2-5980a7cfa15d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:55:00 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-0d367e28-b15e-49dd-88e8-326795a56078 tempest-VolumesNegativeTest-112990104 tempest-VolumesNegativeTest-112990104-project-member] Lock "88e07d6a-1202-4703-abf2-5980a7cfa15d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:55:00 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-0d367e28-b15e-49dd-88e8-326795a56078 tempest-VolumesNegativeTest-112990104 tempest-VolumesNegativeTest-112990104-project-member] Acquiring lock "88e07d6a-1202-4703-abf2-5980a7cfa15d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:55:00 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-0d367e28-b15e-49dd-88e8-326795a56078 tempest-VolumesNegativeTest-112990104 tempest-VolumesNegativeTest-112990104-project-member] Lock "88e07d6a-1202-4703-abf2-5980a7cfa15d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:55:00 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-0d367e28-b15e-49dd-88e8-326795a56078 tempest-VolumesNegativeTest-112990104 tempest-VolumesNegativeTest-112990104-project-member] Lock "88e07d6a-1202-4703-abf2-5980a7cfa15d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:55:00 user nova-compute[75337]: INFO nova.compute.manager [None req-0d367e28-b15e-49dd-88e8-326795a56078 tempest-VolumesNegativeTest-112990104 tempest-VolumesNegativeTest-112990104-project-member] [instance: 88e07d6a-1202-4703-abf2-5980a7cfa15d] Terminating instance
Nov 06 15:55:01 user nova-compute[75337]: DEBUG nova.compute.manager [None req-0d367e28-b15e-49dd-88e8-326795a56078 tempest-VolumesNegativeTest-112990104 tempest-VolumesNegativeTest-112990104-project-member] [instance: 88e07d6a-1202-4703-abf2-5980a7cfa15d] Start destroying the instance on the hypervisor. {{(pid=75337) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 15:55:01 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:55:01 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:55:01 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:55:01 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:55:01 user nova-compute[75337]: DEBUG nova.compute.manager [req-8cd7ca1b-dad9-4ed8-a055-ed6f0f866fbe req-6a3042f2-7c70-4206-920a-158ec311a4c5 service nova] [instance: 88e07d6a-1202-4703-abf2-5980a7cfa15d] Received event network-vif-unplugged-8c31c456-adba-4b37-917e-6148681cfea3 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:55:01 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-8cd7ca1b-dad9-4ed8-a055-ed6f0f866fbe req-6a3042f2-7c70-4206-920a-158ec311a4c5 service nova] Acquiring lock "88e07d6a-1202-4703-abf2-5980a7cfa15d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:55:01 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-8cd7ca1b-dad9-4ed8-a055-ed6f0f866fbe req-6a3042f2-7c70-4206-920a-158ec311a4c5 service nova] Lock "88e07d6a-1202-4703-abf2-5980a7cfa15d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:55:01 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-8cd7ca1b-dad9-4ed8-a055-ed6f0f866fbe req-6a3042f2-7c70-4206-920a-158ec311a4c5 service nova] Lock "88e07d6a-1202-4703-abf2-5980a7cfa15d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:55:01 user nova-compute[75337]: DEBUG nova.compute.manager [req-8cd7ca1b-dad9-4ed8-a055-ed6f0f866fbe req-6a3042f2-7c70-4206-920a-158ec311a4c5 service nova] [instance: 88e07d6a-1202-4703-abf2-5980a7cfa15d] No waiting events found dispatching network-vif-unplugged-8c31c456-adba-4b37-917e-6148681cfea3 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:55:01 user nova-compute[75337]: DEBUG nova.compute.manager [req-8cd7ca1b-dad9-4ed8-a055-ed6f0f866fbe req-6a3042f2-7c70-4206-920a-158ec311a4c5 service nova] [instance: 88e07d6a-1202-4703-abf2-5980a7cfa15d] Received event network-vif-unplugged-8c31c456-adba-4b37-917e-6148681cfea3 for instance with task_state deleting. {{(pid=75337) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 15:55:01 user nova-compute[75337]: INFO nova.virt.libvirt.driver [-] [instance: 88e07d6a-1202-4703-abf2-5980a7cfa15d] Instance destroyed successfully.
Nov 06 15:55:01 user nova-compute[75337]: DEBUG nova.objects.instance [None req-0d367e28-b15e-49dd-88e8-326795a56078 tempest-VolumesNegativeTest-112990104 tempest-VolumesNegativeTest-112990104-project-member] Lazy-loading 'resources' on Instance uuid 88e07d6a-1202-4703-abf2-5980a7cfa15d {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 15:55:01 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-0d367e28-b15e-49dd-88e8-326795a56078 tempest-VolumesNegativeTest-112990104 tempest-VolumesNegativeTest-112990104-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T15:53:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1185446545',display_name='tempest-VolumesNegativeTest-instance-1185446545',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1185446545',id=29,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-06T15:53:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='560875033e144b7388f45682fc334dc9',ramdisk_id='',reservation_id='r-v0qzyura',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-112990104',owner_user_name='tempest-VolumesNegativeTest-112990104-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T15:53:19Z,user_data=None,user_id='fb6f0b5d6286409bbc658b9dfa1466c5',uuid=88e07d6a-1202-4703-abf2-5980a7cfa15d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8c31c456-adba-4b37-917e-6148681cfea3", "address": "fa:16:3e:4a:93:aa", "network": {"id": "c746d36b-79e9-4682-b70e-db94193d24cf", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.191", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "6549a15819f1469bbd5eeae8190e3d44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c31c456-ad", "ovs_interfaceid": "8c31c456-adba-4b37-917e-6148681cfea3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 15:55:01 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-0d367e28-b15e-49dd-88e8-326795a56078 tempest-VolumesNegativeTest-112990104 tempest-VolumesNegativeTest-112990104-project-member] Converting VIF {"id": "8c31c456-adba-4b37-917e-6148681cfea3", "address": "fa:16:3e:4a:93:aa", "network": {"id": "c746d36b-79e9-4682-b70e-db94193d24cf", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.191", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "6549a15819f1469bbd5eeae8190e3d44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c31c456-ad", "ovs_interfaceid": "8c31c456-adba-4b37-917e-6148681cfea3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 15:55:01 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-0d367e28-b15e-49dd-88e8-326795a56078 tempest-VolumesNegativeTest-112990104 tempest-VolumesNegativeTest-112990104-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:93:aa,bridge_name='br-int',has_traffic_filtering=True,id=8c31c456-adba-4b37-917e-6148681cfea3,network=Network(c746d36b-79e9-4682-b70e-db94193d24cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c31c456-ad') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 15:55:01 user nova-compute[75337]: DEBUG os_vif [None req-0d367e28-b15e-49dd-88e8-326795a56078 tempest-VolumesNegativeTest-112990104 tempest-VolumesNegativeTest-112990104-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:93:aa,bridge_name='br-int',has_traffic_filtering=True,id=8c31c456-adba-4b37-917e-6148681cfea3,network=Network(c746d36b-79e9-4682-b70e-db94193d24cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c31c456-ad') {{(pid=75337) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 15:55:01 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:55:01 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8c31c456-ad, bridge=br-int, if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:55:01 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:55:01 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:55:01 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:55:01 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=15a8b348-b1c0-4b91-825f-ecc44c77169d) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:55:01 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:55:01 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:55:01 user nova-compute[75337]: INFO os_vif [None req-0d367e28-b15e-49dd-88e8-326795a56078 tempest-VolumesNegativeTest-112990104 tempest-VolumesNegativeTest-112990104-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:93:aa,bridge_name='br-int',has_traffic_filtering=True,id=8c31c456-adba-4b37-917e-6148681cfea3,network=Network(c746d36b-79e9-4682-b70e-db94193d24cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c31c456-ad')
Nov 06 15:55:01 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-0d367e28-b15e-49dd-88e8-326795a56078 tempest-VolumesNegativeTest-112990104 tempest-VolumesNegativeTest-112990104-project-member] [instance: 88e07d6a-1202-4703-abf2-5980a7cfa15d] Deleting instance files /opt/stack/data/nova/instances/88e07d6a-1202-4703-abf2-5980a7cfa15d_del
Nov 06 15:55:01 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-0d367e28-b15e-49dd-88e8-326795a56078 tempest-VolumesNegativeTest-112990104 tempest-VolumesNegativeTest-112990104-project-member] [instance: 88e07d6a-1202-4703-abf2-5980a7cfa15d] Deletion of /opt/stack/data/nova/instances/88e07d6a-1202-4703-abf2-5980a7cfa15d_del complete
Nov 06 15:55:01 user nova-compute[75337]: INFO nova.compute.manager [None req-0d367e28-b15e-49dd-88e8-326795a56078 tempest-VolumesNegativeTest-112990104 tempest-VolumesNegativeTest-112990104-project-member] [instance: 88e07d6a-1202-4703-abf2-5980a7cfa15d] Took 0.73 seconds to destroy the instance on the hypervisor.
Nov 06 15:55:01 user nova-compute[75337]: DEBUG oslo.service.loopingcall [None req-0d367e28-b15e-49dd-88e8-326795a56078 tempest-VolumesNegativeTest-112990104 tempest-VolumesNegativeTest-112990104-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75337) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 15:55:01 user nova-compute[75337]: DEBUG nova.compute.manager [-] [instance: 88e07d6a-1202-4703-abf2-5980a7cfa15d] Deallocating network for instance {{(pid=75337) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 15:55:01 user nova-compute[75337]: DEBUG nova.network.neutron [-] [instance: 88e07d6a-1202-4703-abf2-5980a7cfa15d] deallocate_for_instance() {{(pid=75337) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 15:55:02 user nova-compute[75337]: DEBUG nova.network.neutron [-] [instance: 88e07d6a-1202-4703-abf2-5980a7cfa15d] Updating instance_info_cache with network_info: [] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:55:02 user nova-compute[75337]: INFO nova.compute.manager [-] [instance: 88e07d6a-1202-4703-abf2-5980a7cfa15d] Took 0.52 seconds to deallocate network for instance.
Nov 06 15:55:02 user nova-compute[75337]: DEBUG nova.compute.manager [req-d2cc725d-ab9d-4938-b80b-b558d6134433 req-912f6d28-7c72-41f8-9168-6f6f739d4af8 service nova] [instance: 88e07d6a-1202-4703-abf2-5980a7cfa15d] Received event network-vif-deleted-8c31c456-adba-4b37-917e-6148681cfea3 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:55:02 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-0d367e28-b15e-49dd-88e8-326795a56078 tempest-VolumesNegativeTest-112990104 tempest-VolumesNegativeTest-112990104-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:55:02 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-0d367e28-b15e-49dd-88e8-326795a56078 tempest-VolumesNegativeTest-112990104 tempest-VolumesNegativeTest-112990104-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:55:02 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-0d367e28-b15e-49dd-88e8-326795a56078 tempest-VolumesNegativeTest-112990104 tempest-VolumesNegativeTest-112990104-project-member] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 15:55:02 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-0d367e28-b15e-49dd-88e8-326795a56078 tempest-VolumesNegativeTest-112990104 tempest-VolumesNegativeTest-112990104-project-member] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 15:55:02 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:55:02 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-0d367e28-b15e-49dd-88e8-326795a56078 tempest-VolumesNegativeTest-112990104 tempest-VolumesNegativeTest-112990104-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.308s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:55:02 user nova-compute[75337]: INFO nova.scheduler.client.report [None req-0d367e28-b15e-49dd-88e8-326795a56078 tempest-VolumesNegativeTest-112990104 tempest-VolumesNegativeTest-112990104-project-member] Deleted allocations for instance 88e07d6a-1202-4703-abf2-5980a7cfa15d
Nov 06 15:55:02 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-0d367e28-b15e-49dd-88e8-326795a56078 tempest-VolumesNegativeTest-112990104 tempest-VolumesNegativeTest-112990104-project-member] Lock "88e07d6a-1202-4703-abf2-5980a7cfa15d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.757s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:55:03 user nova-compute[75337]: DEBUG nova.compute.manager [req-716bfde3-c2a1-4d49-a15a-adc7645918d0 req-c15063cd-afae-4d4a-b0f5-c7c75258fbab service nova] [instance: 88e07d6a-1202-4703-abf2-5980a7cfa15d] Received event network-vif-plugged-8c31c456-adba-4b37-917e-6148681cfea3 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:55:03 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-716bfde3-c2a1-4d49-a15a-adc7645918d0 req-c15063cd-afae-4d4a-b0f5-c7c75258fbab service nova] Acquiring lock "88e07d6a-1202-4703-abf2-5980a7cfa15d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:55:03 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-716bfde3-c2a1-4d49-a15a-adc7645918d0 req-c15063cd-afae-4d4a-b0f5-c7c75258fbab service nova] Lock "88e07d6a-1202-4703-abf2-5980a7cfa15d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:55:03 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-716bfde3-c2a1-4d49-a15a-adc7645918d0 req-c15063cd-afae-4d4a-b0f5-c7c75258fbab service nova] Lock "88e07d6a-1202-4703-abf2-5980a7cfa15d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:55:03 user nova-compute[75337]: DEBUG nova.compute.manager [req-716bfde3-c2a1-4d49-a15a-adc7645918d0 req-c15063cd-afae-4d4a-b0f5-c7c75258fbab service nova] [instance: 88e07d6a-1202-4703-abf2-5980a7cfa15d] No waiting events found dispatching network-vif-plugged-8c31c456-adba-4b37-917e-6148681cfea3 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:55:03 user nova-compute[75337]: WARNING nova.compute.manager [req-716bfde3-c2a1-4d49-a15a-adc7645918d0 req-c15063cd-afae-4d4a-b0f5-c7c75258fbab service nova] [instance: 88e07d6a-1202-4703-abf2-5980a7cfa15d] Received unexpected event network-vif-plugged-8c31c456-adba-4b37-917e-6148681cfea3 for instance with vm_state deleted and task_state None.
Nov 06 15:55:04 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:55:05 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:55:05 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:55:05 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:55:05 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75337) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 15:55:06 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:55:06 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:55:07 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:55:09 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:55:10 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:55:10 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Starting heal instance info cache {{(pid=75337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 15:55:10 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Rebuilding the list of instances to heal {{(pid=75337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 06 15:55:10 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "refresh_cache-a293c354-d1e5-4c33-9e7b-d1558235aaf8" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 15:55:10 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquired lock "refresh_cache-a293c354-d1e5-4c33-9e7b-d1558235aaf8" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 15:55:10 user nova-compute[75337]: DEBUG nova.network.neutron [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] [instance: a293c354-d1e5-4c33-9e7b-d1558235aaf8] Forcefully refreshing network info cache for instance {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 15:55:10 user nova-compute[75337]: DEBUG nova.objects.instance [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lazy-loading 'info_cache' on Instance uuid a293c354-d1e5-4c33-9e7b-d1558235aaf8 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 15:55:11 user nova-compute[75337]: DEBUG nova.network.neutron [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] [instance: a293c354-d1e5-4c33-9e7b-d1558235aaf8] Updating instance_info_cache with network_info: [{"id": "29fff93f-08f1-4e46-91db-84ab16f785e5", "address": "fa:16:3e:d7:cf:dd", "network": {"id": "48f1545d-7e80-462f-9dbf-f1102ddcda9a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1210368397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1013e7afbefd4146a3be04587710b1de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29fff93f-08", "ovs_interfaceid": "29fff93f-08f1-4e46-91db-84ab16f785e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:55:11 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Releasing lock "refresh_cache-a293c354-d1e5-4c33-9e7b-d1558235aaf8" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 15:55:11 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] [instance: a293c354-d1e5-4c33-9e7b-d1558235aaf8] Updated the network info_cache for instance {{(pid=75337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 15:55:11 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:55:14 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:55:15 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager.update_available_resource {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:55:15 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:55:15 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:55:15 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:55:15 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Auditing locally available compute resources for user (node: user) {{(pid=75337) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 15:55:15 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/453c580f-6028-4ea9-87fc-66f3834f0bee/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:55:15 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/453c580f-6028-4ea9-87fc-66f3834f0bee/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:55:15 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/453c580f-6028-4ea9-87fc-66f3834f0bee/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:55:16 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/453c580f-6028-4ea9-87fc-66f3834f0bee/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:55:16 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69df3824-b28c-43c0-9f20-52fa956642cc/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:55:16 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69df3824-b28c-43c0-9f20-52fa956642cc/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:55:16 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69df3824-b28c-43c0-9f20-52fa956642cc/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:55:16 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69df3824-b28c-43c0-9f20-52fa956642cc/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:55:16 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a293c354-d1e5-4c33-9e7b-d1558235aaf8/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:55:16 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a293c354-d1e5-4c33-9e7b-d1558235aaf8/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:55:16 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a293c354-d1e5-4c33-9e7b-d1558235aaf8/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:55:16 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:55:16 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a293c354-d1e5-4c33-9e7b-d1558235aaf8/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:55:16 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30c634ff-6999-40aa-a90d-1db6d278b571/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:55:16 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30c634ff-6999-40aa-a90d-1db6d278b571/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:55:16 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30c634ff-6999-40aa-a90d-1db6d278b571/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:55:17 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30c634ff-6999-40aa-a90d-1db6d278b571/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:55:17 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6110b34a-6fd3-45fc-911d-4e5d3c7f2d78/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:55:17 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6110b34a-6fd3-45fc-911d-4e5d3c7f2d78/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:55:17 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6110b34a-6fd3-45fc-911d-4e5d3c7f2d78/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:55:17 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6110b34a-6fd3-45fc-911d-4e5d3c7f2d78/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:55:17 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d10b4a86-8b0d-423f-81e2-87f5f25a2467/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:55:17 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d10b4a86-8b0d-423f-81e2-87f5f25a2467/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:55:17 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d10b4a86-8b0d-423f-81e2-87f5f25a2467/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:55:17 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d10b4a86-8b0d-423f-81e2-87f5f25a2467/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:55:18 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 15:55:18 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 15:55:18 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Hypervisor/Node resource view: name=user free_ram=7955MB free_disk=25.11642837524414GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75337) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 15:55:18 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:55:18 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:55:18 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance a293c354-d1e5-4c33-9e7b-d1558235aaf8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:55:18 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 30c634ff-6999-40aa-a90d-1db6d278b571 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:55:18 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 6110b34a-6fd3-45fc-911d-4e5d3c7f2d78 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:55:18 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance d10b4a86-8b0d-423f-81e2-87f5f25a2467 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:55:18 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 453c580f-6028-4ea9-87fc-66f3834f0bee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:55:18 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 69df3824-b28c-43c0-9f20-52fa956642cc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:55:18 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 15:55:18 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 15:55:18 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 15:55:18 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 15:55:18 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Compute_service record updated for user:user {{(pid=75337) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 15:55:18 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.336s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:55:19 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:55:21 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:55:24 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:55:26 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:55:26 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:55:31 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:55:31 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:55:31 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75337) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 15:55:31 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 15:55:31 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 15:55:31 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:55:32 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-4d1180fb-e93c-414f-a8ef-a43341c0212f tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Acquiring lock "d10b4a86-8b0d-423f-81e2-87f5f25a2467" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:55:32 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-4d1180fb-e93c-414f-a8ef-a43341c0212f tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Lock "d10b4a86-8b0d-423f-81e2-87f5f25a2467" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:55:32 user nova-compute[75337]: DEBUG nova.objects.instance [None req-4d1180fb-e93c-414f-a8ef-a43341c0212f tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Lazy-loading 'flavor' on Instance uuid d10b4a86-8b0d-423f-81e2-87f5f25a2467 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 15:55:32 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-4d1180fb-e93c-414f-a8ef-a43341c0212f tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Lock "d10b4a86-8b0d-423f-81e2-87f5f25a2467" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:55:32 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-4d1180fb-e93c-414f-a8ef-a43341c0212f tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Acquiring lock "d10b4a86-8b0d-423f-81e2-87f5f25a2467" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:55:32 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-4d1180fb-e93c-414f-a8ef-a43341c0212f tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Lock "d10b4a86-8b0d-423f-81e2-87f5f25a2467" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:55:32 user nova-compute[75337]: INFO nova.compute.manager [None req-4d1180fb-e93c-414f-a8ef-a43341c0212f tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] [instance: d10b4a86-8b0d-423f-81e2-87f5f25a2467] Attaching volume 326a132a-07d4-4085-8da9-ffa8444121b5 to /dev/vdb
Nov 06 15:55:32 user nova-compute[75337]: DEBUG os_brick.utils [None req-4d1180fb-e93c-414f-a8ef-a43341c0212f tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 15:55:32 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:55:32 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:55:32 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dc94b12-722e-4b65-900e-f05c87e77f18]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4ff6411e45b8\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:55:32 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:55:32 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:55:32 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3c83b49-985f-48a5-a513-a299acb875a5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:55:32 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:55:32 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:55:32 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[e849d07c-8123-4002-ae74-b85862c2579c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:55:32 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[02166db8-3c7c-4a30-8e73-0fea1b2f1151]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:55:32 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-4d1180fb-e93c-414f-a8ef-a43341c0212f tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Running cmd (subprocess): nvme version {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:55:32 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-4d1180fb-e93c-414f-a8ef-a43341c0212f tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] 'nvme version' failed. Not Retrying. {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 15:55:32 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4d1180fb-e93c-414f-a8ef-a43341c0212f tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] nvme not present on system {{(pid=75337) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 15:55:32 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:55:32 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 15:55:32 user nova-compute[75337]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 15:55:32 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fe47ac4-75d5-4f36-9489-1ec0f2ba7a49]: (4, '') {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:55:32 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.lightos [None req-4d1180fb-e93c-414f-a8ef-a43341c0212f tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75337) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 15:55:32 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.lightos [None req-4d1180fb-e93c-414f-a8ef-a43341c0212f tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 15:55:32 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.lightos [None req-4d1180fb-e93c-414f-a8ef-a43341c0212f tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] LIGHTOS: no hostnqn found. {{(pid=75337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 15:55:32 user nova-compute[75337]: DEBUG os_brick.utils [None req-4d1180fb-e93c-414f-a8ef-a43341c0212f tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4ff6411e45b8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 15:55:32 user nova-compute[75337]: DEBUG nova.virt.block_device [None req-4d1180fb-e93c-414f-a8ef-a43341c0212f tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] [instance: d10b4a86-8b0d-423f-81e2-87f5f25a2467] Updating existing volume attachment record: a8ebd3a5-df89-4405-ad87-379798ba68e2 {{(pid=75337) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 15:55:33 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-c9145904-5f7b-42e5-8f33-9e86659dbfdc tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] Acquiring lock "453c580f-6028-4ea9-87fc-66f3834f0bee" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:55:33 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-c9145904-5f7b-42e5-8f33-9e86659dbfdc tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] Lock "453c580f-6028-4ea9-87fc-66f3834f0bee" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:55:33 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-c9145904-5f7b-42e5-8f33-9e86659dbfdc tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] Acquiring lock "453c580f-6028-4ea9-87fc-66f3834f0bee-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:55:33 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-c9145904-5f7b-42e5-8f33-9e86659dbfdc tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] Lock "453c580f-6028-4ea9-87fc-66f3834f0bee-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:55:33 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-c9145904-5f7b-42e5-8f33-9e86659dbfdc tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] Lock "453c580f-6028-4ea9-87fc-66f3834f0bee-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:55:33 user nova-compute[75337]: INFO nova.compute.manager [None req-c9145904-5f7b-42e5-8f33-9e86659dbfdc tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] [instance: 453c580f-6028-4ea9-87fc-66f3834f0bee] Terminating instance
Nov 06 15:55:33 user nova-compute[75337]: DEBUG nova.compute.manager [None req-c9145904-5f7b-42e5-8f33-9e86659dbfdc tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] [instance: 453c580f-6028-4ea9-87fc-66f3834f0bee] Start destroying the instance on the hypervisor. {{(pid=75337) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 15:55:33 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:55:33 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:55:33 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:55:34 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:55:34 user nova-compute[75337]: DEBUG nova.compute.manager [req-b7386de5-ce09-4a4c-83f4-663dad844486 req-62cf45f8-180a-40b8-b005-50badc830600 service nova] [instance: 453c580f-6028-4ea9-87fc-66f3834f0bee] Received event network-vif-unplugged-c8b8e3bc-c60d-4481-845f-97bfc6e8592d {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:55:34 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-b7386de5-ce09-4a4c-83f4-663dad844486 req-62cf45f8-180a-40b8-b005-50badc830600 service nova] Acquiring lock "453c580f-6028-4ea9-87fc-66f3834f0bee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:55:34 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-b7386de5-ce09-4a4c-83f4-663dad844486 req-62cf45f8-180a-40b8-b005-50badc830600 service nova] Lock "453c580f-6028-4ea9-87fc-66f3834f0bee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:55:34 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-b7386de5-ce09-4a4c-83f4-663dad844486 req-62cf45f8-180a-40b8-b005-50badc830600 service nova] Lock "453c580f-6028-4ea9-87fc-66f3834f0bee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:55:34 user nova-compute[75337]: DEBUG nova.compute.manager [req-b7386de5-ce09-4a4c-83f4-663dad844486 req-62cf45f8-180a-40b8-b005-50badc830600 service nova] [instance: 453c580f-6028-4ea9-87fc-66f3834f0bee] No waiting events found dispatching network-vif-unplugged-c8b8e3bc-c60d-4481-845f-97bfc6e8592d {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:55:34 user nova-compute[75337]: DEBUG nova.compute.manager [req-b7386de5-ce09-4a4c-83f4-663dad844486 req-62cf45f8-180a-40b8-b005-50badc830600 service nova] [instance: 453c580f-6028-4ea9-87fc-66f3834f0bee] Received event network-vif-unplugged-c8b8e3bc-c60d-4481-845f-97bfc6e8592d for instance with task_state deleting. {{(pid=75337) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 15:55:34 user nova-compute[75337]: INFO nova.virt.libvirt.driver [-] [instance: 453c580f-6028-4ea9-87fc-66f3834f0bee] Instance destroyed successfully.
Nov 06 15:55:34 user nova-compute[75337]: DEBUG nova.objects.instance [None req-c9145904-5f7b-42e5-8f33-9e86659dbfdc tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] Lazy-loading 'resources' on Instance uuid 453c580f-6028-4ea9-87fc-66f3834f0bee {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 15:55:34 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-c9145904-5f7b-42e5-8f33-9e86659dbfdc tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T15:53:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1284458469',display_name='tempest-ServersNegativeTestJSON-server-1284458469',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1284458469',id=31,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-06T15:53:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e13dfd402b7b4ed1a1092c7388ff5188',ramdisk_id='',reservation_id='r-3dwgi04v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-624109021',owner_user_name='tempest-ServersNegativeTestJSON-624109021-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T15:53:50Z,user_data=None,user_id='5691e9e1923f4f2e9fdd3a39d8d7ff20',uuid=453c580f-6028-4ea9-87fc-66f3834f0bee,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c8b8e3bc-c60d-4481-845f-97bfc6e8592d", "address": "fa:16:3e:c6:4d:4d", "network": {"id": "6757c3a5-4f6f-48a7-9645-af433fb039de", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1337373982-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e13dfd402b7b4ed1a1092c7388ff5188", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8b8e3bc-c6", "ovs_interfaceid": "c8b8e3bc-c60d-4481-845f-97bfc6e8592d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 15:55:34 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-c9145904-5f7b-42e5-8f33-9e86659dbfdc tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] Converting VIF {"id": "c8b8e3bc-c60d-4481-845f-97bfc6e8592d", "address": "fa:16:3e:c6:4d:4d", "network": {"id": "6757c3a5-4f6f-48a7-9645-af433fb039de", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1337373982-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e13dfd402b7b4ed1a1092c7388ff5188", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8b8e3bc-c6", "ovs_interfaceid": "c8b8e3bc-c60d-4481-845f-97bfc6e8592d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 15:55:34 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-c9145904-5f7b-42e5-8f33-9e86659dbfdc tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:4d:4d,bridge_name='br-int',has_traffic_filtering=True,id=c8b8e3bc-c60d-4481-845f-97bfc6e8592d,network=Network(6757c3a5-4f6f-48a7-9645-af433fb039de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8b8e3bc-c6') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 15:55:34 user nova-compute[75337]: DEBUG os_vif [None req-c9145904-5f7b-42e5-8f33-9e86659dbfdc tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:4d:4d,bridge_name='br-int',has_traffic_filtering=True,id=c8b8e3bc-c60d-4481-845f-97bfc6e8592d,network=Network(6757c3a5-4f6f-48a7-9645-af433fb039de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8b8e3bc-c6') {{(pid=75337) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 15:55:34 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:55:34 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc8b8e3bc-c6, bridge=br-int, if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:55:34 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:55:34 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:55:34 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:55:34 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f36d85e9-b2f8-4a6d-9b14-0efacd667b53) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:55:34 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:55:34 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:55:34 user nova-compute[75337]: INFO os_vif [None req-c9145904-5f7b-42e5-8f33-9e86659dbfdc tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:4d:4d,bridge_name='br-int',has_traffic_filtering=True,id=c8b8e3bc-c60d-4481-845f-97bfc6e8592d,network=Network(6757c3a5-4f6f-48a7-9645-af433fb039de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8b8e3bc-c6')
Nov 06 15:55:34 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-c9145904-5f7b-42e5-8f33-9e86659dbfdc tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] [instance: 453c580f-6028-4ea9-87fc-66f3834f0bee] Deleting instance files /opt/stack/data/nova/instances/453c580f-6028-4ea9-87fc-66f3834f0bee_del
Nov 06 15:55:34 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-c9145904-5f7b-42e5-8f33-9e86659dbfdc tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] [instance: 453c580f-6028-4ea9-87fc-66f3834f0bee] Deletion of /opt/stack/data/nova/instances/453c580f-6028-4ea9-87fc-66f3834f0bee_del complete
Nov 06 15:55:34 user nova-compute[75337]: INFO nova.compute.manager [None req-c9145904-5f7b-42e5-8f33-9e86659dbfdc tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] [instance: 453c580f-6028-4ea9-87fc-66f3834f0bee] Took 0.68 seconds to destroy the instance on the hypervisor.
Nov 06 15:55:34 user nova-compute[75337]: DEBUG oslo.service.loopingcall [None req-c9145904-5f7b-42e5-8f33-9e86659dbfdc tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75337) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 15:55:34 user nova-compute[75337]: DEBUG nova.compute.manager [-] [instance: 453c580f-6028-4ea9-87fc-66f3834f0bee] Deallocating network for instance {{(pid=75337) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 15:55:34 user nova-compute[75337]: DEBUG nova.network.neutron [-] [instance: 453c580f-6028-4ea9-87fc-66f3834f0bee] deallocate_for_instance() {{(pid=75337) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 15:55:34 user nova-compute[75337]: DEBUG nova.network.neutron [-] [instance: 453c580f-6028-4ea9-87fc-66f3834f0bee] Updating instance_info_cache with network_info: [] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:55:34 user nova-compute[75337]: INFO nova.compute.manager [-] [instance: 453c580f-6028-4ea9-87fc-66f3834f0bee] Took 0.47 seconds to deallocate network for instance.
Nov 06 15:55:34 user nova-compute[75337]: DEBUG nova.compute.manager [req-928c5979-371f-4611-8930-7ff2ceea8160 req-42f4110c-c2fb-4a0c-baaf-af73f151f459 service nova] [instance: 453c580f-6028-4ea9-87fc-66f3834f0bee] Received event network-vif-deleted-c8b8e3bc-c60d-4481-845f-97bfc6e8592d {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:55:34 user nova-compute[75337]: INFO nova.compute.manager [req-928c5979-371f-4611-8930-7ff2ceea8160 req-42f4110c-c2fb-4a0c-baaf-af73f151f459 service nova] [instance: 453c580f-6028-4ea9-87fc-66f3834f0bee] Neutron deleted interface c8b8e3bc-c60d-4481-845f-97bfc6e8592d; detaching it from the instance and deleting it from the info cache
Nov 06 15:55:34 user nova-compute[75337]: DEBUG nova.network.neutron [req-928c5979-371f-4611-8930-7ff2ceea8160 req-42f4110c-c2fb-4a0c-baaf-af73f151f459 service nova] [instance: 453c580f-6028-4ea9-87fc-66f3834f0bee] Updating instance_info_cache with network_info: [] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:55:34 user nova-compute[75337]: DEBUG nova.compute.manager [req-928c5979-371f-4611-8930-7ff2ceea8160 req-42f4110c-c2fb-4a0c-baaf-af73f151f459 service nova] [instance: 453c580f-6028-4ea9-87fc-66f3834f0bee] Detach interface failed, port_id=c8b8e3bc-c60d-4481-845f-97bfc6e8592d, reason: Instance 453c580f-6028-4ea9-87fc-66f3834f0bee could not be found. {{(pid=75337) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 06 15:55:34 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-c9145904-5f7b-42e5-8f33-9e86659dbfdc tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:55:34 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-c9145904-5f7b-42e5-8f33-9e86659dbfdc tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:55:35 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-c9145904-5f7b-42e5-8f33-9e86659dbfdc tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 15:55:35 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-c9145904-5f7b-42e5-8f33-9e86659dbfdc tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 15:55:35 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-c9145904-5f7b-42e5-8f33-9e86659dbfdc tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.221s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:55:35 user nova-compute[75337]: INFO nova.scheduler.client.report [None req-c9145904-5f7b-42e5-8f33-9e86659dbfdc tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] Deleted allocations for instance 453c580f-6028-4ea9-87fc-66f3834f0bee
Nov 06 15:55:35 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-c9145904-5f7b-42e5-8f33-9e86659dbfdc tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] Lock "453c580f-6028-4ea9-87fc-66f3834f0bee" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.591s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:55:36 user nova-compute[75337]: DEBUG nova.compute.manager [req-f8944b10-47eb-452e-b484-1b6f306ac691 req-439cddf6-b52d-41d2-acf3-2ccc18e0f993 service nova] [instance: 453c580f-6028-4ea9-87fc-66f3834f0bee] Received event network-vif-plugged-c8b8e3bc-c60d-4481-845f-97bfc6e8592d {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:55:36 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-f8944b10-47eb-452e-b484-1b6f306ac691 req-439cddf6-b52d-41d2-acf3-2ccc18e0f993 service nova] Acquiring lock "453c580f-6028-4ea9-87fc-66f3834f0bee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:55:36 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-f8944b10-47eb-452e-b484-1b6f306ac691 req-439cddf6-b52d-41d2-acf3-2ccc18e0f993 service nova] Lock "453c580f-6028-4ea9-87fc-66f3834f0bee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:55:36 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-f8944b10-47eb-452e-b484-1b6f306ac691 req-439cddf6-b52d-41d2-acf3-2ccc18e0f993 service nova] Lock "453c580f-6028-4ea9-87fc-66f3834f0bee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:55:36 user nova-compute[75337]: DEBUG nova.compute.manager [req-f8944b10-47eb-452e-b484-1b6f306ac691 req-439cddf6-b52d-41d2-acf3-2ccc18e0f993 service nova] [instance: 453c580f-6028-4ea9-87fc-66f3834f0bee] No waiting events found dispatching network-vif-plugged-c8b8e3bc-c60d-4481-845f-97bfc6e8592d {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:55:36 user nova-compute[75337]: WARNING nova.compute.manager [req-f8944b10-47eb-452e-b484-1b6f306ac691 req-439cddf6-b52d-41d2-acf3-2ccc18e0f993 service nova] [instance: 453c580f-6028-4ea9-87fc-66f3834f0bee] Received unexpected event network-vif-plugged-c8b8e3bc-c60d-4481-845f-97bfc6e8592d for instance with vm_state deleted and task_state None.
Nov 06 15:55:39 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:55:41 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-34753e42-7695-4011-ad77-f2abf4aa998d tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Acquiring lock "5248533a-89b6-444e-a60a-154b3cdef815" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:55:41 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-34753e42-7695-4011-ad77-f2abf4aa998d tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Lock "5248533a-89b6-444e-a60a-154b3cdef815" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:55:41 user nova-compute[75337]: DEBUG nova.compute.manager [None req-34753e42-7695-4011-ad77-f2abf4aa998d tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: 5248533a-89b6-444e-a60a-154b3cdef815] Starting instance... {{(pid=75337) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 15:55:41 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-34753e42-7695-4011-ad77-f2abf4aa998d tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:55:41 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-34753e42-7695-4011-ad77-f2abf4aa998d tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:55:41 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-34753e42-7695-4011-ad77-f2abf4aa998d tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75337) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 15:55:41 user nova-compute[75337]: INFO nova.compute.claims [None req-34753e42-7695-4011-ad77-f2abf4aa998d tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: 5248533a-89b6-444e-a60a-154b3cdef815] Claim successful on node user
Nov 06 15:55:42 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-34753e42-7695-4011-ad77-f2abf4aa998d tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 15:55:42 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-34753e42-7695-4011-ad77-f2abf4aa998d tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 15:55:42 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-34753e42-7695-4011-ad77-f2abf4aa998d tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.414s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:55:42 user nova-compute[75337]: DEBUG nova.compute.manager [None req-34753e42-7695-4011-ad77-f2abf4aa998d tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: 5248533a-89b6-444e-a60a-154b3cdef815] Start building networks asynchronously for instance. {{(pid=75337) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 15:55:42 user nova-compute[75337]: DEBUG nova.compute.manager [None req-34753e42-7695-4011-ad77-f2abf4aa998d tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: 5248533a-89b6-444e-a60a-154b3cdef815] Allocating IP information in the background. {{(pid=75337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 15:55:42 user nova-compute[75337]: DEBUG nova.network.neutron [None req-34753e42-7695-4011-ad77-f2abf4aa998d tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: 5248533a-89b6-444e-a60a-154b3cdef815] allocate_for_instance() {{(pid=75337) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 15:55:42 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-34753e42-7695-4011-ad77-f2abf4aa998d tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: 5248533a-89b6-444e-a60a-154b3cdef815] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 15:55:42 user nova-compute[75337]: DEBUG nova.compute.manager [None req-34753e42-7695-4011-ad77-f2abf4aa998d tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: 5248533a-89b6-444e-a60a-154b3cdef815] Start building block device mappings for instance. {{(pid=75337) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 15:55:42 user nova-compute[75337]: DEBUG nova.policy [None req-34753e42-7695-4011-ad77-f2abf4aa998d tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2e47bf9ad49645deb2c1f834938fa39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243647103fd44f629e0f40be0b56407e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75337) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 15:55:42 user nova-compute[75337]: DEBUG nova.compute.manager [None req-34753e42-7695-4011-ad77-f2abf4aa998d tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: 5248533a-89b6-444e-a60a-154b3cdef815] Start spawning the instance on the hypervisor. {{(pid=75337) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 15:55:42 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-34753e42-7695-4011-ad77-f2abf4aa998d tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: 5248533a-89b6-444e-a60a-154b3cdef815] Creating instance directory {{(pid=75337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 15:55:42 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-34753e42-7695-4011-ad77-f2abf4aa998d tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: 5248533a-89b6-444e-a60a-154b3cdef815] Creating image(s)
Nov 06 15:55:42 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-34753e42-7695-4011-ad77-f2abf4aa998d tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Acquiring lock "/opt/stack/data/nova/instances/5248533a-89b6-444e-a60a-154b3cdef815/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:55:42 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-34753e42-7695-4011-ad77-f2abf4aa998d tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Lock "/opt/stack/data/nova/instances/5248533a-89b6-444e-a60a-154b3cdef815/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:55:42 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-34753e42-7695-4011-ad77-f2abf4aa998d tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Lock "/opt/stack/data/nova/instances/5248533a-89b6-444e-a60a-154b3cdef815/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:55:42 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-34753e42-7695-4011-ad77-f2abf4aa998d tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:55:42 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-34753e42-7695-4011-ad77-f2abf4aa998d tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json" returned: 0 in 0.236s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:55:42 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-34753e42-7695-4011-ad77-f2abf4aa998d tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Acquiring lock "06ba3c914798499e686c5ac75886932347225275" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:55:42 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-34753e42-7695-4011-ad77-f2abf4aa998d tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Lock "06ba3c914798499e686c5ac75886932347225275" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:55:42 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-34753e42-7695-4011-ad77-f2abf4aa998d tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:55:42 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-34753e42-7695-4011-ad77-f2abf4aa998d tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json" returned: 0 in 0.204s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:55:42 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-34753e42-7695-4011-ad77-f2abf4aa998d tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275,backing_fmt=raw /opt/stack/data/nova/instances/5248533a-89b6-444e-a60a-154b3cdef815/disk 1073741824 {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:55:43 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-34753e42-7695-4011-ad77-f2abf4aa998d tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275,backing_fmt=raw /opt/stack/data/nova/instances/5248533a-89b6-444e-a60a-154b3cdef815/disk 1073741824" returned: 0 in 0.053s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:55:43 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-34753e42-7695-4011-ad77-f2abf4aa998d tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Lock "06ba3c914798499e686c5ac75886932347225275" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.266s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:55:43 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-34753e42-7695-4011-ad77-f2abf4aa998d tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:55:43 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-34753e42-7695-4011-ad77-f2abf4aa998d tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json" returned: 0 in 0.212s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:55:43 user nova-compute[75337]: DEBUG nova.virt.disk.api [None req-34753e42-7695-4011-ad77-f2abf4aa998d tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5248533a-89b6-444e-a60a-154b3cdef815/disk. size=1073741824 {{(pid=75337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 15:55:43 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-34753e42-7695-4011-ad77-f2abf4aa998d tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5248533a-89b6-444e-a60a-154b3cdef815/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:55:43 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-34753e42-7695-4011-ad77-f2abf4aa998d tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5248533a-89b6-444e-a60a-154b3cdef815/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:55:43 user nova-compute[75337]: DEBUG nova.virt.disk.api [None req-34753e42-7695-4011-ad77-f2abf4aa998d tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Cannot resize image /opt/stack/data/nova/instances/5248533a-89b6-444e-a60a-154b3cdef815/disk to a smaller size. {{(pid=75337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 06 15:55:43 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-34753e42-7695-4011-ad77-f2abf4aa998d tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: 5248533a-89b6-444e-a60a-154b3cdef815] Created local disks {{(pid=75337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 15:55:43 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-34753e42-7695-4011-ad77-f2abf4aa998d tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: 5248533a-89b6-444e-a60a-154b3cdef815] Ensure instance console log exists: /opt/stack/data/nova/instances/5248533a-89b6-444e-a60a-154b3cdef815/console.log {{(pid=75337) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 15:55:43 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-34753e42-7695-4011-ad77-f2abf4aa998d tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:55:43 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-34753e42-7695-4011-ad77-f2abf4aa998d tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:55:43 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-34753e42-7695-4011-ad77-f2abf4aa998d tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:55:43 user nova-compute[75337]: DEBUG nova.network.neutron [None req-34753e42-7695-4011-ad77-f2abf4aa998d tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: 5248533a-89b6-444e-a60a-154b3cdef815] Successfully created port: 007682c6-c911-4171-b66e-173d248356cb {{(pid=75337) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 15:55:44 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:55:45 user nova-compute[75337]: DEBUG nova.network.neutron [None req-34753e42-7695-4011-ad77-f2abf4aa998d tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: 5248533a-89b6-444e-a60a-154b3cdef815] Successfully updated port: 007682c6-c911-4171-b66e-173d248356cb {{(pid=75337) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 15:55:45 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-34753e42-7695-4011-ad77-f2abf4aa998d tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Acquiring lock "refresh_cache-5248533a-89b6-444e-a60a-154b3cdef815" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 15:55:45 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-34753e42-7695-4011-ad77-f2abf4aa998d tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Acquired lock "refresh_cache-5248533a-89b6-444e-a60a-154b3cdef815" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 15:55:45 user nova-compute[75337]: DEBUG nova.network.neutron [None req-34753e42-7695-4011-ad77-f2abf4aa998d tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: 5248533a-89b6-444e-a60a-154b3cdef815] Building network info cache for instance {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 15:55:45 user nova-compute[75337]: DEBUG nova.compute.manager [req-07d168b0-46a4-443b-bd97-27ec86a21926 req-676b0b19-21f2-4d05-b7f8-870da368b3ff service nova] [instance: 5248533a-89b6-444e-a60a-154b3cdef815] Received event network-changed-007682c6-c911-4171-b66e-173d248356cb {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:55:45 user nova-compute[75337]: DEBUG nova.compute.manager [req-07d168b0-46a4-443b-bd97-27ec86a21926 req-676b0b19-21f2-4d05-b7f8-870da368b3ff service nova] [instance: 5248533a-89b6-444e-a60a-154b3cdef815] Refreshing instance network info cache due to event network-changed-007682c6-c911-4171-b66e-173d248356cb. {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 15:55:45 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-07d168b0-46a4-443b-bd97-27ec86a21926 req-676b0b19-21f2-4d05-b7f8-870da368b3ff service nova] Acquiring lock "refresh_cache-5248533a-89b6-444e-a60a-154b3cdef815" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 15:55:45 user nova-compute[75337]: DEBUG nova.network.neutron [None req-34753e42-7695-4011-ad77-f2abf4aa998d tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: 5248533a-89b6-444e-a60a-154b3cdef815] Instance cache missing network info. {{(pid=75337) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 15:55:45 user nova-compute[75337]: DEBUG nova.network.neutron [None req-34753e42-7695-4011-ad77-f2abf4aa998d tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: 5248533a-89b6-444e-a60a-154b3cdef815] Updating instance_info_cache with network_info: [{"id": "007682c6-c911-4171-b66e-173d248356cb", "address": "fa:16:3e:da:b1:68", "network": {"id": "7f234ecf-bfa6-4316-9dce-c15050ba7914", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1378707892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "243647103fd44f629e0f40be0b56407e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap007682c6-c9", "ovs_interfaceid": "007682c6-c911-4171-b66e-173d248356cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:55:46 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-34753e42-7695-4011-ad77-f2abf4aa998d tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Releasing lock "refresh_cache-5248533a-89b6-444e-a60a-154b3cdef815" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 15:55:46 user nova-compute[75337]: DEBUG nova.compute.manager [None req-34753e42-7695-4011-ad77-f2abf4aa998d tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: 5248533a-89b6-444e-a60a-154b3cdef815] Instance network_info: |[{"id": "007682c6-c911-4171-b66e-173d248356cb", "address": "fa:16:3e:da:b1:68", "network": {"id": "7f234ecf-bfa6-4316-9dce-c15050ba7914", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1378707892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "243647103fd44f629e0f40be0b56407e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap007682c6-c9", "ovs_interfaceid": "007682c6-c911-4171-b66e-173d248356cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 15:55:46 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-07d168b0-46a4-443b-bd97-27ec86a21926 req-676b0b19-21f2-4d05-b7f8-870da368b3ff service nova] Acquired lock "refresh_cache-5248533a-89b6-444e-a60a-154b3cdef815" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 15:55:46 user nova-compute[75337]: DEBUG nova.network.neutron [req-07d168b0-46a4-443b-bd97-27ec86a21926 req-676b0b19-21f2-4d05-b7f8-870da368b3ff service nova] [instance: 5248533a-89b6-444e-a60a-154b3cdef815] Refreshing network info cache for port 007682c6-c911-4171-b66e-173d248356cb {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 15:55:46 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-34753e42-7695-4011-ad77-f2abf4aa998d tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: 5248533a-89b6-444e-a60a-154b3cdef815] Start _get_guest_xml network_info=[{"id": "007682c6-c911-4171-b66e-173d248356cb", "address": "fa:16:3e:da:b1:68", "network": {"id": "7f234ecf-bfa6-4316-9dce-c15050ba7914", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1378707892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "243647103fd44f629e0f40be0b56407e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap007682c6-c9", "ovs_interfaceid": "007682c6-c911-4171-b66e-173d248356cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T15:34:14Z,direct_url=<?>,disk_format='qcow2',id=16b903ae-a40f-41a7-985b-4804cce92c62,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6549a15819f1469bbd5eeae8190e3d44',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T15:34:15Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'guest_format': None, 'size': 0, 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '16b903ae-a40f-41a7-985b-4804cce92c62'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 15:55:46 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-34753e42-7695-4011-ad77-f2abf4aa998d tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 15:55:46 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-34753e42-7695-4011-ad77-f2abf4aa998d tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 15:55:46 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-34753e42-7695-4011-ad77-f2abf4aa998d tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 15:55:46 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-34753e42-7695-4011-ad77-f2abf4aa998d tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] CPU controller missing on host. {{(pid=75337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 15:55:46 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-34753e42-7695-4011-ad77-f2abf4aa998d tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 15:55:46 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-34753e42-7695-4011-ad77-f2abf4aa998d tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] CPU controller found on host. {{(pid=75337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 15:55:46 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-34753e42-7695-4011-ad77-f2abf4aa998d tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75337) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 15:55:46 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-34753e42-7695-4011-ad77-f2abf4aa998d tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T15:34:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T15:34:14Z,direct_url=<?>,disk_format='qcow2',id=16b903ae-a40f-41a7-985b-4804cce92c62,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6549a15819f1469bbd5eeae8190e3d44',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T15:34:15Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 15:55:46 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-34753e42-7695-4011-ad77-f2abf4aa998d tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Flavor limits 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 15:55:46 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-34753e42-7695-4011-ad77-f2abf4aa998d tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Image limits 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 15:55:46 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-34753e42-7695-4011-ad77-f2abf4aa998d tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Flavor pref 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 15:55:46 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-34753e42-7695-4011-ad77-f2abf4aa998d tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Image pref 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 15:55:46 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-34753e42-7695-4011-ad77-f2abf4aa998d tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 15:55:46 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-34753e42-7695-4011-ad77-f2abf4aa998d tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 15:55:46 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-34753e42-7695-4011-ad77-f2abf4aa998d tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 15:55:46 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-34753e42-7695-4011-ad77-f2abf4aa998d tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Got 1 possible topologies {{(pid=75337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 15:55:46 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-34753e42-7695-4011-ad77-f2abf4aa998d tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 15:55:46 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-34753e42-7695-4011-ad77-f2abf4aa998d tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 15:55:46 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-34753e42-7695-4011-ad77-f2abf4aa998d tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T15:55:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1506958454',display_name='tempest-tempest.common.compute-instance-1506958454',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1506958454',id=33,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLLnBW4cDmEWGvvuTCYhgrjSwFeqdq9waFtK0/DRy6vZoehwGRDhsJbCJYWh2vj1zBgwLRqt7KS/TJeEYcini420vHoht0MKs0aDV1+OjULyGrj+Hbr6Qd4OdWLs+79ciw==',key_name='tempest-keypair-45200428',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='243647103fd44f629e0f40be0b56407e',ramdisk_id='',reservation_id='r-8xtee88d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-783619975',owner_user_name='tempest-ServerActionsTestOtherA-783619975-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T15:55:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2e47bf9ad49645deb2c1f834938fa39f',uuid=5248533a-89b6-444e-a60a-154b3cdef815,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "007682c6-c911-4171-b66e-173d248356cb", "address": "fa:16:3e:da:b1:68", "network": {"id": "7f234ecf-bfa6-4316-9dce-c15050ba7914", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1378707892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "243647103fd44f629e0f40be0b56407e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap007682c6-c9", "ovs_interfaceid": "007682c6-c911-4171-b66e-173d248356cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75337) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 15:55:46 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-34753e42-7695-4011-ad77-f2abf4aa998d tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Converting VIF {"id": "007682c6-c911-4171-b66e-173d248356cb", "address": "fa:16:3e:da:b1:68", "network": {"id": "7f234ecf-bfa6-4316-9dce-c15050ba7914", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1378707892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "243647103fd44f629e0f40be0b56407e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap007682c6-c9", "ovs_interfaceid": "007682c6-c911-4171-b66e-173d248356cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 15:55:46 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-34753e42-7695-4011-ad77-f2abf4aa998d tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:b1:68,bridge_name='br-int',has_traffic_filtering=True,id=007682c6-c911-4171-b66e-173d248356cb,network=Network(7f234ecf-bfa6-4316-9dce-c15050ba7914),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap007682c6-c9') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 15:55:46 user nova-compute[75337]: DEBUG nova.objects.instance [None req-34753e42-7695-4011-ad77-f2abf4aa998d tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Lazy-loading 'pci_devices' on Instance uuid 5248533a-89b6-444e-a60a-154b3cdef815 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 15:55:46 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-34753e42-7695-4011-ad77-f2abf4aa998d tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: 5248533a-89b6-444e-a60a-154b3cdef815] End _get_guest_xml xml=<domain type="kvm">
Nov 06 15:55:46 user nova-compute[75337]:   <uuid>5248533a-89b6-444e-a60a-154b3cdef815</uuid>
Nov 06 15:55:46 user nova-compute[75337]:   <name>instance-00000021</name>
Nov 06 15:55:46 user nova-compute[75337]:   <memory>524288</memory>
Nov 06 15:55:46 user nova-compute[75337]:   <vcpu>1</vcpu>
Nov 06 15:55:46 user nova-compute[75337]:   <metadata>
Nov 06 15:55:46 user nova-compute[75337]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 15:55:46 user nova-compute[75337]:       <nova:package version="0.0.0"/>
Nov 06 15:55:46 user nova-compute[75337]:       <nova:name>tempest-tempest.common.compute-instance-1506958454</nova:name>
Nov 06 15:55:46 user nova-compute[75337]:       <nova:creationTime>2023-11-06 15:55:46</nova:creationTime>
Nov 06 15:55:46 user nova-compute[75337]:       <nova:flavor name="m1.tiny">
Nov 06 15:55:46 user nova-compute[75337]:         <nova:memory>512</nova:memory>
Nov 06 15:55:46 user nova-compute[75337]:         <nova:disk>1</nova:disk>
Nov 06 15:55:46 user nova-compute[75337]:         <nova:swap>0</nova:swap>
Nov 06 15:55:46 user nova-compute[75337]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 15:55:46 user nova-compute[75337]:         <nova:vcpus>1</nova:vcpus>
Nov 06 15:55:46 user nova-compute[75337]:       </nova:flavor>
Nov 06 15:55:46 user nova-compute[75337]:       <nova:owner>
Nov 06 15:55:46 user nova-compute[75337]:         <nova:user uuid="2e47bf9ad49645deb2c1f834938fa39f">tempest-ServerActionsTestOtherA-783619975-project-member</nova:user>
Nov 06 15:55:46 user nova-compute[75337]:         <nova:project uuid="243647103fd44f629e0f40be0b56407e">tempest-ServerActionsTestOtherA-783619975</nova:project>
Nov 06 15:55:46 user nova-compute[75337]:       </nova:owner>
Nov 06 15:55:46 user nova-compute[75337]:       <nova:root type="image" uuid="16b903ae-a40f-41a7-985b-4804cce92c62"/>
Nov 06 15:55:46 user nova-compute[75337]:       <nova:ports>
Nov 06 15:55:46 user nova-compute[75337]:         <nova:port uuid="007682c6-c911-4171-b66e-173d248356cb">
Nov 06 15:55:46 user nova-compute[75337]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 06 15:55:46 user nova-compute[75337]:         </nova:port>
Nov 06 15:55:46 user nova-compute[75337]:       </nova:ports>
Nov 06 15:55:46 user nova-compute[75337]:     </nova:instance>
Nov 06 15:55:46 user nova-compute[75337]:   </metadata>
Nov 06 15:55:46 user nova-compute[75337]:   <sysinfo type="smbios">
Nov 06 15:55:46 user nova-compute[75337]:     <system>
Nov 06 15:55:46 user nova-compute[75337]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 15:55:46 user nova-compute[75337]:       <entry name="product">OpenStack Nova</entry>
Nov 06 15:55:46 user nova-compute[75337]:       <entry name="version">0.0.0</entry>
Nov 06 15:55:46 user nova-compute[75337]:       <entry name="serial">5248533a-89b6-444e-a60a-154b3cdef815</entry>
Nov 06 15:55:46 user nova-compute[75337]:       <entry name="uuid">5248533a-89b6-444e-a60a-154b3cdef815</entry>
Nov 06 15:55:46 user nova-compute[75337]:       <entry name="family">Virtual Machine</entry>
Nov 06 15:55:46 user nova-compute[75337]:     </system>
Nov 06 15:55:46 user nova-compute[75337]:   </sysinfo>
Nov 06 15:55:46 user nova-compute[75337]:   <os>
Nov 06 15:55:46 user nova-compute[75337]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 15:55:46 user nova-compute[75337]:     <boot dev="hd"/>
Nov 06 15:55:46 user nova-compute[75337]:     <smbios mode="sysinfo"/>
Nov 06 15:55:46 user nova-compute[75337]:   </os>
Nov 06 15:55:46 user nova-compute[75337]:   <features>
Nov 06 15:55:46 user nova-compute[75337]:     <acpi/>
Nov 06 15:55:46 user nova-compute[75337]:     <apic/>
Nov 06 15:55:46 user nova-compute[75337]:     <vmcoreinfo/>
Nov 06 15:55:46 user nova-compute[75337]:   </features>
Nov 06 15:55:46 user nova-compute[75337]:   <clock offset="utc">
Nov 06 15:55:46 user nova-compute[75337]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 15:55:46 user nova-compute[75337]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 15:55:46 user nova-compute[75337]:     <timer name="hpet" present="no"/>
Nov 06 15:55:46 user nova-compute[75337]:   </clock>
Nov 06 15:55:46 user nova-compute[75337]:   <cpu mode="custom" match="exact">
Nov 06 15:55:46 user nova-compute[75337]:     <model>Nehalem</model>
Nov 06 15:55:46 user nova-compute[75337]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 15:55:46 user nova-compute[75337]:   </cpu>
Nov 06 15:55:46 user nova-compute[75337]:   <devices>
Nov 06 15:55:46 user nova-compute[75337]:     <disk type="file" device="disk">
Nov 06 15:55:46 user nova-compute[75337]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 15:55:46 user nova-compute[75337]:       <source file="/opt/stack/data/nova/instances/5248533a-89b6-444e-a60a-154b3cdef815/disk"/>
Nov 06 15:55:46 user nova-compute[75337]:       <target dev="vda" bus="virtio"/>
Nov 06 15:55:46 user nova-compute[75337]:     </disk>
Nov 06 15:55:46 user nova-compute[75337]:     <interface type="ethernet">
Nov 06 15:55:46 user nova-compute[75337]:       <mac address="fa:16:3e:da:b1:68"/>
Nov 06 15:55:46 user nova-compute[75337]:       <model type="virtio"/>
Nov 06 15:55:46 user nova-compute[75337]:       <mtu size="1442"/>
Nov 06 15:55:46 user nova-compute[75337]:       <target dev="tap007682c6-c9"/>
Nov 06 15:55:46 user nova-compute[75337]:     </interface>
Nov 06 15:55:46 user nova-compute[75337]:     <serial type="pty">
Nov 06 15:55:46 user nova-compute[75337]:       <log file="/opt/stack/data/nova/instances/5248533a-89b6-444e-a60a-154b3cdef815/console.log" append="off"/>
Nov 06 15:55:46 user nova-compute[75337]:     </serial>
Nov 06 15:55:46 user nova-compute[75337]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 15:55:46 user nova-compute[75337]:     <video>
Nov 06 15:55:46 user nova-compute[75337]:       <model type="virtio"/>
Nov 06 15:55:46 user nova-compute[75337]:     </video>
Nov 06 15:55:46 user nova-compute[75337]:     <rng model="virtio">
Nov 06 15:55:46 user nova-compute[75337]:       <backend model="random">/dev/urandom</backend>
Nov 06 15:55:46 user nova-compute[75337]:     </rng>
Nov 06 15:55:46 user nova-compute[75337]:     <controller type="usb" index="0" model="none"/>
Nov 06 15:55:46 user nova-compute[75337]:     <memballoon model="virtio">
Nov 06 15:55:46 user nova-compute[75337]:       <stats period="10"/>
Nov 06 15:55:46 user nova-compute[75337]:     </memballoon>
Nov 06 15:55:46 user nova-compute[75337]:   </devices>
Nov 06 15:55:46 user nova-compute[75337]: </domain>
Nov 06 15:55:46 user nova-compute[75337]:  {{(pid=75337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 15:55:46 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-34753e42-7695-4011-ad77-f2abf4aa998d tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T15:55:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1506958454',display_name='tempest-tempest.common.compute-instance-1506958454',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1506958454',id=33,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLLnBW4cDmEWGvvuTCYhgrjSwFeqdq9waFtK0/DRy6vZoehwGRDhsJbCJYWh2vj1zBgwLRqt7KS/TJeEYcini420vHoht0MKs0aDV1+OjULyGrj+Hbr6Qd4OdWLs+79ciw==',key_name='tempest-keypair-45200428',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='243647103fd44f629e0f40be0b56407e',ramdisk_id='',reservation_id='r-8xtee88d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-783619975',owner_user_name='tempest-ServerActionsTestOtherA-783619975-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T15:55:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2e47bf9ad49645deb2c1f834938fa39f',uuid=5248533a-89b6-444e-a60a-154b3cdef815,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "007682c6-c911-4171-b66e-173d248356cb", "address": "fa:16:3e:da:b1:68", "network": {"id": "7f234ecf-bfa6-4316-9dce-c15050ba7914", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1378707892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "243647103fd44f629e0f40be0b56407e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap007682c6-c9", "ovs_interfaceid": "007682c6-c911-4171-b66e-173d248356cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 15:55:46 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-34753e42-7695-4011-ad77-f2abf4aa998d tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Converting VIF {"id": "007682c6-c911-4171-b66e-173d248356cb", "address": "fa:16:3e:da:b1:68", "network": {"id": "7f234ecf-bfa6-4316-9dce-c15050ba7914", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1378707892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "243647103fd44f629e0f40be0b56407e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap007682c6-c9", "ovs_interfaceid": "007682c6-c911-4171-b66e-173d248356cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 15:55:46 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-34753e42-7695-4011-ad77-f2abf4aa998d tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:b1:68,bridge_name='br-int',has_traffic_filtering=True,id=007682c6-c911-4171-b66e-173d248356cb,network=Network(7f234ecf-bfa6-4316-9dce-c15050ba7914),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap007682c6-c9') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 15:55:46 user nova-compute[75337]: DEBUG os_vif [None req-34753e42-7695-4011-ad77-f2abf4aa998d tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:b1:68,bridge_name='br-int',has_traffic_filtering=True,id=007682c6-c911-4171-b66e-173d248356cb,network=Network(7f234ecf-bfa6-4316-9dce-c15050ba7914),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap007682c6-c9') {{(pid=75337) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 15:55:46 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:55:46 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:55:46 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 15:55:46 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:55:46 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '711fc6b3-c2cf-57ca-96d2-a835288f58f0', '_type': 'linux-noop'}}, row=False) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:55:46 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:55:46 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:55:46 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:55:46 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap007682c6-c9, may_exist=True, interface_attrs={}) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:55:46 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap007682c6-c9, col_values=(('qos', UUID('0095ccfa-2955-473b-ac64-335b8c01bb22')),), if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:55:46 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap007682c6-c9, col_values=(('external_ids', {'iface-id': '007682c6-c911-4171-b66e-173d248356cb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:da:b1:68', 'vm-uuid': '5248533a-89b6-444e-a60a-154b3cdef815'}),), if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:55:46 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:55:46 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:55:46 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:55:46 user nova-compute[75337]: INFO os_vif [None req-34753e42-7695-4011-ad77-f2abf4aa998d tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:b1:68,bridge_name='br-int',has_traffic_filtering=True,id=007682c6-c911-4171-b66e-173d248356cb,network=Network(7f234ecf-bfa6-4316-9dce-c15050ba7914),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap007682c6-c9')
Nov 06 15:55:46 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-34753e42-7695-4011-ad77-f2abf4aa998d tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] No BDM found with device name vda, not building metadata. {{(pid=75337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 15:55:46 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-34753e42-7695-4011-ad77-f2abf4aa998d tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] No VIF found with MAC fa:16:3e:da:b1:68, not building metadata {{(pid=75337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 15:55:46 user nova-compute[75337]: DEBUG nova.network.neutron [req-07d168b0-46a4-443b-bd97-27ec86a21926 req-676b0b19-21f2-4d05-b7f8-870da368b3ff service nova] [instance: 5248533a-89b6-444e-a60a-154b3cdef815] Updated VIF entry in instance network info cache for port 007682c6-c911-4171-b66e-173d248356cb. {{(pid=75337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 15:55:46 user nova-compute[75337]: DEBUG nova.network.neutron [req-07d168b0-46a4-443b-bd97-27ec86a21926 req-676b0b19-21f2-4d05-b7f8-870da368b3ff service nova] [instance: 5248533a-89b6-444e-a60a-154b3cdef815] Updating instance_info_cache with network_info: [{"id": "007682c6-c911-4171-b66e-173d248356cb", "address": "fa:16:3e:da:b1:68", "network": {"id": "7f234ecf-bfa6-4316-9dce-c15050ba7914", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1378707892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "243647103fd44f629e0f40be0b56407e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap007682c6-c9", "ovs_interfaceid": "007682c6-c911-4171-b66e-173d248356cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:55:46 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-07d168b0-46a4-443b-bd97-27ec86a21926 req-676b0b19-21f2-4d05-b7f8-870da368b3ff service nova] Releasing lock "refresh_cache-5248533a-89b6-444e-a60a-154b3cdef815" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 15:55:47 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:55:47 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:55:47 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:55:47 user nova-compute[75337]: DEBUG nova.compute.manager [req-779bd0d3-0deb-4859-a215-e8030dcd1ba9 req-a1dfe8ff-943d-4d04-8818-1e427237ff73 service nova] [instance: 5248533a-89b6-444e-a60a-154b3cdef815] Received event network-vif-plugged-007682c6-c911-4171-b66e-173d248356cb {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:55:47 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-779bd0d3-0deb-4859-a215-e8030dcd1ba9 req-a1dfe8ff-943d-4d04-8818-1e427237ff73 service nova] Acquiring lock "5248533a-89b6-444e-a60a-154b3cdef815-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:55:47 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-779bd0d3-0deb-4859-a215-e8030dcd1ba9 req-a1dfe8ff-943d-4d04-8818-1e427237ff73 service nova] Lock "5248533a-89b6-444e-a60a-154b3cdef815-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:55:47 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-779bd0d3-0deb-4859-a215-e8030dcd1ba9 req-a1dfe8ff-943d-4d04-8818-1e427237ff73 service nova] Lock "5248533a-89b6-444e-a60a-154b3cdef815-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:55:47 user nova-compute[75337]: DEBUG nova.compute.manager [req-779bd0d3-0deb-4859-a215-e8030dcd1ba9 req-a1dfe8ff-943d-4d04-8818-1e427237ff73 service nova] [instance: 5248533a-89b6-444e-a60a-154b3cdef815] No waiting events found dispatching network-vif-plugged-007682c6-c911-4171-b66e-173d248356cb {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:55:47 user nova-compute[75337]: WARNING nova.compute.manager [req-779bd0d3-0deb-4859-a215-e8030dcd1ba9 req-a1dfe8ff-943d-4d04-8818-1e427237ff73 service nova] [instance: 5248533a-89b6-444e-a60a-154b3cdef815] Received unexpected event network-vif-plugged-007682c6-c911-4171-b66e-173d248356cb for instance with vm_state building and task_state spawning.
Nov 06 15:55:48 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:55:48 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:55:49 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:55:50 user nova-compute[75337]: DEBUG nova.compute.manager [req-14425ebb-7aff-4f6a-b5fe-5b64f8539ceb req-1b61e774-0625-4318-9826-7c43a6560f9f service nova] [instance: 5248533a-89b6-444e-a60a-154b3cdef815] Received event network-vif-plugged-007682c6-c911-4171-b66e-173d248356cb {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:55:50 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-14425ebb-7aff-4f6a-b5fe-5b64f8539ceb req-1b61e774-0625-4318-9826-7c43a6560f9f service nova] Acquiring lock "5248533a-89b6-444e-a60a-154b3cdef815-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:55:50 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-14425ebb-7aff-4f6a-b5fe-5b64f8539ceb req-1b61e774-0625-4318-9826-7c43a6560f9f service nova] Lock "5248533a-89b6-444e-a60a-154b3cdef815-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:55:50 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-14425ebb-7aff-4f6a-b5fe-5b64f8539ceb req-1b61e774-0625-4318-9826-7c43a6560f9f service nova] Lock "5248533a-89b6-444e-a60a-154b3cdef815-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:55:50 user nova-compute[75337]: DEBUG nova.compute.manager [req-14425ebb-7aff-4f6a-b5fe-5b64f8539ceb req-1b61e774-0625-4318-9826-7c43a6560f9f service nova] [instance: 5248533a-89b6-444e-a60a-154b3cdef815] No waiting events found dispatching network-vif-plugged-007682c6-c911-4171-b66e-173d248356cb {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:55:50 user nova-compute[75337]: WARNING nova.compute.manager [req-14425ebb-7aff-4f6a-b5fe-5b64f8539ceb req-1b61e774-0625-4318-9826-7c43a6560f9f service nova] [instance: 5248533a-89b6-444e-a60a-154b3cdef815] Received unexpected event network-vif-plugged-007682c6-c911-4171-b66e-173d248356cb for instance with vm_state building and task_state spawning.
Nov 06 15:55:50 user nova-compute[75337]: DEBUG nova.compute.manager [None req-34753e42-7695-4011-ad77-f2abf4aa998d tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: 5248533a-89b6-444e-a60a-154b3cdef815] Instance event wait completed in 0 seconds for  {{(pid=75337) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 15:55:50 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-34753e42-7695-4011-ad77-f2abf4aa998d tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: 5248533a-89b6-444e-a60a-154b3cdef815] Guest created on hypervisor {{(pid=75337) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 15:55:50 user nova-compute[75337]: INFO nova.virt.libvirt.driver [-] [instance: 5248533a-89b6-444e-a60a-154b3cdef815] Instance spawned successfully.
Nov 06 15:55:50 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-34753e42-7695-4011-ad77-f2abf4aa998d tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: 5248533a-89b6-444e-a60a-154b3cdef815] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 15:55:50 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-34753e42-7695-4011-ad77-f2abf4aa998d tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: 5248533a-89b6-444e-a60a-154b3cdef815] Found default for hw_cdrom_bus of ide {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:55:50 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-34753e42-7695-4011-ad77-f2abf4aa998d tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: 5248533a-89b6-444e-a60a-154b3cdef815] Found default for hw_disk_bus of virtio {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:55:50 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-34753e42-7695-4011-ad77-f2abf4aa998d tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: 5248533a-89b6-444e-a60a-154b3cdef815] Found default for hw_input_bus of None {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:55:50 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-34753e42-7695-4011-ad77-f2abf4aa998d tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: 5248533a-89b6-444e-a60a-154b3cdef815] Found default for hw_pointer_model of None {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:55:50 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-34753e42-7695-4011-ad77-f2abf4aa998d tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: 5248533a-89b6-444e-a60a-154b3cdef815] Found default for hw_video_model of virtio {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:55:50 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-34753e42-7695-4011-ad77-f2abf4aa998d tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: 5248533a-89b6-444e-a60a-154b3cdef815] Found default for hw_vif_model of virtio {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:55:50 user nova-compute[75337]: INFO nova.compute.manager [None req-34753e42-7695-4011-ad77-f2abf4aa998d tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: 5248533a-89b6-444e-a60a-154b3cdef815] Took 7.78 seconds to spawn the instance on the hypervisor.
Nov 06 15:55:50 user nova-compute[75337]: DEBUG nova.compute.manager [None req-34753e42-7695-4011-ad77-f2abf4aa998d tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: 5248533a-89b6-444e-a60a-154b3cdef815] Checking state {{(pid=75337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 15:55:50 user nova-compute[75337]: INFO nova.compute.manager [None req-34753e42-7695-4011-ad77-f2abf4aa998d tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: 5248533a-89b6-444e-a60a-154b3cdef815] Took 8.66 seconds to build instance.
Nov 06 15:55:50 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-34753e42-7695-4011-ad77-f2abf4aa998d tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Lock "5248533a-89b6-444e-a60a-154b3cdef815" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.793s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:55:51 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:55:56 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:56:01 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-315c64b4-0ba5-41ce-9d40-99d2cdfc2b9e tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Acquiring lock "9a3a0bd3-6c4d-434f-9f6b-7d954f7c163b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:56:01 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-315c64b4-0ba5-41ce-9d40-99d2cdfc2b9e tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Lock "9a3a0bd3-6c4d-434f-9f6b-7d954f7c163b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:56:01 user nova-compute[75337]: DEBUG nova.compute.manager [None req-315c64b4-0ba5-41ce-9d40-99d2cdfc2b9e tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 9a3a0bd3-6c4d-434f-9f6b-7d954f7c163b] Starting instance... {{(pid=75337) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 15:56:01 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:56:01 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:56:01 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75337) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 15:56:01 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 15:56:01 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 15:56:01 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:56:01 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-315c64b4-0ba5-41ce-9d40-99d2cdfc2b9e tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:56:01 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-315c64b4-0ba5-41ce-9d40-99d2cdfc2b9e tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:56:01 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-315c64b4-0ba5-41ce-9d40-99d2cdfc2b9e tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75337) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 15:56:01 user nova-compute[75337]: INFO nova.compute.claims [None req-315c64b4-0ba5-41ce-9d40-99d2cdfc2b9e tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 9a3a0bd3-6c4d-434f-9f6b-7d954f7c163b] Claim successful on node user
Nov 06 15:56:01 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-315c64b4-0ba5-41ce-9d40-99d2cdfc2b9e tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 15:56:01 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-315c64b4-0ba5-41ce-9d40-99d2cdfc2b9e tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 15:56:01 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-315c64b4-0ba5-41ce-9d40-99d2cdfc2b9e tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.404s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:56:01 user nova-compute[75337]: DEBUG nova.compute.manager [None req-315c64b4-0ba5-41ce-9d40-99d2cdfc2b9e tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 9a3a0bd3-6c4d-434f-9f6b-7d954f7c163b] Start building networks asynchronously for instance. {{(pid=75337) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 15:56:01 user nova-compute[75337]: DEBUG nova.compute.manager [None req-315c64b4-0ba5-41ce-9d40-99d2cdfc2b9e tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 9a3a0bd3-6c4d-434f-9f6b-7d954f7c163b] Allocating IP information in the background. {{(pid=75337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 15:56:01 user nova-compute[75337]: DEBUG nova.network.neutron [None req-315c64b4-0ba5-41ce-9d40-99d2cdfc2b9e tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 9a3a0bd3-6c4d-434f-9f6b-7d954f7c163b] allocate_for_instance() {{(pid=75337) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 15:56:01 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-315c64b4-0ba5-41ce-9d40-99d2cdfc2b9e tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 9a3a0bd3-6c4d-434f-9f6b-7d954f7c163b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 15:56:01 user nova-compute[75337]: DEBUG nova.compute.manager [None req-315c64b4-0ba5-41ce-9d40-99d2cdfc2b9e tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 9a3a0bd3-6c4d-434f-9f6b-7d954f7c163b] Start building block device mappings for instance. {{(pid=75337) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 15:56:01 user nova-compute[75337]: DEBUG nova.policy [None req-315c64b4-0ba5-41ce-9d40-99d2cdfc2b9e tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bb8d5f0200124588be1cfde107341a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915211c6a2734c36b34ff92a56b085f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75337) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 15:56:01 user nova-compute[75337]: INFO nova.virt.block_device [None req-315c64b4-0ba5-41ce-9d40-99d2cdfc2b9e tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 9a3a0bd3-6c4d-434f-9f6b-7d954f7c163b] Booting with volume 324f5822-eef0-4ecf-93e4-791b0677d673 at /dev/vda
Nov 06 15:56:01 user nova-compute[75337]: DEBUG os_brick.utils [None req-315c64b4-0ba5-41ce-9d40-99d2cdfc2b9e tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 15:56:01 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:56:01 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:56:01 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4f4e5e5-86df-49c5-bbfb-e4608b323eeb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4ff6411e45b8\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:56:01 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:56:01 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:56:01 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7a73165-fe06-4459-b167-49aa78b59292]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:56:01 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:56:01 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:56:01 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[1729df5f-876c-4fbc-9520-f9c0b35e9888]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:56:01 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae3574ed-af0c-4da8-a260-f0f0f29b3c48]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:56:01 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-315c64b4-0ba5-41ce-9d40-99d2cdfc2b9e tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Running cmd (subprocess): nvme version {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:56:01 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-315c64b4-0ba5-41ce-9d40-99d2cdfc2b9e tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] 'nvme version' failed. Not Retrying. {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 15:56:01 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.nvmeof [None req-315c64b4-0ba5-41ce-9d40-99d2cdfc2b9e tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] nvme not present on system {{(pid=75337) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 15:56:01 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:56:01 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 15:56:01 user nova-compute[75337]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 15:56:01 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a6b520c-ae60-4ec2-8918-3f2dcf3a8d36]: (4, '') {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:56:01 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.lightos [None req-315c64b4-0ba5-41ce-9d40-99d2cdfc2b9e tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75337) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 15:56:01 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.lightos [None req-315c64b4-0ba5-41ce-9d40-99d2cdfc2b9e tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 15:56:01 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.lightos [None req-315c64b4-0ba5-41ce-9d40-99d2cdfc2b9e tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] LIGHTOS: no hostnqn found. {{(pid=75337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 15:56:01 user nova-compute[75337]: DEBUG os_brick.utils [None req-315c64b4-0ba5-41ce-9d40-99d2cdfc2b9e tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4ff6411e45b8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 15:56:01 user nova-compute[75337]: DEBUG nova.virt.block_device [None req-315c64b4-0ba5-41ce-9d40-99d2cdfc2b9e tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 9a3a0bd3-6c4d-434f-9f6b-7d954f7c163b] Updating existing volume attachment record: 33c00d8d-a0b9-4c37-b4c4-6c596c2f773e {{(pid=75337) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 15:56:02 user nova-compute[75337]: DEBUG nova.network.neutron [None req-315c64b4-0ba5-41ce-9d40-99d2cdfc2b9e tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 9a3a0bd3-6c4d-434f-9f6b-7d954f7c163b] Successfully created port: 733c74d6-103a-491b-b443-9b2fe9ceb5f3 {{(pid=75337) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 15:56:03 user nova-compute[75337]: DEBUG nova.network.neutron [None req-315c64b4-0ba5-41ce-9d40-99d2cdfc2b9e tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 9a3a0bd3-6c4d-434f-9f6b-7d954f7c163b] Successfully updated port: 733c74d6-103a-491b-b443-9b2fe9ceb5f3 {{(pid=75337) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 15:56:03 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-315c64b4-0ba5-41ce-9d40-99d2cdfc2b9e tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Acquiring lock "refresh_cache-9a3a0bd3-6c4d-434f-9f6b-7d954f7c163b" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 15:56:03 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-315c64b4-0ba5-41ce-9d40-99d2cdfc2b9e tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Acquired lock "refresh_cache-9a3a0bd3-6c4d-434f-9f6b-7d954f7c163b" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 15:56:03 user nova-compute[75337]: DEBUG nova.network.neutron [None req-315c64b4-0ba5-41ce-9d40-99d2cdfc2b9e tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 9a3a0bd3-6c4d-434f-9f6b-7d954f7c163b] Building network info cache for instance {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 15:56:03 user nova-compute[75337]: DEBUG nova.compute.manager [req-3ee3a542-2a65-4fe2-852e-4c9d7d148589 req-1581e8e4-004b-42b3-809f-e947ce389dfe service nova] [instance: 9a3a0bd3-6c4d-434f-9f6b-7d954f7c163b] Received event network-changed-733c74d6-103a-491b-b443-9b2fe9ceb5f3 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:56:03 user nova-compute[75337]: DEBUG nova.compute.manager [req-3ee3a542-2a65-4fe2-852e-4c9d7d148589 req-1581e8e4-004b-42b3-809f-e947ce389dfe service nova] [instance: 9a3a0bd3-6c4d-434f-9f6b-7d954f7c163b] Refreshing instance network info cache due to event network-changed-733c74d6-103a-491b-b443-9b2fe9ceb5f3. {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 15:56:03 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-3ee3a542-2a65-4fe2-852e-4c9d7d148589 req-1581e8e4-004b-42b3-809f-e947ce389dfe service nova] Acquiring lock "refresh_cache-9a3a0bd3-6c4d-434f-9f6b-7d954f7c163b" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 15:56:03 user nova-compute[75337]: DEBUG nova.network.neutron [None req-315c64b4-0ba5-41ce-9d40-99d2cdfc2b9e tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 9a3a0bd3-6c4d-434f-9f6b-7d954f7c163b] Instance cache missing network info. {{(pid=75337) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 15:56:03 user nova-compute[75337]: DEBUG nova.network.neutron [None req-315c64b4-0ba5-41ce-9d40-99d2cdfc2b9e tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 9a3a0bd3-6c4d-434f-9f6b-7d954f7c163b] Updating instance_info_cache with network_info: [{"id": "733c74d6-103a-491b-b443-9b2fe9ceb5f3", "address": "fa:16:3e:3d:e8:fb", "network": {"id": "4e47319f-de1d-4dfe-9915-7d2d5131704d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-895093240-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "915211c6a2734c36b34ff92a56b085f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap733c74d6-10", "ovs_interfaceid": "733c74d6-103a-491b-b443-9b2fe9ceb5f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:56:03 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-315c64b4-0ba5-41ce-9d40-99d2cdfc2b9e tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Releasing lock "refresh_cache-9a3a0bd3-6c4d-434f-9f6b-7d954f7c163b" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 15:56:03 user nova-compute[75337]: DEBUG nova.compute.manager [None req-315c64b4-0ba5-41ce-9d40-99d2cdfc2b9e tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 9a3a0bd3-6c4d-434f-9f6b-7d954f7c163b] Instance network_info: |[{"id": "733c74d6-103a-491b-b443-9b2fe9ceb5f3", "address": "fa:16:3e:3d:e8:fb", "network": {"id": "4e47319f-de1d-4dfe-9915-7d2d5131704d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-895093240-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "915211c6a2734c36b34ff92a56b085f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap733c74d6-10", "ovs_interfaceid": "733c74d6-103a-491b-b443-9b2fe9ceb5f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 15:56:03 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-3ee3a542-2a65-4fe2-852e-4c9d7d148589 req-1581e8e4-004b-42b3-809f-e947ce389dfe service nova] Acquired lock "refresh_cache-9a3a0bd3-6c4d-434f-9f6b-7d954f7c163b" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 15:56:03 user nova-compute[75337]: DEBUG nova.network.neutron [req-3ee3a542-2a65-4fe2-852e-4c9d7d148589 req-1581e8e4-004b-42b3-809f-e947ce389dfe service nova] [instance: 9a3a0bd3-6c4d-434f-9f6b-7d954f7c163b] Refreshing network info cache for port 733c74d6-103a-491b-b443-9b2fe9ceb5f3 {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 15:56:04 user nova-compute[75337]: DEBUG nova.network.neutron [req-3ee3a542-2a65-4fe2-852e-4c9d7d148589 req-1581e8e4-004b-42b3-809f-e947ce389dfe service nova] [instance: 9a3a0bd3-6c4d-434f-9f6b-7d954f7c163b] Updated VIF entry in instance network info cache for port 733c74d6-103a-491b-b443-9b2fe9ceb5f3. {{(pid=75337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 15:56:04 user nova-compute[75337]: DEBUG nova.network.neutron [req-3ee3a542-2a65-4fe2-852e-4c9d7d148589 req-1581e8e4-004b-42b3-809f-e947ce389dfe service nova] [instance: 9a3a0bd3-6c4d-434f-9f6b-7d954f7c163b] Updating instance_info_cache with network_info: [{"id": "733c74d6-103a-491b-b443-9b2fe9ceb5f3", "address": "fa:16:3e:3d:e8:fb", "network": {"id": "4e47319f-de1d-4dfe-9915-7d2d5131704d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-895093240-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "915211c6a2734c36b34ff92a56b085f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap733c74d6-10", "ovs_interfaceid": "733c74d6-103a-491b-b443-9b2fe9ceb5f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:56:04 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-3ee3a542-2a65-4fe2-852e-4c9d7d148589 req-1581e8e4-004b-42b3-809f-e947ce389dfe service nova] Releasing lock "refresh_cache-9a3a0bd3-6c4d-434f-9f6b-7d954f7c163b" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 15:56:05 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-ee311c1c-86ff-4001-8dd4-9b14fc87af84 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Acquiring lock "a293c354-d1e5-4c33-9e7b-d1558235aaf8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:56:05 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-ee311c1c-86ff-4001-8dd4-9b14fc87af84 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Lock "a293c354-d1e5-4c33-9e7b-d1558235aaf8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:56:05 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-ee311c1c-86ff-4001-8dd4-9b14fc87af84 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Acquiring lock "a293c354-d1e5-4c33-9e7b-d1558235aaf8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:56:05 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-ee311c1c-86ff-4001-8dd4-9b14fc87af84 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Lock "a293c354-d1e5-4c33-9e7b-d1558235aaf8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:56:05 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-ee311c1c-86ff-4001-8dd4-9b14fc87af84 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Lock "a293c354-d1e5-4c33-9e7b-d1558235aaf8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:56:05 user nova-compute[75337]: INFO nova.compute.manager [None req-ee311c1c-86ff-4001-8dd4-9b14fc87af84 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] [instance: a293c354-d1e5-4c33-9e7b-d1558235aaf8] Terminating instance
Nov 06 15:56:05 user nova-compute[75337]: DEBUG nova.compute.manager [None req-ee311c1c-86ff-4001-8dd4-9b14fc87af84 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] [instance: a293c354-d1e5-4c33-9e7b-d1558235aaf8] Start destroying the instance on the hypervisor. {{(pid=75337) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 15:56:05 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:56:05 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:56:05 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:56:05 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:56:06 user nova-compute[75337]: DEBUG nova.compute.manager [req-201f498b-0b8a-4d7c-b47b-8e109f3def09 req-f264c8cb-d72b-467b-a0e3-d46bcc4c0121 service nova] [instance: a293c354-d1e5-4c33-9e7b-d1558235aaf8] Received event network-vif-unplugged-29fff93f-08f1-4e46-91db-84ab16f785e5 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:56:06 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-201f498b-0b8a-4d7c-b47b-8e109f3def09 req-f264c8cb-d72b-467b-a0e3-d46bcc4c0121 service nova] Acquiring lock "a293c354-d1e5-4c33-9e7b-d1558235aaf8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:56:06 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-201f498b-0b8a-4d7c-b47b-8e109f3def09 req-f264c8cb-d72b-467b-a0e3-d46bcc4c0121 service nova] Lock "a293c354-d1e5-4c33-9e7b-d1558235aaf8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:56:06 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-201f498b-0b8a-4d7c-b47b-8e109f3def09 req-f264c8cb-d72b-467b-a0e3-d46bcc4c0121 service nova] Lock "a293c354-d1e5-4c33-9e7b-d1558235aaf8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:56:06 user nova-compute[75337]: DEBUG nova.compute.manager [req-201f498b-0b8a-4d7c-b47b-8e109f3def09 req-f264c8cb-d72b-467b-a0e3-d46bcc4c0121 service nova] [instance: a293c354-d1e5-4c33-9e7b-d1558235aaf8] No waiting events found dispatching network-vif-unplugged-29fff93f-08f1-4e46-91db-84ab16f785e5 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:56:06 user nova-compute[75337]: DEBUG nova.compute.manager [req-201f498b-0b8a-4d7c-b47b-8e109f3def09 req-f264c8cb-d72b-467b-a0e3-d46bcc4c0121 service nova] [instance: a293c354-d1e5-4c33-9e7b-d1558235aaf8] Received event network-vif-unplugged-29fff93f-08f1-4e46-91db-84ab16f785e5 for instance with task_state deleting. {{(pid=75337) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 15:56:06 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:56:06 user nova-compute[75337]: INFO nova.virt.libvirt.driver [-] [instance: a293c354-d1e5-4c33-9e7b-d1558235aaf8] Instance destroyed successfully.
Nov 06 15:56:06 user nova-compute[75337]: DEBUG nova.objects.instance [None req-ee311c1c-86ff-4001-8dd4-9b14fc87af84 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Lazy-loading 'resources' on Instance uuid a293c354-d1e5-4c33-9e7b-d1558235aaf8 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 15:56:06 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-ee311c1c-86ff-4001-8dd4-9b14fc87af84 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T15:50:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2071528491',display_name='tempest-AttachVolumeNegativeTest-server-2071528491',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2071528491',id=25,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJeCBm+mKfrp2FFF+KMPwGkjm+VWInJnfR36kliM38Uo3mljDirzb+qwGiq+h1GdVb+XUzSDCdW/OrAhZFxL2Qta1UBDBswOEF5zPmKbUn4k464MfeSlPqTVcgazYBh9bw==',key_name='tempest-keypair-2018551821',keypairs=<?>,launch_index=0,launched_at=2023-11-06T15:50:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1013e7afbefd4146a3be04587710b1de',ramdisk_id='',reservation_id='r-b7cg5a97',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1104237961',owner_user_name='tempest-AttachVolumeNegativeTest-1104237961-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T15:50:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aeeea58fcd3e4217a34a4a38be6adf30',uuid=a293c354-d1e5-4c33-9e7b-d1558235aaf8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "29fff93f-08f1-4e46-91db-84ab16f785e5", "address": "fa:16:3e:d7:cf:dd", "network": {"id": "48f1545d-7e80-462f-9dbf-f1102ddcda9a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1210368397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1013e7afbefd4146a3be04587710b1de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29fff93f-08", "ovs_interfaceid": "29fff93f-08f1-4e46-91db-84ab16f785e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 15:56:06 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-ee311c1c-86ff-4001-8dd4-9b14fc87af84 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Converting VIF {"id": "29fff93f-08f1-4e46-91db-84ab16f785e5", "address": "fa:16:3e:d7:cf:dd", "network": {"id": "48f1545d-7e80-462f-9dbf-f1102ddcda9a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1210368397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1013e7afbefd4146a3be04587710b1de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29fff93f-08", "ovs_interfaceid": "29fff93f-08f1-4e46-91db-84ab16f785e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 15:56:06 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-ee311c1c-86ff-4001-8dd4-9b14fc87af84 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d7:cf:dd,bridge_name='br-int',has_traffic_filtering=True,id=29fff93f-08f1-4e46-91db-84ab16f785e5,network=Network(48f1545d-7e80-462f-9dbf-f1102ddcda9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29fff93f-08') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 15:56:06 user nova-compute[75337]: DEBUG os_vif [None req-ee311c1c-86ff-4001-8dd4-9b14fc87af84 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d7:cf:dd,bridge_name='br-int',has_traffic_filtering=True,id=29fff93f-08f1-4e46-91db-84ab16f785e5,network=Network(48f1545d-7e80-462f-9dbf-f1102ddcda9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29fff93f-08') {{(pid=75337) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 15:56:06 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:56:06 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap29fff93f-08, bridge=br-int, if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:56:06 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:56:06 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:56:06 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b11026c6-5c65-4c7a-b393-9eb17509c09c) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:56:06 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:56:06 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:56:06 user nova-compute[75337]: INFO os_vif [None req-ee311c1c-86ff-4001-8dd4-9b14fc87af84 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d7:cf:dd,bridge_name='br-int',has_traffic_filtering=True,id=29fff93f-08f1-4e46-91db-84ab16f785e5,network=Network(48f1545d-7e80-462f-9dbf-f1102ddcda9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29fff93f-08')
Nov 06 15:56:06 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-ee311c1c-86ff-4001-8dd4-9b14fc87af84 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] [instance: a293c354-d1e5-4c33-9e7b-d1558235aaf8] Deleting instance files /opt/stack/data/nova/instances/a293c354-d1e5-4c33-9e7b-d1558235aaf8_del
Nov 06 15:56:06 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-ee311c1c-86ff-4001-8dd4-9b14fc87af84 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] [instance: a293c354-d1e5-4c33-9e7b-d1558235aaf8] Deletion of /opt/stack/data/nova/instances/a293c354-d1e5-4c33-9e7b-d1558235aaf8_del complete
Nov 06 15:56:06 user nova-compute[75337]: INFO nova.compute.manager [None req-ee311c1c-86ff-4001-8dd4-9b14fc87af84 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] [instance: a293c354-d1e5-4c33-9e7b-d1558235aaf8] Took 0.70 seconds to destroy the instance on the hypervisor.
Nov 06 15:56:06 user nova-compute[75337]: DEBUG oslo.service.loopingcall [None req-ee311c1c-86ff-4001-8dd4-9b14fc87af84 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75337) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 15:56:06 user nova-compute[75337]: DEBUG nova.compute.manager [-] [instance: a293c354-d1e5-4c33-9e7b-d1558235aaf8] Deallocating network for instance {{(pid=75337) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 15:56:06 user nova-compute[75337]: DEBUG nova.network.neutron [-] [instance: a293c354-d1e5-4c33-9e7b-d1558235aaf8] deallocate_for_instance() {{(pid=75337) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 15:56:06 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:56:06 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:56:06 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:56:06 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:56:06 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75337) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 15:56:07 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:56:07 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:56:07 user nova-compute[75337]: DEBUG nova.network.neutron [-] [instance: a293c354-d1e5-4c33-9e7b-d1558235aaf8] Updating instance_info_cache with network_info: [] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:56:07 user nova-compute[75337]: INFO nova.compute.manager [-] [instance: a293c354-d1e5-4c33-9e7b-d1558235aaf8] Took 1.08 seconds to deallocate network for instance.
Nov 06 15:56:07 user nova-compute[75337]: DEBUG nova.compute.manager [req-4ca0ed72-2fde-4119-bdf6-6cdd9d461ad3 req-2b049f89-e528-4c96-8fb0-ef7afff21d21 service nova] [instance: a293c354-d1e5-4c33-9e7b-d1558235aaf8] Received event network-vif-deleted-29fff93f-08f1-4e46-91db-84ab16f785e5 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:56:07 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-ee311c1c-86ff-4001-8dd4-9b14fc87af84 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:56:07 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-ee311c1c-86ff-4001-8dd4-9b14fc87af84 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:56:07 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-ee311c1c-86ff-4001-8dd4-9b14fc87af84 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 15:56:07 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-ee311c1c-86ff-4001-8dd4-9b14fc87af84 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 15:56:08 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-ee311c1c-86ff-4001-8dd4-9b14fc87af84 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.343s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:56:08 user nova-compute[75337]: INFO nova.scheduler.client.report [None req-ee311c1c-86ff-4001-8dd4-9b14fc87af84 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Deleted allocations for instance a293c354-d1e5-4c33-9e7b-d1558235aaf8
Nov 06 15:56:08 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-ee311c1c-86ff-4001-8dd4-9b14fc87af84 tempest-AttachVolumeNegativeTest-1104237961 tempest-AttachVolumeNegativeTest-1104237961-project-member] Lock "a293c354-d1e5-4c33-9e7b-d1558235aaf8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.352s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:56:08 user nova-compute[75337]: DEBUG nova.compute.manager [req-87061df8-212e-4318-9cb3-61d3e7ed28f0 req-5d49053a-ed34-4305-b800-2707060b4963 service nova] [instance: a293c354-d1e5-4c33-9e7b-d1558235aaf8] Received event network-vif-plugged-29fff93f-08f1-4e46-91db-84ab16f785e5 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:56:08 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-87061df8-212e-4318-9cb3-61d3e7ed28f0 req-5d49053a-ed34-4305-b800-2707060b4963 service nova] Acquiring lock "a293c354-d1e5-4c33-9e7b-d1558235aaf8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:56:08 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-87061df8-212e-4318-9cb3-61d3e7ed28f0 req-5d49053a-ed34-4305-b800-2707060b4963 service nova] Lock "a293c354-d1e5-4c33-9e7b-d1558235aaf8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:56:08 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-87061df8-212e-4318-9cb3-61d3e7ed28f0 req-5d49053a-ed34-4305-b800-2707060b4963 service nova] Lock "a293c354-d1e5-4c33-9e7b-d1558235aaf8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:56:08 user nova-compute[75337]: DEBUG nova.compute.manager [req-87061df8-212e-4318-9cb3-61d3e7ed28f0 req-5d49053a-ed34-4305-b800-2707060b4963 service nova] [instance: a293c354-d1e5-4c33-9e7b-d1558235aaf8] No waiting events found dispatching network-vif-plugged-29fff93f-08f1-4e46-91db-84ab16f785e5 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:56:08 user nova-compute[75337]: WARNING nova.compute.manager [req-87061df8-212e-4318-9cb3-61d3e7ed28f0 req-5d49053a-ed34-4305-b800-2707060b4963 service nova] [instance: a293c354-d1e5-4c33-9e7b-d1558235aaf8] Received unexpected event network-vif-plugged-29fff93f-08f1-4e46-91db-84ab16f785e5 for instance with vm_state deleted and task_state None.
Nov 06 15:56:08 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:56:09 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:56:09 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:56:10 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:56:10 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Starting heal instance info cache {{(pid=75337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 15:56:10 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "refresh_cache-30c634ff-6999-40aa-a90d-1db6d278b571" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 15:56:10 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquired lock "refresh_cache-30c634ff-6999-40aa-a90d-1db6d278b571" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 15:56:10 user nova-compute[75337]: DEBUG nova.network.neutron [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] [instance: 30c634ff-6999-40aa-a90d-1db6d278b571] Forcefully refreshing network info cache for instance {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 15:56:11 user nova-compute[75337]: DEBUG nova.network.neutron [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] [instance: 30c634ff-6999-40aa-a90d-1db6d278b571] Updating instance_info_cache with network_info: [{"id": "7b7a4e21-92b6-4854-8c0d-4d9556247a72", "address": "fa:16:3e:ee:c7:a1", "network": {"id": "6757c3a5-4f6f-48a7-9645-af433fb039de", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1337373982-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e13dfd402b7b4ed1a1092c7388ff5188", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b7a4e21-92", "ovs_interfaceid": "7b7a4e21-92b6-4854-8c0d-4d9556247a72", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:56:11 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Releasing lock "refresh_cache-30c634ff-6999-40aa-a90d-1db6d278b571" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 15:56:11 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] [instance: 30c634ff-6999-40aa-a90d-1db6d278b571] Updated the network info_cache for instance {{(pid=75337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 15:56:11 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:56:11 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:56:14 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:56:14 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:56:15 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:56:15 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager.update_available_resource {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:56:15 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:56:15 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:56:15 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:56:15 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Auditing locally available compute resources for user (node: user) {{(pid=75337) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 15:56:15 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69df3824-b28c-43c0-9f20-52fa956642cc/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:56:15 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69df3824-b28c-43c0-9f20-52fa956642cc/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:56:15 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69df3824-b28c-43c0-9f20-52fa956642cc/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:56:16 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69df3824-b28c-43c0-9f20-52fa956642cc/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:56:16 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5248533a-89b6-444e-a60a-154b3cdef815/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:56:16 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5248533a-89b6-444e-a60a-154b3cdef815/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:56:16 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5248533a-89b6-444e-a60a-154b3cdef815/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:56:16 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:56:16 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5248533a-89b6-444e-a60a-154b3cdef815/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:56:16 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30c634ff-6999-40aa-a90d-1db6d278b571/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:56:16 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30c634ff-6999-40aa-a90d-1db6d278b571/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:56:16 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30c634ff-6999-40aa-a90d-1db6d278b571/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:56:16 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30c634ff-6999-40aa-a90d-1db6d278b571/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:56:16 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6110b34a-6fd3-45fc-911d-4e5d3c7f2d78/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:56:17 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6110b34a-6fd3-45fc-911d-4e5d3c7f2d78/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:56:17 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6110b34a-6fd3-45fc-911d-4e5d3c7f2d78/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:56:17 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6110b34a-6fd3-45fc-911d-4e5d3c7f2d78/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:56:17 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d10b4a86-8b0d-423f-81e2-87f5f25a2467/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:56:17 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d10b4a86-8b0d-423f-81e2-87f5f25a2467/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:56:17 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d10b4a86-8b0d-423f-81e2-87f5f25a2467/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:56:17 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d10b4a86-8b0d-423f-81e2-87f5f25a2467/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:56:18 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 15:56:18 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 15:56:18 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Hypervisor/Node resource view: name=user free_ram=8077MB free_disk=25.128990173339844GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75337) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 15:56:18 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:56:18 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:56:18 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 30c634ff-6999-40aa-a90d-1db6d278b571 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:56:18 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 6110b34a-6fd3-45fc-911d-4e5d3c7f2d78 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:56:18 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance d10b4a86-8b0d-423f-81e2-87f5f25a2467 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:56:18 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 69df3824-b28c-43c0-9f20-52fa956642cc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:56:18 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 5248533a-89b6-444e-a60a-154b3cdef815 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:56:18 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 9a3a0bd3-6c4d-434f-9f6b-7d954f7c163b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:56:18 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 15:56:18 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 15:56:18 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 15:56:18 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 15:56:18 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Compute_service record updated for user:user {{(pid=75337) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 15:56:18 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.392s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:56:19 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:56:21 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:56:26 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:56:29 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:56:31 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:56:36 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:56:37 user nova-compute[75337]: DEBUG nova.compute.manager [req-f3f95950-d49c-47a8-aa3c-edc571d88738 req-953b1162-0faa-4801-a846-6c141cf5fd97 service nova] [instance: 69df3824-b28c-43c0-9f20-52fa956642cc] Received event network-changed-c3d051e2-c3b7-4ee0-aab0-dcf3c0d1d578 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:56:37 user nova-compute[75337]: DEBUG nova.compute.manager [req-f3f95950-d49c-47a8-aa3c-edc571d88738 req-953b1162-0faa-4801-a846-6c141cf5fd97 service nova] [instance: 69df3824-b28c-43c0-9f20-52fa956642cc] Refreshing instance network info cache due to event network-changed-c3d051e2-c3b7-4ee0-aab0-dcf3c0d1d578. {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 15:56:37 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-f3f95950-d49c-47a8-aa3c-edc571d88738 req-953b1162-0faa-4801-a846-6c141cf5fd97 service nova] Acquiring lock "refresh_cache-69df3824-b28c-43c0-9f20-52fa956642cc" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 15:56:37 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-f3f95950-d49c-47a8-aa3c-edc571d88738 req-953b1162-0faa-4801-a846-6c141cf5fd97 service nova] Acquired lock "refresh_cache-69df3824-b28c-43c0-9f20-52fa956642cc" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 15:56:37 user nova-compute[75337]: DEBUG nova.network.neutron [req-f3f95950-d49c-47a8-aa3c-edc571d88738 req-953b1162-0faa-4801-a846-6c141cf5fd97 service nova] [instance: 69df3824-b28c-43c0-9f20-52fa956642cc] Refreshing network info cache for port c3d051e2-c3b7-4ee0-aab0-dcf3c0d1d578 {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 15:56:38 user nova-compute[75337]: DEBUG nova.network.neutron [req-f3f95950-d49c-47a8-aa3c-edc571d88738 req-953b1162-0faa-4801-a846-6c141cf5fd97 service nova] [instance: 69df3824-b28c-43c0-9f20-52fa956642cc] Updated VIF entry in instance network info cache for port c3d051e2-c3b7-4ee0-aab0-dcf3c0d1d578. {{(pid=75337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 15:56:38 user nova-compute[75337]: DEBUG nova.network.neutron [req-f3f95950-d49c-47a8-aa3c-edc571d88738 req-953b1162-0faa-4801-a846-6c141cf5fd97 service nova] [instance: 69df3824-b28c-43c0-9f20-52fa956642cc] Updating instance_info_cache with network_info: [{"id": "c3d051e2-c3b7-4ee0-aab0-dcf3c0d1d578", "address": "fa:16:3e:7e:b4:bf", "network": {"id": "8b217731-de9e-49bc-84bb-130fd42ede51", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-314618758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98fac9096a3b4f21ba805ba1437d9d38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3d051e2-c3", "ovs_interfaceid": "c3d051e2-c3b7-4ee0-aab0-dcf3c0d1d578", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:56:38 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-f3f95950-d49c-47a8-aa3c-edc571d88738 req-953b1162-0faa-4801-a846-6c141cf5fd97 service nova] Releasing lock "refresh_cache-69df3824-b28c-43c0-9f20-52fa956642cc" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 15:56:39 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:56:41 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:56:43 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-e30b2af0-ed10-4fe7-8b92-00fb05997a1b tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Acquiring lock "69df3824-b28c-43c0-9f20-52fa956642cc" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:56:43 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-e30b2af0-ed10-4fe7-8b92-00fb05997a1b tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Lock "69df3824-b28c-43c0-9f20-52fa956642cc" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:56:43 user nova-compute[75337]: DEBUG nova.objects.instance [None req-e30b2af0-ed10-4fe7-8b92-00fb05997a1b tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Lazy-loading 'flavor' on Instance uuid 69df3824-b28c-43c0-9f20-52fa956642cc {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 15:56:44 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-e30b2af0-ed10-4fe7-8b92-00fb05997a1b tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Lock "69df3824-b28c-43c0-9f20-52fa956642cc" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:56:44 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-e30b2af0-ed10-4fe7-8b92-00fb05997a1b tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Acquiring lock "69df3824-b28c-43c0-9f20-52fa956642cc" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:56:44 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-e30b2af0-ed10-4fe7-8b92-00fb05997a1b tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Lock "69df3824-b28c-43c0-9f20-52fa956642cc" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:56:44 user nova-compute[75337]: INFO nova.compute.manager [None req-e30b2af0-ed10-4fe7-8b92-00fb05997a1b tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] [instance: 69df3824-b28c-43c0-9f20-52fa956642cc] Attaching volume 27fe0158-ccd9-4398-ad6f-5622476733da to /dev/vdb
Nov 06 15:56:44 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:56:44 user nova-compute[75337]: DEBUG os_brick.utils [None req-e30b2af0-ed10-4fe7-8b92-00fb05997a1b tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 15:56:44 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:56:44 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:56:44 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[43b4b67f-679d-46ef-9e22-a7d29809028e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4ff6411e45b8\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:56:44 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:56:44 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:56:44 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bdda329-a1e2-4889-93a5-638438aa7000]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:56:44 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:56:44 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:56:44 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c353fa6-7f43-4627-8d98-b2018d9bbddd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:56:44 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[38da6f0d-ab74-4c23-8c1d-746cc7c2ffb0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:56:44 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-e30b2af0-ed10-4fe7-8b92-00fb05997a1b tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Running cmd (subprocess): nvme version {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:56:44 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-e30b2af0-ed10-4fe7-8b92-00fb05997a1b tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] 'nvme version' failed. Not Retrying. {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 15:56:44 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e30b2af0-ed10-4fe7-8b92-00fb05997a1b tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] nvme not present on system {{(pid=75337) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 15:56:44 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:56:44 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 15:56:44 user nova-compute[75337]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 15:56:44 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[511c6566-6f34-4f26-8707-afe86367349b]: (4, '') {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:56:44 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.lightos [None req-e30b2af0-ed10-4fe7-8b92-00fb05997a1b tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75337) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 15:56:44 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.lightos [None req-e30b2af0-ed10-4fe7-8b92-00fb05997a1b tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 15:56:44 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.lightos [None req-e30b2af0-ed10-4fe7-8b92-00fb05997a1b tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] LIGHTOS: no hostnqn found. {{(pid=75337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 15:56:44 user nova-compute[75337]: DEBUG os_brick.utils [None req-e30b2af0-ed10-4fe7-8b92-00fb05997a1b tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] <== get_connector_properties: return (169ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4ff6411e45b8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 15:56:44 user nova-compute[75337]: DEBUG nova.virt.block_device [None req-e30b2af0-ed10-4fe7-8b92-00fb05997a1b tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] [instance: 69df3824-b28c-43c0-9f20-52fa956642cc] Updating existing volume attachment record: ec9ae61b-1749-4c51-ba77-d135a5c32f96 {{(pid=75337) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 15:56:46 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:56:51 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:56:54 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:56:56 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:57:01 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:57:03 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d1180fb-e93c-414f-a8ef-a43341c0212f tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] [instance: d10b4a86-8b0d-423f-81e2-87f5f25a2467] Calling os-brick to attach iSCSI Volume {{(pid=75337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 15:57:03 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d1180fb-e93c-414f-a8ef-a43341c0212f tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2abc33d0c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:326a132a-07d4-4085-8da9-ffa8444121b5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZkMjQJdO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 15:57:03 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-4d1180fb-e93c-414f-a8ef-a43341c0212f tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 15:57:03 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-4d1180fb-e93c-414f-a8ef-a43341c0212f tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 15:57:03 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-4d1180fb-e93c-414f-a8ef-a43341c0212f tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 15:57:03 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-4d1180fb-e93c-414f-a8ef-a43341c0212f tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 15:57:03 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-4d1180fb-e93c-414f-a8ef-a43341c0212f tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:326a132a-07d4-4085-8da9-ffa8444121b5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 15:57:03 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-4d1180fb-e93c-414f-a8ef-a43341c0212f tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:326a132a-07d4-4085-8da9-ffa8444121b5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 15:57:03 user nova-compute[75337]: INFO os_brick.initiator.connectors.iscsi [None req-4d1180fb-e93c-414f-a8ef-a43341c0212f tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 15:57:03 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:326a132a-07d4-4085-8da9-ffa8444121b5 -p 172.16.0.220:3260 {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:57:03 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:326a132a-07d4-4085-8da9-ffa8444121b5 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:57:03 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[2791526d-9b1c-4939-a62c-368d4d57a567]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:57:03 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d1180fb-e93c-414f-a8ef-a43341c0212f tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 15:57:03 user nova-compute[75337]:  {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:57:03 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:326a132a-07d4-4085-8da9-ffa8444121b5 -p 172.16.0.220:3260 --interface default --op new {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:57:03 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:326a132a-07d4-4085-8da9-ffa8444121b5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:57:03 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[60f5e7ae-54a8-48f8-af3e-b9ffaa5af10c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:326a132a-07d4-4085-8da9-ffa8444121b5] added\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:57:03 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d1180fb-e93c-414f-a8ef-a43341c0212f tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:326a132a-07d4-4085-8da9-ffa8444121b5] added
Nov 06 15:57:03 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:57:03 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:326a132a-07d4-4085-8da9-ffa8444121b5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:57:03 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:326a132a-07d4-4085-8da9-ffa8444121b5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.032s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:57:03 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[08491532-e4ed-4e11-8c24-f4db485c7abf]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:57:03 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d1180fb-e93c-414f-a8ef-a43341c0212f tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:57:03 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:326a132a-07d4-4085-8da9-ffa8444121b5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:57:03 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:326a132a-07d4-4085-8da9-ffa8444121b5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:57:03 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[639b7b71-09c1-4873-b142-a4f201cfdb3e]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:57:03 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d1180fb-e93c-414f-a8ef-a43341c0212f tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:57:03 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:326a132a-07d4-4085-8da9-ffa8444121b5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZkMjQJdO {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:57:03 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:326a132a-07d4-4085-8da9-ffa8444121b5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZkMjQJdO" returned: 0 in 0.018s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:57:03 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[625641f2-ef6f-4b0b-a9e9-ecdcd5f14b66]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:57:03 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d1180fb-e93c-414f-a8ef-a43341c0212f tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZkMjQJdO'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:57:03 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:326a132a-07d4-4085-8da9-ffa8444121b5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:57:04 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:326a132a-07d4-4085-8da9-ffa8444121b5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:57:04 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[e56f6452-9ae0-4d63-9e2f-1ee9f0e33046]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:57:04 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d1180fb-e93c-414f-a8ef-a43341c0212f tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:57:04 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:57:04 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:57:04 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6de6a32-5d99-4c5e-b306-773f1a5c0fbc]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:57:04 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d1180fb-e93c-414f-a8ef-a43341c0212f tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 06 15:57:04 user nova-compute[75337]:  {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 15:57:04 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d1180fb-e93c-414f-a8ef-a43341c0212f tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 06 15:57:04 user nova-compute[75337]:  {{(pid=75337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 15:57:04 user nova-compute[75337]: WARNING os_brick.initiator.connectors.iscsi [None req-4d1180fb-e93c-414f-a8ef-a43341c0212f tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 06 15:57:04 user nova-compute[75337]: 
Nov 06 15:57:04 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:326a132a-07d4-4085-8da9-ffa8444121b5 -p 172.16.0.220:3260 --login {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:57:04 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:326a132a-07d4-4085-8da9-ffa8444121b5 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:57:04 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c6febf1-65de-4db9-8c19-d13f361d0c00]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:326a132a-07d4-4085-8da9-ffa8444121b5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:326a132a-07d4-4085-8da9-ffa8444121b5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:57:04 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d1180fb-e93c-414f-a8ef-a43341c0212f tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:326a132a-07d4-4085-8da9-ffa8444121b5, portal: 172.16.0.220,3260]
Nov 06 15:57:04 user nova-compute[75337]: Login to [iface: default, target: iqn.2010-10.org.openstack:326a132a-07d4-4085-8da9-ffa8444121b5, portal: 172.16.0.220,3260] successful.
Nov 06 15:57:04 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:57:04 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:326a132a-07d4-4085-8da9-ffa8444121b5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:57:04 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:326a132a-07d4-4085-8da9-ffa8444121b5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:57:04 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e6cd675-b264-47d8-b53e-0c34519bf8a0]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:57:04 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d1180fb-e93c-414f-a8ef-a43341c0212f tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:57:04 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:57:04 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:57:04 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[03124e98-5a38-43f8-a4d4-14bf459286ba]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326a132a-07d4-4085-8da9-ffa8444121b5 (non-flash)\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:57:04 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d1180fb-e93c-414f-a8ef-a43341c0212f tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326a132a-07d4-4085-8da9-ffa8444121b5 (non-flash)
Nov 06 15:57:04 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 15:57:04 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d1180fb-e93c-414f-a8ef-a43341c0212f tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326a132a-07d4-4085-8da9-ffa8444121b5 (non-flash)
Nov 06 15:57:04 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 15:57:04 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-4d1180fb-e93c-414f-a8ef-a43341c0212f tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:326a132a-07d4-4085-8da9-ffa8444121b5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.282s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 15:57:04 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d1180fb-e93c-414f-a8ef-a43341c0212f tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Connected to 172.16.0.220:3260 {{(pid=75337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 15:57:04 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-4d1180fb-e93c-414f-a8ef-a43341c0212f tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] HCTL ('33', '-', '-', 0) found on session 32 with lun 0 {{(pid=75337) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 15:57:04 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-4d1180fb-e93c-414f-a8ef-a43341c0212f tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75337) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 15:57:04 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:57:04 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:57:04 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[bef0b538-771c-4029-abec-cdb0c5ce9c12]: (4, ('- - 0', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:57:04 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-4d1180fb-e93c-414f-a8ef-a43341c0212f tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Searching for a device in session 32 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75337) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 15:57:04 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d1180fb-e93c-414f-a8ef-a43341c0212f tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:326a132a-07d4-4085-8da9-ffa8444121b5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZkMjQJdO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 15:57:04 user nova-compute[75337]: DEBUG nova.compute.manager [None req-315c64b4-0ba5-41ce-9d40-99d2cdfc2b9e tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 9a3a0bd3-6c4d-434f-9f6b-7d954f7c163b] Start spawning the instance on the hypervisor. {{(pid=75337) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 15:57:04 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-315c64b4-0ba5-41ce-9d40-99d2cdfc2b9e tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 9a3a0bd3-6c4d-434f-9f6b-7d954f7c163b] Creating instance directory {{(pid=75337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 15:57:04 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-315c64b4-0ba5-41ce-9d40-99d2cdfc2b9e tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 9a3a0bd3-6c4d-434f-9f6b-7d954f7c163b] Creating image(s)
Nov 06 15:57:04 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-315c64b4-0ba5-41ce-9d40-99d2cdfc2b9e tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 9a3a0bd3-6c4d-434f-9f6b-7d954f7c163b] Did not create local disks {{(pid=75337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 06 15:57:04 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-315c64b4-0ba5-41ce-9d40-99d2cdfc2b9e tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 9a3a0bd3-6c4d-434f-9f6b-7d954f7c163b] Ensure instance console log exists: /opt/stack/data/nova/instances/9a3a0bd3-6c4d-434f-9f6b-7d954f7c163b/console.log {{(pid=75337) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 15:57:04 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-315c64b4-0ba5-41ce-9d40-99d2cdfc2b9e tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:57:04 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-315c64b4-0ba5-41ce-9d40-99d2cdfc2b9e tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:57:04 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-315c64b4-0ba5-41ce-9d40-99d2cdfc2b9e tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:57:04 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-315c64b4-0ba5-41ce-9d40-99d2cdfc2b9e tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 9a3a0bd3-6c4d-434f-9f6b-7d954f7c163b] Start _get_guest_xml network_info=[{"id": "733c74d6-103a-491b-b443-9b2fe9ceb5f3", "address": "fa:16:3e:3d:e8:fb", "network": {"id": "4e47319f-de1d-4dfe-9915-7d2d5131704d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-895093240-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "915211c6a2734c36b34ff92a56b085f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap733c74d6-10", "ovs_interfaceid": "733c74d6-103a-491b-b443-9b2fe9ceb5f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'attachment_id': '33c00d8d-a0b9-4c37-b4c4-6c596c2f773e', 'guest_format': None, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CPtyXLsv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9a3a0bd3-6c4d-434f-9f6b-7d954f7c163b', 'attached_at': '', 'detached_at': '', 'volume_id': '324f5822-eef0-4ecf-93e4-791b0677d673', 'serial': '324f5822-eef0-4ecf-93e4-791b0677d673'}, 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=75337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 15:57:04 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-315c64b4-0ba5-41ce-9d40-99d2cdfc2b9e tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 15:57:04 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-315c64b4-0ba5-41ce-9d40-99d2cdfc2b9e tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 15:57:04 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-315c64b4-0ba5-41ce-9d40-99d2cdfc2b9e tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 15:57:04 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-315c64b4-0ba5-41ce-9d40-99d2cdfc2b9e tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] CPU controller missing on host. {{(pid=75337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 15:57:04 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-315c64b4-0ba5-41ce-9d40-99d2cdfc2b9e tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 15:57:04 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-315c64b4-0ba5-41ce-9d40-99d2cdfc2b9e tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] CPU controller found on host. {{(pid=75337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 15:57:04 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-315c64b4-0ba5-41ce-9d40-99d2cdfc2b9e tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75337) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 15:57:04 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-315c64b4-0ba5-41ce-9d40-99d2cdfc2b9e tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T15:34:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 15:57:04 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-315c64b4-0ba5-41ce-9d40-99d2cdfc2b9e tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Flavor limits 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 15:57:04 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-315c64b4-0ba5-41ce-9d40-99d2cdfc2b9e tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Image limits 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 15:57:04 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-315c64b4-0ba5-41ce-9d40-99d2cdfc2b9e tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Flavor pref 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 15:57:04 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-315c64b4-0ba5-41ce-9d40-99d2cdfc2b9e tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Image pref 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 15:57:04 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-315c64b4-0ba5-41ce-9d40-99d2cdfc2b9e tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 15:57:04 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-315c64b4-0ba5-41ce-9d40-99d2cdfc2b9e tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 15:57:04 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-315c64b4-0ba5-41ce-9d40-99d2cdfc2b9e tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 15:57:04 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-315c64b4-0ba5-41ce-9d40-99d2cdfc2b9e tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Got 1 possible topologies {{(pid=75337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 15:57:04 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-315c64b4-0ba5-41ce-9d40-99d2cdfc2b9e tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 15:57:04 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-315c64b4-0ba5-41ce-9d40-99d2cdfc2b9e tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 15:57:04 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-315c64b4-0ba5-41ce-9d40-99d2cdfc2b9e tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 9a3a0bd3-6c4d-434f-9f6b-7d954f7c163b] Calling os-brick to attach iSCSI Volume {{(pid=75337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 15:57:04 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-315c64b4-0ba5-41ce-9d40-99d2cdfc2b9e tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2abc33d0c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CPtyXLsv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 15:57:04 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-315c64b4-0ba5-41ce-9d40-99d2cdfc2b9e tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 15:57:04 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-315c64b4-0ba5-41ce-9d40-99d2cdfc2b9e tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 15:57:05 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-4d1180fb-e93c-414f-a8ef-a43341c0212f tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.320s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 15:57:05 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d1180fb-e93c-414f-a8ef-a43341c0212f tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] <== connect_volume: return (1322ms) {'type': 'block', 'scsi_wwn': '23039346337646335', 'path': '/dev/sdb'} {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 15:57:05 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d1180fb-e93c-414f-a8ef-a43341c0212f tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] [instance: d10b4a86-8b0d-423f-81e2-87f5f25a2467] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23039346337646335', 'path': '/dev/sdb'} {{(pid=75337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 15:57:05 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-315c64b4-0ba5-41ce-9d40-99d2cdfc2b9e tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.687s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 15:57:05 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-315c64b4-0ba5-41ce-9d40-99d2cdfc2b9e tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 15:57:05 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-315c64b4-0ba5-41ce-9d40-99d2cdfc2b9e tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 15:57:05 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-315c64b4-0ba5-41ce-9d40-99d2cdfc2b9e tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 15:57:05 user nova-compute[75337]: INFO os_brick.initiator.connectors.iscsi [None req-315c64b4-0ba5-41ce-9d40-99d2cdfc2b9e tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 15:57:05 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673 -p 172.16.0.220:3260 {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:57:05 user nova-compute[75337]: DEBUG nova.objects.instance [None req-4d1180fb-e93c-414f-a8ef-a43341c0212f tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Lazy-loading 'flavor' on Instance uuid d10b4a86-8b0d-423f-81e2-87f5f25a2467 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 15:57:05 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:57:05 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[158c1c81-faf9-4394-bd1e-2259242e1ad1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:57:05 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-315c64b4-0ba5-41ce-9d40-99d2cdfc2b9e tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 15:57:05 user nova-compute[75337]:  {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:57:05 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673 -p 172.16.0.220:3260 --interface default --op new {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:57:05 user nova-compute[75337]: DEBUG nova.virt.libvirt.guest [None req-4d1180fb-e93c-414f-a8ef-a43341c0212f tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] attach device xml: <disk type="block" device="disk">
Nov 06 15:57:05 user nova-compute[75337]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 15:57:05 user nova-compute[75337]:   <source dev="/dev/sdb"/>
Nov 06 15:57:05 user nova-compute[75337]:   <target dev="vdb" bus="virtio"/>
Nov 06 15:57:05 user nova-compute[75337]:   <serial>326a132a-07d4-4085-8da9-ffa8444121b5</serial>
Nov 06 15:57:05 user nova-compute[75337]: </disk>
Nov 06 15:57:05 user nova-compute[75337]:  {{(pid=75337) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 06 15:57:05 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:57:05 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cb32cc7-8f89-467d-8a2c-27d32e740d6a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673] added\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:57:05 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-315c64b4-0ba5-41ce-9d40-99d2cdfc2b9e tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673] added
Nov 06 15:57:05 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:57:05 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:57:05 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:57:05 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[67348d49-00cb-40ab-a39f-3305761583ae]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:57:05 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-315c64b4-0ba5-41ce-9d40-99d2cdfc2b9e tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:57:05 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:57:05 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:57:05 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fc21ddf-36fc-4b00-93c4-5b46f6467946]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:57:05 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-315c64b4-0ba5-41ce-9d40-99d2cdfc2b9e tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:57:05 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CPtyXLsv {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:57:05 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CPtyXLsv" returned: 0 in 0.021s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:57:05 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[b14028a5-5eb1-4064-8bc7-0df67d551d6d]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:57:05 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-315c64b4-0ba5-41ce-9d40-99d2cdfc2b9e tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CPtyXLsv'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:57:05 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:57:05 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:57:05 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[b752b0f0-086e-4cbf-95c6-967405a1cc6c]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:57:05 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-315c64b4-0ba5-41ce-9d40-99d2cdfc2b9e tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:57:05 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:57:05 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:57:05 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fa7c7d7-09e2-4894-9ff0-34c84bd5cb02]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326a132a-07d4-4085-8da9-ffa8444121b5 (non-flash)\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:57:05 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-315c64b4-0ba5-41ce-9d40-99d2cdfc2b9e tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326a132a-07d4-4085-8da9-ffa8444121b5 (non-flash)
Nov 06 15:57:05 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 15:57:05 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-315c64b4-0ba5-41ce-9d40-99d2cdfc2b9e tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326a132a-07d4-4085-8da9-ffa8444121b5 (non-flash)
Nov 06 15:57:05 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 15:57:05 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673 -p 172.16.0.220:3260 --login {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:57:05 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:57:05 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[588b37d6-47ca-4a7e-b7e3-710a41a77717]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:57:05 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-315c64b4-0ba5-41ce-9d40-99d2cdfc2b9e tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673, portal: 172.16.0.220,3260]
Nov 06 15:57:05 user nova-compute[75337]: Login to [iface: default, target: iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673, portal: 172.16.0.220,3260] successful.
Nov 06 15:57:05 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:57:05 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:57:05 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:57:05 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0937f2e-8530-44b3-8482-adeb8c049674]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:57:05 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-315c64b4-0ba5-41ce-9d40-99d2cdfc2b9e tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:57:05 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:57:05 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:57:05 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fb31ae3-6419-4739-9a57-2052f97e4c46]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326a132a-07d4-4085-8da9-ffa8444121b5 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673 (non-flash)\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:57:05 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-315c64b4-0ba5-41ce-9d40-99d2cdfc2b9e tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326a132a-07d4-4085-8da9-ffa8444121b5 (non-flash)
Nov 06 15:57:05 user nova-compute[75337]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673 (non-flash)
Nov 06 15:57:05 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 15:57:05 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-315c64b4-0ba5-41ce-9d40-99d2cdfc2b9e tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326a132a-07d4-4085-8da9-ffa8444121b5 (non-flash)
Nov 06 15:57:05 user nova-compute[75337]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673 (non-flash)
Nov 06 15:57:05 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 15:57:05 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-315c64b4-0ba5-41ce-9d40-99d2cdfc2b9e tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.312s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 15:57:05 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-315c64b4-0ba5-41ce-9d40-99d2cdfc2b9e tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Connected to 172.16.0.220:3260 {{(pid=75337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 15:57:05 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-315c64b4-0ba5-41ce-9d40-99d2cdfc2b9e tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] HCTL ('34', '-', '-', 0) found on session 33 with lun 0 {{(pid=75337) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 15:57:05 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-315c64b4-0ba5-41ce-9d40-99d2cdfc2b9e tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75337) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 15:57:05 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:57:05 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:57:05 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf804de9-cf5b-46b3-9ff5-a2bb54dd050e]: (4, ('- - 0', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:57:05 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-315c64b4-0ba5-41ce-9d40-99d2cdfc2b9e tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Searching for a device in session 33 and hctl ['34', '*', '*', 0] yield: None {{(pid=75337) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 15:57:05 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-4d1180fb-e93c-414f-a8ef-a43341c0212f tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] No BDM found with device name vda, not building metadata. {{(pid=75337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 15:57:05 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-4d1180fb-e93c-414f-a8ef-a43341c0212f tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 15:57:05 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-4d1180fb-e93c-414f-a8ef-a43341c0212f tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] No VIF found with MAC fa:16:3e:93:ab:63, not building metadata {{(pid=75337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 15:57:05 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-4d1180fb-e93c-414f-a8ef-a43341c0212f tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Lock "d10b4a86-8b0d-423f-81e2-87f5f25a2467" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 93.132s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:57:06 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:57:06 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-315c64b4-0ba5-41ce-9d40-99d2cdfc2b9e tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Searching for a device in session 33 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75337) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 15:57:06 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-315c64b4-0ba5-41ce-9d40-99d2cdfc2b9e tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CPtyXLsv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 15:57:06 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-315c64b4-0ba5-41ce-9d40-99d2cdfc2b9e tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.350s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 15:57:06 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-315c64b4-0ba5-41ce-9d40-99d2cdfc2b9e tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] <== connect_volume: return (2038ms) {'type': 'block', 'scsi_wwn': '23037396239386536', 'path': '/dev/sdc'} {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 15:57:06 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-315c64b4-0ba5-41ce-9d40-99d2cdfc2b9e tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 9a3a0bd3-6c4d-434f-9f6b-7d954f7c163b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23037396239386536', 'path': '/dev/sdc'} {{(pid=75337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 15:57:06 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-315c64b4-0ba5-41ce-9d40-99d2cdfc2b9e tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T15:56:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-103536881',display_name='tempest-TestVolumeBootPattern-server-103536881',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-103536881',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGSEIi3g934sMLPVz4vXQXFZs0uPpfou1A8cQ+7f5EeoH+XvyrzPDAqzu7FTAOU7yXRJ8IemF+WnLjTlXTwpg+PX5Yor65g2g46SgdNmwrUcBQAy+H25S13pZzToJUCwGA==',key_name='tempest-TestVolumeBootPattern-1419808121',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='915211c6a2734c36b34ff92a56b085f6',ramdisk_id='',reservation_id='r-02n02xu0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1055092640',owner_user_name='tempest-TestVolumeBootPattern-1055092640-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T15:56:02Z,user_data=None,user_id='bb8d5f0200124588be1cfde107341a45',uuid=9a3a0bd3-6c4d-434f-9f6b-7d954f7c163b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "733c74d6-103a-491b-b443-9b2fe9ceb5f3", "address": "fa:16:3e:3d:e8:fb", "network": {"id": "4e47319f-de1d-4dfe-9915-7d2d5131704d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-895093240-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "915211c6a2734c36b34ff92a56b085f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap733c74d6-10", "ovs_interfaceid": "733c74d6-103a-491b-b443-9b2fe9ceb5f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75337) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 15:57:06 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-315c64b4-0ba5-41ce-9d40-99d2cdfc2b9e tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Converting VIF {"id": "733c74d6-103a-491b-b443-9b2fe9ceb5f3", "address": "fa:16:3e:3d:e8:fb", "network": {"id": "4e47319f-de1d-4dfe-9915-7d2d5131704d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-895093240-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "915211c6a2734c36b34ff92a56b085f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap733c74d6-10", "ovs_interfaceid": "733c74d6-103a-491b-b443-9b2fe9ceb5f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 15:57:06 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-315c64b4-0ba5-41ce-9d40-99d2cdfc2b9e tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:e8:fb,bridge_name='br-int',has_traffic_filtering=True,id=733c74d6-103a-491b-b443-9b2fe9ceb5f3,network=Network(4e47319f-de1d-4dfe-9915-7d2d5131704d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap733c74d6-10') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 15:57:06 user nova-compute[75337]: DEBUG nova.objects.instance [None req-315c64b4-0ba5-41ce-9d40-99d2cdfc2b9e tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Lazy-loading 'pci_devices' on Instance uuid 9a3a0bd3-6c4d-434f-9f6b-7d954f7c163b {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 15:57:06 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-315c64b4-0ba5-41ce-9d40-99d2cdfc2b9e tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 9a3a0bd3-6c4d-434f-9f6b-7d954f7c163b] End _get_guest_xml xml=<domain type="kvm">
Nov 06 15:57:06 user nova-compute[75337]:   <uuid>9a3a0bd3-6c4d-434f-9f6b-7d954f7c163b</uuid>
Nov 06 15:57:06 user nova-compute[75337]:   <name>instance-00000022</name>
Nov 06 15:57:06 user nova-compute[75337]:   <memory>524288</memory>
Nov 06 15:57:06 user nova-compute[75337]:   <vcpu>1</vcpu>
Nov 06 15:57:06 user nova-compute[75337]:   <metadata>
Nov 06 15:57:06 user nova-compute[75337]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 15:57:06 user nova-compute[75337]:       <nova:package version="0.0.0"/>
Nov 06 15:57:06 user nova-compute[75337]:       <nova:name>tempest-TestVolumeBootPattern-server-103536881</nova:name>
Nov 06 15:57:06 user nova-compute[75337]:       <nova:creationTime>2023-11-06 15:57:04</nova:creationTime>
Nov 06 15:57:06 user nova-compute[75337]:       <nova:flavor name="m1.tiny">
Nov 06 15:57:06 user nova-compute[75337]:         <nova:memory>512</nova:memory>
Nov 06 15:57:06 user nova-compute[75337]:         <nova:disk>1</nova:disk>
Nov 06 15:57:06 user nova-compute[75337]:         <nova:swap>0</nova:swap>
Nov 06 15:57:06 user nova-compute[75337]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 15:57:06 user nova-compute[75337]:         <nova:vcpus>1</nova:vcpus>
Nov 06 15:57:06 user nova-compute[75337]:       </nova:flavor>
Nov 06 15:57:06 user nova-compute[75337]:       <nova:owner>
Nov 06 15:57:06 user nova-compute[75337]:         <nova:user uuid="bb8d5f0200124588be1cfde107341a45">tempest-TestVolumeBootPattern-1055092640-project-member</nova:user>
Nov 06 15:57:06 user nova-compute[75337]:         <nova:project uuid="915211c6a2734c36b34ff92a56b085f6">tempest-TestVolumeBootPattern-1055092640</nova:project>
Nov 06 15:57:06 user nova-compute[75337]:       </nova:owner>
Nov 06 15:57:06 user nova-compute[75337]:       <nova:ports>
Nov 06 15:57:06 user nova-compute[75337]:         <nova:port uuid="733c74d6-103a-491b-b443-9b2fe9ceb5f3">
Nov 06 15:57:06 user nova-compute[75337]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 06 15:57:06 user nova-compute[75337]:         </nova:port>
Nov 06 15:57:06 user nova-compute[75337]:       </nova:ports>
Nov 06 15:57:06 user nova-compute[75337]:     </nova:instance>
Nov 06 15:57:06 user nova-compute[75337]:   </metadata>
Nov 06 15:57:06 user nova-compute[75337]:   <sysinfo type="smbios">
Nov 06 15:57:06 user nova-compute[75337]:     <system>
Nov 06 15:57:06 user nova-compute[75337]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 15:57:06 user nova-compute[75337]:       <entry name="product">OpenStack Nova</entry>
Nov 06 15:57:06 user nova-compute[75337]:       <entry name="version">0.0.0</entry>
Nov 06 15:57:06 user nova-compute[75337]:       <entry name="serial">9a3a0bd3-6c4d-434f-9f6b-7d954f7c163b</entry>
Nov 06 15:57:06 user nova-compute[75337]:       <entry name="uuid">9a3a0bd3-6c4d-434f-9f6b-7d954f7c163b</entry>
Nov 06 15:57:06 user nova-compute[75337]:       <entry name="family">Virtual Machine</entry>
Nov 06 15:57:06 user nova-compute[75337]:     </system>
Nov 06 15:57:06 user nova-compute[75337]:   </sysinfo>
Nov 06 15:57:06 user nova-compute[75337]:   <os>
Nov 06 15:57:06 user nova-compute[75337]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 15:57:06 user nova-compute[75337]:     <boot dev="hd"/>
Nov 06 15:57:06 user nova-compute[75337]:     <smbios mode="sysinfo"/>
Nov 06 15:57:06 user nova-compute[75337]:   </os>
Nov 06 15:57:06 user nova-compute[75337]:   <features>
Nov 06 15:57:06 user nova-compute[75337]:     <acpi/>
Nov 06 15:57:06 user nova-compute[75337]:     <apic/>
Nov 06 15:57:06 user nova-compute[75337]:     <vmcoreinfo/>
Nov 06 15:57:06 user nova-compute[75337]:   </features>
Nov 06 15:57:06 user nova-compute[75337]:   <clock offset="utc">
Nov 06 15:57:06 user nova-compute[75337]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 15:57:06 user nova-compute[75337]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 15:57:06 user nova-compute[75337]:     <timer name="hpet" present="no"/>
Nov 06 15:57:06 user nova-compute[75337]:   </clock>
Nov 06 15:57:06 user nova-compute[75337]:   <cpu mode="custom" match="exact">
Nov 06 15:57:06 user nova-compute[75337]:     <model>Nehalem</model>
Nov 06 15:57:06 user nova-compute[75337]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 15:57:06 user nova-compute[75337]:   </cpu>
Nov 06 15:57:06 user nova-compute[75337]:   <devices>
Nov 06 15:57:06 user nova-compute[75337]:     <disk type="block" device="disk">
Nov 06 15:57:06 user nova-compute[75337]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 15:57:06 user nova-compute[75337]:       <source dev="/dev/sdc"/>
Nov 06 15:57:06 user nova-compute[75337]:       <target dev="vda" bus="virtio"/>
Nov 06 15:57:06 user nova-compute[75337]:       <serial>324f5822-eef0-4ecf-93e4-791b0677d673</serial>
Nov 06 15:57:06 user nova-compute[75337]:     </disk>
Nov 06 15:57:06 user nova-compute[75337]:     <interface type="ethernet">
Nov 06 15:57:06 user nova-compute[75337]:       <mac address="fa:16:3e:3d:e8:fb"/>
Nov 06 15:57:06 user nova-compute[75337]:       <model type="virtio"/>
Nov 06 15:57:06 user nova-compute[75337]:       <mtu size="1442"/>
Nov 06 15:57:06 user nova-compute[75337]:       <target dev="tap733c74d6-10"/>
Nov 06 15:57:06 user nova-compute[75337]:     </interface>
Nov 06 15:57:06 user nova-compute[75337]:     <serial type="pty">
Nov 06 15:57:06 user nova-compute[75337]:       <log file="/opt/stack/data/nova/instances/9a3a0bd3-6c4d-434f-9f6b-7d954f7c163b/console.log" append="off"/>
Nov 06 15:57:06 user nova-compute[75337]:     </serial>
Nov 06 15:57:06 user nova-compute[75337]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 15:57:06 user nova-compute[75337]:     <video>
Nov 06 15:57:06 user nova-compute[75337]:       <model type="virtio"/>
Nov 06 15:57:06 user nova-compute[75337]:     </video>
Nov 06 15:57:06 user nova-compute[75337]:     <rng model="virtio">
Nov 06 15:57:06 user nova-compute[75337]:       <backend model="random">/dev/urandom</backend>
Nov 06 15:57:06 user nova-compute[75337]:     </rng>
Nov 06 15:57:06 user nova-compute[75337]:     <controller type="usb" index="0" model="none"/>
Nov 06 15:57:06 user nova-compute[75337]:     <memballoon model="virtio">
Nov 06 15:57:06 user nova-compute[75337]:       <stats period="10"/>
Nov 06 15:57:06 user nova-compute[75337]:     </memballoon>
Nov 06 15:57:06 user nova-compute[75337]:   </devices>
Nov 06 15:57:06 user nova-compute[75337]: </domain>
Nov 06 15:57:06 user nova-compute[75337]:  {{(pid=75337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 15:57:06 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-315c64b4-0ba5-41ce-9d40-99d2cdfc2b9e tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T15:56:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-103536881',display_name='tempest-TestVolumeBootPattern-server-103536881',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-103536881',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGSEIi3g934sMLPVz4vXQXFZs0uPpfou1A8cQ+7f5EeoH+XvyrzPDAqzu7FTAOU7yXRJ8IemF+WnLjTlXTwpg+PX5Yor65g2g46SgdNmwrUcBQAy+H25S13pZzToJUCwGA==',key_name='tempest-TestVolumeBootPattern-1419808121',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='915211c6a2734c36b34ff92a56b085f6',ramdisk_id='',reservation_id='r-02n02xu0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1055092640',owner_user_name='tempest-TestVolumeBootPattern-1055092640-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T15:56:02Z,user_data=None,user_id='bb8d5f0200124588be1cfde107341a45',uuid=9a3a0bd3-6c4d-434f-9f6b-7d954f7c163b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "733c74d6-103a-491b-b443-9b2fe9ceb5f3", "address": "fa:16:3e:3d:e8:fb", "network": {"id": "4e47319f-de1d-4dfe-9915-7d2d5131704d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-895093240-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "915211c6a2734c36b34ff92a56b085f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap733c74d6-10", "ovs_interfaceid": "733c74d6-103a-491b-b443-9b2fe9ceb5f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 15:57:06 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-315c64b4-0ba5-41ce-9d40-99d2cdfc2b9e tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Converting VIF {"id": "733c74d6-103a-491b-b443-9b2fe9ceb5f3", "address": "fa:16:3e:3d:e8:fb", "network": {"id": "4e47319f-de1d-4dfe-9915-7d2d5131704d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-895093240-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "915211c6a2734c36b34ff92a56b085f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap733c74d6-10", "ovs_interfaceid": "733c74d6-103a-491b-b443-9b2fe9ceb5f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 15:57:06 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-315c64b4-0ba5-41ce-9d40-99d2cdfc2b9e tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:e8:fb,bridge_name='br-int',has_traffic_filtering=True,id=733c74d6-103a-491b-b443-9b2fe9ceb5f3,network=Network(4e47319f-de1d-4dfe-9915-7d2d5131704d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap733c74d6-10') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 15:57:06 user nova-compute[75337]: DEBUG os_vif [None req-315c64b4-0ba5-41ce-9d40-99d2cdfc2b9e tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:e8:fb,bridge_name='br-int',has_traffic_filtering=True,id=733c74d6-103a-491b-b443-9b2fe9ceb5f3,network=Network(4e47319f-de1d-4dfe-9915-7d2d5131704d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap733c74d6-10') {{(pid=75337) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 15:57:06 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:57:06 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:57:06 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 15:57:06 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:57:06 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd71f67c1-c7de-5f48-a7a9-8a7219bd60d5', '_type': 'linux-noop'}}, row=False) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:57:06 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:57:06 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:57:06 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:57:06 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap733c74d6-10, may_exist=True, interface_attrs={}) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:57:06 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap733c74d6-10, col_values=(('qos', UUID('55f1137c-3304-4022-b156-e57fbc9ec860')),), if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:57:06 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap733c74d6-10, col_values=(('external_ids', {'iface-id': '733c74d6-103a-491b-b443-9b2fe9ceb5f3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3d:e8:fb', 'vm-uuid': '9a3a0bd3-6c4d-434f-9f6b-7d954f7c163b'}),), if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:57:06 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:57:06 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:57:06 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:57:06 user nova-compute[75337]: INFO os_vif [None req-315c64b4-0ba5-41ce-9d40-99d2cdfc2b9e tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:e8:fb,bridge_name='br-int',has_traffic_filtering=True,id=733c74d6-103a-491b-b443-9b2fe9ceb5f3,network=Network(4e47319f-de1d-4dfe-9915-7d2d5131704d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap733c74d6-10')
Nov 06 15:57:06 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-315c64b4-0ba5-41ce-9d40-99d2cdfc2b9e tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] No BDM found with device name vda, not building metadata. {{(pid=75337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 15:57:06 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-315c64b4-0ba5-41ce-9d40-99d2cdfc2b9e tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] No VIF found with MAC fa:16:3e:3d:e8:fb, not building metadata {{(pid=75337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 15:57:07 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-fd7c5e48-273f-41b2-8c32-ddb7eb531afc tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Acquiring lock "f196f2b3-8eac-4d68-af2e-46671c865be1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:57:07 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-fd7c5e48-273f-41b2-8c32-ddb7eb531afc tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Lock "f196f2b3-8eac-4d68-af2e-46671c865be1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:57:07 user nova-compute[75337]: DEBUG nova.compute.manager [None req-fd7c5e48-273f-41b2-8c32-ddb7eb531afc tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] [instance: f196f2b3-8eac-4d68-af2e-46671c865be1] Starting instance... {{(pid=75337) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 15:57:07 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-fd7c5e48-273f-41b2-8c32-ddb7eb531afc tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:57:07 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-fd7c5e48-273f-41b2-8c32-ddb7eb531afc tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:57:07 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-fd7c5e48-273f-41b2-8c32-ddb7eb531afc tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75337) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 15:57:07 user nova-compute[75337]: INFO nova.compute.claims [None req-fd7c5e48-273f-41b2-8c32-ddb7eb531afc tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] [instance: f196f2b3-8eac-4d68-af2e-46671c865be1] Claim successful on node user
Nov 06 15:57:07 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e30b2af0-ed10-4fe7-8b92-00fb05997a1b tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] [instance: 69df3824-b28c-43c0-9f20-52fa956642cc] Calling os-brick to attach iSCSI Volume {{(pid=75337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 15:57:07 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e30b2af0-ed10-4fe7-8b92-00fb05997a1b tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2abc33d0c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'csbVPIWq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 15:57:07 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-e30b2af0-ed10-4fe7-8b92-00fb05997a1b tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 15:57:07 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-e30b2af0-ed10-4fe7-8b92-00fb05997a1b tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 15:57:07 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-e30b2af0-ed10-4fe7-8b92-00fb05997a1b tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 15:57:07 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-e30b2af0-ed10-4fe7-8b92-00fb05997a1b tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 15:57:07 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-e30b2af0-ed10-4fe7-8b92-00fb05997a1b tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 15:57:07 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-e30b2af0-ed10-4fe7-8b92-00fb05997a1b tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 15:57:07 user nova-compute[75337]: INFO os_brick.initiator.connectors.iscsi [None req-e30b2af0-ed10-4fe7-8b92-00fb05997a1b tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 15:57:07 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da -p 172.16.0.220:3260 {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:57:07 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:57:07 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[a15bc549-6e8a-466d-a1eb-9362d6ab45da]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:57:07 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e30b2af0-ed10-4fe7-8b92-00fb05997a1b tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 15:57:07 user nova-compute[75337]:  {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:57:07 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da -p 172.16.0.220:3260 --interface default --op new {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:57:07 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:57:07 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a1cec6b-3f1c-442d-877e-8575f3223489]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da] added\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:57:07 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e30b2af0-ed10-4fe7-8b92-00fb05997a1b tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da] added
Nov 06 15:57:07 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:57:07 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:57:07 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.034s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:57:07 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bffb0ce-2dee-4a8c-b03b-d48fe511deeb]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:57:07 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e30b2af0-ed10-4fe7-8b92-00fb05997a1b tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:57:07 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:57:07 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:57:07 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[642ebe7b-266f-4af9-abad-1f53b211933e]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:57:07 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e30b2af0-ed10-4fe7-8b92-00fb05997a1b tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:57:07 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da -p 172.16.0.220:3260 --op update -n node.session.auth.username -v csbVPIWq {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:57:07 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da -p 172.16.0.220:3260 --op update -n node.session.auth.username -v csbVPIWq" returned: 0 in 0.048s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:57:07 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[1657b1cd-b0a6-4156-a476-d83f1406726e]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:57:07 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e30b2af0-ed10-4fe7-8b92-00fb05997a1b tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'csbVPIWq'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:57:07 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:57:07 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:57:07 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c1c17bb-4de4-4bdd-a635-e49053b19b0e]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:57:07 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e30b2af0-ed10-4fe7-8b92-00fb05997a1b tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:57:07 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:57:07 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:57:07 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[802d7d70-d03c-43b1-8032-d2f17ee4e7b1]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326a132a-07d4-4085-8da9-ffa8444121b5 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673 (non-flash)\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:57:07 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e30b2af0-ed10-4fe7-8b92-00fb05997a1b tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326a132a-07d4-4085-8da9-ffa8444121b5 (non-flash)
Nov 06 15:57:07 user nova-compute[75337]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673 (non-flash)
Nov 06 15:57:07 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 15:57:07 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e30b2af0-ed10-4fe7-8b92-00fb05997a1b tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326a132a-07d4-4085-8da9-ffa8444121b5 (non-flash)
Nov 06 15:57:07 user nova-compute[75337]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673 (non-flash)
Nov 06 15:57:07 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 15:57:07 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da -p 172.16.0.220:3260 --login {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:57:08 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:57:08 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[9919e9b2-38cc-45da-817a-e50e84030f98]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:57:08 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e30b2af0-ed10-4fe7-8b92-00fb05997a1b tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da, portal: 172.16.0.220,3260]
Nov 06 15:57:08 user nova-compute[75337]: Login to [iface: default, target: iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da, portal: 172.16.0.220,3260] successful.
Nov 06 15:57:08 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:57:08 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:57:08 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:57:08 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[330bdcbe-110d-48ec-b622-1e7cc5195276]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:57:08 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e30b2af0-ed10-4fe7-8b92-00fb05997a1b tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:57:08 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:57:08 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:57:08 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:57:08 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[09cea2fe-355d-430d-b87f-c2ed8c7e31da]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326a132a-07d4-4085-8da9-ffa8444121b5 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da (non-flash)\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:57:08 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e30b2af0-ed10-4fe7-8b92-00fb05997a1b tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326a132a-07d4-4085-8da9-ffa8444121b5 (non-flash)
Nov 06 15:57:08 user nova-compute[75337]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673 (non-flash)
Nov 06 15:57:08 user nova-compute[75337]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da (non-flash)
Nov 06 15:57:08 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 15:57:08 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e30b2af0-ed10-4fe7-8b92-00fb05997a1b tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326a132a-07d4-4085-8da9-ffa8444121b5 (non-flash)
Nov 06 15:57:08 user nova-compute[75337]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673 (non-flash)
Nov 06 15:57:08 user nova-compute[75337]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da (non-flash)
Nov 06 15:57:08 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 15:57:08 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-e30b2af0-ed10-4fe7-8b92-00fb05997a1b tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.389s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 15:57:08 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e30b2af0-ed10-4fe7-8b92-00fb05997a1b tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Connected to 172.16.0.220:3260 {{(pid=75337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 15:57:08 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-e30b2af0-ed10-4fe7-8b92-00fb05997a1b tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] HCTL ('35', '-', '-', 0) found on session 34 with lun 0 {{(pid=75337) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 15:57:08 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-e30b2af0-ed10-4fe7-8b92-00fb05997a1b tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75337) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 15:57:08 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:57:08 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-fd7c5e48-273f-41b2-8c32-ddb7eb531afc tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 15:57:08 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:57:08 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:57:08 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-fd7c5e48-273f-41b2-8c32-ddb7eb531afc tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 15:57:08 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.028s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:57:08 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a530e9b-506e-4f65-9f85-6d12822ef355]: (4, ('- - 0', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:57:08 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-e30b2af0-ed10-4fe7-8b92-00fb05997a1b tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Searching for a device in session 34 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75337) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 15:57:08 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e30b2af0-ed10-4fe7-8b92-00fb05997a1b tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'csbVPIWq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 15:57:08 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-fd7c5e48-273f-41b2-8c32-ddb7eb531afc tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.509s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:57:08 user nova-compute[75337]: DEBUG nova.compute.manager [None req-fd7c5e48-273f-41b2-8c32-ddb7eb531afc tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] [instance: f196f2b3-8eac-4d68-af2e-46671c865be1] Start building networks asynchronously for instance. {{(pid=75337) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 15:57:08 user nova-compute[75337]: DEBUG nova.compute.manager [None req-fd7c5e48-273f-41b2-8c32-ddb7eb531afc tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] [instance: f196f2b3-8eac-4d68-af2e-46671c865be1] Allocating IP information in the background. {{(pid=75337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 15:57:08 user nova-compute[75337]: DEBUG nova.network.neutron [None req-fd7c5e48-273f-41b2-8c32-ddb7eb531afc tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] [instance: f196f2b3-8eac-4d68-af2e-46671c865be1] allocate_for_instance() {{(pid=75337) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 15:57:08 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-fd7c5e48-273f-41b2-8c32-ddb7eb531afc tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] [instance: f196f2b3-8eac-4d68-af2e-46671c865be1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 15:57:08 user nova-compute[75337]: DEBUG nova.compute.manager [None req-fd7c5e48-273f-41b2-8c32-ddb7eb531afc tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] [instance: f196f2b3-8eac-4d68-af2e-46671c865be1] Start building block device mappings for instance. {{(pid=75337) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 15:57:08 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:57:08 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:57:08 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:57:08 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:57:08 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75337) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 15:57:08 user nova-compute[75337]: DEBUG nova.policy [None req-fd7c5e48-273f-41b2-8c32-ddb7eb531afc tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5b2c5ab3c4244bca99bcc3b143c46ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398008f06ed645099ae8be04ac48a3ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75337) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 15:57:08 user nova-compute[75337]: DEBUG nova.compute.manager [req-088fec04-b55f-41a3-b0d4-a1b98548879d req-ba43a2cb-aee0-4c5e-a488-bcaf0f32d1dc service nova] [instance: 9a3a0bd3-6c4d-434f-9f6b-7d954f7c163b] Received event network-vif-plugged-733c74d6-103a-491b-b443-9b2fe9ceb5f3 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:57:08 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-088fec04-b55f-41a3-b0d4-a1b98548879d req-ba43a2cb-aee0-4c5e-a488-bcaf0f32d1dc service nova] Acquiring lock "9a3a0bd3-6c4d-434f-9f6b-7d954f7c163b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:57:08 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-088fec04-b55f-41a3-b0d4-a1b98548879d req-ba43a2cb-aee0-4c5e-a488-bcaf0f32d1dc service nova] Lock "9a3a0bd3-6c4d-434f-9f6b-7d954f7c163b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:57:08 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-088fec04-b55f-41a3-b0d4-a1b98548879d req-ba43a2cb-aee0-4c5e-a488-bcaf0f32d1dc service nova] Lock "9a3a0bd3-6c4d-434f-9f6b-7d954f7c163b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:57:08 user nova-compute[75337]: DEBUG nova.compute.manager [req-088fec04-b55f-41a3-b0d4-a1b98548879d req-ba43a2cb-aee0-4c5e-a488-bcaf0f32d1dc service nova] [instance: 9a3a0bd3-6c4d-434f-9f6b-7d954f7c163b] No waiting events found dispatching network-vif-plugged-733c74d6-103a-491b-b443-9b2fe9ceb5f3 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:57:08 user nova-compute[75337]: WARNING nova.compute.manager [req-088fec04-b55f-41a3-b0d4-a1b98548879d req-ba43a2cb-aee0-4c5e-a488-bcaf0f32d1dc service nova] [instance: 9a3a0bd3-6c4d-434f-9f6b-7d954f7c163b] Received unexpected event network-vif-plugged-733c74d6-103a-491b-b443-9b2fe9ceb5f3 for instance with vm_state building and task_state spawning.
Nov 06 15:57:08 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:57:08 user nova-compute[75337]: DEBUG nova.compute.manager [None req-fd7c5e48-273f-41b2-8c32-ddb7eb531afc tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] [instance: f196f2b3-8eac-4d68-af2e-46671c865be1] Start spawning the instance on the hypervisor. {{(pid=75337) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 15:57:08 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-fd7c5e48-273f-41b2-8c32-ddb7eb531afc tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] [instance: f196f2b3-8eac-4d68-af2e-46671c865be1] Creating instance directory {{(pid=75337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 15:57:08 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-fd7c5e48-273f-41b2-8c32-ddb7eb531afc tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] [instance: f196f2b3-8eac-4d68-af2e-46671c865be1] Creating image(s)
Nov 06 15:57:08 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-fd7c5e48-273f-41b2-8c32-ddb7eb531afc tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Acquiring lock "/opt/stack/data/nova/instances/f196f2b3-8eac-4d68-af2e-46671c865be1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:57:08 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-fd7c5e48-273f-41b2-8c32-ddb7eb531afc tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Lock "/opt/stack/data/nova/instances/f196f2b3-8eac-4d68-af2e-46671c865be1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:57:08 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-fd7c5e48-273f-41b2-8c32-ddb7eb531afc tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Lock "/opt/stack/data/nova/instances/f196f2b3-8eac-4d68-af2e-46671c865be1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:57:08 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-fd7c5e48-273f-41b2-8c32-ddb7eb531afc tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:57:08 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-fd7c5e48-273f-41b2-8c32-ddb7eb531afc tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json" returned: 0 in 0.218s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:57:08 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-fd7c5e48-273f-41b2-8c32-ddb7eb531afc tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Acquiring lock "06ba3c914798499e686c5ac75886932347225275" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:57:08 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-fd7c5e48-273f-41b2-8c32-ddb7eb531afc tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Lock "06ba3c914798499e686c5ac75886932347225275" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:57:08 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-fd7c5e48-273f-41b2-8c32-ddb7eb531afc tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:57:08 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:57:08 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:57:09 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-fd7c5e48-273f-41b2-8c32-ddb7eb531afc tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json" returned: 0 in 0.217s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:57:09 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-fd7c5e48-273f-41b2-8c32-ddb7eb531afc tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275,backing_fmt=raw /opt/stack/data/nova/instances/f196f2b3-8eac-4d68-af2e-46671c865be1/disk 1073741824 {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:57:09 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-fd7c5e48-273f-41b2-8c32-ddb7eb531afc tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275,backing_fmt=raw /opt/stack/data/nova/instances/f196f2b3-8eac-4d68-af2e-46671c865be1/disk 1073741824" returned: 0 in 0.064s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:57:09 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-fd7c5e48-273f-41b2-8c32-ddb7eb531afc tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Lock "06ba3c914798499e686c5ac75886932347225275" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.289s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:57:09 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-fd7c5e48-273f-41b2-8c32-ddb7eb531afc tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:57:09 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-e30b2af0-ed10-4fe7-8b92-00fb05997a1b tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.480s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 15:57:09 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e30b2af0-ed10-4fe7-8b92-00fb05997a1b tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] <== connect_volume: return (1483ms) {'type': 'block', 'scsi_wwn': '26664623735613735', 'path': '/dev/sdd'} {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 15:57:09 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e30b2af0-ed10-4fe7-8b92-00fb05997a1b tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] [instance: 69df3824-b28c-43c0-9f20-52fa956642cc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26664623735613735', 'path': '/dev/sdd'} {{(pid=75337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 15:57:09 user nova-compute[75337]: DEBUG nova.objects.instance [None req-e30b2af0-ed10-4fe7-8b92-00fb05997a1b tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Lazy-loading 'flavor' on Instance uuid 69df3824-b28c-43c0-9f20-52fa956642cc {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 15:57:09 user nova-compute[75337]: DEBUG nova.virt.libvirt.guest [None req-e30b2af0-ed10-4fe7-8b92-00fb05997a1b tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] attach device xml: <disk type="block" device="disk">
Nov 06 15:57:09 user nova-compute[75337]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 15:57:09 user nova-compute[75337]:   <source dev="/dev/sdd"/>
Nov 06 15:57:09 user nova-compute[75337]:   <target dev="vdb" bus="virtio"/>
Nov 06 15:57:09 user nova-compute[75337]:   <serial>27fe0158-ccd9-4398-ad6f-5622476733da</serial>
Nov 06 15:57:09 user nova-compute[75337]: </disk>
Nov 06 15:57:09 user nova-compute[75337]:  {{(pid=75337) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 06 15:57:09 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-fd7c5e48-273f-41b2-8c32-ddb7eb531afc tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json" returned: 0 in 0.203s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:57:09 user nova-compute[75337]: DEBUG nova.virt.disk.api [None req-fd7c5e48-273f-41b2-8c32-ddb7eb531afc tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f196f2b3-8eac-4d68-af2e-46671c865be1/disk. size=1073741824 {{(pid=75337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 15:57:09 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-fd7c5e48-273f-41b2-8c32-ddb7eb531afc tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f196f2b3-8eac-4d68-af2e-46671c865be1/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:57:09 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:57:09 user nova-compute[75337]: DEBUG nova.compute.manager [req-3446de4e-1a37-48dc-b4ed-4697f090ccde req-e624bc4e-11f8-4f95-9036-87ae1fc83049 service nova] [instance: d10b4a86-8b0d-423f-81e2-87f5f25a2467] Received event network-changed-f9232e10-c7da-42d1-91c6-d72b0a1e0ccb {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:57:09 user nova-compute[75337]: DEBUG nova.compute.manager [req-3446de4e-1a37-48dc-b4ed-4697f090ccde req-e624bc4e-11f8-4f95-9036-87ae1fc83049 service nova] [instance: d10b4a86-8b0d-423f-81e2-87f5f25a2467] Refreshing instance network info cache due to event network-changed-f9232e10-c7da-42d1-91c6-d72b0a1e0ccb. {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 15:57:09 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-3446de4e-1a37-48dc-b4ed-4697f090ccde req-e624bc4e-11f8-4f95-9036-87ae1fc83049 service nova] Acquiring lock "refresh_cache-d10b4a86-8b0d-423f-81e2-87f5f25a2467" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 15:57:09 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-3446de4e-1a37-48dc-b4ed-4697f090ccde req-e624bc4e-11f8-4f95-9036-87ae1fc83049 service nova] Acquired lock "refresh_cache-d10b4a86-8b0d-423f-81e2-87f5f25a2467" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 15:57:09 user nova-compute[75337]: DEBUG nova.network.neutron [req-3446de4e-1a37-48dc-b4ed-4697f090ccde req-e624bc4e-11f8-4f95-9036-87ae1fc83049 service nova] [instance: d10b4a86-8b0d-423f-81e2-87f5f25a2467] Refreshing network info cache for port f9232e10-c7da-42d1-91c6-d72b0a1e0ccb {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 15:57:09 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-fd7c5e48-273f-41b2-8c32-ddb7eb531afc tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f196f2b3-8eac-4d68-af2e-46671c865be1/disk --force-share --output=json" returned: 0 in 0.258s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:57:09 user nova-compute[75337]: DEBUG nova.virt.disk.api [None req-fd7c5e48-273f-41b2-8c32-ddb7eb531afc tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Cannot resize image /opt/stack/data/nova/instances/f196f2b3-8eac-4d68-af2e-46671c865be1/disk to a smaller size. {{(pid=75337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 06 15:57:09 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-fd7c5e48-273f-41b2-8c32-ddb7eb531afc tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] [instance: f196f2b3-8eac-4d68-af2e-46671c865be1] Created local disks {{(pid=75337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 15:57:09 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-fd7c5e48-273f-41b2-8c32-ddb7eb531afc tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] [instance: f196f2b3-8eac-4d68-af2e-46671c865be1] Ensure instance console log exists: /opt/stack/data/nova/instances/f196f2b3-8eac-4d68-af2e-46671c865be1/console.log {{(pid=75337) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 15:57:09 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-fd7c5e48-273f-41b2-8c32-ddb7eb531afc tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:57:09 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-fd7c5e48-273f-41b2-8c32-ddb7eb531afc tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:57:09 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-fd7c5e48-273f-41b2-8c32-ddb7eb531afc tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:57:09 user nova-compute[75337]: DEBUG nova.network.neutron [None req-fd7c5e48-273f-41b2-8c32-ddb7eb531afc tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] [instance: f196f2b3-8eac-4d68-af2e-46671c865be1] Successfully created port: 0aa648d4-16ed-4160-92c7-0bb2ce626454 {{(pid=75337) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 15:57:09 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-e30b2af0-ed10-4fe7-8b92-00fb05997a1b tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] No BDM found with device name vda, not building metadata. {{(pid=75337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 15:57:09 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-e30b2af0-ed10-4fe7-8b92-00fb05997a1b tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 15:57:09 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-e30b2af0-ed10-4fe7-8b92-00fb05997a1b tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] No VIF found with MAC fa:16:3e:7e:b4:bf, not building metadata {{(pid=75337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 15:57:09 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-e30b2af0-ed10-4fe7-8b92-00fb05997a1b tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Lock "69df3824-b28c-43c0-9f20-52fa956642cc" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 25.829s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:57:10 user nova-compute[75337]: DEBUG nova.network.neutron [req-3446de4e-1a37-48dc-b4ed-4697f090ccde req-e624bc4e-11f8-4f95-9036-87ae1fc83049 service nova] [instance: d10b4a86-8b0d-423f-81e2-87f5f25a2467] Updated VIF entry in instance network info cache for port f9232e10-c7da-42d1-91c6-d72b0a1e0ccb. {{(pid=75337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 15:57:10 user nova-compute[75337]: DEBUG nova.network.neutron [req-3446de4e-1a37-48dc-b4ed-4697f090ccde req-e624bc4e-11f8-4f95-9036-87ae1fc83049 service nova] [instance: d10b4a86-8b0d-423f-81e2-87f5f25a2467] Updating instance_info_cache with network_info: [{"id": "f9232e10-c7da-42d1-91c6-d72b0a1e0ccb", "address": "fa:16:3e:93:ab:63", "network": {"id": "c31b513a-57f0-4bd5-b055-4a363aae9793", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1352256985-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cddccc86bf54fe981667da5ef13fa8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9232e10-c7", "ovs_interfaceid": "f9232e10-c7da-42d1-91c6-d72b0a1e0ccb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:57:10 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-3446de4e-1a37-48dc-b4ed-4697f090ccde req-e624bc4e-11f8-4f95-9036-87ae1fc83049 service nova] Releasing lock "refresh_cache-d10b4a86-8b0d-423f-81e2-87f5f25a2467" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 15:57:10 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:57:10 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:57:10 user nova-compute[75337]: DEBUG nova.compute.manager [req-162be064-0493-4aa5-975e-1ba815bea3ea req-d49d6502-921d-4cc4-a383-373bb1df3e21 service nova] [instance: 9a3a0bd3-6c4d-434f-9f6b-7d954f7c163b] Received event network-vif-plugged-733c74d6-103a-491b-b443-9b2fe9ceb5f3 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:57:10 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-162be064-0493-4aa5-975e-1ba815bea3ea req-d49d6502-921d-4cc4-a383-373bb1df3e21 service nova] Acquiring lock "9a3a0bd3-6c4d-434f-9f6b-7d954f7c163b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:57:10 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-162be064-0493-4aa5-975e-1ba815bea3ea req-d49d6502-921d-4cc4-a383-373bb1df3e21 service nova] Lock "9a3a0bd3-6c4d-434f-9f6b-7d954f7c163b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:57:10 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-162be064-0493-4aa5-975e-1ba815bea3ea req-d49d6502-921d-4cc4-a383-373bb1df3e21 service nova] Lock "9a3a0bd3-6c4d-434f-9f6b-7d954f7c163b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:57:10 user nova-compute[75337]: DEBUG nova.compute.manager [req-162be064-0493-4aa5-975e-1ba815bea3ea req-d49d6502-921d-4cc4-a383-373bb1df3e21 service nova] [instance: 9a3a0bd3-6c4d-434f-9f6b-7d954f7c163b] No waiting events found dispatching network-vif-plugged-733c74d6-103a-491b-b443-9b2fe9ceb5f3 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:57:10 user nova-compute[75337]: WARNING nova.compute.manager [req-162be064-0493-4aa5-975e-1ba815bea3ea req-d49d6502-921d-4cc4-a383-373bb1df3e21 service nova] [instance: 9a3a0bd3-6c4d-434f-9f6b-7d954f7c163b] Received unexpected event network-vif-plugged-733c74d6-103a-491b-b443-9b2fe9ceb5f3 for instance with vm_state building and task_state spawning.
Nov 06 15:57:10 user nova-compute[75337]: DEBUG nova.network.neutron [None req-fd7c5e48-273f-41b2-8c32-ddb7eb531afc tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] [instance: f196f2b3-8eac-4d68-af2e-46671c865be1] Successfully updated port: 0aa648d4-16ed-4160-92c7-0bb2ce626454 {{(pid=75337) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 15:57:10 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-fd7c5e48-273f-41b2-8c32-ddb7eb531afc tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Acquiring lock "refresh_cache-f196f2b3-8eac-4d68-af2e-46671c865be1" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 15:57:10 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-fd7c5e48-273f-41b2-8c32-ddb7eb531afc tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Acquired lock "refresh_cache-f196f2b3-8eac-4d68-af2e-46671c865be1" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 15:57:10 user nova-compute[75337]: DEBUG nova.network.neutron [None req-fd7c5e48-273f-41b2-8c32-ddb7eb531afc tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] [instance: f196f2b3-8eac-4d68-af2e-46671c865be1] Building network info cache for instance {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 15:57:10 user nova-compute[75337]: DEBUG nova.network.neutron [None req-fd7c5e48-273f-41b2-8c32-ddb7eb531afc tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] [instance: f196f2b3-8eac-4d68-af2e-46671c865be1] Instance cache missing network info. {{(pid=75337) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 15:57:10 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-d2993056-549c-4d17-a1d3-56182e23c114 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Acquiring lock "69df3824-b28c-43c0-9f20-52fa956642cc" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:57:10 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-d2993056-549c-4d17-a1d3-56182e23c114 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Lock "69df3824-b28c-43c0-9f20-52fa956642cc" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:57:10 user nova-compute[75337]: DEBUG nova.compute.manager [None req-d2993056-549c-4d17-a1d3-56182e23c114 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] [instance: 69df3824-b28c-43c0-9f20-52fa956642cc] Checking state {{(pid=75337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 15:57:10 user nova-compute[75337]: DEBUG nova.compute.manager [None req-d2993056-549c-4d17-a1d3-56182e23c114 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] [instance: 69df3824-b28c-43c0-9f20-52fa956642cc] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=75337) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 06 15:57:10 user nova-compute[75337]: DEBUG nova.objects.instance [None req-d2993056-549c-4d17-a1d3-56182e23c114 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Lazy-loading 'flavor' on Instance uuid 69df3824-b28c-43c0-9f20-52fa956642cc {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 15:57:10 user nova-compute[75337]: DEBUG nova.compute.manager [None req-315c64b4-0ba5-41ce-9d40-99d2cdfc2b9e tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 9a3a0bd3-6c4d-434f-9f6b-7d954f7c163b] Instance event wait completed in 0 seconds for  {{(pid=75337) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 15:57:10 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-315c64b4-0ba5-41ce-9d40-99d2cdfc2b9e tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 9a3a0bd3-6c4d-434f-9f6b-7d954f7c163b] Guest created on hypervisor {{(pid=75337) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 15:57:10 user nova-compute[75337]: INFO nova.virt.libvirt.driver [-] [instance: 9a3a0bd3-6c4d-434f-9f6b-7d954f7c163b] Instance spawned successfully.
Nov 06 15:57:10 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-315c64b4-0ba5-41ce-9d40-99d2cdfc2b9e tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 9a3a0bd3-6c4d-434f-9f6b-7d954f7c163b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 15:57:10 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-315c64b4-0ba5-41ce-9d40-99d2cdfc2b9e tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 9a3a0bd3-6c4d-434f-9f6b-7d954f7c163b] Found default for hw_cdrom_bus of ide {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:57:10 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-315c64b4-0ba5-41ce-9d40-99d2cdfc2b9e tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 9a3a0bd3-6c4d-434f-9f6b-7d954f7c163b] Found default for hw_disk_bus of virtio {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:57:10 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-315c64b4-0ba5-41ce-9d40-99d2cdfc2b9e tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 9a3a0bd3-6c4d-434f-9f6b-7d954f7c163b] Found default for hw_input_bus of None {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:57:10 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-315c64b4-0ba5-41ce-9d40-99d2cdfc2b9e tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 9a3a0bd3-6c4d-434f-9f6b-7d954f7c163b] Found default for hw_pointer_model of None {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:57:10 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-315c64b4-0ba5-41ce-9d40-99d2cdfc2b9e tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 9a3a0bd3-6c4d-434f-9f6b-7d954f7c163b] Found default for hw_video_model of virtio {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:57:10 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-315c64b4-0ba5-41ce-9d40-99d2cdfc2b9e tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 9a3a0bd3-6c4d-434f-9f6b-7d954f7c163b] Found default for hw_vif_model of virtio {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:57:10 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:57:11 user nova-compute[75337]: INFO nova.compute.manager [None req-315c64b4-0ba5-41ce-9d40-99d2cdfc2b9e tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 9a3a0bd3-6c4d-434f-9f6b-7d954f7c163b] Took 6.58 seconds to spawn the instance on the hypervisor.
Nov 06 15:57:11 user nova-compute[75337]: DEBUG nova.compute.manager [None req-315c64b4-0ba5-41ce-9d40-99d2cdfc2b9e tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 9a3a0bd3-6c4d-434f-9f6b-7d954f7c163b] Checking state {{(pid=75337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 15:57:11 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:57:11 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:57:11 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:57:11 user nova-compute[75337]: DEBUG nova.network.neutron [None req-fd7c5e48-273f-41b2-8c32-ddb7eb531afc tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] [instance: f196f2b3-8eac-4d68-af2e-46671c865be1] Updating instance_info_cache with network_info: [{"id": "0aa648d4-16ed-4160-92c7-0bb2ce626454", "address": "fa:16:3e:1e:b2:da", "network": {"id": "8618d6aa-9df1-421d-916b-422978dc518d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1705024451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "398008f06ed645099ae8be04ac48a3ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0aa648d4-16", "ovs_interfaceid": "0aa648d4-16ed-4160-92c7-0bb2ce626454", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:57:11 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-fd7c5e48-273f-41b2-8c32-ddb7eb531afc tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Releasing lock "refresh_cache-f196f2b3-8eac-4d68-af2e-46671c865be1" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 15:57:11 user nova-compute[75337]: DEBUG nova.compute.manager [None req-fd7c5e48-273f-41b2-8c32-ddb7eb531afc tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] [instance: f196f2b3-8eac-4d68-af2e-46671c865be1] Instance network_info: |[{"id": "0aa648d4-16ed-4160-92c7-0bb2ce626454", "address": "fa:16:3e:1e:b2:da", "network": {"id": "8618d6aa-9df1-421d-916b-422978dc518d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1705024451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "398008f06ed645099ae8be04ac48a3ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0aa648d4-16", "ovs_interfaceid": "0aa648d4-16ed-4160-92c7-0bb2ce626454", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 15:57:11 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-fd7c5e48-273f-41b2-8c32-ddb7eb531afc tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] [instance: f196f2b3-8eac-4d68-af2e-46671c865be1] Start _get_guest_xml network_info=[{"id": "0aa648d4-16ed-4160-92c7-0bb2ce626454", "address": "fa:16:3e:1e:b2:da", "network": {"id": "8618d6aa-9df1-421d-916b-422978dc518d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1705024451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "398008f06ed645099ae8be04ac48a3ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0aa648d4-16", "ovs_interfaceid": "0aa648d4-16ed-4160-92c7-0bb2ce626454", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T15:34:14Z,direct_url=<?>,disk_format='qcow2',id=16b903ae-a40f-41a7-985b-4804cce92c62,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6549a15819f1469bbd5eeae8190e3d44',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T15:34:15Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'guest_format': None, 'size': 0, 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '16b903ae-a40f-41a7-985b-4804cce92c62'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 15:57:11 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-fd7c5e48-273f-41b2-8c32-ddb7eb531afc tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 15:57:11 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-fd7c5e48-273f-41b2-8c32-ddb7eb531afc tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 15:57:11 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-fd7c5e48-273f-41b2-8c32-ddb7eb531afc tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 15:57:11 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-fd7c5e48-273f-41b2-8c32-ddb7eb531afc tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] CPU controller missing on host. {{(pid=75337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 15:57:11 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-fd7c5e48-273f-41b2-8c32-ddb7eb531afc tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 15:57:11 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-fd7c5e48-273f-41b2-8c32-ddb7eb531afc tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] CPU controller found on host. {{(pid=75337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 15:57:11 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-fd7c5e48-273f-41b2-8c32-ddb7eb531afc tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75337) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 15:57:11 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-fd7c5e48-273f-41b2-8c32-ddb7eb531afc tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T15:34:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T15:34:14Z,direct_url=<?>,disk_format='qcow2',id=16b903ae-a40f-41a7-985b-4804cce92c62,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6549a15819f1469bbd5eeae8190e3d44',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T15:34:15Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 15:57:11 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-fd7c5e48-273f-41b2-8c32-ddb7eb531afc tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Flavor limits 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 15:57:11 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-fd7c5e48-273f-41b2-8c32-ddb7eb531afc tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Image limits 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 15:57:11 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-fd7c5e48-273f-41b2-8c32-ddb7eb531afc tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Flavor pref 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 15:57:11 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-fd7c5e48-273f-41b2-8c32-ddb7eb531afc tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Image pref 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 15:57:11 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-fd7c5e48-273f-41b2-8c32-ddb7eb531afc tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 15:57:11 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-fd7c5e48-273f-41b2-8c32-ddb7eb531afc tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 15:57:11 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-fd7c5e48-273f-41b2-8c32-ddb7eb531afc tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 15:57:11 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-fd7c5e48-273f-41b2-8c32-ddb7eb531afc tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Got 1 possible topologies {{(pid=75337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 15:57:11 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-fd7c5e48-273f-41b2-8c32-ddb7eb531afc tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 15:57:11 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-fd7c5e48-273f-41b2-8c32-ddb7eb531afc tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 15:57:11 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-fd7c5e48-273f-41b2-8c32-ddb7eb531afc tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T15:57:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1424416',display_name='tempest-VolumesSnapshotTestJSON-instance-1424416',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1424416',id=35,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNs/bKUuaudNIY9n8MJmnIC/KLIWs1U+/1QVYjVM9mXhudgvjiXPDvV1kmsmSeJB4lA3r2g+eBldHD31du2jUzWxhDoG+m1rUsQi8HQagp1Rk3ljVx9pIUh8qF1yIcv+OQ==',key_name='tempest-keypair-1070010014',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='398008f06ed645099ae8be04ac48a3ff',ramdisk_id='',reservation_id='r-fuey3ydl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-208809405',owner_user_name='tempest-VolumesSnapshotTestJSON-208809405-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T15:57:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5b2c5ab3c4244bca99bcc3b143c46ecd',uuid=f196f2b3-8eac-4d68-af2e-46671c865be1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0aa648d4-16ed-4160-92c7-0bb2ce626454", "address": "fa:16:3e:1e:b2:da", "network": {"id": "8618d6aa-9df1-421d-916b-422978dc518d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1705024451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "398008f06ed645099ae8be04ac48a3ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0aa648d4-16", "ovs_interfaceid": "0aa648d4-16ed-4160-92c7-0bb2ce626454", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75337) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 15:57:11 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-fd7c5e48-273f-41b2-8c32-ddb7eb531afc tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Converting VIF {"id": "0aa648d4-16ed-4160-92c7-0bb2ce626454", "address": "fa:16:3e:1e:b2:da", "network": {"id": "8618d6aa-9df1-421d-916b-422978dc518d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1705024451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "398008f06ed645099ae8be04ac48a3ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0aa648d4-16", "ovs_interfaceid": "0aa648d4-16ed-4160-92c7-0bb2ce626454", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 15:57:11 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-fd7c5e48-273f-41b2-8c32-ddb7eb531afc tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:b2:da,bridge_name='br-int',has_traffic_filtering=True,id=0aa648d4-16ed-4160-92c7-0bb2ce626454,network=Network(8618d6aa-9df1-421d-916b-422978dc518d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0aa648d4-16') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 15:57:11 user nova-compute[75337]: DEBUG nova.objects.instance [None req-fd7c5e48-273f-41b2-8c32-ddb7eb531afc tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Lazy-loading 'pci_devices' on Instance uuid f196f2b3-8eac-4d68-af2e-46671c865be1 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 15:57:11 user nova-compute[75337]: INFO nova.compute.manager [None req-315c64b4-0ba5-41ce-9d40-99d2cdfc2b9e tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 9a3a0bd3-6c4d-434f-9f6b-7d954f7c163b] Took 70.04 seconds to build instance.
Nov 06 15:57:11 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-fd7c5e48-273f-41b2-8c32-ddb7eb531afc tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] [instance: f196f2b3-8eac-4d68-af2e-46671c865be1] End _get_guest_xml xml=<domain type="kvm">
Nov 06 15:57:11 user nova-compute[75337]:   <uuid>f196f2b3-8eac-4d68-af2e-46671c865be1</uuid>
Nov 06 15:57:11 user nova-compute[75337]:   <name>instance-00000023</name>
Nov 06 15:57:11 user nova-compute[75337]:   <memory>524288</memory>
Nov 06 15:57:11 user nova-compute[75337]:   <vcpu>1</vcpu>
Nov 06 15:57:11 user nova-compute[75337]:   <metadata>
Nov 06 15:57:11 user nova-compute[75337]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 15:57:11 user nova-compute[75337]:       <nova:package version="0.0.0"/>
Nov 06 15:57:11 user nova-compute[75337]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1424416</nova:name>
Nov 06 15:57:11 user nova-compute[75337]:       <nova:creationTime>2023-11-06 15:57:11</nova:creationTime>
Nov 06 15:57:11 user nova-compute[75337]:       <nova:flavor name="m1.tiny">
Nov 06 15:57:11 user nova-compute[75337]:         <nova:memory>512</nova:memory>
Nov 06 15:57:11 user nova-compute[75337]:         <nova:disk>1</nova:disk>
Nov 06 15:57:11 user nova-compute[75337]:         <nova:swap>0</nova:swap>
Nov 06 15:57:11 user nova-compute[75337]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 15:57:11 user nova-compute[75337]:         <nova:vcpus>1</nova:vcpus>
Nov 06 15:57:11 user nova-compute[75337]:       </nova:flavor>
Nov 06 15:57:11 user nova-compute[75337]:       <nova:owner>
Nov 06 15:57:11 user nova-compute[75337]:         <nova:user uuid="5b2c5ab3c4244bca99bcc3b143c46ecd">tempest-VolumesSnapshotTestJSON-208809405-project-member</nova:user>
Nov 06 15:57:11 user nova-compute[75337]:         <nova:project uuid="398008f06ed645099ae8be04ac48a3ff">tempest-VolumesSnapshotTestJSON-208809405</nova:project>
Nov 06 15:57:11 user nova-compute[75337]:       </nova:owner>
Nov 06 15:57:11 user nova-compute[75337]:       <nova:root type="image" uuid="16b903ae-a40f-41a7-985b-4804cce92c62"/>
Nov 06 15:57:11 user nova-compute[75337]:       <nova:ports>
Nov 06 15:57:11 user nova-compute[75337]:         <nova:port uuid="0aa648d4-16ed-4160-92c7-0bb2ce626454">
Nov 06 15:57:11 user nova-compute[75337]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 06 15:57:11 user nova-compute[75337]:         </nova:port>
Nov 06 15:57:11 user nova-compute[75337]:       </nova:ports>
Nov 06 15:57:11 user nova-compute[75337]:     </nova:instance>
Nov 06 15:57:11 user nova-compute[75337]:   </metadata>
Nov 06 15:57:11 user nova-compute[75337]:   <sysinfo type="smbios">
Nov 06 15:57:11 user nova-compute[75337]:     <system>
Nov 06 15:57:11 user nova-compute[75337]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 15:57:11 user nova-compute[75337]:       <entry name="product">OpenStack Nova</entry>
Nov 06 15:57:11 user nova-compute[75337]:       <entry name="version">0.0.0</entry>
Nov 06 15:57:11 user nova-compute[75337]:       <entry name="serial">f196f2b3-8eac-4d68-af2e-46671c865be1</entry>
Nov 06 15:57:11 user nova-compute[75337]:       <entry name="uuid">f196f2b3-8eac-4d68-af2e-46671c865be1</entry>
Nov 06 15:57:11 user nova-compute[75337]:       <entry name="family">Virtual Machine</entry>
Nov 06 15:57:11 user nova-compute[75337]:     </system>
Nov 06 15:57:11 user nova-compute[75337]:   </sysinfo>
Nov 06 15:57:11 user nova-compute[75337]:   <os>
Nov 06 15:57:11 user nova-compute[75337]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 15:57:11 user nova-compute[75337]:     <boot dev="hd"/>
Nov 06 15:57:11 user nova-compute[75337]:     <smbios mode="sysinfo"/>
Nov 06 15:57:11 user nova-compute[75337]:   </os>
Nov 06 15:57:11 user nova-compute[75337]:   <features>
Nov 06 15:57:11 user nova-compute[75337]:     <acpi/>
Nov 06 15:57:11 user nova-compute[75337]:     <apic/>
Nov 06 15:57:11 user nova-compute[75337]:     <vmcoreinfo/>
Nov 06 15:57:11 user nova-compute[75337]:   </features>
Nov 06 15:57:11 user nova-compute[75337]:   <clock offset="utc">
Nov 06 15:57:11 user nova-compute[75337]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 15:57:11 user nova-compute[75337]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 15:57:11 user nova-compute[75337]:     <timer name="hpet" present="no"/>
Nov 06 15:57:11 user nova-compute[75337]:   </clock>
Nov 06 15:57:11 user nova-compute[75337]:   <cpu mode="custom" match="exact">
Nov 06 15:57:11 user nova-compute[75337]:     <model>Nehalem</model>
Nov 06 15:57:11 user nova-compute[75337]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 15:57:11 user nova-compute[75337]:   </cpu>
Nov 06 15:57:11 user nova-compute[75337]:   <devices>
Nov 06 15:57:11 user nova-compute[75337]:     <disk type="file" device="disk">
Nov 06 15:57:11 user nova-compute[75337]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 15:57:11 user nova-compute[75337]:       <source file="/opt/stack/data/nova/instances/f196f2b3-8eac-4d68-af2e-46671c865be1/disk"/>
Nov 06 15:57:11 user nova-compute[75337]:       <target dev="vda" bus="virtio"/>
Nov 06 15:57:11 user nova-compute[75337]:     </disk>
Nov 06 15:57:11 user nova-compute[75337]:     <interface type="ethernet">
Nov 06 15:57:11 user nova-compute[75337]:       <mac address="fa:16:3e:1e:b2:da"/>
Nov 06 15:57:11 user nova-compute[75337]:       <model type="virtio"/>
Nov 06 15:57:11 user nova-compute[75337]:       <mtu size="1442"/>
Nov 06 15:57:11 user nova-compute[75337]:       <target dev="tap0aa648d4-16"/>
Nov 06 15:57:11 user nova-compute[75337]:     </interface>
Nov 06 15:57:11 user nova-compute[75337]:     <serial type="pty">
Nov 06 15:57:11 user nova-compute[75337]:       <log file="/opt/stack/data/nova/instances/f196f2b3-8eac-4d68-af2e-46671c865be1/console.log" append="off"/>
Nov 06 15:57:11 user nova-compute[75337]:     </serial>
Nov 06 15:57:11 user nova-compute[75337]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 15:57:11 user nova-compute[75337]:     <video>
Nov 06 15:57:11 user nova-compute[75337]:       <model type="virtio"/>
Nov 06 15:57:11 user nova-compute[75337]:     </video>
Nov 06 15:57:11 user nova-compute[75337]:     <rng model="virtio">
Nov 06 15:57:11 user nova-compute[75337]:       <backend model="random">/dev/urandom</backend>
Nov 06 15:57:11 user nova-compute[75337]:     </rng>
Nov 06 15:57:11 user nova-compute[75337]:     <controller type="usb" index="0" model="none"/>
Nov 06 15:57:11 user nova-compute[75337]:     <memballoon model="virtio">
Nov 06 15:57:11 user nova-compute[75337]:       <stats period="10"/>
Nov 06 15:57:11 user nova-compute[75337]:     </memballoon>
Nov 06 15:57:11 user nova-compute[75337]:   </devices>
Nov 06 15:57:11 user nova-compute[75337]: </domain>
Nov 06 15:57:11 user nova-compute[75337]:  {{(pid=75337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 15:57:11 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-fd7c5e48-273f-41b2-8c32-ddb7eb531afc tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T15:57:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1424416',display_name='tempest-VolumesSnapshotTestJSON-instance-1424416',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1424416',id=35,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNs/bKUuaudNIY9n8MJmnIC/KLIWs1U+/1QVYjVM9mXhudgvjiXPDvV1kmsmSeJB4lA3r2g+eBldHD31du2jUzWxhDoG+m1rUsQi8HQagp1Rk3ljVx9pIUh8qF1yIcv+OQ==',key_name='tempest-keypair-1070010014',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='398008f06ed645099ae8be04ac48a3ff',ramdisk_id='',reservation_id='r-fuey3ydl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-208809405',owner_user_name='tempest-VolumesSnapshotTestJSON-208809405-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T15:57:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5b2c5ab3c4244bca99bcc3b143c46ecd',uuid=f196f2b3-8eac-4d68-af2e-46671c865be1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0aa648d4-16ed-4160-92c7-0bb2ce626454", "address": "fa:16:3e:1e:b2:da", "network": {"id": "8618d6aa-9df1-421d-916b-422978dc518d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1705024451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "398008f06ed645099ae8be04ac48a3ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0aa648d4-16", "ovs_interfaceid": "0aa648d4-16ed-4160-92c7-0bb2ce626454", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 15:57:11 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-fd7c5e48-273f-41b2-8c32-ddb7eb531afc tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Converting VIF {"id": "0aa648d4-16ed-4160-92c7-0bb2ce626454", "address": "fa:16:3e:1e:b2:da", "network": {"id": "8618d6aa-9df1-421d-916b-422978dc518d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1705024451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "398008f06ed645099ae8be04ac48a3ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0aa648d4-16", "ovs_interfaceid": "0aa648d4-16ed-4160-92c7-0bb2ce626454", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 15:57:11 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-fd7c5e48-273f-41b2-8c32-ddb7eb531afc tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:b2:da,bridge_name='br-int',has_traffic_filtering=True,id=0aa648d4-16ed-4160-92c7-0bb2ce626454,network=Network(8618d6aa-9df1-421d-916b-422978dc518d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0aa648d4-16') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 15:57:11 user nova-compute[75337]: DEBUG os_vif [None req-fd7c5e48-273f-41b2-8c32-ddb7eb531afc tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:b2:da,bridge_name='br-int',has_traffic_filtering=True,id=0aa648d4-16ed-4160-92c7-0bb2ce626454,network=Network(8618d6aa-9df1-421d-916b-422978dc518d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0aa648d4-16') {{(pid=75337) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 15:57:11 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:57:11 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:57:11 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 15:57:11 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:57:11 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c2744250-2314-5c17-9cc6-79159db72d27', '_type': 'linux-noop'}}, row=False) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:57:11 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:57:11 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:57:11 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:57:11 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:57:11 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0aa648d4-16, may_exist=True, interface_attrs={}) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:57:11 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0aa648d4-16, col_values=(('qos', UUID('72d5f13a-d370-47df-b70c-8426116c7fb6')),), if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:57:11 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0aa648d4-16, col_values=(('external_ids', {'iface-id': '0aa648d4-16ed-4160-92c7-0bb2ce626454', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1e:b2:da', 'vm-uuid': 'f196f2b3-8eac-4d68-af2e-46671c865be1'}),), if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:57:11 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-315c64b4-0ba5-41ce-9d40-99d2cdfc2b9e tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Lock "9a3a0bd3-6c4d-434f-9f6b-7d954f7c163b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 70.166s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:57:11 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:57:11 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:57:11 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:57:11 user nova-compute[75337]: INFO os_vif [None req-fd7c5e48-273f-41b2-8c32-ddb7eb531afc tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:b2:da,bridge_name='br-int',has_traffic_filtering=True,id=0aa648d4-16ed-4160-92c7-0bb2ce626454,network=Network(8618d6aa-9df1-421d-916b-422978dc518d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0aa648d4-16')
Nov 06 15:57:11 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-fd7c5e48-273f-41b2-8c32-ddb7eb531afc tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] No BDM found with device name vda, not building metadata. {{(pid=75337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 15:57:11 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-fd7c5e48-273f-41b2-8c32-ddb7eb531afc tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] No VIF found with MAC fa:16:3e:1e:b2:da, not building metadata {{(pid=75337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 15:57:11 user nova-compute[75337]: DEBUG nova.compute.manager [req-e29b50a0-d20a-4a37-bd2d-5ca942d11149 req-267baa1f-8dcd-4d86-9fc4-49982e0554d0 service nova] [instance: f196f2b3-8eac-4d68-af2e-46671c865be1] Received event network-changed-0aa648d4-16ed-4160-92c7-0bb2ce626454 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:57:11 user nova-compute[75337]: DEBUG nova.compute.manager [req-e29b50a0-d20a-4a37-bd2d-5ca942d11149 req-267baa1f-8dcd-4d86-9fc4-49982e0554d0 service nova] [instance: f196f2b3-8eac-4d68-af2e-46671c865be1] Refreshing instance network info cache due to event network-changed-0aa648d4-16ed-4160-92c7-0bb2ce626454. {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 15:57:11 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-e29b50a0-d20a-4a37-bd2d-5ca942d11149 req-267baa1f-8dcd-4d86-9fc4-49982e0554d0 service nova] Acquiring lock "refresh_cache-f196f2b3-8eac-4d68-af2e-46671c865be1" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 15:57:11 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-e29b50a0-d20a-4a37-bd2d-5ca942d11149 req-267baa1f-8dcd-4d86-9fc4-49982e0554d0 service nova] Acquired lock "refresh_cache-f196f2b3-8eac-4d68-af2e-46671c865be1" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 15:57:11 user nova-compute[75337]: DEBUG nova.network.neutron [req-e29b50a0-d20a-4a37-bd2d-5ca942d11149 req-267baa1f-8dcd-4d86-9fc4-49982e0554d0 service nova] [instance: f196f2b3-8eac-4d68-af2e-46671c865be1] Refreshing network info cache for port 0aa648d4-16ed-4160-92c7-0bb2ce626454 {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 15:57:12 user nova-compute[75337]: INFO nova.virt.libvirt.driver [-] [instance: 69df3824-b28c-43c0-9f20-52fa956642cc] Instance destroyed successfully.
Nov 06 15:57:12 user nova-compute[75337]: DEBUG nova.compute.manager [None req-d2993056-549c-4d17-a1d3-56182e23c114 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] [instance: 69df3824-b28c-43c0-9f20-52fa956642cc] Checking state {{(pid=75337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 15:57:12 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-d2993056-549c-4d17-a1d3-56182e23c114 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Lock "69df3824-b28c-43c0-9f20-52fa956642cc" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 1.313s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:57:12 user nova-compute[75337]: DEBUG nova.network.neutron [req-e29b50a0-d20a-4a37-bd2d-5ca942d11149 req-267baa1f-8dcd-4d86-9fc4-49982e0554d0 service nova] [instance: f196f2b3-8eac-4d68-af2e-46671c865be1] Updated VIF entry in instance network info cache for port 0aa648d4-16ed-4160-92c7-0bb2ce626454. {{(pid=75337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 15:57:12 user nova-compute[75337]: DEBUG nova.network.neutron [req-e29b50a0-d20a-4a37-bd2d-5ca942d11149 req-267baa1f-8dcd-4d86-9fc4-49982e0554d0 service nova] [instance: f196f2b3-8eac-4d68-af2e-46671c865be1] Updating instance_info_cache with network_info: [{"id": "0aa648d4-16ed-4160-92c7-0bb2ce626454", "address": "fa:16:3e:1e:b2:da", "network": {"id": "8618d6aa-9df1-421d-916b-422978dc518d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1705024451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "398008f06ed645099ae8be04ac48a3ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0aa648d4-16", "ovs_interfaceid": "0aa648d4-16ed-4160-92c7-0bb2ce626454", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:57:12 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-e29b50a0-d20a-4a37-bd2d-5ca942d11149 req-267baa1f-8dcd-4d86-9fc4-49982e0554d0 service nova] Releasing lock "refresh_cache-f196f2b3-8eac-4d68-af2e-46671c865be1" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 15:57:12 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:57:12 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Starting heal instance info cache {{(pid=75337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 15:57:12 user nova-compute[75337]: DEBUG nova.compute.manager [req-db4b3687-1540-45ba-a05e-14f873858ec0 req-ae9da240-baf6-47e1-98f1-63334910fd97 service nova] [instance: 69df3824-b28c-43c0-9f20-52fa956642cc] Received event network-vif-unplugged-c3d051e2-c3b7-4ee0-aab0-dcf3c0d1d578 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:57:12 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-db4b3687-1540-45ba-a05e-14f873858ec0 req-ae9da240-baf6-47e1-98f1-63334910fd97 service nova] Acquiring lock "69df3824-b28c-43c0-9f20-52fa956642cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:57:12 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-db4b3687-1540-45ba-a05e-14f873858ec0 req-ae9da240-baf6-47e1-98f1-63334910fd97 service nova] Lock "69df3824-b28c-43c0-9f20-52fa956642cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:57:12 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-db4b3687-1540-45ba-a05e-14f873858ec0 req-ae9da240-baf6-47e1-98f1-63334910fd97 service nova] Lock "69df3824-b28c-43c0-9f20-52fa956642cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:57:12 user nova-compute[75337]: DEBUG nova.compute.manager [req-db4b3687-1540-45ba-a05e-14f873858ec0 req-ae9da240-baf6-47e1-98f1-63334910fd97 service nova] [instance: 69df3824-b28c-43c0-9f20-52fa956642cc] No waiting events found dispatching network-vif-unplugged-c3d051e2-c3b7-4ee0-aab0-dcf3c0d1d578 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:57:12 user nova-compute[75337]: WARNING nova.compute.manager [req-db4b3687-1540-45ba-a05e-14f873858ec0 req-ae9da240-baf6-47e1-98f1-63334910fd97 service nova] [instance: 69df3824-b28c-43c0-9f20-52fa956642cc] Received unexpected event network-vif-unplugged-c3d051e2-c3b7-4ee0-aab0-dcf3c0d1d578 for instance with vm_state stopped and task_state None.
Nov 06 15:57:12 user nova-compute[75337]: DEBUG nova.compute.manager [req-db4b3687-1540-45ba-a05e-14f873858ec0 req-ae9da240-baf6-47e1-98f1-63334910fd97 service nova] [instance: 69df3824-b28c-43c0-9f20-52fa956642cc] Received event network-vif-plugged-c3d051e2-c3b7-4ee0-aab0-dcf3c0d1d578 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:57:12 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-db4b3687-1540-45ba-a05e-14f873858ec0 req-ae9da240-baf6-47e1-98f1-63334910fd97 service nova] Acquiring lock "69df3824-b28c-43c0-9f20-52fa956642cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:57:12 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-db4b3687-1540-45ba-a05e-14f873858ec0 req-ae9da240-baf6-47e1-98f1-63334910fd97 service nova] Lock "69df3824-b28c-43c0-9f20-52fa956642cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:57:12 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-db4b3687-1540-45ba-a05e-14f873858ec0 req-ae9da240-baf6-47e1-98f1-63334910fd97 service nova] Lock "69df3824-b28c-43c0-9f20-52fa956642cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:57:12 user nova-compute[75337]: DEBUG nova.compute.manager [req-db4b3687-1540-45ba-a05e-14f873858ec0 req-ae9da240-baf6-47e1-98f1-63334910fd97 service nova] [instance: 69df3824-b28c-43c0-9f20-52fa956642cc] No waiting events found dispatching network-vif-plugged-c3d051e2-c3b7-4ee0-aab0-dcf3c0d1d578 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:57:12 user nova-compute[75337]: WARNING nova.compute.manager [req-db4b3687-1540-45ba-a05e-14f873858ec0 req-ae9da240-baf6-47e1-98f1-63334910fd97 service nova] [instance: 69df3824-b28c-43c0-9f20-52fa956642cc] Received unexpected event network-vif-plugged-c3d051e2-c3b7-4ee0-aab0-dcf3c0d1d578 for instance with vm_state stopped and task_state None.
Nov 06 15:57:12 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "refresh_cache-6110b34a-6fd3-45fc-911d-4e5d3c7f2d78" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 15:57:12 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquired lock "refresh_cache-6110b34a-6fd3-45fc-911d-4e5d3c7f2d78" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 15:57:12 user nova-compute[75337]: DEBUG nova.network.neutron [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] [instance: 6110b34a-6fd3-45fc-911d-4e5d3c7f2d78] Forcefully refreshing network info cache for instance {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 15:57:13 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:57:13 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:57:13 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:57:13 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:57:13 user nova-compute[75337]: DEBUG nova.network.neutron [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] [instance: 6110b34a-6fd3-45fc-911d-4e5d3c7f2d78] Updating instance_info_cache with network_info: [{"id": "fa3c6657-452e-4a95-b9c8-c59002be4e31", "address": "fa:16:3e:18:69:52", "network": {"id": "7f234ecf-bfa6-4316-9dce-c15050ba7914", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1378707892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "243647103fd44f629e0f40be0b56407e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa3c6657-45", "ovs_interfaceid": "fa3c6657-452e-4a95-b9c8-c59002be4e31", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:57:13 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Releasing lock "refresh_cache-6110b34a-6fd3-45fc-911d-4e5d3c7f2d78" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 15:57:13 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] [instance: 6110b34a-6fd3-45fc-911d-4e5d3c7f2d78] Updated the network info_cache for instance {{(pid=75337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 15:57:13 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:57:13 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:57:14 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:57:14 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:57:14 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-f5e59758-0ded-4740-962c-e7cef324a096 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Acquiring lock "d10b4a86-8b0d-423f-81e2-87f5f25a2467" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:57:14 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-f5e59758-0ded-4740-962c-e7cef324a096 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Lock "d10b4a86-8b0d-423f-81e2-87f5f25a2467" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:57:14 user nova-compute[75337]: INFO nova.compute.manager [None req-f5e59758-0ded-4740-962c-e7cef324a096 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] [instance: d10b4a86-8b0d-423f-81e2-87f5f25a2467] Rebooting instance
Nov 06 15:57:14 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-f5e59758-0ded-4740-962c-e7cef324a096 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Acquiring lock "refresh_cache-d10b4a86-8b0d-423f-81e2-87f5f25a2467" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 15:57:14 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-f5e59758-0ded-4740-962c-e7cef324a096 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Acquired lock "refresh_cache-d10b4a86-8b0d-423f-81e2-87f5f25a2467" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 15:57:14 user nova-compute[75337]: DEBUG nova.network.neutron [None req-f5e59758-0ded-4740-962c-e7cef324a096 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] [instance: d10b4a86-8b0d-423f-81e2-87f5f25a2467] Building network info cache for instance {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 15:57:14 user nova-compute[75337]: DEBUG nova.compute.manager [req-358b3f52-f01b-42db-a56d-53d0d7aafd57 req-fffb26c2-1e3f-4608-89ef-8bdb91950250 service nova] [instance: f196f2b3-8eac-4d68-af2e-46671c865be1] Received event network-vif-plugged-0aa648d4-16ed-4160-92c7-0bb2ce626454 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:57:14 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-358b3f52-f01b-42db-a56d-53d0d7aafd57 req-fffb26c2-1e3f-4608-89ef-8bdb91950250 service nova] Acquiring lock "f196f2b3-8eac-4d68-af2e-46671c865be1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:57:14 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-358b3f52-f01b-42db-a56d-53d0d7aafd57 req-fffb26c2-1e3f-4608-89ef-8bdb91950250 service nova] Lock "f196f2b3-8eac-4d68-af2e-46671c865be1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:57:14 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-358b3f52-f01b-42db-a56d-53d0d7aafd57 req-fffb26c2-1e3f-4608-89ef-8bdb91950250 service nova] Lock "f196f2b3-8eac-4d68-af2e-46671c865be1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:57:14 user nova-compute[75337]: DEBUG nova.compute.manager [req-358b3f52-f01b-42db-a56d-53d0d7aafd57 req-fffb26c2-1e3f-4608-89ef-8bdb91950250 service nova] [instance: f196f2b3-8eac-4d68-af2e-46671c865be1] No waiting events found dispatching network-vif-plugged-0aa648d4-16ed-4160-92c7-0bb2ce626454 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:57:14 user nova-compute[75337]: WARNING nova.compute.manager [req-358b3f52-f01b-42db-a56d-53d0d7aafd57 req-fffb26c2-1e3f-4608-89ef-8bdb91950250 service nova] [instance: f196f2b3-8eac-4d68-af2e-46671c865be1] Received unexpected event network-vif-plugged-0aa648d4-16ed-4160-92c7-0bb2ce626454 for instance with vm_state building and task_state spawning.
Nov 06 15:57:14 user nova-compute[75337]: DEBUG nova.compute.manager [req-358b3f52-f01b-42db-a56d-53d0d7aafd57 req-fffb26c2-1e3f-4608-89ef-8bdb91950250 service nova] [instance: d10b4a86-8b0d-423f-81e2-87f5f25a2467] Received event network-changed-f9232e10-c7da-42d1-91c6-d72b0a1e0ccb {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:57:14 user nova-compute[75337]: DEBUG nova.compute.manager [req-358b3f52-f01b-42db-a56d-53d0d7aafd57 req-fffb26c2-1e3f-4608-89ef-8bdb91950250 service nova] [instance: d10b4a86-8b0d-423f-81e2-87f5f25a2467] Refreshing instance network info cache due to event network-changed-f9232e10-c7da-42d1-91c6-d72b0a1e0ccb. {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 15:57:14 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-358b3f52-f01b-42db-a56d-53d0d7aafd57 req-fffb26c2-1e3f-4608-89ef-8bdb91950250 service nova] Acquiring lock "refresh_cache-d10b4a86-8b0d-423f-81e2-87f5f25a2467" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 15:57:15 user nova-compute[75337]: DEBUG nova.network.neutron [None req-f5e59758-0ded-4740-962c-e7cef324a096 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] [instance: d10b4a86-8b0d-423f-81e2-87f5f25a2467] Updating instance_info_cache with network_info: [{"id": "f9232e10-c7da-42d1-91c6-d72b0a1e0ccb", "address": "fa:16:3e:93:ab:63", "network": {"id": "c31b513a-57f0-4bd5-b055-4a363aae9793", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1352256985-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cddccc86bf54fe981667da5ef13fa8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9232e10-c7", "ovs_interfaceid": "f9232e10-c7da-42d1-91c6-d72b0a1e0ccb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:57:15 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-f5e59758-0ded-4740-962c-e7cef324a096 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Releasing lock "refresh_cache-d10b4a86-8b0d-423f-81e2-87f5f25a2467" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 15:57:15 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-358b3f52-f01b-42db-a56d-53d0d7aafd57 req-fffb26c2-1e3f-4608-89ef-8bdb91950250 service nova] Acquired lock "refresh_cache-d10b4a86-8b0d-423f-81e2-87f5f25a2467" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 15:57:15 user nova-compute[75337]: DEBUG nova.network.neutron [req-358b3f52-f01b-42db-a56d-53d0d7aafd57 req-fffb26c2-1e3f-4608-89ef-8bdb91950250 service nova] [instance: d10b4a86-8b0d-423f-81e2-87f5f25a2467] Refreshing network info cache for port f9232e10-c7da-42d1-91c6-d72b0a1e0ccb {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 15:57:15 user nova-compute[75337]: DEBUG nova.compute.manager [None req-f5e59758-0ded-4740-962c-e7cef324a096 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] [instance: d10b4a86-8b0d-423f-81e2-87f5f25a2467] Checking state {{(pid=75337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 15:57:15 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager.update_available_resource {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:57:15 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:57:15 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:57:15 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:57:15 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Auditing locally available compute resources for user (node: user) {{(pid=75337) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 15:57:15 user nova-compute[75337]: DEBUG nova.compute.manager [None req-fd7c5e48-273f-41b2-8c32-ddb7eb531afc tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] [instance: f196f2b3-8eac-4d68-af2e-46671c865be1] Instance event wait completed in 0 seconds for  {{(pid=75337) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 15:57:15 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-fd7c5e48-273f-41b2-8c32-ddb7eb531afc tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] [instance: f196f2b3-8eac-4d68-af2e-46671c865be1] Guest created on hypervisor {{(pid=75337) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 15:57:15 user nova-compute[75337]: INFO nova.virt.libvirt.driver [-] [instance: f196f2b3-8eac-4d68-af2e-46671c865be1] Instance spawned successfully.
Nov 06 15:57:15 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-fd7c5e48-273f-41b2-8c32-ddb7eb531afc tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] [instance: f196f2b3-8eac-4d68-af2e-46671c865be1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 15:57:15 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-fd7c5e48-273f-41b2-8c32-ddb7eb531afc tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] [instance: f196f2b3-8eac-4d68-af2e-46671c865be1] Found default for hw_cdrom_bus of ide {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:57:15 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-fd7c5e48-273f-41b2-8c32-ddb7eb531afc tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] [instance: f196f2b3-8eac-4d68-af2e-46671c865be1] Found default for hw_disk_bus of virtio {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:57:15 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-fd7c5e48-273f-41b2-8c32-ddb7eb531afc tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] [instance: f196f2b3-8eac-4d68-af2e-46671c865be1] Found default for hw_input_bus of None {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:57:15 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-fd7c5e48-273f-41b2-8c32-ddb7eb531afc tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] [instance: f196f2b3-8eac-4d68-af2e-46671c865be1] Found default for hw_pointer_model of None {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:57:15 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-fd7c5e48-273f-41b2-8c32-ddb7eb531afc tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] [instance: f196f2b3-8eac-4d68-af2e-46671c865be1] Found default for hw_video_model of virtio {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:57:15 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-fd7c5e48-273f-41b2-8c32-ddb7eb531afc tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] [instance: f196f2b3-8eac-4d68-af2e-46671c865be1] Found default for hw_vif_model of virtio {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:57:15 user nova-compute[75337]: INFO nova.compute.manager [None req-fd7c5e48-273f-41b2-8c32-ddb7eb531afc tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] [instance: f196f2b3-8eac-4d68-af2e-46671c865be1] Took 7.30 seconds to spawn the instance on the hypervisor.
Nov 06 15:57:15 user nova-compute[75337]: DEBUG nova.compute.manager [None req-fd7c5e48-273f-41b2-8c32-ddb7eb531afc tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] [instance: f196f2b3-8eac-4d68-af2e-46671c865be1] Checking state {{(pid=75337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 15:57:15 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69df3824-b28c-43c0-9f20-52fa956642cc/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:57:15 user nova-compute[75337]: DEBUG nova.network.neutron [req-358b3f52-f01b-42db-a56d-53d0d7aafd57 req-fffb26c2-1e3f-4608-89ef-8bdb91950250 service nova] [instance: d10b4a86-8b0d-423f-81e2-87f5f25a2467] Updated VIF entry in instance network info cache for port f9232e10-c7da-42d1-91c6-d72b0a1e0ccb. {{(pid=75337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 15:57:15 user nova-compute[75337]: DEBUG nova.network.neutron [req-358b3f52-f01b-42db-a56d-53d0d7aafd57 req-fffb26c2-1e3f-4608-89ef-8bdb91950250 service nova] [instance: d10b4a86-8b0d-423f-81e2-87f5f25a2467] Updating instance_info_cache with network_info: [{"id": "f9232e10-c7da-42d1-91c6-d72b0a1e0ccb", "address": "fa:16:3e:93:ab:63", "network": {"id": "c31b513a-57f0-4bd5-b055-4a363aae9793", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1352256985-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cddccc86bf54fe981667da5ef13fa8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9232e10-c7", "ovs_interfaceid": "f9232e10-c7da-42d1-91c6-d72b0a1e0ccb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:57:16 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-358b3f52-f01b-42db-a56d-53d0d7aafd57 req-fffb26c2-1e3f-4608-89ef-8bdb91950250 service nova] Releasing lock "refresh_cache-d10b4a86-8b0d-423f-81e2-87f5f25a2467" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 15:57:16 user nova-compute[75337]: DEBUG nova.compute.manager [req-358b3f52-f01b-42db-a56d-53d0d7aafd57 req-fffb26c2-1e3f-4608-89ef-8bdb91950250 service nova] [instance: f196f2b3-8eac-4d68-af2e-46671c865be1] Received event network-vif-plugged-0aa648d4-16ed-4160-92c7-0bb2ce626454 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:57:16 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-358b3f52-f01b-42db-a56d-53d0d7aafd57 req-fffb26c2-1e3f-4608-89ef-8bdb91950250 service nova] Acquiring lock "f196f2b3-8eac-4d68-af2e-46671c865be1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:57:16 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-358b3f52-f01b-42db-a56d-53d0d7aafd57 req-fffb26c2-1e3f-4608-89ef-8bdb91950250 service nova] Lock "f196f2b3-8eac-4d68-af2e-46671c865be1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:57:16 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-358b3f52-f01b-42db-a56d-53d0d7aafd57 req-fffb26c2-1e3f-4608-89ef-8bdb91950250 service nova] Lock "f196f2b3-8eac-4d68-af2e-46671c865be1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:57:16 user nova-compute[75337]: DEBUG nova.compute.manager [req-358b3f52-f01b-42db-a56d-53d0d7aafd57 req-fffb26c2-1e3f-4608-89ef-8bdb91950250 service nova] [instance: f196f2b3-8eac-4d68-af2e-46671c865be1] No waiting events found dispatching network-vif-plugged-0aa648d4-16ed-4160-92c7-0bb2ce626454 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:57:16 user nova-compute[75337]: WARNING nova.compute.manager [req-358b3f52-f01b-42db-a56d-53d0d7aafd57 req-fffb26c2-1e3f-4608-89ef-8bdb91950250 service nova] [instance: f196f2b3-8eac-4d68-af2e-46671c865be1] Received unexpected event network-vif-plugged-0aa648d4-16ed-4160-92c7-0bb2ce626454 for instance with vm_state building and task_state spawning.
Nov 06 15:57:16 user nova-compute[75337]: INFO nova.compute.manager [None req-fd7c5e48-273f-41b2-8c32-ddb7eb531afc tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] [instance: f196f2b3-8eac-4d68-af2e-46671c865be1] Took 8.41 seconds to build instance.
Nov 06 15:57:16 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-fd7c5e48-273f-41b2-8c32-ddb7eb531afc tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Lock "f196f2b3-8eac-4d68-af2e-46671c865be1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.538s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:57:16 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69df3824-b28c-43c0-9f20-52fa956642cc/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:57:16 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69df3824-b28c-43c0-9f20-52fa956642cc/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:57:16 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:57:16 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69df3824-b28c-43c0-9f20-52fa956642cc/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:57:16 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 15:57:16 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5248533a-89b6-444e-a60a-154b3cdef815/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:57:16 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5248533a-89b6-444e-a60a-154b3cdef815/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:57:16 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5248533a-89b6-444e-a60a-154b3cdef815/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:57:16 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5248533a-89b6-444e-a60a-154b3cdef815/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:57:16 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30c634ff-6999-40aa-a90d-1db6d278b571/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:57:17 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30c634ff-6999-40aa-a90d-1db6d278b571/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:57:17 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30c634ff-6999-40aa-a90d-1db6d278b571/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:57:17 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30c634ff-6999-40aa-a90d-1db6d278b571/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:57:17 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 15:57:17 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6110b34a-6fd3-45fc-911d-4e5d3c7f2d78/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:57:17 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6110b34a-6fd3-45fc-911d-4e5d3c7f2d78/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:57:17 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6110b34a-6fd3-45fc-911d-4e5d3c7f2d78/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:57:17 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6110b34a-6fd3-45fc-911d-4e5d3c7f2d78/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:57:17 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d10b4a86-8b0d-423f-81e2-87f5f25a2467/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:57:17 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:57:17 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:57:17 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:57:18 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:57:18 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d10b4a86-8b0d-423f-81e2-87f5f25a2467/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:57:18 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d10b4a86-8b0d-423f-81e2-87f5f25a2467/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:57:18 user nova-compute[75337]: DEBUG nova.compute.manager [req-c0b4f3b0-e18e-4329-a0bf-2014e6c24057 req-fce75fdd-ab40-4313-9deb-0bba408896cb service nova] [instance: d10b4a86-8b0d-423f-81e2-87f5f25a2467] Received event network-vif-unplugged-f9232e10-c7da-42d1-91c6-d72b0a1e0ccb {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:57:18 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-c0b4f3b0-e18e-4329-a0bf-2014e6c24057 req-fce75fdd-ab40-4313-9deb-0bba408896cb service nova] Acquiring lock "d10b4a86-8b0d-423f-81e2-87f5f25a2467-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:57:18 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-c0b4f3b0-e18e-4329-a0bf-2014e6c24057 req-fce75fdd-ab40-4313-9deb-0bba408896cb service nova] Lock "d10b4a86-8b0d-423f-81e2-87f5f25a2467-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:57:18 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-c0b4f3b0-e18e-4329-a0bf-2014e6c24057 req-fce75fdd-ab40-4313-9deb-0bba408896cb service nova] Lock "d10b4a86-8b0d-423f-81e2-87f5f25a2467-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:57:18 user nova-compute[75337]: DEBUG nova.compute.manager [req-c0b4f3b0-e18e-4329-a0bf-2014e6c24057 req-fce75fdd-ab40-4313-9deb-0bba408896cb service nova] [instance: d10b4a86-8b0d-423f-81e2-87f5f25a2467] No waiting events found dispatching network-vif-unplugged-f9232e10-c7da-42d1-91c6-d72b0a1e0ccb {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:57:18 user nova-compute[75337]: WARNING nova.compute.manager [req-c0b4f3b0-e18e-4329-a0bf-2014e6c24057 req-fce75fdd-ab40-4313-9deb-0bba408896cb service nova] [instance: d10b4a86-8b0d-423f-81e2-87f5f25a2467] Received unexpected event network-vif-unplugged-f9232e10-c7da-42d1-91c6-d72b0a1e0ccb for instance with vm_state active and task_state reboot_started.
Nov 06 15:57:18 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d10b4a86-8b0d-423f-81e2-87f5f25a2467/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:57:18 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 15:57:18 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f196f2b3-8eac-4d68-af2e-46671c865be1/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:57:18 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f196f2b3-8eac-4d68-af2e-46671c865be1/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:57:18 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f196f2b3-8eac-4d68-af2e-46671c865be1/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:57:18 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-f5e59758-0ded-4740-962c-e7cef324a096 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] [instance: d10b4a86-8b0d-423f-81e2-87f5f25a2467] Instance shutdown successfully.
Nov 06 15:57:18 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f196f2b3-8eac-4d68-af2e-46671c865be1/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:57:22 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:57:22 user nova-compute[75337]: DEBUG nova.compute.manager [req-8d4444cc-2b84-4369-83e6-158f0a95f203 req-11343888-7ad0-4960-9136-bd2a67a163a2 service nova] [instance: d10b4a86-8b0d-423f-81e2-87f5f25a2467] Received event network-vif-plugged-f9232e10-c7da-42d1-91c6-d72b0a1e0ccb {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:57:22 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-8d4444cc-2b84-4369-83e6-158f0a95f203 req-11343888-7ad0-4960-9136-bd2a67a163a2 service nova] Acquiring lock "d10b4a86-8b0d-423f-81e2-87f5f25a2467-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:57:22 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-8d4444cc-2b84-4369-83e6-158f0a95f203 req-11343888-7ad0-4960-9136-bd2a67a163a2 service nova] Lock "d10b4a86-8b0d-423f-81e2-87f5f25a2467-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:57:22 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-8d4444cc-2b84-4369-83e6-158f0a95f203 req-11343888-7ad0-4960-9136-bd2a67a163a2 service nova] Lock "d10b4a86-8b0d-423f-81e2-87f5f25a2467-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:57:22 user nova-compute[75337]: DEBUG nova.compute.manager [req-8d4444cc-2b84-4369-83e6-158f0a95f203 req-11343888-7ad0-4960-9136-bd2a67a163a2 service nova] [instance: d10b4a86-8b0d-423f-81e2-87f5f25a2467] No waiting events found dispatching network-vif-plugged-f9232e10-c7da-42d1-91c6-d72b0a1e0ccb {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:57:22 user nova-compute[75337]: WARNING nova.compute.manager [req-8d4444cc-2b84-4369-83e6-158f0a95f203 req-11343888-7ad0-4960-9136-bd2a67a163a2 service nova] [instance: d10b4a86-8b0d-423f-81e2-87f5f25a2467] Received unexpected event network-vif-plugged-f9232e10-c7da-42d1-91c6-d72b0a1e0ccb for instance with vm_state active and task_state reboot_started.
Nov 06 15:57:22 user nova-compute[75337]: DEBUG nova.compute.manager [req-c62943d7-066c-4255-8eb5-e89e7e4b6e6c req-83213863-23e8-4c55-8155-020fe40dbe4d service nova] [instance: d10b4a86-8b0d-423f-81e2-87f5f25a2467] Received event network-vif-plugged-f9232e10-c7da-42d1-91c6-d72b0a1e0ccb {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:57:22 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-c62943d7-066c-4255-8eb5-e89e7e4b6e6c req-83213863-23e8-4c55-8155-020fe40dbe4d service nova] Acquiring lock "d10b4a86-8b0d-423f-81e2-87f5f25a2467-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:57:22 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-c62943d7-066c-4255-8eb5-e89e7e4b6e6c req-83213863-23e8-4c55-8155-020fe40dbe4d service nova] Lock "d10b4a86-8b0d-423f-81e2-87f5f25a2467-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:57:22 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-c62943d7-066c-4255-8eb5-e89e7e4b6e6c req-83213863-23e8-4c55-8155-020fe40dbe4d service nova] Lock "d10b4a86-8b0d-423f-81e2-87f5f25a2467-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:57:22 user nova-compute[75337]: DEBUG nova.compute.manager [req-c62943d7-066c-4255-8eb5-e89e7e4b6e6c req-83213863-23e8-4c55-8155-020fe40dbe4d service nova] [instance: d10b4a86-8b0d-423f-81e2-87f5f25a2467] No waiting events found dispatching network-vif-plugged-f9232e10-c7da-42d1-91c6-d72b0a1e0ccb {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:57:22 user nova-compute[75337]: WARNING nova.compute.manager [req-c62943d7-066c-4255-8eb5-e89e7e4b6e6c req-83213863-23e8-4c55-8155-020fe40dbe4d service nova] [instance: d10b4a86-8b0d-423f-81e2-87f5f25a2467] Received unexpected event network-vif-plugged-f9232e10-c7da-42d1-91c6-d72b0a1e0ccb for instance with vm_state active and task_state reboot_started.
Nov 06 15:57:22 user nova-compute[75337]: DEBUG nova.compute.manager [req-c62943d7-066c-4255-8eb5-e89e7e4b6e6c req-83213863-23e8-4c55-8155-020fe40dbe4d service nova] [instance: d10b4a86-8b0d-423f-81e2-87f5f25a2467] Received event network-vif-plugged-f9232e10-c7da-42d1-91c6-d72b0a1e0ccb {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:57:22 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-c62943d7-066c-4255-8eb5-e89e7e4b6e6c req-83213863-23e8-4c55-8155-020fe40dbe4d service nova] Acquiring lock "d10b4a86-8b0d-423f-81e2-87f5f25a2467-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:57:22 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-c62943d7-066c-4255-8eb5-e89e7e4b6e6c req-83213863-23e8-4c55-8155-020fe40dbe4d service nova] Lock "d10b4a86-8b0d-423f-81e2-87f5f25a2467-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:57:22 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-c62943d7-066c-4255-8eb5-e89e7e4b6e6c req-83213863-23e8-4c55-8155-020fe40dbe4d service nova] Lock "d10b4a86-8b0d-423f-81e2-87f5f25a2467-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:57:22 user nova-compute[75337]: DEBUG nova.compute.manager [req-c62943d7-066c-4255-8eb5-e89e7e4b6e6c req-83213863-23e8-4c55-8155-020fe40dbe4d service nova] [instance: d10b4a86-8b0d-423f-81e2-87f5f25a2467] No waiting events found dispatching network-vif-plugged-f9232e10-c7da-42d1-91c6-d72b0a1e0ccb {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:57:22 user nova-compute[75337]: WARNING nova.compute.manager [req-c62943d7-066c-4255-8eb5-e89e7e4b6e6c req-83213863-23e8-4c55-8155-020fe40dbe4d service nova] [instance: d10b4a86-8b0d-423f-81e2-87f5f25a2467] Received unexpected event network-vif-plugged-f9232e10-c7da-42d1-91c6-d72b0a1e0ccb for instance with vm_state active and task_state reboot_started.
Nov 06 15:57:22 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 15:57:22 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 15:57:22 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Hypervisor/Node resource view: name=user free_ram=8139MB free_disk=25.122451782226562GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75337) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 15:57:22 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:57:22 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:57:22 user nova-compute[75337]: INFO nova.virt.libvirt.driver [-] [instance: d10b4a86-8b0d-423f-81e2-87f5f25a2467] Instance running successfully.
Nov 06 15:57:22 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-f5e59758-0ded-4740-962c-e7cef324a096 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] [instance: d10b4a86-8b0d-423f-81e2-87f5f25a2467] Instance soft rebooted successfully.
Nov 06 15:57:22 user nova-compute[75337]: DEBUG nova.compute.manager [None req-f5e59758-0ded-4740-962c-e7cef324a096 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] [instance: d10b4a86-8b0d-423f-81e2-87f5f25a2467] Checking state {{(pid=75337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 15:57:22 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 30c634ff-6999-40aa-a90d-1db6d278b571 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:57:22 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 6110b34a-6fd3-45fc-911d-4e5d3c7f2d78 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:57:22 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance d10b4a86-8b0d-423f-81e2-87f5f25a2467 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:57:22 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 69df3824-b28c-43c0-9f20-52fa956642cc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:57:22 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 5248533a-89b6-444e-a60a-154b3cdef815 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:57:22 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 9a3a0bd3-6c4d-434f-9f6b-7d954f7c163b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:57:22 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance f196f2b3-8eac-4d68-af2e-46671c865be1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:57:22 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 15:57:22 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 15:57:22 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-f5e59758-0ded-4740-962c-e7cef324a096 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Lock "d10b4a86-8b0d-423f-81e2-87f5f25a2467" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 8.324s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:57:23 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 15:57:23 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 15:57:23 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Compute_service record updated for user:user {{(pid=75337) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 15:57:23 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.565s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:57:24 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:57:27 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:57:29 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:57:32 user nova-compute[75337]: DEBUG nova.compute.manager [req-9d9eb84a-81ec-4cc9-8198-d15838d05f06 req-ed007d20-5c60-412e-bc2e-443fac310a89 service nova] [instance: 5248533a-89b6-444e-a60a-154b3cdef815] Received event network-changed-007682c6-c911-4171-b66e-173d248356cb {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:57:32 user nova-compute[75337]: DEBUG nova.compute.manager [req-9d9eb84a-81ec-4cc9-8198-d15838d05f06 req-ed007d20-5c60-412e-bc2e-443fac310a89 service nova] [instance: 5248533a-89b6-444e-a60a-154b3cdef815] Refreshing instance network info cache due to event network-changed-007682c6-c911-4171-b66e-173d248356cb. {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 15:57:32 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-9d9eb84a-81ec-4cc9-8198-d15838d05f06 req-ed007d20-5c60-412e-bc2e-443fac310a89 service nova] Acquiring lock "refresh_cache-5248533a-89b6-444e-a60a-154b3cdef815" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 15:57:32 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-9d9eb84a-81ec-4cc9-8198-d15838d05f06 req-ed007d20-5c60-412e-bc2e-443fac310a89 service nova] Acquired lock "refresh_cache-5248533a-89b6-444e-a60a-154b3cdef815" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 15:57:32 user nova-compute[75337]: DEBUG nova.network.neutron [req-9d9eb84a-81ec-4cc9-8198-d15838d05f06 req-ed007d20-5c60-412e-bc2e-443fac310a89 service nova] [instance: 5248533a-89b6-444e-a60a-154b3cdef815] Refreshing network info cache for port 007682c6-c911-4171-b66e-173d248356cb {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 15:57:32 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:57:33 user nova-compute[75337]: DEBUG nova.network.neutron [req-9d9eb84a-81ec-4cc9-8198-d15838d05f06 req-ed007d20-5c60-412e-bc2e-443fac310a89 service nova] [instance: 5248533a-89b6-444e-a60a-154b3cdef815] Updated VIF entry in instance network info cache for port 007682c6-c911-4171-b66e-173d248356cb. {{(pid=75337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 15:57:33 user nova-compute[75337]: DEBUG nova.network.neutron [req-9d9eb84a-81ec-4cc9-8198-d15838d05f06 req-ed007d20-5c60-412e-bc2e-443fac310a89 service nova] [instance: 5248533a-89b6-444e-a60a-154b3cdef815] Updating instance_info_cache with network_info: [{"id": "007682c6-c911-4171-b66e-173d248356cb", "address": "fa:16:3e:da:b1:68", "network": {"id": "7f234ecf-bfa6-4316-9dce-c15050ba7914", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1378707892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "243647103fd44f629e0f40be0b56407e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap007682c6-c9", "ovs_interfaceid": "007682c6-c911-4171-b66e-173d248356cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:57:33 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-9d9eb84a-81ec-4cc9-8198-d15838d05f06 req-ed007d20-5c60-412e-bc2e-443fac310a89 service nova] Releasing lock "refresh_cache-5248533a-89b6-444e-a60a-154b3cdef815" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 15:57:33 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-d3596a7b-d4df-425c-862e-f6cdea75f4cb tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Acquiring lock "5248533a-89b6-444e-a60a-154b3cdef815" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:57:33 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-d3596a7b-d4df-425c-862e-f6cdea75f4cb tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Lock "5248533a-89b6-444e-a60a-154b3cdef815" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:57:33 user nova-compute[75337]: DEBUG nova.objects.instance [None req-d3596a7b-d4df-425c-862e-f6cdea75f4cb tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Lazy-loading 'flavor' on Instance uuid 5248533a-89b6-444e-a60a-154b3cdef815 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 15:57:33 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-d3596a7b-d4df-425c-862e-f6cdea75f4cb tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Lock "5248533a-89b6-444e-a60a-154b3cdef815" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:57:33 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-d3596a7b-d4df-425c-862e-f6cdea75f4cb tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Acquiring lock "5248533a-89b6-444e-a60a-154b3cdef815" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:57:33 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-d3596a7b-d4df-425c-862e-f6cdea75f4cb tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Lock "5248533a-89b6-444e-a60a-154b3cdef815" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:57:33 user nova-compute[75337]: INFO nova.compute.manager [None req-d3596a7b-d4df-425c-862e-f6cdea75f4cb tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: 5248533a-89b6-444e-a60a-154b3cdef815] Attaching volume b702cb69-9f60-445c-a874-5abf6142bbb8 to /dev/vdb
Nov 06 15:57:33 user nova-compute[75337]: DEBUG os_brick.utils [None req-d3596a7b-d4df-425c-862e-f6cdea75f4cb tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 15:57:33 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:57:33 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:57:33 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b8dd7fe-7f14-49fc-b2ab-32a030492db8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4ff6411e45b8\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:57:33 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:57:33 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:57:33 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[81620a16-6815-4e36-bf73-f999ff9daa36]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:57:33 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:57:33 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:57:33 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[c35ed0cd-a369-4596-9a00-cab9b4d19800]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:57:33 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[475718d6-a453-4e95-95ec-963a636ba3d9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:57:33 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-d3596a7b-d4df-425c-862e-f6cdea75f4cb tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Running cmd (subprocess): nvme version {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:57:33 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-d3596a7b-d4df-425c-862e-f6cdea75f4cb tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] 'nvme version' failed. Not Retrying. {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 15:57:33 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d3596a7b-d4df-425c-862e-f6cdea75f4cb tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] nvme not present on system {{(pid=75337) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 15:57:33 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:57:33 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 15:57:33 user nova-compute[75337]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 15:57:33 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd686bf2-4417-4dca-907c-7bdd6cd0d1c2]: (4, '') {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:57:33 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.lightos [None req-d3596a7b-d4df-425c-862e-f6cdea75f4cb tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75337) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 15:57:33 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.lightos [None req-d3596a7b-d4df-425c-862e-f6cdea75f4cb tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 15:57:33 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.lightos [None req-d3596a7b-d4df-425c-862e-f6cdea75f4cb tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] LIGHTOS: no hostnqn found. {{(pid=75337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 15:57:33 user nova-compute[75337]: DEBUG os_brick.utils [None req-d3596a7b-d4df-425c-862e-f6cdea75f4cb tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4ff6411e45b8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 15:57:33 user nova-compute[75337]: DEBUG nova.virt.block_device [None req-d3596a7b-d4df-425c-862e-f6cdea75f4cb tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: 5248533a-89b6-444e-a60a-154b3cdef815] Updating existing volume attachment record: 3c4f67f7-e642-40e1-9857-9cd1531f75da {{(pid=75337) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 15:57:34 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:57:37 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:57:39 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:57:42 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:57:44 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:57:47 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:57:49 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:57:49 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:57:51 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:57:52 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:57:54 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:57:55 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:57:57 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:57:57 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:57:58 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:57:59 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:57:59 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d3596a7b-d4df-425c-862e-f6cdea75f4cb tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: 5248533a-89b6-444e-a60a-154b3cdef815] Calling os-brick to attach iSCSI Volume {{(pid=75337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 15:57:59 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3596a7b-d4df-425c-862e-f6cdea75f4cb tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2abc33d0c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WAXrmtZf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 15:57:59 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-d3596a7b-d4df-425c-862e-f6cdea75f4cb tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 15:57:59 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-d3596a7b-d4df-425c-862e-f6cdea75f4cb tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 15:57:59 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-d3596a7b-d4df-425c-862e-f6cdea75f4cb tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 15:57:59 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-d3596a7b-d4df-425c-862e-f6cdea75f4cb tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 15:57:59 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-d3596a7b-d4df-425c-862e-f6cdea75f4cb tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 15:57:59 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-d3596a7b-d4df-425c-862e-f6cdea75f4cb tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 15:57:59 user nova-compute[75337]: INFO os_brick.initiator.connectors.iscsi [None req-d3596a7b-d4df-425c-862e-f6cdea75f4cb tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 15:57:59 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8 -p 172.16.0.220:3260 {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:57:59 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8 -p 172.16.0.220:3260" returned: 21 in 0.029s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:57:59 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa2583ec-6be7-48ad-807d-fbb3cb651e74]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:57:59 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3596a7b-d4df-425c-862e-f6cdea75f4cb tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 15:57:59 user nova-compute[75337]:  {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:57:59 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8 -p 172.16.0.220:3260 --interface default --op new {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:57:59 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:57:59 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2035834-8a8a-47c0-bbcb-494427b86aa1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8] added\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:57:59 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3596a7b-d4df-425c-862e-f6cdea75f4cb tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8] added
Nov 06 15:57:59 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:57:59 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:57:59 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:57:59 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[7af1d22d-2b43-4077-9605-5b812bda8b17]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:57:59 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3596a7b-d4df-425c-862e-f6cdea75f4cb tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:57:59 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:57:59 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:57:59 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[03e2b581-31c9-421e-bb93-af32b34f5530]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:57:59 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3596a7b-d4df-425c-862e-f6cdea75f4cb tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:57:59 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WAXrmtZf {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:57:59 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WAXrmtZf" returned: 0 in 0.022s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:57:59 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc93e899-d2ab-445a-8217-5a4d7bad7444]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:57:59 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3596a7b-d4df-425c-862e-f6cdea75f4cb tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WAXrmtZf'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:57:59 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:57:59 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:57:59 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[65ad6da7-6024-4842-a07e-c57f25edc03e]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:57:59 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3596a7b-d4df-425c-862e-f6cdea75f4cb tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:57:59 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:57:59 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:57:59 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dff63ed-f3be-4419-90a4-9821f1906bf3]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326a132a-07d4-4085-8da9-ffa8444121b5 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e6d3a58-860f-47e7-8433-aca221b3cbf4 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a1b226b-9eb0-4c56-a888-8acb25505999 (non-flash)\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:57:59 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3596a7b-d4df-425c-862e-f6cdea75f4cb tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326a132a-07d4-4085-8da9-ffa8444121b5 (non-flash)
Nov 06 15:57:59 user nova-compute[75337]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673 (non-flash)
Nov 06 15:57:59 user nova-compute[75337]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da (non-flash)
Nov 06 15:57:59 user nova-compute[75337]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e6d3a58-860f-47e7-8433-aca221b3cbf4 (non-flash)
Nov 06 15:57:59 user nova-compute[75337]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a1b226b-9eb0-4c56-a888-8acb25505999 (non-flash)
Nov 06 15:57:59 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 15:57:59 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3596a7b-d4df-425c-862e-f6cdea75f4cb tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326a132a-07d4-4085-8da9-ffa8444121b5 (non-flash)
Nov 06 15:57:59 user nova-compute[75337]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673 (non-flash)
Nov 06 15:57:59 user nova-compute[75337]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da (non-flash)
Nov 06 15:57:59 user nova-compute[75337]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e6d3a58-860f-47e7-8433-aca221b3cbf4 (non-flash)
Nov 06 15:57:59 user nova-compute[75337]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a1b226b-9eb0-4c56-a888-8acb25505999 (non-flash)
Nov 06 15:57:59 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 15:57:59 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8 -p 172.16.0.220:3260 --login {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:57:59 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8 -p 172.16.0.220:3260 --login" returned: 0 in 0.093s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:57:59 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[913b1e0e-a897-42d3-ac88-6e2232748399]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:57:59 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3596a7b-d4df-425c-862e-f6cdea75f4cb tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8, portal: 172.16.0.220,3260]
Nov 06 15:57:59 user nova-compute[75337]: Login to [iface: default, target: iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8, portal: 172.16.0.220,3260] successful.
Nov 06 15:57:59 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:57:59 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:57:59 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.046s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:57:59 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[619a9992-b271-4ff0-b228-4208386b94e6]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:57:59 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3596a7b-d4df-425c-862e-f6cdea75f4cb tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:57:59 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:57:59 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:57:59 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fcd2321-7126-4778-beb9-32508436699a]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326a132a-07d4-4085-8da9-ffa8444121b5 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e6d3a58-860f-47e7-8433-aca221b3cbf4 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a1b226b-9eb0-4c56-a888-8acb25505999 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8 (non-flash)\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:57:59 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3596a7b-d4df-425c-862e-f6cdea75f4cb tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326a132a-07d4-4085-8da9-ffa8444121b5 (non-flash)
Nov 06 15:57:59 user nova-compute[75337]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673 (non-flash)
Nov 06 15:57:59 user nova-compute[75337]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da (non-flash)
Nov 06 15:57:59 user nova-compute[75337]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e6d3a58-860f-47e7-8433-aca221b3cbf4 (non-flash)
Nov 06 15:57:59 user nova-compute[75337]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a1b226b-9eb0-4c56-a888-8acb25505999 (non-flash)
Nov 06 15:57:59 user nova-compute[75337]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8 (non-flash)
Nov 06 15:57:59 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 15:57:59 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3596a7b-d4df-425c-862e-f6cdea75f4cb tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326a132a-07d4-4085-8da9-ffa8444121b5 (non-flash)
Nov 06 15:57:59 user nova-compute[75337]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673 (non-flash)
Nov 06 15:57:59 user nova-compute[75337]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da (non-flash)
Nov 06 15:57:59 user nova-compute[75337]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e6d3a58-860f-47e7-8433-aca221b3cbf4 (non-flash)
Nov 06 15:57:59 user nova-compute[75337]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a1b226b-9eb0-4c56-a888-8acb25505999 (non-flash)
Nov 06 15:57:59 user nova-compute[75337]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8 (non-flash)
Nov 06 15:57:59 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 15:57:59 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-d3596a7b-d4df-425c-862e-f6cdea75f4cb tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.408s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 15:57:59 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3596a7b-d4df-425c-862e-f6cdea75f4cb tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Connected to 172.16.0.220:3260 {{(pid=75337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 15:57:59 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-d3596a7b-d4df-425c-862e-f6cdea75f4cb tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] HCTL ('38', '-', '-', 0) found on session 37 with lun 0 {{(pid=75337) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 15:57:59 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-d3596a7b-d4df-425c-862e-f6cdea75f4cb tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75337) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 15:58:00 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:58:00 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.019s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:58:00 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2d4802c-4825-4878-8fe6-66c8c68ad74f]: (4, ('- - 0', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:58:00 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-d3596a7b-d4df-425c-862e-f6cdea75f4cb tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Searching for a device in session 37 and hctl ['38', '*', '*', 0] yield: None {{(pid=75337) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 15:58:01 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-d3596a7b-d4df-425c-862e-f6cdea75f4cb tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Searching for a device in session 37 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75337) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 15:58:01 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3596a7b-d4df-425c-862e-f6cdea75f4cb tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WAXrmtZf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 15:58:01 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-d3596a7b-d4df-425c-862e-f6cdea75f4cb tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.441s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 15:58:01 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3596a7b-d4df-425c-862e-f6cdea75f4cb tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] <== connect_volume: return (1443ms) {'type': 'block', 'scsi_wwn': '23365333438626331', 'path': '/dev/sdg'} {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 15:58:01 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d3596a7b-d4df-425c-862e-f6cdea75f4cb tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: 5248533a-89b6-444e-a60a-154b3cdef815] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23365333438626331', 'path': '/dev/sdg'} {{(pid=75337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 15:58:01 user nova-compute[75337]: DEBUG nova.objects.instance [None req-d3596a7b-d4df-425c-862e-f6cdea75f4cb tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Lazy-loading 'flavor' on Instance uuid 5248533a-89b6-444e-a60a-154b3cdef815 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 15:58:01 user nova-compute[75337]: DEBUG nova.virt.libvirt.guest [None req-d3596a7b-d4df-425c-862e-f6cdea75f4cb tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] attach device xml: <disk type="block" device="disk">
Nov 06 15:58:01 user nova-compute[75337]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 15:58:01 user nova-compute[75337]:   <source dev="/dev/sdg"/>
Nov 06 15:58:01 user nova-compute[75337]:   <target dev="vdb" bus="virtio"/>
Nov 06 15:58:01 user nova-compute[75337]:   <serial>b702cb69-9f60-445c-a874-5abf6142bbb8</serial>
Nov 06 15:58:01 user nova-compute[75337]: </disk>
Nov 06 15:58:01 user nova-compute[75337]:  {{(pid=75337) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 06 15:58:01 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-d3596a7b-d4df-425c-862e-f6cdea75f4cb tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] No BDM found with device name vda, not building metadata. {{(pid=75337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 15:58:01 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-d3596a7b-d4df-425c-862e-f6cdea75f4cb tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 15:58:01 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-d3596a7b-d4df-425c-862e-f6cdea75f4cb tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] No VIF found with MAC fa:16:3e:da:b1:68, not building metadata {{(pid=75337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 15:58:01 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-d3596a7b-d4df-425c-862e-f6cdea75f4cb tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Lock "5248533a-89b6-444e-a60a-154b3cdef815" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 28.139s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:58:01 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:58:02 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:58:02 user nova-compute[75337]: INFO nova.compute.manager [None req-3f291767-7e2f-431f-b570-cf5ca8145e3c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: 5248533a-89b6-444e-a60a-154b3cdef815] Rebuilding instance
Nov 06 15:58:03 user nova-compute[75337]: DEBUG nova.compute.manager [None req-3f291767-7e2f-431f-b570-cf5ca8145e3c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: 5248533a-89b6-444e-a60a-154b3cdef815] Checking state {{(pid=75337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 15:58:03 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:58:03 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-2d4efc80-81e3-4e78-bb8a-c3d7f2a98263 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] Acquiring lock "ba7d8a41-5a75-4dca-a192-0177119403be" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:58:03 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-2d4efc80-81e3-4e78-bb8a-c3d7f2a98263 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] Lock "ba7d8a41-5a75-4dca-a192-0177119403be" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:58:03 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:58:03 user nova-compute[75337]: DEBUG nova.compute.manager [None req-2d4efc80-81e3-4e78-bb8a-c3d7f2a98263 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] [instance: ba7d8a41-5a75-4dca-a192-0177119403be] Starting instance... {{(pid=75337) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 15:58:03 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-2d4efc80-81e3-4e78-bb8a-c3d7f2a98263 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:58:03 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-2d4efc80-81e3-4e78-bb8a-c3d7f2a98263 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:58:03 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-2d4efc80-81e3-4e78-bb8a-c3d7f2a98263 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75337) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 15:58:03 user nova-compute[75337]: INFO nova.compute.claims [None req-2d4efc80-81e3-4e78-bb8a-c3d7f2a98263 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] [instance: ba7d8a41-5a75-4dca-a192-0177119403be] Claim successful on node user
Nov 06 15:58:03 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:58:03 user nova-compute[75337]: DEBUG nova.compute.manager [req-ff78119b-252b-442e-852e-b4e65271a2f0 req-87399bea-1a77-4f8a-9a23-8ac52bda70b2 service nova] [instance: 5248533a-89b6-444e-a60a-154b3cdef815] Received event network-vif-unplugged-007682c6-c911-4171-b66e-173d248356cb {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:58:03 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-ff78119b-252b-442e-852e-b4e65271a2f0 req-87399bea-1a77-4f8a-9a23-8ac52bda70b2 service nova] Acquiring lock "5248533a-89b6-444e-a60a-154b3cdef815-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:58:03 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-ff78119b-252b-442e-852e-b4e65271a2f0 req-87399bea-1a77-4f8a-9a23-8ac52bda70b2 service nova] Lock "5248533a-89b6-444e-a60a-154b3cdef815-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:58:03 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-ff78119b-252b-442e-852e-b4e65271a2f0 req-87399bea-1a77-4f8a-9a23-8ac52bda70b2 service nova] Lock "5248533a-89b6-444e-a60a-154b3cdef815-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:58:03 user nova-compute[75337]: DEBUG nova.compute.manager [req-ff78119b-252b-442e-852e-b4e65271a2f0 req-87399bea-1a77-4f8a-9a23-8ac52bda70b2 service nova] [instance: 5248533a-89b6-444e-a60a-154b3cdef815] No waiting events found dispatching network-vif-unplugged-007682c6-c911-4171-b66e-173d248356cb {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:58:03 user nova-compute[75337]: WARNING nova.compute.manager [req-ff78119b-252b-442e-852e-b4e65271a2f0 req-87399bea-1a77-4f8a-9a23-8ac52bda70b2 service nova] [instance: 5248533a-89b6-444e-a60a-154b3cdef815] Received unexpected event network-vif-unplugged-007682c6-c911-4171-b66e-173d248356cb for instance with vm_state active and task_state rebuilding.
Nov 06 15:58:03 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:58:04 user nova-compute[75337]: INFO nova.virt.libvirt.driver [-] [instance: 5248533a-89b6-444e-a60a-154b3cdef815] Instance destroyed successfully.
Nov 06 15:58:04 user nova-compute[75337]: INFO nova.compute.manager [None req-3f291767-7e2f-431f-b570-cf5ca8145e3c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: 5248533a-89b6-444e-a60a-154b3cdef815] Detaching volume b702cb69-9f60-445c-a874-5abf6142bbb8
Nov 06 15:58:04 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:58:04 user nova-compute[75337]: INFO nova.virt.block_device [None req-3f291767-7e2f-431f-b570-cf5ca8145e3c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: 5248533a-89b6-444e-a60a-154b3cdef815] Attempting to driver detach volume b702cb69-9f60-445c-a874-5abf6142bbb8 from mountpoint /dev/vdb
Nov 06 15:58:04 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-3f291767-7e2f-431f-b570-cf5ca8145e3c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Attempting to detach device vdb from instance 5248533a-89b6-444e-a60a-154b3cdef815 from the persistent domain config. {{(pid=75337) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 06 15:58:04 user nova-compute[75337]: DEBUG nova.virt.libvirt.guest [None req-3f291767-7e2f-431f-b570-cf5ca8145e3c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 15:58:04 user nova-compute[75337]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 15:58:04 user nova-compute[75337]:   <source dev="/dev/sdg"/>
Nov 06 15:58:04 user nova-compute[75337]:   <target dev="vdb" bus="virtio"/>
Nov 06 15:58:04 user nova-compute[75337]:   <serial>b702cb69-9f60-445c-a874-5abf6142bbb8</serial>
Nov 06 15:58:04 user nova-compute[75337]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 06 15:58:04 user nova-compute[75337]: </disk>
Nov 06 15:58:04 user nova-compute[75337]:  {{(pid=75337) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 15:58:04 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-3f291767-7e2f-431f-b570-cf5ca8145e3c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Successfully detached device vdb from instance 5248533a-89b6-444e-a60a-154b3cdef815 from the persistent domain config.
Nov 06 15:58:04 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f291767-7e2f-431f-b570-cf5ca8145e3c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: 5248533a-89b6-444e-a60a-154b3cdef815] calling os-brick to detach iSCSI Volume {{(pid=75337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 15:58:04 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f291767-7e2f-431f-b570-cf5ca8145e3c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2abc33d0c0>, {'target_iqn': 'iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WAXrmtZf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 15:58:04 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-3f291767-7e2f-431f-b570-cf5ca8145e3c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 06 15:58:04 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-3f291767-7e2f-431f-b570-cf5ca8145e3c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 15:58:04 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-3f291767-7e2f-431f-b570-cf5ca8145e3c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 15:58:04 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:58:04 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-2d4efc80-81e3-4e78-bb8a-c3d7f2a98263 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 15:58:04 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-2d4efc80-81e3-4e78-bb8a-c3d7f2a98263 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 15:58:04 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:58:04 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[059201bd-dd81-465e-8944-788e91d0257b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:326a132a-07d4-4085-8da9-ffa8444121b5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:58:04 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f291767-7e2f-431f-b570-cf5ca8145e3c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 15:58:04 user nova-compute[75337]: No targets found.
Nov 06 15:58:04 user nova-compute[75337]: iSNS:
Nov 06 15:58:04 user nova-compute[75337]: No targets found.
Nov 06 15:58:04 user nova-compute[75337]: STATIC:
Nov 06 15:58:04 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:326a132a-07d4-4085-8da9-ffa8444121b5
Nov 06 15:58:04 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 15:58:04 user nova-compute[75337]:                 Iface Name: default
Nov 06 15:58:04 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da
Nov 06 15:58:04 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 15:58:04 user nova-compute[75337]:                 Iface Name: default
Nov 06 15:58:04 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8
Nov 06 15:58:04 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 15:58:04 user nova-compute[75337]:                 Iface Name: default
Nov 06 15:58:04 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673
Nov 06 15:58:04 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 15:58:04 user nova-compute[75337]:                 Iface Name: default
Nov 06 15:58:04 user nova-compute[75337]: FIRMWARE:
Nov 06 15:58:04 user nova-compute[75337]: No targets found.
Nov 06 15:58:04 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 15:58:04 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f291767-7e2f-431f-b570-cf5ca8145e3c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 15:58:04 user nova-compute[75337]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 15:58:04 user nova-compute[75337]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75337) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 15:58:04 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f291767-7e2f-431f-b570-cf5ca8145e3c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8', 0)] {{(pid=75337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 15:58:04 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:58:04 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:58:04 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[a07f8b03-f236-49c2-8104-71dfd8edf85c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:326a132a-07d4-4085-8da9-ffa8444121b5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:58:04 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:58:04 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-2d4efc80-81e3-4e78-bb8a-c3d7f2a98263 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.821s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:58:04 user nova-compute[75337]: DEBUG nova.compute.manager [None req-2d4efc80-81e3-4e78-bb8a-c3d7f2a98263 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] [instance: ba7d8a41-5a75-4dca-a192-0177119403be] Start building networks asynchronously for instance. {{(pid=75337) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 15:58:04 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:58:04 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfcbc03b-146e-4cf6-967d-4b07cb998173]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326a132a-07d4-4085-8da9-ffa8444121b5 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8 (non-flash)\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:58:04 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f291767-7e2f-431f-b570-cf5ca8145e3c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326a132a-07d4-4085-8da9-ffa8444121b5 (non-flash)
Nov 06 15:58:04 user nova-compute[75337]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673 (non-flash)
Nov 06 15:58:04 user nova-compute[75337]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da (non-flash)
Nov 06 15:58:04 user nova-compute[75337]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8 (non-flash)
Nov 06 15:58:04 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 15:58:04 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f291767-7e2f-431f-b570-cf5ca8145e3c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326a132a-07d4-4085-8da9-ffa8444121b5 (non-flash)
Nov 06 15:58:04 user nova-compute[75337]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673 (non-flash)
Nov 06 15:58:04 user nova-compute[75337]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da (non-flash)
Nov 06 15:58:04 user nova-compute[75337]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8 (non-flash)
Nov 06 15:58:04 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 15:58:04 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f291767-7e2f-431f-b570-cf5ca8145e3c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2a9c243c70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8'): ({'sdg'}, set())}) {{(pid=75337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 15:58:04 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-3f291767-7e2f-431f-b570-cf5ca8145e3c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Removing single pathed devices sdg {{(pid=75337) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 15:58:04 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:58:04 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:58:04 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[84975e4d-d6c2-462f-a1ae-e866b79b3731]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:58:04 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:58:04 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.018s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:58:04 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc9ade8f-fe41-4c59-a500-61538c5e19a8]: (4, ('ok\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:58:04 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-3f291767-7e2f-431f-b570-cf5ca8145e3c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Flushing IO for device /dev/sdg {{(pid=75337) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 15:58:04 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:58:04 user nova-compute[75337]: DEBUG nova.compute.manager [None req-2d4efc80-81e3-4e78-bb8a-c3d7f2a98263 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] [instance: ba7d8a41-5a75-4dca-a192-0177119403be] Allocating IP information in the background. {{(pid=75337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 15:58:04 user nova-compute[75337]: DEBUG nova.network.neutron [None req-2d4efc80-81e3-4e78-bb8a-c3d7f2a98263 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] [instance: ba7d8a41-5a75-4dca-a192-0177119403be] allocate_for_instance() {{(pid=75337) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 15:58:04 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.017s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:58:04 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[83818e7c-8e71-402d-a6f9-f1f6e9533cb6]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:58:04 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-3f291767-7e2f-431f-b570-cf5ca8145e3c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75337) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 15:58:04 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:58:04 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.047s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:58:04 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[4298fbe6-11d6-4145-b144-2315c9246e89]: (4, ('1', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:58:04 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-3f291767-7e2f-431f-b570-cf5ca8145e3c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 15:58:04 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-3f291767-7e2f-431f-b570-cf5ca8145e3c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] SCSI volumes sdg have been removed. {{(pid=75337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 15:58:04 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f291767-7e2f-431f-b570-cf5ca8145e3c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8')] {{(pid=75337) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 15:58:04 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:58:04 user nova-compute[75337]: DEBUG nova.policy [None req-2d4efc80-81e3-4e78-bb8a-c3d7f2a98263 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c64d7153a7a94b4189312356c2b0b1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3589e9805b0743d59c03decf3e6bad5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75337) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 15:58:04 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.044s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:58:04 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[2efa3b46-6132-4c57-ab30-2676d3c47329]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:58:04 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f291767-7e2f-431f-b570-cf5ca8145e3c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:58:04 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8 -p 172.16.0.220:3260 --logout {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:58:04 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:58:04 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[da514222-03f4-4b6e-8a74-d8f8ddf1816c]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:58:04 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f291767-7e2f-431f-b570-cf5ca8145e3c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8, portal: 172.16.0.220,3260]
Nov 06 15:58:04 user nova-compute[75337]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8, portal: 172.16.0.220,3260] successful.
Nov 06 15:58:04 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:58:04 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8 -p 172.16.0.220:3260 --op delete {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:58:04 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-2d4efc80-81e3-4e78-bb8a-c3d7f2a98263 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] [instance: ba7d8a41-5a75-4dca-a192-0177119403be] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 15:58:04 user nova-compute[75337]: DEBUG nova.compute.manager [None req-2d4efc80-81e3-4e78-bb8a-c3d7f2a98263 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] [instance: ba7d8a41-5a75-4dca-a192-0177119403be] Start building block device mappings for instance. {{(pid=75337) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 15:58:04 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:58:04 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4342d78-76a8-4c60-9ead-45667bf3c28d]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:58:04 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f291767-7e2f-431f-b570-cf5ca8145e3c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:58:04 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-3f291767-7e2f-431f-b570-cf5ca8145e3c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.385s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 15:58:04 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f291767-7e2f-431f-b570-cf5ca8145e3c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] <== disconnect_volume: return (387ms) None {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 15:58:04 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f291767-7e2f-431f-b570-cf5ca8145e3c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: 5248533a-89b6-444e-a60a-154b3cdef815] Disconnected iSCSI Volume {{(pid=75337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 15:58:05 user nova-compute[75337]: DEBUG nova.compute.manager [None req-2d4efc80-81e3-4e78-bb8a-c3d7f2a98263 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] [instance: ba7d8a41-5a75-4dca-a192-0177119403be] Start spawning the instance on the hypervisor. {{(pid=75337) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 15:58:05 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-2d4efc80-81e3-4e78-bb8a-c3d7f2a98263 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] [instance: ba7d8a41-5a75-4dca-a192-0177119403be] Creating instance directory {{(pid=75337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 15:58:05 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-2d4efc80-81e3-4e78-bb8a-c3d7f2a98263 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] [instance: ba7d8a41-5a75-4dca-a192-0177119403be] Creating image(s)
Nov 06 15:58:05 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-2d4efc80-81e3-4e78-bb8a-c3d7f2a98263 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] Acquiring lock "/opt/stack/data/nova/instances/ba7d8a41-5a75-4dca-a192-0177119403be/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:58:05 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-2d4efc80-81e3-4e78-bb8a-c3d7f2a98263 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] Lock "/opt/stack/data/nova/instances/ba7d8a41-5a75-4dca-a192-0177119403be/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:58:05 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-2d4efc80-81e3-4e78-bb8a-c3d7f2a98263 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] Lock "/opt/stack/data/nova/instances/ba7d8a41-5a75-4dca-a192-0177119403be/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:58:05 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-2d4efc80-81e3-4e78-bb8a-c3d7f2a98263 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:58:05 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-2d4efc80-81e3-4e78-bb8a-c3d7f2a98263 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json" returned: 0 in 0.180s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:58:05 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-2d4efc80-81e3-4e78-bb8a-c3d7f2a98263 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] Acquiring lock "06ba3c914798499e686c5ac75886932347225275" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:58:05 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-2d4efc80-81e3-4e78-bb8a-c3d7f2a98263 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] Lock "06ba3c914798499e686c5ac75886932347225275" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:58:05 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-2d4efc80-81e3-4e78-bb8a-c3d7f2a98263 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:58:05 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-2d4efc80-81e3-4e78-bb8a-c3d7f2a98263 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json" returned: 0 in 0.246s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:58:05 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-2d4efc80-81e3-4e78-bb8a-c3d7f2a98263 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275,backing_fmt=raw /opt/stack/data/nova/instances/ba7d8a41-5a75-4dca-a192-0177119403be/disk 1073741824 {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:58:05 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-2d4efc80-81e3-4e78-bb8a-c3d7f2a98263 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275,backing_fmt=raw /opt/stack/data/nova/instances/ba7d8a41-5a75-4dca-a192-0177119403be/disk 1073741824" returned: 0 in 0.063s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:58:05 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-2d4efc80-81e3-4e78-bb8a-c3d7f2a98263 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] Lock "06ba3c914798499e686c5ac75886932347225275" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.319s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:58:05 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-2d4efc80-81e3-4e78-bb8a-c3d7f2a98263 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:58:05 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-2d4efc80-81e3-4e78-bb8a-c3d7f2a98263 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json" returned: 0 in 0.189s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:58:05 user nova-compute[75337]: DEBUG nova.virt.disk.api [None req-2d4efc80-81e3-4e78-bb8a-c3d7f2a98263 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ba7d8a41-5a75-4dca-a192-0177119403be/disk. size=1073741824 {{(pid=75337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 15:58:05 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-2d4efc80-81e3-4e78-bb8a-c3d7f2a98263 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba7d8a41-5a75-4dca-a192-0177119403be/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:58:05 user nova-compute[75337]: DEBUG nova.network.neutron [None req-2d4efc80-81e3-4e78-bb8a-c3d7f2a98263 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] [instance: ba7d8a41-5a75-4dca-a192-0177119403be] Successfully created port: f85d9767-bd59-4182-b18b-a29b13527561 {{(pid=75337) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 15:58:05 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-2d4efc80-81e3-4e78-bb8a-c3d7f2a98263 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba7d8a41-5a75-4dca-a192-0177119403be/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:58:05 user nova-compute[75337]: DEBUG nova.virt.disk.api [None req-2d4efc80-81e3-4e78-bb8a-c3d7f2a98263 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] Cannot resize image /opt/stack/data/nova/instances/ba7d8a41-5a75-4dca-a192-0177119403be/disk to a smaller size. {{(pid=75337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 06 15:58:05 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-2d4efc80-81e3-4e78-bb8a-c3d7f2a98263 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] [instance: ba7d8a41-5a75-4dca-a192-0177119403be] Created local disks {{(pid=75337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 15:58:05 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-2d4efc80-81e3-4e78-bb8a-c3d7f2a98263 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] [instance: ba7d8a41-5a75-4dca-a192-0177119403be] Ensure instance console log exists: /opt/stack/data/nova/instances/ba7d8a41-5a75-4dca-a192-0177119403be/console.log {{(pid=75337) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 15:58:05 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-2d4efc80-81e3-4e78-bb8a-c3d7f2a98263 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:58:05 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-2d4efc80-81e3-4e78-bb8a-c3d7f2a98263 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:58:05 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-2d4efc80-81e3-4e78-bb8a-c3d7f2a98263 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:58:06 user nova-compute[75337]: DEBUG nova.compute.manager [req-0a3c4c6c-6679-4787-81d0-64237100fc6e req-2930a15a-c1e0-4fef-a361-331824f6858f service nova] [instance: 5248533a-89b6-444e-a60a-154b3cdef815] Received event network-vif-plugged-007682c6-c911-4171-b66e-173d248356cb {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:58:06 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-0a3c4c6c-6679-4787-81d0-64237100fc6e req-2930a15a-c1e0-4fef-a361-331824f6858f service nova] Acquiring lock "5248533a-89b6-444e-a60a-154b3cdef815-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:58:06 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-0a3c4c6c-6679-4787-81d0-64237100fc6e req-2930a15a-c1e0-4fef-a361-331824f6858f service nova] Lock "5248533a-89b6-444e-a60a-154b3cdef815-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:58:06 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-0a3c4c6c-6679-4787-81d0-64237100fc6e req-2930a15a-c1e0-4fef-a361-331824f6858f service nova] Lock "5248533a-89b6-444e-a60a-154b3cdef815-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:58:06 user nova-compute[75337]: DEBUG nova.compute.manager [req-0a3c4c6c-6679-4787-81d0-64237100fc6e req-2930a15a-c1e0-4fef-a361-331824f6858f service nova] [instance: 5248533a-89b6-444e-a60a-154b3cdef815] No waiting events found dispatching network-vif-plugged-007682c6-c911-4171-b66e-173d248356cb {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:58:06 user nova-compute[75337]: WARNING nova.compute.manager [req-0a3c4c6c-6679-4787-81d0-64237100fc6e req-2930a15a-c1e0-4fef-a361-331824f6858f service nova] [instance: 5248533a-89b6-444e-a60a-154b3cdef815] Received unexpected event network-vif-plugged-007682c6-c911-4171-b66e-173d248356cb for instance with vm_state active and task_state rebuilding.
Nov 06 15:58:06 user nova-compute[75337]: INFO nova.virt.libvirt.driver [-] [instance: 5248533a-89b6-444e-a60a-154b3cdef815] Instance destroyed successfully.
Nov 06 15:58:06 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-3f291767-7e2f-431f-b570-cf5ca8145e3c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T15:55:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1506958454',display_name='tempest-ServerActionsTestOtherA-server-1915006086',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1506958454',id=33,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLLnBW4cDmEWGvvuTCYhgrjSwFeqdq9waFtK0/DRy6vZoehwGRDhsJbCJYWh2vj1zBgwLRqt7KS/TJeEYcini420vHoht0MKs0aDV1+OjULyGrj+Hbr6Qd4OdWLs+79ciw==',key_name='tempest-keypair-45200428',keypairs=<?>,launch_index=0,launched_at=2023-11-06T15:55:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='243647103fd44f629e0f40be0b56407e',ramdisk_id='',reservation_id='r-8xtee88d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-783619975',owner_user_name='tempest-ServerActionsTestOtherA-783619975-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T15:58:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2e47bf9ad49645deb2c1f834938fa39f',uuid=5248533a-89b6-444e-a60a-154b3cdef815,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "007682c6-c911-4171-b66e-173d248356cb", "address": "fa:16:3e:da:b1:68", "network": {"id": "7f234ecf-bfa6-4316-9dce-c15050ba7914", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1378707892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "243647103fd44f629e0f40be0b56407e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap007682c6-c9", "ovs_interfaceid": "007682c6-c911-4171-b66e-173d248356cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 15:58:06 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-3f291767-7e2f-431f-b570-cf5ca8145e3c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Converting VIF {"id": "007682c6-c911-4171-b66e-173d248356cb", "address": "fa:16:3e:da:b1:68", "network": {"id": "7f234ecf-bfa6-4316-9dce-c15050ba7914", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1378707892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "243647103fd44f629e0f40be0b56407e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap007682c6-c9", "ovs_interfaceid": "007682c6-c911-4171-b66e-173d248356cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 15:58:06 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-3f291767-7e2f-431f-b570-cf5ca8145e3c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:da:b1:68,bridge_name='br-int',has_traffic_filtering=True,id=007682c6-c911-4171-b66e-173d248356cb,network=Network(7f234ecf-bfa6-4316-9dce-c15050ba7914),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap007682c6-c9') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 15:58:06 user nova-compute[75337]: DEBUG os_vif [None req-3f291767-7e2f-431f-b570-cf5ca8145e3c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:da:b1:68,bridge_name='br-int',has_traffic_filtering=True,id=007682c6-c911-4171-b66e-173d248356cb,network=Network(7f234ecf-bfa6-4316-9dce-c15050ba7914),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap007682c6-c9') {{(pid=75337) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 15:58:06 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:58:06 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap007682c6-c9, bridge=br-int, if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:58:06 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:58:06 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:58:06 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:58:06 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:58:06 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0095ccfa-2955-473b-ac64-335b8c01bb22) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:58:06 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:58:06 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:58:06 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:58:06 user nova-compute[75337]: INFO os_vif [None req-3f291767-7e2f-431f-b570-cf5ca8145e3c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:da:b1:68,bridge_name='br-int',has_traffic_filtering=True,id=007682c6-c911-4171-b66e-173d248356cb,network=Network(7f234ecf-bfa6-4316-9dce-c15050ba7914),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap007682c6-c9')
Nov 06 15:58:06 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f291767-7e2f-431f-b570-cf5ca8145e3c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: 5248533a-89b6-444e-a60a-154b3cdef815] calling os-brick to detach iSCSI Volume {{(pid=75337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 15:58:06 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f291767-7e2f-431f-b570-cf5ca8145e3c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2abc33d0c0>, {'target_iqn': 'iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WAXrmtZf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 15:58:06 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-3f291767-7e2f-431f-b570-cf5ca8145e3c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 06 15:58:06 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-3f291767-7e2f-431f-b570-cf5ca8145e3c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 15:58:06 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-3f291767-7e2f-431f-b570-cf5ca8145e3c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 15:58:06 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:58:06 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:58:06 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[08c366f4-f6d0-4b10-8521-bc47e89c41ee]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:326a132a-07d4-4085-8da9-ffa8444121b5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:58:06 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f291767-7e2f-431f-b570-cf5ca8145e3c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 15:58:06 user nova-compute[75337]: No targets found.
Nov 06 15:58:06 user nova-compute[75337]: iSNS:
Nov 06 15:58:06 user nova-compute[75337]: No targets found.
Nov 06 15:58:06 user nova-compute[75337]: STATIC:
Nov 06 15:58:06 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:326a132a-07d4-4085-8da9-ffa8444121b5
Nov 06 15:58:06 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 15:58:06 user nova-compute[75337]:                 Iface Name: default
Nov 06 15:58:06 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da
Nov 06 15:58:06 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 15:58:06 user nova-compute[75337]:                 Iface Name: default
Nov 06 15:58:06 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673
Nov 06 15:58:06 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 15:58:06 user nova-compute[75337]:                 Iface Name: default
Nov 06 15:58:06 user nova-compute[75337]: FIRMWARE:
Nov 06 15:58:06 user nova-compute[75337]: No targets found.
Nov 06 15:58:06 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 15:58:06 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f291767-7e2f-431f-b570-cf5ca8145e3c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 15:58:06 user nova-compute[75337]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 15:58:06 user nova-compute[75337]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75337) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 15:58:06 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f291767-7e2f-431f-b570-cf5ca8145e3c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8', 0)] {{(pid=75337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 15:58:06 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:58:06 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.028s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:58:06 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[edc5dcb7-0f94-4b9e-8712-a9bbcc0df80c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:326a132a-07d4-4085-8da9-ffa8444121b5\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:58:06 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:58:06 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:58:06 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c6c12b0-65ab-48f6-a825-2b4710083613]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326a132a-07d4-4085-8da9-ffa8444121b5 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da (non-flash)\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:58:06 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f291767-7e2f-431f-b570-cf5ca8145e3c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326a132a-07d4-4085-8da9-ffa8444121b5 (non-flash)
Nov 06 15:58:06 user nova-compute[75337]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673 (non-flash)
Nov 06 15:58:06 user nova-compute[75337]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da (non-flash)
Nov 06 15:58:06 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 15:58:06 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f291767-7e2f-431f-b570-cf5ca8145e3c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326a132a-07d4-4085-8da9-ffa8444121b5 (non-flash)
Nov 06 15:58:06 user nova-compute[75337]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673 (non-flash)
Nov 06 15:58:06 user nova-compute[75337]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da (non-flash)
Nov 06 15:58:06 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 15:58:06 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f291767-7e2f-431f-b570-cf5ca8145e3c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2acd6d7f40>, {}) {{(pid=75337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 15:58:06 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f291767-7e2f-431f-b570-cf5ca8145e3c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Disconnecting from: [] {{(pid=75337) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 15:58:06 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-3f291767-7e2f-431f-b570-cf5ca8145e3c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.098s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 15:58:06 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f291767-7e2f-431f-b570-cf5ca8145e3c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] <== disconnect_volume: return (99ms) None {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 15:58:06 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f291767-7e2f-431f-b570-cf5ca8145e3c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: 5248533a-89b6-444e-a60a-154b3cdef815] Disconnected iSCSI Volume {{(pid=75337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 15:58:06 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-3f291767-7e2f-431f-b570-cf5ca8145e3c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: 5248533a-89b6-444e-a60a-154b3cdef815] Deleting instance files /opt/stack/data/nova/instances/5248533a-89b6-444e-a60a-154b3cdef815_del
Nov 06 15:58:06 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-3f291767-7e2f-431f-b570-cf5ca8145e3c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: 5248533a-89b6-444e-a60a-154b3cdef815] Deletion of /opt/stack/data/nova/instances/5248533a-89b6-444e-a60a-154b3cdef815_del complete
Nov 06 15:58:06 user nova-compute[75337]: INFO nova.virt.block_device [None req-3f291767-7e2f-431f-b570-cf5ca8145e3c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: 5248533a-89b6-444e-a60a-154b3cdef815] Booting with volume b702cb69-9f60-445c-a874-5abf6142bbb8 at /dev/vdb
Nov 06 15:58:06 user nova-compute[75337]: DEBUG os_brick.utils [None req-3f291767-7e2f-431f-b570-cf5ca8145e3c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 15:58:06 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:58:06 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:58:06 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[128f771c-f5e8-49ec-a17c-98eddd015a2c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4ff6411e45b8\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:58:06 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:58:06 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:58:06 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cfcd94e-c5b2-4090-8408-2da0f22b7083]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:58:06 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:58:06 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:58:06 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc181713-284d-45aa-a3ce-c6a4bf223b48]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:58:06 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[80207e68-0454-40ae-a883-d7b95c798ae8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:58:06 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-3f291767-7e2f-431f-b570-cf5ca8145e3c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Running cmd (subprocess): nvme version {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:58:06 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-3f291767-7e2f-431f-b570-cf5ca8145e3c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] 'nvme version' failed. Not Retrying. {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 15:58:06 user nova-compute[75337]: DEBUG nova.network.neutron [None req-2d4efc80-81e3-4e78-bb8a-c3d7f2a98263 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] [instance: ba7d8a41-5a75-4dca-a192-0177119403be] Successfully updated port: f85d9767-bd59-4182-b18b-a29b13527561 {{(pid=75337) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 15:58:06 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3f291767-7e2f-431f-b570-cf5ca8145e3c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] nvme not present on system {{(pid=75337) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 15:58:06 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:58:06 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-2d4efc80-81e3-4e78-bb8a-c3d7f2a98263 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] Acquiring lock "refresh_cache-ba7d8a41-5a75-4dca-a192-0177119403be" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 15:58:06 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-2d4efc80-81e3-4e78-bb8a-c3d7f2a98263 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] Acquired lock "refresh_cache-ba7d8a41-5a75-4dca-a192-0177119403be" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 15:58:06 user nova-compute[75337]: DEBUG nova.network.neutron [None req-2d4efc80-81e3-4e78-bb8a-c3d7f2a98263 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] [instance: ba7d8a41-5a75-4dca-a192-0177119403be] Building network info cache for instance {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 15:58:06 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 15:58:06 user nova-compute[75337]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 15:58:06 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[00f78dc9-e806-433d-b57b-a4030af159b7]: (4, '') {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:58:06 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.lightos [None req-3f291767-7e2f-431f-b570-cf5ca8145e3c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75337) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 15:58:06 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.lightos [None req-3f291767-7e2f-431f-b570-cf5ca8145e3c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 15:58:06 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.lightos [None req-3f291767-7e2f-431f-b570-cf5ca8145e3c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] LIGHTOS: no hostnqn found. {{(pid=75337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 15:58:06 user nova-compute[75337]: DEBUG os_brick.utils [None req-3f291767-7e2f-431f-b570-cf5ca8145e3c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] <== get_connector_properties: return (154ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4ff6411e45b8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 15:58:06 user nova-compute[75337]: DEBUG nova.virt.block_device [None req-3f291767-7e2f-431f-b570-cf5ca8145e3c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: 5248533a-89b6-444e-a60a-154b3cdef815] Updating existing volume attachment record: 4c7846b8-cd03-4109-91ec-e6c6206116af {{(pid=75337) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 15:58:06 user nova-compute[75337]: DEBUG nova.compute.manager [req-1db099bb-b1b1-4a0f-9069-4b3f3cc91a9f req-1725f0cf-79a1-4903-b3dc-cba7721d3fe5 service nova] [instance: ba7d8a41-5a75-4dca-a192-0177119403be] Received event network-changed-f85d9767-bd59-4182-b18b-a29b13527561 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:58:06 user nova-compute[75337]: DEBUG nova.compute.manager [req-1db099bb-b1b1-4a0f-9069-4b3f3cc91a9f req-1725f0cf-79a1-4903-b3dc-cba7721d3fe5 service nova] [instance: ba7d8a41-5a75-4dca-a192-0177119403be] Refreshing instance network info cache due to event network-changed-f85d9767-bd59-4182-b18b-a29b13527561. {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 15:58:06 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-1db099bb-b1b1-4a0f-9069-4b3f3cc91a9f req-1725f0cf-79a1-4903-b3dc-cba7721d3fe5 service nova] Acquiring lock "refresh_cache-ba7d8a41-5a75-4dca-a192-0177119403be" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 15:58:06 user nova-compute[75337]: DEBUG nova.network.neutron [None req-2d4efc80-81e3-4e78-bb8a-c3d7f2a98263 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] [instance: ba7d8a41-5a75-4dca-a192-0177119403be] Instance cache missing network info. {{(pid=75337) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 15:58:06 user nova-compute[75337]: DEBUG nova.network.neutron [None req-2d4efc80-81e3-4e78-bb8a-c3d7f2a98263 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] [instance: ba7d8a41-5a75-4dca-a192-0177119403be] Updating instance_info_cache with network_info: [{"id": "f85d9767-bd59-4182-b18b-a29b13527561", "address": "fa:16:3e:d2:44:86", "network": {"id": "86559e08-82d7-4eed-8a89-f5859ff948b3", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-28678156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3589e9805b0743d59c03decf3e6bad5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf85d9767-bd", "ovs_interfaceid": "f85d9767-bd59-4182-b18b-a29b13527561", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:58:07 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-2d4efc80-81e3-4e78-bb8a-c3d7f2a98263 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] Releasing lock "refresh_cache-ba7d8a41-5a75-4dca-a192-0177119403be" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 15:58:07 user nova-compute[75337]: DEBUG nova.compute.manager [None req-2d4efc80-81e3-4e78-bb8a-c3d7f2a98263 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] [instance: ba7d8a41-5a75-4dca-a192-0177119403be] Instance network_info: |[{"id": "f85d9767-bd59-4182-b18b-a29b13527561", "address": "fa:16:3e:d2:44:86", "network": {"id": "86559e08-82d7-4eed-8a89-f5859ff948b3", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-28678156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3589e9805b0743d59c03decf3e6bad5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf85d9767-bd", "ovs_interfaceid": "f85d9767-bd59-4182-b18b-a29b13527561", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 15:58:07 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-1db099bb-b1b1-4a0f-9069-4b3f3cc91a9f req-1725f0cf-79a1-4903-b3dc-cba7721d3fe5 service nova] Acquired lock "refresh_cache-ba7d8a41-5a75-4dca-a192-0177119403be" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 15:58:07 user nova-compute[75337]: DEBUG nova.network.neutron [req-1db099bb-b1b1-4a0f-9069-4b3f3cc91a9f req-1725f0cf-79a1-4903-b3dc-cba7721d3fe5 service nova] [instance: ba7d8a41-5a75-4dca-a192-0177119403be] Refreshing network info cache for port f85d9767-bd59-4182-b18b-a29b13527561 {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 15:58:07 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-2d4efc80-81e3-4e78-bb8a-c3d7f2a98263 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] [instance: ba7d8a41-5a75-4dca-a192-0177119403be] Start _get_guest_xml network_info=[{"id": "f85d9767-bd59-4182-b18b-a29b13527561", "address": "fa:16:3e:d2:44:86", "network": {"id": "86559e08-82d7-4eed-8a89-f5859ff948b3", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-28678156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3589e9805b0743d59c03decf3e6bad5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf85d9767-bd", "ovs_interfaceid": "f85d9767-bd59-4182-b18b-a29b13527561", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T15:34:14Z,direct_url=<?>,disk_format='qcow2',id=16b903ae-a40f-41a7-985b-4804cce92c62,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6549a15819f1469bbd5eeae8190e3d44',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T15:34:15Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'guest_format': None, 'size': 0, 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '16b903ae-a40f-41a7-985b-4804cce92c62'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 15:58:07 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-2d4efc80-81e3-4e78-bb8a-c3d7f2a98263 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 15:58:07 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-2d4efc80-81e3-4e78-bb8a-c3d7f2a98263 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 15:58:07 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-2d4efc80-81e3-4e78-bb8a-c3d7f2a98263 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 15:58:07 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-2d4efc80-81e3-4e78-bb8a-c3d7f2a98263 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] CPU controller missing on host. {{(pid=75337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 15:58:07 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-2d4efc80-81e3-4e78-bb8a-c3d7f2a98263 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 15:58:07 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-2d4efc80-81e3-4e78-bb8a-c3d7f2a98263 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] CPU controller found on host. {{(pid=75337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 15:58:07 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-2d4efc80-81e3-4e78-bb8a-c3d7f2a98263 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75337) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 15:58:07 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-2d4efc80-81e3-4e78-bb8a-c3d7f2a98263 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T15:34:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T15:34:14Z,direct_url=<?>,disk_format='qcow2',id=16b903ae-a40f-41a7-985b-4804cce92c62,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6549a15819f1469bbd5eeae8190e3d44',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T15:34:15Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 15:58:07 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-2d4efc80-81e3-4e78-bb8a-c3d7f2a98263 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] Flavor limits 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 15:58:07 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-2d4efc80-81e3-4e78-bb8a-c3d7f2a98263 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] Image limits 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 15:58:07 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-2d4efc80-81e3-4e78-bb8a-c3d7f2a98263 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] Flavor pref 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 15:58:07 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-2d4efc80-81e3-4e78-bb8a-c3d7f2a98263 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] Image pref 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 15:58:07 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-2d4efc80-81e3-4e78-bb8a-c3d7f2a98263 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 15:58:07 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-2d4efc80-81e3-4e78-bb8a-c3d7f2a98263 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 15:58:07 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-2d4efc80-81e3-4e78-bb8a-c3d7f2a98263 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 15:58:07 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-2d4efc80-81e3-4e78-bb8a-c3d7f2a98263 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] Got 1 possible topologies {{(pid=75337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 15:58:07 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-2d4efc80-81e3-4e78-bb8a-c3d7f2a98263 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 15:58:07 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-2d4efc80-81e3-4e78-bb8a-c3d7f2a98263 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 15:58:07 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-2d4efc80-81e3-4e78-bb8a-c3d7f2a98263 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T15:58:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1151083637',display_name='tempest-TestServerVolumeAttachmentScenario-server-1151083637',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1151083637',id=36,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCB41VFIT5juD7+9z6N1qRknNQRLvsimsPD63E0OSj+2oOdF5JSQ2RIEZayjysK7567xZlXNjOJziMv6mqo0U6agdcFwCKrbSyM2vP/bkxlfCKVdfz2cenTv5hl1n2s+1A==',key_name='tempest-keypair-281126385',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3589e9805b0743d59c03decf3e6bad5c',ramdisk_id='',reservation_id='r-48oejgv9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-2018764463',owner_user_name='tempest-TestServerVolumeAttachmentScenario-2018764463-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T15:58:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c64d7153a7a94b4189312356c2b0b1f1',uuid=ba7d8a41-5a75-4dca-a192-0177119403be,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f85d9767-bd59-4182-b18b-a29b13527561", "address": "fa:16:3e:d2:44:86", "network": {"id": "86559e08-82d7-4eed-8a89-f5859ff948b3", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-28678156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3589e9805b0743d59c03decf3e6bad5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf85d9767-bd", "ovs_interfaceid": "f85d9767-bd59-4182-b18b-a29b13527561", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75337) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 15:58:07 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-2d4efc80-81e3-4e78-bb8a-c3d7f2a98263 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] Converting VIF {"id": "f85d9767-bd59-4182-b18b-a29b13527561", "address": "fa:16:3e:d2:44:86", "network": {"id": "86559e08-82d7-4eed-8a89-f5859ff948b3", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-28678156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3589e9805b0743d59c03decf3e6bad5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf85d9767-bd", "ovs_interfaceid": "f85d9767-bd59-4182-b18b-a29b13527561", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 15:58:07 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-2d4efc80-81e3-4e78-bb8a-c3d7f2a98263 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:44:86,bridge_name='br-int',has_traffic_filtering=True,id=f85d9767-bd59-4182-b18b-a29b13527561,network=Network(86559e08-82d7-4eed-8a89-f5859ff948b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf85d9767-bd') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 15:58:07 user nova-compute[75337]: DEBUG nova.objects.instance [None req-2d4efc80-81e3-4e78-bb8a-c3d7f2a98263 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] Lazy-loading 'pci_devices' on Instance uuid ba7d8a41-5a75-4dca-a192-0177119403be {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 15:58:07 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-2d4efc80-81e3-4e78-bb8a-c3d7f2a98263 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] [instance: ba7d8a41-5a75-4dca-a192-0177119403be] End _get_guest_xml xml=<domain type="kvm">
Nov 06 15:58:07 user nova-compute[75337]:   <uuid>ba7d8a41-5a75-4dca-a192-0177119403be</uuid>
Nov 06 15:58:07 user nova-compute[75337]:   <name>instance-00000024</name>
Nov 06 15:58:07 user nova-compute[75337]:   <memory>524288</memory>
Nov 06 15:58:07 user nova-compute[75337]:   <vcpu>1</vcpu>
Nov 06 15:58:07 user nova-compute[75337]:   <metadata>
Nov 06 15:58:07 user nova-compute[75337]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 15:58:07 user nova-compute[75337]:       <nova:package version="0.0.0"/>
Nov 06 15:58:07 user nova-compute[75337]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-1151083637</nova:name>
Nov 06 15:58:07 user nova-compute[75337]:       <nova:creationTime>2023-11-06 15:58:07</nova:creationTime>
Nov 06 15:58:07 user nova-compute[75337]:       <nova:flavor name="m1.tiny">
Nov 06 15:58:07 user nova-compute[75337]:         <nova:memory>512</nova:memory>
Nov 06 15:58:07 user nova-compute[75337]:         <nova:disk>1</nova:disk>
Nov 06 15:58:07 user nova-compute[75337]:         <nova:swap>0</nova:swap>
Nov 06 15:58:07 user nova-compute[75337]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 15:58:07 user nova-compute[75337]:         <nova:vcpus>1</nova:vcpus>
Nov 06 15:58:07 user nova-compute[75337]:       </nova:flavor>
Nov 06 15:58:07 user nova-compute[75337]:       <nova:owner>
Nov 06 15:58:07 user nova-compute[75337]:         <nova:user uuid="c64d7153a7a94b4189312356c2b0b1f1">tempest-TestServerVolumeAttachmentScenario-2018764463-project-member</nova:user>
Nov 06 15:58:07 user nova-compute[75337]:         <nova:project uuid="3589e9805b0743d59c03decf3e6bad5c">tempest-TestServerVolumeAttachmentScenario-2018764463</nova:project>
Nov 06 15:58:07 user nova-compute[75337]:       </nova:owner>
Nov 06 15:58:07 user nova-compute[75337]:       <nova:root type="image" uuid="16b903ae-a40f-41a7-985b-4804cce92c62"/>
Nov 06 15:58:07 user nova-compute[75337]:       <nova:ports>
Nov 06 15:58:07 user nova-compute[75337]:         <nova:port uuid="f85d9767-bd59-4182-b18b-a29b13527561">
Nov 06 15:58:07 user nova-compute[75337]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 06 15:58:07 user nova-compute[75337]:         </nova:port>
Nov 06 15:58:07 user nova-compute[75337]:       </nova:ports>
Nov 06 15:58:07 user nova-compute[75337]:     </nova:instance>
Nov 06 15:58:07 user nova-compute[75337]:   </metadata>
Nov 06 15:58:07 user nova-compute[75337]:   <sysinfo type="smbios">
Nov 06 15:58:07 user nova-compute[75337]:     <system>
Nov 06 15:58:07 user nova-compute[75337]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 15:58:07 user nova-compute[75337]:       <entry name="product">OpenStack Nova</entry>
Nov 06 15:58:07 user nova-compute[75337]:       <entry name="version">0.0.0</entry>
Nov 06 15:58:07 user nova-compute[75337]:       <entry name="serial">ba7d8a41-5a75-4dca-a192-0177119403be</entry>
Nov 06 15:58:07 user nova-compute[75337]:       <entry name="uuid">ba7d8a41-5a75-4dca-a192-0177119403be</entry>
Nov 06 15:58:07 user nova-compute[75337]:       <entry name="family">Virtual Machine</entry>
Nov 06 15:58:07 user nova-compute[75337]:     </system>
Nov 06 15:58:07 user nova-compute[75337]:   </sysinfo>
Nov 06 15:58:07 user nova-compute[75337]:   <os>
Nov 06 15:58:07 user nova-compute[75337]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 15:58:07 user nova-compute[75337]:     <boot dev="hd"/>
Nov 06 15:58:07 user nova-compute[75337]:     <smbios mode="sysinfo"/>
Nov 06 15:58:07 user nova-compute[75337]:   </os>
Nov 06 15:58:07 user nova-compute[75337]:   <features>
Nov 06 15:58:07 user nova-compute[75337]:     <acpi/>
Nov 06 15:58:07 user nova-compute[75337]:     <apic/>
Nov 06 15:58:07 user nova-compute[75337]:     <vmcoreinfo/>
Nov 06 15:58:07 user nova-compute[75337]:   </features>
Nov 06 15:58:07 user nova-compute[75337]:   <clock offset="utc">
Nov 06 15:58:07 user nova-compute[75337]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 15:58:07 user nova-compute[75337]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 15:58:07 user nova-compute[75337]:     <timer name="hpet" present="no"/>
Nov 06 15:58:07 user nova-compute[75337]:   </clock>
Nov 06 15:58:07 user nova-compute[75337]:   <cpu mode="custom" match="exact">
Nov 06 15:58:07 user nova-compute[75337]:     <model>Nehalem</model>
Nov 06 15:58:07 user nova-compute[75337]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 15:58:07 user nova-compute[75337]:   </cpu>
Nov 06 15:58:07 user nova-compute[75337]:   <devices>
Nov 06 15:58:07 user nova-compute[75337]:     <disk type="file" device="disk">
Nov 06 15:58:07 user nova-compute[75337]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 15:58:07 user nova-compute[75337]:       <source file="/opt/stack/data/nova/instances/ba7d8a41-5a75-4dca-a192-0177119403be/disk"/>
Nov 06 15:58:07 user nova-compute[75337]:       <target dev="vda" bus="virtio"/>
Nov 06 15:58:07 user nova-compute[75337]:     </disk>
Nov 06 15:58:07 user nova-compute[75337]:     <interface type="ethernet">
Nov 06 15:58:07 user nova-compute[75337]:       <mac address="fa:16:3e:d2:44:86"/>
Nov 06 15:58:07 user nova-compute[75337]:       <model type="virtio"/>
Nov 06 15:58:07 user nova-compute[75337]:       <mtu size="1442"/>
Nov 06 15:58:07 user nova-compute[75337]:       <target dev="tapf85d9767-bd"/>
Nov 06 15:58:07 user nova-compute[75337]:     </interface>
Nov 06 15:58:07 user nova-compute[75337]:     <serial type="pty">
Nov 06 15:58:07 user nova-compute[75337]:       <log file="/opt/stack/data/nova/instances/ba7d8a41-5a75-4dca-a192-0177119403be/console.log" append="off"/>
Nov 06 15:58:07 user nova-compute[75337]:     </serial>
Nov 06 15:58:07 user nova-compute[75337]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 15:58:07 user nova-compute[75337]:     <video>
Nov 06 15:58:07 user nova-compute[75337]:       <model type="virtio"/>
Nov 06 15:58:07 user nova-compute[75337]:     </video>
Nov 06 15:58:07 user nova-compute[75337]:     <rng model="virtio">
Nov 06 15:58:07 user nova-compute[75337]:       <backend model="random">/dev/urandom</backend>
Nov 06 15:58:07 user nova-compute[75337]:     </rng>
Nov 06 15:58:07 user nova-compute[75337]:     <controller type="usb" index="0" model="none"/>
Nov 06 15:58:07 user nova-compute[75337]:     <memballoon model="virtio">
Nov 06 15:58:07 user nova-compute[75337]:       <stats period="10"/>
Nov 06 15:58:07 user nova-compute[75337]:     </memballoon>
Nov 06 15:58:07 user nova-compute[75337]:   </devices>
Nov 06 15:58:07 user nova-compute[75337]: </domain>
Nov 06 15:58:07 user nova-compute[75337]:  {{(pid=75337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 15:58:07 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-2d4efc80-81e3-4e78-bb8a-c3d7f2a98263 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T15:58:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1151083637',display_name='tempest-TestServerVolumeAttachmentScenario-server-1151083637',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1151083637',id=36,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCB41VFIT5juD7+9z6N1qRknNQRLvsimsPD63E0OSj+2oOdF5JSQ2RIEZayjysK7567xZlXNjOJziMv6mqo0U6agdcFwCKrbSyM2vP/bkxlfCKVdfz2cenTv5hl1n2s+1A==',key_name='tempest-keypair-281126385',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3589e9805b0743d59c03decf3e6bad5c',ramdisk_id='',reservation_id='r-48oejgv9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-2018764463',owner_user_name='tempest-TestServerVolumeAttachmentScenario-2018764463-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T15:58:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c64d7153a7a94b4189312356c2b0b1f1',uuid=ba7d8a41-5a75-4dca-a192-0177119403be,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f85d9767-bd59-4182-b18b-a29b13527561", "address": "fa:16:3e:d2:44:86", "network": {"id": "86559e08-82d7-4eed-8a89-f5859ff948b3", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-28678156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3589e9805b0743d59c03decf3e6bad5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf85d9767-bd", "ovs_interfaceid": "f85d9767-bd59-4182-b18b-a29b13527561", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 15:58:07 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-2d4efc80-81e3-4e78-bb8a-c3d7f2a98263 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] Converting VIF {"id": "f85d9767-bd59-4182-b18b-a29b13527561", "address": "fa:16:3e:d2:44:86", "network": {"id": "86559e08-82d7-4eed-8a89-f5859ff948b3", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-28678156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3589e9805b0743d59c03decf3e6bad5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf85d9767-bd", "ovs_interfaceid": "f85d9767-bd59-4182-b18b-a29b13527561", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 15:58:07 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-2d4efc80-81e3-4e78-bb8a-c3d7f2a98263 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:44:86,bridge_name='br-int',has_traffic_filtering=True,id=f85d9767-bd59-4182-b18b-a29b13527561,network=Network(86559e08-82d7-4eed-8a89-f5859ff948b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf85d9767-bd') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 15:58:07 user nova-compute[75337]: DEBUG os_vif [None req-2d4efc80-81e3-4e78-bb8a-c3d7f2a98263 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:44:86,bridge_name='br-int',has_traffic_filtering=True,id=f85d9767-bd59-4182-b18b-a29b13527561,network=Network(86559e08-82d7-4eed-8a89-f5859ff948b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf85d9767-bd') {{(pid=75337) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 15:58:07 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:58:07 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:58:07 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 15:58:07 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:58:07 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2823b9e9-ff56-5d9f-bbf1-50e7566c4257', '_type': 'linux-noop'}}, row=False) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:58:07 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:58:07 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:58:07 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:58:07 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:58:07 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf85d9767-bd, may_exist=True, interface_attrs={}) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:58:07 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf85d9767-bd, col_values=(('qos', UUID('46205da7-1dac-44f1-b4d6-5fc9685a9924')),), if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:58:07 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf85d9767-bd, col_values=(('external_ids', {'iface-id': 'f85d9767-bd59-4182-b18b-a29b13527561', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d2:44:86', 'vm-uuid': 'ba7d8a41-5a75-4dca-a192-0177119403be'}),), if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:58:07 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:58:07 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:58:07 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:58:07 user nova-compute[75337]: INFO os_vif [None req-2d4efc80-81e3-4e78-bb8a-c3d7f2a98263 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:44:86,bridge_name='br-int',has_traffic_filtering=True,id=f85d9767-bd59-4182-b18b-a29b13527561,network=Network(86559e08-82d7-4eed-8a89-f5859ff948b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf85d9767-bd')
Nov 06 15:58:07 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-2d4efc80-81e3-4e78-bb8a-c3d7f2a98263 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] No BDM found with device name vda, not building metadata. {{(pid=75337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 15:58:07 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-2d4efc80-81e3-4e78-bb8a-c3d7f2a98263 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] No VIF found with MAC fa:16:3e:d2:44:86, not building metadata {{(pid=75337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 15:58:07 user nova-compute[75337]: DEBUG nova.network.neutron [req-1db099bb-b1b1-4a0f-9069-4b3f3cc91a9f req-1725f0cf-79a1-4903-b3dc-cba7721d3fe5 service nova] [instance: ba7d8a41-5a75-4dca-a192-0177119403be] Updated VIF entry in instance network info cache for port f85d9767-bd59-4182-b18b-a29b13527561. {{(pid=75337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 15:58:07 user nova-compute[75337]: DEBUG nova.network.neutron [req-1db099bb-b1b1-4a0f-9069-4b3f3cc91a9f req-1725f0cf-79a1-4903-b3dc-cba7721d3fe5 service nova] [instance: ba7d8a41-5a75-4dca-a192-0177119403be] Updating instance_info_cache with network_info: [{"id": "f85d9767-bd59-4182-b18b-a29b13527561", "address": "fa:16:3e:d2:44:86", "network": {"id": "86559e08-82d7-4eed-8a89-f5859ff948b3", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-28678156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3589e9805b0743d59c03decf3e6bad5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf85d9767-bd", "ovs_interfaceid": "f85d9767-bd59-4182-b18b-a29b13527561", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:58:07 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-1db099bb-b1b1-4a0f-9069-4b3f3cc91a9f req-1725f0cf-79a1-4903-b3dc-cba7721d3fe5 service nova] Releasing lock "refresh_cache-ba7d8a41-5a75-4dca-a192-0177119403be" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 15:58:08 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:58:08 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:58:08 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:58:08 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:58:08 user nova-compute[75337]: DEBUG nova.compute.manager [req-1a9d6df8-9b5b-414e-afe1-04705db4b326 req-297fcbd7-cee0-44fb-9ebb-03c5d77cf6b9 service nova] [instance: ba7d8a41-5a75-4dca-a192-0177119403be] Received event network-vif-plugged-f85d9767-bd59-4182-b18b-a29b13527561 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:58:08 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-1a9d6df8-9b5b-414e-afe1-04705db4b326 req-297fcbd7-cee0-44fb-9ebb-03c5d77cf6b9 service nova] Acquiring lock "ba7d8a41-5a75-4dca-a192-0177119403be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:58:08 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-1a9d6df8-9b5b-414e-afe1-04705db4b326 req-297fcbd7-cee0-44fb-9ebb-03c5d77cf6b9 service nova] Lock "ba7d8a41-5a75-4dca-a192-0177119403be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:58:08 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-1a9d6df8-9b5b-414e-afe1-04705db4b326 req-297fcbd7-cee0-44fb-9ebb-03c5d77cf6b9 service nova] Lock "ba7d8a41-5a75-4dca-a192-0177119403be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:58:08 user nova-compute[75337]: DEBUG nova.compute.manager [req-1a9d6df8-9b5b-414e-afe1-04705db4b326 req-297fcbd7-cee0-44fb-9ebb-03c5d77cf6b9 service nova] [instance: ba7d8a41-5a75-4dca-a192-0177119403be] No waiting events found dispatching network-vif-plugged-f85d9767-bd59-4182-b18b-a29b13527561 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:58:08 user nova-compute[75337]: WARNING nova.compute.manager [req-1a9d6df8-9b5b-414e-afe1-04705db4b326 req-297fcbd7-cee0-44fb-9ebb-03c5d77cf6b9 service nova] [instance: ba7d8a41-5a75-4dca-a192-0177119403be] Received unexpected event network-vif-plugged-f85d9767-bd59-4182-b18b-a29b13527561 for instance with vm_state building and task_state spawning.
Nov 06 15:58:09 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:58:09 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:58:09 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:58:09 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:58:09 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:58:10 user nova-compute[75337]: DEBUG nova.compute.manager [None req-2d4efc80-81e3-4e78-bb8a-c3d7f2a98263 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] [instance: ba7d8a41-5a75-4dca-a192-0177119403be] Instance event wait completed in 0 seconds for  {{(pid=75337) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 15:58:10 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-2d4efc80-81e3-4e78-bb8a-c3d7f2a98263 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] [instance: ba7d8a41-5a75-4dca-a192-0177119403be] Guest created on hypervisor {{(pid=75337) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 15:58:10 user nova-compute[75337]: INFO nova.virt.libvirt.driver [-] [instance: ba7d8a41-5a75-4dca-a192-0177119403be] Instance spawned successfully.
Nov 06 15:58:10 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-2d4efc80-81e3-4e78-bb8a-c3d7f2a98263 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] [instance: ba7d8a41-5a75-4dca-a192-0177119403be] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 15:58:11 user nova-compute[75337]: DEBUG nova.compute.manager [req-637e4427-7d75-45db-a7ee-5d7fd4831931 req-7eee5d94-a7cd-4a10-948f-aaa9b4063c36 service nova] [instance: ba7d8a41-5a75-4dca-a192-0177119403be] Received event network-vif-plugged-f85d9767-bd59-4182-b18b-a29b13527561 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:58:11 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-637e4427-7d75-45db-a7ee-5d7fd4831931 req-7eee5d94-a7cd-4a10-948f-aaa9b4063c36 service nova] Acquiring lock "ba7d8a41-5a75-4dca-a192-0177119403be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:58:11 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-637e4427-7d75-45db-a7ee-5d7fd4831931 req-7eee5d94-a7cd-4a10-948f-aaa9b4063c36 service nova] Lock "ba7d8a41-5a75-4dca-a192-0177119403be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:58:11 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-637e4427-7d75-45db-a7ee-5d7fd4831931 req-7eee5d94-a7cd-4a10-948f-aaa9b4063c36 service nova] Lock "ba7d8a41-5a75-4dca-a192-0177119403be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:58:11 user nova-compute[75337]: DEBUG nova.compute.manager [req-637e4427-7d75-45db-a7ee-5d7fd4831931 req-7eee5d94-a7cd-4a10-948f-aaa9b4063c36 service nova] [instance: ba7d8a41-5a75-4dca-a192-0177119403be] No waiting events found dispatching network-vif-plugged-f85d9767-bd59-4182-b18b-a29b13527561 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:58:11 user nova-compute[75337]: WARNING nova.compute.manager [req-637e4427-7d75-45db-a7ee-5d7fd4831931 req-7eee5d94-a7cd-4a10-948f-aaa9b4063c36 service nova] [instance: ba7d8a41-5a75-4dca-a192-0177119403be] Received unexpected event network-vif-plugged-f85d9767-bd59-4182-b18b-a29b13527561 for instance with vm_state building and task_state spawning.
Nov 06 15:58:11 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-2d4efc80-81e3-4e78-bb8a-c3d7f2a98263 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] [instance: ba7d8a41-5a75-4dca-a192-0177119403be] Found default for hw_cdrom_bus of ide {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:58:11 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-2d4efc80-81e3-4e78-bb8a-c3d7f2a98263 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] [instance: ba7d8a41-5a75-4dca-a192-0177119403be] Found default for hw_disk_bus of virtio {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:58:11 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-2d4efc80-81e3-4e78-bb8a-c3d7f2a98263 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] [instance: ba7d8a41-5a75-4dca-a192-0177119403be] Found default for hw_input_bus of None {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:58:11 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-2d4efc80-81e3-4e78-bb8a-c3d7f2a98263 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] [instance: ba7d8a41-5a75-4dca-a192-0177119403be] Found default for hw_pointer_model of None {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:58:11 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-2d4efc80-81e3-4e78-bb8a-c3d7f2a98263 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] [instance: ba7d8a41-5a75-4dca-a192-0177119403be] Found default for hw_video_model of virtio {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:58:11 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-2d4efc80-81e3-4e78-bb8a-c3d7f2a98263 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] [instance: ba7d8a41-5a75-4dca-a192-0177119403be] Found default for hw_vif_model of virtio {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:58:11 user nova-compute[75337]: INFO nova.compute.manager [None req-2d4efc80-81e3-4e78-bb8a-c3d7f2a98263 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] [instance: ba7d8a41-5a75-4dca-a192-0177119403be] Took 6.01 seconds to spawn the instance on the hypervisor.
Nov 06 15:58:11 user nova-compute[75337]: DEBUG nova.compute.manager [None req-2d4efc80-81e3-4e78-bb8a-c3d7f2a98263 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] [instance: ba7d8a41-5a75-4dca-a192-0177119403be] Checking state {{(pid=75337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 15:58:11 user nova-compute[75337]: INFO nova.compute.manager [None req-2d4efc80-81e3-4e78-bb8a-c3d7f2a98263 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] [instance: ba7d8a41-5a75-4dca-a192-0177119403be] Took 7.44 seconds to build instance.
Nov 06 15:58:11 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-2d4efc80-81e3-4e78-bb8a-c3d7f2a98263 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] Lock "ba7d8a41-5a75-4dca-a192-0177119403be" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.719s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:58:12 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:58:13 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:58:13 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:58:13 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:58:13 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:58:13 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:58:13 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:58:13 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:58:13 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75337) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 15:58:14 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:58:14 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:58:14 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Starting heal instance info cache {{(pid=75337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 15:58:14 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "refresh_cache-d10b4a86-8b0d-423f-81e2-87f5f25a2467" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 15:58:14 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquired lock "refresh_cache-d10b4a86-8b0d-423f-81e2-87f5f25a2467" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 15:58:14 user nova-compute[75337]: DEBUG nova.network.neutron [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] [instance: d10b4a86-8b0d-423f-81e2-87f5f25a2467] Forcefully refreshing network info cache for instance {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 15:58:15 user nova-compute[75337]: DEBUG nova.network.neutron [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] [instance: d10b4a86-8b0d-423f-81e2-87f5f25a2467] Updating instance_info_cache with network_info: [{"id": "f9232e10-c7da-42d1-91c6-d72b0a1e0ccb", "address": "fa:16:3e:93:ab:63", "network": {"id": "c31b513a-57f0-4bd5-b055-4a363aae9793", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1352256985-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cddccc86bf54fe981667da5ef13fa8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9232e10-c7", "ovs_interfaceid": "f9232e10-c7da-42d1-91c6-d72b0a1e0ccb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:58:15 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Releasing lock "refresh_cache-d10b4a86-8b0d-423f-81e2-87f5f25a2467" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 15:58:15 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] [instance: d10b4a86-8b0d-423f-81e2-87f5f25a2467] Updated the network info_cache for instance {{(pid=75337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 15:58:17 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:58:17 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:58:17 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager.update_available_resource {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:58:17 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:58:17 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:58:17 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:58:17 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Auditing locally available compute resources for user (node: user) {{(pid=75337) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 15:58:17 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba7d8a41-5a75-4dca-a192-0177119403be/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:58:17 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba7d8a41-5a75-4dca-a192-0177119403be/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:58:17 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba7d8a41-5a75-4dca-a192-0177119403be/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:58:18 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba7d8a41-5a75-4dca-a192-0177119403be/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:58:18 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69df3824-b28c-43c0-9f20-52fa956642cc/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:58:18 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69df3824-b28c-43c0-9f20-52fa956642cc/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:58:18 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69df3824-b28c-43c0-9f20-52fa956642cc/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:58:18 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69df3824-b28c-43c0-9f20-52fa956642cc/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:58:18 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 15:58:18 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30c634ff-6999-40aa-a90d-1db6d278b571/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:58:18 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30c634ff-6999-40aa-a90d-1db6d278b571/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:58:18 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30c634ff-6999-40aa-a90d-1db6d278b571/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:58:18 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30c634ff-6999-40aa-a90d-1db6d278b571/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:58:19 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 15:58:19 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6110b34a-6fd3-45fc-911d-4e5d3c7f2d78/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:58:19 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6110b34a-6fd3-45fc-911d-4e5d3c7f2d78/disk --force-share --output=json" returned: 0 in 0.262s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:58:19 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6110b34a-6fd3-45fc-911d-4e5d3c7f2d78/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:58:19 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6110b34a-6fd3-45fc-911d-4e5d3c7f2d78/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:58:19 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d10b4a86-8b0d-423f-81e2-87f5f25a2467/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:58:19 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d10b4a86-8b0d-423f-81e2-87f5f25a2467/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:58:19 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d10b4a86-8b0d-423f-81e2-87f5f25a2467/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:58:19 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d10b4a86-8b0d-423f-81e2-87f5f25a2467/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:58:19 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 15:58:19 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f196f2b3-8eac-4d68-af2e-46671c865be1/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:58:20 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f196f2b3-8eac-4d68-af2e-46671c865be1/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:58:20 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f196f2b3-8eac-4d68-af2e-46671c865be1/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:58:20 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f196f2b3-8eac-4d68-af2e-46671c865be1/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:58:20 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 15:58:20 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 15:58:20 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Hypervisor/Node resource view: name=user free_ram=8042MB free_disk=25.091812133789062GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75337) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 15:58:20 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:58:20 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:58:21 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 30c634ff-6999-40aa-a90d-1db6d278b571 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:58:21 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 6110b34a-6fd3-45fc-911d-4e5d3c7f2d78 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:58:21 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance d10b4a86-8b0d-423f-81e2-87f5f25a2467 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:58:21 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 69df3824-b28c-43c0-9f20-52fa956642cc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:58:21 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 5248533a-89b6-444e-a60a-154b3cdef815 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:58:21 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 9a3a0bd3-6c4d-434f-9f6b-7d954f7c163b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:58:21 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance f196f2b3-8eac-4d68-af2e-46671c865be1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:58:21 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance ba7d8a41-5a75-4dca-a192-0177119403be actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:58:21 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 15:58:21 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 15:58:21 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 15:58:21 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 15:58:21 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Compute_service record updated for user:user {{(pid=75337) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 15:58:21 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.469s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:58:22 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:58:24 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:58:27 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:58:29 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:58:31 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-3f291767-7e2f-431f-b570-cf5ca8145e3c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: 5248533a-89b6-444e-a60a-154b3cdef815] Creating instance directory {{(pid=75337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 15:58:31 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-3f291767-7e2f-431f-b570-cf5ca8145e3c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: 5248533a-89b6-444e-a60a-154b3cdef815] Creating image(s)
Nov 06 15:58:31 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-3f291767-7e2f-431f-b570-cf5ca8145e3c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Acquiring lock "/opt/stack/data/nova/instances/5248533a-89b6-444e-a60a-154b3cdef815/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:58:31 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-3f291767-7e2f-431f-b570-cf5ca8145e3c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Lock "/opt/stack/data/nova/instances/5248533a-89b6-444e-a60a-154b3cdef815/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:58:31 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-3f291767-7e2f-431f-b570-cf5ca8145e3c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Lock "/opt/stack/data/nova/instances/5248533a-89b6-444e-a60a-154b3cdef815/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:58:31 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-3f291767-7e2f-431f-b570-cf5ca8145e3c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:58:31 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-3f291767-7e2f-431f-b570-cf5ca8145e3c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json" returned: 0 in 0.208s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:58:31 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-3f291767-7e2f-431f-b570-cf5ca8145e3c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Acquiring lock "06ba3c914798499e686c5ac75886932347225275" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:58:31 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-3f291767-7e2f-431f-b570-cf5ca8145e3c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Lock "06ba3c914798499e686c5ac75886932347225275" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:58:31 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-3f291767-7e2f-431f-b570-cf5ca8145e3c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:58:31 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-3f291767-7e2f-431f-b570-cf5ca8145e3c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json" returned: 0 in 0.190s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:58:31 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-3f291767-7e2f-431f-b570-cf5ca8145e3c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275,backing_fmt=raw /opt/stack/data/nova/instances/5248533a-89b6-444e-a60a-154b3cdef815/disk 1073741824 {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:58:31 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-3f291767-7e2f-431f-b570-cf5ca8145e3c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275,backing_fmt=raw /opt/stack/data/nova/instances/5248533a-89b6-444e-a60a-154b3cdef815/disk 1073741824" returned: 0 in 0.051s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:58:31 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-3f291767-7e2f-431f-b570-cf5ca8145e3c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Lock "06ba3c914798499e686c5ac75886932347225275" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.250s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:58:31 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-3f291767-7e2f-431f-b570-cf5ca8145e3c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:58:31 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-3f291767-7e2f-431f-b570-cf5ca8145e3c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json" returned: 0 in 0.183s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:58:31 user nova-compute[75337]: DEBUG nova.virt.disk.api [None req-3f291767-7e2f-431f-b570-cf5ca8145e3c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5248533a-89b6-444e-a60a-154b3cdef815/disk. size=1073741824 {{(pid=75337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 15:58:31 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-3f291767-7e2f-431f-b570-cf5ca8145e3c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5248533a-89b6-444e-a60a-154b3cdef815/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:58:32 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-3f291767-7e2f-431f-b570-cf5ca8145e3c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5248533a-89b6-444e-a60a-154b3cdef815/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:58:32 user nova-compute[75337]: DEBUG nova.virt.disk.api [None req-3f291767-7e2f-431f-b570-cf5ca8145e3c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Cannot resize image /opt/stack/data/nova/instances/5248533a-89b6-444e-a60a-154b3cdef815/disk to a smaller size. {{(pid=75337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 06 15:58:32 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-3f291767-7e2f-431f-b570-cf5ca8145e3c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: 5248533a-89b6-444e-a60a-154b3cdef815] Created local disks {{(pid=75337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 15:58:32 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-3f291767-7e2f-431f-b570-cf5ca8145e3c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: 5248533a-89b6-444e-a60a-154b3cdef815] Ensure instance console log exists: /opt/stack/data/nova/instances/5248533a-89b6-444e-a60a-154b3cdef815/console.log {{(pid=75337) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 15:58:32 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-3f291767-7e2f-431f-b570-cf5ca8145e3c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:58:32 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-3f291767-7e2f-431f-b570-cf5ca8145e3c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:58:32 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-3f291767-7e2f-431f-b570-cf5ca8145e3c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:58:32 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-3f291767-7e2f-431f-b570-cf5ca8145e3c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: 5248533a-89b6-444e-a60a-154b3cdef815] Start _get_guest_xml network_info=[{"id": "007682c6-c911-4171-b66e-173d248356cb", "address": "fa:16:3e:da:b1:68", "network": {"id": "7f234ecf-bfa6-4316-9dce-c15050ba7914", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1378707892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "243647103fd44f629e0f40be0b56407e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap007682c6-c9", "ovs_interfaceid": "007682c6-c911-4171-b66e-173d248356cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T15:34:14Z,direct_url=<?>,disk_format='qcow2',id=16b903ae-a40f-41a7-985b-4804cce92c62,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6549a15819f1469bbd5eeae8190e3d44',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T15:34:15Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'guest_format': None, 'size': 0, 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '16b903ae-a40f-41a7-985b-4804cce92c62'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'attachment_id': '4c7846b8-cd03-4109-91ec-e6c6206116af', 'guest_format': None, 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WAXrmtZf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5248533a-89b6-444e-a60a-154b3cdef815', 'attached_at': '', 'detached_at': '', 'volume_id': 'b702cb69-9f60-445c-a874-5abf6142bbb8', 'serial': 'b702cb69-9f60-445c-a874-5abf6142bbb8'}, 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=75337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 15:58:32 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-3f291767-7e2f-431f-b570-cf5ca8145e3c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 06 15:58:32 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-3f291767-7e2f-431f-b570-cf5ca8145e3c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 06 15:58:32 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-3f291767-7e2f-431f-b570-cf5ca8145e3c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 15:58:32 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-3f291767-7e2f-431f-b570-cf5ca8145e3c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] CPU controller missing on host. {{(pid=75337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 15:58:32 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-3f291767-7e2f-431f-b570-cf5ca8145e3c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 15:58:32 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-3f291767-7e2f-431f-b570-cf5ca8145e3c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] CPU controller found on host. {{(pid=75337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 15:58:32 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-3f291767-7e2f-431f-b570-cf5ca8145e3c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75337) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 15:58:32 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-3f291767-7e2f-431f-b570-cf5ca8145e3c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T15:34:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T15:34:14Z,direct_url=<?>,disk_format='qcow2',id=16b903ae-a40f-41a7-985b-4804cce92c62,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6549a15819f1469bbd5eeae8190e3d44',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T15:34:15Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 15:58:32 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-3f291767-7e2f-431f-b570-cf5ca8145e3c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Flavor limits 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 15:58:32 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-3f291767-7e2f-431f-b570-cf5ca8145e3c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Image limits 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 15:58:32 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-3f291767-7e2f-431f-b570-cf5ca8145e3c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Flavor pref 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 15:58:32 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-3f291767-7e2f-431f-b570-cf5ca8145e3c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Image pref 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 15:58:32 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-3f291767-7e2f-431f-b570-cf5ca8145e3c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 15:58:32 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-3f291767-7e2f-431f-b570-cf5ca8145e3c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 15:58:32 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-3f291767-7e2f-431f-b570-cf5ca8145e3c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 15:58:32 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-3f291767-7e2f-431f-b570-cf5ca8145e3c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Got 1 possible topologies {{(pid=75337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 15:58:32 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-3f291767-7e2f-431f-b570-cf5ca8145e3c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 15:58:32 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-3f291767-7e2f-431f-b570-cf5ca8145e3c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 15:58:32 user nova-compute[75337]: DEBUG nova.objects.instance [None req-3f291767-7e2f-431f-b570-cf5ca8145e3c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Lazy-loading 'vcpu_model' on Instance uuid 5248533a-89b6-444e-a60a-154b3cdef815 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 15:58:32 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f291767-7e2f-431f-b570-cf5ca8145e3c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: 5248533a-89b6-444e-a60a-154b3cdef815] Calling os-brick to attach iSCSI Volume {{(pid=75337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 15:58:32 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f291767-7e2f-431f-b570-cf5ca8145e3c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2abc33d0c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WAXrmtZf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 15:58:32 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-3f291767-7e2f-431f-b570-cf5ca8145e3c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 06 15:58:32 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-3f291767-7e2f-431f-b570-cf5ca8145e3c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 15:58:32 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-3f291767-7e2f-431f-b570-cf5ca8145e3c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 15:58:32 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-3f291767-7e2f-431f-b570-cf5ca8145e3c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 06 15:58:32 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-3f291767-7e2f-431f-b570-cf5ca8145e3c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 15:58:32 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-3f291767-7e2f-431f-b570-cf5ca8145e3c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 15:58:32 user nova-compute[75337]: INFO os_brick.initiator.connectors.iscsi [None req-3f291767-7e2f-431f-b570-cf5ca8145e3c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 15:58:32 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8 -p 172.16.0.220:3260 {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:58:32 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:58:32 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:58:32 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[318d0abc-0439-4939-b9cd-06078b65f66f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:58:32 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f291767-7e2f-431f-b570-cf5ca8145e3c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 15:58:32 user nova-compute[75337]:  {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:58:32 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8 -p 172.16.0.220:3260 --interface default --op new {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:58:32 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:58:32 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[93aa0560-11b2-4268-ab10-6f2709cd2014]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8] added\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:58:32 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f291767-7e2f-431f-b570-cf5ca8145e3c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8] added
Nov 06 15:58:32 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:58:32 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:58:32 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:58:32 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[c28cd762-5f79-4b6f-9871-22343b7b162a]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:58:32 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f291767-7e2f-431f-b570-cf5ca8145e3c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:58:32 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:58:32 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:58:32 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[b10e16ae-be78-4178-a09d-ef8aa7971b80]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:58:32 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f291767-7e2f-431f-b570-cf5ca8145e3c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:58:32 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WAXrmtZf {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:58:32 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WAXrmtZf" returned: 0 in 0.026s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:58:32 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[035fe441-6268-4b52-8df9-8069e55958aa]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:58:32 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f291767-7e2f-431f-b570-cf5ca8145e3c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WAXrmtZf'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:58:32 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:58:32 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:58:32 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[76286e65-5a50-48e8-841e-99681cbb53e0]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:58:32 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f291767-7e2f-431f-b570-cf5ca8145e3c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:58:32 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:58:32 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:58:32 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a7c68e3-2c15-4bf9-9fa8-71feb4d1701a]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326a132a-07d4-4085-8da9-ffa8444121b5 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da (non-flash)\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:58:32 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f291767-7e2f-431f-b570-cf5ca8145e3c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326a132a-07d4-4085-8da9-ffa8444121b5 (non-flash)
Nov 06 15:58:32 user nova-compute[75337]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673 (non-flash)
Nov 06 15:58:32 user nova-compute[75337]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da (non-flash)
Nov 06 15:58:32 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 15:58:32 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f291767-7e2f-431f-b570-cf5ca8145e3c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326a132a-07d4-4085-8da9-ffa8444121b5 (non-flash)
Nov 06 15:58:32 user nova-compute[75337]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673 (non-flash)
Nov 06 15:58:32 user nova-compute[75337]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da (non-flash)
Nov 06 15:58:32 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 15:58:32 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8 -p 172.16.0.220:3260 --login {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:58:32 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:58:32 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ec3131a-76a6-4399-98fe-f86d91292fcf]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:58:32 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f291767-7e2f-431f-b570-cf5ca8145e3c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8, portal: 172.16.0.220,3260]
Nov 06 15:58:32 user nova-compute[75337]: Login to [iface: default, target: iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8, portal: 172.16.0.220,3260] successful.
Nov 06 15:58:32 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:58:32 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:58:32 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:58:32 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe91388e-4eb7-41d9-8aea-0a77acf5d2a2]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:58:32 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f291767-7e2f-431f-b570-cf5ca8145e3c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:58:32 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:58:32 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:58:32 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[76321884-cb6b-49a3-836d-81a8a8b93900]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326a132a-07d4-4085-8da9-ffa8444121b5 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8 (non-flash)\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:58:32 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f291767-7e2f-431f-b570-cf5ca8145e3c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326a132a-07d4-4085-8da9-ffa8444121b5 (non-flash)
Nov 06 15:58:32 user nova-compute[75337]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673 (non-flash)
Nov 06 15:58:32 user nova-compute[75337]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da (non-flash)
Nov 06 15:58:32 user nova-compute[75337]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8 (non-flash)
Nov 06 15:58:32 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 15:58:32 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f291767-7e2f-431f-b570-cf5ca8145e3c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326a132a-07d4-4085-8da9-ffa8444121b5 (non-flash)
Nov 06 15:58:32 user nova-compute[75337]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673 (non-flash)
Nov 06 15:58:32 user nova-compute[75337]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da (non-flash)
Nov 06 15:58:32 user nova-compute[75337]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8 (non-flash)
Nov 06 15:58:32 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 15:58:32 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-3f291767-7e2f-431f-b570-cf5ca8145e3c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.293s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 15:58:32 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f291767-7e2f-431f-b570-cf5ca8145e3c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Connected to 172.16.0.220:3260 {{(pid=75337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 15:58:32 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-3f291767-7e2f-431f-b570-cf5ca8145e3c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] HCTL ('36', '-', '-', 0) found on session 38 with lun 0 {{(pid=75337) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 15:58:32 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-3f291767-7e2f-431f-b570-cf5ca8145e3c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75337) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 15:58:32 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:58:32 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.023s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:58:32 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[b807d29c-3a43-4586-8ad0-d9cd7209079b]: (4, ('- - 0', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:58:32 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-3f291767-7e2f-431f-b570-cf5ca8145e3c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Searching for a device in session 38 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75337) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 15:58:32 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f291767-7e2f-431f-b570-cf5ca8145e3c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WAXrmtZf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 15:58:33 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-3f291767-7e2f-431f-b570-cf5ca8145e3c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.331s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 15:58:33 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f291767-7e2f-431f-b570-cf5ca8145e3c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] <== connect_volume: return (1333ms) {'type': 'block', 'scsi_wwn': '23365333438626331', 'path': '/dev/sde'} {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 15:58:33 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f291767-7e2f-431f-b570-cf5ca8145e3c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: 5248533a-89b6-444e-a60a-154b3cdef815] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23365333438626331', 'path': '/dev/sde'} {{(pid=75337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 15:58:33 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-3f291767-7e2f-431f-b570-cf5ca8145e3c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-06T15:55:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1506958454',display_name='tempest-ServerActionsTestOtherA-server-1915006086',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1506958454',id=33,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLLnBW4cDmEWGvvuTCYhgrjSwFeqdq9waFtK0/DRy6vZoehwGRDhsJbCJYWh2vj1zBgwLRqt7KS/TJeEYcini420vHoht0MKs0aDV1+OjULyGrj+Hbr6Qd4OdWLs+79ciw==',key_name='tempest-keypair-45200428',keypairs=<?>,launch_index=0,launched_at=2023-11-06T15:55:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='243647103fd44f629e0f40be0b56407e',ramdisk_id='',reservation_id='r-8xtee88d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-783619975',owner_user_name='tempest-ServerActionsTestOtherA-783619975-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T15:58:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2e47bf9ad49645deb2c1f834938fa39f',uuid=5248533a-89b6-444e-a60a-154b3cdef815,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "007682c6-c911-4171-b66e-173d248356cb", "address": "fa:16:3e:da:b1:68", "network": {"id": "7f234ecf-bfa6-4316-9dce-c15050ba7914", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1378707892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "243647103fd44f629e0f40be0b56407e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap007682c6-c9", "ovs_interfaceid": "007682c6-c911-4171-b66e-173d248356cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75337) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 15:58:33 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-3f291767-7e2f-431f-b570-cf5ca8145e3c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Converting VIF {"id": "007682c6-c911-4171-b66e-173d248356cb", "address": "fa:16:3e:da:b1:68", "network": {"id": "7f234ecf-bfa6-4316-9dce-c15050ba7914", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1378707892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "243647103fd44f629e0f40be0b56407e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap007682c6-c9", "ovs_interfaceid": "007682c6-c911-4171-b66e-173d248356cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 15:58:33 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-3f291767-7e2f-431f-b570-cf5ca8145e3c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:da:b1:68,bridge_name='br-int',has_traffic_filtering=True,id=007682c6-c911-4171-b66e-173d248356cb,network=Network(7f234ecf-bfa6-4316-9dce-c15050ba7914),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap007682c6-c9') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 15:58:33 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-3f291767-7e2f-431f-b570-cf5ca8145e3c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: 5248533a-89b6-444e-a60a-154b3cdef815] End _get_guest_xml xml=<domain type="kvm">
Nov 06 15:58:33 user nova-compute[75337]:   <uuid>5248533a-89b6-444e-a60a-154b3cdef815</uuid>
Nov 06 15:58:33 user nova-compute[75337]:   <name>instance-00000021</name>
Nov 06 15:58:33 user nova-compute[75337]:   <memory>524288</memory>
Nov 06 15:58:33 user nova-compute[75337]:   <vcpu>1</vcpu>
Nov 06 15:58:33 user nova-compute[75337]:   <metadata>
Nov 06 15:58:33 user nova-compute[75337]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 15:58:33 user nova-compute[75337]:       <nova:package version="0.0.0"/>
Nov 06 15:58:33 user nova-compute[75337]:       <nova:name>tempest-ServerActionsTestOtherA-server-1915006086</nova:name>
Nov 06 15:58:33 user nova-compute[75337]:       <nova:creationTime>2023-11-06 15:58:32</nova:creationTime>
Nov 06 15:58:33 user nova-compute[75337]:       <nova:flavor name="m1.tiny">
Nov 06 15:58:33 user nova-compute[75337]:         <nova:memory>512</nova:memory>
Nov 06 15:58:33 user nova-compute[75337]:         <nova:disk>1</nova:disk>
Nov 06 15:58:33 user nova-compute[75337]:         <nova:swap>0</nova:swap>
Nov 06 15:58:33 user nova-compute[75337]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 15:58:33 user nova-compute[75337]:         <nova:vcpus>1</nova:vcpus>
Nov 06 15:58:33 user nova-compute[75337]:       </nova:flavor>
Nov 06 15:58:33 user nova-compute[75337]:       <nova:owner>
Nov 06 15:58:33 user nova-compute[75337]:         <nova:user uuid="2e47bf9ad49645deb2c1f834938fa39f">tempest-ServerActionsTestOtherA-783619975-project-member</nova:user>
Nov 06 15:58:33 user nova-compute[75337]:         <nova:project uuid="243647103fd44f629e0f40be0b56407e">tempest-ServerActionsTestOtherA-783619975</nova:project>
Nov 06 15:58:33 user nova-compute[75337]:       </nova:owner>
Nov 06 15:58:33 user nova-compute[75337]:       <nova:root type="image" uuid="16b903ae-a40f-41a7-985b-4804cce92c62"/>
Nov 06 15:58:33 user nova-compute[75337]:       <nova:ports>
Nov 06 15:58:33 user nova-compute[75337]:         <nova:port uuid="007682c6-c911-4171-b66e-173d248356cb">
Nov 06 15:58:33 user nova-compute[75337]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 06 15:58:33 user nova-compute[75337]:         </nova:port>
Nov 06 15:58:33 user nova-compute[75337]:       </nova:ports>
Nov 06 15:58:33 user nova-compute[75337]:     </nova:instance>
Nov 06 15:58:33 user nova-compute[75337]:   </metadata>
Nov 06 15:58:33 user nova-compute[75337]:   <sysinfo type="smbios">
Nov 06 15:58:33 user nova-compute[75337]:     <system>
Nov 06 15:58:33 user nova-compute[75337]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 15:58:33 user nova-compute[75337]:       <entry name="product">OpenStack Nova</entry>
Nov 06 15:58:33 user nova-compute[75337]:       <entry name="version">0.0.0</entry>
Nov 06 15:58:33 user nova-compute[75337]:       <entry name="serial">5248533a-89b6-444e-a60a-154b3cdef815</entry>
Nov 06 15:58:33 user nova-compute[75337]:       <entry name="uuid">5248533a-89b6-444e-a60a-154b3cdef815</entry>
Nov 06 15:58:33 user nova-compute[75337]:       <entry name="family">Virtual Machine</entry>
Nov 06 15:58:33 user nova-compute[75337]:     </system>
Nov 06 15:58:33 user nova-compute[75337]:   </sysinfo>
Nov 06 15:58:33 user nova-compute[75337]:   <os>
Nov 06 15:58:33 user nova-compute[75337]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 15:58:33 user nova-compute[75337]:     <boot dev="hd"/>
Nov 06 15:58:33 user nova-compute[75337]:     <smbios mode="sysinfo"/>
Nov 06 15:58:33 user nova-compute[75337]:   </os>
Nov 06 15:58:33 user nova-compute[75337]:   <features>
Nov 06 15:58:33 user nova-compute[75337]:     <acpi/>
Nov 06 15:58:33 user nova-compute[75337]:     <apic/>
Nov 06 15:58:33 user nova-compute[75337]:     <vmcoreinfo/>
Nov 06 15:58:33 user nova-compute[75337]:   </features>
Nov 06 15:58:33 user nova-compute[75337]:   <clock offset="utc">
Nov 06 15:58:33 user nova-compute[75337]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 15:58:33 user nova-compute[75337]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 15:58:33 user nova-compute[75337]:     <timer name="hpet" present="no"/>
Nov 06 15:58:33 user nova-compute[75337]:   </clock>
Nov 06 15:58:33 user nova-compute[75337]:   <cpu mode="custom" match="exact">
Nov 06 15:58:33 user nova-compute[75337]:     <model>Nehalem</model>
Nov 06 15:58:33 user nova-compute[75337]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 15:58:33 user nova-compute[75337]:   </cpu>
Nov 06 15:58:33 user nova-compute[75337]:   <devices>
Nov 06 15:58:33 user nova-compute[75337]:     <disk type="file" device="disk">
Nov 06 15:58:33 user nova-compute[75337]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 15:58:33 user nova-compute[75337]:       <source file="/opt/stack/data/nova/instances/5248533a-89b6-444e-a60a-154b3cdef815/disk"/>
Nov 06 15:58:33 user nova-compute[75337]:       <target dev="vda" bus="virtio"/>
Nov 06 15:58:33 user nova-compute[75337]:     </disk>
Nov 06 15:58:33 user nova-compute[75337]:     <disk type="block" device="disk">
Nov 06 15:58:33 user nova-compute[75337]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 15:58:33 user nova-compute[75337]:       <source dev="/dev/sde"/>
Nov 06 15:58:33 user nova-compute[75337]:       <target dev="vdb" bus="virtio"/>
Nov 06 15:58:33 user nova-compute[75337]:       <serial>b702cb69-9f60-445c-a874-5abf6142bbb8</serial>
Nov 06 15:58:33 user nova-compute[75337]:     </disk>
Nov 06 15:58:33 user nova-compute[75337]:     <interface type="ethernet">
Nov 06 15:58:33 user nova-compute[75337]:       <mac address="fa:16:3e:da:b1:68"/>
Nov 06 15:58:33 user nova-compute[75337]:       <model type="virtio"/>
Nov 06 15:58:33 user nova-compute[75337]:       <mtu size="1442"/>
Nov 06 15:58:33 user nova-compute[75337]:       <target dev="tap007682c6-c9"/>
Nov 06 15:58:33 user nova-compute[75337]:     </interface>
Nov 06 15:58:33 user nova-compute[75337]:     <serial type="pty">
Nov 06 15:58:33 user nova-compute[75337]:       <log file="/opt/stack/data/nova/instances/5248533a-89b6-444e-a60a-154b3cdef815/console.log" append="off"/>
Nov 06 15:58:33 user nova-compute[75337]:     </serial>
Nov 06 15:58:33 user nova-compute[75337]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 15:58:33 user nova-compute[75337]:     <video>
Nov 06 15:58:33 user nova-compute[75337]:       <model type="virtio"/>
Nov 06 15:58:33 user nova-compute[75337]:     </video>
Nov 06 15:58:33 user nova-compute[75337]:     <rng model="virtio">
Nov 06 15:58:33 user nova-compute[75337]:       <backend model="random">/dev/urandom</backend>
Nov 06 15:58:33 user nova-compute[75337]:     </rng>
Nov 06 15:58:33 user nova-compute[75337]:     <controller type="usb" index="0" model="none"/>
Nov 06 15:58:33 user nova-compute[75337]:     <memballoon model="virtio">
Nov 06 15:58:33 user nova-compute[75337]:       <stats period="10"/>
Nov 06 15:58:33 user nova-compute[75337]:     </memballoon>
Nov 06 15:58:33 user nova-compute[75337]:   </devices>
Nov 06 15:58:33 user nova-compute[75337]: </domain>
Nov 06 15:58:33 user nova-compute[75337]:  {{(pid=75337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 15:58:33 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-3f291767-7e2f-431f-b570-cf5ca8145e3c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-06T15:55:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1506958454',display_name='tempest-ServerActionsTestOtherA-server-1915006086',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1506958454',id=33,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLLnBW4cDmEWGvvuTCYhgrjSwFeqdq9waFtK0/DRy6vZoehwGRDhsJbCJYWh2vj1zBgwLRqt7KS/TJeEYcini420vHoht0MKs0aDV1+OjULyGrj+Hbr6Qd4OdWLs+79ciw==',key_name='tempest-keypair-45200428',keypairs=<?>,launch_index=0,launched_at=2023-11-06T15:55:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='243647103fd44f629e0f40be0b56407e',ramdisk_id='',reservation_id='r-8xtee88d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-783619975',owner_user_name='tempest-ServerActionsTestOtherA-783619975-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T15:58:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2e47bf9ad49645deb2c1f834938fa39f',uuid=5248533a-89b6-444e-a60a-154b3cdef815,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "007682c6-c911-4171-b66e-173d248356cb", "address": "fa:16:3e:da:b1:68", "network": {"id": "7f234ecf-bfa6-4316-9dce-c15050ba7914", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1378707892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "243647103fd44f629e0f40be0b56407e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap007682c6-c9", "ovs_interfaceid": "007682c6-c911-4171-b66e-173d248356cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 15:58:33 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-3f291767-7e2f-431f-b570-cf5ca8145e3c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Converting VIF {"id": "007682c6-c911-4171-b66e-173d248356cb", "address": "fa:16:3e:da:b1:68", "network": {"id": "7f234ecf-bfa6-4316-9dce-c15050ba7914", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1378707892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "243647103fd44f629e0f40be0b56407e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap007682c6-c9", "ovs_interfaceid": "007682c6-c911-4171-b66e-173d248356cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 15:58:33 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-3f291767-7e2f-431f-b570-cf5ca8145e3c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:da:b1:68,bridge_name='br-int',has_traffic_filtering=True,id=007682c6-c911-4171-b66e-173d248356cb,network=Network(7f234ecf-bfa6-4316-9dce-c15050ba7914),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap007682c6-c9') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 15:58:33 user nova-compute[75337]: DEBUG os_vif [None req-3f291767-7e2f-431f-b570-cf5ca8145e3c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:da:b1:68,bridge_name='br-int',has_traffic_filtering=True,id=007682c6-c911-4171-b66e-173d248356cb,network=Network(7f234ecf-bfa6-4316-9dce-c15050ba7914),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap007682c6-c9') {{(pid=75337) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 15:58:33 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:58:33 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:58:33 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 15:58:33 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:58:33 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '711fc6b3-c2cf-57ca-96d2-a835288f58f0', '_type': 'linux-noop'}}, row=False) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:58:33 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:58:33 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:58:33 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:58:33 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:58:33 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap007682c6-c9, may_exist=True, interface_attrs={}) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:58:33 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap007682c6-c9, col_values=(('qos', UUID('fded3426-4452-49ba-bb99-38c86fe5e0d3')),), if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:58:33 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap007682c6-c9, col_values=(('external_ids', {'iface-id': '007682c6-c911-4171-b66e-173d248356cb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:da:b1:68', 'vm-uuid': '5248533a-89b6-444e-a60a-154b3cdef815'}),), if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:58:33 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:58:33 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:58:33 user nova-compute[75337]: INFO os_vif [None req-3f291767-7e2f-431f-b570-cf5ca8145e3c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:da:b1:68,bridge_name='br-int',has_traffic_filtering=True,id=007682c6-c911-4171-b66e-173d248356cb,network=Network(7f234ecf-bfa6-4316-9dce-c15050ba7914),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap007682c6-c9')
Nov 06 15:58:33 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-3f291767-7e2f-431f-b570-cf5ca8145e3c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] No BDM found with device name vda, not building metadata. {{(pid=75337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 15:58:33 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-3f291767-7e2f-431f-b570-cf5ca8145e3c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 15:58:33 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-3f291767-7e2f-431f-b570-cf5ca8145e3c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] No VIF found with MAC fa:16:3e:da:b1:68, not building metadata {{(pid=75337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 15:58:34 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:58:35 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:58:35 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:58:35 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:58:35 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:58:35 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:58:35 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:58:35 user nova-compute[75337]: DEBUG nova.compute.manager [req-2110c324-2c5b-4fd0-b7a7-2c74baeb79ee req-7893c18d-39a5-4e24-bded-75ea86cb344d service nova] [instance: 5248533a-89b6-444e-a60a-154b3cdef815] Received event network-vif-plugged-007682c6-c911-4171-b66e-173d248356cb {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:58:35 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-2110c324-2c5b-4fd0-b7a7-2c74baeb79ee req-7893c18d-39a5-4e24-bded-75ea86cb344d service nova] Acquiring lock "5248533a-89b6-444e-a60a-154b3cdef815-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:58:35 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-2110c324-2c5b-4fd0-b7a7-2c74baeb79ee req-7893c18d-39a5-4e24-bded-75ea86cb344d service nova] Lock "5248533a-89b6-444e-a60a-154b3cdef815-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:58:35 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-2110c324-2c5b-4fd0-b7a7-2c74baeb79ee req-7893c18d-39a5-4e24-bded-75ea86cb344d service nova] Lock "5248533a-89b6-444e-a60a-154b3cdef815-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:58:35 user nova-compute[75337]: DEBUG nova.compute.manager [req-2110c324-2c5b-4fd0-b7a7-2c74baeb79ee req-7893c18d-39a5-4e24-bded-75ea86cb344d service nova] [instance: 5248533a-89b6-444e-a60a-154b3cdef815] No waiting events found dispatching network-vif-plugged-007682c6-c911-4171-b66e-173d248356cb {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:58:35 user nova-compute[75337]: WARNING nova.compute.manager [req-2110c324-2c5b-4fd0-b7a7-2c74baeb79ee req-7893c18d-39a5-4e24-bded-75ea86cb344d service nova] [instance: 5248533a-89b6-444e-a60a-154b3cdef815] Received unexpected event network-vif-plugged-007682c6-c911-4171-b66e-173d248356cb for instance with vm_state active and task_state rebuild_spawning.
Nov 06 15:58:36 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:58:37 user nova-compute[75337]: DEBUG nova.compute.manager [None req-3f291767-7e2f-431f-b570-cf5ca8145e3c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: 5248533a-89b6-444e-a60a-154b3cdef815] Instance event wait completed in 0 seconds for  {{(pid=75337) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 15:58:37 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-3f291767-7e2f-431f-b570-cf5ca8145e3c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: 5248533a-89b6-444e-a60a-154b3cdef815] Guest created on hypervisor {{(pid=75337) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 15:58:37 user nova-compute[75337]: INFO nova.virt.libvirt.driver [-] [instance: 5248533a-89b6-444e-a60a-154b3cdef815] Instance spawned successfully.
Nov 06 15:58:37 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-3f291767-7e2f-431f-b570-cf5ca8145e3c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: 5248533a-89b6-444e-a60a-154b3cdef815] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 15:58:37 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-3f291767-7e2f-431f-b570-cf5ca8145e3c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: 5248533a-89b6-444e-a60a-154b3cdef815] Found default for hw_cdrom_bus of ide {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:58:37 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-3f291767-7e2f-431f-b570-cf5ca8145e3c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: 5248533a-89b6-444e-a60a-154b3cdef815] Found default for hw_disk_bus of virtio {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:58:37 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-3f291767-7e2f-431f-b570-cf5ca8145e3c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: 5248533a-89b6-444e-a60a-154b3cdef815] Found default for hw_input_bus of None {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:58:37 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-3f291767-7e2f-431f-b570-cf5ca8145e3c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: 5248533a-89b6-444e-a60a-154b3cdef815] Found default for hw_pointer_model of None {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:58:37 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-3f291767-7e2f-431f-b570-cf5ca8145e3c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: 5248533a-89b6-444e-a60a-154b3cdef815] Found default for hw_video_model of virtio {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:58:37 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-3f291767-7e2f-431f-b570-cf5ca8145e3c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: 5248533a-89b6-444e-a60a-154b3cdef815] Found default for hw_vif_model of virtio {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:58:37 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:58:37 user nova-compute[75337]: DEBUG nova.compute.manager [req-12c0e2de-8f86-42ac-a27d-1f0934fb6d6c req-f3ed8fba-2896-4fea-89c8-6580f44dae36 service nova] [instance: 5248533a-89b6-444e-a60a-154b3cdef815] Received event network-vif-plugged-007682c6-c911-4171-b66e-173d248356cb {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:58:37 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-12c0e2de-8f86-42ac-a27d-1f0934fb6d6c req-f3ed8fba-2896-4fea-89c8-6580f44dae36 service nova] Acquiring lock "5248533a-89b6-444e-a60a-154b3cdef815-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:58:37 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-12c0e2de-8f86-42ac-a27d-1f0934fb6d6c req-f3ed8fba-2896-4fea-89c8-6580f44dae36 service nova] Lock "5248533a-89b6-444e-a60a-154b3cdef815-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:58:37 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-12c0e2de-8f86-42ac-a27d-1f0934fb6d6c req-f3ed8fba-2896-4fea-89c8-6580f44dae36 service nova] Lock "5248533a-89b6-444e-a60a-154b3cdef815-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:58:37 user nova-compute[75337]: DEBUG nova.compute.manager [req-12c0e2de-8f86-42ac-a27d-1f0934fb6d6c req-f3ed8fba-2896-4fea-89c8-6580f44dae36 service nova] [instance: 5248533a-89b6-444e-a60a-154b3cdef815] No waiting events found dispatching network-vif-plugged-007682c6-c911-4171-b66e-173d248356cb {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:58:37 user nova-compute[75337]: WARNING nova.compute.manager [req-12c0e2de-8f86-42ac-a27d-1f0934fb6d6c req-f3ed8fba-2896-4fea-89c8-6580f44dae36 service nova] [instance: 5248533a-89b6-444e-a60a-154b3cdef815] Received unexpected event network-vif-plugged-007682c6-c911-4171-b66e-173d248356cb for instance with vm_state active and task_state rebuild_spawning.
Nov 06 15:58:37 user nova-compute[75337]: DEBUG nova.compute.manager [None req-3f291767-7e2f-431f-b570-cf5ca8145e3c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: 5248533a-89b6-444e-a60a-154b3cdef815] Checking state {{(pid=75337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 15:58:37 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-3f291767-7e2f-431f-b570-cf5ca8145e3c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:58:37 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-3f291767-7e2f-431f-b570-cf5ca8145e3c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:58:37 user nova-compute[75337]: DEBUG nova.objects.instance [None req-3f291767-7e2f-431f-b570-cf5ca8145e3c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: 5248533a-89b6-444e-a60a-154b3cdef815] Trying to apply a migration context that does not seem to be set for this instance {{(pid=75337) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 06 15:58:37 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-3f291767-7e2f-431f-b570-cf5ca8145e3c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.096s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:58:38 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:58:39 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:58:40 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:58:43 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:58:43 user nova-compute[75337]: DEBUG nova.compute.manager [req-e90b50b0-92b2-483e-94bc-e8effef28579 req-d784ea84-69b1-4068-9c6b-6d2f929803bb service nova] [instance: 9a3a0bd3-6c4d-434f-9f6b-7d954f7c163b] Received event network-changed-733c74d6-103a-491b-b443-9b2fe9ceb5f3 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:58:43 user nova-compute[75337]: DEBUG nova.compute.manager [req-e90b50b0-92b2-483e-94bc-e8effef28579 req-d784ea84-69b1-4068-9c6b-6d2f929803bb service nova] [instance: 9a3a0bd3-6c4d-434f-9f6b-7d954f7c163b] Refreshing instance network info cache due to event network-changed-733c74d6-103a-491b-b443-9b2fe9ceb5f3. {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 15:58:43 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-e90b50b0-92b2-483e-94bc-e8effef28579 req-d784ea84-69b1-4068-9c6b-6d2f929803bb service nova] Acquiring lock "refresh_cache-9a3a0bd3-6c4d-434f-9f6b-7d954f7c163b" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 15:58:43 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-e90b50b0-92b2-483e-94bc-e8effef28579 req-d784ea84-69b1-4068-9c6b-6d2f929803bb service nova] Acquired lock "refresh_cache-9a3a0bd3-6c4d-434f-9f6b-7d954f7c163b" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 15:58:43 user nova-compute[75337]: DEBUG nova.network.neutron [req-e90b50b0-92b2-483e-94bc-e8effef28579 req-d784ea84-69b1-4068-9c6b-6d2f929803bb service nova] [instance: 9a3a0bd3-6c4d-434f-9f6b-7d954f7c163b] Refreshing network info cache for port 733c74d6-103a-491b-b443-9b2fe9ceb5f3 {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 15:58:44 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:58:44 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:58:44 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-96afe873-adff-400b-b903-d99e3740062e tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Acquiring lock "9a3a0bd3-6c4d-434f-9f6b-7d954f7c163b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:58:44 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-96afe873-adff-400b-b903-d99e3740062e tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Lock "9a3a0bd3-6c4d-434f-9f6b-7d954f7c163b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:58:44 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-96afe873-adff-400b-b903-d99e3740062e tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Acquiring lock "9a3a0bd3-6c4d-434f-9f6b-7d954f7c163b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:58:44 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-96afe873-adff-400b-b903-d99e3740062e tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Lock "9a3a0bd3-6c4d-434f-9f6b-7d954f7c163b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:58:44 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-96afe873-adff-400b-b903-d99e3740062e tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Lock "9a3a0bd3-6c4d-434f-9f6b-7d954f7c163b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:58:44 user nova-compute[75337]: INFO nova.compute.manager [None req-96afe873-adff-400b-b903-d99e3740062e tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 9a3a0bd3-6c4d-434f-9f6b-7d954f7c163b] Terminating instance
Nov 06 15:58:44 user nova-compute[75337]: DEBUG nova.compute.manager [None req-96afe873-adff-400b-b903-d99e3740062e tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 9a3a0bd3-6c4d-434f-9f6b-7d954f7c163b] Start destroying the instance on the hypervisor. {{(pid=75337) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 15:58:44 user nova-compute[75337]: DEBUG nova.network.neutron [req-e90b50b0-92b2-483e-94bc-e8effef28579 req-d784ea84-69b1-4068-9c6b-6d2f929803bb service nova] [instance: 9a3a0bd3-6c4d-434f-9f6b-7d954f7c163b] Updated VIF entry in instance network info cache for port 733c74d6-103a-491b-b443-9b2fe9ceb5f3. {{(pid=75337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 15:58:44 user nova-compute[75337]: DEBUG nova.network.neutron [req-e90b50b0-92b2-483e-94bc-e8effef28579 req-d784ea84-69b1-4068-9c6b-6d2f929803bb service nova] [instance: 9a3a0bd3-6c4d-434f-9f6b-7d954f7c163b] Updating instance_info_cache with network_info: [{"id": "733c74d6-103a-491b-b443-9b2fe9ceb5f3", "address": "fa:16:3e:3d:e8:fb", "network": {"id": "4e47319f-de1d-4dfe-9915-7d2d5131704d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-895093240-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "915211c6a2734c36b34ff92a56b085f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap733c74d6-10", "ovs_interfaceid": "733c74d6-103a-491b-b443-9b2fe9ceb5f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:58:44 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:58:44 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-e90b50b0-92b2-483e-94bc-e8effef28579 req-d784ea84-69b1-4068-9c6b-6d2f929803bb service nova] Releasing lock "refresh_cache-9a3a0bd3-6c4d-434f-9f6b-7d954f7c163b" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 15:58:44 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:58:44 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:58:44 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:58:45 user nova-compute[75337]: INFO nova.virt.libvirt.driver [-] [instance: 9a3a0bd3-6c4d-434f-9f6b-7d954f7c163b] Instance destroyed successfully.
Nov 06 15:58:45 user nova-compute[75337]: DEBUG nova.objects.instance [None req-96afe873-adff-400b-b903-d99e3740062e tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Lazy-loading 'resources' on Instance uuid 9a3a0bd3-6c4d-434f-9f6b-7d954f7c163b {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 15:58:45 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-96afe873-adff-400b-b903-d99e3740062e tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T15:56:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-103536881',display_name='tempest-TestVolumeBootPattern-server-103536881',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-103536881',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGSEIi3g934sMLPVz4vXQXFZs0uPpfou1A8cQ+7f5EeoH+XvyrzPDAqzu7FTAOU7yXRJ8IemF+WnLjTlXTwpg+PX5Yor65g2g46SgdNmwrUcBQAy+H25S13pZzToJUCwGA==',key_name='tempest-TestVolumeBootPattern-1419808121',keypairs=<?>,launch_index=0,launched_at=2023-11-06T15:57:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='915211c6a2734c36b34ff92a56b085f6',ramdisk_id='',reservation_id='r-02n02xu0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1055092640',owner_user_name='tempest-TestVolumeBootPattern-1055092640-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T15:57:11Z,user_data=None,user_id='bb8d5f0200124588be1cfde107341a45',uuid=9a3a0bd3-6c4d-434f-9f6b-7d954f7c163b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "733c74d6-103a-491b-b443-9b2fe9ceb5f3", "address": "fa:16:3e:3d:e8:fb", "network": {"id": "4e47319f-de1d-4dfe-9915-7d2d5131704d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-895093240-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "915211c6a2734c36b34ff92a56b085f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap733c74d6-10", "ovs_interfaceid": "733c74d6-103a-491b-b443-9b2fe9ceb5f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 15:58:45 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-96afe873-adff-400b-b903-d99e3740062e tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Converting VIF {"id": "733c74d6-103a-491b-b443-9b2fe9ceb5f3", "address": "fa:16:3e:3d:e8:fb", "network": {"id": "4e47319f-de1d-4dfe-9915-7d2d5131704d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-895093240-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "915211c6a2734c36b34ff92a56b085f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap733c74d6-10", "ovs_interfaceid": "733c74d6-103a-491b-b443-9b2fe9ceb5f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 15:58:45 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-96afe873-adff-400b-b903-d99e3740062e tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:e8:fb,bridge_name='br-int',has_traffic_filtering=True,id=733c74d6-103a-491b-b443-9b2fe9ceb5f3,network=Network(4e47319f-de1d-4dfe-9915-7d2d5131704d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap733c74d6-10') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 15:58:45 user nova-compute[75337]: DEBUG os_vif [None req-96afe873-adff-400b-b903-d99e3740062e tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:e8:fb,bridge_name='br-int',has_traffic_filtering=True,id=733c74d6-103a-491b-b443-9b2fe9ceb5f3,network=Network(4e47319f-de1d-4dfe-9915-7d2d5131704d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap733c74d6-10') {{(pid=75337) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 15:58:45 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:58:45 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap733c74d6-10, bridge=br-int, if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:58:45 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:58:45 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:58:45 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:58:45 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:58:45 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=55f1137c-3304-4022-b156-e57fbc9ec860) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:58:45 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:58:45 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:58:45 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:58:45 user nova-compute[75337]: INFO os_vif [None req-96afe873-adff-400b-b903-d99e3740062e tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:e8:fb,bridge_name='br-int',has_traffic_filtering=True,id=733c74d6-103a-491b-b443-9b2fe9ceb5f3,network=Network(4e47319f-de1d-4dfe-9915-7d2d5131704d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap733c74d6-10')
Nov 06 15:58:45 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-96afe873-adff-400b-b903-d99e3740062e tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 9a3a0bd3-6c4d-434f-9f6b-7d954f7c163b] calling os-brick to detach iSCSI Volume {{(pid=75337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 15:58:45 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-96afe873-adff-400b-b903-d99e3740062e tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2abc33d0c0>, {'target_iqn': 'iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CPtyXLsv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 15:58:45 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-96afe873-adff-400b-b903-d99e3740062e tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 15:58:45 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-96afe873-adff-400b-b903-d99e3740062e tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 15:58:45 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-96afe873-adff-400b-b903-d99e3740062e tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 15:58:45 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:58:45 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:58:45 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2551426-b95e-436e-9871-fcf12db53973]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:326a132a-07d4-4085-8da9-ffa8444121b5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:58:45 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-96afe873-adff-400b-b903-d99e3740062e tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 15:58:45 user nova-compute[75337]: No targets found.
Nov 06 15:58:45 user nova-compute[75337]: iSNS:
Nov 06 15:58:45 user nova-compute[75337]: No targets found.
Nov 06 15:58:45 user nova-compute[75337]: STATIC:
Nov 06 15:58:45 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:326a132a-07d4-4085-8da9-ffa8444121b5
Nov 06 15:58:45 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 15:58:45 user nova-compute[75337]:                 Iface Name: default
Nov 06 15:58:45 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da
Nov 06 15:58:45 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 15:58:45 user nova-compute[75337]:                 Iface Name: default
Nov 06 15:58:45 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8
Nov 06 15:58:45 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 15:58:45 user nova-compute[75337]:                 Iface Name: default
Nov 06 15:58:45 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673
Nov 06 15:58:45 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 15:58:45 user nova-compute[75337]:                 Iface Name: default
Nov 06 15:58:45 user nova-compute[75337]: FIRMWARE:
Nov 06 15:58:45 user nova-compute[75337]: No targets found.
Nov 06 15:58:45 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 15:58:45 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-96afe873-adff-400b-b903-d99e3740062e tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 15:58:45 user nova-compute[75337]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 15:58:45 user nova-compute[75337]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75337) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 15:58:45 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-96afe873-adff-400b-b903-d99e3740062e tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673', 0)] {{(pid=75337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 15:58:45 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:58:45 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:58:45 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aeec019-9469-4797-b955-8b8f659db459]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:326a132a-07d4-4085-8da9-ffa8444121b5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:58:45 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:58:45 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:58:45 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c24aba5-aebb-435c-972b-37a43d79c419]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326a132a-07d4-4085-8da9-ffa8444121b5 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8 (non-flash)\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:58:45 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-96afe873-adff-400b-b903-d99e3740062e tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326a132a-07d4-4085-8da9-ffa8444121b5 (non-flash)
Nov 06 15:58:45 user nova-compute[75337]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673 (non-flash)
Nov 06 15:58:45 user nova-compute[75337]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da (non-flash)
Nov 06 15:58:45 user nova-compute[75337]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8 (non-flash)
Nov 06 15:58:45 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 15:58:45 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-96afe873-adff-400b-b903-d99e3740062e tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326a132a-07d4-4085-8da9-ffa8444121b5 (non-flash)
Nov 06 15:58:45 user nova-compute[75337]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673 (non-flash)
Nov 06 15:58:45 user nova-compute[75337]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da (non-flash)
Nov 06 15:58:45 user nova-compute[75337]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8 (non-flash)
Nov 06 15:58:45 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 15:58:45 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-96afe873-adff-400b-b903-d99e3740062e tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2a9c5ddf30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673'): ({'sdc'}, set())}) {{(pid=75337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 15:58:45 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-96afe873-adff-400b-b903-d99e3740062e tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Removing single pathed devices sdc {{(pid=75337) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 15:58:45 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:58:45 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:58:45 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b3b2f3a-0e63-4511-8b3a-7c2ce94ce7fd]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:58:45 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:58:45 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.035s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:58:45 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[a21240ca-7b92-4ce4-bd35-c1fa0838c2e2]: (4, ('ok\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:58:45 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-96afe873-adff-400b-b903-d99e3740062e tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Flushing IO for device /dev/sdc {{(pid=75337) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 15:58:45 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:58:45 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.018s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:58:45 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e87f06e-8c36-4890-8f14-13c731fa5b03]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:58:45 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-96afe873-adff-400b-b903-d99e3740062e tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75337) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 15:58:45 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:58:45 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.035s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:58:45 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9c7e257-094e-4e39-a9c0-313e1b762e53]: (4, ('1', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:58:45 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-96afe873-adff-400b-b903-d99e3740062e tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 15:58:45 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-96afe873-adff-400b-b903-d99e3740062e tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] SCSI volumes sdc have been removed. {{(pid=75337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 15:58:45 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-96afe873-adff-400b-b903-d99e3740062e tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673')] {{(pid=75337) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 15:58:45 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:58:45 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:58:45 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a984bcc-222b-44ce-b5d3-32ebfab3131f]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:58:45 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-96afe873-adff-400b-b903-d99e3740062e tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:58:45 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673 -p 172.16.0.220:3260 --logout {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:58:45 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:58:45 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[92c048fa-2a47-47d7-855a-5405615895dc]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:58:45 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-96afe873-adff-400b-b903-d99e3740062e tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673, portal: 172.16.0.220,3260]
Nov 06 15:58:45 user nova-compute[75337]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673, portal: 172.16.0.220,3260] successful.
Nov 06 15:58:45 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:58:45 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673 -p 172.16.0.220:3260 --op delete {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:58:45 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:58:45 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[988188dd-a81c-40da-a211-7f063b4b38d0]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:58:45 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-96afe873-adff-400b-b903-d99e3740062e tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:58:45 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-96afe873-adff-400b-b903-d99e3740062e tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.389s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 15:58:45 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-96afe873-adff-400b-b903-d99e3740062e tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] <== disconnect_volume: return (391ms) None {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 15:58:45 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-96afe873-adff-400b-b903-d99e3740062e tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 9a3a0bd3-6c4d-434f-9f6b-7d954f7c163b] Disconnected iSCSI Volume {{(pid=75337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 15:58:45 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-96afe873-adff-400b-b903-d99e3740062e tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 9a3a0bd3-6c4d-434f-9f6b-7d954f7c163b] Deleting instance files /opt/stack/data/nova/instances/9a3a0bd3-6c4d-434f-9f6b-7d954f7c163b_del
Nov 06 15:58:45 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-96afe873-adff-400b-b903-d99e3740062e tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 9a3a0bd3-6c4d-434f-9f6b-7d954f7c163b] Deletion of /opt/stack/data/nova/instances/9a3a0bd3-6c4d-434f-9f6b-7d954f7c163b_del complete
Nov 06 15:58:45 user nova-compute[75337]: INFO nova.compute.manager [None req-96afe873-adff-400b-b903-d99e3740062e tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 9a3a0bd3-6c4d-434f-9f6b-7d954f7c163b] Took 1.40 seconds to destroy the instance on the hypervisor.
Nov 06 15:58:45 user nova-compute[75337]: DEBUG oslo.service.loopingcall [None req-96afe873-adff-400b-b903-d99e3740062e tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75337) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 15:58:45 user nova-compute[75337]: DEBUG nova.compute.manager [-] [instance: 9a3a0bd3-6c4d-434f-9f6b-7d954f7c163b] Deallocating network for instance {{(pid=75337) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 15:58:45 user nova-compute[75337]: DEBUG nova.network.neutron [-] [instance: 9a3a0bd3-6c4d-434f-9f6b-7d954f7c163b] deallocate_for_instance() {{(pid=75337) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 15:58:47 user nova-compute[75337]: DEBUG nova.network.neutron [-] [instance: 9a3a0bd3-6c4d-434f-9f6b-7d954f7c163b] Updating instance_info_cache with network_info: [] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:58:47 user nova-compute[75337]: INFO nova.compute.manager [-] [instance: 9a3a0bd3-6c4d-434f-9f6b-7d954f7c163b] Took 1.63 seconds to deallocate network for instance.
Nov 06 15:58:47 user nova-compute[75337]: DEBUG nova.compute.manager [req-86612a14-c729-4925-b5b6-2e25ec59fa78 req-32bbd470-a823-42f6-a570-fc9eaac2d780 service nova] [instance: 9a3a0bd3-6c4d-434f-9f6b-7d954f7c163b] Received event network-vif-deleted-733c74d6-103a-491b-b443-9b2fe9ceb5f3 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:58:47 user nova-compute[75337]: INFO nova.compute.manager [req-86612a14-c729-4925-b5b6-2e25ec59fa78 req-32bbd470-a823-42f6-a570-fc9eaac2d780 service nova] [instance: 9a3a0bd3-6c4d-434f-9f6b-7d954f7c163b] Neutron deleted interface 733c74d6-103a-491b-b443-9b2fe9ceb5f3; detaching it from the instance and deleting it from the info cache
Nov 06 15:58:47 user nova-compute[75337]: DEBUG nova.network.neutron [req-86612a14-c729-4925-b5b6-2e25ec59fa78 req-32bbd470-a823-42f6-a570-fc9eaac2d780 service nova] [instance: 9a3a0bd3-6c4d-434f-9f6b-7d954f7c163b] Updating instance_info_cache with network_info: [] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:58:47 user nova-compute[75337]: DEBUG nova.compute.manager [req-86612a14-c729-4925-b5b6-2e25ec59fa78 req-32bbd470-a823-42f6-a570-fc9eaac2d780 service nova] [instance: 9a3a0bd3-6c4d-434f-9f6b-7d954f7c163b] Detach interface failed, port_id=733c74d6-103a-491b-b443-9b2fe9ceb5f3, reason: Instance 9a3a0bd3-6c4d-434f-9f6b-7d954f7c163b could not be found. {{(pid=75337) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 06 15:58:48 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-93ecf7b4-9f9e-4124-8361-950fdb3cfacc tempest-TestServerVolumeAttachScenarioOldVersion-419113578 tempest-TestServerVolumeAttachScenarioOldVersion-419113578-project-member] Acquiring lock "5d479c64-055b-4496-b3a2-ba10f9095ea8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:58:48 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-93ecf7b4-9f9e-4124-8361-950fdb3cfacc tempest-TestServerVolumeAttachScenarioOldVersion-419113578 tempest-TestServerVolumeAttachScenarioOldVersion-419113578-project-member] Lock "5d479c64-055b-4496-b3a2-ba10f9095ea8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:58:48 user nova-compute[75337]: DEBUG nova.compute.manager [None req-93ecf7b4-9f9e-4124-8361-950fdb3cfacc tempest-TestServerVolumeAttachScenarioOldVersion-419113578 tempest-TestServerVolumeAttachScenarioOldVersion-419113578-project-member] [instance: 5d479c64-055b-4496-b3a2-ba10f9095ea8] Starting instance... {{(pid=75337) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 15:58:48 user nova-compute[75337]: INFO nova.compute.manager [None req-96afe873-adff-400b-b903-d99e3740062e tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 9a3a0bd3-6c4d-434f-9f6b-7d954f7c163b] Took 1.24 seconds to detach 1 volumes for instance.
Nov 06 15:58:48 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-93ecf7b4-9f9e-4124-8361-950fdb3cfacc tempest-TestServerVolumeAttachScenarioOldVersion-419113578 tempest-TestServerVolumeAttachScenarioOldVersion-419113578-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:58:48 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-93ecf7b4-9f9e-4124-8361-950fdb3cfacc tempest-TestServerVolumeAttachScenarioOldVersion-419113578 tempest-TestServerVolumeAttachScenarioOldVersion-419113578-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:58:48 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-93ecf7b4-9f9e-4124-8361-950fdb3cfacc tempest-TestServerVolumeAttachScenarioOldVersion-419113578 tempest-TestServerVolumeAttachScenarioOldVersion-419113578-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75337) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 15:58:48 user nova-compute[75337]: INFO nova.compute.claims [None req-93ecf7b4-9f9e-4124-8361-950fdb3cfacc tempest-TestServerVolumeAttachScenarioOldVersion-419113578 tempest-TestServerVolumeAttachScenarioOldVersion-419113578-project-member] [instance: 5d479c64-055b-4496-b3a2-ba10f9095ea8] Claim successful on node user
Nov 06 15:58:48 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-96afe873-adff-400b-b903-d99e3740062e tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:58:49 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-93ecf7b4-9f9e-4124-8361-950fdb3cfacc tempest-TestServerVolumeAttachScenarioOldVersion-419113578 tempest-TestServerVolumeAttachScenarioOldVersion-419113578-project-member] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 15:58:49 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-93ecf7b4-9f9e-4124-8361-950fdb3cfacc tempest-TestServerVolumeAttachScenarioOldVersion-419113578 tempest-TestServerVolumeAttachScenarioOldVersion-419113578-project-member] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 15:58:49 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-93ecf7b4-9f9e-4124-8361-950fdb3cfacc tempest-TestServerVolumeAttachScenarioOldVersion-419113578 tempest-TestServerVolumeAttachScenarioOldVersion-419113578-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.456s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:58:49 user nova-compute[75337]: DEBUG nova.compute.manager [None req-93ecf7b4-9f9e-4124-8361-950fdb3cfacc tempest-TestServerVolumeAttachScenarioOldVersion-419113578 tempest-TestServerVolumeAttachScenarioOldVersion-419113578-project-member] [instance: 5d479c64-055b-4496-b3a2-ba10f9095ea8] Start building networks asynchronously for instance. {{(pid=75337) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 15:58:49 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-96afe873-adff-400b-b903-d99e3740062e tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.365s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:58:49 user nova-compute[75337]: DEBUG nova.compute.manager [None req-93ecf7b4-9f9e-4124-8361-950fdb3cfacc tempest-TestServerVolumeAttachScenarioOldVersion-419113578 tempest-TestServerVolumeAttachScenarioOldVersion-419113578-project-member] [instance: 5d479c64-055b-4496-b3a2-ba10f9095ea8] Allocating IP information in the background. {{(pid=75337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 15:58:49 user nova-compute[75337]: DEBUG nova.network.neutron [None req-93ecf7b4-9f9e-4124-8361-950fdb3cfacc tempest-TestServerVolumeAttachScenarioOldVersion-419113578 tempest-TestServerVolumeAttachScenarioOldVersion-419113578-project-member] [instance: 5d479c64-055b-4496-b3a2-ba10f9095ea8] allocate_for_instance() {{(pid=75337) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 15:58:49 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-93ecf7b4-9f9e-4124-8361-950fdb3cfacc tempest-TestServerVolumeAttachScenarioOldVersion-419113578 tempest-TestServerVolumeAttachScenarioOldVersion-419113578-project-member] [instance: 5d479c64-055b-4496-b3a2-ba10f9095ea8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 15:58:49 user nova-compute[75337]: DEBUG nova.compute.manager [None req-93ecf7b4-9f9e-4124-8361-950fdb3cfacc tempest-TestServerVolumeAttachScenarioOldVersion-419113578 tempest-TestServerVolumeAttachScenarioOldVersion-419113578-project-member] [instance: 5d479c64-055b-4496-b3a2-ba10f9095ea8] Start building block device mappings for instance. {{(pid=75337) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 15:58:49 user nova-compute[75337]: DEBUG nova.policy [None req-93ecf7b4-9f9e-4124-8361-950fdb3cfacc tempest-TestServerVolumeAttachScenarioOldVersion-419113578 tempest-TestServerVolumeAttachScenarioOldVersion-419113578-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ac41d0290309421daae5fcc49f214a63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93b47bd7e8214b4f9d7f930e6f4b5dea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75337) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 15:58:49 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:58:49 user nova-compute[75337]: DEBUG nova.compute.manager [None req-93ecf7b4-9f9e-4124-8361-950fdb3cfacc tempest-TestServerVolumeAttachScenarioOldVersion-419113578 tempest-TestServerVolumeAttachScenarioOldVersion-419113578-project-member] [instance: 5d479c64-055b-4496-b3a2-ba10f9095ea8] Start spawning the instance on the hypervisor. {{(pid=75337) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 15:58:49 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-93ecf7b4-9f9e-4124-8361-950fdb3cfacc tempest-TestServerVolumeAttachScenarioOldVersion-419113578 tempest-TestServerVolumeAttachScenarioOldVersion-419113578-project-member] [instance: 5d479c64-055b-4496-b3a2-ba10f9095ea8] Creating instance directory {{(pid=75337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 15:58:49 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-93ecf7b4-9f9e-4124-8361-950fdb3cfacc tempest-TestServerVolumeAttachScenarioOldVersion-419113578 tempest-TestServerVolumeAttachScenarioOldVersion-419113578-project-member] [instance: 5d479c64-055b-4496-b3a2-ba10f9095ea8] Creating image(s)
Nov 06 15:58:49 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-93ecf7b4-9f9e-4124-8361-950fdb3cfacc tempest-TestServerVolumeAttachScenarioOldVersion-419113578 tempest-TestServerVolumeAttachScenarioOldVersion-419113578-project-member] Acquiring lock "/opt/stack/data/nova/instances/5d479c64-055b-4496-b3a2-ba10f9095ea8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:58:49 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-93ecf7b4-9f9e-4124-8361-950fdb3cfacc tempest-TestServerVolumeAttachScenarioOldVersion-419113578 tempest-TestServerVolumeAttachScenarioOldVersion-419113578-project-member] Lock "/opt/stack/data/nova/instances/5d479c64-055b-4496-b3a2-ba10f9095ea8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:58:49 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-93ecf7b4-9f9e-4124-8361-950fdb3cfacc tempest-TestServerVolumeAttachScenarioOldVersion-419113578 tempest-TestServerVolumeAttachScenarioOldVersion-419113578-project-member] Lock "/opt/stack/data/nova/instances/5d479c64-055b-4496-b3a2-ba10f9095ea8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:58:49 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-93ecf7b4-9f9e-4124-8361-950fdb3cfacc tempest-TestServerVolumeAttachScenarioOldVersion-419113578 tempest-TestServerVolumeAttachScenarioOldVersion-419113578-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:58:49 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-96afe873-adff-400b-b903-d99e3740062e tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 15:58:49 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-96afe873-adff-400b-b903-d99e3740062e tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 15:58:49 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-93ecf7b4-9f9e-4124-8361-950fdb3cfacc tempest-TestServerVolumeAttachScenarioOldVersion-419113578 tempest-TestServerVolumeAttachScenarioOldVersion-419113578-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json" returned: 0 in 0.180s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:58:49 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-93ecf7b4-9f9e-4124-8361-950fdb3cfacc tempest-TestServerVolumeAttachScenarioOldVersion-419113578 tempest-TestServerVolumeAttachScenarioOldVersion-419113578-project-member] Acquiring lock "06ba3c914798499e686c5ac75886932347225275" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:58:49 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-93ecf7b4-9f9e-4124-8361-950fdb3cfacc tempest-TestServerVolumeAttachScenarioOldVersion-419113578 tempest-TestServerVolumeAttachScenarioOldVersion-419113578-project-member] Lock "06ba3c914798499e686c5ac75886932347225275" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:58:49 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-93ecf7b4-9f9e-4124-8361-950fdb3cfacc tempest-TestServerVolumeAttachScenarioOldVersion-419113578 tempest-TestServerVolumeAttachScenarioOldVersion-419113578-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:58:49 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-96afe873-adff-400b-b903-d99e3740062e tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.527s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:58:49 user nova-compute[75337]: INFO nova.scheduler.client.report [None req-96afe873-adff-400b-b903-d99e3740062e tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Deleted allocations for instance 9a3a0bd3-6c4d-434f-9f6b-7d954f7c163b
Nov 06 15:58:49 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-96afe873-adff-400b-b903-d99e3740062e tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Lock "9a3a0bd3-6c4d-434f-9f6b-7d954f7c163b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.418s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:58:49 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-93ecf7b4-9f9e-4124-8361-950fdb3cfacc tempest-TestServerVolumeAttachScenarioOldVersion-419113578 tempest-TestServerVolumeAttachScenarioOldVersion-419113578-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json" returned: 0 in 0.196s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:58:49 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-93ecf7b4-9f9e-4124-8361-950fdb3cfacc tempest-TestServerVolumeAttachScenarioOldVersion-419113578 tempest-TestServerVolumeAttachScenarioOldVersion-419113578-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275,backing_fmt=raw /opt/stack/data/nova/instances/5d479c64-055b-4496-b3a2-ba10f9095ea8/disk 1073741824 {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:58:50 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-93ecf7b4-9f9e-4124-8361-950fdb3cfacc tempest-TestServerVolumeAttachScenarioOldVersion-419113578 tempest-TestServerVolumeAttachScenarioOldVersion-419113578-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275,backing_fmt=raw /opt/stack/data/nova/instances/5d479c64-055b-4496-b3a2-ba10f9095ea8/disk 1073741824" returned: 0 in 0.066s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:58:50 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-93ecf7b4-9f9e-4124-8361-950fdb3cfacc tempest-TestServerVolumeAttachScenarioOldVersion-419113578 tempest-TestServerVolumeAttachScenarioOldVersion-419113578-project-member] Lock "06ba3c914798499e686c5ac75886932347225275" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.268s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:58:50 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-93ecf7b4-9f9e-4124-8361-950fdb3cfacc tempest-TestServerVolumeAttachScenarioOldVersion-419113578 tempest-TestServerVolumeAttachScenarioOldVersion-419113578-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:58:50 user nova-compute[75337]: DEBUG nova.network.neutron [None req-93ecf7b4-9f9e-4124-8361-950fdb3cfacc tempest-TestServerVolumeAttachScenarioOldVersion-419113578 tempest-TestServerVolumeAttachScenarioOldVersion-419113578-project-member] [instance: 5d479c64-055b-4496-b3a2-ba10f9095ea8] Successfully created port: cf2938cc-3588-4aea-8cb9-e0117e78a628 {{(pid=75337) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 15:58:50 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-93ecf7b4-9f9e-4124-8361-950fdb3cfacc tempest-TestServerVolumeAttachScenarioOldVersion-419113578 tempest-TestServerVolumeAttachScenarioOldVersion-419113578-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json" returned: 0 in 0.215s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:58:50 user nova-compute[75337]: DEBUG nova.virt.disk.api [None req-93ecf7b4-9f9e-4124-8361-950fdb3cfacc tempest-TestServerVolumeAttachScenarioOldVersion-419113578 tempest-TestServerVolumeAttachScenarioOldVersion-419113578-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5d479c64-055b-4496-b3a2-ba10f9095ea8/disk. size=1073741824 {{(pid=75337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 15:58:50 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-93ecf7b4-9f9e-4124-8361-950fdb3cfacc tempest-TestServerVolumeAttachScenarioOldVersion-419113578 tempest-TestServerVolumeAttachScenarioOldVersion-419113578-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d479c64-055b-4496-b3a2-ba10f9095ea8/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:58:50 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-93ecf7b4-9f9e-4124-8361-950fdb3cfacc tempest-TestServerVolumeAttachScenarioOldVersion-419113578 tempest-TestServerVolumeAttachScenarioOldVersion-419113578-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d479c64-055b-4496-b3a2-ba10f9095ea8/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:58:50 user nova-compute[75337]: DEBUG nova.virt.disk.api [None req-93ecf7b4-9f9e-4124-8361-950fdb3cfacc tempest-TestServerVolumeAttachScenarioOldVersion-419113578 tempest-TestServerVolumeAttachScenarioOldVersion-419113578-project-member] Cannot resize image /opt/stack/data/nova/instances/5d479c64-055b-4496-b3a2-ba10f9095ea8/disk to a smaller size. {{(pid=75337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 06 15:58:50 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-93ecf7b4-9f9e-4124-8361-950fdb3cfacc tempest-TestServerVolumeAttachScenarioOldVersion-419113578 tempest-TestServerVolumeAttachScenarioOldVersion-419113578-project-member] [instance: 5d479c64-055b-4496-b3a2-ba10f9095ea8] Created local disks {{(pid=75337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 15:58:50 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-93ecf7b4-9f9e-4124-8361-950fdb3cfacc tempest-TestServerVolumeAttachScenarioOldVersion-419113578 tempest-TestServerVolumeAttachScenarioOldVersion-419113578-project-member] [instance: 5d479c64-055b-4496-b3a2-ba10f9095ea8] Ensure instance console log exists: /opt/stack/data/nova/instances/5d479c64-055b-4496-b3a2-ba10f9095ea8/console.log {{(pid=75337) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 15:58:50 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-93ecf7b4-9f9e-4124-8361-950fdb3cfacc tempest-TestServerVolumeAttachScenarioOldVersion-419113578 tempest-TestServerVolumeAttachScenarioOldVersion-419113578-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:58:50 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-93ecf7b4-9f9e-4124-8361-950fdb3cfacc tempest-TestServerVolumeAttachScenarioOldVersion-419113578 tempest-TestServerVolumeAttachScenarioOldVersion-419113578-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:58:50 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-93ecf7b4-9f9e-4124-8361-950fdb3cfacc tempest-TestServerVolumeAttachScenarioOldVersion-419113578 tempest-TestServerVolumeAttachScenarioOldVersion-419113578-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:58:50 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:58:50 user nova-compute[75337]: DEBUG nova.network.neutron [None req-93ecf7b4-9f9e-4124-8361-950fdb3cfacc tempest-TestServerVolumeAttachScenarioOldVersion-419113578 tempest-TestServerVolumeAttachScenarioOldVersion-419113578-project-member] [instance: 5d479c64-055b-4496-b3a2-ba10f9095ea8] Successfully updated port: cf2938cc-3588-4aea-8cb9-e0117e78a628 {{(pid=75337) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 15:58:50 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-93ecf7b4-9f9e-4124-8361-950fdb3cfacc tempest-TestServerVolumeAttachScenarioOldVersion-419113578 tempest-TestServerVolumeAttachScenarioOldVersion-419113578-project-member] Acquiring lock "refresh_cache-5d479c64-055b-4496-b3a2-ba10f9095ea8" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 15:58:50 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-93ecf7b4-9f9e-4124-8361-950fdb3cfacc tempest-TestServerVolumeAttachScenarioOldVersion-419113578 tempest-TestServerVolumeAttachScenarioOldVersion-419113578-project-member] Acquired lock "refresh_cache-5d479c64-055b-4496-b3a2-ba10f9095ea8" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 15:58:50 user nova-compute[75337]: DEBUG nova.network.neutron [None req-93ecf7b4-9f9e-4124-8361-950fdb3cfacc tempest-TestServerVolumeAttachScenarioOldVersion-419113578 tempest-TestServerVolumeAttachScenarioOldVersion-419113578-project-member] [instance: 5d479c64-055b-4496-b3a2-ba10f9095ea8] Building network info cache for instance {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 15:58:50 user nova-compute[75337]: DEBUG nova.compute.manager [req-abdace97-eb5e-4d6d-8ed4-3b69b34ebc50 req-a8264882-27ca-4685-b248-56170d9a2f13 service nova] [instance: 5d479c64-055b-4496-b3a2-ba10f9095ea8] Received event network-changed-cf2938cc-3588-4aea-8cb9-e0117e78a628 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:58:50 user nova-compute[75337]: DEBUG nova.compute.manager [req-abdace97-eb5e-4d6d-8ed4-3b69b34ebc50 req-a8264882-27ca-4685-b248-56170d9a2f13 service nova] [instance: 5d479c64-055b-4496-b3a2-ba10f9095ea8] Refreshing instance network info cache due to event network-changed-cf2938cc-3588-4aea-8cb9-e0117e78a628. {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 15:58:50 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-abdace97-eb5e-4d6d-8ed4-3b69b34ebc50 req-a8264882-27ca-4685-b248-56170d9a2f13 service nova] Acquiring lock "refresh_cache-5d479c64-055b-4496-b3a2-ba10f9095ea8" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 15:58:50 user nova-compute[75337]: DEBUG nova.network.neutron [None req-93ecf7b4-9f9e-4124-8361-950fdb3cfacc tempest-TestServerVolumeAttachScenarioOldVersion-419113578 tempest-TestServerVolumeAttachScenarioOldVersion-419113578-project-member] [instance: 5d479c64-055b-4496-b3a2-ba10f9095ea8] Instance cache missing network info. {{(pid=75337) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 15:58:51 user nova-compute[75337]: DEBUG nova.network.neutron [None req-93ecf7b4-9f9e-4124-8361-950fdb3cfacc tempest-TestServerVolumeAttachScenarioOldVersion-419113578 tempest-TestServerVolumeAttachScenarioOldVersion-419113578-project-member] [instance: 5d479c64-055b-4496-b3a2-ba10f9095ea8] Updating instance_info_cache with network_info: [{"id": "cf2938cc-3588-4aea-8cb9-e0117e78a628", "address": "fa:16:3e:74:b7:02", "network": {"id": "53be211e-34f3-4a33-b5dc-7b7a0c2fb280", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-504725466-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93b47bd7e8214b4f9d7f930e6f4b5dea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf2938cc-35", "ovs_interfaceid": "cf2938cc-3588-4aea-8cb9-e0117e78a628", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:58:51 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-93ecf7b4-9f9e-4124-8361-950fdb3cfacc tempest-TestServerVolumeAttachScenarioOldVersion-419113578 tempest-TestServerVolumeAttachScenarioOldVersion-419113578-project-member] Releasing lock "refresh_cache-5d479c64-055b-4496-b3a2-ba10f9095ea8" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 15:58:51 user nova-compute[75337]: DEBUG nova.compute.manager [None req-93ecf7b4-9f9e-4124-8361-950fdb3cfacc tempest-TestServerVolumeAttachScenarioOldVersion-419113578 tempest-TestServerVolumeAttachScenarioOldVersion-419113578-project-member] [instance: 5d479c64-055b-4496-b3a2-ba10f9095ea8] Instance network_info: |[{"id": "cf2938cc-3588-4aea-8cb9-e0117e78a628", "address": "fa:16:3e:74:b7:02", "network": {"id": "53be211e-34f3-4a33-b5dc-7b7a0c2fb280", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-504725466-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93b47bd7e8214b4f9d7f930e6f4b5dea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf2938cc-35", "ovs_interfaceid": "cf2938cc-3588-4aea-8cb9-e0117e78a628", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 15:58:51 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-abdace97-eb5e-4d6d-8ed4-3b69b34ebc50 req-a8264882-27ca-4685-b248-56170d9a2f13 service nova] Acquired lock "refresh_cache-5d479c64-055b-4496-b3a2-ba10f9095ea8" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 15:58:51 user nova-compute[75337]: DEBUG nova.network.neutron [req-abdace97-eb5e-4d6d-8ed4-3b69b34ebc50 req-a8264882-27ca-4685-b248-56170d9a2f13 service nova] [instance: 5d479c64-055b-4496-b3a2-ba10f9095ea8] Refreshing network info cache for port cf2938cc-3588-4aea-8cb9-e0117e78a628 {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 15:58:51 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-93ecf7b4-9f9e-4124-8361-950fdb3cfacc tempest-TestServerVolumeAttachScenarioOldVersion-419113578 tempest-TestServerVolumeAttachScenarioOldVersion-419113578-project-member] [instance: 5d479c64-055b-4496-b3a2-ba10f9095ea8] Start _get_guest_xml network_info=[{"id": "cf2938cc-3588-4aea-8cb9-e0117e78a628", "address": "fa:16:3e:74:b7:02", "network": {"id": "53be211e-34f3-4a33-b5dc-7b7a0c2fb280", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-504725466-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93b47bd7e8214b4f9d7f930e6f4b5dea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf2938cc-35", "ovs_interfaceid": "cf2938cc-3588-4aea-8cb9-e0117e78a628", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T15:34:14Z,direct_url=<?>,disk_format='qcow2',id=16b903ae-a40f-41a7-985b-4804cce92c62,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6549a15819f1469bbd5eeae8190e3d44',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T15:34:15Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'guest_format': None, 'size': 0, 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '16b903ae-a40f-41a7-985b-4804cce92c62'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 15:58:51 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-93ecf7b4-9f9e-4124-8361-950fdb3cfacc tempest-TestServerVolumeAttachScenarioOldVersion-419113578 tempest-TestServerVolumeAttachScenarioOldVersion-419113578-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 15:58:51 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-93ecf7b4-9f9e-4124-8361-950fdb3cfacc tempest-TestServerVolumeAttachScenarioOldVersion-419113578 tempest-TestServerVolumeAttachScenarioOldVersion-419113578-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 15:58:51 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-93ecf7b4-9f9e-4124-8361-950fdb3cfacc tempest-TestServerVolumeAttachScenarioOldVersion-419113578 tempest-TestServerVolumeAttachScenarioOldVersion-419113578-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 15:58:51 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-93ecf7b4-9f9e-4124-8361-950fdb3cfacc tempest-TestServerVolumeAttachScenarioOldVersion-419113578 tempest-TestServerVolumeAttachScenarioOldVersion-419113578-project-member] CPU controller missing on host. {{(pid=75337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 15:58:51 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-93ecf7b4-9f9e-4124-8361-950fdb3cfacc tempest-TestServerVolumeAttachScenarioOldVersion-419113578 tempest-TestServerVolumeAttachScenarioOldVersion-419113578-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 15:58:51 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-93ecf7b4-9f9e-4124-8361-950fdb3cfacc tempest-TestServerVolumeAttachScenarioOldVersion-419113578 tempest-TestServerVolumeAttachScenarioOldVersion-419113578-project-member] CPU controller found on host. {{(pid=75337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 15:58:51 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-93ecf7b4-9f9e-4124-8361-950fdb3cfacc tempest-TestServerVolumeAttachScenarioOldVersion-419113578 tempest-TestServerVolumeAttachScenarioOldVersion-419113578-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75337) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 15:58:51 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-93ecf7b4-9f9e-4124-8361-950fdb3cfacc tempest-TestServerVolumeAttachScenarioOldVersion-419113578 tempest-TestServerVolumeAttachScenarioOldVersion-419113578-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T15:34:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T15:34:14Z,direct_url=<?>,disk_format='qcow2',id=16b903ae-a40f-41a7-985b-4804cce92c62,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6549a15819f1469bbd5eeae8190e3d44',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T15:34:15Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 15:58:51 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-93ecf7b4-9f9e-4124-8361-950fdb3cfacc tempest-TestServerVolumeAttachScenarioOldVersion-419113578 tempest-TestServerVolumeAttachScenarioOldVersion-419113578-project-member] Flavor limits 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 15:58:51 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-93ecf7b4-9f9e-4124-8361-950fdb3cfacc tempest-TestServerVolumeAttachScenarioOldVersion-419113578 tempest-TestServerVolumeAttachScenarioOldVersion-419113578-project-member] Image limits 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 15:58:51 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-93ecf7b4-9f9e-4124-8361-950fdb3cfacc tempest-TestServerVolumeAttachScenarioOldVersion-419113578 tempest-TestServerVolumeAttachScenarioOldVersion-419113578-project-member] Flavor pref 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 15:58:51 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-93ecf7b4-9f9e-4124-8361-950fdb3cfacc tempest-TestServerVolumeAttachScenarioOldVersion-419113578 tempest-TestServerVolumeAttachScenarioOldVersion-419113578-project-member] Image pref 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 15:58:51 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-93ecf7b4-9f9e-4124-8361-950fdb3cfacc tempest-TestServerVolumeAttachScenarioOldVersion-419113578 tempest-TestServerVolumeAttachScenarioOldVersion-419113578-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 15:58:51 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-93ecf7b4-9f9e-4124-8361-950fdb3cfacc tempest-TestServerVolumeAttachScenarioOldVersion-419113578 tempest-TestServerVolumeAttachScenarioOldVersion-419113578-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 15:58:51 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-93ecf7b4-9f9e-4124-8361-950fdb3cfacc tempest-TestServerVolumeAttachScenarioOldVersion-419113578 tempest-TestServerVolumeAttachScenarioOldVersion-419113578-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 15:58:51 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-93ecf7b4-9f9e-4124-8361-950fdb3cfacc tempest-TestServerVolumeAttachScenarioOldVersion-419113578 tempest-TestServerVolumeAttachScenarioOldVersion-419113578-project-member] Got 1 possible topologies {{(pid=75337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 15:58:51 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-93ecf7b4-9f9e-4124-8361-950fdb3cfacc tempest-TestServerVolumeAttachScenarioOldVersion-419113578 tempest-TestServerVolumeAttachScenarioOldVersion-419113578-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 15:58:51 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-93ecf7b4-9f9e-4124-8361-950fdb3cfacc tempest-TestServerVolumeAttachScenarioOldVersion-419113578 tempest-TestServerVolumeAttachScenarioOldVersion-419113578-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 15:58:51 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-93ecf7b4-9f9e-4124-8361-950fdb3cfacc tempest-TestServerVolumeAttachScenarioOldVersion-419113578 tempest-TestServerVolumeAttachScenarioOldVersion-419113578-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T15:58:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1058406320',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1058406320',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1058406',id=37,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNR95imP03oOG0MVkHGC+Ag0icGvBj91vv/n3yaiNDtFozIEqicyP7d1EpgEC7AmOXgro43bZS6YP0lREjSIuXrbElmm4i5TCLZqmE+DYX37gGTwty8ycwGI6JIO5a+K5w==',key_name='tempest-keypair-75149939',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='93b47bd7e8214b4f9d7f930e6f4b5dea',ramdisk_id='',reservation_id='r-zrb7ddu9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-419113578',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-419113578-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T15:58:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ac41d0290309421daae5fcc49f214a63',uuid=5d479c64-055b-4496-b3a2-ba10f9095ea8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cf2938cc-3588-4aea-8cb9-e0117e78a628", "address": "fa:16:3e:74:b7:02", "network": {"id": "53be211e-34f3-4a33-b5dc-7b7a0c2fb280", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-504725466-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93b47bd7e8214b4f9d7f930e6f4b5dea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf2938cc-35", "ovs_interfaceid": "cf2938cc-3588-4aea-8cb9-e0117e78a628", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75337) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 15:58:51 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-93ecf7b4-9f9e-4124-8361-950fdb3cfacc tempest-TestServerVolumeAttachScenarioOldVersion-419113578 tempest-TestServerVolumeAttachScenarioOldVersion-419113578-project-member] Converting VIF {"id": "cf2938cc-3588-4aea-8cb9-e0117e78a628", "address": "fa:16:3e:74:b7:02", "network": {"id": "53be211e-34f3-4a33-b5dc-7b7a0c2fb280", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-504725466-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93b47bd7e8214b4f9d7f930e6f4b5dea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf2938cc-35", "ovs_interfaceid": "cf2938cc-3588-4aea-8cb9-e0117e78a628", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 15:58:51 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-93ecf7b4-9f9e-4124-8361-950fdb3cfacc tempest-TestServerVolumeAttachScenarioOldVersion-419113578 tempest-TestServerVolumeAttachScenarioOldVersion-419113578-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:b7:02,bridge_name='br-int',has_traffic_filtering=True,id=cf2938cc-3588-4aea-8cb9-e0117e78a628,network=Network(53be211e-34f3-4a33-b5dc-7b7a0c2fb280),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf2938cc-35') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 15:58:51 user nova-compute[75337]: DEBUG nova.objects.instance [None req-93ecf7b4-9f9e-4124-8361-950fdb3cfacc tempest-TestServerVolumeAttachScenarioOldVersion-419113578 tempest-TestServerVolumeAttachScenarioOldVersion-419113578-project-member] Lazy-loading 'pci_devices' on Instance uuid 5d479c64-055b-4496-b3a2-ba10f9095ea8 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 15:58:51 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-93ecf7b4-9f9e-4124-8361-950fdb3cfacc tempest-TestServerVolumeAttachScenarioOldVersion-419113578 tempest-TestServerVolumeAttachScenarioOldVersion-419113578-project-member] [instance: 5d479c64-055b-4496-b3a2-ba10f9095ea8] End _get_guest_xml xml=<domain type="kvm">
Nov 06 15:58:51 user nova-compute[75337]:   <uuid>5d479c64-055b-4496-b3a2-ba10f9095ea8</uuid>
Nov 06 15:58:51 user nova-compute[75337]:   <name>instance-00000025</name>
Nov 06 15:58:51 user nova-compute[75337]:   <memory>524288</memory>
Nov 06 15:58:51 user nova-compute[75337]:   <vcpu>1</vcpu>
Nov 06 15:58:51 user nova-compute[75337]:   <metadata>
Nov 06 15:58:51 user nova-compute[75337]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 15:58:51 user nova-compute[75337]:       <nova:package version="0.0.0"/>
Nov 06 15:58:51 user nova-compute[75337]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-1058406320</nova:name>
Nov 06 15:58:51 user nova-compute[75337]:       <nova:creationTime>2023-11-06 15:58:51</nova:creationTime>
Nov 06 15:58:51 user nova-compute[75337]:       <nova:flavor name="m1.tiny">
Nov 06 15:58:51 user nova-compute[75337]:         <nova:memory>512</nova:memory>
Nov 06 15:58:51 user nova-compute[75337]:         <nova:disk>1</nova:disk>
Nov 06 15:58:51 user nova-compute[75337]:         <nova:swap>0</nova:swap>
Nov 06 15:58:51 user nova-compute[75337]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 15:58:51 user nova-compute[75337]:         <nova:vcpus>1</nova:vcpus>
Nov 06 15:58:51 user nova-compute[75337]:       </nova:flavor>
Nov 06 15:58:51 user nova-compute[75337]:       <nova:owner>
Nov 06 15:58:51 user nova-compute[75337]:         <nova:user uuid="ac41d0290309421daae5fcc49f214a63">tempest-TestServerVolumeAttachScenarioOldVersion-419113578-project-member</nova:user>
Nov 06 15:58:51 user nova-compute[75337]:         <nova:project uuid="93b47bd7e8214b4f9d7f930e6f4b5dea">tempest-TestServerVolumeAttachScenarioOldVersion-419113578</nova:project>
Nov 06 15:58:51 user nova-compute[75337]:       </nova:owner>
Nov 06 15:58:51 user nova-compute[75337]:       <nova:root type="image" uuid="16b903ae-a40f-41a7-985b-4804cce92c62"/>
Nov 06 15:58:51 user nova-compute[75337]:       <nova:ports>
Nov 06 15:58:51 user nova-compute[75337]:         <nova:port uuid="cf2938cc-3588-4aea-8cb9-e0117e78a628">
Nov 06 15:58:51 user nova-compute[75337]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 06 15:58:51 user nova-compute[75337]:         </nova:port>
Nov 06 15:58:51 user nova-compute[75337]:       </nova:ports>
Nov 06 15:58:51 user nova-compute[75337]:     </nova:instance>
Nov 06 15:58:51 user nova-compute[75337]:   </metadata>
Nov 06 15:58:51 user nova-compute[75337]:   <sysinfo type="smbios">
Nov 06 15:58:51 user nova-compute[75337]:     <system>
Nov 06 15:58:51 user nova-compute[75337]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 15:58:51 user nova-compute[75337]:       <entry name="product">OpenStack Nova</entry>
Nov 06 15:58:51 user nova-compute[75337]:       <entry name="version">0.0.0</entry>
Nov 06 15:58:51 user nova-compute[75337]:       <entry name="serial">5d479c64-055b-4496-b3a2-ba10f9095ea8</entry>
Nov 06 15:58:51 user nova-compute[75337]:       <entry name="uuid">5d479c64-055b-4496-b3a2-ba10f9095ea8</entry>
Nov 06 15:58:51 user nova-compute[75337]:       <entry name="family">Virtual Machine</entry>
Nov 06 15:58:51 user nova-compute[75337]:     </system>
Nov 06 15:58:51 user nova-compute[75337]:   </sysinfo>
Nov 06 15:58:51 user nova-compute[75337]:   <os>
Nov 06 15:58:51 user nova-compute[75337]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 15:58:51 user nova-compute[75337]:     <boot dev="hd"/>
Nov 06 15:58:51 user nova-compute[75337]:     <smbios mode="sysinfo"/>
Nov 06 15:58:51 user nova-compute[75337]:   </os>
Nov 06 15:58:51 user nova-compute[75337]:   <features>
Nov 06 15:58:51 user nova-compute[75337]:     <acpi/>
Nov 06 15:58:51 user nova-compute[75337]:     <apic/>
Nov 06 15:58:51 user nova-compute[75337]:     <vmcoreinfo/>
Nov 06 15:58:51 user nova-compute[75337]:   </features>
Nov 06 15:58:51 user nova-compute[75337]:   <clock offset="utc">
Nov 06 15:58:51 user nova-compute[75337]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 15:58:51 user nova-compute[75337]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 15:58:51 user nova-compute[75337]:     <timer name="hpet" present="no"/>
Nov 06 15:58:51 user nova-compute[75337]:   </clock>
Nov 06 15:58:51 user nova-compute[75337]:   <cpu mode="custom" match="exact">
Nov 06 15:58:51 user nova-compute[75337]:     <model>Nehalem</model>
Nov 06 15:58:51 user nova-compute[75337]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 15:58:51 user nova-compute[75337]:   </cpu>
Nov 06 15:58:51 user nova-compute[75337]:   <devices>
Nov 06 15:58:51 user nova-compute[75337]:     <disk type="file" device="disk">
Nov 06 15:58:51 user nova-compute[75337]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 15:58:51 user nova-compute[75337]:       <source file="/opt/stack/data/nova/instances/5d479c64-055b-4496-b3a2-ba10f9095ea8/disk"/>
Nov 06 15:58:51 user nova-compute[75337]:       <target dev="vda" bus="virtio"/>
Nov 06 15:58:51 user nova-compute[75337]:     </disk>
Nov 06 15:58:51 user nova-compute[75337]:     <interface type="ethernet">
Nov 06 15:58:51 user nova-compute[75337]:       <mac address="fa:16:3e:74:b7:02"/>
Nov 06 15:58:51 user nova-compute[75337]:       <model type="virtio"/>
Nov 06 15:58:51 user nova-compute[75337]:       <mtu size="1442"/>
Nov 06 15:58:51 user nova-compute[75337]:       <target dev="tapcf2938cc-35"/>
Nov 06 15:58:51 user nova-compute[75337]:     </interface>
Nov 06 15:58:51 user nova-compute[75337]:     <serial type="pty">
Nov 06 15:58:51 user nova-compute[75337]:       <log file="/opt/stack/data/nova/instances/5d479c64-055b-4496-b3a2-ba10f9095ea8/console.log" append="off"/>
Nov 06 15:58:51 user nova-compute[75337]:     </serial>
Nov 06 15:58:51 user nova-compute[75337]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 15:58:51 user nova-compute[75337]:     <video>
Nov 06 15:58:51 user nova-compute[75337]:       <model type="virtio"/>
Nov 06 15:58:51 user nova-compute[75337]:     </video>
Nov 06 15:58:51 user nova-compute[75337]:     <rng model="virtio">
Nov 06 15:58:51 user nova-compute[75337]:       <backend model="random">/dev/urandom</backend>
Nov 06 15:58:51 user nova-compute[75337]:     </rng>
Nov 06 15:58:51 user nova-compute[75337]:     <controller type="usb" index="0" model="none"/>
Nov 06 15:58:51 user nova-compute[75337]:     <memballoon model="virtio">
Nov 06 15:58:51 user nova-compute[75337]:       <stats period="10"/>
Nov 06 15:58:51 user nova-compute[75337]:     </memballoon>
Nov 06 15:58:51 user nova-compute[75337]:   </devices>
Nov 06 15:58:51 user nova-compute[75337]: </domain>
Nov 06 15:58:51 user nova-compute[75337]:  {{(pid=75337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 15:58:51 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-93ecf7b4-9f9e-4124-8361-950fdb3cfacc tempest-TestServerVolumeAttachScenarioOldVersion-419113578 tempest-TestServerVolumeAttachScenarioOldVersion-419113578-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T15:58:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1058406320',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1058406320',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1058406',id=37,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNR95imP03oOG0MVkHGC+Ag0icGvBj91vv/n3yaiNDtFozIEqicyP7d1EpgEC7AmOXgro43bZS6YP0lREjSIuXrbElmm4i5TCLZqmE+DYX37gGTwty8ycwGI6JIO5a+K5w==',key_name='tempest-keypair-75149939',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='93b47bd7e8214b4f9d7f930e6f4b5dea',ramdisk_id='',reservation_id='r-zrb7ddu9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-419113578',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-419113578-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T15:58:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ac41d0290309421daae5fcc49f214a63',uuid=5d479c64-055b-4496-b3a2-ba10f9095ea8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cf2938cc-3588-4aea-8cb9-e0117e78a628", "address": "fa:16:3e:74:b7:02", "network": {"id": "53be211e-34f3-4a33-b5dc-7b7a0c2fb280", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-504725466-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93b47bd7e8214b4f9d7f930e6f4b5dea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf2938cc-35", "ovs_interfaceid": "cf2938cc-3588-4aea-8cb9-e0117e78a628", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 15:58:51 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-93ecf7b4-9f9e-4124-8361-950fdb3cfacc tempest-TestServerVolumeAttachScenarioOldVersion-419113578 tempest-TestServerVolumeAttachScenarioOldVersion-419113578-project-member] Converting VIF {"id": "cf2938cc-3588-4aea-8cb9-e0117e78a628", "address": "fa:16:3e:74:b7:02", "network": {"id": "53be211e-34f3-4a33-b5dc-7b7a0c2fb280", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-504725466-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93b47bd7e8214b4f9d7f930e6f4b5dea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf2938cc-35", "ovs_interfaceid": "cf2938cc-3588-4aea-8cb9-e0117e78a628", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 15:58:51 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-93ecf7b4-9f9e-4124-8361-950fdb3cfacc tempest-TestServerVolumeAttachScenarioOldVersion-419113578 tempest-TestServerVolumeAttachScenarioOldVersion-419113578-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:b7:02,bridge_name='br-int',has_traffic_filtering=True,id=cf2938cc-3588-4aea-8cb9-e0117e78a628,network=Network(53be211e-34f3-4a33-b5dc-7b7a0c2fb280),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf2938cc-35') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 15:58:51 user nova-compute[75337]: DEBUG os_vif [None req-93ecf7b4-9f9e-4124-8361-950fdb3cfacc tempest-TestServerVolumeAttachScenarioOldVersion-419113578 tempest-TestServerVolumeAttachScenarioOldVersion-419113578-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:b7:02,bridge_name='br-int',has_traffic_filtering=True,id=cf2938cc-3588-4aea-8cb9-e0117e78a628,network=Network(53be211e-34f3-4a33-b5dc-7b7a0c2fb280),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf2938cc-35') {{(pid=75337) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 15:58:51 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:58:51 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:58:51 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 15:58:51 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:58:51 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '13484bd1-bd4b-5148-a384-749d8f9fc07d', '_type': 'linux-noop'}}, row=False) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:58:51 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:58:51 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:58:51 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:58:51 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:58:51 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcf2938cc-35, may_exist=True, interface_attrs={}) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:58:51 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcf2938cc-35, col_values=(('qos', UUID('5bc2d451-a572-4ef1-a5bd-bb77dd75c21e')),), if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:58:51 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcf2938cc-35, col_values=(('external_ids', {'iface-id': 'cf2938cc-3588-4aea-8cb9-e0117e78a628', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:74:b7:02', 'vm-uuid': '5d479c64-055b-4496-b3a2-ba10f9095ea8'}),), if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:58:51 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:58:51 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:58:51 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:58:51 user nova-compute[75337]: INFO os_vif [None req-93ecf7b4-9f9e-4124-8361-950fdb3cfacc tempest-TestServerVolumeAttachScenarioOldVersion-419113578 tempest-TestServerVolumeAttachScenarioOldVersion-419113578-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:b7:02,bridge_name='br-int',has_traffic_filtering=True,id=cf2938cc-3588-4aea-8cb9-e0117e78a628,network=Network(53be211e-34f3-4a33-b5dc-7b7a0c2fb280),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf2938cc-35')
Nov 06 15:58:51 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-93ecf7b4-9f9e-4124-8361-950fdb3cfacc tempest-TestServerVolumeAttachScenarioOldVersion-419113578 tempest-TestServerVolumeAttachScenarioOldVersion-419113578-project-member] No BDM found with device name vda, not building metadata. {{(pid=75337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 15:58:51 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-93ecf7b4-9f9e-4124-8361-950fdb3cfacc tempest-TestServerVolumeAttachScenarioOldVersion-419113578 tempest-TestServerVolumeAttachScenarioOldVersion-419113578-project-member] No VIF found with MAC fa:16:3e:74:b7:02, not building metadata {{(pid=75337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 15:58:51 user nova-compute[75337]: DEBUG nova.network.neutron [req-abdace97-eb5e-4d6d-8ed4-3b69b34ebc50 req-a8264882-27ca-4685-b248-56170d9a2f13 service nova] [instance: 5d479c64-055b-4496-b3a2-ba10f9095ea8] Updated VIF entry in instance network info cache for port cf2938cc-3588-4aea-8cb9-e0117e78a628. {{(pid=75337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 15:58:51 user nova-compute[75337]: DEBUG nova.network.neutron [req-abdace97-eb5e-4d6d-8ed4-3b69b34ebc50 req-a8264882-27ca-4685-b248-56170d9a2f13 service nova] [instance: 5d479c64-055b-4496-b3a2-ba10f9095ea8] Updating instance_info_cache with network_info: [{"id": "cf2938cc-3588-4aea-8cb9-e0117e78a628", "address": "fa:16:3e:74:b7:02", "network": {"id": "53be211e-34f3-4a33-b5dc-7b7a0c2fb280", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-504725466-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93b47bd7e8214b4f9d7f930e6f4b5dea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf2938cc-35", "ovs_interfaceid": "cf2938cc-3588-4aea-8cb9-e0117e78a628", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:58:51 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-abdace97-eb5e-4d6d-8ed4-3b69b34ebc50 req-a8264882-27ca-4685-b248-56170d9a2f13 service nova] Releasing lock "refresh_cache-5d479c64-055b-4496-b3a2-ba10f9095ea8" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 15:58:52 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:58:52 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:58:52 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:58:52 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:58:53 user nova-compute[75337]: DEBUG nova.compute.manager [req-3f62df46-fb1f-4ef2-ac32-fa854a7963bc req-0be6159a-4b47-4107-bda7-54cca58b0cf1 service nova] [instance: 5d479c64-055b-4496-b3a2-ba10f9095ea8] Received event network-vif-plugged-cf2938cc-3588-4aea-8cb9-e0117e78a628 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:58:53 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-3f62df46-fb1f-4ef2-ac32-fa854a7963bc req-0be6159a-4b47-4107-bda7-54cca58b0cf1 service nova] Acquiring lock "5d479c64-055b-4496-b3a2-ba10f9095ea8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:58:53 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-3f62df46-fb1f-4ef2-ac32-fa854a7963bc req-0be6159a-4b47-4107-bda7-54cca58b0cf1 service nova] Lock "5d479c64-055b-4496-b3a2-ba10f9095ea8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:58:53 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-3f62df46-fb1f-4ef2-ac32-fa854a7963bc req-0be6159a-4b47-4107-bda7-54cca58b0cf1 service nova] Lock "5d479c64-055b-4496-b3a2-ba10f9095ea8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:58:53 user nova-compute[75337]: DEBUG nova.compute.manager [req-3f62df46-fb1f-4ef2-ac32-fa854a7963bc req-0be6159a-4b47-4107-bda7-54cca58b0cf1 service nova] [instance: 5d479c64-055b-4496-b3a2-ba10f9095ea8] No waiting events found dispatching network-vif-plugged-cf2938cc-3588-4aea-8cb9-e0117e78a628 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:58:53 user nova-compute[75337]: WARNING nova.compute.manager [req-3f62df46-fb1f-4ef2-ac32-fa854a7963bc req-0be6159a-4b47-4107-bda7-54cca58b0cf1 service nova] [instance: 5d479c64-055b-4496-b3a2-ba10f9095ea8] Received unexpected event network-vif-plugged-cf2938cc-3588-4aea-8cb9-e0117e78a628 for instance with vm_state building and task_state spawning.
Nov 06 15:58:53 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:58:53 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:58:53 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:58:53 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:58:53 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:58:54 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:58:54 user nova-compute[75337]: DEBUG nova.compute.manager [None req-93ecf7b4-9f9e-4124-8361-950fdb3cfacc tempest-TestServerVolumeAttachScenarioOldVersion-419113578 tempest-TestServerVolumeAttachScenarioOldVersion-419113578-project-member] [instance: 5d479c64-055b-4496-b3a2-ba10f9095ea8] Instance event wait completed in 0 seconds for  {{(pid=75337) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 15:58:54 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-93ecf7b4-9f9e-4124-8361-950fdb3cfacc tempest-TestServerVolumeAttachScenarioOldVersion-419113578 tempest-TestServerVolumeAttachScenarioOldVersion-419113578-project-member] [instance: 5d479c64-055b-4496-b3a2-ba10f9095ea8] Guest created on hypervisor {{(pid=75337) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 15:58:54 user nova-compute[75337]: INFO nova.virt.libvirt.driver [-] [instance: 5d479c64-055b-4496-b3a2-ba10f9095ea8] Instance spawned successfully.
Nov 06 15:58:54 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-93ecf7b4-9f9e-4124-8361-950fdb3cfacc tempest-TestServerVolumeAttachScenarioOldVersion-419113578 tempest-TestServerVolumeAttachScenarioOldVersion-419113578-project-member] [instance: 5d479c64-055b-4496-b3a2-ba10f9095ea8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 15:58:54 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-93ecf7b4-9f9e-4124-8361-950fdb3cfacc tempest-TestServerVolumeAttachScenarioOldVersion-419113578 tempest-TestServerVolumeAttachScenarioOldVersion-419113578-project-member] [instance: 5d479c64-055b-4496-b3a2-ba10f9095ea8] Found default for hw_cdrom_bus of ide {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:58:54 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-93ecf7b4-9f9e-4124-8361-950fdb3cfacc tempest-TestServerVolumeAttachScenarioOldVersion-419113578 tempest-TestServerVolumeAttachScenarioOldVersion-419113578-project-member] [instance: 5d479c64-055b-4496-b3a2-ba10f9095ea8] Found default for hw_disk_bus of virtio {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:58:54 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-93ecf7b4-9f9e-4124-8361-950fdb3cfacc tempest-TestServerVolumeAttachScenarioOldVersion-419113578 tempest-TestServerVolumeAttachScenarioOldVersion-419113578-project-member] [instance: 5d479c64-055b-4496-b3a2-ba10f9095ea8] Found default for hw_input_bus of None {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:58:54 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-93ecf7b4-9f9e-4124-8361-950fdb3cfacc tempest-TestServerVolumeAttachScenarioOldVersion-419113578 tempest-TestServerVolumeAttachScenarioOldVersion-419113578-project-member] [instance: 5d479c64-055b-4496-b3a2-ba10f9095ea8] Found default for hw_pointer_model of None {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:58:54 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-93ecf7b4-9f9e-4124-8361-950fdb3cfacc tempest-TestServerVolumeAttachScenarioOldVersion-419113578 tempest-TestServerVolumeAttachScenarioOldVersion-419113578-project-member] [instance: 5d479c64-055b-4496-b3a2-ba10f9095ea8] Found default for hw_video_model of virtio {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:58:54 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-93ecf7b4-9f9e-4124-8361-950fdb3cfacc tempest-TestServerVolumeAttachScenarioOldVersion-419113578 tempest-TestServerVolumeAttachScenarioOldVersion-419113578-project-member] [instance: 5d479c64-055b-4496-b3a2-ba10f9095ea8] Found default for hw_vif_model of virtio {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 15:58:55 user nova-compute[75337]: INFO nova.compute.manager [None req-93ecf7b4-9f9e-4124-8361-950fdb3cfacc tempest-TestServerVolumeAttachScenarioOldVersion-419113578 tempest-TestServerVolumeAttachScenarioOldVersion-419113578-project-member] [instance: 5d479c64-055b-4496-b3a2-ba10f9095ea8] Took 5.49 seconds to spawn the instance on the hypervisor.
Nov 06 15:58:55 user nova-compute[75337]: DEBUG nova.compute.manager [None req-93ecf7b4-9f9e-4124-8361-950fdb3cfacc tempest-TestServerVolumeAttachScenarioOldVersion-419113578 tempest-TestServerVolumeAttachScenarioOldVersion-419113578-project-member] [instance: 5d479c64-055b-4496-b3a2-ba10f9095ea8] Checking state {{(pid=75337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 15:58:55 user nova-compute[75337]: INFO nova.compute.manager [None req-93ecf7b4-9f9e-4124-8361-950fdb3cfacc tempest-TestServerVolumeAttachScenarioOldVersion-419113578 tempest-TestServerVolumeAttachScenarioOldVersion-419113578-project-member] [instance: 5d479c64-055b-4496-b3a2-ba10f9095ea8] Took 6.34 seconds to build instance.
Nov 06 15:58:55 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-93ecf7b4-9f9e-4124-8361-950fdb3cfacc tempest-TestServerVolumeAttachScenarioOldVersion-419113578 tempest-TestServerVolumeAttachScenarioOldVersion-419113578-project-member] Lock "5d479c64-055b-4496-b3a2-ba10f9095ea8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.465s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:58:55 user nova-compute[75337]: DEBUG nova.compute.manager [req-7a48291e-5ccb-46eb-9ed0-ae0139f20e9b req-57c22fe2-14c4-4415-aa73-1fe3a99f4335 service nova] [instance: 5d479c64-055b-4496-b3a2-ba10f9095ea8] Received event network-vif-plugged-cf2938cc-3588-4aea-8cb9-e0117e78a628 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:58:55 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-7a48291e-5ccb-46eb-9ed0-ae0139f20e9b req-57c22fe2-14c4-4415-aa73-1fe3a99f4335 service nova] Acquiring lock "5d479c64-055b-4496-b3a2-ba10f9095ea8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:58:55 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-7a48291e-5ccb-46eb-9ed0-ae0139f20e9b req-57c22fe2-14c4-4415-aa73-1fe3a99f4335 service nova] Lock "5d479c64-055b-4496-b3a2-ba10f9095ea8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:58:55 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-7a48291e-5ccb-46eb-9ed0-ae0139f20e9b req-57c22fe2-14c4-4415-aa73-1fe3a99f4335 service nova] Lock "5d479c64-055b-4496-b3a2-ba10f9095ea8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:58:55 user nova-compute[75337]: DEBUG nova.compute.manager [req-7a48291e-5ccb-46eb-9ed0-ae0139f20e9b req-57c22fe2-14c4-4415-aa73-1fe3a99f4335 service nova] [instance: 5d479c64-055b-4496-b3a2-ba10f9095ea8] No waiting events found dispatching network-vif-plugged-cf2938cc-3588-4aea-8cb9-e0117e78a628 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:58:55 user nova-compute[75337]: WARNING nova.compute.manager [req-7a48291e-5ccb-46eb-9ed0-ae0139f20e9b req-57c22fe2-14c4-4415-aa73-1fe3a99f4335 service nova] [instance: 5d479c64-055b-4496-b3a2-ba10f9095ea8] Received unexpected event network-vif-plugged-cf2938cc-3588-4aea-8cb9-e0117e78a628 for instance with vm_state active and task_state None.
Nov 06 15:58:56 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:58:58 user nova-compute[75337]: DEBUG nova.compute.manager [req-14d8d197-4961-40ee-99c4-bbba59e35067 req-9d75d772-3d00-4259-99cf-4faf6e366cac service nova] [instance: f196f2b3-8eac-4d68-af2e-46671c865be1] Received event network-changed-0aa648d4-16ed-4160-92c7-0bb2ce626454 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:58:58 user nova-compute[75337]: DEBUG nova.compute.manager [req-14d8d197-4961-40ee-99c4-bbba59e35067 req-9d75d772-3d00-4259-99cf-4faf6e366cac service nova] [instance: f196f2b3-8eac-4d68-af2e-46671c865be1] Refreshing instance network info cache due to event network-changed-0aa648d4-16ed-4160-92c7-0bb2ce626454. {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 15:58:58 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-14d8d197-4961-40ee-99c4-bbba59e35067 req-9d75d772-3d00-4259-99cf-4faf6e366cac service nova] Acquiring lock "refresh_cache-f196f2b3-8eac-4d68-af2e-46671c865be1" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 15:58:58 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-14d8d197-4961-40ee-99c4-bbba59e35067 req-9d75d772-3d00-4259-99cf-4faf6e366cac service nova] Acquired lock "refresh_cache-f196f2b3-8eac-4d68-af2e-46671c865be1" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 15:58:58 user nova-compute[75337]: DEBUG nova.network.neutron [req-14d8d197-4961-40ee-99c4-bbba59e35067 req-9d75d772-3d00-4259-99cf-4faf6e366cac service nova] [instance: f196f2b3-8eac-4d68-af2e-46671c865be1] Refreshing network info cache for port 0aa648d4-16ed-4160-92c7-0bb2ce626454 {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 15:58:58 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-a91b8593-a0c5-4a3c-83cd-a3686f93a507 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Acquiring lock "f196f2b3-8eac-4d68-af2e-46671c865be1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:58:58 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-a91b8593-a0c5-4a3c-83cd-a3686f93a507 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Lock "f196f2b3-8eac-4d68-af2e-46671c865be1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:58:59 user nova-compute[75337]: DEBUG nova.objects.instance [None req-a91b8593-a0c5-4a3c-83cd-a3686f93a507 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Lazy-loading 'flavor' on Instance uuid f196f2b3-8eac-4d68-af2e-46671c865be1 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 15:58:59 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-a91b8593-a0c5-4a3c-83cd-a3686f93a507 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] [instance: f196f2b3-8eac-4d68-af2e-46671c865be1] Ignoring supplied device name: /dev/vdb
Nov 06 15:58:59 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-a91b8593-a0c5-4a3c-83cd-a3686f93a507 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Lock "f196f2b3-8eac-4d68-af2e-46671c865be1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:58:59 user nova-compute[75337]: DEBUG nova.network.neutron [req-14d8d197-4961-40ee-99c4-bbba59e35067 req-9d75d772-3d00-4259-99cf-4faf6e366cac service nova] [instance: f196f2b3-8eac-4d68-af2e-46671c865be1] Updated VIF entry in instance network info cache for port 0aa648d4-16ed-4160-92c7-0bb2ce626454. {{(pid=75337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 15:58:59 user nova-compute[75337]: DEBUG nova.network.neutron [req-14d8d197-4961-40ee-99c4-bbba59e35067 req-9d75d772-3d00-4259-99cf-4faf6e366cac service nova] [instance: f196f2b3-8eac-4d68-af2e-46671c865be1] Updating instance_info_cache with network_info: [{"id": "0aa648d4-16ed-4160-92c7-0bb2ce626454", "address": "fa:16:3e:1e:b2:da", "network": {"id": "8618d6aa-9df1-421d-916b-422978dc518d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1705024451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "398008f06ed645099ae8be04ac48a3ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0aa648d4-16", "ovs_interfaceid": "0aa648d4-16ed-4160-92c7-0bb2ce626454", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:58:59 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-a91b8593-a0c5-4a3c-83cd-a3686f93a507 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Acquiring lock "f196f2b3-8eac-4d68-af2e-46671c865be1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:58:59 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-a91b8593-a0c5-4a3c-83cd-a3686f93a507 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Lock "f196f2b3-8eac-4d68-af2e-46671c865be1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:58:59 user nova-compute[75337]: INFO nova.compute.manager [None req-a91b8593-a0c5-4a3c-83cd-a3686f93a507 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] [instance: f196f2b3-8eac-4d68-af2e-46671c865be1] Attaching volume 73a377b1-21a8-4273-8632-8daac8cd3a3b to /dev/vdb
Nov 06 15:58:59 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-14d8d197-4961-40ee-99c4-bbba59e35067 req-9d75d772-3d00-4259-99cf-4faf6e366cac service nova] Releasing lock "refresh_cache-f196f2b3-8eac-4d68-af2e-46671c865be1" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 15:58:59 user nova-compute[75337]: DEBUG os_brick.utils [None req-a91b8593-a0c5-4a3c-83cd-a3686f93a507 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 15:58:59 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:58:59 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.025s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:58:59 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b224032-fbe3-4745-afce-175f05c07f79]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4ff6411e45b8\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:58:59 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:58:59 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:58:59 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[81ab8fd9-016d-43cf-80ac-36da2b3e0612]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:58:59 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:58:59 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:58:59 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[61a998ba-6463-4381-893d-7d5992a88033]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:58:59 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[227ef219-ad23-448b-9efc-7607e85f179d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:58:59 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-a91b8593-a0c5-4a3c-83cd-a3686f93a507 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Running cmd (subprocess): nvme version {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:58:59 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-a91b8593-a0c5-4a3c-83cd-a3686f93a507 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] 'nvme version' failed. Not Retrying. {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 15:58:59 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a91b8593-a0c5-4a3c-83cd-a3686f93a507 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] nvme not present on system {{(pid=75337) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 15:58:59 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:58:59 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 15:58:59 user nova-compute[75337]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 15:58:59 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d1c72a2-001b-4bfc-b036-88b7f5039728]: (4, '') {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:58:59 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.lightos [None req-a91b8593-a0c5-4a3c-83cd-a3686f93a507 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75337) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 15:58:59 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.lightos [None req-a91b8593-a0c5-4a3c-83cd-a3686f93a507 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 15:58:59 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.lightos [None req-a91b8593-a0c5-4a3c-83cd-a3686f93a507 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] LIGHTOS: no hostnqn found. {{(pid=75337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 15:58:59 user nova-compute[75337]: DEBUG os_brick.utils [None req-a91b8593-a0c5-4a3c-83cd-a3686f93a507 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] <== get_connector_properties: return (154ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4ff6411e45b8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 15:58:59 user nova-compute[75337]: DEBUG nova.virt.block_device [None req-a91b8593-a0c5-4a3c-83cd-a3686f93a507 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] [instance: f196f2b3-8eac-4d68-af2e-46671c865be1] Updating existing volume attachment record: b1b7cde4-2733-43a8-af37-46603567e98d {{(pid=75337) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 15:58:59 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:59:01 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:59:01 user nova-compute[75337]: DEBUG nova.objects.instance [None req-7f831d4f-1716-42c1-9e23-83853bea6dd2 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Lazy-loading 'flavor' on Instance uuid 69df3824-b28c-43c0-9f20-52fa956642cc {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 15:59:02 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-7f831d4f-1716-42c1-9e23-83853bea6dd2 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Acquiring lock "refresh_cache-69df3824-b28c-43c0-9f20-52fa956642cc" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 15:59:02 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-7f831d4f-1716-42c1-9e23-83853bea6dd2 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Acquired lock "refresh_cache-69df3824-b28c-43c0-9f20-52fa956642cc" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 15:59:02 user nova-compute[75337]: DEBUG nova.network.neutron [None req-7f831d4f-1716-42c1-9e23-83853bea6dd2 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] [instance: 69df3824-b28c-43c0-9f20-52fa956642cc] Building network info cache for instance {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 15:59:02 user nova-compute[75337]: DEBUG nova.objects.instance [None req-7f831d4f-1716-42c1-9e23-83853bea6dd2 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Lazy-loading 'info_cache' on Instance uuid 69df3824-b28c-43c0-9f20-52fa956642cc {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 15:59:02 user nova-compute[75337]: DEBUG nova.objects.base [None req-7f831d4f-1716-42c1-9e23-83853bea6dd2 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Object Instance<69df3824-b28c-43c0-9f20-52fa956642cc> lazy-loaded attributes: flavor,info_cache {{(pid=75337) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 15:59:02 user nova-compute[75337]: DEBUG nova.network.neutron [None req-7f831d4f-1716-42c1-9e23-83853bea6dd2 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] [instance: 69df3824-b28c-43c0-9f20-52fa956642cc] Updating instance_info_cache with network_info: [{"id": "c3d051e2-c3b7-4ee0-aab0-dcf3c0d1d578", "address": "fa:16:3e:7e:b4:bf", "network": {"id": "8b217731-de9e-49bc-84bb-130fd42ede51", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-314618758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98fac9096a3b4f21ba805ba1437d9d38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3d051e2-c3", "ovs_interfaceid": "c3d051e2-c3b7-4ee0-aab0-dcf3c0d1d578", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:59:02 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-7f831d4f-1716-42c1-9e23-83853bea6dd2 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Releasing lock "refresh_cache-69df3824-b28c-43c0-9f20-52fa956642cc" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 15:59:02 user nova-compute[75337]: INFO nova.virt.libvirt.driver [-] [instance: 69df3824-b28c-43c0-9f20-52fa956642cc] Instance destroyed successfully.
Nov 06 15:59:02 user nova-compute[75337]: DEBUG nova.objects.instance [None req-7f831d4f-1716-42c1-9e23-83853bea6dd2 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Lazy-loading 'resources' on Instance uuid 69df3824-b28c-43c0-9f20-52fa956642cc {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 15:59:02 user nova-compute[75337]: DEBUG nova.objects.base [None req-7f831d4f-1716-42c1-9e23-83853bea6dd2 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Object Instance<69df3824-b28c-43c0-9f20-52fa956642cc> lazy-loaded attributes: flavor,info_cache,resources {{(pid=75337) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 15:59:02 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-7f831d4f-1716-42c1-9e23-83853bea6dd2 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T15:54:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1515449710',display_name='tempest-AttachVolumeTestJSON-server-1515449710',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1515449710',id=32,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOuljMPp9i9MDAKWBD5G58tmj+9Tb6PUeli8EGD2jPfBvIyOYYOj/xbR7lXnFQzbgbAGvrz08EfcDEZH0CAoflAb7Id49fT3SM4gKBFBAbvsmqhfX3tP82mW2VMhPkafYg==',key_name='tempest-keypair-396223312',keypairs=<?>,launch_index=0,launched_at=2023-11-06T15:54:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='98fac9096a3b4f21ba805ba1437d9d38',ramdisk_id='',reservation_id='r-ynykuy84',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-636759182',owner_user_name='tempest-AttachVolumeTestJSON-636759182-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T15:57:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ef1008574bea4cfca8a20b2edcf0aacd',uuid=69df3824-b28c-43c0-9f20-52fa956642cc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "c3d051e2-c3b7-4ee0-aab0-dcf3c0d1d578", "address": "fa:16:3e:7e:b4:bf", "network": {"id": "8b217731-de9e-49bc-84bb-130fd42ede51", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-314618758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98fac9096a3b4f21ba805ba1437d9d38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3d051e2-c3", "ovs_interfaceid": "c3d051e2-c3b7-4ee0-aab0-dcf3c0d1d578", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 15:59:02 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-7f831d4f-1716-42c1-9e23-83853bea6dd2 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Converting VIF {"id": "c3d051e2-c3b7-4ee0-aab0-dcf3c0d1d578", "address": "fa:16:3e:7e:b4:bf", "network": {"id": "8b217731-de9e-49bc-84bb-130fd42ede51", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-314618758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98fac9096a3b4f21ba805ba1437d9d38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3d051e2-c3", "ovs_interfaceid": "c3d051e2-c3b7-4ee0-aab0-dcf3c0d1d578", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 15:59:02 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-7f831d4f-1716-42c1-9e23-83853bea6dd2 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:b4:bf,bridge_name='br-int',has_traffic_filtering=True,id=c3d051e2-c3b7-4ee0-aab0-dcf3c0d1d578,network=Network(8b217731-de9e-49bc-84bb-130fd42ede51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3d051e2-c3') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 15:59:02 user nova-compute[75337]: DEBUG os_vif [None req-7f831d4f-1716-42c1-9e23-83853bea6dd2 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:b4:bf,bridge_name='br-int',has_traffic_filtering=True,id=c3d051e2-c3b7-4ee0-aab0-dcf3c0d1d578,network=Network(8b217731-de9e-49bc-84bb-130fd42ede51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3d051e2-c3') {{(pid=75337) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 15:59:02 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:59:02 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc3d051e2-c3, bridge=br-int, if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:59:02 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:59:02 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:59:02 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:59:02 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3fc3e8f3-033d-4cce-a1c5-e0e8aa65b217) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:59:02 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:59:02 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:59:02 user nova-compute[75337]: INFO os_vif [None req-7f831d4f-1716-42c1-9e23-83853bea6dd2 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:b4:bf,bridge_name='br-int',has_traffic_filtering=True,id=c3d051e2-c3b7-4ee0-aab0-dcf3c0d1d578,network=Network(8b217731-de9e-49bc-84bb-130fd42ede51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3d051e2-c3')
Nov 06 15:59:02 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f831d4f-1716-42c1-9e23-83853bea6dd2 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] [instance: 69df3824-b28c-43c0-9f20-52fa956642cc] calling os-brick to detach iSCSI Volume {{(pid=75337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 15:59:02 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f831d4f-1716-42c1-9e23-83853bea6dd2 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2abc33d0c0>, {'target_iqn': 'iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'csbVPIWq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 15:59:02 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-7f831d4f-1716-42c1-9e23-83853bea6dd2 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 15:59:02 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-7f831d4f-1716-42c1-9e23-83853bea6dd2 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 15:59:02 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-7f831d4f-1716-42c1-9e23-83853bea6dd2 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 15:59:02 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:59:02 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:59:02 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[24081ae8-574b-4977-b2de-e91ad406350b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:326a132a-07d4-4085-8da9-ffa8444121b5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:59:02 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f831d4f-1716-42c1-9e23-83853bea6dd2 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 15:59:02 user nova-compute[75337]: No targets found.
Nov 06 15:59:02 user nova-compute[75337]: iSNS:
Nov 06 15:59:02 user nova-compute[75337]: No targets found.
Nov 06 15:59:02 user nova-compute[75337]: STATIC:
Nov 06 15:59:02 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:326a132a-07d4-4085-8da9-ffa8444121b5
Nov 06 15:59:02 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 15:59:02 user nova-compute[75337]:                 Iface Name: default
Nov 06 15:59:02 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da
Nov 06 15:59:02 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 15:59:02 user nova-compute[75337]:                 Iface Name: default
Nov 06 15:59:02 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8
Nov 06 15:59:02 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 15:59:02 user nova-compute[75337]:                 Iface Name: default
Nov 06 15:59:02 user nova-compute[75337]: FIRMWARE:
Nov 06 15:59:02 user nova-compute[75337]: No targets found.
Nov 06 15:59:02 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 15:59:02 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f831d4f-1716-42c1-9e23-83853bea6dd2 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 15:59:02 user nova-compute[75337]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 15:59:02 user nova-compute[75337]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75337) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 15:59:02 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f831d4f-1716-42c1-9e23-83853bea6dd2 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da', 0)] {{(pid=75337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 15:59:02 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:59:02 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:59:02 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[28f79414-4f78-4fd7-b6ea-a31ffb7f0de9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:326a132a-07d4-4085-8da9-ffa8444121b5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:59:02 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:59:02 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:59:02 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bbda202-b411-43c0-9088-dbdbdc903541]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326a132a-07d4-4085-8da9-ffa8444121b5 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8 (non-flash)\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:59:02 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f831d4f-1716-42c1-9e23-83853bea6dd2 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326a132a-07d4-4085-8da9-ffa8444121b5 (non-flash)
Nov 06 15:59:02 user nova-compute[75337]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da (non-flash)
Nov 06 15:59:02 user nova-compute[75337]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8 (non-flash)
Nov 06 15:59:02 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 15:59:02 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f831d4f-1716-42c1-9e23-83853bea6dd2 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326a132a-07d4-4085-8da9-ffa8444121b5 (non-flash)
Nov 06 15:59:02 user nova-compute[75337]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da (non-flash)
Nov 06 15:59:02 user nova-compute[75337]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8 (non-flash)
Nov 06 15:59:02 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 15:59:02 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f831d4f-1716-42c1-9e23-83853bea6dd2 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2ac404a200>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da'): ({'sdd'}, set())}) {{(pid=75337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 15:59:02 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-7f831d4f-1716-42c1-9e23-83853bea6dd2 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Removing single pathed devices sdd {{(pid=75337) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 15:59:02 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:59:02 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:59:02 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec93f0da-f59d-4128-a4d9-fee69e94cda8]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:59:02 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:59:02 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:59:02 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8627967-82f1-4aa1-b620-1e84861f80fa]: (4, ('ok\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:59:02 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-7f831d4f-1716-42c1-9e23-83853bea6dd2 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Flushing IO for device /dev/sdd {{(pid=75337) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 15:59:02 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:59:02 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:59:02 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[b242850e-b033-4f4b-a096-5f3243bb67f8]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:59:02 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-7f831d4f-1716-42c1-9e23-83853bea6dd2 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75337) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 15:59:02 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:59:02 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.050s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:59:02 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bfa0669-fe2e-4255-9a33-183851fd64db]: (4, ('1', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:59:02 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-7f831d4f-1716-42c1-9e23-83853bea6dd2 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 15:59:02 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-7f831d4f-1716-42c1-9e23-83853bea6dd2 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] SCSI volumes sdd have been removed. {{(pid=75337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 15:59:02 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f831d4f-1716-42c1-9e23-83853bea6dd2 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da')] {{(pid=75337) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 15:59:02 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:59:02 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:59:02 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb5f92d2-e03c-4f56-95c8-62f6d1d27e71]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:59:02 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f831d4f-1716-42c1-9e23-83853bea6dd2 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:59:02 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da -p 172.16.0.220:3260 --logout {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:59:02 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:59:02 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[920bcdc7-06d7-4d14-a2ad-1a91fa19387f]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:59:02 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f831d4f-1716-42c1-9e23-83853bea6dd2 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da, portal: 172.16.0.220,3260]
Nov 06 15:59:02 user nova-compute[75337]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da, portal: 172.16.0.220,3260] successful.
Nov 06 15:59:02 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:59:02 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da -p 172.16.0.220:3260 --op delete {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:59:02 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:59:02 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[28d73d85-6aed-4ff0-bbe5-08f7108c9388]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:59:02 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f831d4f-1716-42c1-9e23-83853bea6dd2 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:59:02 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-7f831d4f-1716-42c1-9e23-83853bea6dd2 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.331s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 15:59:02 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f831d4f-1716-42c1-9e23-83853bea6dd2 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] <== disconnect_volume: return (332ms) None {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 15:59:02 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f831d4f-1716-42c1-9e23-83853bea6dd2 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] [instance: 69df3824-b28c-43c0-9f20-52fa956642cc] Disconnected iSCSI Volume {{(pid=75337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 15:59:02 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-7f831d4f-1716-42c1-9e23-83853bea6dd2 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] [instance: 69df3824-b28c-43c0-9f20-52fa956642cc] Start _get_guest_xml network_info=[{"id": "c3d051e2-c3b7-4ee0-aab0-dcf3c0d1d578", "address": "fa:16:3e:7e:b4:bf", "network": {"id": "8b217731-de9e-49bc-84bb-130fd42ede51", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-314618758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98fac9096a3b4f21ba805ba1437d9d38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3d051e2-c3", "ovs_interfaceid": "c3d051e2-c3b7-4ee0-aab0-dcf3c0d1d578", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=16b903ae-a40f-41a7-985b-4804cce92c62,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'guest_format': None, 'size': 0, 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '16b903ae-a40f-41a7-985b-4804cce92c62'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'attachment_id': 'ec9ae61b-1749-4c51-ba77-d135a5c32f96', 'guest_format': None, 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'csbVPIWq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '69df3824-b28c-43c0-9f20-52fa956642cc', 'attached_at': '', 'detached_at': '', 'volume_id': '27fe0158-ccd9-4398-ad6f-5622476733da', 'serial': '27fe0158-ccd9-4398-ad6f-5622476733da'}, 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=75337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 15:59:02 user nova-compute[75337]: DEBUG nova.objects.instance [None req-7f831d4f-1716-42c1-9e23-83853bea6dd2 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Lazy-loading 'numa_topology' on Instance uuid 69df3824-b28c-43c0-9f20-52fa956642cc {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 15:59:02 user nova-compute[75337]: DEBUG nova.objects.base [None req-7f831d4f-1716-42c1-9e23-83853bea6dd2 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Object Instance<69df3824-b28c-43c0-9f20-52fa956642cc> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=75337) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 15:59:02 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-7f831d4f-1716-42c1-9e23-83853bea6dd2 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 15:59:02 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-7f831d4f-1716-42c1-9e23-83853bea6dd2 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 15:59:03 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-7f831d4f-1716-42c1-9e23-83853bea6dd2 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 15:59:03 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-7f831d4f-1716-42c1-9e23-83853bea6dd2 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] CPU controller missing on host. {{(pid=75337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 15:59:03 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-7f831d4f-1716-42c1-9e23-83853bea6dd2 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 15:59:03 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-7f831d4f-1716-42c1-9e23-83853bea6dd2 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] CPU controller found on host. {{(pid=75337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 15:59:03 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-7f831d4f-1716-42c1-9e23-83853bea6dd2 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75337) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 15:59:03 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-7f831d4f-1716-42c1-9e23-83853bea6dd2 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T15:34:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=16b903ae-a40f-41a7-985b-4804cce92c62,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 15:59:03 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-7f831d4f-1716-42c1-9e23-83853bea6dd2 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Flavor limits 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 15:59:03 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-7f831d4f-1716-42c1-9e23-83853bea6dd2 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Image limits 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 15:59:03 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-7f831d4f-1716-42c1-9e23-83853bea6dd2 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Flavor pref 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 15:59:03 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-7f831d4f-1716-42c1-9e23-83853bea6dd2 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Image pref 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 15:59:03 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-7f831d4f-1716-42c1-9e23-83853bea6dd2 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 15:59:03 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-7f831d4f-1716-42c1-9e23-83853bea6dd2 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 15:59:03 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-7f831d4f-1716-42c1-9e23-83853bea6dd2 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 15:59:03 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-7f831d4f-1716-42c1-9e23-83853bea6dd2 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Got 1 possible topologies {{(pid=75337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 15:59:03 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-7f831d4f-1716-42c1-9e23-83853bea6dd2 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 15:59:03 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-7f831d4f-1716-42c1-9e23-83853bea6dd2 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 15:59:03 user nova-compute[75337]: DEBUG nova.objects.instance [None req-7f831d4f-1716-42c1-9e23-83853bea6dd2 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Lazy-loading 'vcpu_model' on Instance uuid 69df3824-b28c-43c0-9f20-52fa956642cc {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 15:59:03 user nova-compute[75337]: DEBUG nova.objects.base [None req-7f831d4f-1716-42c1-9e23-83853bea6dd2 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Object Instance<69df3824-b28c-43c0-9f20-52fa956642cc> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=75337) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 15:59:03 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f831d4f-1716-42c1-9e23-83853bea6dd2 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] [instance: 69df3824-b28c-43c0-9f20-52fa956642cc] Calling os-brick to attach iSCSI Volume {{(pid=75337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 15:59:03 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f831d4f-1716-42c1-9e23-83853bea6dd2 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2abc33d0c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'csbVPIWq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 15:59:03 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-7f831d4f-1716-42c1-9e23-83853bea6dd2 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 15:59:03 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-7f831d4f-1716-42c1-9e23-83853bea6dd2 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 15:59:03 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-7f831d4f-1716-42c1-9e23-83853bea6dd2 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 15:59:03 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-7f831d4f-1716-42c1-9e23-83853bea6dd2 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 15:59:03 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-7f831d4f-1716-42c1-9e23-83853bea6dd2 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 15:59:03 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-7f831d4f-1716-42c1-9e23-83853bea6dd2 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 15:59:03 user nova-compute[75337]: INFO os_brick.initiator.connectors.iscsi [None req-7f831d4f-1716-42c1-9e23-83853bea6dd2 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 15:59:03 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da -p 172.16.0.220:3260 {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:59:03 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:59:03 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[848db96f-2a28-4428-93e1-74e06b611914]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:59:03 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f831d4f-1716-42c1-9e23-83853bea6dd2 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 15:59:03 user nova-compute[75337]:  {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:59:03 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da -p 172.16.0.220:3260 --interface default --op new {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:59:03 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:59:03 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[df945547-558b-45fb-b209-671f89cfc458]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da] added\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:59:03 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f831d4f-1716-42c1-9e23-83853bea6dd2 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da] added
Nov 06 15:59:03 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:59:03 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:59:03 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:59:03 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e488127-2f70-40f7-8104-d9fd583eac03]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:59:03 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f831d4f-1716-42c1-9e23-83853bea6dd2 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:59:03 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:59:03 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:59:03 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[deca97b2-c537-47ff-9546-7c8fca6b9828]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:59:03 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f831d4f-1716-42c1-9e23-83853bea6dd2 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:59:03 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da -p 172.16.0.220:3260 --op update -n node.session.auth.username -v csbVPIWq {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:59:03 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da -p 172.16.0.220:3260 --op update -n node.session.auth.username -v csbVPIWq" returned: 0 in 0.018s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:59:03 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7466e97-668d-4605-b048-82ac7d056697]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:59:03 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f831d4f-1716-42c1-9e23-83853bea6dd2 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'csbVPIWq'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:59:03 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:59:03 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:59:03 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[31df9a8b-2a01-452e-9d87-ef0ac1b53488]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:59:03 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f831d4f-1716-42c1-9e23-83853bea6dd2 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:59:03 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:59:03 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:59:03 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfaa8494-c3f9-4e2a-86e0-faecae59cb85]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326a132a-07d4-4085-8da9-ffa8444121b5 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8 (non-flash)\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:59:03 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f831d4f-1716-42c1-9e23-83853bea6dd2 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326a132a-07d4-4085-8da9-ffa8444121b5 (non-flash)
Nov 06 15:59:03 user nova-compute[75337]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8 (non-flash)
Nov 06 15:59:03 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 15:59:03 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f831d4f-1716-42c1-9e23-83853bea6dd2 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326a132a-07d4-4085-8da9-ffa8444121b5 (non-flash)
Nov 06 15:59:03 user nova-compute[75337]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8 (non-flash)
Nov 06 15:59:03 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 15:59:03 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da -p 172.16.0.220:3260 --login {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:59:03 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da -p 172.16.0.220:3260 --login" returned: 0 in 0.162s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:59:03 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[68d21a5e-f7d9-4a70-9af0-88e5e5fc24c8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:59:03 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f831d4f-1716-42c1-9e23-83853bea6dd2 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da, portal: 172.16.0.220,3260]
Nov 06 15:59:03 user nova-compute[75337]: Login to [iface: default, target: iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da, portal: 172.16.0.220,3260] successful.
Nov 06 15:59:03 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:59:03 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:59:03 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:59:03 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[84676964-0099-4765-b73d-73b9f66cf952]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:59:03 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f831d4f-1716-42c1-9e23-83853bea6dd2 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:59:03 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:59:03 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:59:03 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[d92599c2-6f96-4a47-9078-18b5cb7b0e07]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326a132a-07d4-4085-8da9-ffa8444121b5 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da (non-flash)\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:59:03 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f831d4f-1716-42c1-9e23-83853bea6dd2 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326a132a-07d4-4085-8da9-ffa8444121b5 (non-flash)
Nov 06 15:59:03 user nova-compute[75337]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8 (non-flash)
Nov 06 15:59:03 user nova-compute[75337]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da (non-flash)
Nov 06 15:59:03 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 15:59:03 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f831d4f-1716-42c1-9e23-83853bea6dd2 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326a132a-07d4-4085-8da9-ffa8444121b5 (non-flash)
Nov 06 15:59:03 user nova-compute[75337]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8 (non-flash)
Nov 06 15:59:03 user nova-compute[75337]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da (non-flash)
Nov 06 15:59:03 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 15:59:03 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-7f831d4f-1716-42c1-9e23-83853bea6dd2 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.390s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 15:59:03 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f831d4f-1716-42c1-9e23-83853bea6dd2 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Connected to 172.16.0.220:3260 {{(pid=75337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 15:59:03 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-7f831d4f-1716-42c1-9e23-83853bea6dd2 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] HCTL ('34', '-', '-', 0) found on session 39 with lun 0 {{(pid=75337) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 15:59:03 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-7f831d4f-1716-42c1-9e23-83853bea6dd2 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75337) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 15:59:03 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:59:03 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:59:03 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d530f61-9742-4fcf-b2fe-977ff6b4eefe]: (4, ('- - 0', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:59:03 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-7f831d4f-1716-42c1-9e23-83853bea6dd2 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Searching for a device in session 39 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75337) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 15:59:03 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f831d4f-1716-42c1-9e23-83853bea6dd2 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'csbVPIWq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 15:59:04 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:59:04 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-7f831d4f-1716-42c1-9e23-83853bea6dd2 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.421s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 15:59:04 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f831d4f-1716-42c1-9e23-83853bea6dd2 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] <== connect_volume: return (1423ms) {'type': 'block', 'scsi_wwn': '26664623735613735', 'path': '/dev/sdc'} {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 15:59:04 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f831d4f-1716-42c1-9e23-83853bea6dd2 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] [instance: 69df3824-b28c-43c0-9f20-52fa956642cc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26664623735613735', 'path': '/dev/sdc'} {{(pid=75337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 15:59:04 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-7f831d4f-1716-42c1-9e23-83853bea6dd2 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T15:54:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1515449710',display_name='tempest-AttachVolumeTestJSON-server-1515449710',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1515449710',id=32,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOuljMPp9i9MDAKWBD5G58tmj+9Tb6PUeli8EGD2jPfBvIyOYYOj/xbR7lXnFQzbgbAGvrz08EfcDEZH0CAoflAb7Id49fT3SM4gKBFBAbvsmqhfX3tP82mW2VMhPkafYg==',key_name='tempest-keypair-396223312',keypairs=<?>,launch_index=0,launched_at=2023-11-06T15:54:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='98fac9096a3b4f21ba805ba1437d9d38',ramdisk_id='',reservation_id='r-ynykuy84',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-636759182',owner_user_name='tempest-AttachVolumeTestJSON-636759182-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T15:57:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ef1008574bea4cfca8a20b2edcf0aacd',uuid=69df3824-b28c-43c0-9f20-52fa956642cc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "c3d051e2-c3b7-4ee0-aab0-dcf3c0d1d578", "address": "fa:16:3e:7e:b4:bf", "network": {"id": "8b217731-de9e-49bc-84bb-130fd42ede51", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-314618758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98fac9096a3b4f21ba805ba1437d9d38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3d051e2-c3", "ovs_interfaceid": "c3d051e2-c3b7-4ee0-aab0-dcf3c0d1d578", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75337) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 15:59:04 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-7f831d4f-1716-42c1-9e23-83853bea6dd2 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Converting VIF {"id": "c3d051e2-c3b7-4ee0-aab0-dcf3c0d1d578", "address": "fa:16:3e:7e:b4:bf", "network": {"id": "8b217731-de9e-49bc-84bb-130fd42ede51", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-314618758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98fac9096a3b4f21ba805ba1437d9d38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3d051e2-c3", "ovs_interfaceid": "c3d051e2-c3b7-4ee0-aab0-dcf3c0d1d578", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 15:59:04 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-7f831d4f-1716-42c1-9e23-83853bea6dd2 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:b4:bf,bridge_name='br-int',has_traffic_filtering=True,id=c3d051e2-c3b7-4ee0-aab0-dcf3c0d1d578,network=Network(8b217731-de9e-49bc-84bb-130fd42ede51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3d051e2-c3') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 15:59:04 user nova-compute[75337]: DEBUG nova.objects.instance [None req-7f831d4f-1716-42c1-9e23-83853bea6dd2 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Lazy-loading 'pci_devices' on Instance uuid 69df3824-b28c-43c0-9f20-52fa956642cc {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 15:59:04 user nova-compute[75337]: DEBUG nova.objects.base [None req-7f831d4f-1716-42c1-9e23-83853bea6dd2 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Object Instance<69df3824-b28c-43c0-9f20-52fa956642cc> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=75337) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 15:59:04 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-7f831d4f-1716-42c1-9e23-83853bea6dd2 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] [instance: 69df3824-b28c-43c0-9f20-52fa956642cc] End _get_guest_xml xml=<domain type="kvm">
Nov 06 15:59:04 user nova-compute[75337]:   <uuid>69df3824-b28c-43c0-9f20-52fa956642cc</uuid>
Nov 06 15:59:04 user nova-compute[75337]:   <name>instance-00000020</name>
Nov 06 15:59:04 user nova-compute[75337]:   <memory>524288</memory>
Nov 06 15:59:04 user nova-compute[75337]:   <vcpu>1</vcpu>
Nov 06 15:59:04 user nova-compute[75337]:   <metadata>
Nov 06 15:59:04 user nova-compute[75337]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 15:59:04 user nova-compute[75337]:       <nova:package version="0.0.0"/>
Nov 06 15:59:04 user nova-compute[75337]:       <nova:name>tempest-AttachVolumeTestJSON-server-1515449710</nova:name>
Nov 06 15:59:04 user nova-compute[75337]:       <nova:creationTime>2023-11-06 15:59:02</nova:creationTime>
Nov 06 15:59:04 user nova-compute[75337]:       <nova:flavor name="m1.tiny">
Nov 06 15:59:04 user nova-compute[75337]:         <nova:memory>512</nova:memory>
Nov 06 15:59:04 user nova-compute[75337]:         <nova:disk>1</nova:disk>
Nov 06 15:59:04 user nova-compute[75337]:         <nova:swap>0</nova:swap>
Nov 06 15:59:04 user nova-compute[75337]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 15:59:04 user nova-compute[75337]:         <nova:vcpus>1</nova:vcpus>
Nov 06 15:59:04 user nova-compute[75337]:       </nova:flavor>
Nov 06 15:59:04 user nova-compute[75337]:       <nova:owner>
Nov 06 15:59:04 user nova-compute[75337]:         <nova:user uuid="ef1008574bea4cfca8a20b2edcf0aacd">tempest-AttachVolumeTestJSON-636759182-project-member</nova:user>
Nov 06 15:59:04 user nova-compute[75337]:         <nova:project uuid="98fac9096a3b4f21ba805ba1437d9d38">tempest-AttachVolumeTestJSON-636759182</nova:project>
Nov 06 15:59:04 user nova-compute[75337]:       </nova:owner>
Nov 06 15:59:04 user nova-compute[75337]:       <nova:root type="image" uuid="16b903ae-a40f-41a7-985b-4804cce92c62"/>
Nov 06 15:59:04 user nova-compute[75337]:       <nova:ports>
Nov 06 15:59:04 user nova-compute[75337]:         <nova:port uuid="c3d051e2-c3b7-4ee0-aab0-dcf3c0d1d578">
Nov 06 15:59:04 user nova-compute[75337]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 06 15:59:04 user nova-compute[75337]:         </nova:port>
Nov 06 15:59:04 user nova-compute[75337]:       </nova:ports>
Nov 06 15:59:04 user nova-compute[75337]:     </nova:instance>
Nov 06 15:59:04 user nova-compute[75337]:   </metadata>
Nov 06 15:59:04 user nova-compute[75337]:   <sysinfo type="smbios">
Nov 06 15:59:04 user nova-compute[75337]:     <system>
Nov 06 15:59:04 user nova-compute[75337]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 15:59:04 user nova-compute[75337]:       <entry name="product">OpenStack Nova</entry>
Nov 06 15:59:04 user nova-compute[75337]:       <entry name="version">0.0.0</entry>
Nov 06 15:59:04 user nova-compute[75337]:       <entry name="serial">69df3824-b28c-43c0-9f20-52fa956642cc</entry>
Nov 06 15:59:04 user nova-compute[75337]:       <entry name="uuid">69df3824-b28c-43c0-9f20-52fa956642cc</entry>
Nov 06 15:59:04 user nova-compute[75337]:       <entry name="family">Virtual Machine</entry>
Nov 06 15:59:04 user nova-compute[75337]:     </system>
Nov 06 15:59:04 user nova-compute[75337]:   </sysinfo>
Nov 06 15:59:04 user nova-compute[75337]:   <os>
Nov 06 15:59:04 user nova-compute[75337]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 15:59:04 user nova-compute[75337]:     <boot dev="hd"/>
Nov 06 15:59:04 user nova-compute[75337]:     <smbios mode="sysinfo"/>
Nov 06 15:59:04 user nova-compute[75337]:   </os>
Nov 06 15:59:04 user nova-compute[75337]:   <features>
Nov 06 15:59:04 user nova-compute[75337]:     <acpi/>
Nov 06 15:59:04 user nova-compute[75337]:     <apic/>
Nov 06 15:59:04 user nova-compute[75337]:     <vmcoreinfo/>
Nov 06 15:59:04 user nova-compute[75337]:   </features>
Nov 06 15:59:04 user nova-compute[75337]:   <clock offset="utc">
Nov 06 15:59:04 user nova-compute[75337]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 15:59:04 user nova-compute[75337]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 15:59:04 user nova-compute[75337]:     <timer name="hpet" present="no"/>
Nov 06 15:59:04 user nova-compute[75337]:   </clock>
Nov 06 15:59:04 user nova-compute[75337]:   <cpu mode="custom" match="exact">
Nov 06 15:59:04 user nova-compute[75337]:     <model>Nehalem</model>
Nov 06 15:59:04 user nova-compute[75337]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 15:59:04 user nova-compute[75337]:   </cpu>
Nov 06 15:59:04 user nova-compute[75337]:   <devices>
Nov 06 15:59:04 user nova-compute[75337]:     <disk type="file" device="disk">
Nov 06 15:59:04 user nova-compute[75337]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 15:59:04 user nova-compute[75337]:       <source file="/opt/stack/data/nova/instances/69df3824-b28c-43c0-9f20-52fa956642cc/disk"/>
Nov 06 15:59:04 user nova-compute[75337]:       <target dev="vda" bus="virtio"/>
Nov 06 15:59:04 user nova-compute[75337]:     </disk>
Nov 06 15:59:04 user nova-compute[75337]:     <disk type="block" device="disk">
Nov 06 15:59:04 user nova-compute[75337]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 15:59:04 user nova-compute[75337]:       <source dev="/dev/sdc"/>
Nov 06 15:59:04 user nova-compute[75337]:       <target dev="vdb" bus="virtio"/>
Nov 06 15:59:04 user nova-compute[75337]:       <serial>27fe0158-ccd9-4398-ad6f-5622476733da</serial>
Nov 06 15:59:04 user nova-compute[75337]:     </disk>
Nov 06 15:59:04 user nova-compute[75337]:     <interface type="ethernet">
Nov 06 15:59:04 user nova-compute[75337]:       <mac address="fa:16:3e:7e:b4:bf"/>
Nov 06 15:59:04 user nova-compute[75337]:       <model type="virtio"/>
Nov 06 15:59:04 user nova-compute[75337]:       <mtu size="1442"/>
Nov 06 15:59:04 user nova-compute[75337]:       <target dev="tapc3d051e2-c3"/>
Nov 06 15:59:04 user nova-compute[75337]:     </interface>
Nov 06 15:59:04 user nova-compute[75337]:     <serial type="pty">
Nov 06 15:59:04 user nova-compute[75337]:       <log file="/opt/stack/data/nova/instances/69df3824-b28c-43c0-9f20-52fa956642cc/console.log" append="off"/>
Nov 06 15:59:04 user nova-compute[75337]:     </serial>
Nov 06 15:59:04 user nova-compute[75337]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 15:59:04 user nova-compute[75337]:     <video>
Nov 06 15:59:04 user nova-compute[75337]:       <model type="virtio"/>
Nov 06 15:59:04 user nova-compute[75337]:     </video>
Nov 06 15:59:04 user nova-compute[75337]:     <rng model="virtio">
Nov 06 15:59:04 user nova-compute[75337]:       <backend model="random">/dev/urandom</backend>
Nov 06 15:59:04 user nova-compute[75337]:     </rng>
Nov 06 15:59:04 user nova-compute[75337]:     <controller type="usb" index="0" model="none"/>
Nov 06 15:59:04 user nova-compute[75337]:     <memballoon model="virtio">
Nov 06 15:59:04 user nova-compute[75337]:       <stats period="10"/>
Nov 06 15:59:04 user nova-compute[75337]:     </memballoon>
Nov 06 15:59:04 user nova-compute[75337]:   </devices>
Nov 06 15:59:04 user nova-compute[75337]: </domain>
Nov 06 15:59:04 user nova-compute[75337]:  {{(pid=75337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 15:59:04 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-7f831d4f-1716-42c1-9e23-83853bea6dd2 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69df3824-b28c-43c0-9f20-52fa956642cc/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:59:04 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-7f831d4f-1716-42c1-9e23-83853bea6dd2 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69df3824-b28c-43c0-9f20-52fa956642cc/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:59:04 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-7f831d4f-1716-42c1-9e23-83853bea6dd2 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69df3824-b28c-43c0-9f20-52fa956642cc/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:59:04 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-7f831d4f-1716-42c1-9e23-83853bea6dd2 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69df3824-b28c-43c0-9f20-52fa956642cc/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:59:04 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-7f831d4f-1716-42c1-9e23-83853bea6dd2 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 15:59:04 user nova-compute[75337]: DEBUG nova.objects.instance [None req-7f831d4f-1716-42c1-9e23-83853bea6dd2 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Lazy-loading 'trusted_certs' on Instance uuid 69df3824-b28c-43c0-9f20-52fa956642cc {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 15:59:04 user nova-compute[75337]: DEBUG nova.objects.base [None req-7f831d4f-1716-42c1-9e23-83853bea6dd2 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Object Instance<69df3824-b28c-43c0-9f20-52fa956642cc> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=75337) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 15:59:04 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-7f831d4f-1716-42c1-9e23-83853bea6dd2 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:59:05 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-7f831d4f-1716-42c1-9e23-83853bea6dd2 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json" returned: 0 in 0.201s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:59:05 user nova-compute[75337]: DEBUG nova.virt.disk.api [None req-7f831d4f-1716-42c1-9e23-83853bea6dd2 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Checking if we can resize image /opt/stack/data/nova/instances/69df3824-b28c-43c0-9f20-52fa956642cc/disk. size=1073741824 {{(pid=75337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 15:59:05 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-7f831d4f-1716-42c1-9e23-83853bea6dd2 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69df3824-b28c-43c0-9f20-52fa956642cc/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:59:05 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-7f831d4f-1716-42c1-9e23-83853bea6dd2 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69df3824-b28c-43c0-9f20-52fa956642cc/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:59:05 user nova-compute[75337]: DEBUG nova.virt.disk.api [None req-7f831d4f-1716-42c1-9e23-83853bea6dd2 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Cannot resize image /opt/stack/data/nova/instances/69df3824-b28c-43c0-9f20-52fa956642cc/disk to a smaller size. {{(pid=75337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 06 15:59:05 user nova-compute[75337]: DEBUG nova.objects.instance [None req-7f831d4f-1716-42c1-9e23-83853bea6dd2 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Lazy-loading 'migration_context' on Instance uuid 69df3824-b28c-43c0-9f20-52fa956642cc {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 15:59:05 user nova-compute[75337]: DEBUG nova.objects.base [None req-7f831d4f-1716-42c1-9e23-83853bea6dd2 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Object Instance<69df3824-b28c-43c0-9f20-52fa956642cc> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75337) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 15:59:05 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-7f831d4f-1716-42c1-9e23-83853bea6dd2 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T15:54:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1515449710',display_name='tempest-AttachVolumeTestJSON-server-1515449710',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1515449710',id=32,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOuljMPp9i9MDAKWBD5G58tmj+9Tb6PUeli8EGD2jPfBvIyOYYOj/xbR7lXnFQzbgbAGvrz08EfcDEZH0CAoflAb7Id49fT3SM4gKBFBAbvsmqhfX3tP82mW2VMhPkafYg==',key_name='tempest-keypair-396223312',keypairs=<?>,launch_index=0,launched_at=2023-11-06T15:54:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='98fac9096a3b4f21ba805ba1437d9d38',ramdisk_id='',reservation_id='r-ynykuy84',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-636759182',owner_user_name='tempest-AttachVolumeTestJSON-636759182-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T15:57:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ef1008574bea4cfca8a20b2edcf0aacd',uuid=69df3824-b28c-43c0-9f20-52fa956642cc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "c3d051e2-c3b7-4ee0-aab0-dcf3c0d1d578", "address": "fa:16:3e:7e:b4:bf", "network": {"id": "8b217731-de9e-49bc-84bb-130fd42ede51", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-314618758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98fac9096a3b4f21ba805ba1437d9d38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3d051e2-c3", "ovs_interfaceid": "c3d051e2-c3b7-4ee0-aab0-dcf3c0d1d578", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 15:59:05 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-7f831d4f-1716-42c1-9e23-83853bea6dd2 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Converting VIF {"id": "c3d051e2-c3b7-4ee0-aab0-dcf3c0d1d578", "address": "fa:16:3e:7e:b4:bf", "network": {"id": "8b217731-de9e-49bc-84bb-130fd42ede51", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-314618758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98fac9096a3b4f21ba805ba1437d9d38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3d051e2-c3", "ovs_interfaceid": "c3d051e2-c3b7-4ee0-aab0-dcf3c0d1d578", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 15:59:05 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-7f831d4f-1716-42c1-9e23-83853bea6dd2 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:b4:bf,bridge_name='br-int',has_traffic_filtering=True,id=c3d051e2-c3b7-4ee0-aab0-dcf3c0d1d578,network=Network(8b217731-de9e-49bc-84bb-130fd42ede51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3d051e2-c3') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 15:59:05 user nova-compute[75337]: DEBUG os_vif [None req-7f831d4f-1716-42c1-9e23-83853bea6dd2 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:b4:bf,bridge_name='br-int',has_traffic_filtering=True,id=c3d051e2-c3b7-4ee0-aab0-dcf3c0d1d578,network=Network(8b217731-de9e-49bc-84bb-130fd42ede51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3d051e2-c3') {{(pid=75337) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 15:59:05 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:59:05 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:59:05 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 15:59:05 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:59:05 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a1c5462e-d3d3-518f-b0be-d8b7089a6f60', '_type': 'linux-noop'}}, row=False) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:59:05 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:59:05 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:59:05 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:59:05 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc3d051e2-c3, may_exist=True, interface_attrs={}) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:59:05 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc3d051e2-c3, col_values=(('qos', UUID('a974a33b-cfe6-4c01-988d-932926cd6c21')),), if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:59:05 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc3d051e2-c3, col_values=(('external_ids', {'iface-id': 'c3d051e2-c3b7-4ee0-aab0-dcf3c0d1d578', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7e:b4:bf', 'vm-uuid': '69df3824-b28c-43c0-9f20-52fa956642cc'}),), if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 15:59:05 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:59:05 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 15:59:05 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:59:05 user nova-compute[75337]: INFO os_vif [None req-7f831d4f-1716-42c1-9e23-83853bea6dd2 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:b4:bf,bridge_name='br-int',has_traffic_filtering=True,id=c3d051e2-c3b7-4ee0-aab0-dcf3c0d1d578,network=Network(8b217731-de9e-49bc-84bb-130fd42ede51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3d051e2-c3')
Nov 06 15:59:06 user nova-compute[75337]: DEBUG nova.compute.manager [req-975f2980-9b2d-43f0-9de4-fb714300941f req-436ccd9a-a3c0-4db9-9dc9-bbb115057ff1 service nova] [instance: d10b4a86-8b0d-423f-81e2-87f5f25a2467] Received event network-changed-f9232e10-c7da-42d1-91c6-d72b0a1e0ccb {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:59:06 user nova-compute[75337]: DEBUG nova.compute.manager [req-975f2980-9b2d-43f0-9de4-fb714300941f req-436ccd9a-a3c0-4db9-9dc9-bbb115057ff1 service nova] [instance: d10b4a86-8b0d-423f-81e2-87f5f25a2467] Refreshing instance network info cache due to event network-changed-f9232e10-c7da-42d1-91c6-d72b0a1e0ccb. {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 15:59:06 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-975f2980-9b2d-43f0-9de4-fb714300941f req-436ccd9a-a3c0-4db9-9dc9-bbb115057ff1 service nova] Acquiring lock "refresh_cache-d10b4a86-8b0d-423f-81e2-87f5f25a2467" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 15:59:06 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-975f2980-9b2d-43f0-9de4-fb714300941f req-436ccd9a-a3c0-4db9-9dc9-bbb115057ff1 service nova] Acquired lock "refresh_cache-d10b4a86-8b0d-423f-81e2-87f5f25a2467" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 15:59:06 user nova-compute[75337]: DEBUG nova.network.neutron [req-975f2980-9b2d-43f0-9de4-fb714300941f req-436ccd9a-a3c0-4db9-9dc9-bbb115057ff1 service nova] [instance: d10b4a86-8b0d-423f-81e2-87f5f25a2467] Refreshing network info cache for port f9232e10-c7da-42d1-91c6-d72b0a1e0ccb {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 15:59:07 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:59:07 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:59:07 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:59:07 user nova-compute[75337]: DEBUG nova.compute.manager [req-4b601f89-46e9-494a-bfb5-8e948b60c7a4 req-b0ee5559-fc59-4649-92c8-6a6be3ac6a58 service nova] [instance: 69df3824-b28c-43c0-9f20-52fa956642cc] Received event network-vif-plugged-c3d051e2-c3b7-4ee0-aab0-dcf3c0d1d578 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:59:07 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-4b601f89-46e9-494a-bfb5-8e948b60c7a4 req-b0ee5559-fc59-4649-92c8-6a6be3ac6a58 service nova] Acquiring lock "69df3824-b28c-43c0-9f20-52fa956642cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:59:07 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-4b601f89-46e9-494a-bfb5-8e948b60c7a4 req-b0ee5559-fc59-4649-92c8-6a6be3ac6a58 service nova] Lock "69df3824-b28c-43c0-9f20-52fa956642cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:59:07 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-4b601f89-46e9-494a-bfb5-8e948b60c7a4 req-b0ee5559-fc59-4649-92c8-6a6be3ac6a58 service nova] Lock "69df3824-b28c-43c0-9f20-52fa956642cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:59:07 user nova-compute[75337]: DEBUG nova.compute.manager [req-4b601f89-46e9-494a-bfb5-8e948b60c7a4 req-b0ee5559-fc59-4649-92c8-6a6be3ac6a58 service nova] [instance: 69df3824-b28c-43c0-9f20-52fa956642cc] No waiting events found dispatching network-vif-plugged-c3d051e2-c3b7-4ee0-aab0-dcf3c0d1d578 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:59:07 user nova-compute[75337]: WARNING nova.compute.manager [req-4b601f89-46e9-494a-bfb5-8e948b60c7a4 req-b0ee5559-fc59-4649-92c8-6a6be3ac6a58 service nova] [instance: 69df3824-b28c-43c0-9f20-52fa956642cc] Received unexpected event network-vif-plugged-c3d051e2-c3b7-4ee0-aab0-dcf3c0d1d578 for instance with vm_state stopped and task_state powering-on.
Nov 06 15:59:07 user nova-compute[75337]: DEBUG nova.network.neutron [req-975f2980-9b2d-43f0-9de4-fb714300941f req-436ccd9a-a3c0-4db9-9dc9-bbb115057ff1 service nova] [instance: d10b4a86-8b0d-423f-81e2-87f5f25a2467] Updated VIF entry in instance network info cache for port f9232e10-c7da-42d1-91c6-d72b0a1e0ccb. {{(pid=75337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 15:59:07 user nova-compute[75337]: DEBUG nova.network.neutron [req-975f2980-9b2d-43f0-9de4-fb714300941f req-436ccd9a-a3c0-4db9-9dc9-bbb115057ff1 service nova] [instance: d10b4a86-8b0d-423f-81e2-87f5f25a2467] Updating instance_info_cache with network_info: [{"id": "f9232e10-c7da-42d1-91c6-d72b0a1e0ccb", "address": "fa:16:3e:93:ab:63", "network": {"id": "c31b513a-57f0-4bd5-b055-4a363aae9793", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1352256985-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cddccc86bf54fe981667da5ef13fa8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9232e10-c7", "ovs_interfaceid": "f9232e10-c7da-42d1-91c6-d72b0a1e0ccb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:59:07 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-975f2980-9b2d-43f0-9de4-fb714300941f req-436ccd9a-a3c0-4db9-9dc9-bbb115057ff1 service nova] Releasing lock "refresh_cache-d10b4a86-8b0d-423f-81e2-87f5f25a2467" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 15:59:07 user nova-compute[75337]: DEBUG nova.compute.manager [req-5b4d7d54-3801-4453-a173-4b4f2dde2b55 req-afbac924-7f49-46dd-a8e8-1e9209564332 service nova] [instance: d10b4a86-8b0d-423f-81e2-87f5f25a2467] Received event network-changed-f9232e10-c7da-42d1-91c6-d72b0a1e0ccb {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:59:07 user nova-compute[75337]: DEBUG nova.compute.manager [req-5b4d7d54-3801-4453-a173-4b4f2dde2b55 req-afbac924-7f49-46dd-a8e8-1e9209564332 service nova] [instance: d10b4a86-8b0d-423f-81e2-87f5f25a2467] Refreshing instance network info cache due to event network-changed-f9232e10-c7da-42d1-91c6-d72b0a1e0ccb. {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 15:59:07 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-5b4d7d54-3801-4453-a173-4b4f2dde2b55 req-afbac924-7f49-46dd-a8e8-1e9209564332 service nova] Acquiring lock "refresh_cache-d10b4a86-8b0d-423f-81e2-87f5f25a2467" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 15:59:07 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-5b4d7d54-3801-4453-a173-4b4f2dde2b55 req-afbac924-7f49-46dd-a8e8-1e9209564332 service nova] Acquired lock "refresh_cache-d10b4a86-8b0d-423f-81e2-87f5f25a2467" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 15:59:07 user nova-compute[75337]: DEBUG nova.network.neutron [req-5b4d7d54-3801-4453-a173-4b4f2dde2b55 req-afbac924-7f49-46dd-a8e8-1e9209564332 service nova] [instance: d10b4a86-8b0d-423f-81e2-87f5f25a2467] Refreshing network info cache for port f9232e10-c7da-42d1-91c6-d72b0a1e0ccb {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 15:59:07 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:59:07 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:59:07 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:59:07 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:59:08 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-fbaafa9b-03fd-43aa-9473-e7931faa0b42 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Acquiring lock "d10b4a86-8b0d-423f-81e2-87f5f25a2467" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:59:08 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-fbaafa9b-03fd-43aa-9473-e7931faa0b42 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Lock "d10b4a86-8b0d-423f-81e2-87f5f25a2467" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:59:08 user nova-compute[75337]: INFO nova.compute.manager [None req-fbaafa9b-03fd-43aa-9473-e7931faa0b42 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] [instance: d10b4a86-8b0d-423f-81e2-87f5f25a2467] Detaching volume 326a132a-07d4-4085-8da9-ffa8444121b5
Nov 06 15:59:08 user nova-compute[75337]: INFO nova.virt.block_device [None req-fbaafa9b-03fd-43aa-9473-e7931faa0b42 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] [instance: d10b4a86-8b0d-423f-81e2-87f5f25a2467] Attempting to driver detach volume 326a132a-07d4-4085-8da9-ffa8444121b5 from mountpoint /dev/vdb
Nov 06 15:59:08 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-fbaafa9b-03fd-43aa-9473-e7931faa0b42 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Attempting to detach device vdb from instance d10b4a86-8b0d-423f-81e2-87f5f25a2467 from the persistent domain config. {{(pid=75337) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 06 15:59:08 user nova-compute[75337]: DEBUG nova.virt.libvirt.guest [None req-fbaafa9b-03fd-43aa-9473-e7931faa0b42 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 15:59:08 user nova-compute[75337]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 15:59:08 user nova-compute[75337]:   <source dev="/dev/sdb"/>
Nov 06 15:59:08 user nova-compute[75337]:   <target dev="vdb" bus="virtio"/>
Nov 06 15:59:08 user nova-compute[75337]:   <serial>326a132a-07d4-4085-8da9-ffa8444121b5</serial>
Nov 06 15:59:08 user nova-compute[75337]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 06 15:59:08 user nova-compute[75337]: </disk>
Nov 06 15:59:08 user nova-compute[75337]:  {{(pid=75337) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 15:59:08 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-fbaafa9b-03fd-43aa-9473-e7931faa0b42 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Successfully detached device vdb from instance d10b4a86-8b0d-423f-81e2-87f5f25a2467 from the persistent domain config.
Nov 06 15:59:08 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-fbaafa9b-03fd-43aa-9473-e7931faa0b42 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d10b4a86-8b0d-423f-81e2-87f5f25a2467 from the live domain config. {{(pid=75337) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 06 15:59:08 user nova-compute[75337]: DEBUG nova.virt.libvirt.guest [None req-fbaafa9b-03fd-43aa-9473-e7931faa0b42 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 15:59:08 user nova-compute[75337]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 15:59:08 user nova-compute[75337]:   <source dev="/dev/sdb"/>
Nov 06 15:59:08 user nova-compute[75337]:   <target dev="vdb" bus="virtio"/>
Nov 06 15:59:08 user nova-compute[75337]:   <serial>326a132a-07d4-4085-8da9-ffa8444121b5</serial>
Nov 06 15:59:08 user nova-compute[75337]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 06 15:59:08 user nova-compute[75337]: </disk>
Nov 06 15:59:08 user nova-compute[75337]:  {{(pid=75337) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 15:59:08 user nova-compute[75337]: DEBUG nova.network.neutron [req-5b4d7d54-3801-4453-a173-4b4f2dde2b55 req-afbac924-7f49-46dd-a8e8-1e9209564332 service nova] [instance: d10b4a86-8b0d-423f-81e2-87f5f25a2467] Updated VIF entry in instance network info cache for port f9232e10-c7da-42d1-91c6-d72b0a1e0ccb. {{(pid=75337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 15:59:08 user nova-compute[75337]: DEBUG nova.network.neutron [req-5b4d7d54-3801-4453-a173-4b4f2dde2b55 req-afbac924-7f49-46dd-a8e8-1e9209564332 service nova] [instance: d10b4a86-8b0d-423f-81e2-87f5f25a2467] Updating instance_info_cache with network_info: [{"id": "f9232e10-c7da-42d1-91c6-d72b0a1e0ccb", "address": "fa:16:3e:93:ab:63", "network": {"id": "c31b513a-57f0-4bd5-b055-4a363aae9793", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1352256985-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cddccc86bf54fe981667da5ef13fa8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9232e10-c7", "ovs_interfaceid": "f9232e10-c7da-42d1-91c6-d72b0a1e0ccb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:59:08 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-5b4d7d54-3801-4453-a173-4b4f2dde2b55 req-afbac924-7f49-46dd-a8e8-1e9209564332 service nova] Releasing lock "refresh_cache-d10b4a86-8b0d-423f-81e2-87f5f25a2467" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 15:59:08 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-fbaafa9b-03fd-43aa-9473-e7931faa0b42 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d10b4a86-8b0d-423f-81e2-87f5f25a2467 {{(pid=75337) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 06 15:59:09 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:59:09 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:59:09 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:59:09 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75337) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 15:59:09 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:59:09 user nova-compute[75337]: DEBUG nova.compute.manager [req-3ecf65d3-8310-4b87-80c4-39badadd82d0 req-e49fa3db-655e-4bb9-aec4-3e1729a1d6f0 service nova] [instance: 69df3824-b28c-43c0-9f20-52fa956642cc] Received event network-vif-plugged-c3d051e2-c3b7-4ee0-aab0-dcf3c0d1d578 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:59:09 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-3ecf65d3-8310-4b87-80c4-39badadd82d0 req-e49fa3db-655e-4bb9-aec4-3e1729a1d6f0 service nova] Acquiring lock "69df3824-b28c-43c0-9f20-52fa956642cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:59:09 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-3ecf65d3-8310-4b87-80c4-39badadd82d0 req-e49fa3db-655e-4bb9-aec4-3e1729a1d6f0 service nova] Lock "69df3824-b28c-43c0-9f20-52fa956642cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:59:09 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-3ecf65d3-8310-4b87-80c4-39badadd82d0 req-e49fa3db-655e-4bb9-aec4-3e1729a1d6f0 service nova] Lock "69df3824-b28c-43c0-9f20-52fa956642cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:59:09 user nova-compute[75337]: DEBUG nova.compute.manager [req-3ecf65d3-8310-4b87-80c4-39badadd82d0 req-e49fa3db-655e-4bb9-aec4-3e1729a1d6f0 service nova] [instance: 69df3824-b28c-43c0-9f20-52fa956642cc] No waiting events found dispatching network-vif-plugged-c3d051e2-c3b7-4ee0-aab0-dcf3c0d1d578 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 15:59:09 user nova-compute[75337]: WARNING nova.compute.manager [req-3ecf65d3-8310-4b87-80c4-39badadd82d0 req-e49fa3db-655e-4bb9-aec4-3e1729a1d6f0 service nova] [instance: 69df3824-b28c-43c0-9f20-52fa956642cc] Received unexpected event network-vif-plugged-c3d051e2-c3b7-4ee0-aab0-dcf3c0d1d578 for instance with vm_state stopped and task_state powering-on.
Nov 06 15:59:09 user nova-compute[75337]: DEBUG nova.compute.manager [None req-7f831d4f-1716-42c1-9e23-83853bea6dd2 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] [instance: 69df3824-b28c-43c0-9f20-52fa956642cc] Instance event wait completed in 0 seconds for  {{(pid=75337) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 15:59:09 user nova-compute[75337]: INFO nova.virt.libvirt.driver [-] [instance: 69df3824-b28c-43c0-9f20-52fa956642cc] Instance rebooted successfully.
Nov 06 15:59:09 user nova-compute[75337]: DEBUG nova.compute.manager [None req-7f831d4f-1716-42c1-9e23-83853bea6dd2 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] [instance: 69df3824-b28c-43c0-9f20-52fa956642cc] Checking state {{(pid=75337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 15:59:10 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:59:10 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:59:12 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:59:12 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:59:13 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:59:14 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:59:15 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:59:16 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:59:16 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Starting heal instance info cache {{(pid=75337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 15:59:16 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "refresh_cache-69df3824-b28c-43c0-9f20-52fa956642cc" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 15:59:16 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquired lock "refresh_cache-69df3824-b28c-43c0-9f20-52fa956642cc" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 15:59:16 user nova-compute[75337]: DEBUG nova.network.neutron [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] [instance: 69df3824-b28c-43c0-9f20-52fa956642cc] Forcefully refreshing network info cache for instance {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 15:59:17 user nova-compute[75337]: DEBUG nova.network.neutron [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] [instance: 69df3824-b28c-43c0-9f20-52fa956642cc] Updating instance_info_cache with network_info: [{"id": "c3d051e2-c3b7-4ee0-aab0-dcf3c0d1d578", "address": "fa:16:3e:7e:b4:bf", "network": {"id": "8b217731-de9e-49bc-84bb-130fd42ede51", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-314618758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98fac9096a3b4f21ba805ba1437d9d38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3d051e2-c3", "ovs_interfaceid": "c3d051e2-c3b7-4ee0-aab0-dcf3c0d1d578", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:59:17 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Releasing lock "refresh_cache-69df3824-b28c-43c0-9f20-52fa956642cc" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 15:59:17 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] [instance: 69df3824-b28c-43c0-9f20-52fa956642cc] Updated the network info_cache for instance {{(pid=75337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 15:59:18 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager.update_available_resource {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:59:18 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:59:18 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:59:18 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:59:18 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Auditing locally available compute resources for user (node: user) {{(pid=75337) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 15:59:18 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba7d8a41-5a75-4dca-a192-0177119403be/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:59:18 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba7d8a41-5a75-4dca-a192-0177119403be/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:59:18 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba7d8a41-5a75-4dca-a192-0177119403be/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:59:19 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba7d8a41-5a75-4dca-a192-0177119403be/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:59:19 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69df3824-b28c-43c0-9f20-52fa956642cc/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:59:19 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69df3824-b28c-43c0-9f20-52fa956642cc/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:59:19 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69df3824-b28c-43c0-9f20-52fa956642cc/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:59:19 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:59:19 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69df3824-b28c-43c0-9f20-52fa956642cc/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:59:19 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 15:59:19 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5248533a-89b6-444e-a60a-154b3cdef815/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:59:19 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5248533a-89b6-444e-a60a-154b3cdef815/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:59:19 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5248533a-89b6-444e-a60a-154b3cdef815/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:59:19 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5248533a-89b6-444e-a60a-154b3cdef815/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:59:19 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 15:59:19 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30c634ff-6999-40aa-a90d-1db6d278b571/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:59:20 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30c634ff-6999-40aa-a90d-1db6d278b571/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:59:20 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30c634ff-6999-40aa-a90d-1db6d278b571/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:59:20 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30c634ff-6999-40aa-a90d-1db6d278b571/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:59:20 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6110b34a-6fd3-45fc-911d-4e5d3c7f2d78/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:59:20 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:59:20 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6110b34a-6fd3-45fc-911d-4e5d3c7f2d78/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:59:20 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6110b34a-6fd3-45fc-911d-4e5d3c7f2d78/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:59:20 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6110b34a-6fd3-45fc-911d-4e5d3c7f2d78/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:59:20 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d10b4a86-8b0d-423f-81e2-87f5f25a2467/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:59:20 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d10b4a86-8b0d-423f-81e2-87f5f25a2467/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:59:20 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d10b4a86-8b0d-423f-81e2-87f5f25a2467/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:59:21 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d10b4a86-8b0d-423f-81e2-87f5f25a2467/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:59:21 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f196f2b3-8eac-4d68-af2e-46671c865be1/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:59:21 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f196f2b3-8eac-4d68-af2e-46671c865be1/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:59:21 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f196f2b3-8eac-4d68-af2e-46671c865be1/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:59:21 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f196f2b3-8eac-4d68-af2e-46671c865be1/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:59:21 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d479c64-055b-4496-b3a2-ba10f9095ea8/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:59:21 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d479c64-055b-4496-b3a2-ba10f9095ea8/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:59:21 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d479c64-055b-4496-b3a2-ba10f9095ea8/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:59:21 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d479c64-055b-4496-b3a2-ba10f9095ea8/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:59:22 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 15:59:22 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 15:59:22 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Hypervisor/Node resource view: name=user free_ram=7689MB free_disk=24.993751525878906GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75337) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 15:59:22 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:59:22 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:59:22 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 30c634ff-6999-40aa-a90d-1db6d278b571 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:59:22 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 6110b34a-6fd3-45fc-911d-4e5d3c7f2d78 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:59:22 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance d10b4a86-8b0d-423f-81e2-87f5f25a2467 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:59:22 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 69df3824-b28c-43c0-9f20-52fa956642cc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:59:22 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 5248533a-89b6-444e-a60a-154b3cdef815 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:59:22 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance f196f2b3-8eac-4d68-af2e-46671c865be1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:59:22 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance ba7d8a41-5a75-4dca-a192-0177119403be actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:59:22 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 5d479c64-055b-4496-b3a2-ba10f9095ea8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 15:59:22 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 15:59:22 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 15:59:22 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Refreshing inventories for resource provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 06 15:59:22 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Updating ProviderTree inventory for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 06 15:59:22 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Updating inventory in ProviderTree for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 06 15:59:22 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Refreshing aggregate associations for resource provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7, aggregates: None {{(pid=75337) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 06 15:59:23 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Refreshing trait associations for resource provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7, traits: COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NODE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_IDE,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSSE3,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_USB {{(pid=75337) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 06 15:59:23 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 15:59:23 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 15:59:23 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Compute_service record updated for user:user {{(pid=75337) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 15:59:23 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.749s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:59:23 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:59:23 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Cleaning up deleted instances with incomplete migration  {{(pid=75337) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 06 15:59:24 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a91b8593-a0c5-4a3c-83cd-a3686f93a507 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] [instance: f196f2b3-8eac-4d68-af2e-46671c865be1] Calling os-brick to attach iSCSI Volume {{(pid=75337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 15:59:24 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-a91b8593-a0c5-4a3c-83cd-a3686f93a507 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2abc33d0c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:73a377b1-21a8-4273-8632-8daac8cd3a3b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OazgGChF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 15:59:24 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-a91b8593-a0c5-4a3c-83cd-a3686f93a507 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 15:59:24 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-a91b8593-a0c5-4a3c-83cd-a3686f93a507 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 15:59:24 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-a91b8593-a0c5-4a3c-83cd-a3686f93a507 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 15:59:24 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-a91b8593-a0c5-4a3c-83cd-a3686f93a507 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 15:59:24 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-a91b8593-a0c5-4a3c-83cd-a3686f93a507 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:73a377b1-21a8-4273-8632-8daac8cd3a3b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 15:59:24 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-a91b8593-a0c5-4a3c-83cd-a3686f93a507 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:73a377b1-21a8-4273-8632-8daac8cd3a3b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 15:59:24 user nova-compute[75337]: INFO os_brick.initiator.connectors.iscsi [None req-a91b8593-a0c5-4a3c-83cd-a3686f93a507 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 15:59:24 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73a377b1-21a8-4273-8632-8daac8cd3a3b -p 172.16.0.220:3260 {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:59:24 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73a377b1-21a8-4273-8632-8daac8cd3a3b -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:59:24 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d0617f6-ac97-47dd-9e6b-c5559c51c58c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:59:24 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-a91b8593-a0c5-4a3c-83cd-a3686f93a507 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 15:59:24 user nova-compute[75337]:  {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:59:24 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73a377b1-21a8-4273-8632-8daac8cd3a3b -p 172.16.0.220:3260 --interface default --op new {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:59:24 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73a377b1-21a8-4273-8632-8daac8cd3a3b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:59:24 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[12f03e86-fb0f-4e03-bcae-3ba43d24375a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:73a377b1-21a8-4273-8632-8daac8cd3a3b] added\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:59:24 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-a91b8593-a0c5-4a3c-83cd-a3686f93a507 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:73a377b1-21a8-4273-8632-8daac8cd3a3b] added
Nov 06 15:59:24 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:59:24 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73a377b1-21a8-4273-8632-8daac8cd3a3b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:59:24 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73a377b1-21a8-4273-8632-8daac8cd3a3b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:59:24 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[bca8060d-ee25-4dce-b1e6-94443189624c]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:59:24 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-a91b8593-a0c5-4a3c-83cd-a3686f93a507 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:59:24 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73a377b1-21a8-4273-8632-8daac8cd3a3b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:59:24 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73a377b1-21a8-4273-8632-8daac8cd3a3b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:59:24 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ae9e9e1-5ab3-41ec-92bb-3d67064eed03]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:59:24 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-a91b8593-a0c5-4a3c-83cd-a3686f93a507 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:59:24 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73a377b1-21a8-4273-8632-8daac8cd3a3b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OazgGChF {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:59:24 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73a377b1-21a8-4273-8632-8daac8cd3a3b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OazgGChF" returned: 0 in 0.023s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:59:24 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[84bcd3cb-db9f-4fe8-a5e7-23c5945df864]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:59:24 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-a91b8593-a0c5-4a3c-83cd-a3686f93a507 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OazgGChF'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:59:24 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73a377b1-21a8-4273-8632-8daac8cd3a3b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:59:24 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73a377b1-21a8-4273-8632-8daac8cd3a3b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:59:24 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[7db7d6b0-2d7e-4191-8835-94a16ad16372]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:59:24 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-a91b8593-a0c5-4a3c-83cd-a3686f93a507 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:59:24 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:59:24 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:59:24 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[50691cad-1991-48ae-953d-67526de93cf0]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326a132a-07d4-4085-8da9-ffa8444121b5 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da (non-flash)\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:59:24 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-a91b8593-a0c5-4a3c-83cd-a3686f93a507 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326a132a-07d4-4085-8da9-ffa8444121b5 (non-flash)
Nov 06 15:59:24 user nova-compute[75337]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8 (non-flash)
Nov 06 15:59:24 user nova-compute[75337]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da (non-flash)
Nov 06 15:59:24 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 15:59:24 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-a91b8593-a0c5-4a3c-83cd-a3686f93a507 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326a132a-07d4-4085-8da9-ffa8444121b5 (non-flash)
Nov 06 15:59:24 user nova-compute[75337]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8 (non-flash)
Nov 06 15:59:24 user nova-compute[75337]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da (non-flash)
Nov 06 15:59:24 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 15:59:24 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73a377b1-21a8-4273-8632-8daac8cd3a3b -p 172.16.0.220:3260 --login {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:59:24 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73a377b1-21a8-4273-8632-8daac8cd3a3b -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:59:24 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[38db371d-14a1-4a33-a38d-47f7f8716a32]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:73a377b1-21a8-4273-8632-8daac8cd3a3b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:73a377b1-21a8-4273-8632-8daac8cd3a3b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:59:24 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-a91b8593-a0c5-4a3c-83cd-a3686f93a507 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:73a377b1-21a8-4273-8632-8daac8cd3a3b, portal: 172.16.0.220,3260]
Nov 06 15:59:24 user nova-compute[75337]: Login to [iface: default, target: iqn.2010-10.org.openstack:73a377b1-21a8-4273-8632-8daac8cd3a3b, portal: 172.16.0.220,3260] successful.
Nov 06 15:59:24 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:59:24 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73a377b1-21a8-4273-8632-8daac8cd3a3b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:59:24 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:59:24 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73a377b1-21a8-4273-8632-8daac8cd3a3b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:59:24 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0da6704-9f95-4cf9-8c98-c483b3850f17]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:59:24 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-a91b8593-a0c5-4a3c-83cd-a3686f93a507 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:59:24 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:59:24 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:59:24 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[923ad8fa-bcc5-42f2-a4e9-3b67b709497a]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326a132a-07d4-4085-8da9-ffa8444121b5 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73a377b1-21a8-4273-8632-8daac8cd3a3b (non-flash)\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:59:24 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-a91b8593-a0c5-4a3c-83cd-a3686f93a507 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326a132a-07d4-4085-8da9-ffa8444121b5 (non-flash)
Nov 06 15:59:24 user nova-compute[75337]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8 (non-flash)
Nov 06 15:59:24 user nova-compute[75337]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da (non-flash)
Nov 06 15:59:24 user nova-compute[75337]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73a377b1-21a8-4273-8632-8daac8cd3a3b (non-flash)
Nov 06 15:59:24 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 15:59:24 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-a91b8593-a0c5-4a3c-83cd-a3686f93a507 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326a132a-07d4-4085-8da9-ffa8444121b5 (non-flash)
Nov 06 15:59:24 user nova-compute[75337]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8 (non-flash)
Nov 06 15:59:24 user nova-compute[75337]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da (non-flash)
Nov 06 15:59:24 user nova-compute[75337]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73a377b1-21a8-4273-8632-8daac8cd3a3b (non-flash)
Nov 06 15:59:24 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 15:59:24 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-a91b8593-a0c5-4a3c-83cd-a3686f93a507 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:73a377b1-21a8-4273-8632-8daac8cd3a3b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.320s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 15:59:24 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-a91b8593-a0c5-4a3c-83cd-a3686f93a507 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Connected to 172.16.0.220:3260 {{(pid=75337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 15:59:24 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-a91b8593-a0c5-4a3c-83cd-a3686f93a507 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] HCTL ('35', '-', '-', 0) found on session 40 with lun 0 {{(pid=75337) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 15:59:24 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-a91b8593-a0c5-4a3c-83cd-a3686f93a507 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75337) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 15:59:24 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:59:24 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:59:24 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[b13f4a4f-27f7-4268-b1b3-82ac9a253743]: (4, ('- - 0', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:59:24 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-a91b8593-a0c5-4a3c-83cd-a3686f93a507 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Searching for a device in session 40 and hctl ['35', '*', '*', 0] yield: None {{(pid=75337) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 15:59:25 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:59:25 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-a91b8593-a0c5-4a3c-83cd-a3686f93a507 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Searching for a device in session 40 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75337) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 15:59:25 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-a91b8593-a0c5-4a3c-83cd-a3686f93a507 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:73a377b1-21a8-4273-8632-8daac8cd3a3b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OazgGChF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 15:59:25 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-a91b8593-a0c5-4a3c-83cd-a3686f93a507 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.354s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 15:59:25 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-a91b8593-a0c5-4a3c-83cd-a3686f93a507 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] <== connect_volume: return (1356ms) {'type': 'block', 'scsi_wwn': '23232613036333633', 'path': '/dev/sdd'} {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 15:59:25 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a91b8593-a0c5-4a3c-83cd-a3686f93a507 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] [instance: f196f2b3-8eac-4d68-af2e-46671c865be1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23232613036333633', 'path': '/dev/sdd'} {{(pid=75337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 15:59:25 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:59:25 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Cleaning up deleted instances {{(pid=75337) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 06 15:59:25 user nova-compute[75337]: DEBUG nova.objects.instance [None req-a91b8593-a0c5-4a3c-83cd-a3686f93a507 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Lazy-loading 'flavor' on Instance uuid f196f2b3-8eac-4d68-af2e-46671c865be1 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 15:59:25 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] There are 0 instances to clean {{(pid=75337) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 06 15:59:25 user nova-compute[75337]: DEBUG nova.virt.libvirt.guest [None req-a91b8593-a0c5-4a3c-83cd-a3686f93a507 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] attach device xml: <disk type="block" device="disk">
Nov 06 15:59:25 user nova-compute[75337]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 15:59:25 user nova-compute[75337]:   <source dev="/dev/sdd"/>
Nov 06 15:59:25 user nova-compute[75337]:   <target dev="vdb" bus="virtio"/>
Nov 06 15:59:25 user nova-compute[75337]:   <serial>73a377b1-21a8-4273-8632-8daac8cd3a3b</serial>
Nov 06 15:59:25 user nova-compute[75337]: </disk>
Nov 06 15:59:25 user nova-compute[75337]:  {{(pid=75337) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 06 15:59:26 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-a91b8593-a0c5-4a3c-83cd-a3686f93a507 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] No BDM found with device name vda, not building metadata. {{(pid=75337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 15:59:26 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-a91b8593-a0c5-4a3c-83cd-a3686f93a507 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 15:59:26 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-a91b8593-a0c5-4a3c-83cd-a3686f93a507 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] No VIF found with MAC fa:16:3e:1e:b2:da, not building metadata {{(pid=75337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 15:59:26 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-a91b8593-a0c5-4a3c-83cd-a3686f93a507 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Lock "f196f2b3-8eac-4d68-af2e-46671c865be1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 26.987s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:59:28 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-fbaafa9b-03fd-43aa-9473-e7931faa0b42 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d10b4a86-8b0d-423f-81e2-87f5f25a2467 is timed out.
Nov 06 15:59:28 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-fbaafa9b-03fd-43aa-9473-e7931faa0b42 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Successfully detached device vdb from instance d10b4a86-8b0d-423f-81e2-87f5f25a2467 from the live domain config.
Nov 06 15:59:28 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fbaafa9b-03fd-43aa-9473-e7931faa0b42 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] [instance: d10b4a86-8b0d-423f-81e2-87f5f25a2467] calling os-brick to detach iSCSI Volume {{(pid=75337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 15:59:28 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbaafa9b-03fd-43aa-9473-e7931faa0b42 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2abc33d0c0>, {'target_iqn': 'iqn.2010-10.org.openstack:326a132a-07d4-4085-8da9-ffa8444121b5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZkMjQJdO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 15:59:28 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-fbaafa9b-03fd-43aa-9473-e7931faa0b42 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 15:59:28 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-fbaafa9b-03fd-43aa-9473-e7931faa0b42 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 15:59:28 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-fbaafa9b-03fd-43aa-9473-e7931faa0b42 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 15:59:28 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:59:28 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:59:28 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[e44ff260-a51b-4a28-bc14-6c52d4fc77d8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:326a132a-07d4-4085-8da9-ffa8444121b5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:73a377b1-21a8-4273-8632-8daac8cd3a3b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:59:28 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbaafa9b-03fd-43aa-9473-e7931faa0b42 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 15:59:28 user nova-compute[75337]: No targets found.
Nov 06 15:59:28 user nova-compute[75337]: iSNS:
Nov 06 15:59:28 user nova-compute[75337]: No targets found.
Nov 06 15:59:28 user nova-compute[75337]: STATIC:
Nov 06 15:59:28 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:326a132a-07d4-4085-8da9-ffa8444121b5
Nov 06 15:59:28 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 15:59:28 user nova-compute[75337]:                 Iface Name: default
Nov 06 15:59:28 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da
Nov 06 15:59:28 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 15:59:28 user nova-compute[75337]:                 Iface Name: default
Nov 06 15:59:28 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8
Nov 06 15:59:28 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 15:59:28 user nova-compute[75337]:                 Iface Name: default
Nov 06 15:59:28 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:73a377b1-21a8-4273-8632-8daac8cd3a3b
Nov 06 15:59:28 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 15:59:28 user nova-compute[75337]:                 Iface Name: default
Nov 06 15:59:28 user nova-compute[75337]: FIRMWARE:
Nov 06 15:59:28 user nova-compute[75337]: No targets found.
Nov 06 15:59:28 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 15:59:28 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbaafa9b-03fd-43aa-9473-e7931faa0b42 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 15:59:28 user nova-compute[75337]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 15:59:28 user nova-compute[75337]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75337) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 15:59:28 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbaafa9b-03fd-43aa-9473-e7931faa0b42 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:326a132a-07d4-4085-8da9-ffa8444121b5', 0)] {{(pid=75337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 15:59:28 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:59:28 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:59:28 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[49eb20c3-5654-4172-8f2b-a074c07f293a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:326a132a-07d4-4085-8da9-ffa8444121b5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:73a377b1-21a8-4273-8632-8daac8cd3a3b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:59:28 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:59:28 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:59:28 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9cf7901-9d85-4ff4-92ec-a66fc2ce8f22]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326a132a-07d4-4085-8da9-ffa8444121b5 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73a377b1-21a8-4273-8632-8daac8cd3a3b (non-flash)\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:59:28 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbaafa9b-03fd-43aa-9473-e7931faa0b42 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326a132a-07d4-4085-8da9-ffa8444121b5 (non-flash)
Nov 06 15:59:28 user nova-compute[75337]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8 (non-flash)
Nov 06 15:59:28 user nova-compute[75337]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da (non-flash)
Nov 06 15:59:28 user nova-compute[75337]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73a377b1-21a8-4273-8632-8daac8cd3a3b (non-flash)
Nov 06 15:59:28 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 15:59:28 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbaafa9b-03fd-43aa-9473-e7931faa0b42 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326a132a-07d4-4085-8da9-ffa8444121b5 (non-flash)
Nov 06 15:59:28 user nova-compute[75337]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8 (non-flash)
Nov 06 15:59:28 user nova-compute[75337]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da (non-flash)
Nov 06 15:59:28 user nova-compute[75337]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73a377b1-21a8-4273-8632-8daac8cd3a3b (non-flash)
Nov 06 15:59:28 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 15:59:28 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbaafa9b-03fd-43aa-9473-e7931faa0b42 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2ac404a5f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:326a132a-07d4-4085-8da9-ffa8444121b5'): ({'sdb'}, set())}) {{(pid=75337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 15:59:28 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-fbaafa9b-03fd-43aa-9473-e7931faa0b42 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Removing single pathed devices sdb {{(pid=75337) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 15:59:28 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:59:28 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:59:28 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[d83040ac-ae0e-4064-b4af-273080653f0f]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:59:28 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:59:28 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:59:28 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c9207bc-79d1-45cc-a0d8-ecaf509ba32e]: (4, ('ok\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:59:28 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-fbaafa9b-03fd-43aa-9473-e7931faa0b42 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Flushing IO for device /dev/sdb {{(pid=75337) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 15:59:28 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:59:28 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:59:28 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[38faa85e-e332-4fda-926e-8a52b386a6dc]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:59:28 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-fbaafa9b-03fd-43aa-9473-e7931faa0b42 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75337) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 15:59:28 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:59:28 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:59:28 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd199bc3-06e8-4c9e-8aa8-840139635161]: (4, ('1', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:59:28 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-fbaafa9b-03fd-43aa-9473-e7931faa0b42 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 15:59:28 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-fbaafa9b-03fd-43aa-9473-e7931faa0b42 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] SCSI volumes sdb have been removed. {{(pid=75337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 15:59:28 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbaafa9b-03fd-43aa-9473-e7931faa0b42 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:326a132a-07d4-4085-8da9-ffa8444121b5')] {{(pid=75337) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 15:59:28 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:326a132a-07d4-4085-8da9-ffa8444121b5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:59:28 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:326a132a-07d4-4085-8da9-ffa8444121b5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:59:28 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c35b460-2757-4b6e-b10d-34fd17648d4b]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:59:28 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbaafa9b-03fd-43aa-9473-e7931faa0b42 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:59:28 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:326a132a-07d4-4085-8da9-ffa8444121b5 -p 172.16.0.220:3260 --logout {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:59:29 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:326a132a-07d4-4085-8da9-ffa8444121b5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:59:29 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[759d6b90-6452-4b97-8b0d-05adc65205a6]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:326a132a-07d4-4085-8da9-ffa8444121b5, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:326a132a-07d4-4085-8da9-ffa8444121b5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:59:29 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbaafa9b-03fd-43aa-9473-e7931faa0b42 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:326a132a-07d4-4085-8da9-ffa8444121b5, portal: 172.16.0.220,3260]
Nov 06 15:59:29 user nova-compute[75337]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:326a132a-07d4-4085-8da9-ffa8444121b5, portal: 172.16.0.220,3260] successful.
Nov 06 15:59:29 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:59:29 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:326a132a-07d4-4085-8da9-ffa8444121b5 -p 172.16.0.220:3260 --op delete {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:59:29 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:326a132a-07d4-4085-8da9-ffa8444121b5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:59:29 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[bff89bd1-df3a-4d4b-baae-4f0e3b41b7db]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:59:29 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbaafa9b-03fd-43aa-9473-e7931faa0b42 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 15:59:29 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-fbaafa9b-03fd-43aa-9473-e7931faa0b42 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.317s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 15:59:29 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbaafa9b-03fd-43aa-9473-e7931faa0b42 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] <== disconnect_volume: return (318ms) None {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 15:59:29 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fbaafa9b-03fd-43aa-9473-e7931faa0b42 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] [instance: d10b4a86-8b0d-423f-81e2-87f5f25a2467] Disconnected iSCSI Volume {{(pid=75337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 15:59:29 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:59:30 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:59:33 user nova-compute[75337]: DEBUG nova.objects.instance [None req-fbaafa9b-03fd-43aa-9473-e7931faa0b42 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Lazy-loading 'flavor' on Instance uuid d10b4a86-8b0d-423f-81e2-87f5f25a2467 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 15:59:33 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-fbaafa9b-03fd-43aa-9473-e7931faa0b42 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Lock "d10b4a86-8b0d-423f-81e2-87f5f25a2467" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 25.193s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:59:34 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:59:34 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 15:59:35 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:59:36 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-01be6a98-4758-40c1-873b-e454c34c24bb tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Acquiring lock "e558736d-848f-4a79-a7aa-1e46638a85dc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:59:36 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-01be6a98-4758-40c1-873b-e454c34c24bb tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Lock "e558736d-848f-4a79-a7aa-1e46638a85dc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:59:36 user nova-compute[75337]: DEBUG nova.compute.manager [None req-01be6a98-4758-40c1-873b-e454c34c24bb tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: e558736d-848f-4a79-a7aa-1e46638a85dc] Starting instance... {{(pid=75337) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 15:59:36 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-01be6a98-4758-40c1-873b-e454c34c24bb tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:59:36 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-01be6a98-4758-40c1-873b-e454c34c24bb tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:59:36 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-01be6a98-4758-40c1-873b-e454c34c24bb tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75337) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 15:59:36 user nova-compute[75337]: INFO nova.compute.claims [None req-01be6a98-4758-40c1-873b-e454c34c24bb tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: e558736d-848f-4a79-a7aa-1e46638a85dc] Claim successful on node user
Nov 06 15:59:36 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-01be6a98-4758-40c1-873b-e454c34c24bb tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 15:59:36 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-01be6a98-4758-40c1-873b-e454c34c24bb tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 15:59:36 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-01be6a98-4758-40c1-873b-e454c34c24bb tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.400s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:59:37 user nova-compute[75337]: DEBUG nova.compute.manager [None req-01be6a98-4758-40c1-873b-e454c34c24bb tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: e558736d-848f-4a79-a7aa-1e46638a85dc] Start building networks asynchronously for instance. {{(pid=75337) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 15:59:37 user nova-compute[75337]: DEBUG nova.compute.manager [None req-01be6a98-4758-40c1-873b-e454c34c24bb tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: e558736d-848f-4a79-a7aa-1e46638a85dc] Allocating IP information in the background. {{(pid=75337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 15:59:37 user nova-compute[75337]: DEBUG nova.network.neutron [None req-01be6a98-4758-40c1-873b-e454c34c24bb tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: e558736d-848f-4a79-a7aa-1e46638a85dc] allocate_for_instance() {{(pid=75337) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 15:59:37 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-01be6a98-4758-40c1-873b-e454c34c24bb tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: e558736d-848f-4a79-a7aa-1e46638a85dc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 15:59:37 user nova-compute[75337]: DEBUG nova.compute.manager [None req-01be6a98-4758-40c1-873b-e454c34c24bb tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: e558736d-848f-4a79-a7aa-1e46638a85dc] Start building block device mappings for instance. {{(pid=75337) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 15:59:37 user nova-compute[75337]: DEBUG nova.policy [None req-01be6a98-4758-40c1-873b-e454c34c24bb tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bb8d5f0200124588be1cfde107341a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915211c6a2734c36b34ff92a56b085f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75337) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 15:59:37 user nova-compute[75337]: INFO nova.virt.block_device [None req-01be6a98-4758-40c1-873b-e454c34c24bb tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: e558736d-848f-4a79-a7aa-1e46638a85dc] Booting with volume 324f5822-eef0-4ecf-93e4-791b0677d673 at /dev/vda
Nov 06 15:59:37 user nova-compute[75337]: DEBUG os_brick.utils [None req-01be6a98-4758-40c1-873b-e454c34c24bb tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 15:59:37 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:59:37 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:59:37 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ec73be8-57a0-49ff-874c-7aaa485d46e6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4ff6411e45b8\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:59:37 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:59:37 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:59:37 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[a983d20d-211c-46b2-84f0-452eee67959a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:59:37 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:59:37 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:59:37 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[a312ecc7-4fa2-4b32-bb4f-483415080af4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:59:37 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[a65f4fa3-ea6a-426d-92f2-832607bc9280]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:59:37 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-01be6a98-4758-40c1-873b-e454c34c24bb tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Running cmd (subprocess): nvme version {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:59:37 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-01be6a98-4758-40c1-873b-e454c34c24bb tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] 'nvme version' failed. Not Retrying. {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 15:59:37 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.nvmeof [None req-01be6a98-4758-40c1-873b-e454c34c24bb tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] nvme not present on system {{(pid=75337) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 15:59:37 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:59:37 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 15:59:37 user nova-compute[75337]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 15:59:37 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b2399cf-ae53-435f-b7a9-83a106cc3e5a]: (4, '') {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:59:37 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.lightos [None req-01be6a98-4758-40c1-873b-e454c34c24bb tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75337) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 15:59:37 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.lightos [None req-01be6a98-4758-40c1-873b-e454c34c24bb tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 15:59:37 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.lightos [None req-01be6a98-4758-40c1-873b-e454c34c24bb tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] LIGHTOS: no hostnqn found. {{(pid=75337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 15:59:37 user nova-compute[75337]: DEBUG os_brick.utils [None req-01be6a98-4758-40c1-873b-e454c34c24bb tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4ff6411e45b8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 15:59:37 user nova-compute[75337]: DEBUG nova.virt.block_device [None req-01be6a98-4758-40c1-873b-e454c34c24bb tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: e558736d-848f-4a79-a7aa-1e46638a85dc] Updating existing volume attachment record: a4b0da79-0b7a-460f-9a46-958a0ef824c2 {{(pid=75337) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 15:59:38 user nova-compute[75337]: DEBUG nova.network.neutron [None req-01be6a98-4758-40c1-873b-e454c34c24bb tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: e558736d-848f-4a79-a7aa-1e46638a85dc] Successfully created port: 0ed5847d-dcc9-43c0-96ae-02b3d24d1416 {{(pid=75337) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 15:59:39 user nova-compute[75337]: DEBUG nova.network.neutron [None req-01be6a98-4758-40c1-873b-e454c34c24bb tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: e558736d-848f-4a79-a7aa-1e46638a85dc] Successfully updated port: 0ed5847d-dcc9-43c0-96ae-02b3d24d1416 {{(pid=75337) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 15:59:39 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-01be6a98-4758-40c1-873b-e454c34c24bb tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Acquiring lock "refresh_cache-e558736d-848f-4a79-a7aa-1e46638a85dc" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 15:59:39 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-01be6a98-4758-40c1-873b-e454c34c24bb tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Acquired lock "refresh_cache-e558736d-848f-4a79-a7aa-1e46638a85dc" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 15:59:39 user nova-compute[75337]: DEBUG nova.network.neutron [None req-01be6a98-4758-40c1-873b-e454c34c24bb tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: e558736d-848f-4a79-a7aa-1e46638a85dc] Building network info cache for instance {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 15:59:39 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:59:39 user nova-compute[75337]: DEBUG nova.network.neutron [None req-01be6a98-4758-40c1-873b-e454c34c24bb tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: e558736d-848f-4a79-a7aa-1e46638a85dc] Instance cache missing network info. {{(pid=75337) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 15:59:39 user nova-compute[75337]: DEBUG nova.compute.manager [req-791b46bf-b759-4b81-866b-5cce43bb3465 req-b52ef27d-70c3-4bca-8f83-90226ad0ea66 service nova] [instance: e558736d-848f-4a79-a7aa-1e46638a85dc] Received event network-changed-0ed5847d-dcc9-43c0-96ae-02b3d24d1416 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:59:39 user nova-compute[75337]: DEBUG nova.compute.manager [req-791b46bf-b759-4b81-866b-5cce43bb3465 req-b52ef27d-70c3-4bca-8f83-90226ad0ea66 service nova] [instance: e558736d-848f-4a79-a7aa-1e46638a85dc] Refreshing instance network info cache due to event network-changed-0ed5847d-dcc9-43c0-96ae-02b3d24d1416. {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 15:59:39 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-791b46bf-b759-4b81-866b-5cce43bb3465 req-b52ef27d-70c3-4bca-8f83-90226ad0ea66 service nova] Acquiring lock "refresh_cache-e558736d-848f-4a79-a7aa-1e46638a85dc" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 15:59:39 user nova-compute[75337]: DEBUG nova.network.neutron [None req-01be6a98-4758-40c1-873b-e454c34c24bb tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: e558736d-848f-4a79-a7aa-1e46638a85dc] Updating instance_info_cache with network_info: [{"id": "0ed5847d-dcc9-43c0-96ae-02b3d24d1416", "address": "fa:16:3e:22:e2:a6", "network": {"id": "4e47319f-de1d-4dfe-9915-7d2d5131704d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-895093240-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "915211c6a2734c36b34ff92a56b085f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ed5847d-dc", "ovs_interfaceid": "0ed5847d-dcc9-43c0-96ae-02b3d24d1416", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:59:39 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-01be6a98-4758-40c1-873b-e454c34c24bb tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Releasing lock "refresh_cache-e558736d-848f-4a79-a7aa-1e46638a85dc" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 15:59:39 user nova-compute[75337]: DEBUG nova.compute.manager [None req-01be6a98-4758-40c1-873b-e454c34c24bb tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: e558736d-848f-4a79-a7aa-1e46638a85dc] Instance network_info: |[{"id": "0ed5847d-dcc9-43c0-96ae-02b3d24d1416", "address": "fa:16:3e:22:e2:a6", "network": {"id": "4e47319f-de1d-4dfe-9915-7d2d5131704d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-895093240-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "915211c6a2734c36b34ff92a56b085f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ed5847d-dc", "ovs_interfaceid": "0ed5847d-dcc9-43c0-96ae-02b3d24d1416", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 15:59:39 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-791b46bf-b759-4b81-866b-5cce43bb3465 req-b52ef27d-70c3-4bca-8f83-90226ad0ea66 service nova] Acquired lock "refresh_cache-e558736d-848f-4a79-a7aa-1e46638a85dc" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 15:59:39 user nova-compute[75337]: DEBUG nova.network.neutron [req-791b46bf-b759-4b81-866b-5cce43bb3465 req-b52ef27d-70c3-4bca-8f83-90226ad0ea66 service nova] [instance: e558736d-848f-4a79-a7aa-1e46638a85dc] Refreshing network info cache for port 0ed5847d-dcc9-43c0-96ae-02b3d24d1416 {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 15:59:40 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:59:40 user nova-compute[75337]: DEBUG nova.network.neutron [req-791b46bf-b759-4b81-866b-5cce43bb3465 req-b52ef27d-70c3-4bca-8f83-90226ad0ea66 service nova] [instance: e558736d-848f-4a79-a7aa-1e46638a85dc] Updated VIF entry in instance network info cache for port 0ed5847d-dcc9-43c0-96ae-02b3d24d1416. {{(pid=75337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 15:59:40 user nova-compute[75337]: DEBUG nova.network.neutron [req-791b46bf-b759-4b81-866b-5cce43bb3465 req-b52ef27d-70c3-4bca-8f83-90226ad0ea66 service nova] [instance: e558736d-848f-4a79-a7aa-1e46638a85dc] Updating instance_info_cache with network_info: [{"id": "0ed5847d-dcc9-43c0-96ae-02b3d24d1416", "address": "fa:16:3e:22:e2:a6", "network": {"id": "4e47319f-de1d-4dfe-9915-7d2d5131704d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-895093240-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "915211c6a2734c36b34ff92a56b085f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ed5847d-dc", "ovs_interfaceid": "0ed5847d-dcc9-43c0-96ae-02b3d24d1416", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:59:40 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-791b46bf-b759-4b81-866b-5cce43bb3465 req-b52ef27d-70c3-4bca-8f83-90226ad0ea66 service nova] Releasing lock "refresh_cache-e558736d-848f-4a79-a7aa-1e46638a85dc" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 15:59:40 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:59:45 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:59:50 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:59:54 user nova-compute[75337]: DEBUG nova.compute.manager [req-63a253d1-946d-4b99-8cb0-a965d42e57e4 req-ff500bd3-a00e-4a74-ab38-8acb9c775e5f service nova] [instance: ba7d8a41-5a75-4dca-a192-0177119403be] Received event network-changed-f85d9767-bd59-4182-b18b-a29b13527561 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 15:59:54 user nova-compute[75337]: DEBUG nova.compute.manager [req-63a253d1-946d-4b99-8cb0-a965d42e57e4 req-ff500bd3-a00e-4a74-ab38-8acb9c775e5f service nova] [instance: ba7d8a41-5a75-4dca-a192-0177119403be] Refreshing instance network info cache due to event network-changed-f85d9767-bd59-4182-b18b-a29b13527561. {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 15:59:54 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-63a253d1-946d-4b99-8cb0-a965d42e57e4 req-ff500bd3-a00e-4a74-ab38-8acb9c775e5f service nova] Acquiring lock "refresh_cache-ba7d8a41-5a75-4dca-a192-0177119403be" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 15:59:54 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-63a253d1-946d-4b99-8cb0-a965d42e57e4 req-ff500bd3-a00e-4a74-ab38-8acb9c775e5f service nova] Acquired lock "refresh_cache-ba7d8a41-5a75-4dca-a192-0177119403be" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 15:59:54 user nova-compute[75337]: DEBUG nova.network.neutron [req-63a253d1-946d-4b99-8cb0-a965d42e57e4 req-ff500bd3-a00e-4a74-ab38-8acb9c775e5f service nova] [instance: ba7d8a41-5a75-4dca-a192-0177119403be] Refreshing network info cache for port f85d9767-bd59-4182-b18b-a29b13527561 {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 15:59:54 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:59:54 user nova-compute[75337]: DEBUG nova.network.neutron [req-63a253d1-946d-4b99-8cb0-a965d42e57e4 req-ff500bd3-a00e-4a74-ab38-8acb9c775e5f service nova] [instance: ba7d8a41-5a75-4dca-a192-0177119403be] Updated VIF entry in instance network info cache for port f85d9767-bd59-4182-b18b-a29b13527561. {{(pid=75337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 15:59:54 user nova-compute[75337]: DEBUG nova.network.neutron [req-63a253d1-946d-4b99-8cb0-a965d42e57e4 req-ff500bd3-a00e-4a74-ab38-8acb9c775e5f service nova] [instance: ba7d8a41-5a75-4dca-a192-0177119403be] Updating instance_info_cache with network_info: [{"id": "f85d9767-bd59-4182-b18b-a29b13527561", "address": "fa:16:3e:d2:44:86", "network": {"id": "86559e08-82d7-4eed-8a89-f5859ff948b3", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-28678156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3589e9805b0743d59c03decf3e6bad5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf85d9767-bd", "ovs_interfaceid": "f85d9767-bd59-4182-b18b-a29b13527561", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 15:59:54 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-63a253d1-946d-4b99-8cb0-a965d42e57e4 req-ff500bd3-a00e-4a74-ab38-8acb9c775e5f service nova] Releasing lock "refresh_cache-ba7d8a41-5a75-4dca-a192-0177119403be" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 15:59:55 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-81fc8da5-6b72-48b1-a80e-5e7cd33bc465 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] Acquiring lock "ba7d8a41-5a75-4dca-a192-0177119403be" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:59:55 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-81fc8da5-6b72-48b1-a80e-5e7cd33bc465 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] Lock "ba7d8a41-5a75-4dca-a192-0177119403be" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:59:55 user nova-compute[75337]: DEBUG nova.objects.instance [None req-81fc8da5-6b72-48b1-a80e-5e7cd33bc465 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] Lazy-loading 'flavor' on Instance uuid ba7d8a41-5a75-4dca-a192-0177119403be {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 15:59:55 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-81fc8da5-6b72-48b1-a80e-5e7cd33bc465 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] Lock "ba7d8a41-5a75-4dca-a192-0177119403be" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 15:59:55 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-81fc8da5-6b72-48b1-a80e-5e7cd33bc465 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] Acquiring lock "ba7d8a41-5a75-4dca-a192-0177119403be" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 15:59:55 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-81fc8da5-6b72-48b1-a80e-5e7cd33bc465 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] Lock "ba7d8a41-5a75-4dca-a192-0177119403be" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 15:59:55 user nova-compute[75337]: INFO nova.compute.manager [None req-81fc8da5-6b72-48b1-a80e-5e7cd33bc465 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] [instance: ba7d8a41-5a75-4dca-a192-0177119403be] Attaching volume 45e66a2b-499f-46ca-90b5-2eeac6a5a8be to /dev/vdb
Nov 06 15:59:55 user nova-compute[75337]: DEBUG os_brick.utils [None req-81fc8da5-6b72-48b1-a80e-5e7cd33bc465 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 15:59:55 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:59:55 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:59:55 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b255e18-6f53-46f1-9e95-074e0a499ba2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4ff6411e45b8\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:59:55 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:59:55 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:59:55 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[15222595-f8c4-4b95-b39b-b4b211caffc8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:59:55 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:59:55 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 15:59:55 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[6552ba57-c7b4-4178-9416-ec2275b494e1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:59:55 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[377fe34e-b09c-461a-8e57-d23a78016fc2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:59:55 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-81fc8da5-6b72-48b1-a80e-5e7cd33bc465 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] Running cmd (subprocess): nvme version {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:59:55 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-81fc8da5-6b72-48b1-a80e-5e7cd33bc465 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] 'nvme version' failed. Not Retrying. {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 15:59:55 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.nvmeof [None req-81fc8da5-6b72-48b1-a80e-5e7cd33bc465 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] nvme not present on system {{(pid=75337) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 15:59:55 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 15:59:55 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 15:59:55 user nova-compute[75337]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 15:59:55 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[79467e78-f2b3-4114-a0b4-7c3ae954f620]: (4, '') {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 15:59:55 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.lightos [None req-81fc8da5-6b72-48b1-a80e-5e7cd33bc465 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75337) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 15:59:55 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.lightos [None req-81fc8da5-6b72-48b1-a80e-5e7cd33bc465 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 15:59:55 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.lightos [None req-81fc8da5-6b72-48b1-a80e-5e7cd33bc465 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] LIGHTOS: no hostnqn found. {{(pid=75337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 15:59:55 user nova-compute[75337]: DEBUG os_brick.utils [None req-81fc8da5-6b72-48b1-a80e-5e7cd33bc465 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4ff6411e45b8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 15:59:55 user nova-compute[75337]: DEBUG nova.virt.block_device [None req-81fc8da5-6b72-48b1-a80e-5e7cd33bc465 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] [instance: ba7d8a41-5a75-4dca-a192-0177119403be] Updating existing volume attachment record: 0901be50-933a-48d5-8ff3-33eebc9a09dc {{(pid=75337) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 15:59:55 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 15:59:59 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:00:00 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:00:01 user nova-compute[75337]: DEBUG nova.compute.manager [None req-01be6a98-4758-40c1-873b-e454c34c24bb tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: e558736d-848f-4a79-a7aa-1e46638a85dc] Start spawning the instance on the hypervisor. {{(pid=75337) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 16:00:01 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-01be6a98-4758-40c1-873b-e454c34c24bb tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: e558736d-848f-4a79-a7aa-1e46638a85dc] Creating instance directory {{(pid=75337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 16:00:01 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-01be6a98-4758-40c1-873b-e454c34c24bb tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: e558736d-848f-4a79-a7aa-1e46638a85dc] Creating image(s)
Nov 06 16:00:01 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-01be6a98-4758-40c1-873b-e454c34c24bb tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: e558736d-848f-4a79-a7aa-1e46638a85dc] Did not create local disks {{(pid=75337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 06 16:00:01 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-01be6a98-4758-40c1-873b-e454c34c24bb tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: e558736d-848f-4a79-a7aa-1e46638a85dc] Ensure instance console log exists: /opt/stack/data/nova/instances/e558736d-848f-4a79-a7aa-1e46638a85dc/console.log {{(pid=75337) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 16:00:01 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-01be6a98-4758-40c1-873b-e454c34c24bb tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:00:01 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-01be6a98-4758-40c1-873b-e454c34c24bb tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:00:01 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-01be6a98-4758-40c1-873b-e454c34c24bb tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:00:01 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-01be6a98-4758-40c1-873b-e454c34c24bb tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: e558736d-848f-4a79-a7aa-1e46638a85dc] Start _get_guest_xml network_info=[{"id": "0ed5847d-dcc9-43c0-96ae-02b3d24d1416", "address": "fa:16:3e:22:e2:a6", "network": {"id": "4e47319f-de1d-4dfe-9915-7d2d5131704d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-895093240-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "915211c6a2734c36b34ff92a56b085f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ed5847d-dc", "ovs_interfaceid": "0ed5847d-dcc9-43c0-96ae-02b3d24d1416", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'attachment_id': 'a4b0da79-0b7a-460f-9a46-958a0ef824c2', 'guest_format': None, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CPtyXLsv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e558736d-848f-4a79-a7aa-1e46638a85dc', 'attached_at': '', 'detached_at': '', 'volume_id': '324f5822-eef0-4ecf-93e4-791b0677d673', 'serial': '324f5822-eef0-4ecf-93e4-791b0677d673'}, 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=75337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 16:00:01 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-01be6a98-4758-40c1-873b-e454c34c24bb tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 16:00:01 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-01be6a98-4758-40c1-873b-e454c34c24bb tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 16:00:01 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-01be6a98-4758-40c1-873b-e454c34c24bb tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 16:00:01 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-01be6a98-4758-40c1-873b-e454c34c24bb tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] CPU controller missing on host. {{(pid=75337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 16:00:01 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-01be6a98-4758-40c1-873b-e454c34c24bb tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 16:00:01 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-01be6a98-4758-40c1-873b-e454c34c24bb tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] CPU controller found on host. {{(pid=75337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 16:00:01 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-01be6a98-4758-40c1-873b-e454c34c24bb tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75337) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 16:00:01 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-01be6a98-4758-40c1-873b-e454c34c24bb tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T15:34:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 16:00:01 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-01be6a98-4758-40c1-873b-e454c34c24bb tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Flavor limits 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 16:00:01 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-01be6a98-4758-40c1-873b-e454c34c24bb tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Image limits 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 16:00:01 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-01be6a98-4758-40c1-873b-e454c34c24bb tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Flavor pref 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 16:00:01 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-01be6a98-4758-40c1-873b-e454c34c24bb tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Image pref 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 16:00:01 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-01be6a98-4758-40c1-873b-e454c34c24bb tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 16:00:01 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-01be6a98-4758-40c1-873b-e454c34c24bb tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 16:00:01 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-01be6a98-4758-40c1-873b-e454c34c24bb tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 16:00:01 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-01be6a98-4758-40c1-873b-e454c34c24bb tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Got 1 possible topologies {{(pid=75337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 16:00:01 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-01be6a98-4758-40c1-873b-e454c34c24bb tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 16:00:01 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-01be6a98-4758-40c1-873b-e454c34c24bb tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 16:00:01 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01be6a98-4758-40c1-873b-e454c34c24bb tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: e558736d-848f-4a79-a7aa-1e46638a85dc] Calling os-brick to attach iSCSI Volume {{(pid=75337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 16:00:01 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-01be6a98-4758-40c1-873b-e454c34c24bb tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2abc33d0c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CPtyXLsv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 16:00:01 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-01be6a98-4758-40c1-873b-e454c34c24bb tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 16:00:01 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-01be6a98-4758-40c1-873b-e454c34c24bb tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 16:00:01 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-01be6a98-4758-40c1-873b-e454c34c24bb tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 16:00:01 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-01be6a98-4758-40c1-873b-e454c34c24bb tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 16:00:01 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-01be6a98-4758-40c1-873b-e454c34c24bb tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 16:00:01 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-01be6a98-4758-40c1-873b-e454c34c24bb tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 16:00:01 user nova-compute[75337]: INFO os_brick.initiator.connectors.iscsi [None req-01be6a98-4758-40c1-873b-e454c34c24bb tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 16:00:01 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673 -p 172.16.0.220:3260 {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:00:01 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:00:01 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[d12b4b27-e9c4-4c11-b48a-3448c8c2f928]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:00:01 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-01be6a98-4758-40c1-873b-e454c34c24bb tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 16:00:01 user nova-compute[75337]:  {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:00:01 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673 -p 172.16.0.220:3260 --interface default --op new {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:00:01 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:00:01 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1cfff76-2be6-443b-ae1b-e31df4f4c66d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673] added\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:00:01 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-01be6a98-4758-40c1-873b-e454c34c24bb tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673] added
Nov 06 16:00:01 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:00:01 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:00:01 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:00:01 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[a73113fb-4ce8-4fb2-846b-14e5811ee2ab]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:00:01 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-01be6a98-4758-40c1-873b-e454c34c24bb tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:00:01 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:00:01 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:00:01 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[94bcccec-87fa-48a7-ad5d-e05aa227d571]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:00:01 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-01be6a98-4758-40c1-873b-e454c34c24bb tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:00:01 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CPtyXLsv {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:00:01 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CPtyXLsv" returned: 0 in 0.018s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:00:01 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3db4db7-8ee5-4b5f-b2fa-6cbec1ca4755]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:00:01 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-01be6a98-4758-40c1-873b-e454c34c24bb tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CPtyXLsv'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:00:01 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:00:01 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:00:01 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[7295b9db-ee2d-41ba-9977-59c6333ca6d9]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:00:01 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-01be6a98-4758-40c1-873b-e454c34c24bb tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:00:01 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:00:01 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:00:01 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[d008e73f-51c8-435b-be32-83a3f253a9b0]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73a377b1-21a8-4273-8632-8daac8cd3a3b (non-flash)\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:00:01 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-01be6a98-4758-40c1-873b-e454c34c24bb tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8 (non-flash)
Nov 06 16:00:01 user nova-compute[75337]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da (non-flash)
Nov 06 16:00:01 user nova-compute[75337]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73a377b1-21a8-4273-8632-8daac8cd3a3b (non-flash)
Nov 06 16:00:01 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 16:00:01 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-01be6a98-4758-40c1-873b-e454c34c24bb tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8 (non-flash)
Nov 06 16:00:01 user nova-compute[75337]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da (non-flash)
Nov 06 16:00:01 user nova-compute[75337]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73a377b1-21a8-4273-8632-8daac8cd3a3b (non-flash)
Nov 06 16:00:01 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 16:00:01 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673 -p 172.16.0.220:3260 --login {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:00:01 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:00:01 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8544276-f910-4dd9-b379-4d69a4f97a65]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:00:01 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-01be6a98-4758-40c1-873b-e454c34c24bb tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673, portal: 172.16.0.220,3260]
Nov 06 16:00:01 user nova-compute[75337]: Login to [iface: default, target: iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673, portal: 172.16.0.220,3260] successful.
Nov 06 16:00:01 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:00:01 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:00:01 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:00:01 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[59fbf4ac-16dc-4163-980b-b7e832981a55]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:00:01 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-01be6a98-4758-40c1-873b-e454c34c24bb tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:00:01 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:00:01 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:00:01 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1193b57-dad5-41bf-aae6-9d9f55f1aa84]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73a377b1-21a8-4273-8632-8daac8cd3a3b (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673 (non-flash)\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:00:01 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-01be6a98-4758-40c1-873b-e454c34c24bb tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8 (non-flash)
Nov 06 16:00:01 user nova-compute[75337]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da (non-flash)
Nov 06 16:00:01 user nova-compute[75337]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73a377b1-21a8-4273-8632-8daac8cd3a3b (non-flash)
Nov 06 16:00:01 user nova-compute[75337]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673 (non-flash)
Nov 06 16:00:01 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 16:00:01 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-01be6a98-4758-40c1-873b-e454c34c24bb tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8 (non-flash)
Nov 06 16:00:01 user nova-compute[75337]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da (non-flash)
Nov 06 16:00:01 user nova-compute[75337]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73a377b1-21a8-4273-8632-8daac8cd3a3b (non-flash)
Nov 06 16:00:01 user nova-compute[75337]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673 (non-flash)
Nov 06 16:00:01 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 16:00:01 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-01be6a98-4758-40c1-873b-e454c34c24bb tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.306s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 16:00:01 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-01be6a98-4758-40c1-873b-e454c34c24bb tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Connected to 172.16.0.220:3260 {{(pid=75337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 16:00:01 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-01be6a98-4758-40c1-873b-e454c34c24bb tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] HCTL ('33', '-', '-', 0) found on session 41 with lun 0 {{(pid=75337) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 16:00:01 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-01be6a98-4758-40c1-873b-e454c34c24bb tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75337) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 16:00:01 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:00:01 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:00:01 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[a013aab9-0634-44f6-a374-56148d4a6b0d]: (4, ('- - 0', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:00:01 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-01be6a98-4758-40c1-873b-e454c34c24bb tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Searching for a device in session 41 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75337) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 16:00:01 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-01be6a98-4758-40c1-873b-e454c34c24bb tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CPtyXLsv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 16:00:02 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-01be6a98-4758-40c1-873b-e454c34c24bb tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.340s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 16:00:02 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-01be6a98-4758-40c1-873b-e454c34c24bb tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] <== connect_volume: return (1342ms) {'type': 'block', 'scsi_wwn': '23037396239386536', 'path': '/dev/sdb'} {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 16:00:02 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01be6a98-4758-40c1-873b-e454c34c24bb tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: e558736d-848f-4a79-a7aa-1e46638a85dc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23037396239386536', 'path': '/dev/sdb'} {{(pid=75337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 16:00:02 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-01be6a98-4758-40c1-873b-e454c34c24bb tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T15:59:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1536076217',display_name='tempest-TestVolumeBootPattern-server-1536076217',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1536076217',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGSEIi3g934sMLPVz4vXQXFZs0uPpfou1A8cQ+7f5EeoH+XvyrzPDAqzu7FTAOU7yXRJ8IemF+WnLjTlXTwpg+PX5Yor65g2g46SgdNmwrUcBQAy+H25S13pZzToJUCwGA==',key_name='tempest-TestVolumeBootPattern-1419808121',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='915211c6a2734c36b34ff92a56b085f6',ramdisk_id='',reservation_id='r-w3ek0o6w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1055092640',owner_user_name='tempest-TestVolumeBootPattern-1055092640-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T15:59:37Z,user_data=None,user_id='bb8d5f0200124588be1cfde107341a45',uuid=e558736d-848f-4a79-a7aa-1e46638a85dc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0ed5847d-dcc9-43c0-96ae-02b3d24d1416", "address": "fa:16:3e:22:e2:a6", "network": {"id": "4e47319f-de1d-4dfe-9915-7d2d5131704d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-895093240-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "915211c6a2734c36b34ff92a56b085f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ed5847d-dc", "ovs_interfaceid": "0ed5847d-dcc9-43c0-96ae-02b3d24d1416", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75337) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 16:00:02 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-01be6a98-4758-40c1-873b-e454c34c24bb tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Converting VIF {"id": "0ed5847d-dcc9-43c0-96ae-02b3d24d1416", "address": "fa:16:3e:22:e2:a6", "network": {"id": "4e47319f-de1d-4dfe-9915-7d2d5131704d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-895093240-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "915211c6a2734c36b34ff92a56b085f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ed5847d-dc", "ovs_interfaceid": "0ed5847d-dcc9-43c0-96ae-02b3d24d1416", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 16:00:02 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-01be6a98-4758-40c1-873b-e454c34c24bb tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:e2:a6,bridge_name='br-int',has_traffic_filtering=True,id=0ed5847d-dcc9-43c0-96ae-02b3d24d1416,network=Network(4e47319f-de1d-4dfe-9915-7d2d5131704d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ed5847d-dc') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 16:00:02 user nova-compute[75337]: DEBUG nova.objects.instance [None req-01be6a98-4758-40c1-873b-e454c34c24bb tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Lazy-loading 'pci_devices' on Instance uuid e558736d-848f-4a79-a7aa-1e46638a85dc {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 16:00:02 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-01be6a98-4758-40c1-873b-e454c34c24bb tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: e558736d-848f-4a79-a7aa-1e46638a85dc] End _get_guest_xml xml=<domain type="kvm">
Nov 06 16:00:02 user nova-compute[75337]:   <uuid>e558736d-848f-4a79-a7aa-1e46638a85dc</uuid>
Nov 06 16:00:02 user nova-compute[75337]:   <name>instance-00000026</name>
Nov 06 16:00:02 user nova-compute[75337]:   <memory>524288</memory>
Nov 06 16:00:02 user nova-compute[75337]:   <vcpu>1</vcpu>
Nov 06 16:00:02 user nova-compute[75337]:   <metadata>
Nov 06 16:00:02 user nova-compute[75337]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 16:00:02 user nova-compute[75337]:       <nova:package version="0.0.0"/>
Nov 06 16:00:02 user nova-compute[75337]:       <nova:name>tempest-TestVolumeBootPattern-server-1536076217</nova:name>
Nov 06 16:00:02 user nova-compute[75337]:       <nova:creationTime>2023-11-06 16:00:01</nova:creationTime>
Nov 06 16:00:02 user nova-compute[75337]:       <nova:flavor name="m1.tiny">
Nov 06 16:00:02 user nova-compute[75337]:         <nova:memory>512</nova:memory>
Nov 06 16:00:02 user nova-compute[75337]:         <nova:disk>1</nova:disk>
Nov 06 16:00:02 user nova-compute[75337]:         <nova:swap>0</nova:swap>
Nov 06 16:00:02 user nova-compute[75337]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 16:00:02 user nova-compute[75337]:         <nova:vcpus>1</nova:vcpus>
Nov 06 16:00:02 user nova-compute[75337]:       </nova:flavor>
Nov 06 16:00:02 user nova-compute[75337]:       <nova:owner>
Nov 06 16:00:02 user nova-compute[75337]:         <nova:user uuid="bb8d5f0200124588be1cfde107341a45">tempest-TestVolumeBootPattern-1055092640-project-member</nova:user>
Nov 06 16:00:02 user nova-compute[75337]:         <nova:project uuid="915211c6a2734c36b34ff92a56b085f6">tempest-TestVolumeBootPattern-1055092640</nova:project>
Nov 06 16:00:02 user nova-compute[75337]:       </nova:owner>
Nov 06 16:00:02 user nova-compute[75337]:       <nova:ports>
Nov 06 16:00:02 user nova-compute[75337]:         <nova:port uuid="0ed5847d-dcc9-43c0-96ae-02b3d24d1416">
Nov 06 16:00:02 user nova-compute[75337]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 06 16:00:02 user nova-compute[75337]:         </nova:port>
Nov 06 16:00:02 user nova-compute[75337]:       </nova:ports>
Nov 06 16:00:02 user nova-compute[75337]:     </nova:instance>
Nov 06 16:00:02 user nova-compute[75337]:   </metadata>
Nov 06 16:00:02 user nova-compute[75337]:   <sysinfo type="smbios">
Nov 06 16:00:02 user nova-compute[75337]:     <system>
Nov 06 16:00:02 user nova-compute[75337]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 16:00:02 user nova-compute[75337]:       <entry name="product">OpenStack Nova</entry>
Nov 06 16:00:02 user nova-compute[75337]:       <entry name="version">0.0.0</entry>
Nov 06 16:00:02 user nova-compute[75337]:       <entry name="serial">e558736d-848f-4a79-a7aa-1e46638a85dc</entry>
Nov 06 16:00:02 user nova-compute[75337]:       <entry name="uuid">e558736d-848f-4a79-a7aa-1e46638a85dc</entry>
Nov 06 16:00:02 user nova-compute[75337]:       <entry name="family">Virtual Machine</entry>
Nov 06 16:00:02 user nova-compute[75337]:     </system>
Nov 06 16:00:02 user nova-compute[75337]:   </sysinfo>
Nov 06 16:00:02 user nova-compute[75337]:   <os>
Nov 06 16:00:02 user nova-compute[75337]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 16:00:02 user nova-compute[75337]:     <boot dev="hd"/>
Nov 06 16:00:02 user nova-compute[75337]:     <smbios mode="sysinfo"/>
Nov 06 16:00:02 user nova-compute[75337]:   </os>
Nov 06 16:00:02 user nova-compute[75337]:   <features>
Nov 06 16:00:02 user nova-compute[75337]:     <acpi/>
Nov 06 16:00:02 user nova-compute[75337]:     <apic/>
Nov 06 16:00:02 user nova-compute[75337]:     <vmcoreinfo/>
Nov 06 16:00:02 user nova-compute[75337]:   </features>
Nov 06 16:00:02 user nova-compute[75337]:   <clock offset="utc">
Nov 06 16:00:02 user nova-compute[75337]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 16:00:02 user nova-compute[75337]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 16:00:02 user nova-compute[75337]:     <timer name="hpet" present="no"/>
Nov 06 16:00:02 user nova-compute[75337]:   </clock>
Nov 06 16:00:02 user nova-compute[75337]:   <cpu mode="custom" match="exact">
Nov 06 16:00:02 user nova-compute[75337]:     <model>Nehalem</model>
Nov 06 16:00:02 user nova-compute[75337]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 16:00:02 user nova-compute[75337]:   </cpu>
Nov 06 16:00:02 user nova-compute[75337]:   <devices>
Nov 06 16:00:02 user nova-compute[75337]:     <disk type="block" device="disk">
Nov 06 16:00:02 user nova-compute[75337]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 16:00:02 user nova-compute[75337]:       <source dev="/dev/sdb"/>
Nov 06 16:00:02 user nova-compute[75337]:       <target dev="vda" bus="virtio"/>
Nov 06 16:00:02 user nova-compute[75337]:       <serial>324f5822-eef0-4ecf-93e4-791b0677d673</serial>
Nov 06 16:00:02 user nova-compute[75337]:     </disk>
Nov 06 16:00:02 user nova-compute[75337]:     <interface type="ethernet">
Nov 06 16:00:02 user nova-compute[75337]:       <mac address="fa:16:3e:22:e2:a6"/>
Nov 06 16:00:02 user nova-compute[75337]:       <model type="virtio"/>
Nov 06 16:00:02 user nova-compute[75337]:       <mtu size="1442"/>
Nov 06 16:00:02 user nova-compute[75337]:       <target dev="tap0ed5847d-dc"/>
Nov 06 16:00:02 user nova-compute[75337]:     </interface>
Nov 06 16:00:02 user nova-compute[75337]:     <serial type="pty">
Nov 06 16:00:02 user nova-compute[75337]:       <log file="/opt/stack/data/nova/instances/e558736d-848f-4a79-a7aa-1e46638a85dc/console.log" append="off"/>
Nov 06 16:00:02 user nova-compute[75337]:     </serial>
Nov 06 16:00:02 user nova-compute[75337]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 16:00:02 user nova-compute[75337]:     <video>
Nov 06 16:00:02 user nova-compute[75337]:       <model type="virtio"/>
Nov 06 16:00:02 user nova-compute[75337]:     </video>
Nov 06 16:00:02 user nova-compute[75337]:     <rng model="virtio">
Nov 06 16:00:02 user nova-compute[75337]:       <backend model="random">/dev/urandom</backend>
Nov 06 16:00:02 user nova-compute[75337]:     </rng>
Nov 06 16:00:02 user nova-compute[75337]:     <controller type="usb" index="0" model="none"/>
Nov 06 16:00:02 user nova-compute[75337]:     <memballoon model="virtio">
Nov 06 16:00:02 user nova-compute[75337]:       <stats period="10"/>
Nov 06 16:00:02 user nova-compute[75337]:     </memballoon>
Nov 06 16:00:02 user nova-compute[75337]:   </devices>
Nov 06 16:00:02 user nova-compute[75337]: </domain>
Nov 06 16:00:02 user nova-compute[75337]:  {{(pid=75337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 16:00:02 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-01be6a98-4758-40c1-873b-e454c34c24bb tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T15:59:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1536076217',display_name='tempest-TestVolumeBootPattern-server-1536076217',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1536076217',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGSEIi3g934sMLPVz4vXQXFZs0uPpfou1A8cQ+7f5EeoH+XvyrzPDAqzu7FTAOU7yXRJ8IemF+WnLjTlXTwpg+PX5Yor65g2g46SgdNmwrUcBQAy+H25S13pZzToJUCwGA==',key_name='tempest-TestVolumeBootPattern-1419808121',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='915211c6a2734c36b34ff92a56b085f6',ramdisk_id='',reservation_id='r-w3ek0o6w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1055092640',owner_user_name='tempest-TestVolumeBootPattern-1055092640-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T15:59:37Z,user_data=None,user_id='bb8d5f0200124588be1cfde107341a45',uuid=e558736d-848f-4a79-a7aa-1e46638a85dc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0ed5847d-dcc9-43c0-96ae-02b3d24d1416", "address": "fa:16:3e:22:e2:a6", "network": {"id": "4e47319f-de1d-4dfe-9915-7d2d5131704d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-895093240-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "915211c6a2734c36b34ff92a56b085f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ed5847d-dc", "ovs_interfaceid": "0ed5847d-dcc9-43c0-96ae-02b3d24d1416", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 16:00:02 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-01be6a98-4758-40c1-873b-e454c34c24bb tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Converting VIF {"id": "0ed5847d-dcc9-43c0-96ae-02b3d24d1416", "address": "fa:16:3e:22:e2:a6", "network": {"id": "4e47319f-de1d-4dfe-9915-7d2d5131704d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-895093240-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "915211c6a2734c36b34ff92a56b085f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ed5847d-dc", "ovs_interfaceid": "0ed5847d-dcc9-43c0-96ae-02b3d24d1416", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 16:00:02 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-01be6a98-4758-40c1-873b-e454c34c24bb tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:e2:a6,bridge_name='br-int',has_traffic_filtering=True,id=0ed5847d-dcc9-43c0-96ae-02b3d24d1416,network=Network(4e47319f-de1d-4dfe-9915-7d2d5131704d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ed5847d-dc') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 16:00:02 user nova-compute[75337]: DEBUG os_vif [None req-01be6a98-4758-40c1-873b-e454c34c24bb tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:e2:a6,bridge_name='br-int',has_traffic_filtering=True,id=0ed5847d-dcc9-43c0-96ae-02b3d24d1416,network=Network(4e47319f-de1d-4dfe-9915-7d2d5131704d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ed5847d-dc') {{(pid=75337) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 16:00:02 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:00:02 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 16:00:02 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 16:00:02 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:00:02 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5f4d0bf3-5ef4-5ba4-8685-a031873b24dc', '_type': 'linux-noop'}}, row=False) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 16:00:02 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:00:02 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:00:02 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:00:02 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0ed5847d-dc, may_exist=True, interface_attrs={}) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 16:00:02 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0ed5847d-dc, col_values=(('qos', UUID('40b885e9-b7d5-4ac6-92a4-6e9e64530fa5')),), if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 16:00:02 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0ed5847d-dc, col_values=(('external_ids', {'iface-id': '0ed5847d-dcc9-43c0-96ae-02b3d24d1416', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:22:e2:a6', 'vm-uuid': 'e558736d-848f-4a79-a7aa-1e46638a85dc'}),), if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 16:00:02 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:00:02 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:00:02 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:00:02 user nova-compute[75337]: INFO os_vif [None req-01be6a98-4758-40c1-873b-e454c34c24bb tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:e2:a6,bridge_name='br-int',has_traffic_filtering=True,id=0ed5847d-dcc9-43c0-96ae-02b3d24d1416,network=Network(4e47319f-de1d-4dfe-9915-7d2d5131704d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ed5847d-dc')
Nov 06 16:00:02 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-01be6a98-4758-40c1-873b-e454c34c24bb tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] No BDM found with device name vda, not building metadata. {{(pid=75337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 16:00:02 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-01be6a98-4758-40c1-873b-e454c34c24bb tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] No VIF found with MAC fa:16:3e:22:e2:a6, not building metadata {{(pid=75337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 16:00:04 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:00:04 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:00:04 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:00:04 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:00:04 user nova-compute[75337]: DEBUG nova.compute.manager [req-cde09863-df74-4f54-9f71-dd65581afd8d req-57fa2fb1-46f4-4bef-9da6-71f70833e49e service nova] [instance: e558736d-848f-4a79-a7aa-1e46638a85dc] Received event network-vif-plugged-0ed5847d-dcc9-43c0-96ae-02b3d24d1416 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:00:04 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-cde09863-df74-4f54-9f71-dd65581afd8d req-57fa2fb1-46f4-4bef-9da6-71f70833e49e service nova] Acquiring lock "e558736d-848f-4a79-a7aa-1e46638a85dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:00:04 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-cde09863-df74-4f54-9f71-dd65581afd8d req-57fa2fb1-46f4-4bef-9da6-71f70833e49e service nova] Lock "e558736d-848f-4a79-a7aa-1e46638a85dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:00:04 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-cde09863-df74-4f54-9f71-dd65581afd8d req-57fa2fb1-46f4-4bef-9da6-71f70833e49e service nova] Lock "e558736d-848f-4a79-a7aa-1e46638a85dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:00:04 user nova-compute[75337]: DEBUG nova.compute.manager [req-cde09863-df74-4f54-9f71-dd65581afd8d req-57fa2fb1-46f4-4bef-9da6-71f70833e49e service nova] [instance: e558736d-848f-4a79-a7aa-1e46638a85dc] No waiting events found dispatching network-vif-plugged-0ed5847d-dcc9-43c0-96ae-02b3d24d1416 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 16:00:04 user nova-compute[75337]: WARNING nova.compute.manager [req-cde09863-df74-4f54-9f71-dd65581afd8d req-57fa2fb1-46f4-4bef-9da6-71f70833e49e service nova] [instance: e558736d-848f-4a79-a7aa-1e46638a85dc] Received unexpected event network-vif-plugged-0ed5847d-dcc9-43c0-96ae-02b3d24d1416 for instance with vm_state building and task_state spawning.
Nov 06 16:00:04 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:00:04 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:00:04 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:00:04 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:00:05 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:00:06 user nova-compute[75337]: DEBUG nova.compute.manager [None req-01be6a98-4758-40c1-873b-e454c34c24bb tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: e558736d-848f-4a79-a7aa-1e46638a85dc] Instance event wait completed in 0 seconds for  {{(pid=75337) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 16:00:06 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-01be6a98-4758-40c1-873b-e454c34c24bb tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: e558736d-848f-4a79-a7aa-1e46638a85dc] Guest created on hypervisor {{(pid=75337) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 16:00:06 user nova-compute[75337]: INFO nova.virt.libvirt.driver [-] [instance: e558736d-848f-4a79-a7aa-1e46638a85dc] Instance spawned successfully.
Nov 06 16:00:06 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-01be6a98-4758-40c1-873b-e454c34c24bb tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: e558736d-848f-4a79-a7aa-1e46638a85dc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 16:00:06 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-01be6a98-4758-40c1-873b-e454c34c24bb tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: e558736d-848f-4a79-a7aa-1e46638a85dc] Found default for hw_cdrom_bus of ide {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 16:00:06 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-01be6a98-4758-40c1-873b-e454c34c24bb tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: e558736d-848f-4a79-a7aa-1e46638a85dc] Found default for hw_disk_bus of virtio {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 16:00:06 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-01be6a98-4758-40c1-873b-e454c34c24bb tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: e558736d-848f-4a79-a7aa-1e46638a85dc] Found default for hw_input_bus of None {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 16:00:06 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-01be6a98-4758-40c1-873b-e454c34c24bb tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: e558736d-848f-4a79-a7aa-1e46638a85dc] Found default for hw_pointer_model of None {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 16:00:06 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-01be6a98-4758-40c1-873b-e454c34c24bb tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: e558736d-848f-4a79-a7aa-1e46638a85dc] Found default for hw_video_model of virtio {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 16:00:06 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-01be6a98-4758-40c1-873b-e454c34c24bb tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: e558736d-848f-4a79-a7aa-1e46638a85dc] Found default for hw_vif_model of virtio {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 16:00:06 user nova-compute[75337]: INFO nova.compute.manager [None req-01be6a98-4758-40c1-873b-e454c34c24bb tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: e558736d-848f-4a79-a7aa-1e46638a85dc] Took 5.39 seconds to spawn the instance on the hypervisor.
Nov 06 16:00:06 user nova-compute[75337]: DEBUG nova.compute.manager [None req-01be6a98-4758-40c1-873b-e454c34c24bb tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: e558736d-848f-4a79-a7aa-1e46638a85dc] Checking state {{(pid=75337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 16:00:06 user nova-compute[75337]: DEBUG nova.compute.manager [req-a247ddcd-b0c9-4750-8a3a-44806857597d req-7d21fabe-ae1a-46aa-8c12-29de2d1cd710 service nova] [instance: e558736d-848f-4a79-a7aa-1e46638a85dc] Received event network-vif-plugged-0ed5847d-dcc9-43c0-96ae-02b3d24d1416 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:00:06 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-a247ddcd-b0c9-4750-8a3a-44806857597d req-7d21fabe-ae1a-46aa-8c12-29de2d1cd710 service nova] Acquiring lock "e558736d-848f-4a79-a7aa-1e46638a85dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:00:06 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-a247ddcd-b0c9-4750-8a3a-44806857597d req-7d21fabe-ae1a-46aa-8c12-29de2d1cd710 service nova] Lock "e558736d-848f-4a79-a7aa-1e46638a85dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:00:06 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-a247ddcd-b0c9-4750-8a3a-44806857597d req-7d21fabe-ae1a-46aa-8c12-29de2d1cd710 service nova] Lock "e558736d-848f-4a79-a7aa-1e46638a85dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:00:06 user nova-compute[75337]: DEBUG nova.compute.manager [req-a247ddcd-b0c9-4750-8a3a-44806857597d req-7d21fabe-ae1a-46aa-8c12-29de2d1cd710 service nova] [instance: e558736d-848f-4a79-a7aa-1e46638a85dc] No waiting events found dispatching network-vif-plugged-0ed5847d-dcc9-43c0-96ae-02b3d24d1416 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 16:00:06 user nova-compute[75337]: WARNING nova.compute.manager [req-a247ddcd-b0c9-4750-8a3a-44806857597d req-7d21fabe-ae1a-46aa-8c12-29de2d1cd710 service nova] [instance: e558736d-848f-4a79-a7aa-1e46638a85dc] Received unexpected event network-vif-plugged-0ed5847d-dcc9-43c0-96ae-02b3d24d1416 for instance with vm_state active and task_state None.
Nov 06 16:00:06 user nova-compute[75337]: INFO nova.compute.manager [None req-01be6a98-4758-40c1-873b-e454c34c24bb tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: e558736d-848f-4a79-a7aa-1e46638a85dc] Took 29.97 seconds to build instance.
Nov 06 16:00:06 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:00:06 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75337) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 16:00:06 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-01be6a98-4758-40c1-873b-e454c34c24bb tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Lock "e558736d-848f-4a79-a7aa-1e46638a85dc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 30.071s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:00:07 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:00:08 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:00:09 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:00:10 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-b72bf353-4f58-44f6-8b85-9e02e7943b79 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Acquiring lock "d10b4a86-8b0d-423f-81e2-87f5f25a2467" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:00:10 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-b72bf353-4f58-44f6-8b85-9e02e7943b79 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Lock "d10b4a86-8b0d-423f-81e2-87f5f25a2467" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:00:10 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-b72bf353-4f58-44f6-8b85-9e02e7943b79 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Acquiring lock "d10b4a86-8b0d-423f-81e2-87f5f25a2467-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:00:10 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-b72bf353-4f58-44f6-8b85-9e02e7943b79 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Lock "d10b4a86-8b0d-423f-81e2-87f5f25a2467-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:00:10 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-b72bf353-4f58-44f6-8b85-9e02e7943b79 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Lock "d10b4a86-8b0d-423f-81e2-87f5f25a2467-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:00:10 user nova-compute[75337]: INFO nova.compute.manager [None req-b72bf353-4f58-44f6-8b85-9e02e7943b79 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] [instance: d10b4a86-8b0d-423f-81e2-87f5f25a2467] Terminating instance
Nov 06 16:00:10 user nova-compute[75337]: DEBUG nova.compute.manager [None req-b72bf353-4f58-44f6-8b85-9e02e7943b79 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] [instance: d10b4a86-8b0d-423f-81e2-87f5f25a2467] Start destroying the instance on the hypervisor. {{(pid=75337) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 16:00:10 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:00:10 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:00:10 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:00:10 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:00:10 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:00:10 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:00:10 user nova-compute[75337]: DEBUG nova.compute.manager [req-79a7a0bf-723f-4fdc-87e1-349e17f7292c req-94f13ee5-871c-48ad-bce0-aa8eebddee67 service nova] [instance: d10b4a86-8b0d-423f-81e2-87f5f25a2467] Received event network-vif-unplugged-f9232e10-c7da-42d1-91c6-d72b0a1e0ccb {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:00:10 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-79a7a0bf-723f-4fdc-87e1-349e17f7292c req-94f13ee5-871c-48ad-bce0-aa8eebddee67 service nova] Acquiring lock "d10b4a86-8b0d-423f-81e2-87f5f25a2467-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:00:10 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-79a7a0bf-723f-4fdc-87e1-349e17f7292c req-94f13ee5-871c-48ad-bce0-aa8eebddee67 service nova] Lock "d10b4a86-8b0d-423f-81e2-87f5f25a2467-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:00:10 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-79a7a0bf-723f-4fdc-87e1-349e17f7292c req-94f13ee5-871c-48ad-bce0-aa8eebddee67 service nova] Lock "d10b4a86-8b0d-423f-81e2-87f5f25a2467-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:00:10 user nova-compute[75337]: DEBUG nova.compute.manager [req-79a7a0bf-723f-4fdc-87e1-349e17f7292c req-94f13ee5-871c-48ad-bce0-aa8eebddee67 service nova] [instance: d10b4a86-8b0d-423f-81e2-87f5f25a2467] No waiting events found dispatching network-vif-unplugged-f9232e10-c7da-42d1-91c6-d72b0a1e0ccb {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 16:00:10 user nova-compute[75337]: DEBUG nova.compute.manager [req-79a7a0bf-723f-4fdc-87e1-349e17f7292c req-94f13ee5-871c-48ad-bce0-aa8eebddee67 service nova] [instance: d10b4a86-8b0d-423f-81e2-87f5f25a2467] Received event network-vif-unplugged-f9232e10-c7da-42d1-91c6-d72b0a1e0ccb for instance with task_state deleting. {{(pid=75337) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 16:00:10 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:00:11 user nova-compute[75337]: INFO nova.virt.libvirt.driver [-] [instance: d10b4a86-8b0d-423f-81e2-87f5f25a2467] Instance destroyed successfully.
Nov 06 16:00:11 user nova-compute[75337]: DEBUG nova.objects.instance [None req-b72bf353-4f58-44f6-8b85-9e02e7943b79 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Lazy-loading 'resources' on Instance uuid d10b4a86-8b0d-423f-81e2-87f5f25a2467 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 16:00:11 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-b72bf353-4f58-44f6-8b85-9e02e7943b79 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T15:53:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1428152347',display_name='tempest-TestMinimumBasicScenario-server-1428152347',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1428152347',id=30,image_ref='b2bd209c-1854-4296-878e-12b97860cf7e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLeGZ0NNG8iDmqfRwynCeGkLkdivVOJUUT+8v5Pk7Ie2vaf+Y7xHcOuUhIU5MfzY1f4/p36cRXZITF1qZCli35Xyvr76yXg1+/gHPr8L3c8kcgm5E40YfNtApHH749OmRA==',key_name='tempest-TestMinimumBasicScenario-1095476101',keypairs=<?>,launch_index=0,launched_at=2023-11-06T15:53:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2cddccc86bf54fe981667da5ef13fa8a',ramdisk_id='',reservation_id='r-ecwh0mw2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b2bd209c-1854-4296-878e-12b97860cf7e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-2098539193',owner_user_name='tempest-TestMinimumBasicScenario-2098539193-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T15:57:23Z,user_data=None,user_id='8c795ee993a944ff89ed544450b90dc2',uuid=d10b4a86-8b0d-423f-81e2-87f5f25a2467,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f9232e10-c7da-42d1-91c6-d72b0a1e0ccb", "address": "fa:16:3e:93:ab:63", "network": {"id": "c31b513a-57f0-4bd5-b055-4a363aae9793", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1352256985-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cddccc86bf54fe981667da5ef13fa8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9232e10-c7", "ovs_interfaceid": "f9232e10-c7da-42d1-91c6-d72b0a1e0ccb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 16:00:11 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-b72bf353-4f58-44f6-8b85-9e02e7943b79 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Converting VIF {"id": "f9232e10-c7da-42d1-91c6-d72b0a1e0ccb", "address": "fa:16:3e:93:ab:63", "network": {"id": "c31b513a-57f0-4bd5-b055-4a363aae9793", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1352256985-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cddccc86bf54fe981667da5ef13fa8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9232e10-c7", "ovs_interfaceid": "f9232e10-c7da-42d1-91c6-d72b0a1e0ccb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 16:00:11 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-b72bf353-4f58-44f6-8b85-9e02e7943b79 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:93:ab:63,bridge_name='br-int',has_traffic_filtering=True,id=f9232e10-c7da-42d1-91c6-d72b0a1e0ccb,network=Network(c31b513a-57f0-4bd5-b055-4a363aae9793),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9232e10-c7') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 16:00:11 user nova-compute[75337]: DEBUG os_vif [None req-b72bf353-4f58-44f6-8b85-9e02e7943b79 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:93:ab:63,bridge_name='br-int',has_traffic_filtering=True,id=f9232e10-c7da-42d1-91c6-d72b0a1e0ccb,network=Network(c31b513a-57f0-4bd5-b055-4a363aae9793),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9232e10-c7') {{(pid=75337) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 16:00:11 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:00:11 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf9232e10-c7, bridge=br-int, if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 16:00:11 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:00:11 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:00:11 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:00:11 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c743ab7e-a8d3-4340-a1b1-989b909a9405) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 16:00:11 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:00:11 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:00:11 user nova-compute[75337]: INFO os_vif [None req-b72bf353-4f58-44f6-8b85-9e02e7943b79 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:93:ab:63,bridge_name='br-int',has_traffic_filtering=True,id=f9232e10-c7da-42d1-91c6-d72b0a1e0ccb,network=Network(c31b513a-57f0-4bd5-b055-4a363aae9793),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9232e10-c7')
Nov 06 16:00:11 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-b72bf353-4f58-44f6-8b85-9e02e7943b79 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] [instance: d10b4a86-8b0d-423f-81e2-87f5f25a2467] Deleting instance files /opt/stack/data/nova/instances/d10b4a86-8b0d-423f-81e2-87f5f25a2467_del
Nov 06 16:00:11 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-b72bf353-4f58-44f6-8b85-9e02e7943b79 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] [instance: d10b4a86-8b0d-423f-81e2-87f5f25a2467] Deletion of /opt/stack/data/nova/instances/d10b4a86-8b0d-423f-81e2-87f5f25a2467_del complete
Nov 06 16:00:11 user nova-compute[75337]: INFO nova.compute.manager [None req-b72bf353-4f58-44f6-8b85-9e02e7943b79 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] [instance: d10b4a86-8b0d-423f-81e2-87f5f25a2467] Took 0.96 seconds to destroy the instance on the hypervisor.
Nov 06 16:00:11 user nova-compute[75337]: DEBUG oslo.service.loopingcall [None req-b72bf353-4f58-44f6-8b85-9e02e7943b79 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75337) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 16:00:11 user nova-compute[75337]: DEBUG nova.compute.manager [-] [instance: d10b4a86-8b0d-423f-81e2-87f5f25a2467] Deallocating network for instance {{(pid=75337) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 16:00:11 user nova-compute[75337]: DEBUG nova.network.neutron [-] [instance: d10b4a86-8b0d-423f-81e2-87f5f25a2467] deallocate_for_instance() {{(pid=75337) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 16:00:11 user nova-compute[75337]: DEBUG nova.network.neutron [-] [instance: d10b4a86-8b0d-423f-81e2-87f5f25a2467] Updating instance_info_cache with network_info: [] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 16:00:11 user nova-compute[75337]: INFO nova.compute.manager [-] [instance: d10b4a86-8b0d-423f-81e2-87f5f25a2467] Took 0.71 seconds to deallocate network for instance.
Nov 06 16:00:11 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-b72bf353-4f58-44f6-8b85-9e02e7943b79 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:00:11 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-b72bf353-4f58-44f6-8b85-9e02e7943b79 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:00:12 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-b72bf353-4f58-44f6-8b85-9e02e7943b79 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 16:00:12 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-b72bf353-4f58-44f6-8b85-9e02e7943b79 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 16:00:12 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-b72bf353-4f58-44f6-8b85-9e02e7943b79 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.343s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:00:12 user nova-compute[75337]: INFO nova.scheduler.client.report [None req-b72bf353-4f58-44f6-8b85-9e02e7943b79 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Deleted allocations for instance d10b4a86-8b0d-423f-81e2-87f5f25a2467
Nov 06 16:00:12 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-b72bf353-4f58-44f6-8b85-9e02e7943b79 tempest-TestMinimumBasicScenario-2098539193 tempest-TestMinimumBasicScenario-2098539193-project-member] Lock "d10b4a86-8b0d-423f-81e2-87f5f25a2467" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.243s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:00:12 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:00:12 user nova-compute[75337]: DEBUG nova.compute.manager [req-30cd4b19-9050-4155-b310-038eee129cc2 req-cbc3e7b4-c7f4-43da-95ff-f2b65e37bc69 service nova] [instance: d10b4a86-8b0d-423f-81e2-87f5f25a2467] Received event network-vif-plugged-f9232e10-c7da-42d1-91c6-d72b0a1e0ccb {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:00:12 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-30cd4b19-9050-4155-b310-038eee129cc2 req-cbc3e7b4-c7f4-43da-95ff-f2b65e37bc69 service nova] Acquiring lock "d10b4a86-8b0d-423f-81e2-87f5f25a2467-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:00:12 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-30cd4b19-9050-4155-b310-038eee129cc2 req-cbc3e7b4-c7f4-43da-95ff-f2b65e37bc69 service nova] Lock "d10b4a86-8b0d-423f-81e2-87f5f25a2467-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:00:12 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-30cd4b19-9050-4155-b310-038eee129cc2 req-cbc3e7b4-c7f4-43da-95ff-f2b65e37bc69 service nova] Lock "d10b4a86-8b0d-423f-81e2-87f5f25a2467-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:00:12 user nova-compute[75337]: DEBUG nova.compute.manager [req-30cd4b19-9050-4155-b310-038eee129cc2 req-cbc3e7b4-c7f4-43da-95ff-f2b65e37bc69 service nova] [instance: d10b4a86-8b0d-423f-81e2-87f5f25a2467] No waiting events found dispatching network-vif-plugged-f9232e10-c7da-42d1-91c6-d72b0a1e0ccb {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 16:00:12 user nova-compute[75337]: WARNING nova.compute.manager [req-30cd4b19-9050-4155-b310-038eee129cc2 req-cbc3e7b4-c7f4-43da-95ff-f2b65e37bc69 service nova] [instance: d10b4a86-8b0d-423f-81e2-87f5f25a2467] Received unexpected event network-vif-plugged-f9232e10-c7da-42d1-91c6-d72b0a1e0ccb for instance with vm_state deleted and task_state None.
Nov 06 16:00:12 user nova-compute[75337]: DEBUG nova.compute.manager [req-30cd4b19-9050-4155-b310-038eee129cc2 req-cbc3e7b4-c7f4-43da-95ff-f2b65e37bc69 service nova] [instance: d10b4a86-8b0d-423f-81e2-87f5f25a2467] Received event network-vif-deleted-f9232e10-c7da-42d1-91c6-d72b0a1e0ccb {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:00:13 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:00:13 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:00:16 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:00:17 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:00:17 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Starting heal instance info cache {{(pid=75337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 16:00:17 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Rebuilding the list of instances to heal {{(pid=75337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 06 16:00:17 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "refresh_cache-30c634ff-6999-40aa-a90d-1db6d278b571" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 16:00:17 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquired lock "refresh_cache-30c634ff-6999-40aa-a90d-1db6d278b571" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 16:00:17 user nova-compute[75337]: DEBUG nova.network.neutron [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] [instance: 30c634ff-6999-40aa-a90d-1db6d278b571] Forcefully refreshing network info cache for instance {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 16:00:17 user nova-compute[75337]: DEBUG nova.objects.instance [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lazy-loading 'info_cache' on Instance uuid 30c634ff-6999-40aa-a90d-1db6d278b571 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 16:00:18 user nova-compute[75337]: DEBUG nova.network.neutron [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] [instance: 30c634ff-6999-40aa-a90d-1db6d278b571] Updating instance_info_cache with network_info: [{"id": "7b7a4e21-92b6-4854-8c0d-4d9556247a72", "address": "fa:16:3e:ee:c7:a1", "network": {"id": "6757c3a5-4f6f-48a7-9645-af433fb039de", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1337373982-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e13dfd402b7b4ed1a1092c7388ff5188", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b7a4e21-92", "ovs_interfaceid": "7b7a4e21-92b6-4854-8c0d-4d9556247a72", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 16:00:18 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Releasing lock "refresh_cache-30c634ff-6999-40aa-a90d-1db6d278b571" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 16:00:18 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] [instance: 30c634ff-6999-40aa-a90d-1db6d278b571] Updated the network info_cache for instance {{(pid=75337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 16:00:19 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-81fc8da5-6b72-48b1-a80e-5e7cd33bc465 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] [instance: ba7d8a41-5a75-4dca-a192-0177119403be] Calling os-brick to attach iSCSI Volume {{(pid=75337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 16:00:19 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-81fc8da5-6b72-48b1-a80e-5e7cd33bc465 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2abc33d0c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:45e66a2b-499f-46ca-90b5-2eeac6a5a8be', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UexatBkR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 16:00:19 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-81fc8da5-6b72-48b1-a80e-5e7cd33bc465 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 16:00:19 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-81fc8da5-6b72-48b1-a80e-5e7cd33bc465 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 16:00:19 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-81fc8da5-6b72-48b1-a80e-5e7cd33bc465 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 16:00:19 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-81fc8da5-6b72-48b1-a80e-5e7cd33bc465 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 16:00:19 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-81fc8da5-6b72-48b1-a80e-5e7cd33bc465 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:45e66a2b-499f-46ca-90b5-2eeac6a5a8be" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 16:00:19 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-81fc8da5-6b72-48b1-a80e-5e7cd33bc465 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:45e66a2b-499f-46ca-90b5-2eeac6a5a8be" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 16:00:19 user nova-compute[75337]: INFO os_brick.initiator.connectors.iscsi [None req-81fc8da5-6b72-48b1-a80e-5e7cd33bc465 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 16:00:19 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45e66a2b-499f-46ca-90b5-2eeac6a5a8be -p 172.16.0.220:3260 {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:00:19 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45e66a2b-499f-46ca-90b5-2eeac6a5a8be -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:00:19 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[8da6a360-194e-47f7-a5b1-8daa8dd8d4e2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:00:19 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-81fc8da5-6b72-48b1-a80e-5e7cd33bc465 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 16:00:19 user nova-compute[75337]:  {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:00:19 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45e66a2b-499f-46ca-90b5-2eeac6a5a8be -p 172.16.0.220:3260 --interface default --op new {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:00:19 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45e66a2b-499f-46ca-90b5-2eeac6a5a8be -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:00:19 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a5f23bb-4924-46a4-9bfa-5f7ab679beeb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:45e66a2b-499f-46ca-90b5-2eeac6a5a8be] added\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:00:19 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-81fc8da5-6b72-48b1-a80e-5e7cd33bc465 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:45e66a2b-499f-46ca-90b5-2eeac6a5a8be] added
Nov 06 16:00:19 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:00:19 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45e66a2b-499f-46ca-90b5-2eeac6a5a8be -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:00:19 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45e66a2b-499f-46ca-90b5-2eeac6a5a8be -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:00:19 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[924233b6-1fcb-4c08-ba49-e0aac40782fd]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:00:19 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-81fc8da5-6b72-48b1-a80e-5e7cd33bc465 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:00:19 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45e66a2b-499f-46ca-90b5-2eeac6a5a8be -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:00:19 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45e66a2b-499f-46ca-90b5-2eeac6a5a8be -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:00:19 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ad22709-7f2d-4618-988e-4a1e8f917149]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:00:19 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-81fc8da5-6b72-48b1-a80e-5e7cd33bc465 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:00:19 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45e66a2b-499f-46ca-90b5-2eeac6a5a8be -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UexatBkR {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:00:19 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45e66a2b-499f-46ca-90b5-2eeac6a5a8be -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UexatBkR" returned: 0 in 0.019s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:00:19 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c3c8149-9222-473c-8a65-43ddf41e4646]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:00:19 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-81fc8da5-6b72-48b1-a80e-5e7cd33bc465 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UexatBkR'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:00:19 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45e66a2b-499f-46ca-90b5-2eeac6a5a8be -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:00:19 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45e66a2b-499f-46ca-90b5-2eeac6a5a8be -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:00:19 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[c97a7bbd-5f39-4337-b118-8de6e1335dcd]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:00:19 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-81fc8da5-6b72-48b1-a80e-5e7cd33bc465 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:00:19 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:00:19 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:00:19 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce4711f3-21dd-4ee4-a5eb-c858b36f6618]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73a377b1-21a8-4273-8632-8daac8cd3a3b (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673 (non-flash)\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:00:19 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-81fc8da5-6b72-48b1-a80e-5e7cd33bc465 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8 (non-flash)
Nov 06 16:00:19 user nova-compute[75337]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da (non-flash)
Nov 06 16:00:19 user nova-compute[75337]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73a377b1-21a8-4273-8632-8daac8cd3a3b (non-flash)
Nov 06 16:00:19 user nova-compute[75337]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673 (non-flash)
Nov 06 16:00:19 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 16:00:19 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-81fc8da5-6b72-48b1-a80e-5e7cd33bc465 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8 (non-flash)
Nov 06 16:00:19 user nova-compute[75337]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da (non-flash)
Nov 06 16:00:19 user nova-compute[75337]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73a377b1-21a8-4273-8632-8daac8cd3a3b (non-flash)
Nov 06 16:00:19 user nova-compute[75337]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673 (non-flash)
Nov 06 16:00:19 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 16:00:19 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45e66a2b-499f-46ca-90b5-2eeac6a5a8be -p 172.16.0.220:3260 --login {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:00:19 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45e66a2b-499f-46ca-90b5-2eeac6a5a8be -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:00:19 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[3742aa36-1418-44f5-9ebf-963675534186]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:45e66a2b-499f-46ca-90b5-2eeac6a5a8be, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:45e66a2b-499f-46ca-90b5-2eeac6a5a8be, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:00:19 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-81fc8da5-6b72-48b1-a80e-5e7cd33bc465 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:45e66a2b-499f-46ca-90b5-2eeac6a5a8be, portal: 172.16.0.220,3260]
Nov 06 16:00:19 user nova-compute[75337]: Login to [iface: default, target: iqn.2010-10.org.openstack:45e66a2b-499f-46ca-90b5-2eeac6a5a8be, portal: 172.16.0.220,3260] successful.
Nov 06 16:00:19 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:00:19 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45e66a2b-499f-46ca-90b5-2eeac6a5a8be -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:00:19 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45e66a2b-499f-46ca-90b5-2eeac6a5a8be -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:00:19 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[66ea9eae-0097-4c17-b30c-df4998b2c966]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:00:19 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-81fc8da5-6b72-48b1-a80e-5e7cd33bc465 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:00:19 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:00:19 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:00:19 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9ce6955-8889-40ff-9b57-9a0181befa33]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73a377b1-21a8-4273-8632-8daac8cd3a3b (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45e66a2b-499f-46ca-90b5-2eeac6a5a8be (non-flash)\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:00:19 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-81fc8da5-6b72-48b1-a80e-5e7cd33bc465 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8 (non-flash)
Nov 06 16:00:19 user nova-compute[75337]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da (non-flash)
Nov 06 16:00:19 user nova-compute[75337]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73a377b1-21a8-4273-8632-8daac8cd3a3b (non-flash)
Nov 06 16:00:19 user nova-compute[75337]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673 (non-flash)
Nov 06 16:00:19 user nova-compute[75337]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45e66a2b-499f-46ca-90b5-2eeac6a5a8be (non-flash)
Nov 06 16:00:19 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 16:00:19 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-81fc8da5-6b72-48b1-a80e-5e7cd33bc465 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8 (non-flash)
Nov 06 16:00:19 user nova-compute[75337]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da (non-flash)
Nov 06 16:00:19 user nova-compute[75337]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73a377b1-21a8-4273-8632-8daac8cd3a3b (non-flash)
Nov 06 16:00:19 user nova-compute[75337]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673 (non-flash)
Nov 06 16:00:19 user nova-compute[75337]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45e66a2b-499f-46ca-90b5-2eeac6a5a8be (non-flash)
Nov 06 16:00:19 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 16:00:19 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-81fc8da5-6b72-48b1-a80e-5e7cd33bc465 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:45e66a2b-499f-46ca-90b5-2eeac6a5a8be" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.290s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 16:00:19 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-81fc8da5-6b72-48b1-a80e-5e7cd33bc465 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] Connected to 172.16.0.220:3260 {{(pid=75337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 16:00:19 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-81fc8da5-6b72-48b1-a80e-5e7cd33bc465 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] HCTL ('37', '-', '-', 0) found on session 42 with lun 0 {{(pid=75337) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 16:00:19 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-81fc8da5-6b72-48b1-a80e-5e7cd33bc465 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75337) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 16:00:19 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:00:19 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:00:19 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[487145f0-ae30-470a-ab01-cbf8d9d76d3e]: (4, ('- - 0', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:00:19 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-81fc8da5-6b72-48b1-a80e-5e7cd33bc465 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] Searching for a device in session 42 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75337) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 16:00:19 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-81fc8da5-6b72-48b1-a80e-5e7cd33bc465 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:45e66a2b-499f-46ca-90b5-2eeac6a5a8be', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UexatBkR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 16:00:19 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager.update_available_resource {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:00:19 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:00:19 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:00:19 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:00:19 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Auditing locally available compute resources for user (node: user) {{(pid=75337) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 16:00:19 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba7d8a41-5a75-4dca-a192-0177119403be/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:00:19 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba7d8a41-5a75-4dca-a192-0177119403be/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:00:19 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba7d8a41-5a75-4dca-a192-0177119403be/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:00:20 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba7d8a41-5a75-4dca-a192-0177119403be/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:00:20 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69df3824-b28c-43c0-9f20-52fa956642cc/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:00:20 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69df3824-b28c-43c0-9f20-52fa956642cc/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:00:20 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69df3824-b28c-43c0-9f20-52fa956642cc/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:00:20 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-81fc8da5-6b72-48b1-a80e-5e7cd33bc465 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.327s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 16:00:20 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-81fc8da5-6b72-48b1-a80e-5e7cd33bc465 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] <== connect_volume: return (1330ms) {'type': 'block', 'scsi_wwn': '26333386132346234', 'path': '/dev/sdf'} {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 16:00:20 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-81fc8da5-6b72-48b1-a80e-5e7cd33bc465 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] [instance: ba7d8a41-5a75-4dca-a192-0177119403be] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26333386132346234', 'path': '/dev/sdf'} {{(pid=75337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 16:00:20 user nova-compute[75337]: DEBUG nova.objects.instance [None req-81fc8da5-6b72-48b1-a80e-5e7cd33bc465 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] Lazy-loading 'flavor' on Instance uuid ba7d8a41-5a75-4dca-a192-0177119403be {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 16:00:20 user nova-compute[75337]: DEBUG nova.virt.libvirt.guest [None req-81fc8da5-6b72-48b1-a80e-5e7cd33bc465 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] attach device xml: <disk type="block" device="disk">
Nov 06 16:00:20 user nova-compute[75337]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 16:00:20 user nova-compute[75337]:   <source dev="/dev/sdf"/>
Nov 06 16:00:20 user nova-compute[75337]:   <target dev="vdb" bus="virtio"/>
Nov 06 16:00:20 user nova-compute[75337]:   <serial>45e66a2b-499f-46ca-90b5-2eeac6a5a8be</serial>
Nov 06 16:00:20 user nova-compute[75337]: </disk>
Nov 06 16:00:20 user nova-compute[75337]:  {{(pid=75337) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 06 16:00:20 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69df3824-b28c-43c0-9f20-52fa956642cc/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:00:20 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 16:00:20 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5248533a-89b6-444e-a60a-154b3cdef815/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:00:20 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5248533a-89b6-444e-a60a-154b3cdef815/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:00:20 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5248533a-89b6-444e-a60a-154b3cdef815/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:00:20 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5248533a-89b6-444e-a60a-154b3cdef815/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:00:20 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 16:00:20 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-81fc8da5-6b72-48b1-a80e-5e7cd33bc465 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] No BDM found with device name vda, not building metadata. {{(pid=75337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 16:00:20 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-81fc8da5-6b72-48b1-a80e-5e7cd33bc465 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 16:00:20 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-81fc8da5-6b72-48b1-a80e-5e7cd33bc465 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] No VIF found with MAC fa:16:3e:d2:44:86, not building metadata {{(pid=75337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 16:00:20 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 16:00:20 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30c634ff-6999-40aa-a90d-1db6d278b571/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:00:21 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30c634ff-6999-40aa-a90d-1db6d278b571/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:00:21 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30c634ff-6999-40aa-a90d-1db6d278b571/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:00:21 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:00:21 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-81fc8da5-6b72-48b1-a80e-5e7cd33bc465 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] Lock "ba7d8a41-5a75-4dca-a192-0177119403be" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 25.867s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:00:21 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30c634ff-6999-40aa-a90d-1db6d278b571/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:00:21 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6110b34a-6fd3-45fc-911d-4e5d3c7f2d78/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:00:21 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6110b34a-6fd3-45fc-911d-4e5d3c7f2d78/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:00:21 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6110b34a-6fd3-45fc-911d-4e5d3c7f2d78/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:00:21 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6110b34a-6fd3-45fc-911d-4e5d3c7f2d78/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:00:21 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f196f2b3-8eac-4d68-af2e-46671c865be1/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:00:21 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f196f2b3-8eac-4d68-af2e-46671c865be1/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:00:21 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f196f2b3-8eac-4d68-af2e-46671c865be1/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:00:21 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f196f2b3-8eac-4d68-af2e-46671c865be1/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:00:21 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 16:00:21 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d479c64-055b-4496-b3a2-ba10f9095ea8/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:00:22 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d479c64-055b-4496-b3a2-ba10f9095ea8/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:00:22 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d479c64-055b-4496-b3a2-ba10f9095ea8/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:00:22 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d479c64-055b-4496-b3a2-ba10f9095ea8/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:00:22 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 16:00:22 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 16:00:22 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Hypervisor/Node resource view: name=user free_ram=7783MB free_disk=25.009845733642578GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75337) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 16:00:22 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:00:22 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:00:22 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 30c634ff-6999-40aa-a90d-1db6d278b571 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 16:00:22 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 6110b34a-6fd3-45fc-911d-4e5d3c7f2d78 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 16:00:22 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 69df3824-b28c-43c0-9f20-52fa956642cc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 16:00:22 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 5248533a-89b6-444e-a60a-154b3cdef815 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 16:00:22 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance f196f2b3-8eac-4d68-af2e-46671c865be1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 16:00:22 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance ba7d8a41-5a75-4dca-a192-0177119403be actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 16:00:22 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 5d479c64-055b-4496-b3a2-ba10f9095ea8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 16:00:22 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance e558736d-848f-4a79-a7aa-1e46638a85dc actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 16:00:22 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 16:00:22 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 16:00:23 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 16:00:23 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 16:00:23 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Compute_service record updated for user:user {{(pid=75337) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 16:00:23 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.378s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:00:24 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:00:25 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:00:25 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-01661569-a52e-46ac-90b7-5721f59e4c59 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] Acquiring lock "ba7d8a41-5a75-4dca-a192-0177119403be" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:00:25 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-01661569-a52e-46ac-90b7-5721f59e4c59 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] Lock "ba7d8a41-5a75-4dca-a192-0177119403be" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:00:25 user nova-compute[75337]: DEBUG nova.objects.instance [None req-01661569-a52e-46ac-90b7-5721f59e4c59 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] Lazy-loading 'flavor' on Instance uuid ba7d8a41-5a75-4dca-a192-0177119403be {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 16:00:25 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-01661569-a52e-46ac-90b7-5721f59e4c59 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] Lock "ba7d8a41-5a75-4dca-a192-0177119403be" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:00:25 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-01661569-a52e-46ac-90b7-5721f59e4c59 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] Acquiring lock "ba7d8a41-5a75-4dca-a192-0177119403be" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:00:25 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-01661569-a52e-46ac-90b7-5721f59e4c59 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] Lock "ba7d8a41-5a75-4dca-a192-0177119403be" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:00:25 user nova-compute[75337]: INFO nova.compute.manager [None req-01661569-a52e-46ac-90b7-5721f59e4c59 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] [instance: ba7d8a41-5a75-4dca-a192-0177119403be] Attaching volume 25450312-4e6c-4048-8a38-8f2bd6191b58 to /dev/vdc
Nov 06 16:00:25 user nova-compute[75337]: DEBUG os_brick.utils [None req-01661569-a52e-46ac-90b7-5721f59e4c59 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 16:00:25 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:00:25 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:00:25 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[70690684-dfba-4043-bbac-1656b7667509]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4ff6411e45b8\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:00:25 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:00:25 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:00:25 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[b360871e-4b76-45f7-86b0-a308de8040b9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:00:25 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:00:25 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:00:25 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bdea7cf-479a-4aee-b43d-d4ae339d76b3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:00:25 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a652c22-008e-4df7-9bc4-7bcbfb8d5f50]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:00:25 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-01661569-a52e-46ac-90b7-5721f59e4c59 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] Running cmd (subprocess): nvme version {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:00:25 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-01661569-a52e-46ac-90b7-5721f59e4c59 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] 'nvme version' failed. Not Retrying. {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 16:00:25 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.nvmeof [None req-01661569-a52e-46ac-90b7-5721f59e4c59 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] nvme not present on system {{(pid=75337) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 16:00:25 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:00:25 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 16:00:25 user nova-compute[75337]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 16:00:25 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[eceaf4d8-d4b4-4d98-ad2b-e452b7720f27]: (4, '') {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:00:25 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.lightos [None req-01661569-a52e-46ac-90b7-5721f59e4c59 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75337) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 16:00:25 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.lightos [None req-01661569-a52e-46ac-90b7-5721f59e4c59 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 16:00:25 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.lightos [None req-01661569-a52e-46ac-90b7-5721f59e4c59 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] LIGHTOS: no hostnqn found. {{(pid=75337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 16:00:25 user nova-compute[75337]: DEBUG os_brick.utils [None req-01661569-a52e-46ac-90b7-5721f59e4c59 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4ff6411e45b8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 16:00:25 user nova-compute[75337]: DEBUG nova.virt.block_device [None req-01661569-a52e-46ac-90b7-5721f59e4c59 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] [instance: ba7d8a41-5a75-4dca-a192-0177119403be] Updating existing volume attachment record: 2955ea6b-bcde-48bc-be59-8cfdadde724c {{(pid=75337) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 16:00:26 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:00:29 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:00:31 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:00:34 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:00:34 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-b8cb6fe8-e9b7-4adc-8465-f3fb8588d2e4 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Acquiring lock "f196f2b3-8eac-4d68-af2e-46671c865be1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:00:34 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-b8cb6fe8-e9b7-4adc-8465-f3fb8588d2e4 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Lock "f196f2b3-8eac-4d68-af2e-46671c865be1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:00:34 user nova-compute[75337]: INFO nova.compute.manager [None req-b8cb6fe8-e9b7-4adc-8465-f3fb8588d2e4 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] [instance: f196f2b3-8eac-4d68-af2e-46671c865be1] Detaching volume 73a377b1-21a8-4273-8632-8daac8cd3a3b
Nov 06 16:00:34 user nova-compute[75337]: INFO nova.virt.block_device [None req-b8cb6fe8-e9b7-4adc-8465-f3fb8588d2e4 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] [instance: f196f2b3-8eac-4d68-af2e-46671c865be1] Attempting to driver detach volume 73a377b1-21a8-4273-8632-8daac8cd3a3b from mountpoint /dev/vdb
Nov 06 16:00:34 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-b8cb6fe8-e9b7-4adc-8465-f3fb8588d2e4 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Attempting to detach device vdb from instance f196f2b3-8eac-4d68-af2e-46671c865be1 from the persistent domain config. {{(pid=75337) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 06 16:00:34 user nova-compute[75337]: DEBUG nova.virt.libvirt.guest [None req-b8cb6fe8-e9b7-4adc-8465-f3fb8588d2e4 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 16:00:34 user nova-compute[75337]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 16:00:34 user nova-compute[75337]:   <source dev="/dev/sdd"/>
Nov 06 16:00:34 user nova-compute[75337]:   <target dev="vdb" bus="virtio"/>
Nov 06 16:00:34 user nova-compute[75337]:   <serial>73a377b1-21a8-4273-8632-8daac8cd3a3b</serial>
Nov 06 16:00:34 user nova-compute[75337]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 06 16:00:34 user nova-compute[75337]: </disk>
Nov 06 16:00:34 user nova-compute[75337]:  {{(pid=75337) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 16:00:34 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-b8cb6fe8-e9b7-4adc-8465-f3fb8588d2e4 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Successfully detached device vdb from instance f196f2b3-8eac-4d68-af2e-46671c865be1 from the persistent domain config.
Nov 06 16:00:34 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-b8cb6fe8-e9b7-4adc-8465-f3fb8588d2e4 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f196f2b3-8eac-4d68-af2e-46671c865be1 from the live domain config. {{(pid=75337) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 06 16:00:34 user nova-compute[75337]: DEBUG nova.virt.libvirt.guest [None req-b8cb6fe8-e9b7-4adc-8465-f3fb8588d2e4 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 16:00:34 user nova-compute[75337]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 16:00:34 user nova-compute[75337]:   <source dev="/dev/sdd"/>
Nov 06 16:00:34 user nova-compute[75337]:   <target dev="vdb" bus="virtio"/>
Nov 06 16:00:34 user nova-compute[75337]:   <serial>73a377b1-21a8-4273-8632-8daac8cd3a3b</serial>
Nov 06 16:00:34 user nova-compute[75337]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 06 16:00:34 user nova-compute[75337]: </disk>
Nov 06 16:00:34 user nova-compute[75337]:  {{(pid=75337) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 16:00:34 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-48183fbb-bec3-48ff-a416-962fa3029f49 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Acquiring lock "f196f2b3-8eac-4d68-af2e-46671c865be1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:00:35 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-b8cb6fe8-e9b7-4adc-8465-f3fb8588d2e4 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f196f2b3-8eac-4d68-af2e-46671c865be1 {{(pid=75337) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 06 16:00:36 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:00:40 user nova-compute[75337]: DEBUG nova.compute.manager [req-a65c3749-3f32-4eb4-8c8a-5d3cf720f78b req-43dcac02-5042-49b6-ac1a-9538f032ef95 service nova] [instance: 5d479c64-055b-4496-b3a2-ba10f9095ea8] Received event network-changed-cf2938cc-3588-4aea-8cb9-e0117e78a628 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:00:40 user nova-compute[75337]: DEBUG nova.compute.manager [req-a65c3749-3f32-4eb4-8c8a-5d3cf720f78b req-43dcac02-5042-49b6-ac1a-9538f032ef95 service nova] [instance: 5d479c64-055b-4496-b3a2-ba10f9095ea8] Refreshing instance network info cache due to event network-changed-cf2938cc-3588-4aea-8cb9-e0117e78a628. {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 16:00:40 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-a65c3749-3f32-4eb4-8c8a-5d3cf720f78b req-43dcac02-5042-49b6-ac1a-9538f032ef95 service nova] Acquiring lock "refresh_cache-5d479c64-055b-4496-b3a2-ba10f9095ea8" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 16:00:40 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-a65c3749-3f32-4eb4-8c8a-5d3cf720f78b req-43dcac02-5042-49b6-ac1a-9538f032ef95 service nova] Acquired lock "refresh_cache-5d479c64-055b-4496-b3a2-ba10f9095ea8" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 16:00:40 user nova-compute[75337]: DEBUG nova.network.neutron [req-a65c3749-3f32-4eb4-8c8a-5d3cf720f78b req-43dcac02-5042-49b6-ac1a-9538f032ef95 service nova] [instance: 5d479c64-055b-4496-b3a2-ba10f9095ea8] Refreshing network info cache for port cf2938cc-3588-4aea-8cb9-e0117e78a628 {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 16:00:40 user nova-compute[75337]: DEBUG nova.network.neutron [req-a65c3749-3f32-4eb4-8c8a-5d3cf720f78b req-43dcac02-5042-49b6-ac1a-9538f032ef95 service nova] [instance: 5d479c64-055b-4496-b3a2-ba10f9095ea8] Updated VIF entry in instance network info cache for port cf2938cc-3588-4aea-8cb9-e0117e78a628. {{(pid=75337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 16:00:40 user nova-compute[75337]: DEBUG nova.network.neutron [req-a65c3749-3f32-4eb4-8c8a-5d3cf720f78b req-43dcac02-5042-49b6-ac1a-9538f032ef95 service nova] [instance: 5d479c64-055b-4496-b3a2-ba10f9095ea8] Updating instance_info_cache with network_info: [{"id": "cf2938cc-3588-4aea-8cb9-e0117e78a628", "address": "fa:16:3e:74:b7:02", "network": {"id": "53be211e-34f3-4a33-b5dc-7b7a0c2fb280", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-504725466-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93b47bd7e8214b4f9d7f930e6f4b5dea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf2938cc-35", "ovs_interfaceid": "cf2938cc-3588-4aea-8cb9-e0117e78a628", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 16:00:40 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-a65c3749-3f32-4eb4-8c8a-5d3cf720f78b req-43dcac02-5042-49b6-ac1a-9538f032ef95 service nova] Releasing lock "refresh_cache-5d479c64-055b-4496-b3a2-ba10f9095ea8" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 16:00:41 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:00:41 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:00:41 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75337) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 16:00:41 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 16:00:41 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 16:00:41 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:00:44 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:00:46 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:00:47 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-49460f3b-05fb-44e0-bb1f-9c713c1f23d2 tempest-TestServerVolumeAttachScenarioOldVersion-419113578 tempest-TestServerVolumeAttachScenarioOldVersion-419113578-project-member] Acquiring lock "5d479c64-055b-4496-b3a2-ba10f9095ea8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:00:47 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-49460f3b-05fb-44e0-bb1f-9c713c1f23d2 tempest-TestServerVolumeAttachScenarioOldVersion-419113578 tempest-TestServerVolumeAttachScenarioOldVersion-419113578-project-member] Lock "5d479c64-055b-4496-b3a2-ba10f9095ea8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:00:47 user nova-compute[75337]: DEBUG nova.objects.instance [None req-49460f3b-05fb-44e0-bb1f-9c713c1f23d2 tempest-TestServerVolumeAttachScenarioOldVersion-419113578 tempest-TestServerVolumeAttachScenarioOldVersion-419113578-project-member] Lazy-loading 'flavor' on Instance uuid 5d479c64-055b-4496-b3a2-ba10f9095ea8 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 16:00:47 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-49460f3b-05fb-44e0-bb1f-9c713c1f23d2 tempest-TestServerVolumeAttachScenarioOldVersion-419113578 tempest-TestServerVolumeAttachScenarioOldVersion-419113578-project-member] Lock "5d479c64-055b-4496-b3a2-ba10f9095ea8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:00:47 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-49460f3b-05fb-44e0-bb1f-9c713c1f23d2 tempest-TestServerVolumeAttachScenarioOldVersion-419113578 tempest-TestServerVolumeAttachScenarioOldVersion-419113578-project-member] Acquiring lock "5d479c64-055b-4496-b3a2-ba10f9095ea8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:00:47 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-49460f3b-05fb-44e0-bb1f-9c713c1f23d2 tempest-TestServerVolumeAttachScenarioOldVersion-419113578 tempest-TestServerVolumeAttachScenarioOldVersion-419113578-project-member] Lock "5d479c64-055b-4496-b3a2-ba10f9095ea8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:00:47 user nova-compute[75337]: INFO nova.compute.manager [None req-49460f3b-05fb-44e0-bb1f-9c713c1f23d2 tempest-TestServerVolumeAttachScenarioOldVersion-419113578 tempest-TestServerVolumeAttachScenarioOldVersion-419113578-project-member] [instance: 5d479c64-055b-4496-b3a2-ba10f9095ea8] Attaching volume bf78953a-1bbf-43d5-9bd5-b026150d4f50 to /dev/vdb
Nov 06 16:00:47 user nova-compute[75337]: DEBUG os_brick.utils [None req-49460f3b-05fb-44e0-bb1f-9c713c1f23d2 tempest-TestServerVolumeAttachScenarioOldVersion-419113578 tempest-TestServerVolumeAttachScenarioOldVersion-419113578-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 16:00:47 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:00:47 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:00:47 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[19a04abc-047e-475c-ace1-d3f787028f22]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4ff6411e45b8\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:00:47 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:00:47 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:00:47 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[b403c767-edde-44d8-ab11-5d791dfb09ff]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:00:47 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:00:47 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:00:47 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[55a22d0c-60b8-4830-a505-322455a32f9b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:00:47 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[623f589b-ff24-4a0f-ad0c-adc31396b147]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:00:47 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-49460f3b-05fb-44e0-bb1f-9c713c1f23d2 tempest-TestServerVolumeAttachScenarioOldVersion-419113578 tempest-TestServerVolumeAttachScenarioOldVersion-419113578-project-member] Running cmd (subprocess): nvme version {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:00:47 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-49460f3b-05fb-44e0-bb1f-9c713c1f23d2 tempest-TestServerVolumeAttachScenarioOldVersion-419113578 tempest-TestServerVolumeAttachScenarioOldVersion-419113578-project-member] 'nvme version' failed. Not Retrying. {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 16:00:47 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.nvmeof [None req-49460f3b-05fb-44e0-bb1f-9c713c1f23d2 tempest-TestServerVolumeAttachScenarioOldVersion-419113578 tempest-TestServerVolumeAttachScenarioOldVersion-419113578-project-member] nvme not present on system {{(pid=75337) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 16:00:47 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:00:47 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 16:00:47 user nova-compute[75337]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 16:00:47 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[86abd58e-7b20-4c96-a942-ee10a61d261b]: (4, '') {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:00:47 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.lightos [None req-49460f3b-05fb-44e0-bb1f-9c713c1f23d2 tempest-TestServerVolumeAttachScenarioOldVersion-419113578 tempest-TestServerVolumeAttachScenarioOldVersion-419113578-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75337) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 16:00:47 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.lightos [None req-49460f3b-05fb-44e0-bb1f-9c713c1f23d2 tempest-TestServerVolumeAttachScenarioOldVersion-419113578 tempest-TestServerVolumeAttachScenarioOldVersion-419113578-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 16:00:47 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.lightos [None req-49460f3b-05fb-44e0-bb1f-9c713c1f23d2 tempest-TestServerVolumeAttachScenarioOldVersion-419113578 tempest-TestServerVolumeAttachScenarioOldVersion-419113578-project-member] LIGHTOS: no hostnqn found. {{(pid=75337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 16:00:47 user nova-compute[75337]: DEBUG os_brick.utils [None req-49460f3b-05fb-44e0-bb1f-9c713c1f23d2 tempest-TestServerVolumeAttachScenarioOldVersion-419113578 tempest-TestServerVolumeAttachScenarioOldVersion-419113578-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4ff6411e45b8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 16:00:47 user nova-compute[75337]: DEBUG nova.virt.block_device [None req-49460f3b-05fb-44e0-bb1f-9c713c1f23d2 tempest-TestServerVolumeAttachScenarioOldVersion-419113578 tempest-TestServerVolumeAttachScenarioOldVersion-419113578-project-member] [instance: 5d479c64-055b-4496-b3a2-ba10f9095ea8] Updating existing volume attachment record: 4d9ac0c7-bc71-49d8-8584-dd3624b180ca {{(pid=75337) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 16:00:48 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01661569-a52e-46ac-90b7-5721f59e4c59 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] [instance: ba7d8a41-5a75-4dca-a192-0177119403be] Calling os-brick to attach iSCSI Volume {{(pid=75337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 16:00:48 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-01661569-a52e-46ac-90b7-5721f59e4c59 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2abc33d0c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:25450312-4e6c-4048-8a38-8f2bd6191b58', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IUgMmDNH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 16:00:48 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-01661569-a52e-46ac-90b7-5721f59e4c59 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 16:00:48 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-01661569-a52e-46ac-90b7-5721f59e4c59 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 16:00:48 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-01661569-a52e-46ac-90b7-5721f59e4c59 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 16:00:48 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-01661569-a52e-46ac-90b7-5721f59e4c59 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 16:00:48 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-01661569-a52e-46ac-90b7-5721f59e4c59 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:25450312-4e6c-4048-8a38-8f2bd6191b58" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 16:00:48 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-01661569-a52e-46ac-90b7-5721f59e4c59 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:25450312-4e6c-4048-8a38-8f2bd6191b58" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 16:00:48 user nova-compute[75337]: INFO os_brick.initiator.connectors.iscsi [None req-01661569-a52e-46ac-90b7-5721f59e4c59 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 16:00:48 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25450312-4e6c-4048-8a38-8f2bd6191b58 -p 172.16.0.220:3260 {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:00:48 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25450312-4e6c-4048-8a38-8f2bd6191b58 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:00:48 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0abfd79-c94d-4231-8bc8-139cde2df023]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:00:48 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-01661569-a52e-46ac-90b7-5721f59e4c59 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 16:00:48 user nova-compute[75337]:  {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:00:48 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25450312-4e6c-4048-8a38-8f2bd6191b58 -p 172.16.0.220:3260 --interface default --op new {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:00:48 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25450312-4e6c-4048-8a38-8f2bd6191b58 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:00:48 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d4c0a6a-0dda-4fa3-b610-847a95e34a5c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:25450312-4e6c-4048-8a38-8f2bd6191b58] added\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:00:48 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-01661569-a52e-46ac-90b7-5721f59e4c59 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:25450312-4e6c-4048-8a38-8f2bd6191b58] added
Nov 06 16:00:48 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:00:48 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25450312-4e6c-4048-8a38-8f2bd6191b58 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:00:48 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25450312-4e6c-4048-8a38-8f2bd6191b58 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:00:48 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f7f8de9-8ee1-407a-800b-91fae0f4dbd2]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:00:48 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-01661569-a52e-46ac-90b7-5721f59e4c59 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:00:48 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25450312-4e6c-4048-8a38-8f2bd6191b58 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:00:48 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25450312-4e6c-4048-8a38-8f2bd6191b58 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:00:48 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[bef7275a-ae21-4614-ad82-bc3f4901485e]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:00:48 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-01661569-a52e-46ac-90b7-5721f59e4c59 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:00:48 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25450312-4e6c-4048-8a38-8f2bd6191b58 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IUgMmDNH {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:00:48 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25450312-4e6c-4048-8a38-8f2bd6191b58 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IUgMmDNH" returned: 0 in 0.018s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:00:48 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7c70a95-b804-4114-b8a2-89d835d05d03]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:00:48 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-01661569-a52e-46ac-90b7-5721f59e4c59 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IUgMmDNH'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:00:48 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25450312-4e6c-4048-8a38-8f2bd6191b58 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:00:48 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25450312-4e6c-4048-8a38-8f2bd6191b58 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.032s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:00:48 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e92813e-37be-408c-add5-d65bfda1fff8]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:00:48 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-01661569-a52e-46ac-90b7-5721f59e4c59 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:00:48 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:00:48 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:00:48 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[82bfb8d2-f135-4813-99d6-e42514fb4b95]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73a377b1-21a8-4273-8632-8daac8cd3a3b (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45e66a2b-499f-46ca-90b5-2eeac6a5a8be (non-flash)\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:00:48 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-01661569-a52e-46ac-90b7-5721f59e4c59 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8 (non-flash)
Nov 06 16:00:48 user nova-compute[75337]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da (non-flash)
Nov 06 16:00:48 user nova-compute[75337]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73a377b1-21a8-4273-8632-8daac8cd3a3b (non-flash)
Nov 06 16:00:48 user nova-compute[75337]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673 (non-flash)
Nov 06 16:00:48 user nova-compute[75337]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45e66a2b-499f-46ca-90b5-2eeac6a5a8be (non-flash)
Nov 06 16:00:48 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 16:00:48 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-01661569-a52e-46ac-90b7-5721f59e4c59 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8 (non-flash)
Nov 06 16:00:48 user nova-compute[75337]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da (non-flash)
Nov 06 16:00:48 user nova-compute[75337]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73a377b1-21a8-4273-8632-8daac8cd3a3b (non-flash)
Nov 06 16:00:48 user nova-compute[75337]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673 (non-flash)
Nov 06 16:00:48 user nova-compute[75337]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45e66a2b-499f-46ca-90b5-2eeac6a5a8be (non-flash)
Nov 06 16:00:48 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 16:00:48 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25450312-4e6c-4048-8a38-8f2bd6191b58 -p 172.16.0.220:3260 --login {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:00:48 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25450312-4e6c-4048-8a38-8f2bd6191b58 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:00:48 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[b254619d-ec7e-4136-b1f9-daa185c377fe]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:25450312-4e6c-4048-8a38-8f2bd6191b58, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:25450312-4e6c-4048-8a38-8f2bd6191b58, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:00:48 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-01661569-a52e-46ac-90b7-5721f59e4c59 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:25450312-4e6c-4048-8a38-8f2bd6191b58, portal: 172.16.0.220,3260]
Nov 06 16:00:48 user nova-compute[75337]: Login to [iface: default, target: iqn.2010-10.org.openstack:25450312-4e6c-4048-8a38-8f2bd6191b58, portal: 172.16.0.220,3260] successful.
Nov 06 16:00:48 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:00:48 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25450312-4e6c-4048-8a38-8f2bd6191b58 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:00:48 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25450312-4e6c-4048-8a38-8f2bd6191b58 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:00:48 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[f224edad-5ff2-40c8-938b-1af168a6bc46]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:00:48 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-01661569-a52e-46ac-90b7-5721f59e4c59 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:00:48 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:00:48 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:00:48 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[c875639c-1d83-4aee-a0dd-ac3b06410db6]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73a377b1-21a8-4273-8632-8daac8cd3a3b (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45e66a2b-499f-46ca-90b5-2eeac6a5a8be (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25450312-4e6c-4048-8a38-8f2bd6191b58 (non-flash)\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:00:48 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-01661569-a52e-46ac-90b7-5721f59e4c59 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8 (non-flash)
Nov 06 16:00:48 user nova-compute[75337]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da (non-flash)
Nov 06 16:00:48 user nova-compute[75337]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73a377b1-21a8-4273-8632-8daac8cd3a3b (non-flash)
Nov 06 16:00:48 user nova-compute[75337]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673 (non-flash)
Nov 06 16:00:48 user nova-compute[75337]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45e66a2b-499f-46ca-90b5-2eeac6a5a8be (non-flash)
Nov 06 16:00:48 user nova-compute[75337]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25450312-4e6c-4048-8a38-8f2bd6191b58 (non-flash)
Nov 06 16:00:48 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 16:00:48 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-01661569-a52e-46ac-90b7-5721f59e4c59 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8 (non-flash)
Nov 06 16:00:48 user nova-compute[75337]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da (non-flash)
Nov 06 16:00:48 user nova-compute[75337]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73a377b1-21a8-4273-8632-8daac8cd3a3b (non-flash)
Nov 06 16:00:48 user nova-compute[75337]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673 (non-flash)
Nov 06 16:00:48 user nova-compute[75337]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45e66a2b-499f-46ca-90b5-2eeac6a5a8be (non-flash)
Nov 06 16:00:48 user nova-compute[75337]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25450312-4e6c-4048-8a38-8f2bd6191b58 (non-flash)
Nov 06 16:00:48 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 16:00:48 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-01661569-a52e-46ac-90b7-5721f59e4c59 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:25450312-4e6c-4048-8a38-8f2bd6191b58" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.336s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 16:00:48 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-01661569-a52e-46ac-90b7-5721f59e4c59 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] Connected to 172.16.0.220:3260 {{(pid=75337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 16:00:48 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-01661569-a52e-46ac-90b7-5721f59e4c59 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] HCTL ('38', '-', '-', 0) found on session 43 with lun 0 {{(pid=75337) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 16:00:48 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-01661569-a52e-46ac-90b7-5721f59e4c59 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75337) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 16:00:48 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:00:49 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.018s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:00:49 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a191a8e-e250-420e-8558-050c4c160805]: (4, ('- - 0', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:00:49 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-01661569-a52e-46ac-90b7-5721f59e4c59 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] Searching for a device in session 43 and hctl ['38', '*', '*', 0] yield: None {{(pid=75337) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 16:00:49 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:00:50 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-01661569-a52e-46ac-90b7-5721f59e4c59 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] Searching for a device in session 43 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75337) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 16:00:50 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-01661569-a52e-46ac-90b7-5721f59e4c59 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:25450312-4e6c-4048-8a38-8f2bd6191b58', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IUgMmDNH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 16:00:50 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-01661569-a52e-46ac-90b7-5721f59e4c59 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.368s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 16:00:50 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-01661569-a52e-46ac-90b7-5721f59e4c59 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] <== connect_volume: return (1369ms) {'type': 'block', 'scsi_wwn': '26461326434386262', 'path': '/dev/sdg'} {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 16:00:50 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01661569-a52e-46ac-90b7-5721f59e4c59 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] [instance: ba7d8a41-5a75-4dca-a192-0177119403be] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26461326434386262', 'path': '/dev/sdg'} {{(pid=75337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 16:00:50 user nova-compute[75337]: DEBUG nova.objects.instance [None req-01661569-a52e-46ac-90b7-5721f59e4c59 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] Lazy-loading 'flavor' on Instance uuid ba7d8a41-5a75-4dca-a192-0177119403be {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 16:00:50 user nova-compute[75337]: DEBUG nova.virt.libvirt.guest [None req-01661569-a52e-46ac-90b7-5721f59e4c59 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] attach device xml: <disk type="block" device="disk">
Nov 06 16:00:50 user nova-compute[75337]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 16:00:50 user nova-compute[75337]:   <source dev="/dev/sdg"/>
Nov 06 16:00:50 user nova-compute[75337]:   <target dev="vdc" bus="virtio"/>
Nov 06 16:00:50 user nova-compute[75337]:   <serial>25450312-4e6c-4048-8a38-8f2bd6191b58</serial>
Nov 06 16:00:50 user nova-compute[75337]: </disk>
Nov 06 16:00:50 user nova-compute[75337]:  {{(pid=75337) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 06 16:00:50 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-01661569-a52e-46ac-90b7-5721f59e4c59 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] No BDM found with device name vda, not building metadata. {{(pid=75337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 16:00:50 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-01661569-a52e-46ac-90b7-5721f59e4c59 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 16:00:50 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-01661569-a52e-46ac-90b7-5721f59e4c59 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 16:00:50 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-01661569-a52e-46ac-90b7-5721f59e4c59 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] No VIF found with MAC fa:16:3e:d2:44:86, not building metadata {{(pid=75337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 16:00:50 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-01661569-a52e-46ac-90b7-5721f59e4c59 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] Lock "ba7d8a41-5a75-4dca-a192-0177119403be" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 25.027s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:00:51 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:00:51 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-575c2ebe-decd-457a-82fd-7c9afe13a8db tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] Acquiring lock "ba7d8a41-5a75-4dca-a192-0177119403be" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:00:51 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-575c2ebe-decd-457a-82fd-7c9afe13a8db tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] Lock "ba7d8a41-5a75-4dca-a192-0177119403be" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:00:51 user nova-compute[75337]: INFO nova.compute.manager [None req-575c2ebe-decd-457a-82fd-7c9afe13a8db tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] [instance: ba7d8a41-5a75-4dca-a192-0177119403be] Detaching volume 25450312-4e6c-4048-8a38-8f2bd6191b58
Nov 06 16:00:51 user nova-compute[75337]: INFO nova.virt.block_device [None req-575c2ebe-decd-457a-82fd-7c9afe13a8db tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] [instance: ba7d8a41-5a75-4dca-a192-0177119403be] Attempting to driver detach volume 25450312-4e6c-4048-8a38-8f2bd6191b58 from mountpoint /dev/vdc
Nov 06 16:00:51 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-575c2ebe-decd-457a-82fd-7c9afe13a8db tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] Attempting to detach device vdc from instance ba7d8a41-5a75-4dca-a192-0177119403be from the persistent domain config. {{(pid=75337) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 06 16:00:51 user nova-compute[75337]: DEBUG nova.virt.libvirt.guest [None req-575c2ebe-decd-457a-82fd-7c9afe13a8db tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 16:00:51 user nova-compute[75337]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 16:00:51 user nova-compute[75337]:   <source dev="/dev/sdg"/>
Nov 06 16:00:51 user nova-compute[75337]:   <target dev="vdc" bus="virtio"/>
Nov 06 16:00:51 user nova-compute[75337]:   <serial>25450312-4e6c-4048-8a38-8f2bd6191b58</serial>
Nov 06 16:00:51 user nova-compute[75337]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 06 16:00:51 user nova-compute[75337]: </disk>
Nov 06 16:00:51 user nova-compute[75337]:  {{(pid=75337) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 16:00:51 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-575c2ebe-decd-457a-82fd-7c9afe13a8db tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] Successfully detached device vdc from instance ba7d8a41-5a75-4dca-a192-0177119403be from the persistent domain config.
Nov 06 16:00:51 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-575c2ebe-decd-457a-82fd-7c9afe13a8db tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance ba7d8a41-5a75-4dca-a192-0177119403be from the live domain config. {{(pid=75337) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 06 16:00:51 user nova-compute[75337]: DEBUG nova.virt.libvirt.guest [None req-575c2ebe-decd-457a-82fd-7c9afe13a8db tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 16:00:51 user nova-compute[75337]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 16:00:51 user nova-compute[75337]:   <source dev="/dev/sdg"/>
Nov 06 16:00:51 user nova-compute[75337]:   <target dev="vdc" bus="virtio"/>
Nov 06 16:00:51 user nova-compute[75337]:   <serial>25450312-4e6c-4048-8a38-8f2bd6191b58</serial>
Nov 06 16:00:51 user nova-compute[75337]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 06 16:00:51 user nova-compute[75337]: </disk>
Nov 06 16:00:51 user nova-compute[75337]:  {{(pid=75337) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 16:00:52 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-575c2ebe-decd-457a-82fd-7c9afe13a8db tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance ba7d8a41-5a75-4dca-a192-0177119403be {{(pid=75337) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 06 16:00:53 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-d547941c-b48d-4c54-b144-91ff588107c1 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Acquiring lock "69df3824-b28c-43c0-9f20-52fa956642cc" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:00:53 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-d547941c-b48d-4c54-b144-91ff588107c1 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Lock "69df3824-b28c-43c0-9f20-52fa956642cc" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:00:53 user nova-compute[75337]: INFO nova.compute.manager [None req-d547941c-b48d-4c54-b144-91ff588107c1 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] [instance: 69df3824-b28c-43c0-9f20-52fa956642cc] Detaching volume 27fe0158-ccd9-4398-ad6f-5622476733da
Nov 06 16:00:53 user nova-compute[75337]: INFO nova.virt.block_device [None req-d547941c-b48d-4c54-b144-91ff588107c1 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] [instance: 69df3824-b28c-43c0-9f20-52fa956642cc] Attempting to driver detach volume 27fe0158-ccd9-4398-ad6f-5622476733da from mountpoint /dev/vdb
Nov 06 16:00:53 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-d547941c-b48d-4c54-b144-91ff588107c1 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Attempting to detach device vdb from instance 69df3824-b28c-43c0-9f20-52fa956642cc from the persistent domain config. {{(pid=75337) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 06 16:00:53 user nova-compute[75337]: DEBUG nova.virt.libvirt.guest [None req-d547941c-b48d-4c54-b144-91ff588107c1 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 16:00:53 user nova-compute[75337]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 16:00:53 user nova-compute[75337]:   <source dev="/dev/sdc"/>
Nov 06 16:00:53 user nova-compute[75337]:   <target dev="vdb" bus="virtio"/>
Nov 06 16:00:53 user nova-compute[75337]:   <serial>27fe0158-ccd9-4398-ad6f-5622476733da</serial>
Nov 06 16:00:53 user nova-compute[75337]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 06 16:00:53 user nova-compute[75337]: </disk>
Nov 06 16:00:53 user nova-compute[75337]:  {{(pid=75337) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 16:00:53 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-d547941c-b48d-4c54-b144-91ff588107c1 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Successfully detached device vdb from instance 69df3824-b28c-43c0-9f20-52fa956642cc from the persistent domain config.
Nov 06 16:00:53 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-d547941c-b48d-4c54-b144-91ff588107c1 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 69df3824-b28c-43c0-9f20-52fa956642cc from the live domain config. {{(pid=75337) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 06 16:00:53 user nova-compute[75337]: DEBUG nova.virt.libvirt.guest [None req-d547941c-b48d-4c54-b144-91ff588107c1 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 16:00:53 user nova-compute[75337]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 16:00:53 user nova-compute[75337]:   <source dev="/dev/sdc"/>
Nov 06 16:00:53 user nova-compute[75337]:   <target dev="vdb" bus="virtio"/>
Nov 06 16:00:53 user nova-compute[75337]:   <serial>27fe0158-ccd9-4398-ad6f-5622476733da</serial>
Nov 06 16:00:53 user nova-compute[75337]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 06 16:00:53 user nova-compute[75337]: </disk>
Nov 06 16:00:53 user nova-compute[75337]:  {{(pid=75337) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 16:00:53 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-d547941c-b48d-4c54-b144-91ff588107c1 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 69df3824-b28c-43c0-9f20-52fa956642cc {{(pid=75337) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 06 16:00:54 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:00:54 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-231df4e4-b4f6-4e0f-8346-f8489a7329f9 tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Acquiring lock "5248533a-89b6-444e-a60a-154b3cdef815" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:00:54 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-231df4e4-b4f6-4e0f-8346-f8489a7329f9 tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Lock "5248533a-89b6-444e-a60a-154b3cdef815" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:00:54 user nova-compute[75337]: INFO nova.compute.manager [None req-231df4e4-b4f6-4e0f-8346-f8489a7329f9 tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: 5248533a-89b6-444e-a60a-154b3cdef815] Detaching volume b702cb69-9f60-445c-a874-5abf6142bbb8
Nov 06 16:00:54 user nova-compute[75337]: INFO nova.virt.block_device [None req-231df4e4-b4f6-4e0f-8346-f8489a7329f9 tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: 5248533a-89b6-444e-a60a-154b3cdef815] Attempting to driver detach volume b702cb69-9f60-445c-a874-5abf6142bbb8 from mountpoint /dev/vdb
Nov 06 16:00:54 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-231df4e4-b4f6-4e0f-8346-f8489a7329f9 tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Attempting to detach device vdb from instance 5248533a-89b6-444e-a60a-154b3cdef815 from the persistent domain config. {{(pid=75337) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 06 16:00:54 user nova-compute[75337]: DEBUG nova.virt.libvirt.guest [None req-231df4e4-b4f6-4e0f-8346-f8489a7329f9 tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 16:00:54 user nova-compute[75337]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 16:00:54 user nova-compute[75337]:   <source dev="/dev/sde"/>
Nov 06 16:00:54 user nova-compute[75337]:   <target dev="vdb" bus="virtio"/>
Nov 06 16:00:54 user nova-compute[75337]:   <serial>b702cb69-9f60-445c-a874-5abf6142bbb8</serial>
Nov 06 16:00:54 user nova-compute[75337]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 06 16:00:54 user nova-compute[75337]: </disk>
Nov 06 16:00:54 user nova-compute[75337]:  {{(pid=75337) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 16:00:54 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-231df4e4-b4f6-4e0f-8346-f8489a7329f9 tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Successfully detached device vdb from instance 5248533a-89b6-444e-a60a-154b3cdef815 from the persistent domain config.
Nov 06 16:00:54 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-231df4e4-b4f6-4e0f-8346-f8489a7329f9 tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5248533a-89b6-444e-a60a-154b3cdef815 from the live domain config. {{(pid=75337) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 06 16:00:54 user nova-compute[75337]: DEBUG nova.virt.libvirt.guest [None req-231df4e4-b4f6-4e0f-8346-f8489a7329f9 tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 16:00:54 user nova-compute[75337]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 16:00:54 user nova-compute[75337]:   <source dev="/dev/sde"/>
Nov 06 16:00:54 user nova-compute[75337]:   <target dev="vdb" bus="virtio"/>
Nov 06 16:00:54 user nova-compute[75337]:   <serial>b702cb69-9f60-445c-a874-5abf6142bbb8</serial>
Nov 06 16:00:54 user nova-compute[75337]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 06 16:00:54 user nova-compute[75337]: </disk>
Nov 06 16:00:54 user nova-compute[75337]:  {{(pid=75337) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 16:00:55 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-231df4e4-b4f6-4e0f-8346-f8489a7329f9 tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5248533a-89b6-444e-a60a-154b3cdef815 {{(pid=75337) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 06 16:00:55 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-b8cb6fe8-e9b7-4adc-8465-f3fb8588d2e4 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f196f2b3-8eac-4d68-af2e-46671c865be1 is timed out.
Nov 06 16:00:55 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-b8cb6fe8-e9b7-4adc-8465-f3fb8588d2e4 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Successfully detached device vdb from instance f196f2b3-8eac-4d68-af2e-46671c865be1 from the live domain config.
Nov 06 16:00:55 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b8cb6fe8-e9b7-4adc-8465-f3fb8588d2e4 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] [instance: f196f2b3-8eac-4d68-af2e-46671c865be1] calling os-brick to detach iSCSI Volume {{(pid=75337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 16:00:55 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8cb6fe8-e9b7-4adc-8465-f3fb8588d2e4 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2abc33d0c0>, {'target_iqn': 'iqn.2010-10.org.openstack:73a377b1-21a8-4273-8632-8daac8cd3a3b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OazgGChF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 16:00:55 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-b8cb6fe8-e9b7-4adc-8465-f3fb8588d2e4 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 16:00:55 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-b8cb6fe8-e9b7-4adc-8465-f3fb8588d2e4 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 16:00:55 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-b8cb6fe8-e9b7-4adc-8465-f3fb8588d2e4 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 16:00:55 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:00:55 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:00:55 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[3984e614-3c93-459d-9db2-241a1e4c3390]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:45e66a2b-499f-46ca-90b5-2eeac6a5a8be\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:25450312-4e6c-4048-8a38-8f2bd6191b58\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:73a377b1-21a8-4273-8632-8daac8cd3a3b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:00:55 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8cb6fe8-e9b7-4adc-8465-f3fb8588d2e4 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 16:00:55 user nova-compute[75337]: No targets found.
Nov 06 16:00:55 user nova-compute[75337]: iSNS:
Nov 06 16:00:55 user nova-compute[75337]: No targets found.
Nov 06 16:00:55 user nova-compute[75337]: STATIC:
Nov 06 16:00:55 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:45e66a2b-499f-46ca-90b5-2eeac6a5a8be
Nov 06 16:00:55 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 16:00:55 user nova-compute[75337]:                 Iface Name: default
Nov 06 16:00:55 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da
Nov 06 16:00:55 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 16:00:55 user nova-compute[75337]:                 Iface Name: default
Nov 06 16:00:55 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8
Nov 06 16:00:55 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 16:00:55 user nova-compute[75337]:                 Iface Name: default
Nov 06 16:00:55 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673
Nov 06 16:00:55 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 16:00:55 user nova-compute[75337]:                 Iface Name: default
Nov 06 16:00:55 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:25450312-4e6c-4048-8a38-8f2bd6191b58
Nov 06 16:00:55 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 16:00:55 user nova-compute[75337]:                 Iface Name: default
Nov 06 16:00:55 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:73a377b1-21a8-4273-8632-8daac8cd3a3b
Nov 06 16:00:55 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 16:00:55 user nova-compute[75337]:                 Iface Name: default
Nov 06 16:00:55 user nova-compute[75337]: FIRMWARE:
Nov 06 16:00:55 user nova-compute[75337]: No targets found.
Nov 06 16:00:55 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 16:00:55 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8cb6fe8-e9b7-4adc-8465-f3fb8588d2e4 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 16:00:55 user nova-compute[75337]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 16:00:55 user nova-compute[75337]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75337) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 16:00:55 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8cb6fe8-e9b7-4adc-8465-f3fb8588d2e4 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:73a377b1-21a8-4273-8632-8daac8cd3a3b', 0)] {{(pid=75337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 16:00:55 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:00:55 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:00:55 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4854cb4-73b0-40b2-a4fe-f0463353bce6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:25450312-4e6c-4048-8a38-8f2bd6191b58\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45e66a2b-499f-46ca-90b5-2eeac6a5a8be\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:73a377b1-21a8-4273-8632-8daac8cd3a3b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:00:55 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:00:55 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:00:55 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[17f2b19d-6300-4255-9453-4d7c744f9a01]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73a377b1-21a8-4273-8632-8daac8cd3a3b (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45e66a2b-499f-46ca-90b5-2eeac6a5a8be (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25450312-4e6c-4048-8a38-8f2bd6191b58 (non-flash)\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:00:55 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8cb6fe8-e9b7-4adc-8465-f3fb8588d2e4 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8 (non-flash)
Nov 06 16:00:55 user nova-compute[75337]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da (non-flash)
Nov 06 16:00:55 user nova-compute[75337]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73a377b1-21a8-4273-8632-8daac8cd3a3b (non-flash)
Nov 06 16:00:55 user nova-compute[75337]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673 (non-flash)
Nov 06 16:00:55 user nova-compute[75337]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45e66a2b-499f-46ca-90b5-2eeac6a5a8be (non-flash)
Nov 06 16:00:55 user nova-compute[75337]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25450312-4e6c-4048-8a38-8f2bd6191b58 (non-flash)
Nov 06 16:00:55 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 16:00:55 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8cb6fe8-e9b7-4adc-8465-f3fb8588d2e4 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8 (non-flash)
Nov 06 16:00:55 user nova-compute[75337]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da (non-flash)
Nov 06 16:00:55 user nova-compute[75337]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73a377b1-21a8-4273-8632-8daac8cd3a3b (non-flash)
Nov 06 16:00:55 user nova-compute[75337]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673 (non-flash)
Nov 06 16:00:55 user nova-compute[75337]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45e66a2b-499f-46ca-90b5-2eeac6a5a8be (non-flash)
Nov 06 16:00:55 user nova-compute[75337]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25450312-4e6c-4048-8a38-8f2bd6191b58 (non-flash)
Nov 06 16:00:55 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 16:00:55 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8cb6fe8-e9b7-4adc-8465-f3fb8588d2e4 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2acd6d7f40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:73a377b1-21a8-4273-8632-8daac8cd3a3b'): ({'sdd'}, set())}) {{(pid=75337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 16:00:55 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-b8cb6fe8-e9b7-4adc-8465-f3fb8588d2e4 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Removing single pathed devices sdd {{(pid=75337) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 16:00:55 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:00:55 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:00:55 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3cf7a0a-bf90-458a-b5dc-791464adb15b]: (4, ('path checker states:\nup                  5\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:00:55 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:00:55 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:00:55 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[87cab06b-b9d2-4dbd-ac82-ba3243ba8014]: (4, ('ok\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:00:55 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-b8cb6fe8-e9b7-4adc-8465-f3fb8588d2e4 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Flushing IO for device /dev/sdd {{(pid=75337) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 16:00:55 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:00:55 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:00:55 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[c11661e3-062b-4849-9bf1-047369b876b5]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:00:55 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-b8cb6fe8-e9b7-4adc-8465-f3fb8588d2e4 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75337) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 16:00:55 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:00:55 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.034s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:00:55 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[daf480eb-403f-437b-a9f7-15842e96f62a]: (4, ('1', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:00:55 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-b8cb6fe8-e9b7-4adc-8465-f3fb8588d2e4 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 16:00:55 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-b8cb6fe8-e9b7-4adc-8465-f3fb8588d2e4 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] SCSI volumes sdd have been removed. {{(pid=75337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 16:00:55 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8cb6fe8-e9b7-4adc-8465-f3fb8588d2e4 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:73a377b1-21a8-4273-8632-8daac8cd3a3b')] {{(pid=75337) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 16:00:55 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73a377b1-21a8-4273-8632-8daac8cd3a3b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:00:55 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73a377b1-21a8-4273-8632-8daac8cd3a3b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:00:55 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[d51ac377-4a6a-4d67-8599-64f05a6956f5]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:00:55 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8cb6fe8-e9b7-4adc-8465-f3fb8588d2e4 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:00:55 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73a377b1-21a8-4273-8632-8daac8cd3a3b -p 172.16.0.220:3260 --logout {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:00:55 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73a377b1-21a8-4273-8632-8daac8cd3a3b -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:00:55 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[413fe0f6-093b-4014-8da8-09203d26f9d5]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:73a377b1-21a8-4273-8632-8daac8cd3a3b, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:73a377b1-21a8-4273-8632-8daac8cd3a3b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:00:55 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8cb6fe8-e9b7-4adc-8465-f3fb8588d2e4 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:73a377b1-21a8-4273-8632-8daac8cd3a3b, portal: 172.16.0.220,3260]
Nov 06 16:00:55 user nova-compute[75337]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:73a377b1-21a8-4273-8632-8daac8cd3a3b, portal: 172.16.0.220,3260] successful.
Nov 06 16:00:55 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:00:55 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73a377b1-21a8-4273-8632-8daac8cd3a3b -p 172.16.0.220:3260 --op delete {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:00:55 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73a377b1-21a8-4273-8632-8daac8cd3a3b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:00:55 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b7587cb-a887-44be-80c2-de1306554ff1]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:00:55 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8cb6fe8-e9b7-4adc-8465-f3fb8588d2e4 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:00:55 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-b8cb6fe8-e9b7-4adc-8465-f3fb8588d2e4 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.329s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 16:00:55 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8cb6fe8-e9b7-4adc-8465-f3fb8588d2e4 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] <== disconnect_volume: return (331ms) None {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 16:00:55 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b8cb6fe8-e9b7-4adc-8465-f3fb8588d2e4 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] [instance: f196f2b3-8eac-4d68-af2e-46671c865be1] Disconnected iSCSI Volume {{(pid=75337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 16:00:56 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:00:56 user nova-compute[75337]: DEBUG nova.objects.instance [None req-b8cb6fe8-e9b7-4adc-8465-f3fb8588d2e4 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Lazy-loading 'flavor' on Instance uuid f196f2b3-8eac-4d68-af2e-46671c865be1 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 16:00:56 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-b8cb6fe8-e9b7-4adc-8465-f3fb8588d2e4 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Lock "f196f2b3-8eac-4d68-af2e-46671c865be1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.075s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:00:56 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-48183fbb-bec3-48ff-a416-962fa3029f49 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Lock "f196f2b3-8eac-4d68-af2e-46671c865be1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.952s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:00:56 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-48183fbb-bec3-48ff-a416-962fa3029f49 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Acquiring lock "f196f2b3-8eac-4d68-af2e-46671c865be1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:00:56 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-48183fbb-bec3-48ff-a416-962fa3029f49 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Lock "f196f2b3-8eac-4d68-af2e-46671c865be1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:00:56 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-48183fbb-bec3-48ff-a416-962fa3029f49 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Lock "f196f2b3-8eac-4d68-af2e-46671c865be1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:00:56 user nova-compute[75337]: INFO nova.compute.manager [None req-48183fbb-bec3-48ff-a416-962fa3029f49 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] [instance: f196f2b3-8eac-4d68-af2e-46671c865be1] Terminating instance
Nov 06 16:00:56 user nova-compute[75337]: DEBUG nova.compute.manager [None req-48183fbb-bec3-48ff-a416-962fa3029f49 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] [instance: f196f2b3-8eac-4d68-af2e-46671c865be1] Start destroying the instance on the hypervisor. {{(pid=75337) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 16:00:57 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:00:57 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:00:57 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:00:57 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:00:57 user nova-compute[75337]: ERROR nova.volume.cinder [None req-49460f3b-05fb-44e0-bb1f-9c713c1f23d2 tempest-TestServerVolumeAttachScenarioOldVersion-419113578 tempest-TestServerVolumeAttachScenarioOldVersion-419113578-project-member] Update attachment failed for attachment 4d9ac0c7-bc71-49d8-8584-dd3624b180ca. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-d42bf869-1300-4cf7-a347-d0ffdd6f0de0) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-d42bf869-1300-4cf7-a347-d0ffdd6f0de0)
Nov 06 16:00:57 user nova-compute[75337]: ERROR nova.compute.manager [None req-49460f3b-05fb-44e0-bb1f-9c713c1f23d2 tempest-TestServerVolumeAttachScenarioOldVersion-419113578 tempest-TestServerVolumeAttachScenarioOldVersion-419113578-project-member] [instance: 5d479c64-055b-4496-b3a2-ba10f9095ea8] Failed to attach bf78953a-1bbf-43d5-9bd5-b026150d4f50 at /dev/vdb: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-d42bf869-1300-4cf7-a347-d0ffdd6f0de0)
Nov 06 16:00:57 user nova-compute[75337]: ERROR nova.compute.manager [instance: 5d479c64-055b-4496-b3a2-ba10f9095ea8] Traceback (most recent call last):
Nov 06 16:00:57 user nova-compute[75337]: ERROR nova.compute.manager [instance: 5d479c64-055b-4496-b3a2-ba10f9095ea8]   File "/opt/stack/nova/nova/compute/manager.py", line 7567, in _attach_volume
Nov 06 16:00:57 user nova-compute[75337]: ERROR nova.compute.manager [instance: 5d479c64-055b-4496-b3a2-ba10f9095ea8]     bdm.attach(context, instance, self.volume_api, self.driver,
Nov 06 16:00:57 user nova-compute[75337]: ERROR nova.compute.manager [instance: 5d479c64-055b-4496-b3a2-ba10f9095ea8]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 06 16:00:57 user nova-compute[75337]: ERROR nova.compute.manager [instance: 5d479c64-055b-4496-b3a2-ba10f9095ea8]     ret_val = method(obj, context, *args, **kwargs)
Nov 06 16:00:57 user nova-compute[75337]: ERROR nova.compute.manager [instance: 5d479c64-055b-4496-b3a2-ba10f9095ea8]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 06 16:00:57 user nova-compute[75337]: ERROR nova.compute.manager [instance: 5d479c64-055b-4496-b3a2-ba10f9095ea8]     self._do_attach(context, instance, volume, volume_api,
Nov 06 16:00:57 user nova-compute[75337]: ERROR nova.compute.manager [instance: 5d479c64-055b-4496-b3a2-ba10f9095ea8]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 06 16:00:57 user nova-compute[75337]: ERROR nova.compute.manager [instance: 5d479c64-055b-4496-b3a2-ba10f9095ea8]     self._volume_attach(context, volume, connector, instance,
Nov 06 16:00:57 user nova-compute[75337]: ERROR nova.compute.manager [instance: 5d479c64-055b-4496-b3a2-ba10f9095ea8]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 06 16:00:57 user nova-compute[75337]: ERROR nova.compute.manager [instance: 5d479c64-055b-4496-b3a2-ba10f9095ea8]     connection_info = volume_api.attachment_update(
Nov 06 16:00:57 user nova-compute[75337]: ERROR nova.compute.manager [instance: 5d479c64-055b-4496-b3a2-ba10f9095ea8]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 06 16:00:57 user nova-compute[75337]: ERROR nova.compute.manager [instance: 5d479c64-055b-4496-b3a2-ba10f9095ea8]     res = method(self, ctx, *args, **kwargs)
Nov 06 16:00:57 user nova-compute[75337]: ERROR nova.compute.manager [instance: 5d479c64-055b-4496-b3a2-ba10f9095ea8]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 06 16:00:57 user nova-compute[75337]: ERROR nova.compute.manager [instance: 5d479c64-055b-4496-b3a2-ba10f9095ea8]     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 06 16:00:57 user nova-compute[75337]: ERROR nova.compute.manager [instance: 5d479c64-055b-4496-b3a2-ba10f9095ea8]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 06 16:00:57 user nova-compute[75337]: ERROR nova.compute.manager [instance: 5d479c64-055b-4496-b3a2-ba10f9095ea8]     with excutils.save_and_reraise_exception():
Nov 06 16:00:57 user nova-compute[75337]: ERROR nova.compute.manager [instance: 5d479c64-055b-4496-b3a2-ba10f9095ea8]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 06 16:00:57 user nova-compute[75337]: ERROR nova.compute.manager [instance: 5d479c64-055b-4496-b3a2-ba10f9095ea8]     self.force_reraise()
Nov 06 16:00:57 user nova-compute[75337]: ERROR nova.compute.manager [instance: 5d479c64-055b-4496-b3a2-ba10f9095ea8]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 06 16:00:57 user nova-compute[75337]: ERROR nova.compute.manager [instance: 5d479c64-055b-4496-b3a2-ba10f9095ea8]     raise self.value
Nov 06 16:00:57 user nova-compute[75337]: ERROR nova.compute.manager [instance: 5d479c64-055b-4496-b3a2-ba10f9095ea8]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 06 16:00:57 user nova-compute[75337]: ERROR nova.compute.manager [instance: 5d479c64-055b-4496-b3a2-ba10f9095ea8]     context, '3.44', skip_version_check=True).attachments.update(
Nov 06 16:00:57 user nova-compute[75337]: ERROR nova.compute.manager [instance: 5d479c64-055b-4496-b3a2-ba10f9095ea8]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 06 16:00:57 user nova-compute[75337]: ERROR nova.compute.manager [instance: 5d479c64-055b-4496-b3a2-ba10f9095ea8]     return method.func(obj, *args, **kwargs)
Nov 06 16:00:57 user nova-compute[75337]: ERROR nova.compute.manager [instance: 5d479c64-055b-4496-b3a2-ba10f9095ea8]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 06 16:00:57 user nova-compute[75337]: ERROR nova.compute.manager [instance: 5d479c64-055b-4496-b3a2-ba10f9095ea8]     resp = self._update('/attachments/%s' % id, body)
Nov 06 16:00:57 user nova-compute[75337]: ERROR nova.compute.manager [instance: 5d479c64-055b-4496-b3a2-ba10f9095ea8]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 06 16:00:57 user nova-compute[75337]: ERROR nova.compute.manager [instance: 5d479c64-055b-4496-b3a2-ba10f9095ea8]     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 06 16:00:57 user nova-compute[75337]: ERROR nova.compute.manager [instance: 5d479c64-055b-4496-b3a2-ba10f9095ea8]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 06 16:00:57 user nova-compute[75337]: ERROR nova.compute.manager [instance: 5d479c64-055b-4496-b3a2-ba10f9095ea8]     return self._cs_request(url, 'PUT', **kwargs)
Nov 06 16:00:57 user nova-compute[75337]: ERROR nova.compute.manager [instance: 5d479c64-055b-4496-b3a2-ba10f9095ea8]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 06 16:00:57 user nova-compute[75337]: ERROR nova.compute.manager [instance: 5d479c64-055b-4496-b3a2-ba10f9095ea8]     return self.request(url, method, **kwargs)
Nov 06 16:00:57 user nova-compute[75337]: ERROR nova.compute.manager [instance: 5d479c64-055b-4496-b3a2-ba10f9095ea8]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 06 16:00:57 user nova-compute[75337]: ERROR nova.compute.manager [instance: 5d479c64-055b-4496-b3a2-ba10f9095ea8]     raise exceptions.from_response(resp, body)
Nov 06 16:00:57 user nova-compute[75337]: ERROR nova.compute.manager [instance: 5d479c64-055b-4496-b3a2-ba10f9095ea8] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-d42bf869-1300-4cf7-a347-d0ffdd6f0de0)
Nov 06 16:00:57 user nova-compute[75337]: ERROR nova.compute.manager [instance: 5d479c64-055b-4496-b3a2-ba10f9095ea8] 
Nov 06 16:00:57 user nova-compute[75337]: DEBUG nova.compute.manager [req-f7675731-5225-4e5f-addb-c958d78821c8 req-d517b0a4-c7c4-4ca8-ade4-976c4798f6df service nova] [instance: f196f2b3-8eac-4d68-af2e-46671c865be1] Received event network-vif-unplugged-0aa648d4-16ed-4160-92c7-0bb2ce626454 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:00:57 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-f7675731-5225-4e5f-addb-c958d78821c8 req-d517b0a4-c7c4-4ca8-ade4-976c4798f6df service nova] Acquiring lock "f196f2b3-8eac-4d68-af2e-46671c865be1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:00:57 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-f7675731-5225-4e5f-addb-c958d78821c8 req-d517b0a4-c7c4-4ca8-ade4-976c4798f6df service nova] Lock "f196f2b3-8eac-4d68-af2e-46671c865be1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:00:57 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-f7675731-5225-4e5f-addb-c958d78821c8 req-d517b0a4-c7c4-4ca8-ade4-976c4798f6df service nova] Lock "f196f2b3-8eac-4d68-af2e-46671c865be1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:00:57 user nova-compute[75337]: DEBUG nova.compute.manager [req-f7675731-5225-4e5f-addb-c958d78821c8 req-d517b0a4-c7c4-4ca8-ade4-976c4798f6df service nova] [instance: f196f2b3-8eac-4d68-af2e-46671c865be1] No waiting events found dispatching network-vif-unplugged-0aa648d4-16ed-4160-92c7-0bb2ce626454 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 16:00:57 user nova-compute[75337]: DEBUG nova.compute.manager [req-f7675731-5225-4e5f-addb-c958d78821c8 req-d517b0a4-c7c4-4ca8-ade4-976c4798f6df service nova] [instance: f196f2b3-8eac-4d68-af2e-46671c865be1] Received event network-vif-unplugged-0aa648d4-16ed-4160-92c7-0bb2ce626454 for instance with task_state deleting. {{(pid=75337) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 16:00:57 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-49460f3b-05fb-44e0-bb1f-9c713c1f23d2 tempest-TestServerVolumeAttachScenarioOldVersion-419113578 tempest-TestServerVolumeAttachScenarioOldVersion-419113578-project-member] Lock "5d479c64-055b-4496-b3a2-ba10f9095ea8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.701s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:00:57 user nova-compute[75337]: ERROR oslo_messaging.rpc.server [None req-49460f3b-05fb-44e0-bb1f-9c713c1f23d2 tempest-TestServerVolumeAttachScenarioOldVersion-419113578 tempest-TestServerVolumeAttachScenarioOldVersion-419113578-project-member] Exception during message handling: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-d42bf869-1300-4cf7-a347-d0ffdd6f0de0)
Nov 06 16:00:57 user nova-compute[75337]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 06 16:00:57 user nova-compute[75337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 06 16:00:57 user nova-compute[75337]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 06 16:00:57 user nova-compute[75337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 06 16:00:57 user nova-compute[75337]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 06 16:00:57 user nova-compute[75337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 06 16:00:57 user nova-compute[75337]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 06 16:00:57 user nova-compute[75337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 06 16:00:57 user nova-compute[75337]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 06 16:00:57 user nova-compute[75337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 06 16:00:57 user nova-compute[75337]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 06 16:00:57 user nova-compute[75337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 06 16:00:57 user nova-compute[75337]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 06 16:00:57 user nova-compute[75337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 06 16:00:57 user nova-compute[75337]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 06 16:00:57 user nova-compute[75337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Nov 06 16:00:57 user nova-compute[75337]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 06 16:00:57 user nova-compute[75337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Nov 06 16:00:57 user nova-compute[75337]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 06 16:00:57 user nova-compute[75337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 06 16:00:57 user nova-compute[75337]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 06 16:00:57 user nova-compute[75337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 06 16:00:57 user nova-compute[75337]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 06 16:00:57 user nova-compute[75337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Nov 06 16:00:57 user nova-compute[75337]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 06 16:00:57 user nova-compute[75337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7553, in attach_volume
Nov 06 16:00:57 user nova-compute[75337]: ERROR oslo_messaging.rpc.server     do_attach_volume(context, instance, driver_bdm)
Nov 06 16:00:57 user nova-compute[75337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py", line 414, in inner
Nov 06 16:00:57 user nova-compute[75337]: ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
Nov 06 16:00:57 user nova-compute[75337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7550, in do_attach_volume
Nov 06 16:00:57 user nova-compute[75337]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 06 16:00:57 user nova-compute[75337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 06 16:00:57 user nova-compute[75337]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 06 16:00:57 user nova-compute[75337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 06 16:00:57 user nova-compute[75337]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 06 16:00:57 user nova-compute[75337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7548, in do_attach_volume
Nov 06 16:00:57 user nova-compute[75337]: ERROR oslo_messaging.rpc.server     return self._attach_volume(context, instance, driver_bdm)
Nov 06 16:00:57 user nova-compute[75337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7570, in _attach_volume
Nov 06 16:00:57 user nova-compute[75337]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 06 16:00:57 user nova-compute[75337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 06 16:00:57 user nova-compute[75337]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 06 16:00:57 user nova-compute[75337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 06 16:00:57 user nova-compute[75337]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 06 16:00:57 user nova-compute[75337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7567, in _attach_volume
Nov 06 16:00:57 user nova-compute[75337]: ERROR oslo_messaging.rpc.server     bdm.attach(context, instance, self.volume_api, self.driver,
Nov 06 16:00:57 user nova-compute[75337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 06 16:00:57 user nova-compute[75337]: ERROR oslo_messaging.rpc.server     ret_val = method(obj, context, *args, **kwargs)
Nov 06 16:00:57 user nova-compute[75337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 06 16:00:57 user nova-compute[75337]: ERROR oslo_messaging.rpc.server     self._do_attach(context, instance, volume, volume_api,
Nov 06 16:00:57 user nova-compute[75337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 06 16:00:57 user nova-compute[75337]: ERROR oslo_messaging.rpc.server     self._volume_attach(context, volume, connector, instance,
Nov 06 16:00:57 user nova-compute[75337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 06 16:00:57 user nova-compute[75337]: ERROR oslo_messaging.rpc.server     connection_info = volume_api.attachment_update(
Nov 06 16:00:57 user nova-compute[75337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 06 16:00:57 user nova-compute[75337]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Nov 06 16:00:57 user nova-compute[75337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 06 16:00:57 user nova-compute[75337]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 06 16:00:57 user nova-compute[75337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 06 16:00:57 user nova-compute[75337]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 06 16:00:57 user nova-compute[75337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 06 16:00:57 user nova-compute[75337]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 06 16:00:57 user nova-compute[75337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 06 16:00:57 user nova-compute[75337]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 06 16:00:57 user nova-compute[75337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 06 16:00:57 user nova-compute[75337]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Nov 06 16:00:57 user nova-compute[75337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 06 16:00:57 user nova-compute[75337]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Nov 06 16:00:57 user nova-compute[75337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 06 16:00:57 user nova-compute[75337]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Nov 06 16:00:57 user nova-compute[75337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 06 16:00:57 user nova-compute[75337]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 06 16:00:57 user nova-compute[75337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 06 16:00:57 user nova-compute[75337]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Nov 06 16:00:57 user nova-compute[75337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 06 16:00:57 user nova-compute[75337]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Nov 06 16:00:57 user nova-compute[75337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 06 16:00:57 user nova-compute[75337]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Nov 06 16:00:57 user nova-compute[75337]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-d42bf869-1300-4cf7-a347-d0ffdd6f0de0)
Nov 06 16:00:57 user nova-compute[75337]: ERROR oslo_messaging.rpc.server 
Nov 06 16:00:57 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:00:57 user nova-compute[75337]: INFO nova.virt.libvirt.driver [-] [instance: f196f2b3-8eac-4d68-af2e-46671c865be1] Instance destroyed successfully.
Nov 06 16:00:57 user nova-compute[75337]: DEBUG nova.objects.instance [None req-48183fbb-bec3-48ff-a416-962fa3029f49 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Lazy-loading 'resources' on Instance uuid f196f2b3-8eac-4d68-af2e-46671c865be1 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 16:00:57 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-48183fbb-bec3-48ff-a416-962fa3029f49 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T15:57:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1424416',display_name='tempest-VolumesSnapshotTestJSON-instance-1424416',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1424416',id=35,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNs/bKUuaudNIY9n8MJmnIC/KLIWs1U+/1QVYjVM9mXhudgvjiXPDvV1kmsmSeJB4lA3r2g+eBldHD31du2jUzWxhDoG+m1rUsQi8HQagp1Rk3ljVx9pIUh8qF1yIcv+OQ==',key_name='tempest-keypair-1070010014',keypairs=<?>,launch_index=0,launched_at=2023-11-06T15:57:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='398008f06ed645099ae8be04ac48a3ff',ramdisk_id='',reservation_id='r-fuey3ydl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-208809405',owner_user_name='tempest-VolumesSnapshotTestJSON-208809405-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T15:57:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5b2c5ab3c4244bca99bcc3b143c46ecd',uuid=f196f2b3-8eac-4d68-af2e-46671c865be1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0aa648d4-16ed-4160-92c7-0bb2ce626454", "address": "fa:16:3e:1e:b2:da", "network": {"id": "8618d6aa-9df1-421d-916b-422978dc518d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1705024451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "398008f06ed645099ae8be04ac48a3ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0aa648d4-16", "ovs_interfaceid": "0aa648d4-16ed-4160-92c7-0bb2ce626454", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 16:00:57 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-48183fbb-bec3-48ff-a416-962fa3029f49 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Converting VIF {"id": "0aa648d4-16ed-4160-92c7-0bb2ce626454", "address": "fa:16:3e:1e:b2:da", "network": {"id": "8618d6aa-9df1-421d-916b-422978dc518d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1705024451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "398008f06ed645099ae8be04ac48a3ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0aa648d4-16", "ovs_interfaceid": "0aa648d4-16ed-4160-92c7-0bb2ce626454", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 16:00:57 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-48183fbb-bec3-48ff-a416-962fa3029f49 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1e:b2:da,bridge_name='br-int',has_traffic_filtering=True,id=0aa648d4-16ed-4160-92c7-0bb2ce626454,network=Network(8618d6aa-9df1-421d-916b-422978dc518d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0aa648d4-16') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 16:00:57 user nova-compute[75337]: DEBUG os_vif [None req-48183fbb-bec3-48ff-a416-962fa3029f49 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1e:b2:da,bridge_name='br-int',has_traffic_filtering=True,id=0aa648d4-16ed-4160-92c7-0bb2ce626454,network=Network(8618d6aa-9df1-421d-916b-422978dc518d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0aa648d4-16') {{(pid=75337) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 16:00:57 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:00:57 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0aa648d4-16, bridge=br-int, if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 16:00:57 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:00:57 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:00:57 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:00:57 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=72d5f13a-d370-47df-b70c-8426116c7fb6) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 16:00:57 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:00:57 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:00:57 user nova-compute[75337]: INFO os_vif [None req-48183fbb-bec3-48ff-a416-962fa3029f49 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1e:b2:da,bridge_name='br-int',has_traffic_filtering=True,id=0aa648d4-16ed-4160-92c7-0bb2ce626454,network=Network(8618d6aa-9df1-421d-916b-422978dc518d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0aa648d4-16')
Nov 06 16:00:57 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-48183fbb-bec3-48ff-a416-962fa3029f49 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] [instance: f196f2b3-8eac-4d68-af2e-46671c865be1] calling os-brick to detach iSCSI Volume {{(pid=75337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 16:00:57 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-48183fbb-bec3-48ff-a416-962fa3029f49 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2abc33d0c0>, {'target_iqn': 'iqn.2010-10.org.openstack:73a377b1-21a8-4273-8632-8daac8cd3a3b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OazgGChF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 16:00:57 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-48183fbb-bec3-48ff-a416-962fa3029f49 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 16:00:57 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-48183fbb-bec3-48ff-a416-962fa3029f49 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 16:00:57 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-48183fbb-bec3-48ff-a416-962fa3029f49 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 16:00:57 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:00:57 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:00:57 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa02629e-954a-407c-9474-02bbad7dfdfb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:45e66a2b-499f-46ca-90b5-2eeac6a5a8be\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:25450312-4e6c-4048-8a38-8f2bd6191b58\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:00:57 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-48183fbb-bec3-48ff-a416-962fa3029f49 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 16:00:57 user nova-compute[75337]: No targets found.
Nov 06 16:00:57 user nova-compute[75337]: iSNS:
Nov 06 16:00:57 user nova-compute[75337]: No targets found.
Nov 06 16:00:57 user nova-compute[75337]: STATIC:
Nov 06 16:00:57 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:45e66a2b-499f-46ca-90b5-2eeac6a5a8be
Nov 06 16:00:57 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 16:00:57 user nova-compute[75337]:                 Iface Name: default
Nov 06 16:00:57 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da
Nov 06 16:00:57 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 16:00:57 user nova-compute[75337]:                 Iface Name: default
Nov 06 16:00:57 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8
Nov 06 16:00:57 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 16:00:57 user nova-compute[75337]:                 Iface Name: default
Nov 06 16:00:57 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673
Nov 06 16:00:57 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 16:00:57 user nova-compute[75337]:                 Iface Name: default
Nov 06 16:00:57 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:25450312-4e6c-4048-8a38-8f2bd6191b58
Nov 06 16:00:57 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 16:00:57 user nova-compute[75337]:                 Iface Name: default
Nov 06 16:00:57 user nova-compute[75337]: FIRMWARE:
Nov 06 16:00:57 user nova-compute[75337]: No targets found.
Nov 06 16:00:57 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 16:00:57 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-48183fbb-bec3-48ff-a416-962fa3029f49 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 16:00:57 user nova-compute[75337]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 16:00:57 user nova-compute[75337]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75337) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 16:00:57 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-48183fbb-bec3-48ff-a416-962fa3029f49 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:73a377b1-21a8-4273-8632-8daac8cd3a3b', 0)] {{(pid=75337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 16:00:57 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:00:57 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:00:57 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec9444db-3c95-471a-bd29-a993f574f890]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:25450312-4e6c-4048-8a38-8f2bd6191b58\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45e66a2b-499f-46ca-90b5-2eeac6a5a8be\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:00:57 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:00:57 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:00:57 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8eee536-d99e-4e0c-b8cf-ddff9a03d6aa]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45e66a2b-499f-46ca-90b5-2eeac6a5a8be (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25450312-4e6c-4048-8a38-8f2bd6191b58 (non-flash)\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:00:57 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-48183fbb-bec3-48ff-a416-962fa3029f49 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8 (non-flash)
Nov 06 16:00:57 user nova-compute[75337]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da (non-flash)
Nov 06 16:00:57 user nova-compute[75337]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673 (non-flash)
Nov 06 16:00:57 user nova-compute[75337]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45e66a2b-499f-46ca-90b5-2eeac6a5a8be (non-flash)
Nov 06 16:00:57 user nova-compute[75337]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25450312-4e6c-4048-8a38-8f2bd6191b58 (non-flash)
Nov 06 16:00:57 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 16:00:57 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-48183fbb-bec3-48ff-a416-962fa3029f49 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8 (non-flash)
Nov 06 16:00:57 user nova-compute[75337]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da (non-flash)
Nov 06 16:00:57 user nova-compute[75337]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673 (non-flash)
Nov 06 16:00:57 user nova-compute[75337]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45e66a2b-499f-46ca-90b5-2eeac6a5a8be (non-flash)
Nov 06 16:00:57 user nova-compute[75337]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25450312-4e6c-4048-8a38-8f2bd6191b58 (non-flash)
Nov 06 16:00:57 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 16:00:57 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-48183fbb-bec3-48ff-a416-962fa3029f49 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2abc5308b0>, {}) {{(pid=75337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 16:00:57 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-48183fbb-bec3-48ff-a416-962fa3029f49 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Disconnecting from: [] {{(pid=75337) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 16:00:57 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-48183fbb-bec3-48ff-a416-962fa3029f49 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.082s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 16:00:57 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-48183fbb-bec3-48ff-a416-962fa3029f49 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] <== disconnect_volume: return (83ms) None {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 16:00:57 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-48183fbb-bec3-48ff-a416-962fa3029f49 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] [instance: f196f2b3-8eac-4d68-af2e-46671c865be1] Disconnected iSCSI Volume {{(pid=75337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 16:00:57 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-48183fbb-bec3-48ff-a416-962fa3029f49 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] [instance: f196f2b3-8eac-4d68-af2e-46671c865be1] Deleting instance files /opt/stack/data/nova/instances/f196f2b3-8eac-4d68-af2e-46671c865be1_del
Nov 06 16:00:57 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-48183fbb-bec3-48ff-a416-962fa3029f49 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] [instance: f196f2b3-8eac-4d68-af2e-46671c865be1] Deletion of /opt/stack/data/nova/instances/f196f2b3-8eac-4d68-af2e-46671c865be1_del complete
Nov 06 16:00:57 user nova-compute[75337]: INFO nova.compute.manager [None req-48183fbb-bec3-48ff-a416-962fa3029f49 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] [instance: f196f2b3-8eac-4d68-af2e-46671c865be1] Took 0.95 seconds to destroy the instance on the hypervisor.
Nov 06 16:00:57 user nova-compute[75337]: DEBUG oslo.service.loopingcall [None req-48183fbb-bec3-48ff-a416-962fa3029f49 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75337) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 16:00:57 user nova-compute[75337]: DEBUG nova.compute.manager [-] [instance: f196f2b3-8eac-4d68-af2e-46671c865be1] Deallocating network for instance {{(pid=75337) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 16:00:57 user nova-compute[75337]: DEBUG nova.network.neutron [-] [instance: f196f2b3-8eac-4d68-af2e-46671c865be1] deallocate_for_instance() {{(pid=75337) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 16:00:59 user nova-compute[75337]: DEBUG nova.network.neutron [-] [instance: f196f2b3-8eac-4d68-af2e-46671c865be1] Updating instance_info_cache with network_info: [] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 16:00:59 user nova-compute[75337]: INFO nova.compute.manager [-] [instance: f196f2b3-8eac-4d68-af2e-46671c865be1] Took 1.14 seconds to deallocate network for instance.
Nov 06 16:00:59 user nova-compute[75337]: WARNING nova.volume.cinder [None req-48183fbb-bec3-48ff-a416-962fa3029f49 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Attachment b1b7cde4-2733-43a8-af37-46603567e98d does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = b1b7cde4-2733-43a8-af37-46603567e98d. (HTTP 404) (Request-ID: req-0378dcb2-a898-435d-b6b5-e0a64f7956ce)
Nov 06 16:00:59 user nova-compute[75337]: INFO nova.compute.manager [None req-48183fbb-bec3-48ff-a416-962fa3029f49 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] [instance: f196f2b3-8eac-4d68-af2e-46671c865be1] Took 0.02 seconds to detach 1 volumes for instance.
Nov 06 16:00:59 user nova-compute[75337]: DEBUG nova.compute.manager [req-67b3e1ad-3e90-485f-a177-6130388ee660 req-32979557-3ad7-4d08-847c-9a9c7ab5a354 service nova] [instance: f196f2b3-8eac-4d68-af2e-46671c865be1] Received event network-vif-deleted-0aa648d4-16ed-4160-92c7-0bb2ce626454 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:00:59 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-48183fbb-bec3-48ff-a416-962fa3029f49 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:00:59 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-48183fbb-bec3-48ff-a416-962fa3029f49 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:00:59 user nova-compute[75337]: DEBUG nova.compute.manager [req-c22f7532-d463-4110-84eb-c108d980f166 req-48fe1e16-93ea-45a4-98ba-ad39282062cc service nova] [instance: f196f2b3-8eac-4d68-af2e-46671c865be1] Received event network-vif-plugged-0aa648d4-16ed-4160-92c7-0bb2ce626454 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:00:59 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-c22f7532-d463-4110-84eb-c108d980f166 req-48fe1e16-93ea-45a4-98ba-ad39282062cc service nova] Acquiring lock "f196f2b3-8eac-4d68-af2e-46671c865be1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:00:59 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-c22f7532-d463-4110-84eb-c108d980f166 req-48fe1e16-93ea-45a4-98ba-ad39282062cc service nova] Lock "f196f2b3-8eac-4d68-af2e-46671c865be1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:00:59 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-c22f7532-d463-4110-84eb-c108d980f166 req-48fe1e16-93ea-45a4-98ba-ad39282062cc service nova] Lock "f196f2b3-8eac-4d68-af2e-46671c865be1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:00:59 user nova-compute[75337]: DEBUG nova.compute.manager [req-c22f7532-d463-4110-84eb-c108d980f166 req-48fe1e16-93ea-45a4-98ba-ad39282062cc service nova] [instance: f196f2b3-8eac-4d68-af2e-46671c865be1] No waiting events found dispatching network-vif-plugged-0aa648d4-16ed-4160-92c7-0bb2ce626454 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 16:00:59 user nova-compute[75337]: WARNING nova.compute.manager [req-c22f7532-d463-4110-84eb-c108d980f166 req-48fe1e16-93ea-45a4-98ba-ad39282062cc service nova] [instance: f196f2b3-8eac-4d68-af2e-46671c865be1] Received unexpected event network-vif-plugged-0aa648d4-16ed-4160-92c7-0bb2ce626454 for instance with vm_state deleted and task_state None.
Nov 06 16:00:59 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-48183fbb-bec3-48ff-a416-962fa3029f49 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 16:00:59 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-48183fbb-bec3-48ff-a416-962fa3029f49 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 16:00:59 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-48183fbb-bec3-48ff-a416-962fa3029f49 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.324s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:00:59 user nova-compute[75337]: INFO nova.scheduler.client.report [None req-48183fbb-bec3-48ff-a416-962fa3029f49 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Deleted allocations for instance f196f2b3-8eac-4d68-af2e-46671c865be1
Nov 06 16:00:59 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:00:59 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-48183fbb-bec3-48ff-a416-962fa3029f49 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Lock "f196f2b3-8eac-4d68-af2e-46671c865be1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.619s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:01:01 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-eb42bf9d-6eae-4014-bb44-a4b1dd5a6a5e tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] Acquiring lock "30c634ff-6999-40aa-a90d-1db6d278b571" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:01:01 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-eb42bf9d-6eae-4014-bb44-a4b1dd5a6a5e tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] Lock "30c634ff-6999-40aa-a90d-1db6d278b571" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:01:01 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-eb42bf9d-6eae-4014-bb44-a4b1dd5a6a5e tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] Acquiring lock "30c634ff-6999-40aa-a90d-1db6d278b571-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:01:01 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-eb42bf9d-6eae-4014-bb44-a4b1dd5a6a5e tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] Lock "30c634ff-6999-40aa-a90d-1db6d278b571-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:01:01 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-eb42bf9d-6eae-4014-bb44-a4b1dd5a6a5e tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] Lock "30c634ff-6999-40aa-a90d-1db6d278b571-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:01:01 user nova-compute[75337]: INFO nova.compute.manager [None req-eb42bf9d-6eae-4014-bb44-a4b1dd5a6a5e tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] [instance: 30c634ff-6999-40aa-a90d-1db6d278b571] Terminating instance
Nov 06 16:01:01 user nova-compute[75337]: DEBUG nova.compute.manager [None req-eb42bf9d-6eae-4014-bb44-a4b1dd5a6a5e tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] [instance: 30c634ff-6999-40aa-a90d-1db6d278b571] Start destroying the instance on the hypervisor. {{(pid=75337) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 16:01:01 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:01:01 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:01:01 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:01:01 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:01:01 user nova-compute[75337]: DEBUG nova.compute.manager [req-56e3afc8-a233-4b1e-845e-d058d353e45c req-821a89a7-6de7-4246-865c-df1a04d1ebc7 service nova] [instance: 30c634ff-6999-40aa-a90d-1db6d278b571] Received event network-vif-unplugged-7b7a4e21-92b6-4854-8c0d-4d9556247a72 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:01:01 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-56e3afc8-a233-4b1e-845e-d058d353e45c req-821a89a7-6de7-4246-865c-df1a04d1ebc7 service nova] Acquiring lock "30c634ff-6999-40aa-a90d-1db6d278b571-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:01:01 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-56e3afc8-a233-4b1e-845e-d058d353e45c req-821a89a7-6de7-4246-865c-df1a04d1ebc7 service nova] Lock "30c634ff-6999-40aa-a90d-1db6d278b571-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:01:01 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-56e3afc8-a233-4b1e-845e-d058d353e45c req-821a89a7-6de7-4246-865c-df1a04d1ebc7 service nova] Lock "30c634ff-6999-40aa-a90d-1db6d278b571-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:01:01 user nova-compute[75337]: DEBUG nova.compute.manager [req-56e3afc8-a233-4b1e-845e-d058d353e45c req-821a89a7-6de7-4246-865c-df1a04d1ebc7 service nova] [instance: 30c634ff-6999-40aa-a90d-1db6d278b571] No waiting events found dispatching network-vif-unplugged-7b7a4e21-92b6-4854-8c0d-4d9556247a72 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 16:01:01 user nova-compute[75337]: DEBUG nova.compute.manager [req-56e3afc8-a233-4b1e-845e-d058d353e45c req-821a89a7-6de7-4246-865c-df1a04d1ebc7 service nova] [instance: 30c634ff-6999-40aa-a90d-1db6d278b571] Received event network-vif-unplugged-7b7a4e21-92b6-4854-8c0d-4d9556247a72 for instance with task_state deleting. {{(pid=75337) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 16:01:02 user nova-compute[75337]: INFO nova.virt.libvirt.driver [-] [instance: 30c634ff-6999-40aa-a90d-1db6d278b571] Instance destroyed successfully.
Nov 06 16:01:02 user nova-compute[75337]: DEBUG nova.objects.instance [None req-eb42bf9d-6eae-4014-bb44-a4b1dd5a6a5e tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] Lazy-loading 'resources' on Instance uuid 30c634ff-6999-40aa-a90d-1db6d278b571 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 16:01:02 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-eb42bf9d-6eae-4014-bb44-a4b1dd5a6a5e tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T15:51:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-989606681',display_name='tempest-ServersNegativeTestJSON-server-989606681',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-989606681',id=27,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-06T15:51:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e13dfd402b7b4ed1a1092c7388ff5188',ramdisk_id='',reservation_id='r-k5gb33hd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-624109021',owner_user_name='tempest-ServersNegativeTestJSON-624109021-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T15:51:59Z,user_data=None,user_id='5691e9e1923f4f2e9fdd3a39d8d7ff20',uuid=30c634ff-6999-40aa-a90d-1db6d278b571,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7b7a4e21-92b6-4854-8c0d-4d9556247a72", "address": "fa:16:3e:ee:c7:a1", "network": {"id": "6757c3a5-4f6f-48a7-9645-af433fb039de", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1337373982-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e13dfd402b7b4ed1a1092c7388ff5188", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b7a4e21-92", "ovs_interfaceid": "7b7a4e21-92b6-4854-8c0d-4d9556247a72", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 16:01:02 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-eb42bf9d-6eae-4014-bb44-a4b1dd5a6a5e tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] Converting VIF {"id": "7b7a4e21-92b6-4854-8c0d-4d9556247a72", "address": "fa:16:3e:ee:c7:a1", "network": {"id": "6757c3a5-4f6f-48a7-9645-af433fb039de", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1337373982-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e13dfd402b7b4ed1a1092c7388ff5188", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b7a4e21-92", "ovs_interfaceid": "7b7a4e21-92b6-4854-8c0d-4d9556247a72", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 16:01:02 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-eb42bf9d-6eae-4014-bb44-a4b1dd5a6a5e tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ee:c7:a1,bridge_name='br-int',has_traffic_filtering=True,id=7b7a4e21-92b6-4854-8c0d-4d9556247a72,network=Network(6757c3a5-4f6f-48a7-9645-af433fb039de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b7a4e21-92') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 16:01:02 user nova-compute[75337]: DEBUG os_vif [None req-eb42bf9d-6eae-4014-bb44-a4b1dd5a6a5e tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ee:c7:a1,bridge_name='br-int',has_traffic_filtering=True,id=7b7a4e21-92b6-4854-8c0d-4d9556247a72,network=Network(6757c3a5-4f6f-48a7-9645-af433fb039de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b7a4e21-92') {{(pid=75337) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 16:01:02 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:01:02 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7b7a4e21-92, bridge=br-int, if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 16:01:02 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:01:02 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:01:02 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:01:02 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c7b905c3-f707-43ca-9800-b672aadb06e8) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 16:01:02 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:01:02 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:01:02 user nova-compute[75337]: INFO os_vif [None req-eb42bf9d-6eae-4014-bb44-a4b1dd5a6a5e tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ee:c7:a1,bridge_name='br-int',has_traffic_filtering=True,id=7b7a4e21-92b6-4854-8c0d-4d9556247a72,network=Network(6757c3a5-4f6f-48a7-9645-af433fb039de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b7a4e21-92')
Nov 06 16:01:02 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-eb42bf9d-6eae-4014-bb44-a4b1dd5a6a5e tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] [instance: 30c634ff-6999-40aa-a90d-1db6d278b571] Deleting instance files /opt/stack/data/nova/instances/30c634ff-6999-40aa-a90d-1db6d278b571_del
Nov 06 16:01:02 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-eb42bf9d-6eae-4014-bb44-a4b1dd5a6a5e tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] [instance: 30c634ff-6999-40aa-a90d-1db6d278b571] Deletion of /opt/stack/data/nova/instances/30c634ff-6999-40aa-a90d-1db6d278b571_del complete
Nov 06 16:01:02 user nova-compute[75337]: INFO nova.compute.manager [None req-eb42bf9d-6eae-4014-bb44-a4b1dd5a6a5e tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] [instance: 30c634ff-6999-40aa-a90d-1db6d278b571] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 06 16:01:02 user nova-compute[75337]: DEBUG oslo.service.loopingcall [None req-eb42bf9d-6eae-4014-bb44-a4b1dd5a6a5e tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75337) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 16:01:02 user nova-compute[75337]: DEBUG nova.compute.manager [-] [instance: 30c634ff-6999-40aa-a90d-1db6d278b571] Deallocating network for instance {{(pid=75337) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 16:01:02 user nova-compute[75337]: DEBUG nova.network.neutron [-] [instance: 30c634ff-6999-40aa-a90d-1db6d278b571] deallocate_for_instance() {{(pid=75337) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 16:01:03 user nova-compute[75337]: DEBUG nova.network.neutron [-] [instance: 30c634ff-6999-40aa-a90d-1db6d278b571] Updating instance_info_cache with network_info: [] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 16:01:03 user nova-compute[75337]: INFO nova.compute.manager [-] [instance: 30c634ff-6999-40aa-a90d-1db6d278b571] Took 0.53 seconds to deallocate network for instance.
Nov 06 16:01:03 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-eb42bf9d-6eae-4014-bb44-a4b1dd5a6a5e tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:01:03 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-eb42bf9d-6eae-4014-bb44-a4b1dd5a6a5e tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:01:03 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-eb42bf9d-6eae-4014-bb44-a4b1dd5a6a5e tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 16:01:03 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-eb42bf9d-6eae-4014-bb44-a4b1dd5a6a5e tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 16:01:03 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-eb42bf9d-6eae-4014-bb44-a4b1dd5a6a5e tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.348s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:01:03 user nova-compute[75337]: INFO nova.scheduler.client.report [None req-eb42bf9d-6eae-4014-bb44-a4b1dd5a6a5e tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] Deleted allocations for instance 30c634ff-6999-40aa-a90d-1db6d278b571
Nov 06 16:01:03 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-eb42bf9d-6eae-4014-bb44-a4b1dd5a6a5e tempest-ServersNegativeTestJSON-624109021 tempest-ServersNegativeTestJSON-624109021-project-member] Lock "30c634ff-6999-40aa-a90d-1db6d278b571" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.945s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:01:03 user nova-compute[75337]: DEBUG nova.compute.manager [req-b8f40c46-bb37-427b-9170-e465c550392c req-bf4c6f98-6028-4d85-896b-d505de1b365e service nova] [instance: 30c634ff-6999-40aa-a90d-1db6d278b571] Received event network-vif-plugged-7b7a4e21-92b6-4854-8c0d-4d9556247a72 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:01:03 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-b8f40c46-bb37-427b-9170-e465c550392c req-bf4c6f98-6028-4d85-896b-d505de1b365e service nova] Acquiring lock "30c634ff-6999-40aa-a90d-1db6d278b571-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:01:03 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-b8f40c46-bb37-427b-9170-e465c550392c req-bf4c6f98-6028-4d85-896b-d505de1b365e service nova] Lock "30c634ff-6999-40aa-a90d-1db6d278b571-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:01:03 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-b8f40c46-bb37-427b-9170-e465c550392c req-bf4c6f98-6028-4d85-896b-d505de1b365e service nova] Lock "30c634ff-6999-40aa-a90d-1db6d278b571-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:01:03 user nova-compute[75337]: DEBUG nova.compute.manager [req-b8f40c46-bb37-427b-9170-e465c550392c req-bf4c6f98-6028-4d85-896b-d505de1b365e service nova] [instance: 30c634ff-6999-40aa-a90d-1db6d278b571] No waiting events found dispatching network-vif-plugged-7b7a4e21-92b6-4854-8c0d-4d9556247a72 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 16:01:03 user nova-compute[75337]: WARNING nova.compute.manager [req-b8f40c46-bb37-427b-9170-e465c550392c req-bf4c6f98-6028-4d85-896b-d505de1b365e service nova] [instance: 30c634ff-6999-40aa-a90d-1db6d278b571] Received unexpected event network-vif-plugged-7b7a4e21-92b6-4854-8c0d-4d9556247a72 for instance with vm_state deleted and task_state None.
Nov 06 16:01:03 user nova-compute[75337]: DEBUG nova.compute.manager [req-b8f40c46-bb37-427b-9170-e465c550392c req-bf4c6f98-6028-4d85-896b-d505de1b365e service nova] [instance: 30c634ff-6999-40aa-a90d-1db6d278b571] Received event network-vif-deleted-7b7a4e21-92b6-4854-8c0d-4d9556247a72 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:01:04 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:01:05 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:01:07 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:01:07 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:01:07 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:01:07 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75337) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 16:01:08 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:01:10 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:01:12 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-575c2ebe-decd-457a-82fd-7c9afe13a8db tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance ba7d8a41-5a75-4dca-a192-0177119403be is timed out.
Nov 06 16:01:12 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-575c2ebe-decd-457a-82fd-7c9afe13a8db tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] Successfully detached device vdc from instance ba7d8a41-5a75-4dca-a192-0177119403be from the live domain config.
Nov 06 16:01:12 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-575c2ebe-decd-457a-82fd-7c9afe13a8db tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] [instance: ba7d8a41-5a75-4dca-a192-0177119403be] calling os-brick to detach iSCSI Volume {{(pid=75337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 16:01:12 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-575c2ebe-decd-457a-82fd-7c9afe13a8db tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2abc33d0c0>, {'target_iqn': 'iqn.2010-10.org.openstack:25450312-4e6c-4048-8a38-8f2bd6191b58', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IUgMmDNH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 16:01:12 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-575c2ebe-decd-457a-82fd-7c9afe13a8db tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 16:01:12 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-575c2ebe-decd-457a-82fd-7c9afe13a8db tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 16:01:12 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-575c2ebe-decd-457a-82fd-7c9afe13a8db tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 16:01:12 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:01:12 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.070s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:01:12 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e5bcf14-83e5-404a-85fc-6d71f1e1d0aa]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:45e66a2b-499f-46ca-90b5-2eeac6a5a8be\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:25450312-4e6c-4048-8a38-8f2bd6191b58\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:01:12 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-575c2ebe-decd-457a-82fd-7c9afe13a8db tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 16:01:12 user nova-compute[75337]: No targets found.
Nov 06 16:01:12 user nova-compute[75337]: iSNS:
Nov 06 16:01:12 user nova-compute[75337]: No targets found.
Nov 06 16:01:12 user nova-compute[75337]: STATIC:
Nov 06 16:01:12 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:45e66a2b-499f-46ca-90b5-2eeac6a5a8be
Nov 06 16:01:12 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 16:01:12 user nova-compute[75337]:                 Iface Name: default
Nov 06 16:01:12 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da
Nov 06 16:01:12 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 16:01:12 user nova-compute[75337]:                 Iface Name: default
Nov 06 16:01:12 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8
Nov 06 16:01:12 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 16:01:12 user nova-compute[75337]:                 Iface Name: default
Nov 06 16:01:12 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673
Nov 06 16:01:12 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 16:01:12 user nova-compute[75337]:                 Iface Name: default
Nov 06 16:01:12 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:25450312-4e6c-4048-8a38-8f2bd6191b58
Nov 06 16:01:12 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 16:01:12 user nova-compute[75337]:                 Iface Name: default
Nov 06 16:01:12 user nova-compute[75337]: FIRMWARE:
Nov 06 16:01:12 user nova-compute[75337]: No targets found.
Nov 06 16:01:12 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 16:01:12 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-575c2ebe-decd-457a-82fd-7c9afe13a8db tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 16:01:12 user nova-compute[75337]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 16:01:12 user nova-compute[75337]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75337) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 16:01:12 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-575c2ebe-decd-457a-82fd-7c9afe13a8db tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:25450312-4e6c-4048-8a38-8f2bd6191b58', 0)] {{(pid=75337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 16:01:12 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:01:12 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:01:12 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dda5279-b9a2-4764-8faa-179e4078646a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:25450312-4e6c-4048-8a38-8f2bd6191b58\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45e66a2b-499f-46ca-90b5-2eeac6a5a8be\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:01:12 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:01:12 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:01:12 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[5526476c-f7be-4f45-a843-051fcb551f2a]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45e66a2b-499f-46ca-90b5-2eeac6a5a8be (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25450312-4e6c-4048-8a38-8f2bd6191b58 (non-flash)\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:01:12 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-575c2ebe-decd-457a-82fd-7c9afe13a8db tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8 (non-flash)
Nov 06 16:01:12 user nova-compute[75337]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da (non-flash)
Nov 06 16:01:12 user nova-compute[75337]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673 (non-flash)
Nov 06 16:01:12 user nova-compute[75337]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45e66a2b-499f-46ca-90b5-2eeac6a5a8be (non-flash)
Nov 06 16:01:12 user nova-compute[75337]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25450312-4e6c-4048-8a38-8f2bd6191b58 (non-flash)
Nov 06 16:01:12 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 16:01:12 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-575c2ebe-decd-457a-82fd-7c9afe13a8db tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8 (non-flash)
Nov 06 16:01:12 user nova-compute[75337]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da (non-flash)
Nov 06 16:01:12 user nova-compute[75337]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673 (non-flash)
Nov 06 16:01:12 user nova-compute[75337]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45e66a2b-499f-46ca-90b5-2eeac6a5a8be (non-flash)
Nov 06 16:01:12 user nova-compute[75337]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25450312-4e6c-4048-8a38-8f2bd6191b58 (non-flash)
Nov 06 16:01:12 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 16:01:12 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-575c2ebe-decd-457a-82fd-7c9afe13a8db tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2abc60d6c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:25450312-4e6c-4048-8a38-8f2bd6191b58'): ({'sdg'}, set())}) {{(pid=75337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 16:01:12 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-575c2ebe-decd-457a-82fd-7c9afe13a8db tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] Removing single pathed devices sdg {{(pid=75337) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 16:01:12 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:01:12 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:01:12 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a26c922-afcb-42fa-9b18-7cbfc93d9805]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:01:12 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:01:12 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.028s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:01:12 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[2023dbc9-33ef-4d16-97c9-dc96c7149765]: (4, ('ok\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:01:12 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-575c2ebe-decd-457a-82fd-7c9afe13a8db tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] Flushing IO for device /dev/sdg {{(pid=75337) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 16:01:12 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:01:12 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.014s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:01:12 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[f579194a-ead1-4372-92a7-9ae73bcf4d96]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:01:12 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-575c2ebe-decd-457a-82fd-7c9afe13a8db tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75337) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 16:01:12 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:01:12 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:01:12 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.052s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:01:12 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[21e1ce43-1585-4a34-b68b-f1c2fcadf829]: (4, ('1', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:01:12 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-575c2ebe-decd-457a-82fd-7c9afe13a8db tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 16:01:12 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-575c2ebe-decd-457a-82fd-7c9afe13a8db tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] SCSI volumes sdg have been removed. {{(pid=75337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 16:01:12 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-575c2ebe-decd-457a-82fd-7c9afe13a8db tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:25450312-4e6c-4048-8a38-8f2bd6191b58')] {{(pid=75337) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 16:01:12 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25450312-4e6c-4048-8a38-8f2bd6191b58 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:01:12 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25450312-4e6c-4048-8a38-8f2bd6191b58 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:01:12 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc58bf6b-b4d5-423d-b745-fa5e55ea94af]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:01:12 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-575c2ebe-decd-457a-82fd-7c9afe13a8db tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:01:12 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25450312-4e6c-4048-8a38-8f2bd6191b58 -p 172.16.0.220:3260 --logout {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:01:12 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25450312-4e6c-4048-8a38-8f2bd6191b58 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:01:12 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[f68b86fb-2d44-4af7-8c0e-509b349e2632]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:25450312-4e6c-4048-8a38-8f2bd6191b58, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:25450312-4e6c-4048-8a38-8f2bd6191b58, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:01:12 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-575c2ebe-decd-457a-82fd-7c9afe13a8db tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:25450312-4e6c-4048-8a38-8f2bd6191b58, portal: 172.16.0.220,3260]
Nov 06 16:01:12 user nova-compute[75337]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:25450312-4e6c-4048-8a38-8f2bd6191b58, portal: 172.16.0.220,3260] successful.
Nov 06 16:01:12 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:01:12 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25450312-4e6c-4048-8a38-8f2bd6191b58 -p 172.16.0.220:3260 --op delete {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:01:12 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:01:12 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25450312-4e6c-4048-8a38-8f2bd6191b58 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:01:12 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[e193bb48-2701-4b5f-b22d-ccb6c9058780]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:01:12 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-575c2ebe-decd-457a-82fd-7c9afe13a8db tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:01:12 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-575c2ebe-decd-457a-82fd-7c9afe13a8db tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.396s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 16:01:12 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-575c2ebe-decd-457a-82fd-7c9afe13a8db tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] <== disconnect_volume: return (397ms) None {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 16:01:12 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-575c2ebe-decd-457a-82fd-7c9afe13a8db tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] [instance: ba7d8a41-5a75-4dca-a192-0177119403be] Disconnected iSCSI Volume {{(pid=75337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 16:01:13 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:01:13 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:01:13 user nova-compute[75337]: DEBUG nova.objects.instance [None req-575c2ebe-decd-457a-82fd-7c9afe13a8db tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] Lazy-loading 'flavor' on Instance uuid ba7d8a41-5a75-4dca-a192-0177119403be {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 16:01:13 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-575c2ebe-decd-457a-82fd-7c9afe13a8db tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] Lock "ba7d8a41-5a75-4dca-a192-0177119403be" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.131s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:01:13 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-d547941c-b48d-4c54-b144-91ff588107c1 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 69df3824-b28c-43c0-9f20-52fa956642cc is timed out.
Nov 06 16:01:13 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-d547941c-b48d-4c54-b144-91ff588107c1 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Successfully detached device vdb from instance 69df3824-b28c-43c0-9f20-52fa956642cc from the live domain config.
Nov 06 16:01:13 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d547941c-b48d-4c54-b144-91ff588107c1 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] [instance: 69df3824-b28c-43c0-9f20-52fa956642cc] calling os-brick to detach iSCSI Volume {{(pid=75337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 16:01:13 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-d547941c-b48d-4c54-b144-91ff588107c1 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2abc33d0c0>, {'target_iqn': 'iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'csbVPIWq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 16:01:13 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-d547941c-b48d-4c54-b144-91ff588107c1 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 16:01:13 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-d547941c-b48d-4c54-b144-91ff588107c1 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 16:01:13 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-d547941c-b48d-4c54-b144-91ff588107c1 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 16:01:13 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:01:13 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:01:13 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[c46df815-1354-4289-bb11-cdcab9963f81]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:45e66a2b-499f-46ca-90b5-2eeac6a5a8be\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:01:13 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-d547941c-b48d-4c54-b144-91ff588107c1 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 16:01:13 user nova-compute[75337]: No targets found.
Nov 06 16:01:13 user nova-compute[75337]: iSNS:
Nov 06 16:01:13 user nova-compute[75337]: No targets found.
Nov 06 16:01:13 user nova-compute[75337]: STATIC:
Nov 06 16:01:13 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:45e66a2b-499f-46ca-90b5-2eeac6a5a8be
Nov 06 16:01:13 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 16:01:13 user nova-compute[75337]:                 Iface Name: default
Nov 06 16:01:13 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da
Nov 06 16:01:13 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 16:01:13 user nova-compute[75337]:                 Iface Name: default
Nov 06 16:01:13 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8
Nov 06 16:01:13 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 16:01:13 user nova-compute[75337]:                 Iface Name: default
Nov 06 16:01:13 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673
Nov 06 16:01:13 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 16:01:13 user nova-compute[75337]:                 Iface Name: default
Nov 06 16:01:13 user nova-compute[75337]: FIRMWARE:
Nov 06 16:01:13 user nova-compute[75337]: No targets found.
Nov 06 16:01:13 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 16:01:13 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-d547941c-b48d-4c54-b144-91ff588107c1 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 16:01:13 user nova-compute[75337]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 16:01:13 user nova-compute[75337]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75337) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 16:01:13 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-d547941c-b48d-4c54-b144-91ff588107c1 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da', 0)] {{(pid=75337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 16:01:13 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:01:13 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:01:13 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4f77b7d-b5e7-4a13-b121-5c85a5459c67]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45e66a2b-499f-46ca-90b5-2eeac6a5a8be\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:01:13 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:01:13 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:01:13 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[594b897d-4047-41c2-a437-f62c2c509eaa]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45e66a2b-499f-46ca-90b5-2eeac6a5a8be (non-flash)\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:01:13 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-d547941c-b48d-4c54-b144-91ff588107c1 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8 (non-flash)
Nov 06 16:01:13 user nova-compute[75337]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da (non-flash)
Nov 06 16:01:13 user nova-compute[75337]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673 (non-flash)
Nov 06 16:01:13 user nova-compute[75337]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45e66a2b-499f-46ca-90b5-2eeac6a5a8be (non-flash)
Nov 06 16:01:13 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 16:01:13 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-d547941c-b48d-4c54-b144-91ff588107c1 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8 (non-flash)
Nov 06 16:01:13 user nova-compute[75337]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da (non-flash)
Nov 06 16:01:13 user nova-compute[75337]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673 (non-flash)
Nov 06 16:01:13 user nova-compute[75337]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45e66a2b-499f-46ca-90b5-2eeac6a5a8be (non-flash)
Nov 06 16:01:13 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 16:01:13 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-d547941c-b48d-4c54-b144-91ff588107c1 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2a9c243f40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da'): ({'sdc'}, set())}) {{(pid=75337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 16:01:13 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-d547941c-b48d-4c54-b144-91ff588107c1 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Removing single pathed devices sdc {{(pid=75337) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 16:01:13 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:01:13 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:01:13 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f0407e1-93ca-4881-a1a9-ec61dad285e7]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:01:13 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:01:13 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:01:13 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[e819d65c-de73-46aa-a666-b4825815a3e3]: (4, ('ok\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:01:13 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-d547941c-b48d-4c54-b144-91ff588107c1 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Flushing IO for device /dev/sdc {{(pid=75337) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 16:01:13 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:01:14 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:01:14 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[12f159c5-ea94-4b53-af71-c0388e90f526]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:01:14 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-d547941c-b48d-4c54-b144-91ff588107c1 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75337) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 16:01:14 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:01:14 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.036s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:01:14 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[133295ad-51ff-4c56-bd56-79d644054ef7]: (4, ('1', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:01:14 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-d547941c-b48d-4c54-b144-91ff588107c1 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 16:01:14 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-d547941c-b48d-4c54-b144-91ff588107c1 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] SCSI volumes sdc have been removed. {{(pid=75337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 16:01:14 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-d547941c-b48d-4c54-b144-91ff588107c1 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da')] {{(pid=75337) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 16:01:14 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:01:14 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:01:14 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6d488cc-bdef-44a4-ac1f-45efde143d35]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:01:14 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-d547941c-b48d-4c54-b144-91ff588107c1 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:01:14 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da -p 172.16.0.220:3260 --logout {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:01:14 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:01:14 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b528418-1bbe-4723-a661-f5bd9da388bd]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:01:14 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-d547941c-b48d-4c54-b144-91ff588107c1 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da, portal: 172.16.0.220,3260]
Nov 06 16:01:14 user nova-compute[75337]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da, portal: 172.16.0.220,3260] successful.
Nov 06 16:01:14 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:01:14 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da -p 172.16.0.220:3260 --op delete {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:01:14 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27fe0158-ccd9-4398-ad6f-5622476733da -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:01:14 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b1bc830-03c3-479b-91d8-bd160fa9491d]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:01:14 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-d547941c-b48d-4c54-b144-91ff588107c1 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:01:14 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-d547941c-b48d-4c54-b144-91ff588107c1 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.343s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 16:01:14 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-d547941c-b48d-4c54-b144-91ff588107c1 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] <== disconnect_volume: return (345ms) None {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 16:01:14 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d547941c-b48d-4c54-b144-91ff588107c1 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] [instance: 69df3824-b28c-43c0-9f20-52fa956642cc] Disconnected iSCSI Volume {{(pid=75337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 16:01:14 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:01:15 user nova-compute[75337]: DEBUG nova.objects.instance [None req-d547941c-b48d-4c54-b144-91ff588107c1 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Lazy-loading 'flavor' on Instance uuid 69df3824-b28c-43c0-9f20-52fa956642cc {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 16:01:15 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-d547941c-b48d-4c54-b144-91ff588107c1 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Lock "69df3824-b28c-43c0-9f20-52fa956642cc" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.979s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:01:15 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:01:15 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-231df4e4-b4f6-4e0f-8346-f8489a7329f9 tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 5248533a-89b6-444e-a60a-154b3cdef815 is timed out.
Nov 06 16:01:15 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-231df4e4-b4f6-4e0f-8346-f8489a7329f9 tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Successfully detached device vdb from instance 5248533a-89b6-444e-a60a-154b3cdef815 from the live domain config.
Nov 06 16:01:15 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-231df4e4-b4f6-4e0f-8346-f8489a7329f9 tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: 5248533a-89b6-444e-a60a-154b3cdef815] calling os-brick to detach iSCSI Volume {{(pid=75337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 16:01:15 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-231df4e4-b4f6-4e0f-8346-f8489a7329f9 tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2abc33d0c0>, {'target_iqn': 'iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WAXrmtZf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 16:01:15 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-231df4e4-b4f6-4e0f-8346-f8489a7329f9 tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 16:01:15 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-231df4e4-b4f6-4e0f-8346-f8489a7329f9 tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 16:01:15 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-231df4e4-b4f6-4e0f-8346-f8489a7329f9 tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 16:01:15 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:01:15 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:01:15 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[8586c43e-026e-4f62-898b-bb52add80932]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:45e66a2b-499f-46ca-90b5-2eeac6a5a8be\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:01:15 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-231df4e4-b4f6-4e0f-8346-f8489a7329f9 tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 16:01:15 user nova-compute[75337]: No targets found.
Nov 06 16:01:15 user nova-compute[75337]: iSNS:
Nov 06 16:01:15 user nova-compute[75337]: No targets found.
Nov 06 16:01:15 user nova-compute[75337]: STATIC:
Nov 06 16:01:15 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:45e66a2b-499f-46ca-90b5-2eeac6a5a8be
Nov 06 16:01:15 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 16:01:15 user nova-compute[75337]:                 Iface Name: default
Nov 06 16:01:15 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8
Nov 06 16:01:15 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 16:01:15 user nova-compute[75337]:                 Iface Name: default
Nov 06 16:01:15 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673
Nov 06 16:01:15 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 16:01:15 user nova-compute[75337]:                 Iface Name: default
Nov 06 16:01:15 user nova-compute[75337]: FIRMWARE:
Nov 06 16:01:15 user nova-compute[75337]: No targets found.
Nov 06 16:01:15 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 16:01:15 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-231df4e4-b4f6-4e0f-8346-f8489a7329f9 tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 16:01:15 user nova-compute[75337]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 16:01:15 user nova-compute[75337]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75337) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 16:01:15 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-231df4e4-b4f6-4e0f-8346-f8489a7329f9 tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8', 0)] {{(pid=75337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 16:01:15 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:01:15 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:01:15 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[553d991c-6227-41f9-8860-77578dbec368]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45e66a2b-499f-46ca-90b5-2eeac6a5a8be\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:01:15 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:01:15 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:01:15 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2593aa7-94b0-4352-93e0-897658876e93]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45e66a2b-499f-46ca-90b5-2eeac6a5a8be (non-flash)\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:01:15 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-231df4e4-b4f6-4e0f-8346-f8489a7329f9 tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8 (non-flash)
Nov 06 16:01:15 user nova-compute[75337]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673 (non-flash)
Nov 06 16:01:15 user nova-compute[75337]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45e66a2b-499f-46ca-90b5-2eeac6a5a8be (non-flash)
Nov 06 16:01:15 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 16:01:15 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-231df4e4-b4f6-4e0f-8346-f8489a7329f9 tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8 (non-flash)
Nov 06 16:01:15 user nova-compute[75337]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673 (non-flash)
Nov 06 16:01:15 user nova-compute[75337]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45e66a2b-499f-46ca-90b5-2eeac6a5a8be (non-flash)
Nov 06 16:01:15 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 16:01:15 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-231df4e4-b4f6-4e0f-8346-f8489a7329f9 tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2a9c20a290>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8'): ({'sde'}, set())}) {{(pid=75337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 16:01:15 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-231df4e4-b4f6-4e0f-8346-f8489a7329f9 tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Removing single pathed devices sde {{(pid=75337) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 16:01:15 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:01:15 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:01:15 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6457bc9-8266-498a-8e9c-67cdf7a39dc9]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:01:15 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:01:15 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:01:15 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[54b03217-d27d-4377-b91b-17bbcee3a7f3]: (4, ('ok\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:01:15 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-231df4e4-b4f6-4e0f-8346-f8489a7329f9 tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Flushing IO for device /dev/sde {{(pid=75337) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 16:01:15 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:01:15 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:01:15 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f649d4f-e0f8-4018-ae23-3d60c02f828f]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:01:15 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-231df4e4-b4f6-4e0f-8346-f8489a7329f9 tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75337) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 16:01:15 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:01:15 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:01:15 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.040s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:01:15 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd114700-b972-437d-bcfe-e7e91aa5ed17]: (4, ('1', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:01:15 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-231df4e4-b4f6-4e0f-8346-f8489a7329f9 tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 16:01:15 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-231df4e4-b4f6-4e0f-8346-f8489a7329f9 tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] SCSI volumes sde have been removed. {{(pid=75337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 16:01:15 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-231df4e4-b4f6-4e0f-8346-f8489a7329f9 tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8')] {{(pid=75337) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 16:01:15 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:01:15 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:01:15 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[80487718-2e61-4f24-83ab-e9f4ce8d6cc5]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:01:15 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-231df4e4-b4f6-4e0f-8346-f8489a7329f9 tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:01:15 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8 -p 172.16.0.220:3260 --logout {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:01:15 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:01:15 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[71069e3f-9198-42ff-b96f-4b02382d8e24]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:01:15 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-231df4e4-b4f6-4e0f-8346-f8489a7329f9 tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8, portal: 172.16.0.220,3260]
Nov 06 16:01:15 user nova-compute[75337]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8, portal: 172.16.0.220,3260] successful.
Nov 06 16:01:15 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:01:15 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8 -p 172.16.0.220:3260 --op delete {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:01:15 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b702cb69-9f60-445c-a874-5abf6142bbb8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:01:15 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[227c085f-fc48-4d62-8165-4a2166cd4051]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:01:15 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-231df4e4-b4f6-4e0f-8346-f8489a7329f9 tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:01:15 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-231df4e4-b4f6-4e0f-8346-f8489a7329f9 tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.325s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 16:01:15 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-231df4e4-b4f6-4e0f-8346-f8489a7329f9 tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] <== disconnect_volume: return (327ms) None {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 16:01:15 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-231df4e4-b4f6-4e0f-8346-f8489a7329f9 tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: 5248533a-89b6-444e-a60a-154b3cdef815] Disconnected iSCSI Volume {{(pid=75337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 16:01:15 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-a53b0af7-db0f-4fd8-9355-b9139bae5da3 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Acquiring lock "69df3824-b28c-43c0-9f20-52fa956642cc" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:01:15 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-a53b0af7-db0f-4fd8-9355-b9139bae5da3 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Lock "69df3824-b28c-43c0-9f20-52fa956642cc" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:01:15 user nova-compute[75337]: DEBUG nova.compute.manager [None req-a53b0af7-db0f-4fd8-9355-b9139bae5da3 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] [instance: 69df3824-b28c-43c0-9f20-52fa956642cc] Checking state {{(pid=75337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 16:01:15 user nova-compute[75337]: DEBUG nova.compute.manager [None req-a53b0af7-db0f-4fd8-9355-b9139bae5da3 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] [instance: 69df3824-b28c-43c0-9f20-52fa956642cc] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=75337) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 06 16:01:15 user nova-compute[75337]: DEBUG nova.objects.instance [None req-a53b0af7-db0f-4fd8-9355-b9139bae5da3 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Lazy-loading 'flavor' on Instance uuid 69df3824-b28c-43c0-9f20-52fa956642cc {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 16:01:15 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:01:15 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:01:15 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:01:15 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:01:16 user nova-compute[75337]: DEBUG nova.compute.manager [req-7c1310d1-cf66-40ab-84e0-cac3b13f6996 req-6755009b-c887-49b2-8d33-cc5e6c681a30 service nova] [instance: 69df3824-b28c-43c0-9f20-52fa956642cc] Received event network-vif-unplugged-c3d051e2-c3b7-4ee0-aab0-dcf3c0d1d578 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:01:16 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-7c1310d1-cf66-40ab-84e0-cac3b13f6996 req-6755009b-c887-49b2-8d33-cc5e6c681a30 service nova] Acquiring lock "69df3824-b28c-43c0-9f20-52fa956642cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:01:16 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-7c1310d1-cf66-40ab-84e0-cac3b13f6996 req-6755009b-c887-49b2-8d33-cc5e6c681a30 service nova] Lock "69df3824-b28c-43c0-9f20-52fa956642cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:01:16 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-7c1310d1-cf66-40ab-84e0-cac3b13f6996 req-6755009b-c887-49b2-8d33-cc5e6c681a30 service nova] Lock "69df3824-b28c-43c0-9f20-52fa956642cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:01:16 user nova-compute[75337]: DEBUG nova.compute.manager [req-7c1310d1-cf66-40ab-84e0-cac3b13f6996 req-6755009b-c887-49b2-8d33-cc5e6c681a30 service nova] [instance: 69df3824-b28c-43c0-9f20-52fa956642cc] No waiting events found dispatching network-vif-unplugged-c3d051e2-c3b7-4ee0-aab0-dcf3c0d1d578 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 16:01:16 user nova-compute[75337]: WARNING nova.compute.manager [req-7c1310d1-cf66-40ab-84e0-cac3b13f6996 req-6755009b-c887-49b2-8d33-cc5e6c681a30 service nova] [instance: 69df3824-b28c-43c0-9f20-52fa956642cc] Received unexpected event network-vif-unplugged-c3d051e2-c3b7-4ee0-aab0-dcf3c0d1d578 for instance with vm_state active and task_state powering-off.
Nov 06 16:01:16 user nova-compute[75337]: INFO nova.virt.libvirt.driver [-] [instance: 69df3824-b28c-43c0-9f20-52fa956642cc] Instance destroyed successfully.
Nov 06 16:01:16 user nova-compute[75337]: DEBUG nova.compute.manager [None req-a53b0af7-db0f-4fd8-9355-b9139bae5da3 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] [instance: 69df3824-b28c-43c0-9f20-52fa956642cc] Checking state {{(pid=75337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 16:01:16 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-a53b0af7-db0f-4fd8-9355-b9139bae5da3 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Lock "69df3824-b28c-43c0-9f20-52fa956642cc" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.871s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:01:16 user nova-compute[75337]: DEBUG nova.objects.instance [None req-231df4e4-b4f6-4e0f-8346-f8489a7329f9 tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Lazy-loading 'flavor' on Instance uuid 5248533a-89b6-444e-a60a-154b3cdef815 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 16:01:16 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-231df4e4-b4f6-4e0f-8346-f8489a7329f9 tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Lock "5248533a-89b6-444e-a60a-154b3cdef815" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.962s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:01:17 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:01:17 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:01:17 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Starting heal instance info cache {{(pid=75337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 16:01:17 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "refresh_cache-6110b34a-6fd3-45fc-911d-4e5d3c7f2d78" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 16:01:17 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquired lock "refresh_cache-6110b34a-6fd3-45fc-911d-4e5d3c7f2d78" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 16:01:17 user nova-compute[75337]: DEBUG nova.network.neutron [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] [instance: 6110b34a-6fd3-45fc-911d-4e5d3c7f2d78] Forcefully refreshing network info cache for instance {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 16:01:18 user nova-compute[75337]: DEBUG nova.network.neutron [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] [instance: 6110b34a-6fd3-45fc-911d-4e5d3c7f2d78] Updating instance_info_cache with network_info: [{"id": "fa3c6657-452e-4a95-b9c8-c59002be4e31", "address": "fa:16:3e:18:69:52", "network": {"id": "7f234ecf-bfa6-4316-9dce-c15050ba7914", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1378707892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "243647103fd44f629e0f40be0b56407e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa3c6657-45", "ovs_interfaceid": "fa3c6657-452e-4a95-b9c8-c59002be4e31", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 16:01:18 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Releasing lock "refresh_cache-6110b34a-6fd3-45fc-911d-4e5d3c7f2d78" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 16:01:18 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] [instance: 6110b34a-6fd3-45fc-911d-4e5d3c7f2d78] Updated the network info_cache for instance {{(pid=75337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 16:01:18 user nova-compute[75337]: DEBUG nova.compute.manager [req-d0afabf1-f2c7-4238-9543-f107bc1ba553 req-70d8c8bb-f9fc-486d-84ef-37cc80a29fb6 service nova] [instance: 69df3824-b28c-43c0-9f20-52fa956642cc] Received event network-vif-plugged-c3d051e2-c3b7-4ee0-aab0-dcf3c0d1d578 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:01:18 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-d0afabf1-f2c7-4238-9543-f107bc1ba553 req-70d8c8bb-f9fc-486d-84ef-37cc80a29fb6 service nova] Acquiring lock "69df3824-b28c-43c0-9f20-52fa956642cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:01:18 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-d0afabf1-f2c7-4238-9543-f107bc1ba553 req-70d8c8bb-f9fc-486d-84ef-37cc80a29fb6 service nova] Lock "69df3824-b28c-43c0-9f20-52fa956642cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:01:18 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-d0afabf1-f2c7-4238-9543-f107bc1ba553 req-70d8c8bb-f9fc-486d-84ef-37cc80a29fb6 service nova] Lock "69df3824-b28c-43c0-9f20-52fa956642cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:01:18 user nova-compute[75337]: DEBUG nova.compute.manager [req-d0afabf1-f2c7-4238-9543-f107bc1ba553 req-70d8c8bb-f9fc-486d-84ef-37cc80a29fb6 service nova] [instance: 69df3824-b28c-43c0-9f20-52fa956642cc] No waiting events found dispatching network-vif-plugged-c3d051e2-c3b7-4ee0-aab0-dcf3c0d1d578 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 16:01:18 user nova-compute[75337]: WARNING nova.compute.manager [req-d0afabf1-f2c7-4238-9543-f107bc1ba553 req-70d8c8bb-f9fc-486d-84ef-37cc80a29fb6 service nova] [instance: 69df3824-b28c-43c0-9f20-52fa956642cc] Received unexpected event network-vif-plugged-c3d051e2-c3b7-4ee0-aab0-dcf3c0d1d578 for instance with vm_state stopped and task_state None.
Nov 06 16:01:19 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:01:19 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:01:20 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager.update_available_resource {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:01:20 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:01:20 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:01:20 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:01:20 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Auditing locally available compute resources for user (node: user) {{(pid=75337) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 16:01:20 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba7d8a41-5a75-4dca-a192-0177119403be/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:01:20 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:01:20 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba7d8a41-5a75-4dca-a192-0177119403be/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:01:20 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba7d8a41-5a75-4dca-a192-0177119403be/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:01:21 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba7d8a41-5a75-4dca-a192-0177119403be/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:01:21 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 16:01:21 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69df3824-b28c-43c0-9f20-52fa956642cc/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:01:21 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69df3824-b28c-43c0-9f20-52fa956642cc/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:01:21 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69df3824-b28c-43c0-9f20-52fa956642cc/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:01:21 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69df3824-b28c-43c0-9f20-52fa956642cc/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:01:21 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5248533a-89b6-444e-a60a-154b3cdef815/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:01:21 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5248533a-89b6-444e-a60a-154b3cdef815/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:01:21 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5248533a-89b6-444e-a60a-154b3cdef815/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:01:21 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5248533a-89b6-444e-a60a-154b3cdef815/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:01:21 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 16:01:21 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6110b34a-6fd3-45fc-911d-4e5d3c7f2d78/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:01:22 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6110b34a-6fd3-45fc-911d-4e5d3c7f2d78/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:01:22 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6110b34a-6fd3-45fc-911d-4e5d3c7f2d78/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:01:22 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6110b34a-6fd3-45fc-911d-4e5d3c7f2d78/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:01:22 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d479c64-055b-4496-b3a2-ba10f9095ea8/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:01:22 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:01:22 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d479c64-055b-4496-b3a2-ba10f9095ea8/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:01:22 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d479c64-055b-4496-b3a2-ba10f9095ea8/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:01:22 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d479c64-055b-4496-b3a2-ba10f9095ea8/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:01:23 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 16:01:23 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 16:01:23 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Hypervisor/Node resource view: name=user free_ram=8182MB free_disk=25.093280792236328GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75337) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 16:01:23 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:01:23 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:01:23 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 6110b34a-6fd3-45fc-911d-4e5d3c7f2d78 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 16:01:23 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 69df3824-b28c-43c0-9f20-52fa956642cc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 16:01:23 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 5248533a-89b6-444e-a60a-154b3cdef815 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 16:01:23 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance ba7d8a41-5a75-4dca-a192-0177119403be actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 16:01:23 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 5d479c64-055b-4496-b3a2-ba10f9095ea8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 16:01:23 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance e558736d-848f-4a79-a7aa-1e46638a85dc actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 16:01:23 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 16:01:23 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 16:01:23 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 16:01:23 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 16:01:23 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Compute_service record updated for user:user {{(pid=75337) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 16:01:23 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.355s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:01:24 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-b7ba7714-adf0-48e9-8db5-859be4497804 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Acquiring lock "01b61f9a-2591-4714-b18e-54f674a441ab" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:01:24 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-b7ba7714-adf0-48e9-8db5-859be4497804 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Lock "01b61f9a-2591-4714-b18e-54f674a441ab" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:01:24 user nova-compute[75337]: DEBUG nova.compute.manager [None req-b7ba7714-adf0-48e9-8db5-859be4497804 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] [instance: 01b61f9a-2591-4714-b18e-54f674a441ab] Starting instance... {{(pid=75337) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 16:01:24 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-b7ba7714-adf0-48e9-8db5-859be4497804 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:01:24 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-b7ba7714-adf0-48e9-8db5-859be4497804 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:01:24 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-b7ba7714-adf0-48e9-8db5-859be4497804 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75337) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 16:01:24 user nova-compute[75337]: INFO nova.compute.claims [None req-b7ba7714-adf0-48e9-8db5-859be4497804 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] [instance: 01b61f9a-2591-4714-b18e-54f674a441ab] Claim successful on node user
Nov 06 16:01:24 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:01:24 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-b7ba7714-adf0-48e9-8db5-859be4497804 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 16:01:24 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-b7ba7714-adf0-48e9-8db5-859be4497804 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 16:01:24 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-b7ba7714-adf0-48e9-8db5-859be4497804 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.367s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:01:24 user nova-compute[75337]: DEBUG nova.compute.manager [None req-b7ba7714-adf0-48e9-8db5-859be4497804 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] [instance: 01b61f9a-2591-4714-b18e-54f674a441ab] Start building networks asynchronously for instance. {{(pid=75337) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 16:01:24 user nova-compute[75337]: DEBUG nova.compute.manager [None req-b7ba7714-adf0-48e9-8db5-859be4497804 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] [instance: 01b61f9a-2591-4714-b18e-54f674a441ab] Allocating IP information in the background. {{(pid=75337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 16:01:24 user nova-compute[75337]: DEBUG nova.network.neutron [None req-b7ba7714-adf0-48e9-8db5-859be4497804 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] [instance: 01b61f9a-2591-4714-b18e-54f674a441ab] allocate_for_instance() {{(pid=75337) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 16:01:24 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-b7ba7714-adf0-48e9-8db5-859be4497804 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] [instance: 01b61f9a-2591-4714-b18e-54f674a441ab] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 16:01:24 user nova-compute[75337]: DEBUG nova.compute.manager [None req-b7ba7714-adf0-48e9-8db5-859be4497804 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] [instance: 01b61f9a-2591-4714-b18e-54f674a441ab] Start building block device mappings for instance. {{(pid=75337) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 16:01:24 user nova-compute[75337]: DEBUG nova.policy [None req-b7ba7714-adf0-48e9-8db5-859be4497804 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b551ef2185264d24b3af5f38bd583701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b65a37b3ac4a92af0279d7ef3b9637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75337) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 16:01:25 user nova-compute[75337]: DEBUG nova.compute.manager [None req-b7ba7714-adf0-48e9-8db5-859be4497804 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] [instance: 01b61f9a-2591-4714-b18e-54f674a441ab] Start spawning the instance on the hypervisor. {{(pid=75337) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 16:01:25 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-b7ba7714-adf0-48e9-8db5-859be4497804 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] [instance: 01b61f9a-2591-4714-b18e-54f674a441ab] Creating instance directory {{(pid=75337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 16:01:25 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-b7ba7714-adf0-48e9-8db5-859be4497804 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] [instance: 01b61f9a-2591-4714-b18e-54f674a441ab] Creating image(s)
Nov 06 16:01:25 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-b7ba7714-adf0-48e9-8db5-859be4497804 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Acquiring lock "/opt/stack/data/nova/instances/01b61f9a-2591-4714-b18e-54f674a441ab/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:01:25 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-b7ba7714-adf0-48e9-8db5-859be4497804 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Lock "/opt/stack/data/nova/instances/01b61f9a-2591-4714-b18e-54f674a441ab/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:01:25 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-b7ba7714-adf0-48e9-8db5-859be4497804 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Lock "/opt/stack/data/nova/instances/01b61f9a-2591-4714-b18e-54f674a441ab/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:01:25 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-b7ba7714-adf0-48e9-8db5-859be4497804 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:01:25 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-b7ba7714-adf0-48e9-8db5-859be4497804 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json" returned: 0 in 0.171s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:01:25 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-b7ba7714-adf0-48e9-8db5-859be4497804 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Acquiring lock "06ba3c914798499e686c5ac75886932347225275" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:01:25 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-b7ba7714-adf0-48e9-8db5-859be4497804 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Lock "06ba3c914798499e686c5ac75886932347225275" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:01:25 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-b7ba7714-adf0-48e9-8db5-859be4497804 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:01:25 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-b7ba7714-adf0-48e9-8db5-859be4497804 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json" returned: 0 in 0.179s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:01:25 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-b7ba7714-adf0-48e9-8db5-859be4497804 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275,backing_fmt=raw /opt/stack/data/nova/instances/01b61f9a-2591-4714-b18e-54f674a441ab/disk 1073741824 {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:01:25 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-b7ba7714-adf0-48e9-8db5-859be4497804 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275,backing_fmt=raw /opt/stack/data/nova/instances/01b61f9a-2591-4714-b18e-54f674a441ab/disk 1073741824" returned: 0 in 0.095s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:01:25 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-b7ba7714-adf0-48e9-8db5-859be4497804 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Lock "06ba3c914798499e686c5ac75886932347225275" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.280s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:01:25 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-b7ba7714-adf0-48e9-8db5-859be4497804 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:01:25 user nova-compute[75337]: DEBUG nova.network.neutron [None req-b7ba7714-adf0-48e9-8db5-859be4497804 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] [instance: 01b61f9a-2591-4714-b18e-54f674a441ab] Successfully created port: b5784ac8-0dc1-41ef-bb91-1e6b7d8a61fe {{(pid=75337) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 16:01:25 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-b7ba7714-adf0-48e9-8db5-859be4497804 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json" returned: 0 in 0.189s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:01:25 user nova-compute[75337]: DEBUG nova.virt.disk.api [None req-b7ba7714-adf0-48e9-8db5-859be4497804 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Checking if we can resize image /opt/stack/data/nova/instances/01b61f9a-2591-4714-b18e-54f674a441ab/disk. size=1073741824 {{(pid=75337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 16:01:25 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-b7ba7714-adf0-48e9-8db5-859be4497804 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01b61f9a-2591-4714-b18e-54f674a441ab/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:01:25 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-b7ba7714-adf0-48e9-8db5-859be4497804 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01b61f9a-2591-4714-b18e-54f674a441ab/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:01:25 user nova-compute[75337]: DEBUG nova.virt.disk.api [None req-b7ba7714-adf0-48e9-8db5-859be4497804 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Cannot resize image /opt/stack/data/nova/instances/01b61f9a-2591-4714-b18e-54f674a441ab/disk to a smaller size. {{(pid=75337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 06 16:01:25 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-b7ba7714-adf0-48e9-8db5-859be4497804 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] [instance: 01b61f9a-2591-4714-b18e-54f674a441ab] Created local disks {{(pid=75337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 16:01:25 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-b7ba7714-adf0-48e9-8db5-859be4497804 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] [instance: 01b61f9a-2591-4714-b18e-54f674a441ab] Ensure instance console log exists: /opt/stack/data/nova/instances/01b61f9a-2591-4714-b18e-54f674a441ab/console.log {{(pid=75337) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 16:01:25 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-b7ba7714-adf0-48e9-8db5-859be4497804 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:01:25 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-b7ba7714-adf0-48e9-8db5-859be4497804 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:01:25 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-b7ba7714-adf0-48e9-8db5-859be4497804 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:01:26 user nova-compute[75337]: DEBUG nova.network.neutron [None req-b7ba7714-adf0-48e9-8db5-859be4497804 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] [instance: 01b61f9a-2591-4714-b18e-54f674a441ab] Successfully updated port: b5784ac8-0dc1-41ef-bb91-1e6b7d8a61fe {{(pid=75337) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 16:01:26 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-b7ba7714-adf0-48e9-8db5-859be4497804 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Acquiring lock "refresh_cache-01b61f9a-2591-4714-b18e-54f674a441ab" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 16:01:26 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-b7ba7714-adf0-48e9-8db5-859be4497804 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Acquired lock "refresh_cache-01b61f9a-2591-4714-b18e-54f674a441ab" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 16:01:26 user nova-compute[75337]: DEBUG nova.network.neutron [None req-b7ba7714-adf0-48e9-8db5-859be4497804 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] [instance: 01b61f9a-2591-4714-b18e-54f674a441ab] Building network info cache for instance {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 16:01:26 user nova-compute[75337]: DEBUG nova.compute.manager [req-5af998c5-5627-4939-8213-650a8c25a0f7 req-345555c7-29a2-48aa-9c30-6ccb53d2dedf service nova] [instance: 01b61f9a-2591-4714-b18e-54f674a441ab] Received event network-changed-b5784ac8-0dc1-41ef-bb91-1e6b7d8a61fe {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:01:26 user nova-compute[75337]: DEBUG nova.compute.manager [req-5af998c5-5627-4939-8213-650a8c25a0f7 req-345555c7-29a2-48aa-9c30-6ccb53d2dedf service nova] [instance: 01b61f9a-2591-4714-b18e-54f674a441ab] Refreshing instance network info cache due to event network-changed-b5784ac8-0dc1-41ef-bb91-1e6b7d8a61fe. {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 16:01:26 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-5af998c5-5627-4939-8213-650a8c25a0f7 req-345555c7-29a2-48aa-9c30-6ccb53d2dedf service nova] Acquiring lock "refresh_cache-01b61f9a-2591-4714-b18e-54f674a441ab" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 16:01:26 user nova-compute[75337]: DEBUG nova.network.neutron [None req-b7ba7714-adf0-48e9-8db5-859be4497804 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] [instance: 01b61f9a-2591-4714-b18e-54f674a441ab] Instance cache missing network info. {{(pid=75337) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 16:01:26 user nova-compute[75337]: DEBUG nova.network.neutron [None req-b7ba7714-adf0-48e9-8db5-859be4497804 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] [instance: 01b61f9a-2591-4714-b18e-54f674a441ab] Updating instance_info_cache with network_info: [{"id": "b5784ac8-0dc1-41ef-bb91-1e6b7d8a61fe", "address": "fa:16:3e:2c:49:a1", "network": {"id": "df5f1c2e-c934-4237-aee6-f070a198c4ac", "bridge": "br-int", "label": "tempest-TestStampPattern-1883369969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37b65a37b3ac4a92af0279d7ef3b9637", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5784ac8-0d", "ovs_interfaceid": "b5784ac8-0dc1-41ef-bb91-1e6b7d8a61fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 16:01:26 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-b7ba7714-adf0-48e9-8db5-859be4497804 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Releasing lock "refresh_cache-01b61f9a-2591-4714-b18e-54f674a441ab" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 16:01:26 user nova-compute[75337]: DEBUG nova.compute.manager [None req-b7ba7714-adf0-48e9-8db5-859be4497804 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] [instance: 01b61f9a-2591-4714-b18e-54f674a441ab] Instance network_info: |[{"id": "b5784ac8-0dc1-41ef-bb91-1e6b7d8a61fe", "address": "fa:16:3e:2c:49:a1", "network": {"id": "df5f1c2e-c934-4237-aee6-f070a198c4ac", "bridge": "br-int", "label": "tempest-TestStampPattern-1883369969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37b65a37b3ac4a92af0279d7ef3b9637", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5784ac8-0d", "ovs_interfaceid": "b5784ac8-0dc1-41ef-bb91-1e6b7d8a61fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 16:01:26 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-5af998c5-5627-4939-8213-650a8c25a0f7 req-345555c7-29a2-48aa-9c30-6ccb53d2dedf service nova] Acquired lock "refresh_cache-01b61f9a-2591-4714-b18e-54f674a441ab" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 16:01:26 user nova-compute[75337]: DEBUG nova.network.neutron [req-5af998c5-5627-4939-8213-650a8c25a0f7 req-345555c7-29a2-48aa-9c30-6ccb53d2dedf service nova] [instance: 01b61f9a-2591-4714-b18e-54f674a441ab] Refreshing network info cache for port b5784ac8-0dc1-41ef-bb91-1e6b7d8a61fe {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 16:01:26 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-b7ba7714-adf0-48e9-8db5-859be4497804 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] [instance: 01b61f9a-2591-4714-b18e-54f674a441ab] Start _get_guest_xml network_info=[{"id": "b5784ac8-0dc1-41ef-bb91-1e6b7d8a61fe", "address": "fa:16:3e:2c:49:a1", "network": {"id": "df5f1c2e-c934-4237-aee6-f070a198c4ac", "bridge": "br-int", "label": "tempest-TestStampPattern-1883369969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37b65a37b3ac4a92af0279d7ef3b9637", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5784ac8-0d", "ovs_interfaceid": "b5784ac8-0dc1-41ef-bb91-1e6b7d8a61fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T15:34:14Z,direct_url=<?>,disk_format='qcow2',id=16b903ae-a40f-41a7-985b-4804cce92c62,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6549a15819f1469bbd5eeae8190e3d44',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T15:34:15Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'guest_format': None, 'size': 0, 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '16b903ae-a40f-41a7-985b-4804cce92c62'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 16:01:26 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-b7ba7714-adf0-48e9-8db5-859be4497804 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 16:01:26 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-b7ba7714-adf0-48e9-8db5-859be4497804 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 16:01:26 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-b7ba7714-adf0-48e9-8db5-859be4497804 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 16:01:26 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-b7ba7714-adf0-48e9-8db5-859be4497804 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] CPU controller missing on host. {{(pid=75337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 16:01:26 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-b7ba7714-adf0-48e9-8db5-859be4497804 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 16:01:26 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-b7ba7714-adf0-48e9-8db5-859be4497804 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] CPU controller found on host. {{(pid=75337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 16:01:26 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-b7ba7714-adf0-48e9-8db5-859be4497804 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75337) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 16:01:26 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-b7ba7714-adf0-48e9-8db5-859be4497804 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T15:34:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T15:34:14Z,direct_url=<?>,disk_format='qcow2',id=16b903ae-a40f-41a7-985b-4804cce92c62,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6549a15819f1469bbd5eeae8190e3d44',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T15:34:15Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 16:01:26 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-b7ba7714-adf0-48e9-8db5-859be4497804 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Flavor limits 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 16:01:26 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-b7ba7714-adf0-48e9-8db5-859be4497804 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Image limits 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 16:01:26 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-b7ba7714-adf0-48e9-8db5-859be4497804 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Flavor pref 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 16:01:26 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-b7ba7714-adf0-48e9-8db5-859be4497804 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Image pref 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 16:01:26 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-b7ba7714-adf0-48e9-8db5-859be4497804 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 16:01:26 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-b7ba7714-adf0-48e9-8db5-859be4497804 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 16:01:26 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-b7ba7714-adf0-48e9-8db5-859be4497804 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 16:01:26 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-b7ba7714-adf0-48e9-8db5-859be4497804 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Got 1 possible topologies {{(pid=75337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 16:01:26 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-b7ba7714-adf0-48e9-8db5-859be4497804 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 16:01:26 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-b7ba7714-adf0-48e9-8db5-859be4497804 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 16:01:26 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-b7ba7714-adf0-48e9-8db5-859be4497804 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T16:01:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1483310334',display_name='tempest-TestStampPattern-server-1483310334',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1483310334',id=39,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMMCtkcnnPytdqY3MPUgpmiSS7xeTmnpNw4yaIWZePSkgldKNk3oCL2U4/sFc1ScnWZoqLzBjkjfNxl1aD3owimjf0HTAAfgYQIOjLMlBJeg0uRD4v0ywlrz4Y1mxBwe3Q==',key_name='tempest-TestStampPattern-1350094120',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='37b65a37b3ac4a92af0279d7ef3b9637',ramdisk_id='',reservation_id='r-e6e2zlk2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-2127170584',owner_user_name='tempest-TestStampPattern-2127170584-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T16:01:25Z,user_data=None,user_id='b551ef2185264d24b3af5f38bd583701',uuid=01b61f9a-2591-4714-b18e-54f674a441ab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b5784ac8-0dc1-41ef-bb91-1e6b7d8a61fe", "address": "fa:16:3e:2c:49:a1", "network": {"id": "df5f1c2e-c934-4237-aee6-f070a198c4ac", "bridge": "br-int", "label": "tempest-TestStampPattern-1883369969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37b65a37b3ac4a92af0279d7ef3b9637", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5784ac8-0d", "ovs_interfaceid": "b5784ac8-0dc1-41ef-bb91-1e6b7d8a61fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75337) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 16:01:26 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-b7ba7714-adf0-48e9-8db5-859be4497804 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Converting VIF {"id": "b5784ac8-0dc1-41ef-bb91-1e6b7d8a61fe", "address": "fa:16:3e:2c:49:a1", "network": {"id": "df5f1c2e-c934-4237-aee6-f070a198c4ac", "bridge": "br-int", "label": "tempest-TestStampPattern-1883369969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37b65a37b3ac4a92af0279d7ef3b9637", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5784ac8-0d", "ovs_interfaceid": "b5784ac8-0dc1-41ef-bb91-1e6b7d8a61fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 16:01:26 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-b7ba7714-adf0-48e9-8db5-859be4497804 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2c:49:a1,bridge_name='br-int',has_traffic_filtering=True,id=b5784ac8-0dc1-41ef-bb91-1e6b7d8a61fe,network=Network(df5f1c2e-c934-4237-aee6-f070a198c4ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5784ac8-0d') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 16:01:26 user nova-compute[75337]: DEBUG nova.objects.instance [None req-b7ba7714-adf0-48e9-8db5-859be4497804 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Lazy-loading 'pci_devices' on Instance uuid 01b61f9a-2591-4714-b18e-54f674a441ab {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 16:01:26 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-b7ba7714-adf0-48e9-8db5-859be4497804 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] [instance: 01b61f9a-2591-4714-b18e-54f674a441ab] End _get_guest_xml xml=<domain type="kvm">
Nov 06 16:01:26 user nova-compute[75337]:   <uuid>01b61f9a-2591-4714-b18e-54f674a441ab</uuid>
Nov 06 16:01:26 user nova-compute[75337]:   <name>instance-00000027</name>
Nov 06 16:01:26 user nova-compute[75337]:   <memory>524288</memory>
Nov 06 16:01:26 user nova-compute[75337]:   <vcpu>1</vcpu>
Nov 06 16:01:26 user nova-compute[75337]:   <metadata>
Nov 06 16:01:26 user nova-compute[75337]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 16:01:26 user nova-compute[75337]:       <nova:package version="0.0.0"/>
Nov 06 16:01:26 user nova-compute[75337]:       <nova:name>tempest-TestStampPattern-server-1483310334</nova:name>
Nov 06 16:01:26 user nova-compute[75337]:       <nova:creationTime>2023-11-06 16:01:26</nova:creationTime>
Nov 06 16:01:26 user nova-compute[75337]:       <nova:flavor name="m1.tiny">
Nov 06 16:01:26 user nova-compute[75337]:         <nova:memory>512</nova:memory>
Nov 06 16:01:26 user nova-compute[75337]:         <nova:disk>1</nova:disk>
Nov 06 16:01:26 user nova-compute[75337]:         <nova:swap>0</nova:swap>
Nov 06 16:01:26 user nova-compute[75337]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 16:01:26 user nova-compute[75337]:         <nova:vcpus>1</nova:vcpus>
Nov 06 16:01:26 user nova-compute[75337]:       </nova:flavor>
Nov 06 16:01:26 user nova-compute[75337]:       <nova:owner>
Nov 06 16:01:26 user nova-compute[75337]:         <nova:user uuid="b551ef2185264d24b3af5f38bd583701">tempest-TestStampPattern-2127170584-project-member</nova:user>
Nov 06 16:01:26 user nova-compute[75337]:         <nova:project uuid="37b65a37b3ac4a92af0279d7ef3b9637">tempest-TestStampPattern-2127170584</nova:project>
Nov 06 16:01:26 user nova-compute[75337]:       </nova:owner>
Nov 06 16:01:26 user nova-compute[75337]:       <nova:root type="image" uuid="16b903ae-a40f-41a7-985b-4804cce92c62"/>
Nov 06 16:01:26 user nova-compute[75337]:       <nova:ports>
Nov 06 16:01:26 user nova-compute[75337]:         <nova:port uuid="b5784ac8-0dc1-41ef-bb91-1e6b7d8a61fe">
Nov 06 16:01:26 user nova-compute[75337]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 06 16:01:26 user nova-compute[75337]:         </nova:port>
Nov 06 16:01:26 user nova-compute[75337]:       </nova:ports>
Nov 06 16:01:26 user nova-compute[75337]:     </nova:instance>
Nov 06 16:01:26 user nova-compute[75337]:   </metadata>
Nov 06 16:01:26 user nova-compute[75337]:   <sysinfo type="smbios">
Nov 06 16:01:26 user nova-compute[75337]:     <system>
Nov 06 16:01:26 user nova-compute[75337]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 16:01:26 user nova-compute[75337]:       <entry name="product">OpenStack Nova</entry>
Nov 06 16:01:26 user nova-compute[75337]:       <entry name="version">0.0.0</entry>
Nov 06 16:01:26 user nova-compute[75337]:       <entry name="serial">01b61f9a-2591-4714-b18e-54f674a441ab</entry>
Nov 06 16:01:26 user nova-compute[75337]:       <entry name="uuid">01b61f9a-2591-4714-b18e-54f674a441ab</entry>
Nov 06 16:01:26 user nova-compute[75337]:       <entry name="family">Virtual Machine</entry>
Nov 06 16:01:26 user nova-compute[75337]:     </system>
Nov 06 16:01:26 user nova-compute[75337]:   </sysinfo>
Nov 06 16:01:26 user nova-compute[75337]:   <os>
Nov 06 16:01:26 user nova-compute[75337]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 16:01:26 user nova-compute[75337]:     <boot dev="hd"/>
Nov 06 16:01:26 user nova-compute[75337]:     <smbios mode="sysinfo"/>
Nov 06 16:01:26 user nova-compute[75337]:   </os>
Nov 06 16:01:26 user nova-compute[75337]:   <features>
Nov 06 16:01:26 user nova-compute[75337]:     <acpi/>
Nov 06 16:01:26 user nova-compute[75337]:     <apic/>
Nov 06 16:01:26 user nova-compute[75337]:     <vmcoreinfo/>
Nov 06 16:01:26 user nova-compute[75337]:   </features>
Nov 06 16:01:26 user nova-compute[75337]:   <clock offset="utc">
Nov 06 16:01:26 user nova-compute[75337]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 16:01:26 user nova-compute[75337]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 16:01:26 user nova-compute[75337]:     <timer name="hpet" present="no"/>
Nov 06 16:01:26 user nova-compute[75337]:   </clock>
Nov 06 16:01:26 user nova-compute[75337]:   <cpu mode="custom" match="exact">
Nov 06 16:01:26 user nova-compute[75337]:     <model>Nehalem</model>
Nov 06 16:01:26 user nova-compute[75337]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 16:01:26 user nova-compute[75337]:   </cpu>
Nov 06 16:01:26 user nova-compute[75337]:   <devices>
Nov 06 16:01:26 user nova-compute[75337]:     <disk type="file" device="disk">
Nov 06 16:01:26 user nova-compute[75337]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 16:01:26 user nova-compute[75337]:       <source file="/opt/stack/data/nova/instances/01b61f9a-2591-4714-b18e-54f674a441ab/disk"/>
Nov 06 16:01:26 user nova-compute[75337]:       <target dev="vda" bus="virtio"/>
Nov 06 16:01:26 user nova-compute[75337]:     </disk>
Nov 06 16:01:26 user nova-compute[75337]:     <interface type="ethernet">
Nov 06 16:01:26 user nova-compute[75337]:       <mac address="fa:16:3e:2c:49:a1"/>
Nov 06 16:01:26 user nova-compute[75337]:       <model type="virtio"/>
Nov 06 16:01:26 user nova-compute[75337]:       <mtu size="1442"/>
Nov 06 16:01:26 user nova-compute[75337]:       <target dev="tapb5784ac8-0d"/>
Nov 06 16:01:26 user nova-compute[75337]:     </interface>
Nov 06 16:01:26 user nova-compute[75337]:     <serial type="pty">
Nov 06 16:01:26 user nova-compute[75337]:       <log file="/opt/stack/data/nova/instances/01b61f9a-2591-4714-b18e-54f674a441ab/console.log" append="off"/>
Nov 06 16:01:26 user nova-compute[75337]:     </serial>
Nov 06 16:01:26 user nova-compute[75337]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 16:01:26 user nova-compute[75337]:     <video>
Nov 06 16:01:26 user nova-compute[75337]:       <model type="virtio"/>
Nov 06 16:01:26 user nova-compute[75337]:     </video>
Nov 06 16:01:26 user nova-compute[75337]:     <rng model="virtio">
Nov 06 16:01:26 user nova-compute[75337]:       <backend model="random">/dev/urandom</backend>
Nov 06 16:01:26 user nova-compute[75337]:     </rng>
Nov 06 16:01:26 user nova-compute[75337]:     <controller type="usb" index="0" model="none"/>
Nov 06 16:01:26 user nova-compute[75337]:     <memballoon model="virtio">
Nov 06 16:01:26 user nova-compute[75337]:       <stats period="10"/>
Nov 06 16:01:26 user nova-compute[75337]:     </memballoon>
Nov 06 16:01:26 user nova-compute[75337]:   </devices>
Nov 06 16:01:26 user nova-compute[75337]: </domain>
Nov 06 16:01:26 user nova-compute[75337]:  {{(pid=75337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 16:01:26 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-b7ba7714-adf0-48e9-8db5-859be4497804 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T16:01:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1483310334',display_name='tempest-TestStampPattern-server-1483310334',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1483310334',id=39,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMMCtkcnnPytdqY3MPUgpmiSS7xeTmnpNw4yaIWZePSkgldKNk3oCL2U4/sFc1ScnWZoqLzBjkjfNxl1aD3owimjf0HTAAfgYQIOjLMlBJeg0uRD4v0ywlrz4Y1mxBwe3Q==',key_name='tempest-TestStampPattern-1350094120',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='37b65a37b3ac4a92af0279d7ef3b9637',ramdisk_id='',reservation_id='r-e6e2zlk2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-2127170584',owner_user_name='tempest-TestStampPattern-2127170584-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T16:01:25Z,user_data=None,user_id='b551ef2185264d24b3af5f38bd583701',uuid=01b61f9a-2591-4714-b18e-54f674a441ab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b5784ac8-0dc1-41ef-bb91-1e6b7d8a61fe", "address": "fa:16:3e:2c:49:a1", "network": {"id": "df5f1c2e-c934-4237-aee6-f070a198c4ac", "bridge": "br-int", "label": "tempest-TestStampPattern-1883369969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37b65a37b3ac4a92af0279d7ef3b9637", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5784ac8-0d", "ovs_interfaceid": "b5784ac8-0dc1-41ef-bb91-1e6b7d8a61fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 16:01:26 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-b7ba7714-adf0-48e9-8db5-859be4497804 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Converting VIF {"id": "b5784ac8-0dc1-41ef-bb91-1e6b7d8a61fe", "address": "fa:16:3e:2c:49:a1", "network": {"id": "df5f1c2e-c934-4237-aee6-f070a198c4ac", "bridge": "br-int", "label": "tempest-TestStampPattern-1883369969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37b65a37b3ac4a92af0279d7ef3b9637", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5784ac8-0d", "ovs_interfaceid": "b5784ac8-0dc1-41ef-bb91-1e6b7d8a61fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 16:01:26 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-b7ba7714-adf0-48e9-8db5-859be4497804 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2c:49:a1,bridge_name='br-int',has_traffic_filtering=True,id=b5784ac8-0dc1-41ef-bb91-1e6b7d8a61fe,network=Network(df5f1c2e-c934-4237-aee6-f070a198c4ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5784ac8-0d') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 16:01:26 user nova-compute[75337]: DEBUG os_vif [None req-b7ba7714-adf0-48e9-8db5-859be4497804 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2c:49:a1,bridge_name='br-int',has_traffic_filtering=True,id=b5784ac8-0dc1-41ef-bb91-1e6b7d8a61fe,network=Network(df5f1c2e-c934-4237-aee6-f070a198c4ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5784ac8-0d') {{(pid=75337) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 16:01:26 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:01:26 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 16:01:26 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 16:01:26 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:01:26 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd5d5bdcc-be11-5917-8a6a-4dc53653d45d', '_type': 'linux-noop'}}, row=False) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 16:01:26 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:01:26 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:01:26 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:01:26 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:01:26 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb5784ac8-0d, may_exist=True, interface_attrs={}) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 16:01:26 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb5784ac8-0d, col_values=(('qos', UUID('c91c0b79-003f-44d4-abcf-37ba3b0cec66')),), if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 16:01:26 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb5784ac8-0d, col_values=(('external_ids', {'iface-id': 'b5784ac8-0dc1-41ef-bb91-1e6b7d8a61fe', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2c:49:a1', 'vm-uuid': '01b61f9a-2591-4714-b18e-54f674a441ab'}),), if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 16:01:26 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:01:26 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:01:26 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:01:26 user nova-compute[75337]: INFO os_vif [None req-b7ba7714-adf0-48e9-8db5-859be4497804 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2c:49:a1,bridge_name='br-int',has_traffic_filtering=True,id=b5784ac8-0dc1-41ef-bb91-1e6b7d8a61fe,network=Network(df5f1c2e-c934-4237-aee6-f070a198c4ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5784ac8-0d')
Nov 06 16:01:26 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-b7ba7714-adf0-48e9-8db5-859be4497804 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] No BDM found with device name vda, not building metadata. {{(pid=75337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 16:01:26 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-b7ba7714-adf0-48e9-8db5-859be4497804 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] No VIF found with MAC fa:16:3e:2c:49:a1, not building metadata {{(pid=75337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 16:01:27 user nova-compute[75337]: DEBUG nova.network.neutron [req-5af998c5-5627-4939-8213-650a8c25a0f7 req-345555c7-29a2-48aa-9c30-6ccb53d2dedf service nova] [instance: 01b61f9a-2591-4714-b18e-54f674a441ab] Updated VIF entry in instance network info cache for port b5784ac8-0dc1-41ef-bb91-1e6b7d8a61fe. {{(pid=75337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 16:01:27 user nova-compute[75337]: DEBUG nova.network.neutron [req-5af998c5-5627-4939-8213-650a8c25a0f7 req-345555c7-29a2-48aa-9c30-6ccb53d2dedf service nova] [instance: 01b61f9a-2591-4714-b18e-54f674a441ab] Updating instance_info_cache with network_info: [{"id": "b5784ac8-0dc1-41ef-bb91-1e6b7d8a61fe", "address": "fa:16:3e:2c:49:a1", "network": {"id": "df5f1c2e-c934-4237-aee6-f070a198c4ac", "bridge": "br-int", "label": "tempest-TestStampPattern-1883369969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37b65a37b3ac4a92af0279d7ef3b9637", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5784ac8-0d", "ovs_interfaceid": "b5784ac8-0dc1-41ef-bb91-1e6b7d8a61fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 16:01:27 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-5af998c5-5627-4939-8213-650a8c25a0f7 req-345555c7-29a2-48aa-9c30-6ccb53d2dedf service nova] Releasing lock "refresh_cache-01b61f9a-2591-4714-b18e-54f674a441ab" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 16:01:28 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:01:28 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:01:28 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:01:28 user nova-compute[75337]: DEBUG nova.compute.manager [req-e36e170b-1ccd-40d7-a092-65bfa536a8f3 req-0f257407-509e-439a-a139-6bdae52c48d3 service nova] [instance: e558736d-848f-4a79-a7aa-1e46638a85dc] Received event network-changed-0ed5847d-dcc9-43c0-96ae-02b3d24d1416 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:01:28 user nova-compute[75337]: DEBUG nova.compute.manager [req-e36e170b-1ccd-40d7-a092-65bfa536a8f3 req-0f257407-509e-439a-a139-6bdae52c48d3 service nova] [instance: e558736d-848f-4a79-a7aa-1e46638a85dc] Refreshing instance network info cache due to event network-changed-0ed5847d-dcc9-43c0-96ae-02b3d24d1416. {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 16:01:28 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-e36e170b-1ccd-40d7-a092-65bfa536a8f3 req-0f257407-509e-439a-a139-6bdae52c48d3 service nova] Acquiring lock "refresh_cache-e558736d-848f-4a79-a7aa-1e46638a85dc" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 16:01:28 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-e36e170b-1ccd-40d7-a092-65bfa536a8f3 req-0f257407-509e-439a-a139-6bdae52c48d3 service nova] Acquired lock "refresh_cache-e558736d-848f-4a79-a7aa-1e46638a85dc" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 16:01:28 user nova-compute[75337]: DEBUG nova.network.neutron [req-e36e170b-1ccd-40d7-a092-65bfa536a8f3 req-0f257407-509e-439a-a139-6bdae52c48d3 service nova] [instance: e558736d-848f-4a79-a7aa-1e46638a85dc] Refreshing network info cache for port 0ed5847d-dcc9-43c0-96ae-02b3d24d1416 {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 16:01:28 user nova-compute[75337]: DEBUG nova.compute.manager [req-a2232b40-1494-439c-98b7-537e5e12c12b req-2400626d-e4d4-443e-98e7-22b22d19243e service nova] [instance: 01b61f9a-2591-4714-b18e-54f674a441ab] Received event network-vif-plugged-b5784ac8-0dc1-41ef-bb91-1e6b7d8a61fe {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:01:28 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-a2232b40-1494-439c-98b7-537e5e12c12b req-2400626d-e4d4-443e-98e7-22b22d19243e service nova] Acquiring lock "01b61f9a-2591-4714-b18e-54f674a441ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:01:28 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-a2232b40-1494-439c-98b7-537e5e12c12b req-2400626d-e4d4-443e-98e7-22b22d19243e service nova] Lock "01b61f9a-2591-4714-b18e-54f674a441ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:01:28 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-a2232b40-1494-439c-98b7-537e5e12c12b req-2400626d-e4d4-443e-98e7-22b22d19243e service nova] Lock "01b61f9a-2591-4714-b18e-54f674a441ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:01:28 user nova-compute[75337]: DEBUG nova.compute.manager [req-a2232b40-1494-439c-98b7-537e5e12c12b req-2400626d-e4d4-443e-98e7-22b22d19243e service nova] [instance: 01b61f9a-2591-4714-b18e-54f674a441ab] No waiting events found dispatching network-vif-plugged-b5784ac8-0dc1-41ef-bb91-1e6b7d8a61fe {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 16:01:28 user nova-compute[75337]: WARNING nova.compute.manager [req-a2232b40-1494-439c-98b7-537e5e12c12b req-2400626d-e4d4-443e-98e7-22b22d19243e service nova] [instance: 01b61f9a-2591-4714-b18e-54f674a441ab] Received unexpected event network-vif-plugged-b5784ac8-0dc1-41ef-bb91-1e6b7d8a61fe for instance with vm_state building and task_state spawning.
Nov 06 16:01:28 user nova-compute[75337]: DEBUG nova.network.neutron [req-e36e170b-1ccd-40d7-a092-65bfa536a8f3 req-0f257407-509e-439a-a139-6bdae52c48d3 service nova] [instance: e558736d-848f-4a79-a7aa-1e46638a85dc] Updated VIF entry in instance network info cache for port 0ed5847d-dcc9-43c0-96ae-02b3d24d1416. {{(pid=75337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 16:01:28 user nova-compute[75337]: DEBUG nova.network.neutron [req-e36e170b-1ccd-40d7-a092-65bfa536a8f3 req-0f257407-509e-439a-a139-6bdae52c48d3 service nova] [instance: e558736d-848f-4a79-a7aa-1e46638a85dc] Updating instance_info_cache with network_info: [{"id": "0ed5847d-dcc9-43c0-96ae-02b3d24d1416", "address": "fa:16:3e:22:e2:a6", "network": {"id": "4e47319f-de1d-4dfe-9915-7d2d5131704d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-895093240-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "915211c6a2734c36b34ff92a56b085f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ed5847d-dc", "ovs_interfaceid": "0ed5847d-dcc9-43c0-96ae-02b3d24d1416", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 16:01:28 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:01:28 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-e36e170b-1ccd-40d7-a092-65bfa536a8f3 req-0f257407-509e-439a-a139-6bdae52c48d3 service nova] Releasing lock "refresh_cache-e558736d-848f-4a79-a7aa-1e46638a85dc" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 16:01:28 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:01:28 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:01:28 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:01:28 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:01:29 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:01:30 user nova-compute[75337]: DEBUG nova.compute.manager [None req-b7ba7714-adf0-48e9-8db5-859be4497804 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] [instance: 01b61f9a-2591-4714-b18e-54f674a441ab] Instance event wait completed in 0 seconds for  {{(pid=75337) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 16:01:30 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-b7ba7714-adf0-48e9-8db5-859be4497804 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] [instance: 01b61f9a-2591-4714-b18e-54f674a441ab] Guest created on hypervisor {{(pid=75337) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 16:01:30 user nova-compute[75337]: INFO nova.virt.libvirt.driver [-] [instance: 01b61f9a-2591-4714-b18e-54f674a441ab] Instance spawned successfully.
Nov 06 16:01:30 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-b7ba7714-adf0-48e9-8db5-859be4497804 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] [instance: 01b61f9a-2591-4714-b18e-54f674a441ab] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 16:01:30 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-b7ba7714-adf0-48e9-8db5-859be4497804 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] [instance: 01b61f9a-2591-4714-b18e-54f674a441ab] Found default for hw_cdrom_bus of ide {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 16:01:30 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-b7ba7714-adf0-48e9-8db5-859be4497804 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] [instance: 01b61f9a-2591-4714-b18e-54f674a441ab] Found default for hw_disk_bus of virtio {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 16:01:30 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-b7ba7714-adf0-48e9-8db5-859be4497804 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] [instance: 01b61f9a-2591-4714-b18e-54f674a441ab] Found default for hw_input_bus of None {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 16:01:30 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-b7ba7714-adf0-48e9-8db5-859be4497804 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] [instance: 01b61f9a-2591-4714-b18e-54f674a441ab] Found default for hw_pointer_model of None {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 16:01:30 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-b7ba7714-adf0-48e9-8db5-859be4497804 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] [instance: 01b61f9a-2591-4714-b18e-54f674a441ab] Found default for hw_video_model of virtio {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 16:01:30 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-b7ba7714-adf0-48e9-8db5-859be4497804 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] [instance: 01b61f9a-2591-4714-b18e-54f674a441ab] Found default for hw_vif_model of virtio {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 16:01:30 user nova-compute[75337]: DEBUG nova.compute.manager [req-bd4ab8e2-6512-4c9a-9c64-8df4613305b3 req-92d67e77-4c8e-4ae5-a2ea-a2d51bf90449 service nova] [instance: 01b61f9a-2591-4714-b18e-54f674a441ab] Received event network-vif-plugged-b5784ac8-0dc1-41ef-bb91-1e6b7d8a61fe {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:01:30 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-bd4ab8e2-6512-4c9a-9c64-8df4613305b3 req-92d67e77-4c8e-4ae5-a2ea-a2d51bf90449 service nova] Acquiring lock "01b61f9a-2591-4714-b18e-54f674a441ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:01:30 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-bd4ab8e2-6512-4c9a-9c64-8df4613305b3 req-92d67e77-4c8e-4ae5-a2ea-a2d51bf90449 service nova] Lock "01b61f9a-2591-4714-b18e-54f674a441ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:01:30 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-bd4ab8e2-6512-4c9a-9c64-8df4613305b3 req-92d67e77-4c8e-4ae5-a2ea-a2d51bf90449 service nova] Lock "01b61f9a-2591-4714-b18e-54f674a441ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:01:30 user nova-compute[75337]: DEBUG nova.compute.manager [req-bd4ab8e2-6512-4c9a-9c64-8df4613305b3 req-92d67e77-4c8e-4ae5-a2ea-a2d51bf90449 service nova] [instance: 01b61f9a-2591-4714-b18e-54f674a441ab] No waiting events found dispatching network-vif-plugged-b5784ac8-0dc1-41ef-bb91-1e6b7d8a61fe {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 16:01:30 user nova-compute[75337]: WARNING nova.compute.manager [req-bd4ab8e2-6512-4c9a-9c64-8df4613305b3 req-92d67e77-4c8e-4ae5-a2ea-a2d51bf90449 service nova] [instance: 01b61f9a-2591-4714-b18e-54f674a441ab] Received unexpected event network-vif-plugged-b5784ac8-0dc1-41ef-bb91-1e6b7d8a61fe for instance with vm_state building and task_state spawning.
Nov 06 16:01:30 user nova-compute[75337]: INFO nova.compute.manager [None req-b7ba7714-adf0-48e9-8db5-859be4497804 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] [instance: 01b61f9a-2591-4714-b18e-54f674a441ab] Took 5.60 seconds to spawn the instance on the hypervisor.
Nov 06 16:01:30 user nova-compute[75337]: DEBUG nova.compute.manager [None req-b7ba7714-adf0-48e9-8db5-859be4497804 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] [instance: 01b61f9a-2591-4714-b18e-54f674a441ab] Checking state {{(pid=75337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 16:01:30 user nova-compute[75337]: INFO nova.compute.manager [None req-b7ba7714-adf0-48e9-8db5-859be4497804 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] [instance: 01b61f9a-2591-4714-b18e-54f674a441ab] Took 6.31 seconds to build instance.
Nov 06 16:01:30 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-b7ba7714-adf0-48e9-8db5-859be4497804 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Lock "01b61f9a-2591-4714-b18e-54f674a441ab" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.418s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:01:31 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:01:34 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:01:36 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:01:39 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:01:41 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:01:42 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-4636565f-6e70-421e-bcac-eaf8d1815658 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] Acquiring lock "ba7d8a41-5a75-4dca-a192-0177119403be" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:01:42 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-4636565f-6e70-421e-bcac-eaf8d1815658 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] Lock "ba7d8a41-5a75-4dca-a192-0177119403be" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:01:42 user nova-compute[75337]: INFO nova.compute.manager [None req-4636565f-6e70-421e-bcac-eaf8d1815658 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] [instance: ba7d8a41-5a75-4dca-a192-0177119403be] Detaching volume 45e66a2b-499f-46ca-90b5-2eeac6a5a8be
Nov 06 16:01:42 user nova-compute[75337]: INFO nova.virt.block_device [None req-4636565f-6e70-421e-bcac-eaf8d1815658 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] [instance: ba7d8a41-5a75-4dca-a192-0177119403be] Attempting to driver detach volume 45e66a2b-499f-46ca-90b5-2eeac6a5a8be from mountpoint /dev/vdb
Nov 06 16:01:42 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-4636565f-6e70-421e-bcac-eaf8d1815658 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] Attempting to detach device vdb from instance ba7d8a41-5a75-4dca-a192-0177119403be from the persistent domain config. {{(pid=75337) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 06 16:01:42 user nova-compute[75337]: DEBUG nova.virt.libvirt.guest [None req-4636565f-6e70-421e-bcac-eaf8d1815658 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 16:01:42 user nova-compute[75337]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 16:01:42 user nova-compute[75337]:   <source dev="/dev/sdf"/>
Nov 06 16:01:42 user nova-compute[75337]:   <target dev="vdb" bus="virtio"/>
Nov 06 16:01:42 user nova-compute[75337]:   <serial>45e66a2b-499f-46ca-90b5-2eeac6a5a8be</serial>
Nov 06 16:01:42 user nova-compute[75337]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 06 16:01:42 user nova-compute[75337]: </disk>
Nov 06 16:01:42 user nova-compute[75337]:  {{(pid=75337) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 16:01:42 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-4636565f-6e70-421e-bcac-eaf8d1815658 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] Successfully detached device vdb from instance ba7d8a41-5a75-4dca-a192-0177119403be from the persistent domain config.
Nov 06 16:01:42 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-4636565f-6e70-421e-bcac-eaf8d1815658 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ba7d8a41-5a75-4dca-a192-0177119403be from the live domain config. {{(pid=75337) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 06 16:01:42 user nova-compute[75337]: DEBUG nova.virt.libvirt.guest [None req-4636565f-6e70-421e-bcac-eaf8d1815658 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 16:01:42 user nova-compute[75337]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 16:01:42 user nova-compute[75337]:   <source dev="/dev/sdf"/>
Nov 06 16:01:42 user nova-compute[75337]:   <target dev="vdb" bus="virtio"/>
Nov 06 16:01:42 user nova-compute[75337]:   <serial>45e66a2b-499f-46ca-90b5-2eeac6a5a8be</serial>
Nov 06 16:01:42 user nova-compute[75337]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 06 16:01:42 user nova-compute[75337]: </disk>
Nov 06 16:01:42 user nova-compute[75337]:  {{(pid=75337) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 16:01:42 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-4636565f-6e70-421e-bcac-eaf8d1815658 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ba7d8a41-5a75-4dca-a192-0177119403be {{(pid=75337) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 06 16:01:44 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:01:45 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-18cb2f58-47a5-45c4-ad72-46b3cc4eda39 tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Acquiring lock "5248533a-89b6-444e-a60a-154b3cdef815" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:01:45 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-18cb2f58-47a5-45c4-ad72-46b3cc4eda39 tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Lock "5248533a-89b6-444e-a60a-154b3cdef815" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:01:45 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-18cb2f58-47a5-45c4-ad72-46b3cc4eda39 tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Acquiring lock "5248533a-89b6-444e-a60a-154b3cdef815-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:01:45 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-18cb2f58-47a5-45c4-ad72-46b3cc4eda39 tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Lock "5248533a-89b6-444e-a60a-154b3cdef815-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:01:45 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-18cb2f58-47a5-45c4-ad72-46b3cc4eda39 tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Lock "5248533a-89b6-444e-a60a-154b3cdef815-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:01:45 user nova-compute[75337]: INFO nova.compute.manager [None req-18cb2f58-47a5-45c4-ad72-46b3cc4eda39 tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: 5248533a-89b6-444e-a60a-154b3cdef815] Terminating instance
Nov 06 16:01:45 user nova-compute[75337]: DEBUG nova.compute.manager [None req-18cb2f58-47a5-45c4-ad72-46b3cc4eda39 tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: 5248533a-89b6-444e-a60a-154b3cdef815] Start destroying the instance on the hypervisor. {{(pid=75337) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 16:01:45 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:01:45 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:01:45 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:01:45 user nova-compute[75337]: DEBUG nova.compute.manager [req-5a7c93ef-1e36-4d6b-a486-c315cad14c7e req-027ec65d-e7b4-49c2-ab62-be37f6677327 service nova] [instance: 5248533a-89b6-444e-a60a-154b3cdef815] Received event network-vif-unplugged-007682c6-c911-4171-b66e-173d248356cb {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:01:45 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-5a7c93ef-1e36-4d6b-a486-c315cad14c7e req-027ec65d-e7b4-49c2-ab62-be37f6677327 service nova] Acquiring lock "5248533a-89b6-444e-a60a-154b3cdef815-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:01:45 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-5a7c93ef-1e36-4d6b-a486-c315cad14c7e req-027ec65d-e7b4-49c2-ab62-be37f6677327 service nova] Lock "5248533a-89b6-444e-a60a-154b3cdef815-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:01:45 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-5a7c93ef-1e36-4d6b-a486-c315cad14c7e req-027ec65d-e7b4-49c2-ab62-be37f6677327 service nova] Lock "5248533a-89b6-444e-a60a-154b3cdef815-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:01:45 user nova-compute[75337]: DEBUG nova.compute.manager [req-5a7c93ef-1e36-4d6b-a486-c315cad14c7e req-027ec65d-e7b4-49c2-ab62-be37f6677327 service nova] [instance: 5248533a-89b6-444e-a60a-154b3cdef815] No waiting events found dispatching network-vif-unplugged-007682c6-c911-4171-b66e-173d248356cb {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 16:01:45 user nova-compute[75337]: DEBUG nova.compute.manager [req-5a7c93ef-1e36-4d6b-a486-c315cad14c7e req-027ec65d-e7b4-49c2-ab62-be37f6677327 service nova] [instance: 5248533a-89b6-444e-a60a-154b3cdef815] Received event network-vif-unplugged-007682c6-c911-4171-b66e-173d248356cb for instance with task_state deleting. {{(pid=75337) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 16:01:45 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:01:46 user nova-compute[75337]: INFO nova.virt.libvirt.driver [-] [instance: 5248533a-89b6-444e-a60a-154b3cdef815] Instance destroyed successfully.
Nov 06 16:01:46 user nova-compute[75337]: DEBUG nova.objects.instance [None req-18cb2f58-47a5-45c4-ad72-46b3cc4eda39 tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Lazy-loading 'resources' on Instance uuid 5248533a-89b6-444e-a60a-154b3cdef815 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 16:01:46 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-18cb2f58-47a5-45c4-ad72-46b3cc4eda39 tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-06T15:55:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1506958454',display_name='tempest-ServerActionsTestOtherA-server-1915006086',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1506958454',id=33,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLLnBW4cDmEWGvvuTCYhgrjSwFeqdq9waFtK0/DRy6vZoehwGRDhsJbCJYWh2vj1zBgwLRqt7KS/TJeEYcini420vHoht0MKs0aDV1+OjULyGrj+Hbr6Qd4OdWLs+79ciw==',key_name='tempest-keypair-45200428',keypairs=<?>,launch_index=0,launched_at=2023-11-06T15:58:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='243647103fd44f629e0f40be0b56407e',ramdisk_id='',reservation_id='r-8xtee88d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-783619975',owner_user_name='tempest-ServerActionsTestOtherA-783619975-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T15:58:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2e47bf9ad49645deb2c1f834938fa39f',uuid=5248533a-89b6-444e-a60a-154b3cdef815,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "007682c6-c911-4171-b66e-173d248356cb", "address": "fa:16:3e:da:b1:68", "network": {"id": "7f234ecf-bfa6-4316-9dce-c15050ba7914", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1378707892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "243647103fd44f629e0f40be0b56407e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap007682c6-c9", "ovs_interfaceid": "007682c6-c911-4171-b66e-173d248356cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 16:01:46 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-18cb2f58-47a5-45c4-ad72-46b3cc4eda39 tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Converting VIF {"id": "007682c6-c911-4171-b66e-173d248356cb", "address": "fa:16:3e:da:b1:68", "network": {"id": "7f234ecf-bfa6-4316-9dce-c15050ba7914", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1378707892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "243647103fd44f629e0f40be0b56407e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap007682c6-c9", "ovs_interfaceid": "007682c6-c911-4171-b66e-173d248356cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 16:01:46 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-18cb2f58-47a5-45c4-ad72-46b3cc4eda39 tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:da:b1:68,bridge_name='br-int',has_traffic_filtering=True,id=007682c6-c911-4171-b66e-173d248356cb,network=Network(7f234ecf-bfa6-4316-9dce-c15050ba7914),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap007682c6-c9') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 16:01:46 user nova-compute[75337]: DEBUG os_vif [None req-18cb2f58-47a5-45c4-ad72-46b3cc4eda39 tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:da:b1:68,bridge_name='br-int',has_traffic_filtering=True,id=007682c6-c911-4171-b66e-173d248356cb,network=Network(7f234ecf-bfa6-4316-9dce-c15050ba7914),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap007682c6-c9') {{(pid=75337) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 16:01:46 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:01:46 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap007682c6-c9, bridge=br-int, if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 16:01:46 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:01:46 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:01:46 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:01:46 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:01:46 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fded3426-4452-49ba-bb99-38c86fe5e0d3) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 16:01:46 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:01:46 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:01:46 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:01:46 user nova-compute[75337]: INFO os_vif [None req-18cb2f58-47a5-45c4-ad72-46b3cc4eda39 tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:da:b1:68,bridge_name='br-int',has_traffic_filtering=True,id=007682c6-c911-4171-b66e-173d248356cb,network=Network(7f234ecf-bfa6-4316-9dce-c15050ba7914),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap007682c6-c9')
Nov 06 16:01:46 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-18cb2f58-47a5-45c4-ad72-46b3cc4eda39 tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: 5248533a-89b6-444e-a60a-154b3cdef815] Deleting instance files /opt/stack/data/nova/instances/5248533a-89b6-444e-a60a-154b3cdef815_del
Nov 06 16:01:46 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-18cb2f58-47a5-45c4-ad72-46b3cc4eda39 tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: 5248533a-89b6-444e-a60a-154b3cdef815] Deletion of /opt/stack/data/nova/instances/5248533a-89b6-444e-a60a-154b3cdef815_del complete
Nov 06 16:01:46 user nova-compute[75337]: INFO nova.compute.manager [None req-18cb2f58-47a5-45c4-ad72-46b3cc4eda39 tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: 5248533a-89b6-444e-a60a-154b3cdef815] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 06 16:01:46 user nova-compute[75337]: DEBUG oslo.service.loopingcall [None req-18cb2f58-47a5-45c4-ad72-46b3cc4eda39 tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75337) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 16:01:46 user nova-compute[75337]: DEBUG nova.compute.manager [-] [instance: 5248533a-89b6-444e-a60a-154b3cdef815] Deallocating network for instance {{(pid=75337) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 16:01:46 user nova-compute[75337]: DEBUG nova.network.neutron [-] [instance: 5248533a-89b6-444e-a60a-154b3cdef815] deallocate_for_instance() {{(pid=75337) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 16:01:47 user nova-compute[75337]: DEBUG nova.compute.manager [req-4c533283-753a-46d5-969c-49344de46412 req-461c0e83-8c01-4413-b9f4-3ab6b27629c5 service nova] [instance: 5248533a-89b6-444e-a60a-154b3cdef815] Received event network-vif-plugged-007682c6-c911-4171-b66e-173d248356cb {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:01:47 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-4c533283-753a-46d5-969c-49344de46412 req-461c0e83-8c01-4413-b9f4-3ab6b27629c5 service nova] Acquiring lock "5248533a-89b6-444e-a60a-154b3cdef815-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:01:47 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-4c533283-753a-46d5-969c-49344de46412 req-461c0e83-8c01-4413-b9f4-3ab6b27629c5 service nova] Lock "5248533a-89b6-444e-a60a-154b3cdef815-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:01:47 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-4c533283-753a-46d5-969c-49344de46412 req-461c0e83-8c01-4413-b9f4-3ab6b27629c5 service nova] Lock "5248533a-89b6-444e-a60a-154b3cdef815-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:01:47 user nova-compute[75337]: DEBUG nova.compute.manager [req-4c533283-753a-46d5-969c-49344de46412 req-461c0e83-8c01-4413-b9f4-3ab6b27629c5 service nova] [instance: 5248533a-89b6-444e-a60a-154b3cdef815] No waiting events found dispatching network-vif-plugged-007682c6-c911-4171-b66e-173d248356cb {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 16:01:47 user nova-compute[75337]: WARNING nova.compute.manager [req-4c533283-753a-46d5-969c-49344de46412 req-461c0e83-8c01-4413-b9f4-3ab6b27629c5 service nova] [instance: 5248533a-89b6-444e-a60a-154b3cdef815] Received unexpected event network-vif-plugged-007682c6-c911-4171-b66e-173d248356cb for instance with vm_state active and task_state deleting.
Nov 06 16:01:48 user nova-compute[75337]: DEBUG nova.network.neutron [-] [instance: 5248533a-89b6-444e-a60a-154b3cdef815] Updating instance_info_cache with network_info: [] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 16:01:48 user nova-compute[75337]: INFO nova.compute.manager [-] [instance: 5248533a-89b6-444e-a60a-154b3cdef815] Took 1.96 seconds to deallocate network for instance.
Nov 06 16:01:48 user nova-compute[75337]: DEBUG nova.compute.manager [req-11f9627c-d7cf-4079-a5b5-6656ff6d01eb req-cb1a571e-9235-4e34-af88-54eeef799da1 service nova] [instance: 5248533a-89b6-444e-a60a-154b3cdef815] Received event network-vif-deleted-007682c6-c911-4171-b66e-173d248356cb {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:01:48 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-18cb2f58-47a5-45c4-ad72-46b3cc4eda39 tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:01:48 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-18cb2f58-47a5-45c4-ad72-46b3cc4eda39 tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:01:48 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-18cb2f58-47a5-45c4-ad72-46b3cc4eda39 tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 16:01:48 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-18cb2f58-47a5-45c4-ad72-46b3cc4eda39 tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 16:01:48 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-18cb2f58-47a5-45c4-ad72-46b3cc4eda39 tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.306s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:01:48 user nova-compute[75337]: INFO nova.scheduler.client.report [None req-18cb2f58-47a5-45c4-ad72-46b3cc4eda39 tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Deleted allocations for instance 5248533a-89b6-444e-a60a-154b3cdef815
Nov 06 16:01:48 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-18cb2f58-47a5-45c4-ad72-46b3cc4eda39 tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Lock "5248533a-89b6-444e-a60a-154b3cdef815" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.377s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:01:48 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-77f99c06-8523-4b70-82ec-c7f6b9614a41 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Acquiring lock "85c56287-3140-4125-a316-0c652cc0f18a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:01:48 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-77f99c06-8523-4b70-82ec-c7f6b9614a41 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Lock "85c56287-3140-4125-a316-0c652cc0f18a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:01:48 user nova-compute[75337]: DEBUG nova.compute.manager [None req-77f99c06-8523-4b70-82ec-c7f6b9614a41 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 85c56287-3140-4125-a316-0c652cc0f18a] Starting instance... {{(pid=75337) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 16:01:48 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-77f99c06-8523-4b70-82ec-c7f6b9614a41 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:01:48 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-77f99c06-8523-4b70-82ec-c7f6b9614a41 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:01:48 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-77f99c06-8523-4b70-82ec-c7f6b9614a41 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75337) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 16:01:48 user nova-compute[75337]: INFO nova.compute.claims [None req-77f99c06-8523-4b70-82ec-c7f6b9614a41 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 85c56287-3140-4125-a316-0c652cc0f18a] Claim successful on node user
Nov 06 16:01:49 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-77f99c06-8523-4b70-82ec-c7f6b9614a41 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 16:01:49 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-77f99c06-8523-4b70-82ec-c7f6b9614a41 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 16:01:49 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-77f99c06-8523-4b70-82ec-c7f6b9614a41 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.693s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:01:49 user nova-compute[75337]: DEBUG nova.compute.manager [None req-77f99c06-8523-4b70-82ec-c7f6b9614a41 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 85c56287-3140-4125-a316-0c652cc0f18a] Start building networks asynchronously for instance. {{(pid=75337) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 16:01:49 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:01:49 user nova-compute[75337]: DEBUG nova.compute.manager [None req-77f99c06-8523-4b70-82ec-c7f6b9614a41 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 85c56287-3140-4125-a316-0c652cc0f18a] Allocating IP information in the background. {{(pid=75337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 16:01:49 user nova-compute[75337]: DEBUG nova.network.neutron [None req-77f99c06-8523-4b70-82ec-c7f6b9614a41 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 85c56287-3140-4125-a316-0c652cc0f18a] allocate_for_instance() {{(pid=75337) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 16:01:49 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-77f99c06-8523-4b70-82ec-c7f6b9614a41 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 85c56287-3140-4125-a316-0c652cc0f18a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 16:01:49 user nova-compute[75337]: DEBUG nova.compute.manager [None req-77f99c06-8523-4b70-82ec-c7f6b9614a41 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 85c56287-3140-4125-a316-0c652cc0f18a] Start building block device mappings for instance. {{(pid=75337) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 16:01:49 user nova-compute[75337]: DEBUG nova.policy [None req-77f99c06-8523-4b70-82ec-c7f6b9614a41 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bb8d5f0200124588be1cfde107341a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915211c6a2734c36b34ff92a56b085f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75337) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 16:01:49 user nova-compute[75337]: INFO nova.virt.block_device [None req-77f99c06-8523-4b70-82ec-c7f6b9614a41 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 85c56287-3140-4125-a316-0c652cc0f18a] Booting with volume 15e7bca5-29b3-477d-9332-0fd23668f25c at /dev/vda
Nov 06 16:01:49 user nova-compute[75337]: DEBUG os_brick.utils [None req-77f99c06-8523-4b70-82ec-c7f6b9614a41 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 16:01:49 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:01:49 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:01:49 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[719bdec7-df8c-4b5b-9bfa-470a19556ee6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4ff6411e45b8\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:01:49 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:01:49 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:01:49 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9c36607-a1ad-4726-8cc8-e19203bda965]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:01:49 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:01:49 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:01:49 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[4456cff9-22cd-45c9-9a1c-7d465227b909]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:01:49 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[89e4db0b-d1d5-406b-8335-969082359e89]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:01:49 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-77f99c06-8523-4b70-82ec-c7f6b9614a41 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Running cmd (subprocess): nvme version {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:01:49 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-77f99c06-8523-4b70-82ec-c7f6b9614a41 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] 'nvme version' failed. Not Retrying. {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 16:01:49 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.nvmeof [None req-77f99c06-8523-4b70-82ec-c7f6b9614a41 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] nvme not present on system {{(pid=75337) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 16:01:49 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:01:49 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 16:01:49 user nova-compute[75337]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 16:01:49 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[7987390f-d1b7-4ad8-84b4-4417fd00c64a]: (4, '') {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:01:49 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.lightos [None req-77f99c06-8523-4b70-82ec-c7f6b9614a41 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75337) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 16:01:49 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.lightos [None req-77f99c06-8523-4b70-82ec-c7f6b9614a41 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 16:01:49 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.lightos [None req-77f99c06-8523-4b70-82ec-c7f6b9614a41 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] LIGHTOS: no hostnqn found. {{(pid=75337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 16:01:49 user nova-compute[75337]: DEBUG os_brick.utils [None req-77f99c06-8523-4b70-82ec-c7f6b9614a41 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4ff6411e45b8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 16:01:49 user nova-compute[75337]: DEBUG nova.virt.block_device [None req-77f99c06-8523-4b70-82ec-c7f6b9614a41 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 85c56287-3140-4125-a316-0c652cc0f18a] Updating existing volume attachment record: 195d62a4-70b4-436e-a27d-0ea8281492a0 {{(pid=75337) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 16:01:50 user nova-compute[75337]: DEBUG nova.network.neutron [None req-77f99c06-8523-4b70-82ec-c7f6b9614a41 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 85c56287-3140-4125-a316-0c652cc0f18a] Successfully created port: 51662fe4-0156-4111-8e0e-1c330f05d5e6 {{(pid=75337) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 16:01:51 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:01:51 user nova-compute[75337]: DEBUG nova.network.neutron [None req-77f99c06-8523-4b70-82ec-c7f6b9614a41 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 85c56287-3140-4125-a316-0c652cc0f18a] Successfully updated port: 51662fe4-0156-4111-8e0e-1c330f05d5e6 {{(pid=75337) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 16:01:51 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-77f99c06-8523-4b70-82ec-c7f6b9614a41 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Acquiring lock "refresh_cache-85c56287-3140-4125-a316-0c652cc0f18a" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 16:01:51 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-77f99c06-8523-4b70-82ec-c7f6b9614a41 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Acquired lock "refresh_cache-85c56287-3140-4125-a316-0c652cc0f18a" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 16:01:51 user nova-compute[75337]: DEBUG nova.network.neutron [None req-77f99c06-8523-4b70-82ec-c7f6b9614a41 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 85c56287-3140-4125-a316-0c652cc0f18a] Building network info cache for instance {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 16:01:51 user nova-compute[75337]: DEBUG nova.compute.manager [req-313737eb-5602-4842-87dd-42207cc2be3e req-c27909d9-8c1f-412c-8f86-581657666fe3 service nova] [instance: 85c56287-3140-4125-a316-0c652cc0f18a] Received event network-changed-51662fe4-0156-4111-8e0e-1c330f05d5e6 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:01:51 user nova-compute[75337]: DEBUG nova.compute.manager [req-313737eb-5602-4842-87dd-42207cc2be3e req-c27909d9-8c1f-412c-8f86-581657666fe3 service nova] [instance: 85c56287-3140-4125-a316-0c652cc0f18a] Refreshing instance network info cache due to event network-changed-51662fe4-0156-4111-8e0e-1c330f05d5e6. {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 16:01:51 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-313737eb-5602-4842-87dd-42207cc2be3e req-c27909d9-8c1f-412c-8f86-581657666fe3 service nova] Acquiring lock "refresh_cache-85c56287-3140-4125-a316-0c652cc0f18a" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 16:01:51 user nova-compute[75337]: DEBUG nova.network.neutron [None req-77f99c06-8523-4b70-82ec-c7f6b9614a41 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 85c56287-3140-4125-a316-0c652cc0f18a] Instance cache missing network info. {{(pid=75337) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 16:01:51 user nova-compute[75337]: DEBUG nova.network.neutron [None req-77f99c06-8523-4b70-82ec-c7f6b9614a41 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 85c56287-3140-4125-a316-0c652cc0f18a] Updating instance_info_cache with network_info: [{"id": "51662fe4-0156-4111-8e0e-1c330f05d5e6", "address": "fa:16:3e:76:55:28", "network": {"id": "4e47319f-de1d-4dfe-9915-7d2d5131704d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-895093240-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "915211c6a2734c36b34ff92a56b085f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51662fe4-01", "ovs_interfaceid": "51662fe4-0156-4111-8e0e-1c330f05d5e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 16:01:51 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-77f99c06-8523-4b70-82ec-c7f6b9614a41 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Releasing lock "refresh_cache-85c56287-3140-4125-a316-0c652cc0f18a" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 16:01:51 user nova-compute[75337]: DEBUG nova.compute.manager [None req-77f99c06-8523-4b70-82ec-c7f6b9614a41 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 85c56287-3140-4125-a316-0c652cc0f18a] Instance network_info: |[{"id": "51662fe4-0156-4111-8e0e-1c330f05d5e6", "address": "fa:16:3e:76:55:28", "network": {"id": "4e47319f-de1d-4dfe-9915-7d2d5131704d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-895093240-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "915211c6a2734c36b34ff92a56b085f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51662fe4-01", "ovs_interfaceid": "51662fe4-0156-4111-8e0e-1c330f05d5e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 16:01:51 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-313737eb-5602-4842-87dd-42207cc2be3e req-c27909d9-8c1f-412c-8f86-581657666fe3 service nova] Acquired lock "refresh_cache-85c56287-3140-4125-a316-0c652cc0f18a" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 16:01:51 user nova-compute[75337]: DEBUG nova.network.neutron [req-313737eb-5602-4842-87dd-42207cc2be3e req-c27909d9-8c1f-412c-8f86-581657666fe3 service nova] [instance: 85c56287-3140-4125-a316-0c652cc0f18a] Refreshing network info cache for port 51662fe4-0156-4111-8e0e-1c330f05d5e6 {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 16:01:52 user nova-compute[75337]: DEBUG nova.network.neutron [req-313737eb-5602-4842-87dd-42207cc2be3e req-c27909d9-8c1f-412c-8f86-581657666fe3 service nova] [instance: 85c56287-3140-4125-a316-0c652cc0f18a] Updated VIF entry in instance network info cache for port 51662fe4-0156-4111-8e0e-1c330f05d5e6. {{(pid=75337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 16:01:52 user nova-compute[75337]: DEBUG nova.network.neutron [req-313737eb-5602-4842-87dd-42207cc2be3e req-c27909d9-8c1f-412c-8f86-581657666fe3 service nova] [instance: 85c56287-3140-4125-a316-0c652cc0f18a] Updating instance_info_cache with network_info: [{"id": "51662fe4-0156-4111-8e0e-1c330f05d5e6", "address": "fa:16:3e:76:55:28", "network": {"id": "4e47319f-de1d-4dfe-9915-7d2d5131704d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-895093240-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "915211c6a2734c36b34ff92a56b085f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51662fe4-01", "ovs_interfaceid": "51662fe4-0156-4111-8e0e-1c330f05d5e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 16:01:52 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-313737eb-5602-4842-87dd-42207cc2be3e req-c27909d9-8c1f-412c-8f86-581657666fe3 service nova] Releasing lock "refresh_cache-85c56287-3140-4125-a316-0c652cc0f18a" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 16:01:54 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:01:54 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:01:56 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:01:59 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:02:01 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:02:02 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-4636565f-6e70-421e-bcac-eaf8d1815658 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance ba7d8a41-5a75-4dca-a192-0177119403be is timed out.
Nov 06 16:02:02 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-4636565f-6e70-421e-bcac-eaf8d1815658 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] Successfully detached device vdb from instance ba7d8a41-5a75-4dca-a192-0177119403be from the live domain config.
Nov 06 16:02:02 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4636565f-6e70-421e-bcac-eaf8d1815658 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] [instance: ba7d8a41-5a75-4dca-a192-0177119403be] calling os-brick to detach iSCSI Volume {{(pid=75337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 16:02:02 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-4636565f-6e70-421e-bcac-eaf8d1815658 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2abc33d0c0>, {'target_iqn': 'iqn.2010-10.org.openstack:45e66a2b-499f-46ca-90b5-2eeac6a5a8be', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UexatBkR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 16:02:02 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-4636565f-6e70-421e-bcac-eaf8d1815658 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 16:02:02 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-4636565f-6e70-421e-bcac-eaf8d1815658 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 16:02:02 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-4636565f-6e70-421e-bcac-eaf8d1815658 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 16:02:02 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:02:02 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:02:02 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[720c87fa-7b26-44fa-8445-f1c4fba0554d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:45e66a2b-499f-46ca-90b5-2eeac6a5a8be\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:02:02 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-4636565f-6e70-421e-bcac-eaf8d1815658 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 16:02:02 user nova-compute[75337]: No targets found.
Nov 06 16:02:02 user nova-compute[75337]: iSNS:
Nov 06 16:02:02 user nova-compute[75337]: No targets found.
Nov 06 16:02:02 user nova-compute[75337]: STATIC:
Nov 06 16:02:02 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:45e66a2b-499f-46ca-90b5-2eeac6a5a8be
Nov 06 16:02:02 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 16:02:02 user nova-compute[75337]:                 Iface Name: default
Nov 06 16:02:02 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673
Nov 06 16:02:02 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 16:02:02 user nova-compute[75337]:                 Iface Name: default
Nov 06 16:02:02 user nova-compute[75337]: FIRMWARE:
Nov 06 16:02:02 user nova-compute[75337]: No targets found.
Nov 06 16:02:02 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 16:02:02 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-4636565f-6e70-421e-bcac-eaf8d1815658 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 16:02:02 user nova-compute[75337]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 16:02:02 user nova-compute[75337]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75337) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 16:02:02 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-4636565f-6e70-421e-bcac-eaf8d1815658 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:45e66a2b-499f-46ca-90b5-2eeac6a5a8be', 0)] {{(pid=75337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 16:02:02 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:02:02 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:02:02 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[06477e58-8703-4400-9862-b40c97c103bd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45e66a2b-499f-46ca-90b5-2eeac6a5a8be\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:02:02 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:02:02 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:02:02 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[601c74c5-220e-4c37-93d8-8fcb55965835]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45e66a2b-499f-46ca-90b5-2eeac6a5a8be (non-flash)\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:02:02 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-4636565f-6e70-421e-bcac-eaf8d1815658 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673 (non-flash)
Nov 06 16:02:02 user nova-compute[75337]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45e66a2b-499f-46ca-90b5-2eeac6a5a8be (non-flash)
Nov 06 16:02:02 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 16:02:02 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-4636565f-6e70-421e-bcac-eaf8d1815658 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673 (non-flash)
Nov 06 16:02:02 user nova-compute[75337]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45e66a2b-499f-46ca-90b5-2eeac6a5a8be (non-flash)
Nov 06 16:02:02 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 16:02:02 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-4636565f-6e70-421e-bcac-eaf8d1815658 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2a9c3c8af0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:45e66a2b-499f-46ca-90b5-2eeac6a5a8be'): ({'sdf'}, set())}) {{(pid=75337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 16:02:02 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-4636565f-6e70-421e-bcac-eaf8d1815658 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] Removing single pathed devices sdf {{(pid=75337) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 16:02:02 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:02:02 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:02:02 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[11a12350-b715-4771-bfa5-fb7f26f1b8a2]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:02:02 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:02:02 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:02:02 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[1da70f10-4e3e-4a4b-b9ce-d61d2fa2a2fe]: (4, ('ok\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:02:02 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-4636565f-6e70-421e-bcac-eaf8d1815658 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] Flushing IO for device /dev/sdf {{(pid=75337) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 16:02:02 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:02:02 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:02:02 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[f05bbed9-aa5a-499f-a7c1-d26f4e056a17]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:02:02 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-4636565f-6e70-421e-bcac-eaf8d1815658 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75337) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 16:02:02 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:02:02 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.046s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:02:02 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bcb950b-2b52-4379-9981-eec07f9ea948]: (4, ('1', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:02:02 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-4636565f-6e70-421e-bcac-eaf8d1815658 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 16:02:02 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-4636565f-6e70-421e-bcac-eaf8d1815658 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] SCSI volumes sdf have been removed. {{(pid=75337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 16:02:02 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-4636565f-6e70-421e-bcac-eaf8d1815658 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:45e66a2b-499f-46ca-90b5-2eeac6a5a8be')] {{(pid=75337) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 16:02:02 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45e66a2b-499f-46ca-90b5-2eeac6a5a8be -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:02:02 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45e66a2b-499f-46ca-90b5-2eeac6a5a8be -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:02:02 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[99246c5e-13b2-496c-84b3-c91e7a9fb911]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:02:02 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-4636565f-6e70-421e-bcac-eaf8d1815658 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:02:02 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45e66a2b-499f-46ca-90b5-2eeac6a5a8be -p 172.16.0.220:3260 --logout {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:02:02 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45e66a2b-499f-46ca-90b5-2eeac6a5a8be -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:02:02 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[11111f05-44f8-48a8-84fa-c47230e88211]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:45e66a2b-499f-46ca-90b5-2eeac6a5a8be, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:45e66a2b-499f-46ca-90b5-2eeac6a5a8be, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:02:02 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-4636565f-6e70-421e-bcac-eaf8d1815658 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:45e66a2b-499f-46ca-90b5-2eeac6a5a8be, portal: 172.16.0.220,3260]
Nov 06 16:02:02 user nova-compute[75337]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:45e66a2b-499f-46ca-90b5-2eeac6a5a8be, portal: 172.16.0.220,3260] successful.
Nov 06 16:02:02 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:02:02 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45e66a2b-499f-46ca-90b5-2eeac6a5a8be -p 172.16.0.220:3260 --op delete {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:02:02 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45e66a2b-499f-46ca-90b5-2eeac6a5a8be -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:02:02 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[68853d4a-ec5a-4b3a-a412-a14e825c0068]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:02:02 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-4636565f-6e70-421e-bcac-eaf8d1815658 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:02:02 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-4636565f-6e70-421e-bcac-eaf8d1815658 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.303s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 16:02:02 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-4636565f-6e70-421e-bcac-eaf8d1815658 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] <== disconnect_volume: return (304ms) None {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 16:02:02 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4636565f-6e70-421e-bcac-eaf8d1815658 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] [instance: ba7d8a41-5a75-4dca-a192-0177119403be] Disconnected iSCSI Volume {{(pid=75337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 16:02:03 user nova-compute[75337]: DEBUG nova.objects.instance [None req-4636565f-6e70-421e-bcac-eaf8d1815658 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] Lazy-loading 'flavor' on Instance uuid ba7d8a41-5a75-4dca-a192-0177119403be {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 16:02:03 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-4636565f-6e70-421e-bcac-eaf8d1815658 tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] Lock "ba7d8a41-5a75-4dca-a192-0177119403be" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.820s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:02:06 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:02:10 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:02:10 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:02:10 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75337) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 16:02:10 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:02:10 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:02:11 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:02:11 user nova-compute[75337]: DEBUG nova.compute.manager [None req-77f99c06-8523-4b70-82ec-c7f6b9614a41 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 85c56287-3140-4125-a316-0c652cc0f18a] Start spawning the instance on the hypervisor. {{(pid=75337) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 16:02:11 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-77f99c06-8523-4b70-82ec-c7f6b9614a41 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 85c56287-3140-4125-a316-0c652cc0f18a] Creating instance directory {{(pid=75337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 16:02:11 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-77f99c06-8523-4b70-82ec-c7f6b9614a41 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 85c56287-3140-4125-a316-0c652cc0f18a] Creating image(s)
Nov 06 16:02:11 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-77f99c06-8523-4b70-82ec-c7f6b9614a41 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 85c56287-3140-4125-a316-0c652cc0f18a] Did not create local disks {{(pid=75337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 06 16:02:11 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-77f99c06-8523-4b70-82ec-c7f6b9614a41 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 85c56287-3140-4125-a316-0c652cc0f18a] Ensure instance console log exists: /opt/stack/data/nova/instances/85c56287-3140-4125-a316-0c652cc0f18a/console.log {{(pid=75337) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 16:02:11 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-77f99c06-8523-4b70-82ec-c7f6b9614a41 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:02:11 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-77f99c06-8523-4b70-82ec-c7f6b9614a41 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:02:11 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-77f99c06-8523-4b70-82ec-c7f6b9614a41 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:02:11 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-77f99c06-8523-4b70-82ec-c7f6b9614a41 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 85c56287-3140-4125-a316-0c652cc0f18a] Start _get_guest_xml network_info=[{"id": "51662fe4-0156-4111-8e0e-1c330f05d5e6", "address": "fa:16:3e:76:55:28", "network": {"id": "4e47319f-de1d-4dfe-9915-7d2d5131704d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-895093240-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "915211c6a2734c36b34ff92a56b085f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51662fe4-01", "ovs_interfaceid": "51662fe4-0156-4111-8e0e-1c330f05d5e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'attachment_id': '195d62a4-70b4-436e-a27d-0ea8281492a0', 'guest_format': None, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:15e7bca5-29b3-477d-9332-0fd23668f25c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RIJTXBxp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '85c56287-3140-4125-a316-0c652cc0f18a', 'attached_at': '', 'detached_at': '', 'volume_id': '15e7bca5-29b3-477d-9332-0fd23668f25c', 'serial': '15e7bca5-29b3-477d-9332-0fd23668f25c'}, 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=75337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 16:02:11 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-77f99c06-8523-4b70-82ec-c7f6b9614a41 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 16:02:11 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-77f99c06-8523-4b70-82ec-c7f6b9614a41 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 16:02:11 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-77f99c06-8523-4b70-82ec-c7f6b9614a41 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 16:02:11 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-77f99c06-8523-4b70-82ec-c7f6b9614a41 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] CPU controller missing on host. {{(pid=75337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 16:02:11 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-77f99c06-8523-4b70-82ec-c7f6b9614a41 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 16:02:11 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-77f99c06-8523-4b70-82ec-c7f6b9614a41 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] CPU controller found on host. {{(pid=75337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 16:02:11 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-77f99c06-8523-4b70-82ec-c7f6b9614a41 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75337) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 16:02:11 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-77f99c06-8523-4b70-82ec-c7f6b9614a41 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T15:34:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 16:02:11 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-77f99c06-8523-4b70-82ec-c7f6b9614a41 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Flavor limits 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 16:02:11 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-77f99c06-8523-4b70-82ec-c7f6b9614a41 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Image limits 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 16:02:11 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-77f99c06-8523-4b70-82ec-c7f6b9614a41 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Flavor pref 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 16:02:11 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-77f99c06-8523-4b70-82ec-c7f6b9614a41 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Image pref 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 16:02:11 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-77f99c06-8523-4b70-82ec-c7f6b9614a41 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 16:02:11 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-77f99c06-8523-4b70-82ec-c7f6b9614a41 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 16:02:11 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-77f99c06-8523-4b70-82ec-c7f6b9614a41 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 16:02:11 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-77f99c06-8523-4b70-82ec-c7f6b9614a41 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Got 1 possible topologies {{(pid=75337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 16:02:11 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-77f99c06-8523-4b70-82ec-c7f6b9614a41 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 16:02:11 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-77f99c06-8523-4b70-82ec-c7f6b9614a41 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 16:02:11 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-77f99c06-8523-4b70-82ec-c7f6b9614a41 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 85c56287-3140-4125-a316-0c652cc0f18a] Calling os-brick to attach iSCSI Volume {{(pid=75337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 16:02:11 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-77f99c06-8523-4b70-82ec-c7f6b9614a41 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2abc33d0c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:15e7bca5-29b3-477d-9332-0fd23668f25c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RIJTXBxp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 16:02:11 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-77f99c06-8523-4b70-82ec-c7f6b9614a41 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 16:02:11 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-77f99c06-8523-4b70-82ec-c7f6b9614a41 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 16:02:11 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-77f99c06-8523-4b70-82ec-c7f6b9614a41 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 16:02:11 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-77f99c06-8523-4b70-82ec-c7f6b9614a41 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 16:02:11 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-77f99c06-8523-4b70-82ec-c7f6b9614a41 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:15e7bca5-29b3-477d-9332-0fd23668f25c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 16:02:11 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-77f99c06-8523-4b70-82ec-c7f6b9614a41 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:15e7bca5-29b3-477d-9332-0fd23668f25c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 16:02:11 user nova-compute[75337]: INFO os_brick.initiator.connectors.iscsi [None req-77f99c06-8523-4b70-82ec-c7f6b9614a41 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 16:02:11 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15e7bca5-29b3-477d-9332-0fd23668f25c -p 172.16.0.220:3260 {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:02:11 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15e7bca5-29b3-477d-9332-0fd23668f25c -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:02:11 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[256e388e-250b-41d4-ae36-9fc8684f54ac]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:02:11 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-77f99c06-8523-4b70-82ec-c7f6b9614a41 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 16:02:11 user nova-compute[75337]:  {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:02:11 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15e7bca5-29b3-477d-9332-0fd23668f25c -p 172.16.0.220:3260 --interface default --op new {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:02:11 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15e7bca5-29b3-477d-9332-0fd23668f25c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:02:11 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[19a98666-47cc-4eab-9e86-0392ad99c25f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:15e7bca5-29b3-477d-9332-0fd23668f25c] added\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:02:11 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-77f99c06-8523-4b70-82ec-c7f6b9614a41 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:15e7bca5-29b3-477d-9332-0fd23668f25c] added
Nov 06 16:02:11 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:02:11 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15e7bca5-29b3-477d-9332-0fd23668f25c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:02:11 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15e7bca5-29b3-477d-9332-0fd23668f25c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:02:11 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4d2708b-d9e7-4017-817c-021c1583c867]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:02:11 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-77f99c06-8523-4b70-82ec-c7f6b9614a41 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:02:11 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15e7bca5-29b3-477d-9332-0fd23668f25c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:02:11 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15e7bca5-29b3-477d-9332-0fd23668f25c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:02:11 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e92cd24-5aa7-4cf4-b31f-4f3398ede9e6]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:02:11 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-77f99c06-8523-4b70-82ec-c7f6b9614a41 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:02:11 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15e7bca5-29b3-477d-9332-0fd23668f25c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RIJTXBxp {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:02:11 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15e7bca5-29b3-477d-9332-0fd23668f25c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RIJTXBxp" returned: 0 in 0.017s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:02:11 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[b79331ab-359b-4c42-a760-5f1d1bd89050]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:02:11 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-77f99c06-8523-4b70-82ec-c7f6b9614a41 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RIJTXBxp'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:02:11 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15e7bca5-29b3-477d-9332-0fd23668f25c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:02:11 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15e7bca5-29b3-477d-9332-0fd23668f25c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:02:11 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[123d3d04-d696-4f1f-bf29-398a091a1be4]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:02:11 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-77f99c06-8523-4b70-82ec-c7f6b9614a41 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:02:11 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:02:11 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:02:11 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[e22105f2-2ab4-4693-a2db-d4b59e1af173]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673 (non-flash)\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:02:11 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-77f99c06-8523-4b70-82ec-c7f6b9614a41 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673 (non-flash)
Nov 06 16:02:11 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 16:02:11 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-77f99c06-8523-4b70-82ec-c7f6b9614a41 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673 (non-flash)
Nov 06 16:02:11 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 16:02:11 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15e7bca5-29b3-477d-9332-0fd23668f25c -p 172.16.0.220:3260 --login {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:02:11 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15e7bca5-29b3-477d-9332-0fd23668f25c -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:02:11 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[9517d373-1627-404c-be7b-2573c0112d6f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:15e7bca5-29b3-477d-9332-0fd23668f25c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:15e7bca5-29b3-477d-9332-0fd23668f25c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:02:11 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-77f99c06-8523-4b70-82ec-c7f6b9614a41 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:15e7bca5-29b3-477d-9332-0fd23668f25c, portal: 172.16.0.220,3260]
Nov 06 16:02:11 user nova-compute[75337]: Login to [iface: default, target: iqn.2010-10.org.openstack:15e7bca5-29b3-477d-9332-0fd23668f25c, portal: 172.16.0.220,3260] successful.
Nov 06 16:02:11 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:02:11 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15e7bca5-29b3-477d-9332-0fd23668f25c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:02:11 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15e7bca5-29b3-477d-9332-0fd23668f25c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:02:11 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a131c76-a3c9-4b96-be67-8583d9df3b5d]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:02:11 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-77f99c06-8523-4b70-82ec-c7f6b9614a41 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:02:11 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:02:11 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:02:11 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[d105220a-de62-46c7-b782-779ea1e7027a]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15e7bca5-29b3-477d-9332-0fd23668f25c (non-flash)\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:02:11 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-77f99c06-8523-4b70-82ec-c7f6b9614a41 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673 (non-flash)
Nov 06 16:02:11 user nova-compute[75337]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15e7bca5-29b3-477d-9332-0fd23668f25c (non-flash)
Nov 06 16:02:11 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 16:02:11 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-77f99c06-8523-4b70-82ec-c7f6b9614a41 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673 (non-flash)
Nov 06 16:02:11 user nova-compute[75337]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15e7bca5-29b3-477d-9332-0fd23668f25c (non-flash)
Nov 06 16:02:11 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 16:02:11 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-77f99c06-8523-4b70-82ec-c7f6b9614a41 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:15e7bca5-29b3-477d-9332-0fd23668f25c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.276s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 16:02:11 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-77f99c06-8523-4b70-82ec-c7f6b9614a41 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Connected to 172.16.0.220:3260 {{(pid=75337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 16:02:11 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-77f99c06-8523-4b70-82ec-c7f6b9614a41 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] HCTL ('34', '-', '-', 0) found on session 44 with lun 0 {{(pid=75337) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 16:02:11 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-77f99c06-8523-4b70-82ec-c7f6b9614a41 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75337) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 16:02:11 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:02:11 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:02:11 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[93bbeb15-907b-42bf-9014-91428a4e4bd1]: (4, ('- - 0', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:02:11 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-77f99c06-8523-4b70-82ec-c7f6b9614a41 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Searching for a device in session 44 and hctl ['34', '*', '*', 0] yield: None {{(pid=75337) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 16:02:12 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:02:12 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-77f99c06-8523-4b70-82ec-c7f6b9614a41 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Searching for a device in session 44 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75337) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 16:02:12 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-77f99c06-8523-4b70-82ec-c7f6b9614a41 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:15e7bca5-29b3-477d-9332-0fd23668f25c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RIJTXBxp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 16:02:12 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-77f99c06-8523-4b70-82ec-c7f6b9614a41 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.307s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 16:02:12 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-77f99c06-8523-4b70-82ec-c7f6b9614a41 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] <== connect_volume: return (1308ms) {'type': 'block', 'scsi_wwn': '26236363439326565', 'path': '/dev/sdc'} {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 16:02:12 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-77f99c06-8523-4b70-82ec-c7f6b9614a41 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 85c56287-3140-4125-a316-0c652cc0f18a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26236363439326565', 'path': '/dev/sdc'} {{(pid=75337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 16:02:13 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-77f99c06-8523-4b70-82ec-c7f6b9614a41 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T16:01:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1438138758',display_name='tempest-TestVolumeBootPattern-server-1438138758',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1438138758',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGSEIi3g934sMLPVz4vXQXFZs0uPpfou1A8cQ+7f5EeoH+XvyrzPDAqzu7FTAOU7yXRJ8IemF+WnLjTlXTwpg+PX5Yor65g2g46SgdNmwrUcBQAy+H25S13pZzToJUCwGA==',key_name='tempest-TestVolumeBootPattern-1419808121',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='915211c6a2734c36b34ff92a56b085f6',ramdisk_id='',reservation_id='r-uimne3fm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1055092640',owner_user_name='tempest-TestVolumeBootPattern-1055092640-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T16:01:50Z,user_data=None,user_id='bb8d5f0200124588be1cfde107341a45',uuid=85c56287-3140-4125-a316-0c652cc0f18a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "51662fe4-0156-4111-8e0e-1c330f05d5e6", "address": "fa:16:3e:76:55:28", "network": {"id": "4e47319f-de1d-4dfe-9915-7d2d5131704d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-895093240-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "915211c6a2734c36b34ff92a56b085f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51662fe4-01", "ovs_interfaceid": "51662fe4-0156-4111-8e0e-1c330f05d5e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75337) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 16:02:13 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-77f99c06-8523-4b70-82ec-c7f6b9614a41 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Converting VIF {"id": "51662fe4-0156-4111-8e0e-1c330f05d5e6", "address": "fa:16:3e:76:55:28", "network": {"id": "4e47319f-de1d-4dfe-9915-7d2d5131704d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-895093240-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "915211c6a2734c36b34ff92a56b085f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51662fe4-01", "ovs_interfaceid": "51662fe4-0156-4111-8e0e-1c330f05d5e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 16:02:13 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-77f99c06-8523-4b70-82ec-c7f6b9614a41 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:55:28,bridge_name='br-int',has_traffic_filtering=True,id=51662fe4-0156-4111-8e0e-1c330f05d5e6,network=Network(4e47319f-de1d-4dfe-9915-7d2d5131704d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51662fe4-01') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 16:02:13 user nova-compute[75337]: DEBUG nova.objects.instance [None req-77f99c06-8523-4b70-82ec-c7f6b9614a41 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Lazy-loading 'pci_devices' on Instance uuid 85c56287-3140-4125-a316-0c652cc0f18a {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 16:02:13 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-77f99c06-8523-4b70-82ec-c7f6b9614a41 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 85c56287-3140-4125-a316-0c652cc0f18a] End _get_guest_xml xml=<domain type="kvm">
Nov 06 16:02:13 user nova-compute[75337]:   <uuid>85c56287-3140-4125-a316-0c652cc0f18a</uuid>
Nov 06 16:02:13 user nova-compute[75337]:   <name>instance-00000028</name>
Nov 06 16:02:13 user nova-compute[75337]:   <memory>524288</memory>
Nov 06 16:02:13 user nova-compute[75337]:   <vcpu>1</vcpu>
Nov 06 16:02:13 user nova-compute[75337]:   <metadata>
Nov 06 16:02:13 user nova-compute[75337]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 16:02:13 user nova-compute[75337]:       <nova:package version="0.0.0"/>
Nov 06 16:02:13 user nova-compute[75337]:       <nova:name>tempest-TestVolumeBootPattern-server-1438138758</nova:name>
Nov 06 16:02:13 user nova-compute[75337]:       <nova:creationTime>2023-11-06 16:02:11</nova:creationTime>
Nov 06 16:02:13 user nova-compute[75337]:       <nova:flavor name="m1.tiny">
Nov 06 16:02:13 user nova-compute[75337]:         <nova:memory>512</nova:memory>
Nov 06 16:02:13 user nova-compute[75337]:         <nova:disk>1</nova:disk>
Nov 06 16:02:13 user nova-compute[75337]:         <nova:swap>0</nova:swap>
Nov 06 16:02:13 user nova-compute[75337]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 16:02:13 user nova-compute[75337]:         <nova:vcpus>1</nova:vcpus>
Nov 06 16:02:13 user nova-compute[75337]:       </nova:flavor>
Nov 06 16:02:13 user nova-compute[75337]:       <nova:owner>
Nov 06 16:02:13 user nova-compute[75337]:         <nova:user uuid="bb8d5f0200124588be1cfde107341a45">tempest-TestVolumeBootPattern-1055092640-project-member</nova:user>
Nov 06 16:02:13 user nova-compute[75337]:         <nova:project uuid="915211c6a2734c36b34ff92a56b085f6">tempest-TestVolumeBootPattern-1055092640</nova:project>
Nov 06 16:02:13 user nova-compute[75337]:       </nova:owner>
Nov 06 16:02:13 user nova-compute[75337]:       <nova:ports>
Nov 06 16:02:13 user nova-compute[75337]:         <nova:port uuid="51662fe4-0156-4111-8e0e-1c330f05d5e6">
Nov 06 16:02:13 user nova-compute[75337]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 06 16:02:13 user nova-compute[75337]:         </nova:port>
Nov 06 16:02:13 user nova-compute[75337]:       </nova:ports>
Nov 06 16:02:13 user nova-compute[75337]:     </nova:instance>
Nov 06 16:02:13 user nova-compute[75337]:   </metadata>
Nov 06 16:02:13 user nova-compute[75337]:   <sysinfo type="smbios">
Nov 06 16:02:13 user nova-compute[75337]:     <system>
Nov 06 16:02:13 user nova-compute[75337]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 16:02:13 user nova-compute[75337]:       <entry name="product">OpenStack Nova</entry>
Nov 06 16:02:13 user nova-compute[75337]:       <entry name="version">0.0.0</entry>
Nov 06 16:02:13 user nova-compute[75337]:       <entry name="serial">85c56287-3140-4125-a316-0c652cc0f18a</entry>
Nov 06 16:02:13 user nova-compute[75337]:       <entry name="uuid">85c56287-3140-4125-a316-0c652cc0f18a</entry>
Nov 06 16:02:13 user nova-compute[75337]:       <entry name="family">Virtual Machine</entry>
Nov 06 16:02:13 user nova-compute[75337]:     </system>
Nov 06 16:02:13 user nova-compute[75337]:   </sysinfo>
Nov 06 16:02:13 user nova-compute[75337]:   <os>
Nov 06 16:02:13 user nova-compute[75337]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 16:02:13 user nova-compute[75337]:     <boot dev="hd"/>
Nov 06 16:02:13 user nova-compute[75337]:     <smbios mode="sysinfo"/>
Nov 06 16:02:13 user nova-compute[75337]:   </os>
Nov 06 16:02:13 user nova-compute[75337]:   <features>
Nov 06 16:02:13 user nova-compute[75337]:     <acpi/>
Nov 06 16:02:13 user nova-compute[75337]:     <apic/>
Nov 06 16:02:13 user nova-compute[75337]:     <vmcoreinfo/>
Nov 06 16:02:13 user nova-compute[75337]:   </features>
Nov 06 16:02:13 user nova-compute[75337]:   <clock offset="utc">
Nov 06 16:02:13 user nova-compute[75337]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 16:02:13 user nova-compute[75337]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 16:02:13 user nova-compute[75337]:     <timer name="hpet" present="no"/>
Nov 06 16:02:13 user nova-compute[75337]:   </clock>
Nov 06 16:02:13 user nova-compute[75337]:   <cpu mode="custom" match="exact">
Nov 06 16:02:13 user nova-compute[75337]:     <model>Nehalem</model>
Nov 06 16:02:13 user nova-compute[75337]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 16:02:13 user nova-compute[75337]:   </cpu>
Nov 06 16:02:13 user nova-compute[75337]:   <devices>
Nov 06 16:02:13 user nova-compute[75337]:     <disk type="block" device="disk">
Nov 06 16:02:13 user nova-compute[75337]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 16:02:13 user nova-compute[75337]:       <source dev="/dev/sdc"/>
Nov 06 16:02:13 user nova-compute[75337]:       <target dev="vda" bus="virtio"/>
Nov 06 16:02:13 user nova-compute[75337]:       <serial>15e7bca5-29b3-477d-9332-0fd23668f25c</serial>
Nov 06 16:02:13 user nova-compute[75337]:     </disk>
Nov 06 16:02:13 user nova-compute[75337]:     <interface type="ethernet">
Nov 06 16:02:13 user nova-compute[75337]:       <mac address="fa:16:3e:76:55:28"/>
Nov 06 16:02:13 user nova-compute[75337]:       <model type="virtio"/>
Nov 06 16:02:13 user nova-compute[75337]:       <mtu size="1442"/>
Nov 06 16:02:13 user nova-compute[75337]:       <target dev="tap51662fe4-01"/>
Nov 06 16:02:13 user nova-compute[75337]:     </interface>
Nov 06 16:02:13 user nova-compute[75337]:     <serial type="pty">
Nov 06 16:02:13 user nova-compute[75337]:       <log file="/opt/stack/data/nova/instances/85c56287-3140-4125-a316-0c652cc0f18a/console.log" append="off"/>
Nov 06 16:02:13 user nova-compute[75337]:     </serial>
Nov 06 16:02:13 user nova-compute[75337]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 16:02:13 user nova-compute[75337]:     <video>
Nov 06 16:02:13 user nova-compute[75337]:       <model type="virtio"/>
Nov 06 16:02:13 user nova-compute[75337]:     </video>
Nov 06 16:02:13 user nova-compute[75337]:     <rng model="virtio">
Nov 06 16:02:13 user nova-compute[75337]:       <backend model="random">/dev/urandom</backend>
Nov 06 16:02:13 user nova-compute[75337]:     </rng>
Nov 06 16:02:13 user nova-compute[75337]:     <controller type="usb" index="0" model="none"/>
Nov 06 16:02:13 user nova-compute[75337]:     <memballoon model="virtio">
Nov 06 16:02:13 user nova-compute[75337]:       <stats period="10"/>
Nov 06 16:02:13 user nova-compute[75337]:     </memballoon>
Nov 06 16:02:13 user nova-compute[75337]:   </devices>
Nov 06 16:02:13 user nova-compute[75337]: </domain>
Nov 06 16:02:13 user nova-compute[75337]:  {{(pid=75337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 16:02:13 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-77f99c06-8523-4b70-82ec-c7f6b9614a41 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T16:01:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1438138758',display_name='tempest-TestVolumeBootPattern-server-1438138758',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1438138758',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGSEIi3g934sMLPVz4vXQXFZs0uPpfou1A8cQ+7f5EeoH+XvyrzPDAqzu7FTAOU7yXRJ8IemF+WnLjTlXTwpg+PX5Yor65g2g46SgdNmwrUcBQAy+H25S13pZzToJUCwGA==',key_name='tempest-TestVolumeBootPattern-1419808121',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='915211c6a2734c36b34ff92a56b085f6',ramdisk_id='',reservation_id='r-uimne3fm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1055092640',owner_user_name='tempest-TestVolumeBootPattern-1055092640-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T16:01:50Z,user_data=None,user_id='bb8d5f0200124588be1cfde107341a45',uuid=85c56287-3140-4125-a316-0c652cc0f18a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "51662fe4-0156-4111-8e0e-1c330f05d5e6", "address": "fa:16:3e:76:55:28", "network": {"id": "4e47319f-de1d-4dfe-9915-7d2d5131704d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-895093240-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "915211c6a2734c36b34ff92a56b085f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51662fe4-01", "ovs_interfaceid": "51662fe4-0156-4111-8e0e-1c330f05d5e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 16:02:13 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-77f99c06-8523-4b70-82ec-c7f6b9614a41 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Converting VIF {"id": "51662fe4-0156-4111-8e0e-1c330f05d5e6", "address": "fa:16:3e:76:55:28", "network": {"id": "4e47319f-de1d-4dfe-9915-7d2d5131704d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-895093240-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "915211c6a2734c36b34ff92a56b085f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51662fe4-01", "ovs_interfaceid": "51662fe4-0156-4111-8e0e-1c330f05d5e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 16:02:13 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-77f99c06-8523-4b70-82ec-c7f6b9614a41 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:55:28,bridge_name='br-int',has_traffic_filtering=True,id=51662fe4-0156-4111-8e0e-1c330f05d5e6,network=Network(4e47319f-de1d-4dfe-9915-7d2d5131704d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51662fe4-01') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 16:02:13 user nova-compute[75337]: DEBUG os_vif [None req-77f99c06-8523-4b70-82ec-c7f6b9614a41 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:55:28,bridge_name='br-int',has_traffic_filtering=True,id=51662fe4-0156-4111-8e0e-1c330f05d5e6,network=Network(4e47319f-de1d-4dfe-9915-7d2d5131704d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51662fe4-01') {{(pid=75337) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 16:02:13 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:02:13 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 16:02:13 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 16:02:13 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:02:13 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '61e83319-fa0e-57e3-a1a9-3196037e46a2', '_type': 'linux-noop'}}, row=False) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 16:02:13 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:02:13 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:02:13 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:02:13 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:02:13 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap51662fe4-01, may_exist=True, interface_attrs={}) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 16:02:13 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap51662fe4-01, col_values=(('qos', UUID('404111e0-f1e1-4e15-8c5d-89eec04cb7b4')),), if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 16:02:13 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap51662fe4-01, col_values=(('external_ids', {'iface-id': '51662fe4-0156-4111-8e0e-1c330f05d5e6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:76:55:28', 'vm-uuid': '85c56287-3140-4125-a316-0c652cc0f18a'}),), if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 16:02:13 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:02:13 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:02:13 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:02:13 user nova-compute[75337]: INFO os_vif [None req-77f99c06-8523-4b70-82ec-c7f6b9614a41 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:55:28,bridge_name='br-int',has_traffic_filtering=True,id=51662fe4-0156-4111-8e0e-1c330f05d5e6,network=Network(4e47319f-de1d-4dfe-9915-7d2d5131704d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51662fe4-01')
Nov 06 16:02:13 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-77f99c06-8523-4b70-82ec-c7f6b9614a41 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] No BDM found with device name vda, not building metadata. {{(pid=75337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 16:02:13 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-77f99c06-8523-4b70-82ec-c7f6b9614a41 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] No VIF found with MAC fa:16:3e:76:55:28, not building metadata {{(pid=75337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 16:02:13 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:02:14 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:02:14 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:02:14 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:02:14 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-f3b4af83-145f-468c-b06e-7ea65091a93c tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Acquiring lock "ba20919c-b506-458e-ac17-70bcb8900bb7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:02:14 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-f3b4af83-145f-468c-b06e-7ea65091a93c tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Lock "ba20919c-b506-458e-ac17-70bcb8900bb7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:02:14 user nova-compute[75337]: DEBUG nova.compute.manager [None req-f3b4af83-145f-468c-b06e-7ea65091a93c tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] [instance: ba20919c-b506-458e-ac17-70bcb8900bb7] Starting instance... {{(pid=75337) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 16:02:14 user nova-compute[75337]: DEBUG nova.compute.manager [req-77fe37d1-e541-4970-b085-ee3f48b43a4d req-03e279f4-c61d-455e-a405-45cc63f5ae98 service nova] [instance: 85c56287-3140-4125-a316-0c652cc0f18a] Received event network-vif-plugged-51662fe4-0156-4111-8e0e-1c330f05d5e6 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:02:14 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-77fe37d1-e541-4970-b085-ee3f48b43a4d req-03e279f4-c61d-455e-a405-45cc63f5ae98 service nova] Acquiring lock "85c56287-3140-4125-a316-0c652cc0f18a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:02:14 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-77fe37d1-e541-4970-b085-ee3f48b43a4d req-03e279f4-c61d-455e-a405-45cc63f5ae98 service nova] Lock "85c56287-3140-4125-a316-0c652cc0f18a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:02:14 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-77fe37d1-e541-4970-b085-ee3f48b43a4d req-03e279f4-c61d-455e-a405-45cc63f5ae98 service nova] Lock "85c56287-3140-4125-a316-0c652cc0f18a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:02:14 user nova-compute[75337]: DEBUG nova.compute.manager [req-77fe37d1-e541-4970-b085-ee3f48b43a4d req-03e279f4-c61d-455e-a405-45cc63f5ae98 service nova] [instance: 85c56287-3140-4125-a316-0c652cc0f18a] No waiting events found dispatching network-vif-plugged-51662fe4-0156-4111-8e0e-1c330f05d5e6 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 16:02:14 user nova-compute[75337]: WARNING nova.compute.manager [req-77fe37d1-e541-4970-b085-ee3f48b43a4d req-03e279f4-c61d-455e-a405-45cc63f5ae98 service nova] [instance: 85c56287-3140-4125-a316-0c652cc0f18a] Received unexpected event network-vif-plugged-51662fe4-0156-4111-8e0e-1c330f05d5e6 for instance with vm_state building and task_state spawning.
Nov 06 16:02:14 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-f3b4af83-145f-468c-b06e-7ea65091a93c tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:02:14 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-f3b4af83-145f-468c-b06e-7ea65091a93c tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:02:14 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-f3b4af83-145f-468c-b06e-7ea65091a93c tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75337) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 16:02:14 user nova-compute[75337]: INFO nova.compute.claims [None req-f3b4af83-145f-468c-b06e-7ea65091a93c tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] [instance: ba20919c-b506-458e-ac17-70bcb8900bb7] Claim successful on node user
Nov 06 16:02:14 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:02:14 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:02:15 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-f3b4af83-145f-468c-b06e-7ea65091a93c tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 16:02:15 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-f3b4af83-145f-468c-b06e-7ea65091a93c tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 16:02:15 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-f3b4af83-145f-468c-b06e-7ea65091a93c tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.424s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:02:15 user nova-compute[75337]: DEBUG nova.compute.manager [None req-f3b4af83-145f-468c-b06e-7ea65091a93c tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] [instance: ba20919c-b506-458e-ac17-70bcb8900bb7] Start building networks asynchronously for instance. {{(pid=75337) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 16:02:15 user nova-compute[75337]: DEBUG nova.compute.manager [None req-f3b4af83-145f-468c-b06e-7ea65091a93c tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] [instance: ba20919c-b506-458e-ac17-70bcb8900bb7] Allocating IP information in the background. {{(pid=75337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 16:02:15 user nova-compute[75337]: DEBUG nova.network.neutron [None req-f3b4af83-145f-468c-b06e-7ea65091a93c tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] [instance: ba20919c-b506-458e-ac17-70bcb8900bb7] allocate_for_instance() {{(pid=75337) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 16:02:15 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-f3b4af83-145f-468c-b06e-7ea65091a93c tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] [instance: ba20919c-b506-458e-ac17-70bcb8900bb7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 16:02:15 user nova-compute[75337]: DEBUG nova.compute.manager [None req-f3b4af83-145f-468c-b06e-7ea65091a93c tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] [instance: ba20919c-b506-458e-ac17-70bcb8900bb7] Start building block device mappings for instance. {{(pid=75337) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 16:02:15 user nova-compute[75337]: DEBUG nova.policy [None req-f3b4af83-145f-468c-b06e-7ea65091a93c tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5b2c5ab3c4244bca99bcc3b143c46ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398008f06ed645099ae8be04ac48a3ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75337) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 16:02:15 user nova-compute[75337]: DEBUG nova.compute.manager [None req-f3b4af83-145f-468c-b06e-7ea65091a93c tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] [instance: ba20919c-b506-458e-ac17-70bcb8900bb7] Start spawning the instance on the hypervisor. {{(pid=75337) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 16:02:15 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-f3b4af83-145f-468c-b06e-7ea65091a93c tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] [instance: ba20919c-b506-458e-ac17-70bcb8900bb7] Creating instance directory {{(pid=75337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 16:02:15 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-f3b4af83-145f-468c-b06e-7ea65091a93c tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] [instance: ba20919c-b506-458e-ac17-70bcb8900bb7] Creating image(s)
Nov 06 16:02:15 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-f3b4af83-145f-468c-b06e-7ea65091a93c tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Acquiring lock "/opt/stack/data/nova/instances/ba20919c-b506-458e-ac17-70bcb8900bb7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:02:15 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-f3b4af83-145f-468c-b06e-7ea65091a93c tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Lock "/opt/stack/data/nova/instances/ba20919c-b506-458e-ac17-70bcb8900bb7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:02:15 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-f3b4af83-145f-468c-b06e-7ea65091a93c tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Lock "/opt/stack/data/nova/instances/ba20919c-b506-458e-ac17-70bcb8900bb7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:02:15 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-f3b4af83-145f-468c-b06e-7ea65091a93c tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:02:15 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-f3b4af83-145f-468c-b06e-7ea65091a93c tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json" returned: 0 in 0.187s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:02:15 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-f3b4af83-145f-468c-b06e-7ea65091a93c tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Acquiring lock "06ba3c914798499e686c5ac75886932347225275" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:02:15 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-f3b4af83-145f-468c-b06e-7ea65091a93c tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Lock "06ba3c914798499e686c5ac75886932347225275" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:02:15 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-f3b4af83-145f-468c-b06e-7ea65091a93c tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:02:15 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:02:15 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-f3b4af83-145f-468c-b06e-7ea65091a93c tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json" returned: 0 in 0.170s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:02:15 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-f3b4af83-145f-468c-b06e-7ea65091a93c tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275,backing_fmt=raw /opt/stack/data/nova/instances/ba20919c-b506-458e-ac17-70bcb8900bb7/disk 1073741824 {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:02:15 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-f3b4af83-145f-468c-b06e-7ea65091a93c tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275,backing_fmt=raw /opt/stack/data/nova/instances/ba20919c-b506-458e-ac17-70bcb8900bb7/disk 1073741824" returned: 0 in 0.062s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:02:15 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-f3b4af83-145f-468c-b06e-7ea65091a93c tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Lock "06ba3c914798499e686c5ac75886932347225275" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:02:15 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-f3b4af83-145f-468c-b06e-7ea65091a93c tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:02:15 user nova-compute[75337]: DEBUG nova.network.neutron [None req-f3b4af83-145f-468c-b06e-7ea65091a93c tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] [instance: ba20919c-b506-458e-ac17-70bcb8900bb7] Successfully created port: 18a22e63-f67e-4843-8d5c-97e4f4d7eb31 {{(pid=75337) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 16:02:15 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-f3b4af83-145f-468c-b06e-7ea65091a93c tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json" returned: 0 in 0.198s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:02:15 user nova-compute[75337]: DEBUG nova.virt.disk.api [None req-f3b4af83-145f-468c-b06e-7ea65091a93c tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ba20919c-b506-458e-ac17-70bcb8900bb7/disk. size=1073741824 {{(pid=75337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 16:02:15 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-f3b4af83-145f-468c-b06e-7ea65091a93c tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba20919c-b506-458e-ac17-70bcb8900bb7/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:02:16 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-f3b4af83-145f-468c-b06e-7ea65091a93c tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba20919c-b506-458e-ac17-70bcb8900bb7/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:02:16 user nova-compute[75337]: DEBUG nova.virt.disk.api [None req-f3b4af83-145f-468c-b06e-7ea65091a93c tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Cannot resize image /opt/stack/data/nova/instances/ba20919c-b506-458e-ac17-70bcb8900bb7/disk to a smaller size. {{(pid=75337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 06 16:02:16 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-f3b4af83-145f-468c-b06e-7ea65091a93c tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] [instance: ba20919c-b506-458e-ac17-70bcb8900bb7] Created local disks {{(pid=75337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 16:02:16 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-f3b4af83-145f-468c-b06e-7ea65091a93c tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] [instance: ba20919c-b506-458e-ac17-70bcb8900bb7] Ensure instance console log exists: /opt/stack/data/nova/instances/ba20919c-b506-458e-ac17-70bcb8900bb7/console.log {{(pid=75337) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 16:02:16 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-f3b4af83-145f-468c-b06e-7ea65091a93c tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:02:16 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-f3b4af83-145f-468c-b06e-7ea65091a93c tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:02:16 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-f3b4af83-145f-468c-b06e-7ea65091a93c tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:02:16 user nova-compute[75337]: DEBUG nova.network.neutron [None req-f3b4af83-145f-468c-b06e-7ea65091a93c tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] [instance: ba20919c-b506-458e-ac17-70bcb8900bb7] Successfully updated port: 18a22e63-f67e-4843-8d5c-97e4f4d7eb31 {{(pid=75337) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 16:02:16 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-f3b4af83-145f-468c-b06e-7ea65091a93c tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Acquiring lock "refresh_cache-ba20919c-b506-458e-ac17-70bcb8900bb7" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 16:02:16 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-f3b4af83-145f-468c-b06e-7ea65091a93c tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Acquired lock "refresh_cache-ba20919c-b506-458e-ac17-70bcb8900bb7" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 16:02:16 user nova-compute[75337]: DEBUG nova.network.neutron [None req-f3b4af83-145f-468c-b06e-7ea65091a93c tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] [instance: ba20919c-b506-458e-ac17-70bcb8900bb7] Building network info cache for instance {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 16:02:16 user nova-compute[75337]: DEBUG nova.compute.manager [req-27e7023b-3ffc-4801-9a2f-a663fc806ee9 req-08045549-c6e1-4807-be2f-f7c3fa5ff301 service nova] [instance: ba20919c-b506-458e-ac17-70bcb8900bb7] Received event network-changed-18a22e63-f67e-4843-8d5c-97e4f4d7eb31 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:02:16 user nova-compute[75337]: DEBUG nova.compute.manager [req-27e7023b-3ffc-4801-9a2f-a663fc806ee9 req-08045549-c6e1-4807-be2f-f7c3fa5ff301 service nova] [instance: ba20919c-b506-458e-ac17-70bcb8900bb7] Refreshing instance network info cache due to event network-changed-18a22e63-f67e-4843-8d5c-97e4f4d7eb31. {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 16:02:16 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-27e7023b-3ffc-4801-9a2f-a663fc806ee9 req-08045549-c6e1-4807-be2f-f7c3fa5ff301 service nova] Acquiring lock "refresh_cache-ba20919c-b506-458e-ac17-70bcb8900bb7" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 16:02:16 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:02:16 user nova-compute[75337]: DEBUG nova.network.neutron [None req-f3b4af83-145f-468c-b06e-7ea65091a93c tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] [instance: ba20919c-b506-458e-ac17-70bcb8900bb7] Instance cache missing network info. {{(pid=75337) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 16:02:16 user nova-compute[75337]: DEBUG nova.compute.manager [None req-77f99c06-8523-4b70-82ec-c7f6b9614a41 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 85c56287-3140-4125-a316-0c652cc0f18a] Instance event wait completed in 0 seconds for  {{(pid=75337) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 16:02:16 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-77f99c06-8523-4b70-82ec-c7f6b9614a41 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 85c56287-3140-4125-a316-0c652cc0f18a] Guest created on hypervisor {{(pid=75337) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 16:02:16 user nova-compute[75337]: INFO nova.virt.libvirt.driver [-] [instance: 85c56287-3140-4125-a316-0c652cc0f18a] Instance spawned successfully.
Nov 06 16:02:16 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-77f99c06-8523-4b70-82ec-c7f6b9614a41 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 85c56287-3140-4125-a316-0c652cc0f18a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 16:02:16 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-77f99c06-8523-4b70-82ec-c7f6b9614a41 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 85c56287-3140-4125-a316-0c652cc0f18a] Found default for hw_cdrom_bus of ide {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 16:02:16 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-77f99c06-8523-4b70-82ec-c7f6b9614a41 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 85c56287-3140-4125-a316-0c652cc0f18a] Found default for hw_disk_bus of virtio {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 16:02:16 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-77f99c06-8523-4b70-82ec-c7f6b9614a41 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 85c56287-3140-4125-a316-0c652cc0f18a] Found default for hw_input_bus of None {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 16:02:16 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-77f99c06-8523-4b70-82ec-c7f6b9614a41 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 85c56287-3140-4125-a316-0c652cc0f18a] Found default for hw_pointer_model of None {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 16:02:16 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-77f99c06-8523-4b70-82ec-c7f6b9614a41 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 85c56287-3140-4125-a316-0c652cc0f18a] Found default for hw_video_model of virtio {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 16:02:16 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-77f99c06-8523-4b70-82ec-c7f6b9614a41 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 85c56287-3140-4125-a316-0c652cc0f18a] Found default for hw_vif_model of virtio {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 16:02:16 user nova-compute[75337]: DEBUG nova.compute.manager [req-e9c91125-7b96-43c6-9037-eec1a78bc79a req-de3b971f-c29e-480f-b78f-ce87bf55efe6 service nova] [instance: 85c56287-3140-4125-a316-0c652cc0f18a] Received event network-vif-plugged-51662fe4-0156-4111-8e0e-1c330f05d5e6 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:02:16 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-e9c91125-7b96-43c6-9037-eec1a78bc79a req-de3b971f-c29e-480f-b78f-ce87bf55efe6 service nova] Acquiring lock "85c56287-3140-4125-a316-0c652cc0f18a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:02:16 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-e9c91125-7b96-43c6-9037-eec1a78bc79a req-de3b971f-c29e-480f-b78f-ce87bf55efe6 service nova] Lock "85c56287-3140-4125-a316-0c652cc0f18a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:02:16 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-e9c91125-7b96-43c6-9037-eec1a78bc79a req-de3b971f-c29e-480f-b78f-ce87bf55efe6 service nova] Lock "85c56287-3140-4125-a316-0c652cc0f18a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:02:16 user nova-compute[75337]: DEBUG nova.compute.manager [req-e9c91125-7b96-43c6-9037-eec1a78bc79a req-de3b971f-c29e-480f-b78f-ce87bf55efe6 service nova] [instance: 85c56287-3140-4125-a316-0c652cc0f18a] No waiting events found dispatching network-vif-plugged-51662fe4-0156-4111-8e0e-1c330f05d5e6 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 16:02:16 user nova-compute[75337]: WARNING nova.compute.manager [req-e9c91125-7b96-43c6-9037-eec1a78bc79a req-de3b971f-c29e-480f-b78f-ce87bf55efe6 service nova] [instance: 85c56287-3140-4125-a316-0c652cc0f18a] Received unexpected event network-vif-plugged-51662fe4-0156-4111-8e0e-1c330f05d5e6 for instance with vm_state building and task_state spawning.
Nov 06 16:02:16 user nova-compute[75337]: INFO nova.compute.manager [None req-77f99c06-8523-4b70-82ec-c7f6b9614a41 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 85c56287-3140-4125-a316-0c652cc0f18a] Took 5.13 seconds to spawn the instance on the hypervisor.
Nov 06 16:02:16 user nova-compute[75337]: DEBUG nova.compute.manager [None req-77f99c06-8523-4b70-82ec-c7f6b9614a41 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 85c56287-3140-4125-a316-0c652cc0f18a] Checking state {{(pid=75337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 16:02:16 user nova-compute[75337]: INFO nova.compute.manager [None req-77f99c06-8523-4b70-82ec-c7f6b9614a41 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 85c56287-3140-4125-a316-0c652cc0f18a] Took 28.07 seconds to build instance.
Nov 06 16:02:16 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-77f99c06-8523-4b70-82ec-c7f6b9614a41 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Lock "85c56287-3140-4125-a316-0c652cc0f18a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 28.173s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:02:16 user nova-compute[75337]: DEBUG nova.network.neutron [None req-f3b4af83-145f-468c-b06e-7ea65091a93c tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] [instance: ba20919c-b506-458e-ac17-70bcb8900bb7] Updating instance_info_cache with network_info: [{"id": "18a22e63-f67e-4843-8d5c-97e4f4d7eb31", "address": "fa:16:3e:5d:7f:5e", "network": {"id": "8618d6aa-9df1-421d-916b-422978dc518d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1705024451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "398008f06ed645099ae8be04ac48a3ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18a22e63-f6", "ovs_interfaceid": "18a22e63-f67e-4843-8d5c-97e4f4d7eb31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 16:02:16 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-f3b4af83-145f-468c-b06e-7ea65091a93c tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Releasing lock "refresh_cache-ba20919c-b506-458e-ac17-70bcb8900bb7" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 16:02:16 user nova-compute[75337]: DEBUG nova.compute.manager [None req-f3b4af83-145f-468c-b06e-7ea65091a93c tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] [instance: ba20919c-b506-458e-ac17-70bcb8900bb7] Instance network_info: |[{"id": "18a22e63-f67e-4843-8d5c-97e4f4d7eb31", "address": "fa:16:3e:5d:7f:5e", "network": {"id": "8618d6aa-9df1-421d-916b-422978dc518d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1705024451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "398008f06ed645099ae8be04ac48a3ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18a22e63-f6", "ovs_interfaceid": "18a22e63-f67e-4843-8d5c-97e4f4d7eb31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 16:02:16 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-27e7023b-3ffc-4801-9a2f-a663fc806ee9 req-08045549-c6e1-4807-be2f-f7c3fa5ff301 service nova] Acquired lock "refresh_cache-ba20919c-b506-458e-ac17-70bcb8900bb7" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 16:02:16 user nova-compute[75337]: DEBUG nova.network.neutron [req-27e7023b-3ffc-4801-9a2f-a663fc806ee9 req-08045549-c6e1-4807-be2f-f7c3fa5ff301 service nova] [instance: ba20919c-b506-458e-ac17-70bcb8900bb7] Refreshing network info cache for port 18a22e63-f67e-4843-8d5c-97e4f4d7eb31 {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 16:02:16 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-f3b4af83-145f-468c-b06e-7ea65091a93c tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] [instance: ba20919c-b506-458e-ac17-70bcb8900bb7] Start _get_guest_xml network_info=[{"id": "18a22e63-f67e-4843-8d5c-97e4f4d7eb31", "address": "fa:16:3e:5d:7f:5e", "network": {"id": "8618d6aa-9df1-421d-916b-422978dc518d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1705024451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "398008f06ed645099ae8be04ac48a3ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18a22e63-f6", "ovs_interfaceid": "18a22e63-f67e-4843-8d5c-97e4f4d7eb31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T15:34:14Z,direct_url=<?>,disk_format='qcow2',id=16b903ae-a40f-41a7-985b-4804cce92c62,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6549a15819f1469bbd5eeae8190e3d44',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T15:34:15Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'guest_format': None, 'size': 0, 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '16b903ae-a40f-41a7-985b-4804cce92c62'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 16:02:16 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-f3b4af83-145f-468c-b06e-7ea65091a93c tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 16:02:16 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-f3b4af83-145f-468c-b06e-7ea65091a93c tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 16:02:16 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-f3b4af83-145f-468c-b06e-7ea65091a93c tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 16:02:16 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-f3b4af83-145f-468c-b06e-7ea65091a93c tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] CPU controller missing on host. {{(pid=75337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 16:02:16 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-f3b4af83-145f-468c-b06e-7ea65091a93c tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 16:02:16 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-f3b4af83-145f-468c-b06e-7ea65091a93c tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] CPU controller found on host. {{(pid=75337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 16:02:16 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-f3b4af83-145f-468c-b06e-7ea65091a93c tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75337) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 16:02:16 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-f3b4af83-145f-468c-b06e-7ea65091a93c tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T15:34:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T15:34:14Z,direct_url=<?>,disk_format='qcow2',id=16b903ae-a40f-41a7-985b-4804cce92c62,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6549a15819f1469bbd5eeae8190e3d44',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T15:34:15Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 16:02:16 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-f3b4af83-145f-468c-b06e-7ea65091a93c tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Flavor limits 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 16:02:16 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-f3b4af83-145f-468c-b06e-7ea65091a93c tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Image limits 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 16:02:16 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-f3b4af83-145f-468c-b06e-7ea65091a93c tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Flavor pref 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 16:02:16 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-f3b4af83-145f-468c-b06e-7ea65091a93c tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Image pref 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 16:02:16 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-f3b4af83-145f-468c-b06e-7ea65091a93c tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 16:02:16 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-f3b4af83-145f-468c-b06e-7ea65091a93c tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 16:02:16 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-f3b4af83-145f-468c-b06e-7ea65091a93c tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 16:02:16 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-f3b4af83-145f-468c-b06e-7ea65091a93c tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Got 1 possible topologies {{(pid=75337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 16:02:16 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-f3b4af83-145f-468c-b06e-7ea65091a93c tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 16:02:16 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-f3b4af83-145f-468c-b06e-7ea65091a93c tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 16:02:16 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-f3b4af83-145f-468c-b06e-7ea65091a93c tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T16:02:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-859962119',display_name='tempest-VolumesSnapshotTestJSON-instance-859962119',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-859962119',id=41,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMahMmBI48/EJ8R5Z/+uTLcZCdIoAGXjosrdj3y+PwQmOzlZ50q9XJSmCe74o+PJ6UXlCflqsjgci9QOjGzR3EcPp1WVToliUVXMm+xH+6jZ08NupzmZoscIbYzSElIW1w==',key_name='tempest-keypair-403348999',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='398008f06ed645099ae8be04ac48a3ff',ramdisk_id='',reservation_id='r-3usnlrdi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-208809405',owner_user_name='tempest-VolumesSnapshotTestJSON-208809405-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T16:02:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5b2c5ab3c4244bca99bcc3b143c46ecd',uuid=ba20919c-b506-458e-ac17-70bcb8900bb7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "18a22e63-f67e-4843-8d5c-97e4f4d7eb31", "address": "fa:16:3e:5d:7f:5e", "network": {"id": "8618d6aa-9df1-421d-916b-422978dc518d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1705024451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "398008f06ed645099ae8be04ac48a3ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18a22e63-f6", "ovs_interfaceid": "18a22e63-f67e-4843-8d5c-97e4f4d7eb31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75337) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 16:02:16 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-f3b4af83-145f-468c-b06e-7ea65091a93c tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Converting VIF {"id": "18a22e63-f67e-4843-8d5c-97e4f4d7eb31", "address": "fa:16:3e:5d:7f:5e", "network": {"id": "8618d6aa-9df1-421d-916b-422978dc518d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1705024451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "398008f06ed645099ae8be04ac48a3ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18a22e63-f6", "ovs_interfaceid": "18a22e63-f67e-4843-8d5c-97e4f4d7eb31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 16:02:16 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-f3b4af83-145f-468c-b06e-7ea65091a93c tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:7f:5e,bridge_name='br-int',has_traffic_filtering=True,id=18a22e63-f67e-4843-8d5c-97e4f4d7eb31,network=Network(8618d6aa-9df1-421d-916b-422978dc518d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18a22e63-f6') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 16:02:16 user nova-compute[75337]: DEBUG nova.objects.instance [None req-f3b4af83-145f-468c-b06e-7ea65091a93c tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Lazy-loading 'pci_devices' on Instance uuid ba20919c-b506-458e-ac17-70bcb8900bb7 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 16:02:17 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-f3b4af83-145f-468c-b06e-7ea65091a93c tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] [instance: ba20919c-b506-458e-ac17-70bcb8900bb7] End _get_guest_xml xml=<domain type="kvm">
Nov 06 16:02:17 user nova-compute[75337]:   <uuid>ba20919c-b506-458e-ac17-70bcb8900bb7</uuid>
Nov 06 16:02:17 user nova-compute[75337]:   <name>instance-00000029</name>
Nov 06 16:02:17 user nova-compute[75337]:   <memory>524288</memory>
Nov 06 16:02:17 user nova-compute[75337]:   <vcpu>1</vcpu>
Nov 06 16:02:17 user nova-compute[75337]:   <metadata>
Nov 06 16:02:17 user nova-compute[75337]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 16:02:17 user nova-compute[75337]:       <nova:package version="0.0.0"/>
Nov 06 16:02:17 user nova-compute[75337]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-859962119</nova:name>
Nov 06 16:02:17 user nova-compute[75337]:       <nova:creationTime>2023-11-06 16:02:16</nova:creationTime>
Nov 06 16:02:17 user nova-compute[75337]:       <nova:flavor name="m1.tiny">
Nov 06 16:02:17 user nova-compute[75337]:         <nova:memory>512</nova:memory>
Nov 06 16:02:17 user nova-compute[75337]:         <nova:disk>1</nova:disk>
Nov 06 16:02:17 user nova-compute[75337]:         <nova:swap>0</nova:swap>
Nov 06 16:02:17 user nova-compute[75337]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 16:02:17 user nova-compute[75337]:         <nova:vcpus>1</nova:vcpus>
Nov 06 16:02:17 user nova-compute[75337]:       </nova:flavor>
Nov 06 16:02:17 user nova-compute[75337]:       <nova:owner>
Nov 06 16:02:17 user nova-compute[75337]:         <nova:user uuid="5b2c5ab3c4244bca99bcc3b143c46ecd">tempest-VolumesSnapshotTestJSON-208809405-project-member</nova:user>
Nov 06 16:02:17 user nova-compute[75337]:         <nova:project uuid="398008f06ed645099ae8be04ac48a3ff">tempest-VolumesSnapshotTestJSON-208809405</nova:project>
Nov 06 16:02:17 user nova-compute[75337]:       </nova:owner>
Nov 06 16:02:17 user nova-compute[75337]:       <nova:root type="image" uuid="16b903ae-a40f-41a7-985b-4804cce92c62"/>
Nov 06 16:02:17 user nova-compute[75337]:       <nova:ports>
Nov 06 16:02:17 user nova-compute[75337]:         <nova:port uuid="18a22e63-f67e-4843-8d5c-97e4f4d7eb31">
Nov 06 16:02:17 user nova-compute[75337]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 06 16:02:17 user nova-compute[75337]:         </nova:port>
Nov 06 16:02:17 user nova-compute[75337]:       </nova:ports>
Nov 06 16:02:17 user nova-compute[75337]:     </nova:instance>
Nov 06 16:02:17 user nova-compute[75337]:   </metadata>
Nov 06 16:02:17 user nova-compute[75337]:   <sysinfo type="smbios">
Nov 06 16:02:17 user nova-compute[75337]:     <system>
Nov 06 16:02:17 user nova-compute[75337]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 16:02:17 user nova-compute[75337]:       <entry name="product">OpenStack Nova</entry>
Nov 06 16:02:17 user nova-compute[75337]:       <entry name="version">0.0.0</entry>
Nov 06 16:02:17 user nova-compute[75337]:       <entry name="serial">ba20919c-b506-458e-ac17-70bcb8900bb7</entry>
Nov 06 16:02:17 user nova-compute[75337]:       <entry name="uuid">ba20919c-b506-458e-ac17-70bcb8900bb7</entry>
Nov 06 16:02:17 user nova-compute[75337]:       <entry name="family">Virtual Machine</entry>
Nov 06 16:02:17 user nova-compute[75337]:     </system>
Nov 06 16:02:17 user nova-compute[75337]:   </sysinfo>
Nov 06 16:02:17 user nova-compute[75337]:   <os>
Nov 06 16:02:17 user nova-compute[75337]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 16:02:17 user nova-compute[75337]:     <boot dev="hd"/>
Nov 06 16:02:17 user nova-compute[75337]:     <smbios mode="sysinfo"/>
Nov 06 16:02:17 user nova-compute[75337]:   </os>
Nov 06 16:02:17 user nova-compute[75337]:   <features>
Nov 06 16:02:17 user nova-compute[75337]:     <acpi/>
Nov 06 16:02:17 user nova-compute[75337]:     <apic/>
Nov 06 16:02:17 user nova-compute[75337]:     <vmcoreinfo/>
Nov 06 16:02:17 user nova-compute[75337]:   </features>
Nov 06 16:02:17 user nova-compute[75337]:   <clock offset="utc">
Nov 06 16:02:17 user nova-compute[75337]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 16:02:17 user nova-compute[75337]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 16:02:17 user nova-compute[75337]:     <timer name="hpet" present="no"/>
Nov 06 16:02:17 user nova-compute[75337]:   </clock>
Nov 06 16:02:17 user nova-compute[75337]:   <cpu mode="custom" match="exact">
Nov 06 16:02:17 user nova-compute[75337]:     <model>Nehalem</model>
Nov 06 16:02:17 user nova-compute[75337]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 16:02:17 user nova-compute[75337]:   </cpu>
Nov 06 16:02:17 user nova-compute[75337]:   <devices>
Nov 06 16:02:17 user nova-compute[75337]:     <disk type="file" device="disk">
Nov 06 16:02:17 user nova-compute[75337]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 16:02:17 user nova-compute[75337]:       <source file="/opt/stack/data/nova/instances/ba20919c-b506-458e-ac17-70bcb8900bb7/disk"/>
Nov 06 16:02:17 user nova-compute[75337]:       <target dev="vda" bus="virtio"/>
Nov 06 16:02:17 user nova-compute[75337]:     </disk>
Nov 06 16:02:17 user nova-compute[75337]:     <interface type="ethernet">
Nov 06 16:02:17 user nova-compute[75337]:       <mac address="fa:16:3e:5d:7f:5e"/>
Nov 06 16:02:17 user nova-compute[75337]:       <model type="virtio"/>
Nov 06 16:02:17 user nova-compute[75337]:       <mtu size="1442"/>
Nov 06 16:02:17 user nova-compute[75337]:       <target dev="tap18a22e63-f6"/>
Nov 06 16:02:17 user nova-compute[75337]:     </interface>
Nov 06 16:02:17 user nova-compute[75337]:     <serial type="pty">
Nov 06 16:02:17 user nova-compute[75337]:       <log file="/opt/stack/data/nova/instances/ba20919c-b506-458e-ac17-70bcb8900bb7/console.log" append="off"/>
Nov 06 16:02:17 user nova-compute[75337]:     </serial>
Nov 06 16:02:17 user nova-compute[75337]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 16:02:17 user nova-compute[75337]:     <video>
Nov 06 16:02:17 user nova-compute[75337]:       <model type="virtio"/>
Nov 06 16:02:17 user nova-compute[75337]:     </video>
Nov 06 16:02:17 user nova-compute[75337]:     <rng model="virtio">
Nov 06 16:02:17 user nova-compute[75337]:       <backend model="random">/dev/urandom</backend>
Nov 06 16:02:17 user nova-compute[75337]:     </rng>
Nov 06 16:02:17 user nova-compute[75337]:     <controller type="usb" index="0" model="none"/>
Nov 06 16:02:17 user nova-compute[75337]:     <memballoon model="virtio">
Nov 06 16:02:17 user nova-compute[75337]:       <stats period="10"/>
Nov 06 16:02:17 user nova-compute[75337]:     </memballoon>
Nov 06 16:02:17 user nova-compute[75337]:   </devices>
Nov 06 16:02:17 user nova-compute[75337]: </domain>
Nov 06 16:02:17 user nova-compute[75337]:  {{(pid=75337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 16:02:17 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-f3b4af83-145f-468c-b06e-7ea65091a93c tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T16:02:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-859962119',display_name='tempest-VolumesSnapshotTestJSON-instance-859962119',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-859962119',id=41,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMahMmBI48/EJ8R5Z/+uTLcZCdIoAGXjosrdj3y+PwQmOzlZ50q9XJSmCe74o+PJ6UXlCflqsjgci9QOjGzR3EcPp1WVToliUVXMm+xH+6jZ08NupzmZoscIbYzSElIW1w==',key_name='tempest-keypair-403348999',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='398008f06ed645099ae8be04ac48a3ff',ramdisk_id='',reservation_id='r-3usnlrdi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-208809405',owner_user_name='tempest-VolumesSnapshotTestJSON-208809405-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T16:02:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5b2c5ab3c4244bca99bcc3b143c46ecd',uuid=ba20919c-b506-458e-ac17-70bcb8900bb7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "18a22e63-f67e-4843-8d5c-97e4f4d7eb31", "address": "fa:16:3e:5d:7f:5e", "network": {"id": "8618d6aa-9df1-421d-916b-422978dc518d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1705024451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "398008f06ed645099ae8be04ac48a3ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18a22e63-f6", "ovs_interfaceid": "18a22e63-f67e-4843-8d5c-97e4f4d7eb31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 16:02:17 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-f3b4af83-145f-468c-b06e-7ea65091a93c tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Converting VIF {"id": "18a22e63-f67e-4843-8d5c-97e4f4d7eb31", "address": "fa:16:3e:5d:7f:5e", "network": {"id": "8618d6aa-9df1-421d-916b-422978dc518d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1705024451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "398008f06ed645099ae8be04ac48a3ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18a22e63-f6", "ovs_interfaceid": "18a22e63-f67e-4843-8d5c-97e4f4d7eb31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 16:02:17 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-f3b4af83-145f-468c-b06e-7ea65091a93c tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:7f:5e,bridge_name='br-int',has_traffic_filtering=True,id=18a22e63-f67e-4843-8d5c-97e4f4d7eb31,network=Network(8618d6aa-9df1-421d-916b-422978dc518d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18a22e63-f6') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 16:02:17 user nova-compute[75337]: DEBUG os_vif [None req-f3b4af83-145f-468c-b06e-7ea65091a93c tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:7f:5e,bridge_name='br-int',has_traffic_filtering=True,id=18a22e63-f67e-4843-8d5c-97e4f4d7eb31,network=Network(8618d6aa-9df1-421d-916b-422978dc518d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18a22e63-f6') {{(pid=75337) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 16:02:17 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:02:17 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 16:02:17 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 16:02:17 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:02:17 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6d360d65-a8f4-5d5e-8dc0-ad74f177cf54', '_type': 'linux-noop'}}, row=False) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 16:02:17 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:02:17 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:02:17 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:02:17 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:02:17 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap18a22e63-f6, may_exist=True, interface_attrs={}) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 16:02:17 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap18a22e63-f6, col_values=(('qos', UUID('15d2875a-7e8a-497c-87ce-52e3fca6347d')),), if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 16:02:17 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap18a22e63-f6, col_values=(('external_ids', {'iface-id': '18a22e63-f67e-4843-8d5c-97e4f4d7eb31', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5d:7f:5e', 'vm-uuid': 'ba20919c-b506-458e-ac17-70bcb8900bb7'}),), if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 16:02:17 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:02:17 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:02:17 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:02:17 user nova-compute[75337]: INFO os_vif [None req-f3b4af83-145f-468c-b06e-7ea65091a93c tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:7f:5e,bridge_name='br-int',has_traffic_filtering=True,id=18a22e63-f67e-4843-8d5c-97e4f4d7eb31,network=Network(8618d6aa-9df1-421d-916b-422978dc518d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18a22e63-f6')
Nov 06 16:02:17 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-f3b4af83-145f-468c-b06e-7ea65091a93c tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] No BDM found with device name vda, not building metadata. {{(pid=75337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 16:02:17 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-f3b4af83-145f-468c-b06e-7ea65091a93c tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] No VIF found with MAC fa:16:3e:5d:7f:5e, not building metadata {{(pid=75337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 16:02:17 user nova-compute[75337]: DEBUG nova.network.neutron [req-27e7023b-3ffc-4801-9a2f-a663fc806ee9 req-08045549-c6e1-4807-be2f-f7c3fa5ff301 service nova] [instance: ba20919c-b506-458e-ac17-70bcb8900bb7] Updated VIF entry in instance network info cache for port 18a22e63-f67e-4843-8d5c-97e4f4d7eb31. {{(pid=75337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 16:02:17 user nova-compute[75337]: DEBUG nova.network.neutron [req-27e7023b-3ffc-4801-9a2f-a663fc806ee9 req-08045549-c6e1-4807-be2f-f7c3fa5ff301 service nova] [instance: ba20919c-b506-458e-ac17-70bcb8900bb7] Updating instance_info_cache with network_info: [{"id": "18a22e63-f67e-4843-8d5c-97e4f4d7eb31", "address": "fa:16:3e:5d:7f:5e", "network": {"id": "8618d6aa-9df1-421d-916b-422978dc518d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1705024451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "398008f06ed645099ae8be04ac48a3ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18a22e63-f6", "ovs_interfaceid": "18a22e63-f67e-4843-8d5c-97e4f4d7eb31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 16:02:17 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-27e7023b-3ffc-4801-9a2f-a663fc806ee9 req-08045549-c6e1-4807-be2f-f7c3fa5ff301 service nova] Releasing lock "refresh_cache-ba20919c-b506-458e-ac17-70bcb8900bb7" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 16:02:18 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:02:18 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:02:18 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:02:18 user nova-compute[75337]: DEBUG nova.compute.manager [req-0e84cb18-0153-48ac-8bf2-acc2eca4436b req-003fac06-4146-4761-9568-cfd3f04af61c service nova] [instance: ba20919c-b506-458e-ac17-70bcb8900bb7] Received event network-vif-plugged-18a22e63-f67e-4843-8d5c-97e4f4d7eb31 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:02:18 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-0e84cb18-0153-48ac-8bf2-acc2eca4436b req-003fac06-4146-4761-9568-cfd3f04af61c service nova] Acquiring lock "ba20919c-b506-458e-ac17-70bcb8900bb7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:02:18 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-0e84cb18-0153-48ac-8bf2-acc2eca4436b req-003fac06-4146-4761-9568-cfd3f04af61c service nova] Lock "ba20919c-b506-458e-ac17-70bcb8900bb7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:02:18 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-0e84cb18-0153-48ac-8bf2-acc2eca4436b req-003fac06-4146-4761-9568-cfd3f04af61c service nova] Lock "ba20919c-b506-458e-ac17-70bcb8900bb7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:02:18 user nova-compute[75337]: DEBUG nova.compute.manager [req-0e84cb18-0153-48ac-8bf2-acc2eca4436b req-003fac06-4146-4761-9568-cfd3f04af61c service nova] [instance: ba20919c-b506-458e-ac17-70bcb8900bb7] No waiting events found dispatching network-vif-plugged-18a22e63-f67e-4843-8d5c-97e4f4d7eb31 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 16:02:18 user nova-compute[75337]: WARNING nova.compute.manager [req-0e84cb18-0153-48ac-8bf2-acc2eca4436b req-003fac06-4146-4761-9568-cfd3f04af61c service nova] [instance: ba20919c-b506-458e-ac17-70bcb8900bb7] Received unexpected event network-vif-plugged-18a22e63-f67e-4843-8d5c-97e4f4d7eb31 for instance with vm_state building and task_state spawning.
Nov 06 16:02:19 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:02:19 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:02:19 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:02:19 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:02:19 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:02:19 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:02:19 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Starting heal instance info cache {{(pid=75337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 16:02:19 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:02:19 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "refresh_cache-69df3824-b28c-43c0-9f20-52fa956642cc" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 16:02:19 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquired lock "refresh_cache-69df3824-b28c-43c0-9f20-52fa956642cc" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 16:02:19 user nova-compute[75337]: DEBUG nova.network.neutron [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] [instance: 69df3824-b28c-43c0-9f20-52fa956642cc] Forcefully refreshing network info cache for instance {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 16:02:20 user nova-compute[75337]: DEBUG nova.network.neutron [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] [instance: 69df3824-b28c-43c0-9f20-52fa956642cc] Updating instance_info_cache with network_info: [{"id": "c3d051e2-c3b7-4ee0-aab0-dcf3c0d1d578", "address": "fa:16:3e:7e:b4:bf", "network": {"id": "8b217731-de9e-49bc-84bb-130fd42ede51", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-314618758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98fac9096a3b4f21ba805ba1437d9d38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3d051e2-c3", "ovs_interfaceid": "c3d051e2-c3b7-4ee0-aab0-dcf3c0d1d578", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 16:02:20 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Releasing lock "refresh_cache-69df3824-b28c-43c0-9f20-52fa956642cc" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 16:02:20 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] [instance: 69df3824-b28c-43c0-9f20-52fa956642cc] Updated the network info_cache for instance {{(pid=75337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 16:02:20 user nova-compute[75337]: DEBUG nova.compute.manager [req-7b1d7896-123e-4514-9a05-7a9fd6e4248d req-8cbc899c-6acd-443d-b894-9e75b70a434f service nova] [instance: ba20919c-b506-458e-ac17-70bcb8900bb7] Received event network-vif-plugged-18a22e63-f67e-4843-8d5c-97e4f4d7eb31 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:02:20 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-7b1d7896-123e-4514-9a05-7a9fd6e4248d req-8cbc899c-6acd-443d-b894-9e75b70a434f service nova] Acquiring lock "ba20919c-b506-458e-ac17-70bcb8900bb7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:02:20 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-7b1d7896-123e-4514-9a05-7a9fd6e4248d req-8cbc899c-6acd-443d-b894-9e75b70a434f service nova] Lock "ba20919c-b506-458e-ac17-70bcb8900bb7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:02:20 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-7b1d7896-123e-4514-9a05-7a9fd6e4248d req-8cbc899c-6acd-443d-b894-9e75b70a434f service nova] Lock "ba20919c-b506-458e-ac17-70bcb8900bb7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:02:20 user nova-compute[75337]: DEBUG nova.compute.manager [req-7b1d7896-123e-4514-9a05-7a9fd6e4248d req-8cbc899c-6acd-443d-b894-9e75b70a434f service nova] [instance: ba20919c-b506-458e-ac17-70bcb8900bb7] No waiting events found dispatching network-vif-plugged-18a22e63-f67e-4843-8d5c-97e4f4d7eb31 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 16:02:20 user nova-compute[75337]: WARNING nova.compute.manager [req-7b1d7896-123e-4514-9a05-7a9fd6e4248d req-8cbc899c-6acd-443d-b894-9e75b70a434f service nova] [instance: ba20919c-b506-458e-ac17-70bcb8900bb7] Received unexpected event network-vif-plugged-18a22e63-f67e-4843-8d5c-97e4f4d7eb31 for instance with vm_state building and task_state spawning.
Nov 06 16:02:20 user nova-compute[75337]: DEBUG nova.compute.manager [None req-f3b4af83-145f-468c-b06e-7ea65091a93c tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] [instance: ba20919c-b506-458e-ac17-70bcb8900bb7] Instance event wait completed in 0 seconds for  {{(pid=75337) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 16:02:20 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-f3b4af83-145f-468c-b06e-7ea65091a93c tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] [instance: ba20919c-b506-458e-ac17-70bcb8900bb7] Guest created on hypervisor {{(pid=75337) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 16:02:20 user nova-compute[75337]: INFO nova.virt.libvirt.driver [-] [instance: ba20919c-b506-458e-ac17-70bcb8900bb7] Instance spawned successfully.
Nov 06 16:02:20 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-f3b4af83-145f-468c-b06e-7ea65091a93c tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] [instance: ba20919c-b506-458e-ac17-70bcb8900bb7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 16:02:20 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-f3b4af83-145f-468c-b06e-7ea65091a93c tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] [instance: ba20919c-b506-458e-ac17-70bcb8900bb7] Found default for hw_cdrom_bus of ide {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 16:02:20 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-f3b4af83-145f-468c-b06e-7ea65091a93c tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] [instance: ba20919c-b506-458e-ac17-70bcb8900bb7] Found default for hw_disk_bus of virtio {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 16:02:20 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-f3b4af83-145f-468c-b06e-7ea65091a93c tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] [instance: ba20919c-b506-458e-ac17-70bcb8900bb7] Found default for hw_input_bus of None {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 16:02:20 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-f3b4af83-145f-468c-b06e-7ea65091a93c tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] [instance: ba20919c-b506-458e-ac17-70bcb8900bb7] Found default for hw_pointer_model of None {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 16:02:20 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-f3b4af83-145f-468c-b06e-7ea65091a93c tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] [instance: ba20919c-b506-458e-ac17-70bcb8900bb7] Found default for hw_video_model of virtio {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 16:02:20 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-f3b4af83-145f-468c-b06e-7ea65091a93c tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] [instance: ba20919c-b506-458e-ac17-70bcb8900bb7] Found default for hw_vif_model of virtio {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 16:02:20 user nova-compute[75337]: INFO nova.compute.manager [None req-f3b4af83-145f-468c-b06e-7ea65091a93c tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] [instance: ba20919c-b506-458e-ac17-70bcb8900bb7] Took 5.63 seconds to spawn the instance on the hypervisor.
Nov 06 16:02:20 user nova-compute[75337]: DEBUG nova.compute.manager [None req-f3b4af83-145f-468c-b06e-7ea65091a93c tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] [instance: ba20919c-b506-458e-ac17-70bcb8900bb7] Checking state {{(pid=75337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 16:02:21 user nova-compute[75337]: INFO nova.compute.manager [None req-f3b4af83-145f-468c-b06e-7ea65091a93c tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] [instance: ba20919c-b506-458e-ac17-70bcb8900bb7] Took 6.40 seconds to build instance.
Nov 06 16:02:21 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-f3b4af83-145f-468c-b06e-7ea65091a93c tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Lock "ba20919c-b506-458e-ac17-70bcb8900bb7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.492s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:02:21 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager.update_available_resource {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:02:21 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:02:21 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:02:21 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:02:21 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Auditing locally available compute resources for user (node: user) {{(pid=75337) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 16:02:21 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba7d8a41-5a75-4dca-a192-0177119403be/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:02:21 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba7d8a41-5a75-4dca-a192-0177119403be/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:02:21 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba7d8a41-5a75-4dca-a192-0177119403be/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:02:22 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:02:22 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba7d8a41-5a75-4dca-a192-0177119403be/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:02:22 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69df3824-b28c-43c0-9f20-52fa956642cc/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:02:22 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69df3824-b28c-43c0-9f20-52fa956642cc/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:02:22 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69df3824-b28c-43c0-9f20-52fa956642cc/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:02:22 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69df3824-b28c-43c0-9f20-52fa956642cc/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:02:22 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 16:02:22 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01b61f9a-2591-4714-b18e-54f674a441ab/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:02:22 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01b61f9a-2591-4714-b18e-54f674a441ab/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:02:22 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01b61f9a-2591-4714-b18e-54f674a441ab/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:02:22 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01b61f9a-2591-4714-b18e-54f674a441ab/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:02:22 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 16:02:22 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6110b34a-6fd3-45fc-911d-4e5d3c7f2d78/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:02:23 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6110b34a-6fd3-45fc-911d-4e5d3c7f2d78/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:02:23 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6110b34a-6fd3-45fc-911d-4e5d3c7f2d78/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:02:23 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6110b34a-6fd3-45fc-911d-4e5d3c7f2d78/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:02:23 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba20919c-b506-458e-ac17-70bcb8900bb7/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:02:23 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba20919c-b506-458e-ac17-70bcb8900bb7/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:02:23 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba20919c-b506-458e-ac17-70bcb8900bb7/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:02:23 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba20919c-b506-458e-ac17-70bcb8900bb7/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:02:23 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d479c64-055b-4496-b3a2-ba10f9095ea8/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:02:23 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d479c64-055b-4496-b3a2-ba10f9095ea8/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:02:23 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d479c64-055b-4496-b3a2-ba10f9095ea8/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:02:24 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d479c64-055b-4496-b3a2-ba10f9095ea8/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:02:24 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:02:24 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 16:02:24 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 16:02:24 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Hypervisor/Node resource view: name=user free_ram=8098MB free_disk=25.086997985839844GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75337) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 16:02:24 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:02:24 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:02:24 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 6110b34a-6fd3-45fc-911d-4e5d3c7f2d78 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 16:02:24 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 69df3824-b28c-43c0-9f20-52fa956642cc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 16:02:24 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance ba7d8a41-5a75-4dca-a192-0177119403be actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 16:02:24 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 5d479c64-055b-4496-b3a2-ba10f9095ea8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 16:02:24 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance e558736d-848f-4a79-a7aa-1e46638a85dc actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 16:02:24 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 01b61f9a-2591-4714-b18e-54f674a441ab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 16:02:24 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 85c56287-3140-4125-a316-0c652cc0f18a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 16:02:24 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance ba20919c-b506-458e-ac17-70bcb8900bb7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 16:02:24 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 16:02:24 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 16:02:25 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 16:02:25 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 16:02:25 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Compute_service record updated for user:user {{(pid=75337) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 16:02:25 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.459s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:02:26 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:02:27 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:02:32 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:02:32 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-c820a36c-6ed1-4dd9-8f04-1806e77f871c tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] Acquiring lock "ba7d8a41-5a75-4dca-a192-0177119403be" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:02:32 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-c820a36c-6ed1-4dd9-8f04-1806e77f871c tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] Lock "ba7d8a41-5a75-4dca-a192-0177119403be" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:02:32 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-c820a36c-6ed1-4dd9-8f04-1806e77f871c tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] Acquiring lock "ba7d8a41-5a75-4dca-a192-0177119403be-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:02:32 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-c820a36c-6ed1-4dd9-8f04-1806e77f871c tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] Lock "ba7d8a41-5a75-4dca-a192-0177119403be-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:02:32 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-c820a36c-6ed1-4dd9-8f04-1806e77f871c tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] Lock "ba7d8a41-5a75-4dca-a192-0177119403be-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:02:32 user nova-compute[75337]: INFO nova.compute.manager [None req-c820a36c-6ed1-4dd9-8f04-1806e77f871c tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] [instance: ba7d8a41-5a75-4dca-a192-0177119403be] Terminating instance
Nov 06 16:02:32 user nova-compute[75337]: DEBUG nova.compute.manager [None req-c820a36c-6ed1-4dd9-8f04-1806e77f871c tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] [instance: ba7d8a41-5a75-4dca-a192-0177119403be] Start destroying the instance on the hypervisor. {{(pid=75337) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 16:02:32 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:02:32 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:02:32 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:02:32 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:02:32 user nova-compute[75337]: DEBUG nova.compute.manager [req-ddb06d97-ad40-4e55-9d1f-8a1ee3455572 req-f93d8c70-3d0e-4378-b57f-ef2a8a3b9665 service nova] [instance: ba7d8a41-5a75-4dca-a192-0177119403be] Received event network-vif-unplugged-f85d9767-bd59-4182-b18b-a29b13527561 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:02:32 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-ddb06d97-ad40-4e55-9d1f-8a1ee3455572 req-f93d8c70-3d0e-4378-b57f-ef2a8a3b9665 service nova] Acquiring lock "ba7d8a41-5a75-4dca-a192-0177119403be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:02:32 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-ddb06d97-ad40-4e55-9d1f-8a1ee3455572 req-f93d8c70-3d0e-4378-b57f-ef2a8a3b9665 service nova] Lock "ba7d8a41-5a75-4dca-a192-0177119403be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:02:32 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-ddb06d97-ad40-4e55-9d1f-8a1ee3455572 req-f93d8c70-3d0e-4378-b57f-ef2a8a3b9665 service nova] Lock "ba7d8a41-5a75-4dca-a192-0177119403be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:02:32 user nova-compute[75337]: DEBUG nova.compute.manager [req-ddb06d97-ad40-4e55-9d1f-8a1ee3455572 req-f93d8c70-3d0e-4378-b57f-ef2a8a3b9665 service nova] [instance: ba7d8a41-5a75-4dca-a192-0177119403be] No waiting events found dispatching network-vif-unplugged-f85d9767-bd59-4182-b18b-a29b13527561 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 16:02:32 user nova-compute[75337]: DEBUG nova.compute.manager [req-ddb06d97-ad40-4e55-9d1f-8a1ee3455572 req-f93d8c70-3d0e-4378-b57f-ef2a8a3b9665 service nova] [instance: ba7d8a41-5a75-4dca-a192-0177119403be] Received event network-vif-unplugged-f85d9767-bd59-4182-b18b-a29b13527561 for instance with task_state deleting. {{(pid=75337) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 16:02:33 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:02:33 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:02:33 user nova-compute[75337]: INFO nova.virt.libvirt.driver [-] [instance: ba7d8a41-5a75-4dca-a192-0177119403be] Instance destroyed successfully.
Nov 06 16:02:33 user nova-compute[75337]: DEBUG nova.objects.instance [None req-c820a36c-6ed1-4dd9-8f04-1806e77f871c tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] Lazy-loading 'resources' on Instance uuid ba7d8a41-5a75-4dca-a192-0177119403be {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 16:02:33 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-c820a36c-6ed1-4dd9-8f04-1806e77f871c tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T15:58:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1151083637',display_name='tempest-TestServerVolumeAttachmentScenario-server-1151083637',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1151083637',id=36,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCB41VFIT5juD7+9z6N1qRknNQRLvsimsPD63E0OSj+2oOdF5JSQ2RIEZayjysK7567xZlXNjOJziMv6mqo0U6agdcFwCKrbSyM2vP/bkxlfCKVdfz2cenTv5hl1n2s+1A==',key_name='tempest-keypair-281126385',keypairs=<?>,launch_index=0,launched_at=2023-11-06T15:58:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3589e9805b0743d59c03decf3e6bad5c',ramdisk_id='',reservation_id='r-48oejgv9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-2018764463',owner_user_name='tempest-TestServerVolumeAttachmentScenario-2018764463-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T15:58:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c64d7153a7a94b4189312356c2b0b1f1',uuid=ba7d8a41-5a75-4dca-a192-0177119403be,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f85d9767-bd59-4182-b18b-a29b13527561", "address": "fa:16:3e:d2:44:86", "network": {"id": "86559e08-82d7-4eed-8a89-f5859ff948b3", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-28678156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3589e9805b0743d59c03decf3e6bad5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf85d9767-bd", "ovs_interfaceid": "f85d9767-bd59-4182-b18b-a29b13527561", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 16:02:33 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-c820a36c-6ed1-4dd9-8f04-1806e77f871c tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] Converting VIF {"id": "f85d9767-bd59-4182-b18b-a29b13527561", "address": "fa:16:3e:d2:44:86", "network": {"id": "86559e08-82d7-4eed-8a89-f5859ff948b3", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-28678156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3589e9805b0743d59c03decf3e6bad5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf85d9767-bd", "ovs_interfaceid": "f85d9767-bd59-4182-b18b-a29b13527561", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 16:02:33 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-c820a36c-6ed1-4dd9-8f04-1806e77f871c tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d2:44:86,bridge_name='br-int',has_traffic_filtering=True,id=f85d9767-bd59-4182-b18b-a29b13527561,network=Network(86559e08-82d7-4eed-8a89-f5859ff948b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf85d9767-bd') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 16:02:33 user nova-compute[75337]: DEBUG os_vif [None req-c820a36c-6ed1-4dd9-8f04-1806e77f871c tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d2:44:86,bridge_name='br-int',has_traffic_filtering=True,id=f85d9767-bd59-4182-b18b-a29b13527561,network=Network(86559e08-82d7-4eed-8a89-f5859ff948b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf85d9767-bd') {{(pid=75337) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 16:02:33 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:02:33 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf85d9767-bd, bridge=br-int, if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 16:02:33 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:02:33 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:02:33 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:02:33 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:02:33 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=46205da7-1dac-44f1-b4d6-5fc9685a9924) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 16:02:33 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:02:33 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:02:33 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:02:33 user nova-compute[75337]: INFO os_vif [None req-c820a36c-6ed1-4dd9-8f04-1806e77f871c tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d2:44:86,bridge_name='br-int',has_traffic_filtering=True,id=f85d9767-bd59-4182-b18b-a29b13527561,network=Network(86559e08-82d7-4eed-8a89-f5859ff948b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf85d9767-bd')
Nov 06 16:02:33 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-c820a36c-6ed1-4dd9-8f04-1806e77f871c tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] [instance: ba7d8a41-5a75-4dca-a192-0177119403be] Deleting instance files /opt/stack/data/nova/instances/ba7d8a41-5a75-4dca-a192-0177119403be_del
Nov 06 16:02:33 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-c820a36c-6ed1-4dd9-8f04-1806e77f871c tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] [instance: ba7d8a41-5a75-4dca-a192-0177119403be] Deletion of /opt/stack/data/nova/instances/ba7d8a41-5a75-4dca-a192-0177119403be_del complete
Nov 06 16:02:33 user nova-compute[75337]: INFO nova.compute.manager [None req-c820a36c-6ed1-4dd9-8f04-1806e77f871c tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] [instance: ba7d8a41-5a75-4dca-a192-0177119403be] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 06 16:02:33 user nova-compute[75337]: DEBUG oslo.service.loopingcall [None req-c820a36c-6ed1-4dd9-8f04-1806e77f871c tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75337) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 16:02:33 user nova-compute[75337]: DEBUG nova.compute.manager [-] [instance: ba7d8a41-5a75-4dca-a192-0177119403be] Deallocating network for instance {{(pid=75337) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 16:02:33 user nova-compute[75337]: DEBUG nova.network.neutron [-] [instance: ba7d8a41-5a75-4dca-a192-0177119403be] deallocate_for_instance() {{(pid=75337) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 16:02:34 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:02:34 user nova-compute[75337]: DEBUG nova.network.neutron [-] [instance: ba7d8a41-5a75-4dca-a192-0177119403be] Updating instance_info_cache with network_info: [] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 16:02:34 user nova-compute[75337]: INFO nova.compute.manager [-] [instance: ba7d8a41-5a75-4dca-a192-0177119403be] Took 1.37 seconds to deallocate network for instance.
Nov 06 16:02:34 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-c820a36c-6ed1-4dd9-8f04-1806e77f871c tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:02:34 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-c820a36c-6ed1-4dd9-8f04-1806e77f871c tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:02:34 user nova-compute[75337]: DEBUG nova.compute.manager [req-2419e6a2-d877-47ea-9298-2149405a0103 req-6bf8b39a-82a1-48c4-a7cc-eaea75e221e8 service nova] [instance: ba7d8a41-5a75-4dca-a192-0177119403be] Received event network-vif-plugged-f85d9767-bd59-4182-b18b-a29b13527561 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:02:34 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-2419e6a2-d877-47ea-9298-2149405a0103 req-6bf8b39a-82a1-48c4-a7cc-eaea75e221e8 service nova] Acquiring lock "ba7d8a41-5a75-4dca-a192-0177119403be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:02:34 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-2419e6a2-d877-47ea-9298-2149405a0103 req-6bf8b39a-82a1-48c4-a7cc-eaea75e221e8 service nova] Lock "ba7d8a41-5a75-4dca-a192-0177119403be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:02:34 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-2419e6a2-d877-47ea-9298-2149405a0103 req-6bf8b39a-82a1-48c4-a7cc-eaea75e221e8 service nova] Lock "ba7d8a41-5a75-4dca-a192-0177119403be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:02:34 user nova-compute[75337]: DEBUG nova.compute.manager [req-2419e6a2-d877-47ea-9298-2149405a0103 req-6bf8b39a-82a1-48c4-a7cc-eaea75e221e8 service nova] [instance: ba7d8a41-5a75-4dca-a192-0177119403be] No waiting events found dispatching network-vif-plugged-f85d9767-bd59-4182-b18b-a29b13527561 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 16:02:34 user nova-compute[75337]: WARNING nova.compute.manager [req-2419e6a2-d877-47ea-9298-2149405a0103 req-6bf8b39a-82a1-48c4-a7cc-eaea75e221e8 service nova] [instance: ba7d8a41-5a75-4dca-a192-0177119403be] Received unexpected event network-vif-plugged-f85d9767-bd59-4182-b18b-a29b13527561 for instance with vm_state deleted and task_state None.
Nov 06 16:02:34 user nova-compute[75337]: DEBUG nova.compute.manager [req-2419e6a2-d877-47ea-9298-2149405a0103 req-6bf8b39a-82a1-48c4-a7cc-eaea75e221e8 service nova] [instance: ba7d8a41-5a75-4dca-a192-0177119403be] Received event network-vif-deleted-f85d9767-bd59-4182-b18b-a29b13527561 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:02:35 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-c820a36c-6ed1-4dd9-8f04-1806e77f871c tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 16:02:35 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-c820a36c-6ed1-4dd9-8f04-1806e77f871c tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 16:02:35 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-c820a36c-6ed1-4dd9-8f04-1806e77f871c tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.317s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:02:35 user nova-compute[75337]: INFO nova.scheduler.client.report [None req-c820a36c-6ed1-4dd9-8f04-1806e77f871c tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] Deleted allocations for instance ba7d8a41-5a75-4dca-a192-0177119403be
Nov 06 16:02:35 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-c820a36c-6ed1-4dd9-8f04-1806e77f871c tempest-TestServerVolumeAttachmentScenario-2018764463 tempest-TestServerVolumeAttachmentScenario-2018764463-project-member] Lock "ba7d8a41-5a75-4dca-a192-0177119403be" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.769s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:02:38 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:02:39 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:02:43 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:02:44 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:02:48 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:02:49 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:02:53 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:02:58 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:03:03 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:03:06 user nova-compute[75337]: DEBUG nova.objects.instance [None req-7707b62e-73ac-4629-b0fd-6c9d7b7033c5 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Lazy-loading 'flavor' on Instance uuid 69df3824-b28c-43c0-9f20-52fa956642cc {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 16:03:06 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-7707b62e-73ac-4629-b0fd-6c9d7b7033c5 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Acquiring lock "refresh_cache-69df3824-b28c-43c0-9f20-52fa956642cc" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 16:03:06 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-7707b62e-73ac-4629-b0fd-6c9d7b7033c5 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Acquired lock "refresh_cache-69df3824-b28c-43c0-9f20-52fa956642cc" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 16:03:06 user nova-compute[75337]: DEBUG nova.network.neutron [None req-7707b62e-73ac-4629-b0fd-6c9d7b7033c5 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] [instance: 69df3824-b28c-43c0-9f20-52fa956642cc] Building network info cache for instance {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 16:03:06 user nova-compute[75337]: DEBUG nova.objects.instance [None req-7707b62e-73ac-4629-b0fd-6c9d7b7033c5 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Lazy-loading 'info_cache' on Instance uuid 69df3824-b28c-43c0-9f20-52fa956642cc {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 16:03:06 user nova-compute[75337]: DEBUG nova.objects.base [None req-7707b62e-73ac-4629-b0fd-6c9d7b7033c5 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Object Instance<69df3824-b28c-43c0-9f20-52fa956642cc> lazy-loaded attributes: flavor,info_cache {{(pid=75337) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 16:03:07 user nova-compute[75337]: DEBUG nova.network.neutron [None req-7707b62e-73ac-4629-b0fd-6c9d7b7033c5 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] [instance: 69df3824-b28c-43c0-9f20-52fa956642cc] Updating instance_info_cache with network_info: [{"id": "c3d051e2-c3b7-4ee0-aab0-dcf3c0d1d578", "address": "fa:16:3e:7e:b4:bf", "network": {"id": "8b217731-de9e-49bc-84bb-130fd42ede51", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-314618758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98fac9096a3b4f21ba805ba1437d9d38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3d051e2-c3", "ovs_interfaceid": "c3d051e2-c3b7-4ee0-aab0-dcf3c0d1d578", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 16:03:07 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-7707b62e-73ac-4629-b0fd-6c9d7b7033c5 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Releasing lock "refresh_cache-69df3824-b28c-43c0-9f20-52fa956642cc" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 16:03:07 user nova-compute[75337]: INFO nova.virt.libvirt.driver [-] [instance: 69df3824-b28c-43c0-9f20-52fa956642cc] Instance destroyed successfully.
Nov 06 16:03:07 user nova-compute[75337]: DEBUG nova.objects.instance [None req-7707b62e-73ac-4629-b0fd-6c9d7b7033c5 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Lazy-loading 'resources' on Instance uuid 69df3824-b28c-43c0-9f20-52fa956642cc {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 16:03:07 user nova-compute[75337]: DEBUG nova.objects.base [None req-7707b62e-73ac-4629-b0fd-6c9d7b7033c5 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Object Instance<69df3824-b28c-43c0-9f20-52fa956642cc> lazy-loaded attributes: flavor,info_cache,resources {{(pid=75337) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 16:03:07 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-7707b62e-73ac-4629-b0fd-6c9d7b7033c5 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T15:54:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1515449710',display_name='tempest-AttachVolumeTestJSON-server-1515449710',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1515449710',id=32,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOuljMPp9i9MDAKWBD5G58tmj+9Tb6PUeli8EGD2jPfBvIyOYYOj/xbR7lXnFQzbgbAGvrz08EfcDEZH0CAoflAb7Id49fT3SM4gKBFBAbvsmqhfX3tP82mW2VMhPkafYg==',key_name='tempest-keypair-396223312',keypairs=<?>,launch_index=0,launched_at=2023-11-06T15:54:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='98fac9096a3b4f21ba805ba1437d9d38',ramdisk_id='',reservation_id='r-ynykuy84',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-636759182',owner_user_name='tempest-AttachVolumeTestJSON-636759182-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T16:01:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ef1008574bea4cfca8a20b2edcf0aacd',uuid=69df3824-b28c-43c0-9f20-52fa956642cc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "c3d051e2-c3b7-4ee0-aab0-dcf3c0d1d578", "address": "fa:16:3e:7e:b4:bf", "network": {"id": "8b217731-de9e-49bc-84bb-130fd42ede51", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-314618758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98fac9096a3b4f21ba805ba1437d9d38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3d051e2-c3", "ovs_interfaceid": "c3d051e2-c3b7-4ee0-aab0-dcf3c0d1d578", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 16:03:07 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-7707b62e-73ac-4629-b0fd-6c9d7b7033c5 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Converting VIF {"id": "c3d051e2-c3b7-4ee0-aab0-dcf3c0d1d578", "address": "fa:16:3e:7e:b4:bf", "network": {"id": "8b217731-de9e-49bc-84bb-130fd42ede51", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-314618758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98fac9096a3b4f21ba805ba1437d9d38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3d051e2-c3", "ovs_interfaceid": "c3d051e2-c3b7-4ee0-aab0-dcf3c0d1d578", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 16:03:07 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-7707b62e-73ac-4629-b0fd-6c9d7b7033c5 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:b4:bf,bridge_name='br-int',has_traffic_filtering=True,id=c3d051e2-c3b7-4ee0-aab0-dcf3c0d1d578,network=Network(8b217731-de9e-49bc-84bb-130fd42ede51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3d051e2-c3') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 16:03:07 user nova-compute[75337]: DEBUG os_vif [None req-7707b62e-73ac-4629-b0fd-6c9d7b7033c5 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:b4:bf,bridge_name='br-int',has_traffic_filtering=True,id=c3d051e2-c3b7-4ee0-aab0-dcf3c0d1d578,network=Network(8b217731-de9e-49bc-84bb-130fd42ede51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3d051e2-c3') {{(pid=75337) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 16:03:07 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:03:07 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc3d051e2-c3, bridge=br-int, if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 16:03:07 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:03:07 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:03:07 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:03:07 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a974a33b-cfe6-4c01-988d-932926cd6c21) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 16:03:07 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:03:07 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:03:07 user nova-compute[75337]: INFO os_vif [None req-7707b62e-73ac-4629-b0fd-6c9d7b7033c5 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:b4:bf,bridge_name='br-int',has_traffic_filtering=True,id=c3d051e2-c3b7-4ee0-aab0-dcf3c0d1d578,network=Network(8b217731-de9e-49bc-84bb-130fd42ede51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3d051e2-c3')
Nov 06 16:03:07 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-7707b62e-73ac-4629-b0fd-6c9d7b7033c5 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] [instance: 69df3824-b28c-43c0-9f20-52fa956642cc] Start _get_guest_xml network_info=[{"id": "c3d051e2-c3b7-4ee0-aab0-dcf3c0d1d578", "address": "fa:16:3e:7e:b4:bf", "network": {"id": "8b217731-de9e-49bc-84bb-130fd42ede51", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-314618758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98fac9096a3b4f21ba805ba1437d9d38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3d051e2-c3", "ovs_interfaceid": "c3d051e2-c3b7-4ee0-aab0-dcf3c0d1d578", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=16b903ae-a40f-41a7-985b-4804cce92c62,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'guest_format': None, 'size': 0, 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '16b903ae-a40f-41a7-985b-4804cce92c62'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 16:03:07 user nova-compute[75337]: DEBUG nova.objects.instance [None req-7707b62e-73ac-4629-b0fd-6c9d7b7033c5 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Lazy-loading 'numa_topology' on Instance uuid 69df3824-b28c-43c0-9f20-52fa956642cc {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 16:03:07 user nova-compute[75337]: DEBUG nova.objects.base [None req-7707b62e-73ac-4629-b0fd-6c9d7b7033c5 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Object Instance<69df3824-b28c-43c0-9f20-52fa956642cc> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=75337) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 16:03:07 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-7707b62e-73ac-4629-b0fd-6c9d7b7033c5 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 16:03:07 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-7707b62e-73ac-4629-b0fd-6c9d7b7033c5 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 16:03:07 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-7707b62e-73ac-4629-b0fd-6c9d7b7033c5 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 16:03:07 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-7707b62e-73ac-4629-b0fd-6c9d7b7033c5 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] CPU controller missing on host. {{(pid=75337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 16:03:07 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-7707b62e-73ac-4629-b0fd-6c9d7b7033c5 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 16:03:07 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-7707b62e-73ac-4629-b0fd-6c9d7b7033c5 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] CPU controller found on host. {{(pid=75337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 16:03:07 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-7707b62e-73ac-4629-b0fd-6c9d7b7033c5 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75337) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 16:03:07 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-7707b62e-73ac-4629-b0fd-6c9d7b7033c5 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T15:34:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=16b903ae-a40f-41a7-985b-4804cce92c62,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 16:03:07 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-7707b62e-73ac-4629-b0fd-6c9d7b7033c5 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Flavor limits 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 16:03:07 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-7707b62e-73ac-4629-b0fd-6c9d7b7033c5 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Image limits 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 16:03:07 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-7707b62e-73ac-4629-b0fd-6c9d7b7033c5 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Flavor pref 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 16:03:07 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-7707b62e-73ac-4629-b0fd-6c9d7b7033c5 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Image pref 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 16:03:07 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-7707b62e-73ac-4629-b0fd-6c9d7b7033c5 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 16:03:07 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-7707b62e-73ac-4629-b0fd-6c9d7b7033c5 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 16:03:07 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-7707b62e-73ac-4629-b0fd-6c9d7b7033c5 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 16:03:07 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-7707b62e-73ac-4629-b0fd-6c9d7b7033c5 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Got 1 possible topologies {{(pid=75337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 16:03:07 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-7707b62e-73ac-4629-b0fd-6c9d7b7033c5 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 16:03:07 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-7707b62e-73ac-4629-b0fd-6c9d7b7033c5 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 16:03:07 user nova-compute[75337]: DEBUG nova.objects.instance [None req-7707b62e-73ac-4629-b0fd-6c9d7b7033c5 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Lazy-loading 'vcpu_model' on Instance uuid 69df3824-b28c-43c0-9f20-52fa956642cc {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 16:03:07 user nova-compute[75337]: DEBUG nova.objects.base [None req-7707b62e-73ac-4629-b0fd-6c9d7b7033c5 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Object Instance<69df3824-b28c-43c0-9f20-52fa956642cc> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=75337) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 16:03:07 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-7707b62e-73ac-4629-b0fd-6c9d7b7033c5 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T15:54:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1515449710',display_name='tempest-AttachVolumeTestJSON-server-1515449710',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1515449710',id=32,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOuljMPp9i9MDAKWBD5G58tmj+9Tb6PUeli8EGD2jPfBvIyOYYOj/xbR7lXnFQzbgbAGvrz08EfcDEZH0CAoflAb7Id49fT3SM4gKBFBAbvsmqhfX3tP82mW2VMhPkafYg==',key_name='tempest-keypair-396223312',keypairs=<?>,launch_index=0,launched_at=2023-11-06T15:54:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='98fac9096a3b4f21ba805ba1437d9d38',ramdisk_id='',reservation_id='r-ynykuy84',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-636759182',owner_user_name='tempest-AttachVolumeTestJSON-636759182-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T16:01:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ef1008574bea4cfca8a20b2edcf0aacd',uuid=69df3824-b28c-43c0-9f20-52fa956642cc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "c3d051e2-c3b7-4ee0-aab0-dcf3c0d1d578", "address": "fa:16:3e:7e:b4:bf", "network": {"id": "8b217731-de9e-49bc-84bb-130fd42ede51", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-314618758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98fac9096a3b4f21ba805ba1437d9d38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3d051e2-c3", "ovs_interfaceid": "c3d051e2-c3b7-4ee0-aab0-dcf3c0d1d578", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75337) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 16:03:07 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-7707b62e-73ac-4629-b0fd-6c9d7b7033c5 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Converting VIF {"id": "c3d051e2-c3b7-4ee0-aab0-dcf3c0d1d578", "address": "fa:16:3e:7e:b4:bf", "network": {"id": "8b217731-de9e-49bc-84bb-130fd42ede51", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-314618758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98fac9096a3b4f21ba805ba1437d9d38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3d051e2-c3", "ovs_interfaceid": "c3d051e2-c3b7-4ee0-aab0-dcf3c0d1d578", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 16:03:07 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-7707b62e-73ac-4629-b0fd-6c9d7b7033c5 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:b4:bf,bridge_name='br-int',has_traffic_filtering=True,id=c3d051e2-c3b7-4ee0-aab0-dcf3c0d1d578,network=Network(8b217731-de9e-49bc-84bb-130fd42ede51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3d051e2-c3') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 16:03:07 user nova-compute[75337]: DEBUG nova.objects.instance [None req-7707b62e-73ac-4629-b0fd-6c9d7b7033c5 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Lazy-loading 'pci_devices' on Instance uuid 69df3824-b28c-43c0-9f20-52fa956642cc {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 16:03:07 user nova-compute[75337]: DEBUG nova.objects.base [None req-7707b62e-73ac-4629-b0fd-6c9d7b7033c5 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Object Instance<69df3824-b28c-43c0-9f20-52fa956642cc> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=75337) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 16:03:07 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-7707b62e-73ac-4629-b0fd-6c9d7b7033c5 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] [instance: 69df3824-b28c-43c0-9f20-52fa956642cc] End _get_guest_xml xml=<domain type="kvm">
Nov 06 16:03:07 user nova-compute[75337]:   <uuid>69df3824-b28c-43c0-9f20-52fa956642cc</uuid>
Nov 06 16:03:07 user nova-compute[75337]:   <name>instance-00000020</name>
Nov 06 16:03:07 user nova-compute[75337]:   <memory>524288</memory>
Nov 06 16:03:07 user nova-compute[75337]:   <vcpu>1</vcpu>
Nov 06 16:03:07 user nova-compute[75337]:   <metadata>
Nov 06 16:03:07 user nova-compute[75337]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 16:03:07 user nova-compute[75337]:       <nova:package version="0.0.0"/>
Nov 06 16:03:07 user nova-compute[75337]:       <nova:name>tempest-AttachVolumeTestJSON-server-1515449710</nova:name>
Nov 06 16:03:07 user nova-compute[75337]:       <nova:creationTime>2023-11-06 16:03:07</nova:creationTime>
Nov 06 16:03:07 user nova-compute[75337]:       <nova:flavor name="m1.tiny">
Nov 06 16:03:07 user nova-compute[75337]:         <nova:memory>512</nova:memory>
Nov 06 16:03:07 user nova-compute[75337]:         <nova:disk>1</nova:disk>
Nov 06 16:03:07 user nova-compute[75337]:         <nova:swap>0</nova:swap>
Nov 06 16:03:07 user nova-compute[75337]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 16:03:07 user nova-compute[75337]:         <nova:vcpus>1</nova:vcpus>
Nov 06 16:03:07 user nova-compute[75337]:       </nova:flavor>
Nov 06 16:03:07 user nova-compute[75337]:       <nova:owner>
Nov 06 16:03:07 user nova-compute[75337]:         <nova:user uuid="ef1008574bea4cfca8a20b2edcf0aacd">tempest-AttachVolumeTestJSON-636759182-project-member</nova:user>
Nov 06 16:03:07 user nova-compute[75337]:         <nova:project uuid="98fac9096a3b4f21ba805ba1437d9d38">tempest-AttachVolumeTestJSON-636759182</nova:project>
Nov 06 16:03:07 user nova-compute[75337]:       </nova:owner>
Nov 06 16:03:07 user nova-compute[75337]:       <nova:root type="image" uuid="16b903ae-a40f-41a7-985b-4804cce92c62"/>
Nov 06 16:03:07 user nova-compute[75337]:       <nova:ports>
Nov 06 16:03:07 user nova-compute[75337]:         <nova:port uuid="c3d051e2-c3b7-4ee0-aab0-dcf3c0d1d578">
Nov 06 16:03:07 user nova-compute[75337]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 06 16:03:07 user nova-compute[75337]:         </nova:port>
Nov 06 16:03:07 user nova-compute[75337]:       </nova:ports>
Nov 06 16:03:07 user nova-compute[75337]:     </nova:instance>
Nov 06 16:03:07 user nova-compute[75337]:   </metadata>
Nov 06 16:03:07 user nova-compute[75337]:   <sysinfo type="smbios">
Nov 06 16:03:07 user nova-compute[75337]:     <system>
Nov 06 16:03:07 user nova-compute[75337]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 16:03:07 user nova-compute[75337]:       <entry name="product">OpenStack Nova</entry>
Nov 06 16:03:07 user nova-compute[75337]:       <entry name="version">0.0.0</entry>
Nov 06 16:03:07 user nova-compute[75337]:       <entry name="serial">69df3824-b28c-43c0-9f20-52fa956642cc</entry>
Nov 06 16:03:07 user nova-compute[75337]:       <entry name="uuid">69df3824-b28c-43c0-9f20-52fa956642cc</entry>
Nov 06 16:03:07 user nova-compute[75337]:       <entry name="family">Virtual Machine</entry>
Nov 06 16:03:07 user nova-compute[75337]:     </system>
Nov 06 16:03:07 user nova-compute[75337]:   </sysinfo>
Nov 06 16:03:07 user nova-compute[75337]:   <os>
Nov 06 16:03:07 user nova-compute[75337]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 16:03:07 user nova-compute[75337]:     <boot dev="hd"/>
Nov 06 16:03:07 user nova-compute[75337]:     <smbios mode="sysinfo"/>
Nov 06 16:03:07 user nova-compute[75337]:   </os>
Nov 06 16:03:07 user nova-compute[75337]:   <features>
Nov 06 16:03:07 user nova-compute[75337]:     <acpi/>
Nov 06 16:03:07 user nova-compute[75337]:     <apic/>
Nov 06 16:03:07 user nova-compute[75337]:     <vmcoreinfo/>
Nov 06 16:03:07 user nova-compute[75337]:   </features>
Nov 06 16:03:07 user nova-compute[75337]:   <clock offset="utc">
Nov 06 16:03:07 user nova-compute[75337]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 16:03:07 user nova-compute[75337]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 16:03:07 user nova-compute[75337]:     <timer name="hpet" present="no"/>
Nov 06 16:03:07 user nova-compute[75337]:   </clock>
Nov 06 16:03:07 user nova-compute[75337]:   <cpu mode="custom" match="exact">
Nov 06 16:03:07 user nova-compute[75337]:     <model>Nehalem</model>
Nov 06 16:03:07 user nova-compute[75337]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 16:03:07 user nova-compute[75337]:   </cpu>
Nov 06 16:03:07 user nova-compute[75337]:   <devices>
Nov 06 16:03:07 user nova-compute[75337]:     <disk type="file" device="disk">
Nov 06 16:03:07 user nova-compute[75337]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 16:03:07 user nova-compute[75337]:       <source file="/opt/stack/data/nova/instances/69df3824-b28c-43c0-9f20-52fa956642cc/disk"/>
Nov 06 16:03:07 user nova-compute[75337]:       <target dev="vda" bus="virtio"/>
Nov 06 16:03:07 user nova-compute[75337]:     </disk>
Nov 06 16:03:07 user nova-compute[75337]:     <interface type="ethernet">
Nov 06 16:03:07 user nova-compute[75337]:       <mac address="fa:16:3e:7e:b4:bf"/>
Nov 06 16:03:07 user nova-compute[75337]:       <model type="virtio"/>
Nov 06 16:03:07 user nova-compute[75337]:       <mtu size="1442"/>
Nov 06 16:03:07 user nova-compute[75337]:       <target dev="tapc3d051e2-c3"/>
Nov 06 16:03:07 user nova-compute[75337]:     </interface>
Nov 06 16:03:07 user nova-compute[75337]:     <serial type="pty">
Nov 06 16:03:07 user nova-compute[75337]:       <log file="/opt/stack/data/nova/instances/69df3824-b28c-43c0-9f20-52fa956642cc/console.log" append="off"/>
Nov 06 16:03:07 user nova-compute[75337]:     </serial>
Nov 06 16:03:07 user nova-compute[75337]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 16:03:07 user nova-compute[75337]:     <video>
Nov 06 16:03:07 user nova-compute[75337]:       <model type="virtio"/>
Nov 06 16:03:07 user nova-compute[75337]:     </video>
Nov 06 16:03:07 user nova-compute[75337]:     <rng model="virtio">
Nov 06 16:03:07 user nova-compute[75337]:       <backend model="random">/dev/urandom</backend>
Nov 06 16:03:07 user nova-compute[75337]:     </rng>
Nov 06 16:03:07 user nova-compute[75337]:     <controller type="usb" index="0" model="none"/>
Nov 06 16:03:07 user nova-compute[75337]:     <memballoon model="virtio">
Nov 06 16:03:07 user nova-compute[75337]:       <stats period="10"/>
Nov 06 16:03:07 user nova-compute[75337]:     </memballoon>
Nov 06 16:03:07 user nova-compute[75337]:   </devices>
Nov 06 16:03:07 user nova-compute[75337]: </domain>
Nov 06 16:03:07 user nova-compute[75337]:  {{(pid=75337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 16:03:07 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-7707b62e-73ac-4629-b0fd-6c9d7b7033c5 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69df3824-b28c-43c0-9f20-52fa956642cc/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:03:07 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-7707b62e-73ac-4629-b0fd-6c9d7b7033c5 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69df3824-b28c-43c0-9f20-52fa956642cc/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:03:07 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-7707b62e-73ac-4629-b0fd-6c9d7b7033c5 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69df3824-b28c-43c0-9f20-52fa956642cc/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:03:07 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:03:07 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:03:07 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75337) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 16:03:07 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-7707b62e-73ac-4629-b0fd-6c9d7b7033c5 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69df3824-b28c-43c0-9f20-52fa956642cc/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:03:07 user nova-compute[75337]: DEBUG nova.objects.instance [None req-7707b62e-73ac-4629-b0fd-6c9d7b7033c5 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Lazy-loading 'trusted_certs' on Instance uuid 69df3824-b28c-43c0-9f20-52fa956642cc {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 16:03:07 user nova-compute[75337]: DEBUG nova.objects.base [None req-7707b62e-73ac-4629-b0fd-6c9d7b7033c5 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Object Instance<69df3824-b28c-43c0-9f20-52fa956642cc> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=75337) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 16:03:07 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-7707b62e-73ac-4629-b0fd-6c9d7b7033c5 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:03:07 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-7707b62e-73ac-4629-b0fd-6c9d7b7033c5 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json" returned: 0 in 0.202s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:03:07 user nova-compute[75337]: DEBUG nova.virt.disk.api [None req-7707b62e-73ac-4629-b0fd-6c9d7b7033c5 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Checking if we can resize image /opt/stack/data/nova/instances/69df3824-b28c-43c0-9f20-52fa956642cc/disk. size=1073741824 {{(pid=75337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 16:03:07 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-7707b62e-73ac-4629-b0fd-6c9d7b7033c5 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69df3824-b28c-43c0-9f20-52fa956642cc/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:03:07 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-7707b62e-73ac-4629-b0fd-6c9d7b7033c5 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69df3824-b28c-43c0-9f20-52fa956642cc/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:03:07 user nova-compute[75337]: DEBUG nova.virt.disk.api [None req-7707b62e-73ac-4629-b0fd-6c9d7b7033c5 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Cannot resize image /opt/stack/data/nova/instances/69df3824-b28c-43c0-9f20-52fa956642cc/disk to a smaller size. {{(pid=75337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 06 16:03:07 user nova-compute[75337]: DEBUG nova.objects.instance [None req-7707b62e-73ac-4629-b0fd-6c9d7b7033c5 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Lazy-loading 'migration_context' on Instance uuid 69df3824-b28c-43c0-9f20-52fa956642cc {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 16:03:07 user nova-compute[75337]: DEBUG nova.objects.base [None req-7707b62e-73ac-4629-b0fd-6c9d7b7033c5 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Object Instance<69df3824-b28c-43c0-9f20-52fa956642cc> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75337) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 16:03:07 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-7707b62e-73ac-4629-b0fd-6c9d7b7033c5 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T15:54:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1515449710',display_name='tempest-AttachVolumeTestJSON-server-1515449710',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1515449710',id=32,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOuljMPp9i9MDAKWBD5G58tmj+9Tb6PUeli8EGD2jPfBvIyOYYOj/xbR7lXnFQzbgbAGvrz08EfcDEZH0CAoflAb7Id49fT3SM4gKBFBAbvsmqhfX3tP82mW2VMhPkafYg==',key_name='tempest-keypair-396223312',keypairs=<?>,launch_index=0,launched_at=2023-11-06T15:54:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='98fac9096a3b4f21ba805ba1437d9d38',ramdisk_id='',reservation_id='r-ynykuy84',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-636759182',owner_user_name='tempest-AttachVolumeTestJSON-636759182-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T16:01:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ef1008574bea4cfca8a20b2edcf0aacd',uuid=69df3824-b28c-43c0-9f20-52fa956642cc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "c3d051e2-c3b7-4ee0-aab0-dcf3c0d1d578", "address": "fa:16:3e:7e:b4:bf", "network": {"id": "8b217731-de9e-49bc-84bb-130fd42ede51", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-314618758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98fac9096a3b4f21ba805ba1437d9d38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3d051e2-c3", "ovs_interfaceid": "c3d051e2-c3b7-4ee0-aab0-dcf3c0d1d578", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 16:03:07 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-7707b62e-73ac-4629-b0fd-6c9d7b7033c5 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Converting VIF {"id": "c3d051e2-c3b7-4ee0-aab0-dcf3c0d1d578", "address": "fa:16:3e:7e:b4:bf", "network": {"id": "8b217731-de9e-49bc-84bb-130fd42ede51", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-314618758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98fac9096a3b4f21ba805ba1437d9d38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3d051e2-c3", "ovs_interfaceid": "c3d051e2-c3b7-4ee0-aab0-dcf3c0d1d578", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 16:03:07 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-7707b62e-73ac-4629-b0fd-6c9d7b7033c5 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:b4:bf,bridge_name='br-int',has_traffic_filtering=True,id=c3d051e2-c3b7-4ee0-aab0-dcf3c0d1d578,network=Network(8b217731-de9e-49bc-84bb-130fd42ede51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3d051e2-c3') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 16:03:07 user nova-compute[75337]: DEBUG os_vif [None req-7707b62e-73ac-4629-b0fd-6c9d7b7033c5 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:b4:bf,bridge_name='br-int',has_traffic_filtering=True,id=c3d051e2-c3b7-4ee0-aab0-dcf3c0d1d578,network=Network(8b217731-de9e-49bc-84bb-130fd42ede51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3d051e2-c3') {{(pid=75337) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 16:03:07 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:03:07 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 16:03:07 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 16:03:07 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:03:07 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a1c5462e-d3d3-518f-b0be-d8b7089a6f60', '_type': 'linux-noop'}}, row=False) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 16:03:07 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:03:07 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:03:08 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:03:08 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc3d051e2-c3, may_exist=True, interface_attrs={}) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 16:03:08 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc3d051e2-c3, col_values=(('qos', UUID('5f437363-4062-4190-be8b-f3e57964465b')),), if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 16:03:08 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc3d051e2-c3, col_values=(('external_ids', {'iface-id': 'c3d051e2-c3b7-4ee0-aab0-dcf3c0d1d578', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7e:b4:bf', 'vm-uuid': '69df3824-b28c-43c0-9f20-52fa956642cc'}),), if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 16:03:08 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:03:08 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:03:08 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:03:08 user nova-compute[75337]: INFO os_vif [None req-7707b62e-73ac-4629-b0fd-6c9d7b7033c5 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:b4:bf,bridge_name='br-int',has_traffic_filtering=True,id=c3d051e2-c3b7-4ee0-aab0-dcf3c0d1d578,network=Network(8b217731-de9e-49bc-84bb-130fd42ede51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3d051e2-c3')
Nov 06 16:03:09 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:03:09 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:03:09 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:03:09 user nova-compute[75337]: DEBUG nova.compute.manager [req-0aec5583-9b8d-4e8a-a5a5-b44508bed0b2 req-b6304fe9-f4e6-4828-8650-b195584b841e service nova] [instance: 69df3824-b28c-43c0-9f20-52fa956642cc] Received event network-vif-plugged-c3d051e2-c3b7-4ee0-aab0-dcf3c0d1d578 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:03:09 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-0aec5583-9b8d-4e8a-a5a5-b44508bed0b2 req-b6304fe9-f4e6-4828-8650-b195584b841e service nova] Acquiring lock "69df3824-b28c-43c0-9f20-52fa956642cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:03:09 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-0aec5583-9b8d-4e8a-a5a5-b44508bed0b2 req-b6304fe9-f4e6-4828-8650-b195584b841e service nova] Lock "69df3824-b28c-43c0-9f20-52fa956642cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:03:09 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-0aec5583-9b8d-4e8a-a5a5-b44508bed0b2 req-b6304fe9-f4e6-4828-8650-b195584b841e service nova] Lock "69df3824-b28c-43c0-9f20-52fa956642cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:03:09 user nova-compute[75337]: DEBUG nova.compute.manager [req-0aec5583-9b8d-4e8a-a5a5-b44508bed0b2 req-b6304fe9-f4e6-4828-8650-b195584b841e service nova] [instance: 69df3824-b28c-43c0-9f20-52fa956642cc] No waiting events found dispatching network-vif-plugged-c3d051e2-c3b7-4ee0-aab0-dcf3c0d1d578 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 16:03:09 user nova-compute[75337]: WARNING nova.compute.manager [req-0aec5583-9b8d-4e8a-a5a5-b44508bed0b2 req-b6304fe9-f4e6-4828-8650-b195584b841e service nova] [instance: 69df3824-b28c-43c0-9f20-52fa956642cc] Received unexpected event network-vif-plugged-c3d051e2-c3b7-4ee0-aab0-dcf3c0d1d578 for instance with vm_state stopped and task_state powering-on.
Nov 06 16:03:09 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:03:09 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:03:11 user nova-compute[75337]: DEBUG nova.compute.manager [None req-7707b62e-73ac-4629-b0fd-6c9d7b7033c5 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] [instance: 69df3824-b28c-43c0-9f20-52fa956642cc] Instance event wait completed in 0 seconds for  {{(pid=75337) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 16:03:11 user nova-compute[75337]: INFO nova.virt.libvirt.driver [-] [instance: 69df3824-b28c-43c0-9f20-52fa956642cc] Instance rebooted successfully.
Nov 06 16:03:11 user nova-compute[75337]: DEBUG nova.compute.manager [None req-7707b62e-73ac-4629-b0fd-6c9d7b7033c5 tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] [instance: 69df3824-b28c-43c0-9f20-52fa956642cc] Checking state {{(pid=75337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 16:03:11 user nova-compute[75337]: DEBUG nova.compute.manager [req-8ef4c3f8-a34e-4bc4-a673-40cbd9e8fdf5 req-e3b3672c-3208-4953-9383-fde21212d5e5 service nova] [instance: 69df3824-b28c-43c0-9f20-52fa956642cc] Received event network-vif-plugged-c3d051e2-c3b7-4ee0-aab0-dcf3c0d1d578 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:03:11 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-8ef4c3f8-a34e-4bc4-a673-40cbd9e8fdf5 req-e3b3672c-3208-4953-9383-fde21212d5e5 service nova] Acquiring lock "69df3824-b28c-43c0-9f20-52fa956642cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:03:11 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-8ef4c3f8-a34e-4bc4-a673-40cbd9e8fdf5 req-e3b3672c-3208-4953-9383-fde21212d5e5 service nova] Lock "69df3824-b28c-43c0-9f20-52fa956642cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:03:11 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-8ef4c3f8-a34e-4bc4-a673-40cbd9e8fdf5 req-e3b3672c-3208-4953-9383-fde21212d5e5 service nova] Lock "69df3824-b28c-43c0-9f20-52fa956642cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:03:11 user nova-compute[75337]: DEBUG nova.compute.manager [req-8ef4c3f8-a34e-4bc4-a673-40cbd9e8fdf5 req-e3b3672c-3208-4953-9383-fde21212d5e5 service nova] [instance: 69df3824-b28c-43c0-9f20-52fa956642cc] No waiting events found dispatching network-vif-plugged-c3d051e2-c3b7-4ee0-aab0-dcf3c0d1d578 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 16:03:11 user nova-compute[75337]: WARNING nova.compute.manager [req-8ef4c3f8-a34e-4bc4-a673-40cbd9e8fdf5 req-e3b3672c-3208-4953-9383-fde21212d5e5 service nova] [instance: 69df3824-b28c-43c0-9f20-52fa956642cc] Received unexpected event network-vif-plugged-c3d051e2-c3b7-4ee0-aab0-dcf3c0d1d578 for instance with vm_state active and task_state None.
Nov 06 16:03:11 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:03:12 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:03:13 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:03:14 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:03:15 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:03:15 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:03:16 user nova-compute[75337]: DEBUG nova.compute.manager [req-3c4c938a-74d7-4173-aa05-fba649880607 req-4577e00b-5f98-48c7-be81-3e6e2d14dcd2 service nova] [instance: 01b61f9a-2591-4714-b18e-54f674a441ab] Received event network-changed-b5784ac8-0dc1-41ef-bb91-1e6b7d8a61fe {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:03:16 user nova-compute[75337]: DEBUG nova.compute.manager [req-3c4c938a-74d7-4173-aa05-fba649880607 req-4577e00b-5f98-48c7-be81-3e6e2d14dcd2 service nova] [instance: 01b61f9a-2591-4714-b18e-54f674a441ab] Refreshing instance network info cache due to event network-changed-b5784ac8-0dc1-41ef-bb91-1e6b7d8a61fe. {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 16:03:16 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-3c4c938a-74d7-4173-aa05-fba649880607 req-4577e00b-5f98-48c7-be81-3e6e2d14dcd2 service nova] Acquiring lock "refresh_cache-01b61f9a-2591-4714-b18e-54f674a441ab" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 16:03:16 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-3c4c938a-74d7-4173-aa05-fba649880607 req-4577e00b-5f98-48c7-be81-3e6e2d14dcd2 service nova] Acquired lock "refresh_cache-01b61f9a-2591-4714-b18e-54f674a441ab" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 16:03:16 user nova-compute[75337]: DEBUG nova.network.neutron [req-3c4c938a-74d7-4173-aa05-fba649880607 req-4577e00b-5f98-48c7-be81-3e6e2d14dcd2 service nova] [instance: 01b61f9a-2591-4714-b18e-54f674a441ab] Refreshing network info cache for port b5784ac8-0dc1-41ef-bb91-1e6b7d8a61fe {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 16:03:16 user nova-compute[75337]: DEBUG nova.network.neutron [req-3c4c938a-74d7-4173-aa05-fba649880607 req-4577e00b-5f98-48c7-be81-3e6e2d14dcd2 service nova] [instance: 01b61f9a-2591-4714-b18e-54f674a441ab] Updated VIF entry in instance network info cache for port b5784ac8-0dc1-41ef-bb91-1e6b7d8a61fe. {{(pid=75337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 16:03:16 user nova-compute[75337]: DEBUG nova.network.neutron [req-3c4c938a-74d7-4173-aa05-fba649880607 req-4577e00b-5f98-48c7-be81-3e6e2d14dcd2 service nova] [instance: 01b61f9a-2591-4714-b18e-54f674a441ab] Updating instance_info_cache with network_info: [{"id": "b5784ac8-0dc1-41ef-bb91-1e6b7d8a61fe", "address": "fa:16:3e:2c:49:a1", "network": {"id": "df5f1c2e-c934-4237-aee6-f070a198c4ac", "bridge": "br-int", "label": "tempest-TestStampPattern-1883369969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37b65a37b3ac4a92af0279d7ef3b9637", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5784ac8-0d", "ovs_interfaceid": "b5784ac8-0dc1-41ef-bb91-1e6b7d8a61fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 16:03:16 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-3c4c938a-74d7-4173-aa05-fba649880607 req-4577e00b-5f98-48c7-be81-3e6e2d14dcd2 service nova] Releasing lock "refresh_cache-01b61f9a-2591-4714-b18e-54f674a441ab" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 16:03:16 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-29da9883-70f4-46a0-8258-8bbfae9c47fa tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Acquiring lock "01b61f9a-2591-4714-b18e-54f674a441ab" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:03:16 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-29da9883-70f4-46a0-8258-8bbfae9c47fa tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Lock "01b61f9a-2591-4714-b18e-54f674a441ab" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:03:16 user nova-compute[75337]: DEBUG nova.objects.instance [None req-29da9883-70f4-46a0-8258-8bbfae9c47fa tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Lazy-loading 'flavor' on Instance uuid 01b61f9a-2591-4714-b18e-54f674a441ab {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 16:03:16 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-29da9883-70f4-46a0-8258-8bbfae9c47fa tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Lock "01b61f9a-2591-4714-b18e-54f674a441ab" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:03:17 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-29da9883-70f4-46a0-8258-8bbfae9c47fa tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Acquiring lock "01b61f9a-2591-4714-b18e-54f674a441ab" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:03:17 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-29da9883-70f4-46a0-8258-8bbfae9c47fa tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Lock "01b61f9a-2591-4714-b18e-54f674a441ab" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:03:17 user nova-compute[75337]: INFO nova.compute.manager [None req-29da9883-70f4-46a0-8258-8bbfae9c47fa tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] [instance: 01b61f9a-2591-4714-b18e-54f674a441ab] Attaching volume 04dfdd40-f3fc-4409-87e2-1b284cd27a35 to /dev/vdb
Nov 06 16:03:17 user nova-compute[75337]: DEBUG os_brick.utils [None req-29da9883-70f4-46a0-8258-8bbfae9c47fa tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 16:03:17 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:03:17 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:03:17 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[70f54940-d824-44eb-bcb6-1b55ac6e6936]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4ff6411e45b8\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:03:17 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:03:17 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:03:17 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b36d068-2cee-45c8-828d-d429f136c7d1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:03:17 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:03:17 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:03:17 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[8382737a-7efe-4e25-9165-930d355356ef]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:03:17 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d5896ef-6bd0-42d5-957c-1f469efda62f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:03:17 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-29da9883-70f4-46a0-8258-8bbfae9c47fa tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Running cmd (subprocess): nvme version {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:03:17 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-29da9883-70f4-46a0-8258-8bbfae9c47fa tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] 'nvme version' failed. Not Retrying. {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 16:03:17 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.nvmeof [None req-29da9883-70f4-46a0-8258-8bbfae9c47fa tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] nvme not present on system {{(pid=75337) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 16:03:17 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:03:17 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 16:03:17 user nova-compute[75337]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 16:03:17 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[8044a77d-c29b-4856-8047-106098024fbe]: (4, '') {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:03:17 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.lightos [None req-29da9883-70f4-46a0-8258-8bbfae9c47fa tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75337) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 16:03:17 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.lightos [None req-29da9883-70f4-46a0-8258-8bbfae9c47fa tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 16:03:17 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.lightos [None req-29da9883-70f4-46a0-8258-8bbfae9c47fa tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] LIGHTOS: no hostnqn found. {{(pid=75337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 16:03:17 user nova-compute[75337]: DEBUG os_brick.utils [None req-29da9883-70f4-46a0-8258-8bbfae9c47fa tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4ff6411e45b8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 16:03:17 user nova-compute[75337]: DEBUG nova.virt.block_device [None req-29da9883-70f4-46a0-8258-8bbfae9c47fa tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] [instance: 01b61f9a-2591-4714-b18e-54f674a441ab] Updating existing volume attachment record: 8f2a21f3-2f76-4fab-8e60-f8e7b0761d13 {{(pid=75337) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 16:03:17 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:03:17 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:03:18 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:03:19 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:03:21 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:03:21 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Starting heal instance info cache {{(pid=75337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 16:03:21 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "refresh_cache-5d479c64-055b-4496-b3a2-ba10f9095ea8" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 16:03:21 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquired lock "refresh_cache-5d479c64-055b-4496-b3a2-ba10f9095ea8" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 16:03:21 user nova-compute[75337]: DEBUG nova.network.neutron [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] [instance: 5d479c64-055b-4496-b3a2-ba10f9095ea8] Forcefully refreshing network info cache for instance {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 16:03:22 user nova-compute[75337]: DEBUG nova.network.neutron [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] [instance: 5d479c64-055b-4496-b3a2-ba10f9095ea8] Updating instance_info_cache with network_info: [{"id": "cf2938cc-3588-4aea-8cb9-e0117e78a628", "address": "fa:16:3e:74:b7:02", "network": {"id": "53be211e-34f3-4a33-b5dc-7b7a0c2fb280", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-504725466-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93b47bd7e8214b4f9d7f930e6f4b5dea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf2938cc-35", "ovs_interfaceid": "cf2938cc-3588-4aea-8cb9-e0117e78a628", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 16:03:22 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Releasing lock "refresh_cache-5d479c64-055b-4496-b3a2-ba10f9095ea8" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 16:03:22 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] [instance: 5d479c64-055b-4496-b3a2-ba10f9095ea8] Updated the network info_cache for instance {{(pid=75337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 16:03:22 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager.update_available_resource {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:03:22 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:03:22 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:03:22 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:03:22 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Auditing locally available compute resources for user (node: user) {{(pid=75337) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 16:03:22 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69df3824-b28c-43c0-9f20-52fa956642cc/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:03:22 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69df3824-b28c-43c0-9f20-52fa956642cc/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:03:22 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69df3824-b28c-43c0-9f20-52fa956642cc/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:03:23 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:03:23 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69df3824-b28c-43c0-9f20-52fa956642cc/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:03:23 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 16:03:23 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01b61f9a-2591-4714-b18e-54f674a441ab/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:03:23 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01b61f9a-2591-4714-b18e-54f674a441ab/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:03:23 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01b61f9a-2591-4714-b18e-54f674a441ab/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:03:23 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01b61f9a-2591-4714-b18e-54f674a441ab/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:03:23 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 16:03:23 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6110b34a-6fd3-45fc-911d-4e5d3c7f2d78/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:03:23 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6110b34a-6fd3-45fc-911d-4e5d3c7f2d78/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:03:23 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6110b34a-6fd3-45fc-911d-4e5d3c7f2d78/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:03:23 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6110b34a-6fd3-45fc-911d-4e5d3c7f2d78/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:03:23 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba20919c-b506-458e-ac17-70bcb8900bb7/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:03:24 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba20919c-b506-458e-ac17-70bcb8900bb7/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:03:24 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba20919c-b506-458e-ac17-70bcb8900bb7/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:03:24 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba20919c-b506-458e-ac17-70bcb8900bb7/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:03:24 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d479c64-055b-4496-b3a2-ba10f9095ea8/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:03:24 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d479c64-055b-4496-b3a2-ba10f9095ea8/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:03:24 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d479c64-055b-4496-b3a2-ba10f9095ea8/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:03:24 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:03:24 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d479c64-055b-4496-b3a2-ba10f9095ea8/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:03:25 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 16:03:25 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 16:03:25 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Hypervisor/Node resource view: name=user free_ram=7965MB free_disk=25.08386993408203GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75337) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 16:03:25 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:03:25 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:03:25 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 6110b34a-6fd3-45fc-911d-4e5d3c7f2d78 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 16:03:25 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 69df3824-b28c-43c0-9f20-52fa956642cc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 16:03:25 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 5d479c64-055b-4496-b3a2-ba10f9095ea8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 16:03:25 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance e558736d-848f-4a79-a7aa-1e46638a85dc actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 16:03:25 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 01b61f9a-2591-4714-b18e-54f674a441ab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 16:03:25 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 85c56287-3140-4125-a316-0c652cc0f18a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 16:03:25 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance ba20919c-b506-458e-ac17-70bcb8900bb7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 16:03:25 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 16:03:25 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 16:03:25 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 16:03:25 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 16:03:25 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Compute_service record updated for user:user {{(pid=75337) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 16:03:25 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.415s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:03:28 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:03:29 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:03:33 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:03:34 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:03:38 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:03:39 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:03:39 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29da9883-70f4-46a0-8258-8bbfae9c47fa tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] [instance: 01b61f9a-2591-4714-b18e-54f674a441ab] Calling os-brick to attach iSCSI Volume {{(pid=75337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 16:03:39 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-29da9883-70f4-46a0-8258-8bbfae9c47fa tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2abc33d0c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:04dfdd40-f3fc-4409-87e2-1b284cd27a35', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CedVpYKZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 16:03:39 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-29da9883-70f4-46a0-8258-8bbfae9c47fa tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 16:03:39 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-29da9883-70f4-46a0-8258-8bbfae9c47fa tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 16:03:39 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-29da9883-70f4-46a0-8258-8bbfae9c47fa tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 16:03:39 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-29da9883-70f4-46a0-8258-8bbfae9c47fa tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 16:03:39 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-29da9883-70f4-46a0-8258-8bbfae9c47fa tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:04dfdd40-f3fc-4409-87e2-1b284cd27a35" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 16:03:39 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-29da9883-70f4-46a0-8258-8bbfae9c47fa tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:04dfdd40-f3fc-4409-87e2-1b284cd27a35" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 16:03:39 user nova-compute[75337]: INFO os_brick.initiator.connectors.iscsi [None req-29da9883-70f4-46a0-8258-8bbfae9c47fa tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 16:03:39 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04dfdd40-f3fc-4409-87e2-1b284cd27a35 -p 172.16.0.220:3260 {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:03:39 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04dfdd40-f3fc-4409-87e2-1b284cd27a35 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:03:39 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[a705fd5f-0691-445a-8ac5-8b6a7c3df361]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:03:39 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-29da9883-70f4-46a0-8258-8bbfae9c47fa tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 16:03:39 user nova-compute[75337]:  {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:03:39 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04dfdd40-f3fc-4409-87e2-1b284cd27a35 -p 172.16.0.220:3260 --interface default --op new {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:03:39 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04dfdd40-f3fc-4409-87e2-1b284cd27a35 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:03:39 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0856632-65db-4520-9cef-86e1ccee45fd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:04dfdd40-f3fc-4409-87e2-1b284cd27a35] added\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:03:39 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-29da9883-70f4-46a0-8258-8bbfae9c47fa tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:04dfdd40-f3fc-4409-87e2-1b284cd27a35] added
Nov 06 16:03:39 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:03:39 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04dfdd40-f3fc-4409-87e2-1b284cd27a35 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:03:39 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04dfdd40-f3fc-4409-87e2-1b284cd27a35 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:03:39 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[21aeac7d-7862-444c-8726-cf294bf2de2f]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:03:39 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-29da9883-70f4-46a0-8258-8bbfae9c47fa tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:03:39 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04dfdd40-f3fc-4409-87e2-1b284cd27a35 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:03:39 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04dfdd40-f3fc-4409-87e2-1b284cd27a35 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:03:39 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c8a8d8d-ee4d-4715-98c9-38e1e5c1efd4]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:03:39 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-29da9883-70f4-46a0-8258-8bbfae9c47fa tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:03:39 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04dfdd40-f3fc-4409-87e2-1b284cd27a35 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CedVpYKZ {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:03:40 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04dfdd40-f3fc-4409-87e2-1b284cd27a35 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CedVpYKZ" returned: 0 in 0.024s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:03:40 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb88344c-fe4f-4b92-82c8-e21c8aae8cf4]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:03:40 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-29da9883-70f4-46a0-8258-8bbfae9c47fa tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CedVpYKZ'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:03:40 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04dfdd40-f3fc-4409-87e2-1b284cd27a35 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:03:40 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04dfdd40-f3fc-4409-87e2-1b284cd27a35 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:03:40 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c9a700e-5aec-4c80-8084-e3eb86b0dffe]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:03:40 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-29da9883-70f4-46a0-8258-8bbfae9c47fa tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:03:40 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:03:40 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:03:40 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[a809efae-9217-4820-8773-7dd831945ddf]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15e7bca5-29b3-477d-9332-0fd23668f25c (non-flash)\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:03:40 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-29da9883-70f4-46a0-8258-8bbfae9c47fa tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673 (non-flash)
Nov 06 16:03:40 user nova-compute[75337]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15e7bca5-29b3-477d-9332-0fd23668f25c (non-flash)
Nov 06 16:03:40 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 16:03:40 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-29da9883-70f4-46a0-8258-8bbfae9c47fa tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673 (non-flash)
Nov 06 16:03:40 user nova-compute[75337]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15e7bca5-29b3-477d-9332-0fd23668f25c (non-flash)
Nov 06 16:03:40 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 16:03:40 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04dfdd40-f3fc-4409-87e2-1b284cd27a35 -p 172.16.0.220:3260 --login {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:03:40 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04dfdd40-f3fc-4409-87e2-1b284cd27a35 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:03:40 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6da1561-9187-4263-9f86-e47cf1cb8cc1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:04dfdd40-f3fc-4409-87e2-1b284cd27a35, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:04dfdd40-f3fc-4409-87e2-1b284cd27a35, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:03:40 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-29da9883-70f4-46a0-8258-8bbfae9c47fa tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:04dfdd40-f3fc-4409-87e2-1b284cd27a35, portal: 172.16.0.220,3260]
Nov 06 16:03:40 user nova-compute[75337]: Login to [iface: default, target: iqn.2010-10.org.openstack:04dfdd40-f3fc-4409-87e2-1b284cd27a35, portal: 172.16.0.220,3260] successful.
Nov 06 16:03:40 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:03:40 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04dfdd40-f3fc-4409-87e2-1b284cd27a35 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:03:40 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04dfdd40-f3fc-4409-87e2-1b284cd27a35 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:03:40 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9bb840c-3e94-4a1e-8e3d-b45ba4e027e8]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:03:40 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-29da9883-70f4-46a0-8258-8bbfae9c47fa tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:03:40 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:03:40 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:03:40 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f04a6e9-3229-439d-91b9-d45b8b6a32dc]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15e7bca5-29b3-477d-9332-0fd23668f25c (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04dfdd40-f3fc-4409-87e2-1b284cd27a35 (non-flash)\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:03:40 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-29da9883-70f4-46a0-8258-8bbfae9c47fa tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673 (non-flash)
Nov 06 16:03:40 user nova-compute[75337]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15e7bca5-29b3-477d-9332-0fd23668f25c (non-flash)
Nov 06 16:03:40 user nova-compute[75337]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04dfdd40-f3fc-4409-87e2-1b284cd27a35 (non-flash)
Nov 06 16:03:40 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 16:03:40 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-29da9883-70f4-46a0-8258-8bbfae9c47fa tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673 (non-flash)
Nov 06 16:03:40 user nova-compute[75337]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15e7bca5-29b3-477d-9332-0fd23668f25c (non-flash)
Nov 06 16:03:40 user nova-compute[75337]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04dfdd40-f3fc-4409-87e2-1b284cd27a35 (non-flash)
Nov 06 16:03:40 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 16:03:40 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-29da9883-70f4-46a0-8258-8bbfae9c47fa tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:04dfdd40-f3fc-4409-87e2-1b284cd27a35" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.314s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 16:03:40 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-29da9883-70f4-46a0-8258-8bbfae9c47fa tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Connected to 172.16.0.220:3260 {{(pid=75337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 16:03:40 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-29da9883-70f4-46a0-8258-8bbfae9c47fa tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] HCTL ('35', '-', '-', 0) found on session 45 with lun 0 {{(pid=75337) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 16:03:40 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-29da9883-70f4-46a0-8258-8bbfae9c47fa tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75337) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 16:03:40 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:03:40 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.028s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:03:40 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[81d77cfc-bc84-459e-b9e1-bd619d7c21df]: (4, ('- - 0', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:03:40 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-29da9883-70f4-46a0-8258-8bbfae9c47fa tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Searching for a device in session 45 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75337) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 16:03:40 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-29da9883-70f4-46a0-8258-8bbfae9c47fa tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:04dfdd40-f3fc-4409-87e2-1b284cd27a35', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CedVpYKZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 16:03:40 user nova-compute[75337]: DEBUG nova.compute.manager [req-3f7d710a-cbcb-4fc1-bf27-df7c8ab60efb req-5db003a3-1186-418e-a0e5-a3dd7fef2cf0 service nova] [instance: 85c56287-3140-4125-a316-0c652cc0f18a] Received event network-changed-51662fe4-0156-4111-8e0e-1c330f05d5e6 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:03:40 user nova-compute[75337]: DEBUG nova.compute.manager [req-3f7d710a-cbcb-4fc1-bf27-df7c8ab60efb req-5db003a3-1186-418e-a0e5-a3dd7fef2cf0 service nova] [instance: 85c56287-3140-4125-a316-0c652cc0f18a] Refreshing instance network info cache due to event network-changed-51662fe4-0156-4111-8e0e-1c330f05d5e6. {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 16:03:40 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-3f7d710a-cbcb-4fc1-bf27-df7c8ab60efb req-5db003a3-1186-418e-a0e5-a3dd7fef2cf0 service nova] Acquiring lock "refresh_cache-85c56287-3140-4125-a316-0c652cc0f18a" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 16:03:40 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-3f7d710a-cbcb-4fc1-bf27-df7c8ab60efb req-5db003a3-1186-418e-a0e5-a3dd7fef2cf0 service nova] Acquired lock "refresh_cache-85c56287-3140-4125-a316-0c652cc0f18a" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 16:03:40 user nova-compute[75337]: DEBUG nova.network.neutron [req-3f7d710a-cbcb-4fc1-bf27-df7c8ab60efb req-5db003a3-1186-418e-a0e5-a3dd7fef2cf0 service nova] [instance: 85c56287-3140-4125-a316-0c652cc0f18a] Refreshing network info cache for port 51662fe4-0156-4111-8e0e-1c330f05d5e6 {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 16:03:41 user nova-compute[75337]: DEBUG nova.network.neutron [req-3f7d710a-cbcb-4fc1-bf27-df7c8ab60efb req-5db003a3-1186-418e-a0e5-a3dd7fef2cf0 service nova] [instance: 85c56287-3140-4125-a316-0c652cc0f18a] Updated VIF entry in instance network info cache for port 51662fe4-0156-4111-8e0e-1c330f05d5e6. {{(pid=75337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 16:03:41 user nova-compute[75337]: DEBUG nova.network.neutron [req-3f7d710a-cbcb-4fc1-bf27-df7c8ab60efb req-5db003a3-1186-418e-a0e5-a3dd7fef2cf0 service nova] [instance: 85c56287-3140-4125-a316-0c652cc0f18a] Updating instance_info_cache with network_info: [{"id": "51662fe4-0156-4111-8e0e-1c330f05d5e6", "address": "fa:16:3e:76:55:28", "network": {"id": "4e47319f-de1d-4dfe-9915-7d2d5131704d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-895093240-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "915211c6a2734c36b34ff92a56b085f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51662fe4-01", "ovs_interfaceid": "51662fe4-0156-4111-8e0e-1c330f05d5e6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 16:03:41 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-29da9883-70f4-46a0-8258-8bbfae9c47fa tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.362s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 16:03:41 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-29da9883-70f4-46a0-8258-8bbfae9c47fa tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] <== connect_volume: return (1363ms) {'type': 'block', 'scsi_wwn': '26564393761613338', 'path': '/dev/sdd'} {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 16:03:41 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29da9883-70f4-46a0-8258-8bbfae9c47fa tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] [instance: 01b61f9a-2591-4714-b18e-54f674a441ab] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26564393761613338', 'path': '/dev/sdd'} {{(pid=75337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 16:03:41 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-3f7d710a-cbcb-4fc1-bf27-df7c8ab60efb req-5db003a3-1186-418e-a0e5-a3dd7fef2cf0 service nova] Releasing lock "refresh_cache-85c56287-3140-4125-a316-0c652cc0f18a" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 16:03:41 user nova-compute[75337]: DEBUG nova.objects.instance [None req-29da9883-70f4-46a0-8258-8bbfae9c47fa tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Lazy-loading 'flavor' on Instance uuid 01b61f9a-2591-4714-b18e-54f674a441ab {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 16:03:41 user nova-compute[75337]: DEBUG nova.virt.libvirt.guest [None req-29da9883-70f4-46a0-8258-8bbfae9c47fa tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] attach device xml: <disk type="block" device="disk">
Nov 06 16:03:41 user nova-compute[75337]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 16:03:41 user nova-compute[75337]:   <source dev="/dev/sdd"/>
Nov 06 16:03:41 user nova-compute[75337]:   <target dev="vdb" bus="virtio"/>
Nov 06 16:03:41 user nova-compute[75337]:   <serial>04dfdd40-f3fc-4409-87e2-1b284cd27a35</serial>
Nov 06 16:03:41 user nova-compute[75337]: </disk>
Nov 06 16:03:41 user nova-compute[75337]:  {{(pid=75337) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 06 16:03:41 user nova-compute[75337]: DEBUG nova.compute.manager [req-08075dff-ac83-42ff-ae44-c77db4cc70fc req-58f46cda-a3a0-41af-b196-c62cf7818979 service nova] [instance: 85c56287-3140-4125-a316-0c652cc0f18a] Received event network-changed-51662fe4-0156-4111-8e0e-1c330f05d5e6 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:03:41 user nova-compute[75337]: DEBUG nova.compute.manager [req-08075dff-ac83-42ff-ae44-c77db4cc70fc req-58f46cda-a3a0-41af-b196-c62cf7818979 service nova] [instance: 85c56287-3140-4125-a316-0c652cc0f18a] Refreshing instance network info cache due to event network-changed-51662fe4-0156-4111-8e0e-1c330f05d5e6. {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 16:03:41 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-08075dff-ac83-42ff-ae44-c77db4cc70fc req-58f46cda-a3a0-41af-b196-c62cf7818979 service nova] Acquiring lock "refresh_cache-85c56287-3140-4125-a316-0c652cc0f18a" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 16:03:41 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-08075dff-ac83-42ff-ae44-c77db4cc70fc req-58f46cda-a3a0-41af-b196-c62cf7818979 service nova] Acquired lock "refresh_cache-85c56287-3140-4125-a316-0c652cc0f18a" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 16:03:41 user nova-compute[75337]: DEBUG nova.network.neutron [req-08075dff-ac83-42ff-ae44-c77db4cc70fc req-58f46cda-a3a0-41af-b196-c62cf7818979 service nova] [instance: 85c56287-3140-4125-a316-0c652cc0f18a] Refreshing network info cache for port 51662fe4-0156-4111-8e0e-1c330f05d5e6 {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 16:03:41 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-0b134ea7-dd21-4ee7-8537-a2256c56ef06 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Acquiring lock "85c56287-3140-4125-a316-0c652cc0f18a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:03:41 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-0b134ea7-dd21-4ee7-8537-a2256c56ef06 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Lock "85c56287-3140-4125-a316-0c652cc0f18a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:03:41 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-0b134ea7-dd21-4ee7-8537-a2256c56ef06 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Acquiring lock "85c56287-3140-4125-a316-0c652cc0f18a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:03:41 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-0b134ea7-dd21-4ee7-8537-a2256c56ef06 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Lock "85c56287-3140-4125-a316-0c652cc0f18a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:03:41 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-0b134ea7-dd21-4ee7-8537-a2256c56ef06 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Lock "85c56287-3140-4125-a316-0c652cc0f18a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:03:41 user nova-compute[75337]: INFO nova.compute.manager [None req-0b134ea7-dd21-4ee7-8537-a2256c56ef06 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 85c56287-3140-4125-a316-0c652cc0f18a] Terminating instance
Nov 06 16:03:41 user nova-compute[75337]: DEBUG nova.compute.manager [None req-0b134ea7-dd21-4ee7-8537-a2256c56ef06 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 85c56287-3140-4125-a316-0c652cc0f18a] Start destroying the instance on the hypervisor. {{(pid=75337) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 16:03:41 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-29da9883-70f4-46a0-8258-8bbfae9c47fa tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] No BDM found with device name vda, not building metadata. {{(pid=75337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 16:03:41 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-29da9883-70f4-46a0-8258-8bbfae9c47fa tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 16:03:41 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-29da9883-70f4-46a0-8258-8bbfae9c47fa tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] No VIF found with MAC fa:16:3e:2c:49:a1, not building metadata {{(pid=75337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 16:03:41 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:03:41 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:03:41 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-29da9883-70f4-46a0-8258-8bbfae9c47fa tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Lock "01b61f9a-2591-4714-b18e-54f674a441ab" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 24.800s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:03:42 user nova-compute[75337]: DEBUG nova.compute.manager [req-574e917c-be38-427c-abcb-311d6c654d22 req-f9f49d5e-3033-404f-b464-3f882e91d1de service nova] [instance: 85c56287-3140-4125-a316-0c652cc0f18a] Received event network-vif-unplugged-51662fe4-0156-4111-8e0e-1c330f05d5e6 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:03:42 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-574e917c-be38-427c-abcb-311d6c654d22 req-f9f49d5e-3033-404f-b464-3f882e91d1de service nova] Acquiring lock "85c56287-3140-4125-a316-0c652cc0f18a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:03:42 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-574e917c-be38-427c-abcb-311d6c654d22 req-f9f49d5e-3033-404f-b464-3f882e91d1de service nova] Lock "85c56287-3140-4125-a316-0c652cc0f18a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:03:42 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-574e917c-be38-427c-abcb-311d6c654d22 req-f9f49d5e-3033-404f-b464-3f882e91d1de service nova] Lock "85c56287-3140-4125-a316-0c652cc0f18a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:03:42 user nova-compute[75337]: DEBUG nova.compute.manager [req-574e917c-be38-427c-abcb-311d6c654d22 req-f9f49d5e-3033-404f-b464-3f882e91d1de service nova] [instance: 85c56287-3140-4125-a316-0c652cc0f18a] No waiting events found dispatching network-vif-unplugged-51662fe4-0156-4111-8e0e-1c330f05d5e6 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 16:03:42 user nova-compute[75337]: DEBUG nova.compute.manager [req-574e917c-be38-427c-abcb-311d6c654d22 req-f9f49d5e-3033-404f-b464-3f882e91d1de service nova] [instance: 85c56287-3140-4125-a316-0c652cc0f18a] Received event network-vif-unplugged-51662fe4-0156-4111-8e0e-1c330f05d5e6 for instance with task_state deleting. {{(pid=75337) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 16:03:42 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:03:42 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:03:42 user nova-compute[75337]: DEBUG nova.network.neutron [req-08075dff-ac83-42ff-ae44-c77db4cc70fc req-58f46cda-a3a0-41af-b196-c62cf7818979 service nova] [instance: 85c56287-3140-4125-a316-0c652cc0f18a] Updated VIF entry in instance network info cache for port 51662fe4-0156-4111-8e0e-1c330f05d5e6. {{(pid=75337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 16:03:42 user nova-compute[75337]: DEBUG nova.network.neutron [req-08075dff-ac83-42ff-ae44-c77db4cc70fc req-58f46cda-a3a0-41af-b196-c62cf7818979 service nova] [instance: 85c56287-3140-4125-a316-0c652cc0f18a] Updating instance_info_cache with network_info: [{"id": "51662fe4-0156-4111-8e0e-1c330f05d5e6", "address": "fa:16:3e:76:55:28", "network": {"id": "4e47319f-de1d-4dfe-9915-7d2d5131704d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-895093240-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "915211c6a2734c36b34ff92a56b085f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51662fe4-01", "ovs_interfaceid": "51662fe4-0156-4111-8e0e-1c330f05d5e6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 16:03:42 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-08075dff-ac83-42ff-ae44-c77db4cc70fc req-58f46cda-a3a0-41af-b196-c62cf7818979 service nova] Releasing lock "refresh_cache-85c56287-3140-4125-a316-0c652cc0f18a" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 16:03:42 user nova-compute[75337]: INFO nova.virt.libvirt.driver [-] [instance: 85c56287-3140-4125-a316-0c652cc0f18a] Instance destroyed successfully.
Nov 06 16:03:42 user nova-compute[75337]: DEBUG nova.objects.instance [None req-0b134ea7-dd21-4ee7-8537-a2256c56ef06 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Lazy-loading 'resources' on Instance uuid 85c56287-3140-4125-a316-0c652cc0f18a {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 16:03:42 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-0b134ea7-dd21-4ee7-8537-a2256c56ef06 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T16:01:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1438138758',display_name='tempest-TestVolumeBootPattern-server-1438138758',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1438138758',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGSEIi3g934sMLPVz4vXQXFZs0uPpfou1A8cQ+7f5EeoH+XvyrzPDAqzu7FTAOU7yXRJ8IemF+WnLjTlXTwpg+PX5Yor65g2g46SgdNmwrUcBQAy+H25S13pZzToJUCwGA==',key_name='tempest-TestVolumeBootPattern-1419808121',keypairs=<?>,launch_index=0,launched_at=2023-11-06T16:02:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='915211c6a2734c36b34ff92a56b085f6',ramdisk_id='',reservation_id='r-uimne3fm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1055092640',owner_user_name='tempest-TestVolumeBootPattern-1055092640-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T16:02:17Z,user_data=None,user_id='bb8d5f0200124588be1cfde107341a45',uuid=85c56287-3140-4125-a316-0c652cc0f18a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "51662fe4-0156-4111-8e0e-1c330f05d5e6", "address": "fa:16:3e:76:55:28", "network": {"id": "4e47319f-de1d-4dfe-9915-7d2d5131704d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-895093240-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "915211c6a2734c36b34ff92a56b085f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51662fe4-01", "ovs_interfaceid": "51662fe4-0156-4111-8e0e-1c330f05d5e6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 16:03:42 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-0b134ea7-dd21-4ee7-8537-a2256c56ef06 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Converting VIF {"id": "51662fe4-0156-4111-8e0e-1c330f05d5e6", "address": "fa:16:3e:76:55:28", "network": {"id": "4e47319f-de1d-4dfe-9915-7d2d5131704d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-895093240-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "915211c6a2734c36b34ff92a56b085f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51662fe4-01", "ovs_interfaceid": "51662fe4-0156-4111-8e0e-1c330f05d5e6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 16:03:42 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-0b134ea7-dd21-4ee7-8537-a2256c56ef06 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:76:55:28,bridge_name='br-int',has_traffic_filtering=True,id=51662fe4-0156-4111-8e0e-1c330f05d5e6,network=Network(4e47319f-de1d-4dfe-9915-7d2d5131704d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51662fe4-01') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 16:03:42 user nova-compute[75337]: DEBUG os_vif [None req-0b134ea7-dd21-4ee7-8537-a2256c56ef06 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:76:55:28,bridge_name='br-int',has_traffic_filtering=True,id=51662fe4-0156-4111-8e0e-1c330f05d5e6,network=Network(4e47319f-de1d-4dfe-9915-7d2d5131704d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51662fe4-01') {{(pid=75337) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 16:03:42 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:03:42 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap51662fe4-01, bridge=br-int, if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 16:03:42 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:03:42 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:03:42 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:03:42 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=404111e0-f1e1-4e15-8c5d-89eec04cb7b4) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 16:03:42 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:03:42 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:03:42 user nova-compute[75337]: INFO os_vif [None req-0b134ea7-dd21-4ee7-8537-a2256c56ef06 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:76:55:28,bridge_name='br-int',has_traffic_filtering=True,id=51662fe4-0156-4111-8e0e-1c330f05d5e6,network=Network(4e47319f-de1d-4dfe-9915-7d2d5131704d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51662fe4-01')
Nov 06 16:03:42 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0b134ea7-dd21-4ee7-8537-a2256c56ef06 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 85c56287-3140-4125-a316-0c652cc0f18a] calling os-brick to detach iSCSI Volume {{(pid=75337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 16:03:42 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b134ea7-dd21-4ee7-8537-a2256c56ef06 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2abc33d0c0>, {'target_iqn': 'iqn.2010-10.org.openstack:15e7bca5-29b3-477d-9332-0fd23668f25c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RIJTXBxp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 16:03:42 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-0b134ea7-dd21-4ee7-8537-a2256c56ef06 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 16:03:42 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-0b134ea7-dd21-4ee7-8537-a2256c56ef06 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 16:03:42 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-0b134ea7-dd21-4ee7-8537-a2256c56ef06 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 16:03:42 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:03:42 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:03:42 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[27738228-64b6-42a7-a632-9455fa355758]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:15e7bca5-29b3-477d-9332-0fd23668f25c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:04dfdd40-f3fc-4409-87e2-1b284cd27a35\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:03:42 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b134ea7-dd21-4ee7-8537-a2256c56ef06 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 16:03:42 user nova-compute[75337]: No targets found.
Nov 06 16:03:42 user nova-compute[75337]: iSNS:
Nov 06 16:03:42 user nova-compute[75337]: No targets found.
Nov 06 16:03:42 user nova-compute[75337]: STATIC:
Nov 06 16:03:42 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:15e7bca5-29b3-477d-9332-0fd23668f25c
Nov 06 16:03:42 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 16:03:42 user nova-compute[75337]:                 Iface Name: default
Nov 06 16:03:42 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673
Nov 06 16:03:42 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 16:03:42 user nova-compute[75337]:                 Iface Name: default
Nov 06 16:03:42 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:04dfdd40-f3fc-4409-87e2-1b284cd27a35
Nov 06 16:03:42 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 16:03:42 user nova-compute[75337]:                 Iface Name: default
Nov 06 16:03:42 user nova-compute[75337]: FIRMWARE:
Nov 06 16:03:42 user nova-compute[75337]: No targets found.
Nov 06 16:03:42 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 16:03:42 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b134ea7-dd21-4ee7-8537-a2256c56ef06 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 16:03:42 user nova-compute[75337]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 16:03:42 user nova-compute[75337]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75337) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 16:03:42 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b134ea7-dd21-4ee7-8537-a2256c56ef06 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:15e7bca5-29b3-477d-9332-0fd23668f25c', 0)] {{(pid=75337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 16:03:42 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:03:42 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:03:42 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d043897-d1e1-4b9d-8b30-e98be1ff7a15]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04dfdd40-f3fc-4409-87e2-1b284cd27a35\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:15e7bca5-29b3-477d-9332-0fd23668f25c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:03:42 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:03:42 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:03:42 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fe3df59-7691-49e9-b95a-fc1bd29ac096]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15e7bca5-29b3-477d-9332-0fd23668f25c (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04dfdd40-f3fc-4409-87e2-1b284cd27a35 (non-flash)\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:03:42 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b134ea7-dd21-4ee7-8537-a2256c56ef06 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673 (non-flash)
Nov 06 16:03:42 user nova-compute[75337]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15e7bca5-29b3-477d-9332-0fd23668f25c (non-flash)
Nov 06 16:03:42 user nova-compute[75337]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04dfdd40-f3fc-4409-87e2-1b284cd27a35 (non-flash)
Nov 06 16:03:42 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 16:03:42 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b134ea7-dd21-4ee7-8537-a2256c56ef06 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673 (non-flash)
Nov 06 16:03:42 user nova-compute[75337]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15e7bca5-29b3-477d-9332-0fd23668f25c (non-flash)
Nov 06 16:03:42 user nova-compute[75337]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04dfdd40-f3fc-4409-87e2-1b284cd27a35 (non-flash)
Nov 06 16:03:42 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 16:03:42 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b134ea7-dd21-4ee7-8537-a2256c56ef06 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2a9c42a170>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:15e7bca5-29b3-477d-9332-0fd23668f25c'): ({'sdc'}, set())}) {{(pid=75337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 16:03:42 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-0b134ea7-dd21-4ee7-8537-a2256c56ef06 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Removing single pathed devices sdc {{(pid=75337) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 16:03:42 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:03:42 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:03:42 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0481d2c-6700-460e-b6a2-5aaeb3beba91]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:03:42 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:03:42 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.028s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:03:42 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6a3be87-d83b-4c0e-9bd7-755b3f896073]: (4, ('ok\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:03:42 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-0b134ea7-dd21-4ee7-8537-a2256c56ef06 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Flushing IO for device /dev/sdc {{(pid=75337) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 16:03:42 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:03:42 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:03:42 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[c24902fc-9e35-410e-9c85-20f5e83b2d6b]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:03:42 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-0b134ea7-dd21-4ee7-8537-a2256c56ef06 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75337) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 16:03:42 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:03:42 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.059s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:03:42 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[b83703d8-91b6-4e12-bd05-23dc6baef50d]: (4, ('1', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:03:42 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-0b134ea7-dd21-4ee7-8537-a2256c56ef06 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 16:03:42 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-0b134ea7-dd21-4ee7-8537-a2256c56ef06 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] SCSI volumes sdc have been removed. {{(pid=75337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 16:03:42 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b134ea7-dd21-4ee7-8537-a2256c56ef06 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:15e7bca5-29b3-477d-9332-0fd23668f25c')] {{(pid=75337) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 16:03:42 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15e7bca5-29b3-477d-9332-0fd23668f25c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:03:42 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15e7bca5-29b3-477d-9332-0fd23668f25c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:03:42 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fe09c10-5e49-44b1-b236-2d0d9c536f0b]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:03:42 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b134ea7-dd21-4ee7-8537-a2256c56ef06 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:03:42 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15e7bca5-29b3-477d-9332-0fd23668f25c -p 172.16.0.220:3260 --logout {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:03:42 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15e7bca5-29b3-477d-9332-0fd23668f25c -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:03:42 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc70b808-03c3-449c-b018-b27f6b957f60]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:15e7bca5-29b3-477d-9332-0fd23668f25c, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:15e7bca5-29b3-477d-9332-0fd23668f25c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:03:42 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b134ea7-dd21-4ee7-8537-a2256c56ef06 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:15e7bca5-29b3-477d-9332-0fd23668f25c, portal: 172.16.0.220,3260]
Nov 06 16:03:42 user nova-compute[75337]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:15e7bca5-29b3-477d-9332-0fd23668f25c, portal: 172.16.0.220,3260] successful.
Nov 06 16:03:42 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:03:42 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15e7bca5-29b3-477d-9332-0fd23668f25c -p 172.16.0.220:3260 --op delete {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:03:42 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15e7bca5-29b3-477d-9332-0fd23668f25c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:03:42 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9966eb5-a22b-42a3-bbf7-23b6a0dcbb27]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:03:42 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b134ea7-dd21-4ee7-8537-a2256c56ef06 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:03:42 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-0b134ea7-dd21-4ee7-8537-a2256c56ef06 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.354s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 16:03:42 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b134ea7-dd21-4ee7-8537-a2256c56ef06 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] <== disconnect_volume: return (355ms) None {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 16:03:42 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0b134ea7-dd21-4ee7-8537-a2256c56ef06 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 85c56287-3140-4125-a316-0c652cc0f18a] Disconnected iSCSI Volume {{(pid=75337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 16:03:42 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-0b134ea7-dd21-4ee7-8537-a2256c56ef06 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 85c56287-3140-4125-a316-0c652cc0f18a] Deleting instance files /opt/stack/data/nova/instances/85c56287-3140-4125-a316-0c652cc0f18a_del
Nov 06 16:03:42 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-0b134ea7-dd21-4ee7-8537-a2256c56ef06 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 85c56287-3140-4125-a316-0c652cc0f18a] Deletion of /opt/stack/data/nova/instances/85c56287-3140-4125-a316-0c652cc0f18a_del complete
Nov 06 16:03:42 user nova-compute[75337]: INFO nova.compute.manager [None req-0b134ea7-dd21-4ee7-8537-a2256c56ef06 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 85c56287-3140-4125-a316-0c652cc0f18a] Took 1.24 seconds to destroy the instance on the hypervisor.
Nov 06 16:03:42 user nova-compute[75337]: DEBUG oslo.service.loopingcall [None req-0b134ea7-dd21-4ee7-8537-a2256c56ef06 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75337) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 16:03:42 user nova-compute[75337]: DEBUG nova.compute.manager [-] [instance: 85c56287-3140-4125-a316-0c652cc0f18a] Deallocating network for instance {{(pid=75337) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 16:03:42 user nova-compute[75337]: DEBUG nova.network.neutron [-] [instance: 85c56287-3140-4125-a316-0c652cc0f18a] deallocate_for_instance() {{(pid=75337) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 16:03:43 user nova-compute[75337]: DEBUG nova.network.neutron [-] [instance: 85c56287-3140-4125-a316-0c652cc0f18a] Updating instance_info_cache with network_info: [] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 16:03:43 user nova-compute[75337]: INFO nova.compute.manager [-] [instance: 85c56287-3140-4125-a316-0c652cc0f18a] Took 0.65 seconds to deallocate network for instance.
Nov 06 16:03:43 user nova-compute[75337]: DEBUG nova.compute.manager [req-4509b540-7e66-482d-bc44-3b106049c38f req-27c9d4cf-b55b-43b7-8df7-bdbbd15223d7 service nova] [instance: 85c56287-3140-4125-a316-0c652cc0f18a] Received event network-vif-deleted-51662fe4-0156-4111-8e0e-1c330f05d5e6 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:03:44 user nova-compute[75337]: DEBUG nova.compute.manager [req-93182422-5c61-41e6-9be1-6ba994487203 req-956249e1-2911-4ab8-87cb-4e17d6f1e722 service nova] [instance: 85c56287-3140-4125-a316-0c652cc0f18a] Received event network-vif-plugged-51662fe4-0156-4111-8e0e-1c330f05d5e6 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:03:44 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-93182422-5c61-41e6-9be1-6ba994487203 req-956249e1-2911-4ab8-87cb-4e17d6f1e722 service nova] Acquiring lock "85c56287-3140-4125-a316-0c652cc0f18a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:03:44 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-93182422-5c61-41e6-9be1-6ba994487203 req-956249e1-2911-4ab8-87cb-4e17d6f1e722 service nova] Lock "85c56287-3140-4125-a316-0c652cc0f18a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:03:44 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-93182422-5c61-41e6-9be1-6ba994487203 req-956249e1-2911-4ab8-87cb-4e17d6f1e722 service nova] Lock "85c56287-3140-4125-a316-0c652cc0f18a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:03:44 user nova-compute[75337]: DEBUG nova.compute.manager [req-93182422-5c61-41e6-9be1-6ba994487203 req-956249e1-2911-4ab8-87cb-4e17d6f1e722 service nova] [instance: 85c56287-3140-4125-a316-0c652cc0f18a] No waiting events found dispatching network-vif-plugged-51662fe4-0156-4111-8e0e-1c330f05d5e6 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 16:03:44 user nova-compute[75337]: WARNING nova.compute.manager [req-93182422-5c61-41e6-9be1-6ba994487203 req-956249e1-2911-4ab8-87cb-4e17d6f1e722 service nova] [instance: 85c56287-3140-4125-a316-0c652cc0f18a] Received unexpected event network-vif-plugged-51662fe4-0156-4111-8e0e-1c330f05d5e6 for instance with vm_state active and task_state deleting.
Nov 06 16:03:44 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:03:44 user nova-compute[75337]: INFO nova.compute.manager [None req-0b134ea7-dd21-4ee7-8537-a2256c56ef06 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: 85c56287-3140-4125-a316-0c652cc0f18a] Took 0.98 seconds to detach 1 volumes for instance.
Nov 06 16:03:44 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-0b134ea7-dd21-4ee7-8537-a2256c56ef06 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:03:44 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-0b134ea7-dd21-4ee7-8537-a2256c56ef06 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:03:44 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-41d91bad-bdd4-43ee-9b94-b5492caf8774 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Acquiring lock "01b61f9a-2591-4714-b18e-54f674a441ab" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:03:44 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-41d91bad-bdd4-43ee-9b94-b5492caf8774 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Lock "01b61f9a-2591-4714-b18e-54f674a441ab" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:03:44 user nova-compute[75337]: INFO nova.compute.manager [None req-41d91bad-bdd4-43ee-9b94-b5492caf8774 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] [instance: 01b61f9a-2591-4714-b18e-54f674a441ab] Detaching volume 04dfdd40-f3fc-4409-87e2-1b284cd27a35
Nov 06 16:03:44 user nova-compute[75337]: INFO nova.virt.block_device [None req-41d91bad-bdd4-43ee-9b94-b5492caf8774 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] [instance: 01b61f9a-2591-4714-b18e-54f674a441ab] Attempting to driver detach volume 04dfdd40-f3fc-4409-87e2-1b284cd27a35 from mountpoint /dev/vdb
Nov 06 16:03:44 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-41d91bad-bdd4-43ee-9b94-b5492caf8774 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Attempting to detach device vdb from instance 01b61f9a-2591-4714-b18e-54f674a441ab from the persistent domain config. {{(pid=75337) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 06 16:03:44 user nova-compute[75337]: DEBUG nova.virt.libvirt.guest [None req-41d91bad-bdd4-43ee-9b94-b5492caf8774 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 16:03:44 user nova-compute[75337]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 16:03:44 user nova-compute[75337]:   <source dev="/dev/sdd"/>
Nov 06 16:03:44 user nova-compute[75337]:   <target dev="vdb" bus="virtio"/>
Nov 06 16:03:44 user nova-compute[75337]:   <serial>04dfdd40-f3fc-4409-87e2-1b284cd27a35</serial>
Nov 06 16:03:44 user nova-compute[75337]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 06 16:03:44 user nova-compute[75337]: </disk>
Nov 06 16:03:44 user nova-compute[75337]:  {{(pid=75337) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 16:03:44 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-41d91bad-bdd4-43ee-9b94-b5492caf8774 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Successfully detached device vdb from instance 01b61f9a-2591-4714-b18e-54f674a441ab from the persistent domain config.
Nov 06 16:03:44 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-41d91bad-bdd4-43ee-9b94-b5492caf8774 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 01b61f9a-2591-4714-b18e-54f674a441ab from the live domain config. {{(pid=75337) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 06 16:03:44 user nova-compute[75337]: DEBUG nova.virt.libvirt.guest [None req-41d91bad-bdd4-43ee-9b94-b5492caf8774 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 16:03:44 user nova-compute[75337]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 16:03:44 user nova-compute[75337]:   <source dev="/dev/sdd"/>
Nov 06 16:03:44 user nova-compute[75337]:   <target dev="vdb" bus="virtio"/>
Nov 06 16:03:44 user nova-compute[75337]:   <serial>04dfdd40-f3fc-4409-87e2-1b284cd27a35</serial>
Nov 06 16:03:44 user nova-compute[75337]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 06 16:03:44 user nova-compute[75337]: </disk>
Nov 06 16:03:44 user nova-compute[75337]:  {{(pid=75337) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 16:03:45 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-0b134ea7-dd21-4ee7-8537-a2256c56ef06 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 16:03:45 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-0b134ea7-dd21-4ee7-8537-a2256c56ef06 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 16:03:45 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-0b134ea7-dd21-4ee7-8537-a2256c56ef06 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.394s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:03:45 user nova-compute[75337]: INFO nova.scheduler.client.report [None req-0b134ea7-dd21-4ee7-8537-a2256c56ef06 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Deleted allocations for instance 85c56287-3140-4125-a316-0c652cc0f18a
Nov 06 16:03:45 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-0b134ea7-dd21-4ee7-8537-a2256c56ef06 tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Lock "85c56287-3140-4125-a316-0c652cc0f18a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.538s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:03:45 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-41d91bad-bdd4-43ee-9b94-b5492caf8774 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 01b61f9a-2591-4714-b18e-54f674a441ab {{(pid=75337) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 06 16:03:47 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:03:49 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:03:49 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:03:52 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:03:53 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:03:57 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:04:02 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:04:04 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-2be28abf-a306-43de-b5c3-70812fd6713c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Acquiring lock "d6eaef86-b841-4142-9549-31954fb34fa2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:04:04 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-2be28abf-a306-43de-b5c3-70812fd6713c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Lock "d6eaef86-b841-4142-9549-31954fb34fa2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:04:04 user nova-compute[75337]: DEBUG nova.compute.manager [None req-2be28abf-a306-43de-b5c3-70812fd6713c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: d6eaef86-b841-4142-9549-31954fb34fa2] Starting instance... {{(pid=75337) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 16:04:04 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-2be28abf-a306-43de-b5c3-70812fd6713c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:04:04 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-2be28abf-a306-43de-b5c3-70812fd6713c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:04:04 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-2be28abf-a306-43de-b5c3-70812fd6713c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75337) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 16:04:04 user nova-compute[75337]: INFO nova.compute.claims [None req-2be28abf-a306-43de-b5c3-70812fd6713c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: d6eaef86-b841-4142-9549-31954fb34fa2] Claim successful on node user
Nov 06 16:04:04 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-2be28abf-a306-43de-b5c3-70812fd6713c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 16:04:04 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-2be28abf-a306-43de-b5c3-70812fd6713c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 16:04:04 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-2be28abf-a306-43de-b5c3-70812fd6713c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.318s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:04:04 user nova-compute[75337]: DEBUG nova.compute.manager [None req-2be28abf-a306-43de-b5c3-70812fd6713c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: d6eaef86-b841-4142-9549-31954fb34fa2] Start building networks asynchronously for instance. {{(pid=75337) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 16:04:04 user nova-compute[75337]: DEBUG nova.compute.manager [None req-2be28abf-a306-43de-b5c3-70812fd6713c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: d6eaef86-b841-4142-9549-31954fb34fa2] Allocating IP information in the background. {{(pid=75337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 16:04:04 user nova-compute[75337]: DEBUG nova.network.neutron [None req-2be28abf-a306-43de-b5c3-70812fd6713c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: d6eaef86-b841-4142-9549-31954fb34fa2] allocate_for_instance() {{(pid=75337) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 16:04:04 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-2be28abf-a306-43de-b5c3-70812fd6713c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: d6eaef86-b841-4142-9549-31954fb34fa2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 16:04:04 user nova-compute[75337]: DEBUG nova.compute.manager [None req-2be28abf-a306-43de-b5c3-70812fd6713c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: d6eaef86-b841-4142-9549-31954fb34fa2] Start building block device mappings for instance. {{(pid=75337) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 16:04:04 user nova-compute[75337]: DEBUG nova.policy [None req-2be28abf-a306-43de-b5c3-70812fd6713c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2e47bf9ad49645deb2c1f834938fa39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '243647103fd44f629e0f40be0b56407e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75337) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 16:04:04 user nova-compute[75337]: INFO nova.virt.block_device [None req-2be28abf-a306-43de-b5c3-70812fd6713c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: d6eaef86-b841-4142-9549-31954fb34fa2] Booting with volume 58cdef33-eb5c-4ee9-a1b4-ee008e62a139 at /dev/vda
Nov 06 16:04:04 user nova-compute[75337]: DEBUG os_brick.utils [None req-2be28abf-a306-43de-b5c3-70812fd6713c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 16:04:04 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:04:04 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:04:04 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5d94012-683e-4be8-bebf-c28490e2f591]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4ff6411e45b8\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:04:04 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:04:04 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:04:04 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[72d926b1-5839-4e99-be3c-06d197b741a8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:04:04 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:04:04 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:04:04 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a12de20-24db-47e1-888c-4b4f95716eae]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:04:04 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[784f7a6b-57da-4340-98ea-5826cf83d5e3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:04:04 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-2be28abf-a306-43de-b5c3-70812fd6713c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Running cmd (subprocess): nvme version {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:04:04 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-2be28abf-a306-43de-b5c3-70812fd6713c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] 'nvme version' failed. Not Retrying. {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 16:04:04 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2be28abf-a306-43de-b5c3-70812fd6713c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] nvme not present on system {{(pid=75337) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 16:04:04 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:04:04 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 16:04:04 user nova-compute[75337]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 16:04:04 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2db75de-50b4-45d2-ba38-d24be7beab17]: (4, '') {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:04:04 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.lightos [None req-2be28abf-a306-43de-b5c3-70812fd6713c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75337) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 16:04:04 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.lightos [None req-2be28abf-a306-43de-b5c3-70812fd6713c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 16:04:04 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.lightos [None req-2be28abf-a306-43de-b5c3-70812fd6713c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] LIGHTOS: no hostnqn found. {{(pid=75337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 16:04:04 user nova-compute[75337]: DEBUG os_brick.utils [None req-2be28abf-a306-43de-b5c3-70812fd6713c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4ff6411e45b8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 16:04:04 user nova-compute[75337]: DEBUG nova.virt.block_device [None req-2be28abf-a306-43de-b5c3-70812fd6713c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: d6eaef86-b841-4142-9549-31954fb34fa2] Updating existing volume attachment record: 836751fa-597d-4fba-8e20-6c855102e601 {{(pid=75337) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 16:04:05 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-41d91bad-bdd4-43ee-9b94-b5492caf8774 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 01b61f9a-2591-4714-b18e-54f674a441ab is timed out.
Nov 06 16:04:05 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-41d91bad-bdd4-43ee-9b94-b5492caf8774 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Successfully detached device vdb from instance 01b61f9a-2591-4714-b18e-54f674a441ab from the live domain config.
Nov 06 16:04:05 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-41d91bad-bdd4-43ee-9b94-b5492caf8774 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] [instance: 01b61f9a-2591-4714-b18e-54f674a441ab] calling os-brick to detach iSCSI Volume {{(pid=75337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 16:04:05 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-41d91bad-bdd4-43ee-9b94-b5492caf8774 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2abc33d0c0>, {'target_iqn': 'iqn.2010-10.org.openstack:04dfdd40-f3fc-4409-87e2-1b284cd27a35', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CedVpYKZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 16:04:05 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-41d91bad-bdd4-43ee-9b94-b5492caf8774 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 16:04:05 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-41d91bad-bdd4-43ee-9b94-b5492caf8774 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 16:04:05 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-41d91bad-bdd4-43ee-9b94-b5492caf8774 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 16:04:05 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:04:05 user nova-compute[75337]: DEBUG nova.network.neutron [None req-2be28abf-a306-43de-b5c3-70812fd6713c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: d6eaef86-b841-4142-9549-31954fb34fa2] Successfully created port: 99bb43c1-3b95-4be2-a534-845c37778773 {{(pid=75337) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 16:04:05 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:04:05 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[afd0f399-b362-473d-b61c-3cd4998b1dfd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:04dfdd40-f3fc-4409-87e2-1b284cd27a35\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:04:05 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-41d91bad-bdd4-43ee-9b94-b5492caf8774 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 16:04:05 user nova-compute[75337]: No targets found.
Nov 06 16:04:05 user nova-compute[75337]: iSNS:
Nov 06 16:04:05 user nova-compute[75337]: No targets found.
Nov 06 16:04:05 user nova-compute[75337]: STATIC:
Nov 06 16:04:05 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673
Nov 06 16:04:05 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 16:04:05 user nova-compute[75337]:                 Iface Name: default
Nov 06 16:04:05 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:04dfdd40-f3fc-4409-87e2-1b284cd27a35
Nov 06 16:04:05 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 16:04:05 user nova-compute[75337]:                 Iface Name: default
Nov 06 16:04:05 user nova-compute[75337]: FIRMWARE:
Nov 06 16:04:05 user nova-compute[75337]: No targets found.
Nov 06 16:04:05 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 16:04:05 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-41d91bad-bdd4-43ee-9b94-b5492caf8774 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 16:04:05 user nova-compute[75337]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 16:04:05 user nova-compute[75337]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75337) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 16:04:05 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-41d91bad-bdd4-43ee-9b94-b5492caf8774 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:04dfdd40-f3fc-4409-87e2-1b284cd27a35', 0)] {{(pid=75337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 16:04:05 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:04:05 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:04:05 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[606c6ae3-c2c4-451b-afa2-da62b355c96c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04dfdd40-f3fc-4409-87e2-1b284cd27a35\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:04:05 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:04:05 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:04:05 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[f719e794-3640-4af0-be76-87e11d3ab27c]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04dfdd40-f3fc-4409-87e2-1b284cd27a35 (non-flash)\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:04:05 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-41d91bad-bdd4-43ee-9b94-b5492caf8774 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673 (non-flash)
Nov 06 16:04:05 user nova-compute[75337]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04dfdd40-f3fc-4409-87e2-1b284cd27a35 (non-flash)
Nov 06 16:04:05 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 16:04:05 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-41d91bad-bdd4-43ee-9b94-b5492caf8774 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673 (non-flash)
Nov 06 16:04:05 user nova-compute[75337]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04dfdd40-f3fc-4409-87e2-1b284cd27a35 (non-flash)
Nov 06 16:04:05 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 16:04:05 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-41d91bad-bdd4-43ee-9b94-b5492caf8774 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2a9c2428c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:04dfdd40-f3fc-4409-87e2-1b284cd27a35'): ({'sdd'}, set())}) {{(pid=75337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 16:04:05 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-41d91bad-bdd4-43ee-9b94-b5492caf8774 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Removing single pathed devices sdd {{(pid=75337) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 16:04:05 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:04:05 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:04:05 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fd6b436-6c3a-4925-9ddd-1a0bb4f993b0]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:04:05 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:04:05 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:04:05 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[972d9b6f-b264-41ad-8aa2-4c5cc49dbb25]: (4, ('ok\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:04:05 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-41d91bad-bdd4-43ee-9b94-b5492caf8774 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Flushing IO for device /dev/sdd {{(pid=75337) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 16:04:05 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:04:05 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:04:05 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc330c83-11f2-4c49-857e-f1250d5269b2]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:04:05 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-41d91bad-bdd4-43ee-9b94-b5492caf8774 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75337) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 16:04:05 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:04:05 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.047s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:04:05 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[506c34f8-6486-4290-834b-1450bd773214]: (4, ('1', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:04:05 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-41d91bad-bdd4-43ee-9b94-b5492caf8774 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 16:04:05 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-41d91bad-bdd4-43ee-9b94-b5492caf8774 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] SCSI volumes sdd have been removed. {{(pid=75337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 16:04:05 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-41d91bad-bdd4-43ee-9b94-b5492caf8774 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:04dfdd40-f3fc-4409-87e2-1b284cd27a35')] {{(pid=75337) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 16:04:05 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04dfdd40-f3fc-4409-87e2-1b284cd27a35 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:04:05 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04dfdd40-f3fc-4409-87e2-1b284cd27a35 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:04:05 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[19b89e79-e1aa-4777-8dd7-023d7f5b3696]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:04:05 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-41d91bad-bdd4-43ee-9b94-b5492caf8774 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:04:05 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04dfdd40-f3fc-4409-87e2-1b284cd27a35 -p 172.16.0.220:3260 --logout {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:04:05 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04dfdd40-f3fc-4409-87e2-1b284cd27a35 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:04:05 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[45e9a86b-cb36-4bbf-811c-9542d177217f]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:04dfdd40-f3fc-4409-87e2-1b284cd27a35, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:04dfdd40-f3fc-4409-87e2-1b284cd27a35, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:04:05 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-41d91bad-bdd4-43ee-9b94-b5492caf8774 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:04dfdd40-f3fc-4409-87e2-1b284cd27a35, portal: 172.16.0.220,3260]
Nov 06 16:04:05 user nova-compute[75337]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:04dfdd40-f3fc-4409-87e2-1b284cd27a35, portal: 172.16.0.220,3260] successful.
Nov 06 16:04:05 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:04:05 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04dfdd40-f3fc-4409-87e2-1b284cd27a35 -p 172.16.0.220:3260 --op delete {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:04:05 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04dfdd40-f3fc-4409-87e2-1b284cd27a35 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:04:05 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[a10072f1-bc21-4258-954e-cd80ab8ced7f]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:04:05 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-41d91bad-bdd4-43ee-9b94-b5492caf8774 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:04:05 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-41d91bad-bdd4-43ee-9b94-b5492caf8774 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 16:04:05 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-41d91bad-bdd4-43ee-9b94-b5492caf8774 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] <== disconnect_volume: return (312ms) None {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 16:04:05 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-41d91bad-bdd4-43ee-9b94-b5492caf8774 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] [instance: 01b61f9a-2591-4714-b18e-54f674a441ab] Disconnected iSCSI Volume {{(pid=75337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 16:04:05 user nova-compute[75337]: DEBUG nova.compute.manager [req-c1881c69-680e-45ff-8815-cd2ee35209af req-c297d011-3898-48fa-ae90-7986edc95a55 service nova] [instance: ba20919c-b506-458e-ac17-70bcb8900bb7] Received event network-changed-18a22e63-f67e-4843-8d5c-97e4f4d7eb31 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:04:05 user nova-compute[75337]: DEBUG nova.compute.manager [req-c1881c69-680e-45ff-8815-cd2ee35209af req-c297d011-3898-48fa-ae90-7986edc95a55 service nova] [instance: ba20919c-b506-458e-ac17-70bcb8900bb7] Refreshing instance network info cache due to event network-changed-18a22e63-f67e-4843-8d5c-97e4f4d7eb31. {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 16:04:05 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-c1881c69-680e-45ff-8815-cd2ee35209af req-c297d011-3898-48fa-ae90-7986edc95a55 service nova] Acquiring lock "refresh_cache-ba20919c-b506-458e-ac17-70bcb8900bb7" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 16:04:05 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-c1881c69-680e-45ff-8815-cd2ee35209af req-c297d011-3898-48fa-ae90-7986edc95a55 service nova] Acquired lock "refresh_cache-ba20919c-b506-458e-ac17-70bcb8900bb7" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 16:04:05 user nova-compute[75337]: DEBUG nova.network.neutron [req-c1881c69-680e-45ff-8815-cd2ee35209af req-c297d011-3898-48fa-ae90-7986edc95a55 service nova] [instance: ba20919c-b506-458e-ac17-70bcb8900bb7] Refreshing network info cache for port 18a22e63-f67e-4843-8d5c-97e4f4d7eb31 {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 16:04:06 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-202ade15-7cee-4c4c-949d-d77e106b2ce6 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Acquiring lock "ba20919c-b506-458e-ac17-70bcb8900bb7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:04:06 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-202ade15-7cee-4c4c-949d-d77e106b2ce6 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Lock "ba20919c-b506-458e-ac17-70bcb8900bb7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:04:06 user nova-compute[75337]: DEBUG nova.network.neutron [None req-2be28abf-a306-43de-b5c3-70812fd6713c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: d6eaef86-b841-4142-9549-31954fb34fa2] Successfully updated port: 99bb43c1-3b95-4be2-a534-845c37778773 {{(pid=75337) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 16:04:06 user nova-compute[75337]: DEBUG nova.objects.instance [None req-202ade15-7cee-4c4c-949d-d77e106b2ce6 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Lazy-loading 'flavor' on Instance uuid ba20919c-b506-458e-ac17-70bcb8900bb7 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 16:04:06 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-2be28abf-a306-43de-b5c3-70812fd6713c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Acquiring lock "refresh_cache-d6eaef86-b841-4142-9549-31954fb34fa2" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 16:04:06 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-2be28abf-a306-43de-b5c3-70812fd6713c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Acquired lock "refresh_cache-d6eaef86-b841-4142-9549-31954fb34fa2" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 16:04:06 user nova-compute[75337]: DEBUG nova.network.neutron [None req-2be28abf-a306-43de-b5c3-70812fd6713c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: d6eaef86-b841-4142-9549-31954fb34fa2] Building network info cache for instance {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 16:04:06 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-202ade15-7cee-4c4c-949d-d77e106b2ce6 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] [instance: ba20919c-b506-458e-ac17-70bcb8900bb7] Ignoring supplied device name: /dev/vdb
Nov 06 16:04:06 user nova-compute[75337]: DEBUG nova.compute.manager [req-74a1fd24-a9de-45ce-a6f1-48f95ae286d5 req-28e664ba-b493-4b24-9a63-4d6d375ebb24 service nova] [instance: d6eaef86-b841-4142-9549-31954fb34fa2] Received event network-changed-99bb43c1-3b95-4be2-a534-845c37778773 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:04:06 user nova-compute[75337]: DEBUG nova.compute.manager [req-74a1fd24-a9de-45ce-a6f1-48f95ae286d5 req-28e664ba-b493-4b24-9a63-4d6d375ebb24 service nova] [instance: d6eaef86-b841-4142-9549-31954fb34fa2] Refreshing instance network info cache due to event network-changed-99bb43c1-3b95-4be2-a534-845c37778773. {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 16:04:06 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-74a1fd24-a9de-45ce-a6f1-48f95ae286d5 req-28e664ba-b493-4b24-9a63-4d6d375ebb24 service nova] Acquiring lock "refresh_cache-d6eaef86-b841-4142-9549-31954fb34fa2" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 16:04:06 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-202ade15-7cee-4c4c-949d-d77e106b2ce6 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Lock "ba20919c-b506-458e-ac17-70bcb8900bb7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:04:06 user nova-compute[75337]: DEBUG nova.network.neutron [None req-2be28abf-a306-43de-b5c3-70812fd6713c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: d6eaef86-b841-4142-9549-31954fb34fa2] Instance cache missing network info. {{(pid=75337) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 16:04:06 user nova-compute[75337]: DEBUG nova.network.neutron [req-c1881c69-680e-45ff-8815-cd2ee35209af req-c297d011-3898-48fa-ae90-7986edc95a55 service nova] [instance: ba20919c-b506-458e-ac17-70bcb8900bb7] Updated VIF entry in instance network info cache for port 18a22e63-f67e-4843-8d5c-97e4f4d7eb31. {{(pid=75337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 16:04:06 user nova-compute[75337]: DEBUG nova.network.neutron [req-c1881c69-680e-45ff-8815-cd2ee35209af req-c297d011-3898-48fa-ae90-7986edc95a55 service nova] [instance: ba20919c-b506-458e-ac17-70bcb8900bb7] Updating instance_info_cache with network_info: [{"id": "18a22e63-f67e-4843-8d5c-97e4f4d7eb31", "address": "fa:16:3e:5d:7f:5e", "network": {"id": "8618d6aa-9df1-421d-916b-422978dc518d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1705024451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "398008f06ed645099ae8be04ac48a3ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18a22e63-f6", "ovs_interfaceid": "18a22e63-f67e-4843-8d5c-97e4f4d7eb31", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 16:04:06 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-c1881c69-680e-45ff-8815-cd2ee35209af req-c297d011-3898-48fa-ae90-7986edc95a55 service nova] Releasing lock "refresh_cache-ba20919c-b506-458e-ac17-70bcb8900bb7" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 16:04:06 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-202ade15-7cee-4c4c-949d-d77e106b2ce6 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Acquiring lock "ba20919c-b506-458e-ac17-70bcb8900bb7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:04:06 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-202ade15-7cee-4c4c-949d-d77e106b2ce6 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Lock "ba20919c-b506-458e-ac17-70bcb8900bb7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:04:06 user nova-compute[75337]: INFO nova.compute.manager [None req-202ade15-7cee-4c4c-949d-d77e106b2ce6 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] [instance: ba20919c-b506-458e-ac17-70bcb8900bb7] Attaching volume c4a5e7b2-ad62-4972-974e-83b84afac437 to /dev/vdb
Nov 06 16:04:06 user nova-compute[75337]: DEBUG os_brick.utils [None req-202ade15-7cee-4c4c-949d-d77e106b2ce6 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 16:04:06 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:04:06 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:04:06 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[a696f223-5422-4833-b76b-c310882ce95d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4ff6411e45b8\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:04:06 user nova-compute[75337]: DEBUG nova.network.neutron [None req-2be28abf-a306-43de-b5c3-70812fd6713c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: d6eaef86-b841-4142-9549-31954fb34fa2] Updating instance_info_cache with network_info: [{"id": "99bb43c1-3b95-4be2-a534-845c37778773", "address": "fa:16:3e:98:6e:e3", "network": {"id": "7f234ecf-bfa6-4316-9dce-c15050ba7914", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1378707892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "243647103fd44f629e0f40be0b56407e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99bb43c1-3b", "ovs_interfaceid": "99bb43c1-3b95-4be2-a534-845c37778773", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 16:04:06 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:04:06 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-2be28abf-a306-43de-b5c3-70812fd6713c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Releasing lock "refresh_cache-d6eaef86-b841-4142-9549-31954fb34fa2" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 16:04:06 user nova-compute[75337]: DEBUG nova.compute.manager [None req-2be28abf-a306-43de-b5c3-70812fd6713c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: d6eaef86-b841-4142-9549-31954fb34fa2] Instance network_info: |[{"id": "99bb43c1-3b95-4be2-a534-845c37778773", "address": "fa:16:3e:98:6e:e3", "network": {"id": "7f234ecf-bfa6-4316-9dce-c15050ba7914", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1378707892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "243647103fd44f629e0f40be0b56407e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99bb43c1-3b", "ovs_interfaceid": "99bb43c1-3b95-4be2-a534-845c37778773", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 16:04:06 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:04:06 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-74a1fd24-a9de-45ce-a6f1-48f95ae286d5 req-28e664ba-b493-4b24-9a63-4d6d375ebb24 service nova] Acquired lock "refresh_cache-d6eaef86-b841-4142-9549-31954fb34fa2" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 16:04:06 user nova-compute[75337]: DEBUG nova.network.neutron [req-74a1fd24-a9de-45ce-a6f1-48f95ae286d5 req-28e664ba-b493-4b24-9a63-4d6d375ebb24 service nova] [instance: d6eaef86-b841-4142-9549-31954fb34fa2] Refreshing network info cache for port 99bb43c1-3b95-4be2-a534-845c37778773 {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 16:04:06 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[b279e8e9-3b80-40b6-8f5c-f8c2c7e739e0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:04:06 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:04:06 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:04:06 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ff100be-9ffa-4a52-8172-228babdb3a52]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:04:06 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[def419dd-c308-4206-8602-08f3ad9d32c2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:04:06 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-202ade15-7cee-4c4c-949d-d77e106b2ce6 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Running cmd (subprocess): nvme version {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:04:06 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-202ade15-7cee-4c4c-949d-d77e106b2ce6 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] 'nvme version' failed. Not Retrying. {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 16:04:06 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.nvmeof [None req-202ade15-7cee-4c4c-949d-d77e106b2ce6 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] nvme not present on system {{(pid=75337) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 16:04:06 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:04:06 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 16:04:06 user nova-compute[75337]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 16:04:06 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[f48303c5-4304-4772-bcf7-4142709871ee]: (4, '') {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:04:06 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.lightos [None req-202ade15-7cee-4c4c-949d-d77e106b2ce6 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75337) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 16:04:06 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.lightos [None req-202ade15-7cee-4c4c-949d-d77e106b2ce6 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 16:04:06 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.lightos [None req-202ade15-7cee-4c4c-949d-d77e106b2ce6 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] LIGHTOS: no hostnqn found. {{(pid=75337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 16:04:06 user nova-compute[75337]: DEBUG os_brick.utils [None req-202ade15-7cee-4c4c-949d-d77e106b2ce6 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4ff6411e45b8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 16:04:06 user nova-compute[75337]: DEBUG nova.virt.block_device [None req-202ade15-7cee-4c4c-949d-d77e106b2ce6 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] [instance: ba20919c-b506-458e-ac17-70bcb8900bb7] Updating existing volume attachment record: acab67b8-71c2-4850-95cf-e0e769178894 {{(pid=75337) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 16:04:06 user nova-compute[75337]: DEBUG nova.objects.instance [None req-41d91bad-bdd4-43ee-9b94-b5492caf8774 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Lazy-loading 'flavor' on Instance uuid 01b61f9a-2591-4714-b18e-54f674a441ab {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 16:04:06 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-41d91bad-bdd4-43ee-9b94-b5492caf8774 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Lock "01b61f9a-2591-4714-b18e-54f674a441ab" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.091s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:04:07 user nova-compute[75337]: DEBUG nova.network.neutron [req-74a1fd24-a9de-45ce-a6f1-48f95ae286d5 req-28e664ba-b493-4b24-9a63-4d6d375ebb24 service nova] [instance: d6eaef86-b841-4142-9549-31954fb34fa2] Updated VIF entry in instance network info cache for port 99bb43c1-3b95-4be2-a534-845c37778773. {{(pid=75337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 16:04:07 user nova-compute[75337]: DEBUG nova.network.neutron [req-74a1fd24-a9de-45ce-a6f1-48f95ae286d5 req-28e664ba-b493-4b24-9a63-4d6d375ebb24 service nova] [instance: d6eaef86-b841-4142-9549-31954fb34fa2] Updating instance_info_cache with network_info: [{"id": "99bb43c1-3b95-4be2-a534-845c37778773", "address": "fa:16:3e:98:6e:e3", "network": {"id": "7f234ecf-bfa6-4316-9dce-c15050ba7914", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1378707892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "243647103fd44f629e0f40be0b56407e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99bb43c1-3b", "ovs_interfaceid": "99bb43c1-3b95-4be2-a534-845c37778773", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 16:04:07 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-74a1fd24-a9de-45ce-a6f1-48f95ae286d5 req-28e664ba-b493-4b24-9a63-4d6d375ebb24 service nova] Releasing lock "refresh_cache-d6eaef86-b841-4142-9549-31954fb34fa2" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 16:04:07 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:04:09 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:04:12 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:04:12 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:04:12 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:04:12 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:04:12 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75337) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 16:04:12 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:04:14 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:04:15 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-fc133ec0-6fe2-45d7-9b19-7b4bce97224e tempest-TestServerVolumeAttachScenarioOldVersion-419113578 tempest-TestServerVolumeAttachScenarioOldVersion-419113578-project-member] Acquiring lock "5d479c64-055b-4496-b3a2-ba10f9095ea8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:04:15 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-fc133ec0-6fe2-45d7-9b19-7b4bce97224e tempest-TestServerVolumeAttachScenarioOldVersion-419113578 tempest-TestServerVolumeAttachScenarioOldVersion-419113578-project-member] Lock "5d479c64-055b-4496-b3a2-ba10f9095ea8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:04:15 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-fc133ec0-6fe2-45d7-9b19-7b4bce97224e tempest-TestServerVolumeAttachScenarioOldVersion-419113578 tempest-TestServerVolumeAttachScenarioOldVersion-419113578-project-member] Acquiring lock "5d479c64-055b-4496-b3a2-ba10f9095ea8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:04:15 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-fc133ec0-6fe2-45d7-9b19-7b4bce97224e tempest-TestServerVolumeAttachScenarioOldVersion-419113578 tempest-TestServerVolumeAttachScenarioOldVersion-419113578-project-member] Lock "5d479c64-055b-4496-b3a2-ba10f9095ea8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:04:15 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-fc133ec0-6fe2-45d7-9b19-7b4bce97224e tempest-TestServerVolumeAttachScenarioOldVersion-419113578 tempest-TestServerVolumeAttachScenarioOldVersion-419113578-project-member] Lock "5d479c64-055b-4496-b3a2-ba10f9095ea8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:04:15 user nova-compute[75337]: INFO nova.compute.manager [None req-fc133ec0-6fe2-45d7-9b19-7b4bce97224e tempest-TestServerVolumeAttachScenarioOldVersion-419113578 tempest-TestServerVolumeAttachScenarioOldVersion-419113578-project-member] [instance: 5d479c64-055b-4496-b3a2-ba10f9095ea8] Terminating instance
Nov 06 16:04:15 user nova-compute[75337]: DEBUG nova.compute.manager [None req-fc133ec0-6fe2-45d7-9b19-7b4bce97224e tempest-TestServerVolumeAttachScenarioOldVersion-419113578 tempest-TestServerVolumeAttachScenarioOldVersion-419113578-project-member] [instance: 5d479c64-055b-4496-b3a2-ba10f9095ea8] Start destroying the instance on the hypervisor. {{(pid=75337) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 16:04:15 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:04:15 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:04:15 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:04:15 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:04:16 user nova-compute[75337]: DEBUG nova.compute.manager [req-0cf079c6-2eaf-4777-93b2-2f9f6ae5bf62 req-fa7a56fc-b35d-4f54-8f5c-f12d88ebfcc0 service nova] [instance: 5d479c64-055b-4496-b3a2-ba10f9095ea8] Received event network-vif-unplugged-cf2938cc-3588-4aea-8cb9-e0117e78a628 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:04:16 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-0cf079c6-2eaf-4777-93b2-2f9f6ae5bf62 req-fa7a56fc-b35d-4f54-8f5c-f12d88ebfcc0 service nova] Acquiring lock "5d479c64-055b-4496-b3a2-ba10f9095ea8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:04:16 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-0cf079c6-2eaf-4777-93b2-2f9f6ae5bf62 req-fa7a56fc-b35d-4f54-8f5c-f12d88ebfcc0 service nova] Lock "5d479c64-055b-4496-b3a2-ba10f9095ea8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:04:16 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-0cf079c6-2eaf-4777-93b2-2f9f6ae5bf62 req-fa7a56fc-b35d-4f54-8f5c-f12d88ebfcc0 service nova] Lock "5d479c64-055b-4496-b3a2-ba10f9095ea8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:04:16 user nova-compute[75337]: DEBUG nova.compute.manager [req-0cf079c6-2eaf-4777-93b2-2f9f6ae5bf62 req-fa7a56fc-b35d-4f54-8f5c-f12d88ebfcc0 service nova] [instance: 5d479c64-055b-4496-b3a2-ba10f9095ea8] No waiting events found dispatching network-vif-unplugged-cf2938cc-3588-4aea-8cb9-e0117e78a628 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 16:04:16 user nova-compute[75337]: DEBUG nova.compute.manager [req-0cf079c6-2eaf-4777-93b2-2f9f6ae5bf62 req-fa7a56fc-b35d-4f54-8f5c-f12d88ebfcc0 service nova] [instance: 5d479c64-055b-4496-b3a2-ba10f9095ea8] Received event network-vif-unplugged-cf2938cc-3588-4aea-8cb9-e0117e78a628 for instance with task_state deleting. {{(pid=75337) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 16:04:16 user nova-compute[75337]: INFO nova.virt.libvirt.driver [-] [instance: 5d479c64-055b-4496-b3a2-ba10f9095ea8] Instance destroyed successfully.
Nov 06 16:04:16 user nova-compute[75337]: DEBUG nova.objects.instance [None req-fc133ec0-6fe2-45d7-9b19-7b4bce97224e tempest-TestServerVolumeAttachScenarioOldVersion-419113578 tempest-TestServerVolumeAttachScenarioOldVersion-419113578-project-member] Lazy-loading 'resources' on Instance uuid 5d479c64-055b-4496-b3a2-ba10f9095ea8 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 16:04:16 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-fc133ec0-6fe2-45d7-9b19-7b4bce97224e tempest-TestServerVolumeAttachScenarioOldVersion-419113578 tempest-TestServerVolumeAttachScenarioOldVersion-419113578-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T15:58:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1058406320',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1058406320',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1058406',id=37,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNR95imP03oOG0MVkHGC+Ag0icGvBj91vv/n3yaiNDtFozIEqicyP7d1EpgEC7AmOXgro43bZS6YP0lREjSIuXrbElmm4i5TCLZqmE+DYX37gGTwty8ycwGI6JIO5a+K5w==',key_name='tempest-keypair-75149939',keypairs=<?>,launch_index=0,launched_at=2023-11-06T15:58:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='93b47bd7e8214b4f9d7f930e6f4b5dea',ramdisk_id='',reservation_id='r-zrb7ddu9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-419113578',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-419113578-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T15:58:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ac41d0290309421daae5fcc49f214a63',uuid=5d479c64-055b-4496-b3a2-ba10f9095ea8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cf2938cc-3588-4aea-8cb9-e0117e78a628", "address": "fa:16:3e:74:b7:02", "network": {"id": "53be211e-34f3-4a33-b5dc-7b7a0c2fb280", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-504725466-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93b47bd7e8214b4f9d7f930e6f4b5dea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf2938cc-35", "ovs_interfaceid": "cf2938cc-3588-4aea-8cb9-e0117e78a628", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 16:04:16 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-fc133ec0-6fe2-45d7-9b19-7b4bce97224e tempest-TestServerVolumeAttachScenarioOldVersion-419113578 tempest-TestServerVolumeAttachScenarioOldVersion-419113578-project-member] Converting VIF {"id": "cf2938cc-3588-4aea-8cb9-e0117e78a628", "address": "fa:16:3e:74:b7:02", "network": {"id": "53be211e-34f3-4a33-b5dc-7b7a0c2fb280", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-504725466-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93b47bd7e8214b4f9d7f930e6f4b5dea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf2938cc-35", "ovs_interfaceid": "cf2938cc-3588-4aea-8cb9-e0117e78a628", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 16:04:16 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-fc133ec0-6fe2-45d7-9b19-7b4bce97224e tempest-TestServerVolumeAttachScenarioOldVersion-419113578 tempest-TestServerVolumeAttachScenarioOldVersion-419113578-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:74:b7:02,bridge_name='br-int',has_traffic_filtering=True,id=cf2938cc-3588-4aea-8cb9-e0117e78a628,network=Network(53be211e-34f3-4a33-b5dc-7b7a0c2fb280),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf2938cc-35') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 16:04:16 user nova-compute[75337]: DEBUG os_vif [None req-fc133ec0-6fe2-45d7-9b19-7b4bce97224e tempest-TestServerVolumeAttachScenarioOldVersion-419113578 tempest-TestServerVolumeAttachScenarioOldVersion-419113578-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:74:b7:02,bridge_name='br-int',has_traffic_filtering=True,id=cf2938cc-3588-4aea-8cb9-e0117e78a628,network=Network(53be211e-34f3-4a33-b5dc-7b7a0c2fb280),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf2938cc-35') {{(pid=75337) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 16:04:16 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:04:16 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcf2938cc-35, bridge=br-int, if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 16:04:16 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:04:16 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:04:16 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:04:16 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5bc2d451-a572-4ef1-a5bd-bb77dd75c21e) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 16:04:16 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:04:16 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:04:16 user nova-compute[75337]: INFO os_vif [None req-fc133ec0-6fe2-45d7-9b19-7b4bce97224e tempest-TestServerVolumeAttachScenarioOldVersion-419113578 tempest-TestServerVolumeAttachScenarioOldVersion-419113578-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:74:b7:02,bridge_name='br-int',has_traffic_filtering=True,id=cf2938cc-3588-4aea-8cb9-e0117e78a628,network=Network(53be211e-34f3-4a33-b5dc-7b7a0c2fb280),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf2938cc-35')
Nov 06 16:04:16 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-fc133ec0-6fe2-45d7-9b19-7b4bce97224e tempest-TestServerVolumeAttachScenarioOldVersion-419113578 tempest-TestServerVolumeAttachScenarioOldVersion-419113578-project-member] [instance: 5d479c64-055b-4496-b3a2-ba10f9095ea8] Deleting instance files /opt/stack/data/nova/instances/5d479c64-055b-4496-b3a2-ba10f9095ea8_del
Nov 06 16:04:16 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-fc133ec0-6fe2-45d7-9b19-7b4bce97224e tempest-TestServerVolumeAttachScenarioOldVersion-419113578 tempest-TestServerVolumeAttachScenarioOldVersion-419113578-project-member] [instance: 5d479c64-055b-4496-b3a2-ba10f9095ea8] Deletion of /opt/stack/data/nova/instances/5d479c64-055b-4496-b3a2-ba10f9095ea8_del complete
Nov 06 16:04:16 user nova-compute[75337]: INFO nova.compute.manager [None req-fc133ec0-6fe2-45d7-9b19-7b4bce97224e tempest-TestServerVolumeAttachScenarioOldVersion-419113578 tempest-TestServerVolumeAttachScenarioOldVersion-419113578-project-member] [instance: 5d479c64-055b-4496-b3a2-ba10f9095ea8] Took 0.77 seconds to destroy the instance on the hypervisor.
Nov 06 16:04:16 user nova-compute[75337]: DEBUG oslo.service.loopingcall [None req-fc133ec0-6fe2-45d7-9b19-7b4bce97224e tempest-TestServerVolumeAttachScenarioOldVersion-419113578 tempest-TestServerVolumeAttachScenarioOldVersion-419113578-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75337) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 16:04:16 user nova-compute[75337]: DEBUG nova.compute.manager [-] [instance: 5d479c64-055b-4496-b3a2-ba10f9095ea8] Deallocating network for instance {{(pid=75337) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 16:04:16 user nova-compute[75337]: DEBUG nova.network.neutron [-] [instance: 5d479c64-055b-4496-b3a2-ba10f9095ea8] deallocate_for_instance() {{(pid=75337) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 16:04:16 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:04:17 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:04:17 user nova-compute[75337]: DEBUG nova.network.neutron [-] [instance: 5d479c64-055b-4496-b3a2-ba10f9095ea8] Updating instance_info_cache with network_info: [] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 16:04:17 user nova-compute[75337]: INFO nova.compute.manager [-] [instance: 5d479c64-055b-4496-b3a2-ba10f9095ea8] Took 0.77 seconds to deallocate network for instance.
Nov 06 16:04:17 user nova-compute[75337]: DEBUG nova.compute.manager [req-d3b78629-2a9d-4b92-9dd9-c12422e092d7 req-704bc6d8-bdd7-49a6-87a8-219e338ce9ba service nova] [instance: 5d479c64-055b-4496-b3a2-ba10f9095ea8] Received event network-vif-deleted-cf2938cc-3588-4aea-8cb9-e0117e78a628 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:04:17 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-fc133ec0-6fe2-45d7-9b19-7b4bce97224e tempest-TestServerVolumeAttachScenarioOldVersion-419113578 tempest-TestServerVolumeAttachScenarioOldVersion-419113578-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:04:17 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-fc133ec0-6fe2-45d7-9b19-7b4bce97224e tempest-TestServerVolumeAttachScenarioOldVersion-419113578 tempest-TestServerVolumeAttachScenarioOldVersion-419113578-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:04:17 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:04:17 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-fc133ec0-6fe2-45d7-9b19-7b4bce97224e tempest-TestServerVolumeAttachScenarioOldVersion-419113578 tempest-TestServerVolumeAttachScenarioOldVersion-419113578-project-member] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 16:04:17 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-fc133ec0-6fe2-45d7-9b19-7b4bce97224e tempest-TestServerVolumeAttachScenarioOldVersion-419113578 tempest-TestServerVolumeAttachScenarioOldVersion-419113578-project-member] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 16:04:17 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-fc133ec0-6fe2-45d7-9b19-7b4bce97224e tempest-TestServerVolumeAttachScenarioOldVersion-419113578 tempest-TestServerVolumeAttachScenarioOldVersion-419113578-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.302s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:04:17 user nova-compute[75337]: INFO nova.scheduler.client.report [None req-fc133ec0-6fe2-45d7-9b19-7b4bce97224e tempest-TestServerVolumeAttachScenarioOldVersion-419113578 tempest-TestServerVolumeAttachScenarioOldVersion-419113578-project-member] Deleted allocations for instance 5d479c64-055b-4496-b3a2-ba10f9095ea8
Nov 06 16:04:17 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-fc133ec0-6fe2-45d7-9b19-7b4bce97224e tempest-TestServerVolumeAttachScenarioOldVersion-419113578 tempest-TestServerVolumeAttachScenarioOldVersion-419113578-project-member] Lock "5d479c64-055b-4496-b3a2-ba10f9095ea8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.152s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:04:18 user nova-compute[75337]: DEBUG nova.compute.manager [req-91afdcfb-6c8d-4aa9-9230-10938c8656ab req-8bec302d-c7f4-4607-a534-6027cdcc8361 service nova] [instance: 5d479c64-055b-4496-b3a2-ba10f9095ea8] Received event network-vif-plugged-cf2938cc-3588-4aea-8cb9-e0117e78a628 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:04:18 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-91afdcfb-6c8d-4aa9-9230-10938c8656ab req-8bec302d-c7f4-4607-a534-6027cdcc8361 service nova] Acquiring lock "5d479c64-055b-4496-b3a2-ba10f9095ea8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:04:18 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-91afdcfb-6c8d-4aa9-9230-10938c8656ab req-8bec302d-c7f4-4607-a534-6027cdcc8361 service nova] Lock "5d479c64-055b-4496-b3a2-ba10f9095ea8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:04:18 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-91afdcfb-6c8d-4aa9-9230-10938c8656ab req-8bec302d-c7f4-4607-a534-6027cdcc8361 service nova] Lock "5d479c64-055b-4496-b3a2-ba10f9095ea8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:04:18 user nova-compute[75337]: DEBUG nova.compute.manager [req-91afdcfb-6c8d-4aa9-9230-10938c8656ab req-8bec302d-c7f4-4607-a534-6027cdcc8361 service nova] [instance: 5d479c64-055b-4496-b3a2-ba10f9095ea8] No waiting events found dispatching network-vif-plugged-cf2938cc-3588-4aea-8cb9-e0117e78a628 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 16:04:18 user nova-compute[75337]: WARNING nova.compute.manager [req-91afdcfb-6c8d-4aa9-9230-10938c8656ab req-8bec302d-c7f4-4607-a534-6027cdcc8361 service nova] [instance: 5d479c64-055b-4496-b3a2-ba10f9095ea8] Received unexpected event network-vif-plugged-cf2938cc-3588-4aea-8cb9-e0117e78a628 for instance with vm_state deleted and task_state None.
Nov 06 16:04:19 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:04:21 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:04:22 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:04:22 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Starting heal instance info cache {{(pid=75337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 16:04:22 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "refresh_cache-e558736d-848f-4a79-a7aa-1e46638a85dc" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 16:04:22 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquired lock "refresh_cache-e558736d-848f-4a79-a7aa-1e46638a85dc" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 16:04:22 user nova-compute[75337]: DEBUG nova.network.neutron [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] [instance: e558736d-848f-4a79-a7aa-1e46638a85dc] Forcefully refreshing network info cache for instance {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 16:04:23 user nova-compute[75337]: DEBUG nova.network.neutron [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] [instance: e558736d-848f-4a79-a7aa-1e46638a85dc] Updating instance_info_cache with network_info: [{"id": "0ed5847d-dcc9-43c0-96ae-02b3d24d1416", "address": "fa:16:3e:22:e2:a6", "network": {"id": "4e47319f-de1d-4dfe-9915-7d2d5131704d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-895093240-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "915211c6a2734c36b34ff92a56b085f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ed5847d-dc", "ovs_interfaceid": "0ed5847d-dcc9-43c0-96ae-02b3d24d1416", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 16:04:23 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Releasing lock "refresh_cache-e558736d-848f-4a79-a7aa-1e46638a85dc" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 16:04:23 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] [instance: e558736d-848f-4a79-a7aa-1e46638a85dc] Updated the network info_cache for instance {{(pid=75337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 16:04:23 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager.update_available_resource {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:04:23 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:04:23 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:04:23 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:04:23 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Auditing locally available compute resources for user (node: user) {{(pid=75337) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 16:04:23 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69df3824-b28c-43c0-9f20-52fa956642cc/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:04:23 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69df3824-b28c-43c0-9f20-52fa956642cc/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:04:23 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69df3824-b28c-43c0-9f20-52fa956642cc/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:04:23 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69df3824-b28c-43c0-9f20-52fa956642cc/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:04:23 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 16:04:23 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01b61f9a-2591-4714-b18e-54f674a441ab/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:04:23 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01b61f9a-2591-4714-b18e-54f674a441ab/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:04:23 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01b61f9a-2591-4714-b18e-54f674a441ab/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:04:24 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01b61f9a-2591-4714-b18e-54f674a441ab/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:04:24 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6110b34a-6fd3-45fc-911d-4e5d3c7f2d78/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:04:24 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6110b34a-6fd3-45fc-911d-4e5d3c7f2d78/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:04:24 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6110b34a-6fd3-45fc-911d-4e5d3c7f2d78/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:04:24 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6110b34a-6fd3-45fc-911d-4e5d3c7f2d78/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:04:24 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba20919c-b506-458e-ac17-70bcb8900bb7/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:04:24 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:04:24 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba20919c-b506-458e-ac17-70bcb8900bb7/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:04:24 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba20919c-b506-458e-ac17-70bcb8900bb7/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:04:24 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba20919c-b506-458e-ac17-70bcb8900bb7/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:04:25 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 16:04:25 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 16:04:25 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Hypervisor/Node resource view: name=user free_ram=8232MB free_disk=25.084049224853516GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75337) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 16:04:25 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:04:25 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:04:25 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 6110b34a-6fd3-45fc-911d-4e5d3c7f2d78 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 16:04:25 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 69df3824-b28c-43c0-9f20-52fa956642cc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 16:04:25 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance e558736d-848f-4a79-a7aa-1e46638a85dc actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 16:04:25 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 01b61f9a-2591-4714-b18e-54f674a441ab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 16:04:25 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance ba20919c-b506-458e-ac17-70bcb8900bb7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 16:04:25 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance d6eaef86-b841-4142-9549-31954fb34fa2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 16:04:25 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 16:04:25 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 16:04:25 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Refreshing inventories for resource provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 06 16:04:25 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Updating ProviderTree inventory for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 06 16:04:25 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Updating inventory in ProviderTree for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 06 16:04:25 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Refreshing aggregate associations for resource provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7, aggregates: None {{(pid=75337) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 06 16:04:25 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Refreshing trait associations for resource provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7, traits: COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NODE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_IDE,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSSE3,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_USB {{(pid=75337) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 06 16:04:25 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 16:04:25 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 16:04:25 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Compute_service record updated for user:user {{(pid=75337) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 16:04:25 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.686s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:04:26 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:04:28 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-202ade15-7cee-4c4c-949d-d77e106b2ce6 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] [instance: ba20919c-b506-458e-ac17-70bcb8900bb7] Calling os-brick to attach iSCSI Volume {{(pid=75337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 16:04:28 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-202ade15-7cee-4c4c-949d-d77e106b2ce6 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2abc33d0c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c4a5e7b2-ad62-4972-974e-83b84afac437', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YjkNSVmd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 16:04:28 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-202ade15-7cee-4c4c-949d-d77e106b2ce6 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 16:04:28 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-202ade15-7cee-4c4c-949d-d77e106b2ce6 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 16:04:28 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-202ade15-7cee-4c4c-949d-d77e106b2ce6 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 16:04:28 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-202ade15-7cee-4c4c-949d-d77e106b2ce6 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 16:04:28 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-202ade15-7cee-4c4c-949d-d77e106b2ce6 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c4a5e7b2-ad62-4972-974e-83b84afac437" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 16:04:28 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-202ade15-7cee-4c4c-949d-d77e106b2ce6 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c4a5e7b2-ad62-4972-974e-83b84afac437" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 16:04:28 user nova-compute[75337]: INFO os_brick.initiator.connectors.iscsi [None req-202ade15-7cee-4c4c-949d-d77e106b2ce6 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 16:04:28 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:04:28 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:04:28 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Cleaning up deleted instances {{(pid=75337) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 06 16:04:28 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4a5e7b2-ad62-4972-974e-83b84afac437 -p 172.16.0.220:3260 {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:04:28 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] There are 0 instances to clean {{(pid=75337) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 06 16:04:28 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4a5e7b2-ad62-4972-974e-83b84afac437 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:04:28 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[7af750ba-7395-49e0-8f33-b4a72335bd98]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:04:28 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-202ade15-7cee-4c4c-949d-d77e106b2ce6 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 16:04:28 user nova-compute[75337]:  {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:04:28 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4a5e7b2-ad62-4972-974e-83b84afac437 -p 172.16.0.220:3260 --interface default --op new {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:04:28 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4a5e7b2-ad62-4972-974e-83b84afac437 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:04:28 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cc1674a-2c71-4115-8c62-c158682b9eb3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c4a5e7b2-ad62-4972-974e-83b84afac437] added\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:04:28 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-202ade15-7cee-4c4c-949d-d77e106b2ce6 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c4a5e7b2-ad62-4972-974e-83b84afac437] added
Nov 06 16:04:28 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:04:28 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4a5e7b2-ad62-4972-974e-83b84afac437 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:04:28 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4a5e7b2-ad62-4972-974e-83b84afac437 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:04:28 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[08a866e1-fcf3-4eaf-a08c-e7a68a3bcbc7]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:04:28 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-202ade15-7cee-4c4c-949d-d77e106b2ce6 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:04:28 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4a5e7b2-ad62-4972-974e-83b84afac437 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:04:28 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4a5e7b2-ad62-4972-974e-83b84afac437 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:04:28 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[f76e372d-3049-4c0f-8d1a-2a7a0a87140c]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:04:28 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-202ade15-7cee-4c4c-949d-d77e106b2ce6 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:04:28 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4a5e7b2-ad62-4972-974e-83b84afac437 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YjkNSVmd {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:04:28 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4a5e7b2-ad62-4972-974e-83b84afac437 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YjkNSVmd" returned: 0 in 0.041s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:04:28 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[62191b69-3bbf-418c-a946-0759bed5dc8b]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:04:28 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-202ade15-7cee-4c4c-949d-d77e106b2ce6 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YjkNSVmd'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:04:28 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4a5e7b2-ad62-4972-974e-83b84afac437 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:04:28 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4a5e7b2-ad62-4972-974e-83b84afac437 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:04:28 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9c7e839-85f9-4815-a25a-f874bb4af556]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:04:28 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-202ade15-7cee-4c4c-949d-d77e106b2ce6 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:04:28 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:04:28 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:04:28 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[41ae2abd-9385-43f8-9c2e-ce20a42a51ff]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673 (non-flash)\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:04:28 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-202ade15-7cee-4c4c-949d-d77e106b2ce6 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673 (non-flash)
Nov 06 16:04:28 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 16:04:28 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-202ade15-7cee-4c4c-949d-d77e106b2ce6 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673 (non-flash)
Nov 06 16:04:28 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 16:04:28 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4a5e7b2-ad62-4972-974e-83b84afac437 -p 172.16.0.220:3260 --login {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:04:28 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4a5e7b2-ad62-4972-974e-83b84afac437 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:04:28 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6e31ecb-3ac7-4264-b109-29eaa70c1ad2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c4a5e7b2-ad62-4972-974e-83b84afac437, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c4a5e7b2-ad62-4972-974e-83b84afac437, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:04:28 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-202ade15-7cee-4c4c-949d-d77e106b2ce6 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c4a5e7b2-ad62-4972-974e-83b84afac437, portal: 172.16.0.220,3260]
Nov 06 16:04:28 user nova-compute[75337]: Login to [iface: default, target: iqn.2010-10.org.openstack:c4a5e7b2-ad62-4972-974e-83b84afac437, portal: 172.16.0.220,3260] successful.
Nov 06 16:04:28 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:04:28 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4a5e7b2-ad62-4972-974e-83b84afac437 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:04:28 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4a5e7b2-ad62-4972-974e-83b84afac437 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:04:28 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[66ceb4c7-8f63-4398-b94a-011212f50c6e]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:04:28 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-202ade15-7cee-4c4c-949d-d77e106b2ce6 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:04:28 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:04:28 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:04:28 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[48962696-083b-42ac-82ab-8652a746d2ac]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a5e7b2-ad62-4972-974e-83b84afac437 (non-flash)\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:04:28 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-202ade15-7cee-4c4c-949d-d77e106b2ce6 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673 (non-flash)
Nov 06 16:04:28 user nova-compute[75337]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a5e7b2-ad62-4972-974e-83b84afac437 (non-flash)
Nov 06 16:04:28 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 16:04:28 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-202ade15-7cee-4c4c-949d-d77e106b2ce6 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673 (non-flash)
Nov 06 16:04:28 user nova-compute[75337]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a5e7b2-ad62-4972-974e-83b84afac437 (non-flash)
Nov 06 16:04:28 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 16:04:28 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-202ade15-7cee-4c4c-949d-d77e106b2ce6 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c4a5e7b2-ad62-4972-974e-83b84afac437" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.285s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 16:04:28 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-202ade15-7cee-4c4c-949d-d77e106b2ce6 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Connected to 172.16.0.220:3260 {{(pid=75337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 16:04:28 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-202ade15-7cee-4c4c-949d-d77e106b2ce6 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] HCTL ('34', '-', '-', 0) found on session 46 with lun 0 {{(pid=75337) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 16:04:28 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-202ade15-7cee-4c4c-949d-d77e106b2ce6 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75337) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 16:04:28 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:04:28 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:04:28 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ace4551-d6dd-43fd-9772-458d0697bac1]: (4, ('- - 0', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:04:28 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-202ade15-7cee-4c4c-949d-d77e106b2ce6 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Searching for a device in session 46 and hctl ['34', '*', '*', 0] yield: None {{(pid=75337) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 16:04:29 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-202ade15-7cee-4c4c-949d-d77e106b2ce6 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Searching for a device in session 46 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75337) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 16:04:29 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-202ade15-7cee-4c4c-949d-d77e106b2ce6 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:c4a5e7b2-ad62-4972-974e-83b84afac437', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YjkNSVmd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 16:04:29 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-202ade15-7cee-4c4c-949d-d77e106b2ce6 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.318s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 16:04:29 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-202ade15-7cee-4c4c-949d-d77e106b2ce6 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] <== connect_volume: return (1320ms) {'type': 'block', 'scsi_wwn': '26664396634613432', 'path': '/dev/sdc'} {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 16:04:29 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-202ade15-7cee-4c4c-949d-d77e106b2ce6 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] [instance: ba20919c-b506-458e-ac17-70bcb8900bb7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26664396634613432', 'path': '/dev/sdc'} {{(pid=75337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 16:04:29 user nova-compute[75337]: DEBUG nova.objects.instance [None req-202ade15-7cee-4c4c-949d-d77e106b2ce6 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Lazy-loading 'flavor' on Instance uuid ba20919c-b506-458e-ac17-70bcb8900bb7 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 16:04:29 user nova-compute[75337]: DEBUG nova.virt.libvirt.guest [None req-202ade15-7cee-4c4c-949d-d77e106b2ce6 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] attach device xml: <disk type="block" device="disk">
Nov 06 16:04:29 user nova-compute[75337]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 16:04:29 user nova-compute[75337]:   <source dev="/dev/sdc"/>
Nov 06 16:04:29 user nova-compute[75337]:   <target dev="vdb" bus="virtio"/>
Nov 06 16:04:29 user nova-compute[75337]:   <serial>c4a5e7b2-ad62-4972-974e-83b84afac437</serial>
Nov 06 16:04:29 user nova-compute[75337]: </disk>
Nov 06 16:04:29 user nova-compute[75337]:  {{(pid=75337) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 06 16:04:29 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:04:30 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-202ade15-7cee-4c4c-949d-d77e106b2ce6 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] No BDM found with device name vda, not building metadata. {{(pid=75337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 16:04:30 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-202ade15-7cee-4c4c-949d-d77e106b2ce6 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 16:04:30 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-202ade15-7cee-4c4c-949d-d77e106b2ce6 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] No VIF found with MAC fa:16:3e:5d:7f:5e, not building metadata {{(pid=75337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 16:04:30 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-202ade15-7cee-4c4c-949d-d77e106b2ce6 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Lock "ba20919c-b506-458e-ac17-70bcb8900bb7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 23.977s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:04:30 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:04:30 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Cleaning up deleted instances with incomplete migration  {{(pid=75337) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 06 16:04:31 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:04:36 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:04:39 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:04:41 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:04:46 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:04:46 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:04:47 user nova-compute[75337]: DEBUG nova.compute.manager [None req-2be28abf-a306-43de-b5c3-70812fd6713c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: d6eaef86-b841-4142-9549-31954fb34fa2] Start spawning the instance on the hypervisor. {{(pid=75337) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 16:04:47 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-2be28abf-a306-43de-b5c3-70812fd6713c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: d6eaef86-b841-4142-9549-31954fb34fa2] Creating instance directory {{(pid=75337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 16:04:47 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-2be28abf-a306-43de-b5c3-70812fd6713c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: d6eaef86-b841-4142-9549-31954fb34fa2] Creating image(s)
Nov 06 16:04:47 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-2be28abf-a306-43de-b5c3-70812fd6713c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: d6eaef86-b841-4142-9549-31954fb34fa2] Did not create local disks {{(pid=75337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 06 16:04:47 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-2be28abf-a306-43de-b5c3-70812fd6713c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: d6eaef86-b841-4142-9549-31954fb34fa2] Ensure instance console log exists: /opt/stack/data/nova/instances/d6eaef86-b841-4142-9549-31954fb34fa2/console.log {{(pid=75337) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 16:04:47 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-2be28abf-a306-43de-b5c3-70812fd6713c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:04:47 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-2be28abf-a306-43de-b5c3-70812fd6713c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:04:47 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-2be28abf-a306-43de-b5c3-70812fd6713c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:04:47 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-2be28abf-a306-43de-b5c3-70812fd6713c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: d6eaef86-b841-4142-9549-31954fb34fa2] Start _get_guest_xml network_info=[{"id": "99bb43c1-3b95-4be2-a534-845c37778773", "address": "fa:16:3e:98:6e:e3", "network": {"id": "7f234ecf-bfa6-4316-9dce-c15050ba7914", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1378707892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "243647103fd44f629e0f40be0b56407e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99bb43c1-3b", "ovs_interfaceid": "99bb43c1-3b95-4be2-a534-845c37778773", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'attachment_id': '836751fa-597d-4fba-8e20-6c855102e601', 'guest_format': None, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wZVTXPEQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd6eaef86-b841-4142-9549-31954fb34fa2', 'attached_at': '', 'detached_at': '', 'volume_id': '58cdef33-eb5c-4ee9-a1b4-ee008e62a139', 'serial': '58cdef33-eb5c-4ee9-a1b4-ee008e62a139'}, 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=75337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 16:04:47 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-2be28abf-a306-43de-b5c3-70812fd6713c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 16:04:47 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-2be28abf-a306-43de-b5c3-70812fd6713c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 16:04:47 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-2be28abf-a306-43de-b5c3-70812fd6713c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 16:04:47 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-2be28abf-a306-43de-b5c3-70812fd6713c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] CPU controller missing on host. {{(pid=75337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 16:04:47 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-2be28abf-a306-43de-b5c3-70812fd6713c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 16:04:47 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-2be28abf-a306-43de-b5c3-70812fd6713c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] CPU controller found on host. {{(pid=75337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 16:04:47 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-2be28abf-a306-43de-b5c3-70812fd6713c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75337) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 16:04:47 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-2be28abf-a306-43de-b5c3-70812fd6713c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T15:34:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 16:04:47 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-2be28abf-a306-43de-b5c3-70812fd6713c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Flavor limits 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 16:04:47 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-2be28abf-a306-43de-b5c3-70812fd6713c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Image limits 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 16:04:47 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-2be28abf-a306-43de-b5c3-70812fd6713c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Flavor pref 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 16:04:47 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-2be28abf-a306-43de-b5c3-70812fd6713c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Image pref 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 16:04:47 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-2be28abf-a306-43de-b5c3-70812fd6713c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 16:04:47 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-2be28abf-a306-43de-b5c3-70812fd6713c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 16:04:47 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-2be28abf-a306-43de-b5c3-70812fd6713c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 16:04:47 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-2be28abf-a306-43de-b5c3-70812fd6713c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Got 1 possible topologies {{(pid=75337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 16:04:47 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-2be28abf-a306-43de-b5c3-70812fd6713c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 16:04:47 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-2be28abf-a306-43de-b5c3-70812fd6713c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 16:04:47 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2be28abf-a306-43de-b5c3-70812fd6713c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: d6eaef86-b841-4142-9549-31954fb34fa2] Calling os-brick to attach iSCSI Volume {{(pid=75337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 16:04:47 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-2be28abf-a306-43de-b5c3-70812fd6713c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2abc33d0c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wZVTXPEQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 16:04:47 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-2be28abf-a306-43de-b5c3-70812fd6713c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 16:04:47 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-2be28abf-a306-43de-b5c3-70812fd6713c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 16:04:47 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-2be28abf-a306-43de-b5c3-70812fd6713c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 16:04:47 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-2be28abf-a306-43de-b5c3-70812fd6713c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 16:04:47 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-2be28abf-a306-43de-b5c3-70812fd6713c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 16:04:47 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-2be28abf-a306-43de-b5c3-70812fd6713c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 16:04:47 user nova-compute[75337]: INFO os_brick.initiator.connectors.iscsi [None req-2be28abf-a306-43de-b5c3-70812fd6713c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 16:04:47 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139 -p 172.16.0.220:3260 {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:04:47 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:04:47 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a6d3c4a-2936-49c6-9602-88615c976528]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:04:47 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-2be28abf-a306-43de-b5c3-70812fd6713c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 16:04:47 user nova-compute[75337]:  {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:04:47 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139 -p 172.16.0.220:3260 --interface default --op new {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:04:47 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:04:47 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb697217-70a6-473d-b9d7-1ef9392b07c6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139] added\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:04:47 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-2be28abf-a306-43de-b5c3-70812fd6713c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139] added
Nov 06 16:04:47 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:04:47 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:04:47 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:04:47 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[3de9a484-7151-4113-94ef-6d5c5aff3ad9]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:04:47 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-2be28abf-a306-43de-b5c3-70812fd6713c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:04:47 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:04:47 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:04:47 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[629e9b5d-4185-459a-93f0-13d53825b691]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:04:47 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-2be28abf-a306-43de-b5c3-70812fd6713c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:04:47 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wZVTXPEQ {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:04:47 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wZVTXPEQ" returned: 0 in 0.026s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:04:47 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c74dd70-a79b-4f09-87bb-bd17e5d8cf5d]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:04:47 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-2be28abf-a306-43de-b5c3-70812fd6713c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wZVTXPEQ'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:04:47 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:04:48 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.177s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:04:48 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3638152-6cd3-4126-ab23-d01eb902c23b]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:04:48 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-2be28abf-a306-43de-b5c3-70812fd6713c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:04:48 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:04:48 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:04:48 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[03a9e727-ba3d-4c26-bba9-d3a74a11008b]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a5e7b2-ad62-4972-974e-83b84afac437 (non-flash)\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:04:48 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-2be28abf-a306-43de-b5c3-70812fd6713c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673 (non-flash)
Nov 06 16:04:48 user nova-compute[75337]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a5e7b2-ad62-4972-974e-83b84afac437 (non-flash)
Nov 06 16:04:48 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 16:04:48 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-2be28abf-a306-43de-b5c3-70812fd6713c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673 (non-flash)
Nov 06 16:04:48 user nova-compute[75337]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a5e7b2-ad62-4972-974e-83b84afac437 (non-flash)
Nov 06 16:04:48 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 16:04:48 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139 -p 172.16.0.220:3260 --login {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:04:48 user nova-compute[75337]: DEBUG nova.compute.manager [None req-92fde145-9057-4b59-8f52-20d1ec1f8d81 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] [instance: 01b61f9a-2591-4714-b18e-54f674a441ab] Checking state {{(pid=75337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 16:04:48 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:04:48 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2f5ff23-dfd6-4d24-b678-be0896cf074f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:04:48 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-2be28abf-a306-43de-b5c3-70812fd6713c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139, portal: 172.16.0.220,3260]
Nov 06 16:04:48 user nova-compute[75337]: Login to [iface: default, target: iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139, portal: 172.16.0.220,3260] successful.
Nov 06 16:04:48 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:04:48 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:04:48 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:04:48 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[5100df75-42f3-48a4-82d5-4abcdd8f59ab]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:04:48 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-2be28abf-a306-43de-b5c3-70812fd6713c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:04:48 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:04:48 user nova-compute[75337]: INFO nova.compute.manager [None req-92fde145-9057-4b59-8f52-20d1ec1f8d81 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] [instance: 01b61f9a-2591-4714-b18e-54f674a441ab] instance snapshotting
Nov 06 16:04:48 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:04:48 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e6fec24-129e-400b-8e7c-9884ee990eff]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a5e7b2-ad62-4972-974e-83b84afac437 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139 (non-flash)\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:04:48 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-2be28abf-a306-43de-b5c3-70812fd6713c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673 (non-flash)
Nov 06 16:04:48 user nova-compute[75337]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a5e7b2-ad62-4972-974e-83b84afac437 (non-flash)
Nov 06 16:04:48 user nova-compute[75337]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139 (non-flash)
Nov 06 16:04:48 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 16:04:48 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-2be28abf-a306-43de-b5c3-70812fd6713c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673 (non-flash)
Nov 06 16:04:48 user nova-compute[75337]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a5e7b2-ad62-4972-974e-83b84afac437 (non-flash)
Nov 06 16:04:48 user nova-compute[75337]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139 (non-flash)
Nov 06 16:04:48 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 16:04:48 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-2be28abf-a306-43de-b5c3-70812fd6713c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.480s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 16:04:48 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-2be28abf-a306-43de-b5c3-70812fd6713c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Connected to 172.16.0.220:3260 {{(pid=75337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 16:04:48 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-2be28abf-a306-43de-b5c3-70812fd6713c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] HCTL ('35', '-', '-', 0) found on session 47 with lun 0 {{(pid=75337) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 16:04:48 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-2be28abf-a306-43de-b5c3-70812fd6713c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75337) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 16:04:48 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:04:48 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:04:48 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[6958c835-df4d-471e-8ec4-598f6f5c8fc9]: (4, ('- - 0', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:04:48 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-2be28abf-a306-43de-b5c3-70812fd6713c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Searching for a device in session 47 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75337) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 16:04:48 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-2be28abf-a306-43de-b5c3-70812fd6713c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wZVTXPEQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 16:04:48 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-92fde145-9057-4b59-8f52-20d1ec1f8d81 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] [instance: 01b61f9a-2591-4714-b18e-54f674a441ab] Beginning live snapshot process
Nov 06 16:04:48 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-92fde145-9057-4b59-8f52-20d1ec1f8d81 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01b61f9a-2591-4714-b18e-54f674a441ab/disk --force-share --output=json -f qcow2 {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:04:48 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-92fde145-9057-4b59-8f52-20d1ec1f8d81 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01b61f9a-2591-4714-b18e-54f674a441ab/disk --force-share --output=json -f qcow2" returned: 0 in 0.196s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:04:48 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-92fde145-9057-4b59-8f52-20d1ec1f8d81 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01b61f9a-2591-4714-b18e-54f674a441ab/disk --force-share --output=json -f qcow2 {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:04:48 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-92fde145-9057-4b59-8f52-20d1ec1f8d81 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01b61f9a-2591-4714-b18e-54f674a441ab/disk --force-share --output=json -f qcow2" returned: 0 in 0.199s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:04:48 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-92fde145-9057-4b59-8f52-20d1ec1f8d81 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:04:49 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-92fde145-9057-4b59-8f52-20d1ec1f8d81 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json" returned: 0 in 0.182s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:04:49 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-92fde145-9057-4b59-8f52-20d1ec1f8d81 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpnuaw_o56/78731050d27e4a808892ffafe0d5168f.delta 1073741824 {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:04:49 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-92fde145-9057-4b59-8f52-20d1ec1f8d81 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpnuaw_o56/78731050d27e4a808892ffafe0d5168f.delta 1073741824" returned: 0 in 0.058s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:04:49 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-92fde145-9057-4b59-8f52-20d1ec1f8d81 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] [instance: 01b61f9a-2591-4714-b18e-54f674a441ab] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 06 16:04:49 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-2be28abf-a306-43de-b5c3-70812fd6713c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.522s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 16:04:49 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-2be28abf-a306-43de-b5c3-70812fd6713c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] <== connect_volume: return (1524ms) {'type': 'block', 'scsi_wwn': '23162376336383232', 'path': '/dev/sdd'} {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 16:04:49 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2be28abf-a306-43de-b5c3-70812fd6713c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: d6eaef86-b841-4142-9549-31954fb34fa2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23162376336383232', 'path': '/dev/sdd'} {{(pid=75337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 16:04:49 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-2be28abf-a306-43de-b5c3-70812fd6713c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T16:04:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-861327703',display_name='tempest-ServerActionsTestOtherA-server-861327703',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-861327703',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL4qUjCjjdVsflRB1h4DRug41qRThkRpbPytYUyz/XMQHNCLS4P/DapnKkRg0/Jn7/AhFFjdzCG9PxcwwVtb8q/utJpW4U9sbkxfbmmpOTPsJTE2NdIyui4Q27o5JkMUFA==',key_name='tempest-keypair-766127816',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='243647103fd44f629e0f40be0b56407e',ramdisk_id='',reservation_id='r-zax76e41',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-783619975',owner_user_name='tempest-ServerActionsTestOtherA-783619975-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T16:04:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2e47bf9ad49645deb2c1f834938fa39f',uuid=d6eaef86-b841-4142-9549-31954fb34fa2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "99bb43c1-3b95-4be2-a534-845c37778773", "address": "fa:16:3e:98:6e:e3", "network": {"id": "7f234ecf-bfa6-4316-9dce-c15050ba7914", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1378707892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "243647103fd44f629e0f40be0b56407e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99bb43c1-3b", "ovs_interfaceid": "99bb43c1-3b95-4be2-a534-845c37778773", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75337) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 16:04:49 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-2be28abf-a306-43de-b5c3-70812fd6713c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Converting VIF {"id": "99bb43c1-3b95-4be2-a534-845c37778773", "address": "fa:16:3e:98:6e:e3", "network": {"id": "7f234ecf-bfa6-4316-9dce-c15050ba7914", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1378707892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "243647103fd44f629e0f40be0b56407e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99bb43c1-3b", "ovs_interfaceid": "99bb43c1-3b95-4be2-a534-845c37778773", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 16:04:49 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-2be28abf-a306-43de-b5c3-70812fd6713c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:6e:e3,bridge_name='br-int',has_traffic_filtering=True,id=99bb43c1-3b95-4be2-a534-845c37778773,network=Network(7f234ecf-bfa6-4316-9dce-c15050ba7914),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99bb43c1-3b') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 16:04:49 user nova-compute[75337]: DEBUG nova.objects.instance [None req-2be28abf-a306-43de-b5c3-70812fd6713c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Lazy-loading 'pci_devices' on Instance uuid d6eaef86-b841-4142-9549-31954fb34fa2 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 16:04:49 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-2be28abf-a306-43de-b5c3-70812fd6713c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: d6eaef86-b841-4142-9549-31954fb34fa2] End _get_guest_xml xml=<domain type="kvm">
Nov 06 16:04:49 user nova-compute[75337]:   <uuid>d6eaef86-b841-4142-9549-31954fb34fa2</uuid>
Nov 06 16:04:49 user nova-compute[75337]:   <name>instance-0000002a</name>
Nov 06 16:04:49 user nova-compute[75337]:   <memory>524288</memory>
Nov 06 16:04:49 user nova-compute[75337]:   <vcpu>1</vcpu>
Nov 06 16:04:49 user nova-compute[75337]:   <metadata>
Nov 06 16:04:49 user nova-compute[75337]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 16:04:49 user nova-compute[75337]:       <nova:package version="0.0.0"/>
Nov 06 16:04:49 user nova-compute[75337]:       <nova:name>tempest-ServerActionsTestOtherA-server-861327703</nova:name>
Nov 06 16:04:49 user nova-compute[75337]:       <nova:creationTime>2023-11-06 16:04:47</nova:creationTime>
Nov 06 16:04:49 user nova-compute[75337]:       <nova:flavor name="m1.tiny">
Nov 06 16:04:49 user nova-compute[75337]:         <nova:memory>512</nova:memory>
Nov 06 16:04:49 user nova-compute[75337]:         <nova:disk>1</nova:disk>
Nov 06 16:04:49 user nova-compute[75337]:         <nova:swap>0</nova:swap>
Nov 06 16:04:49 user nova-compute[75337]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 16:04:49 user nova-compute[75337]:         <nova:vcpus>1</nova:vcpus>
Nov 06 16:04:49 user nova-compute[75337]:       </nova:flavor>
Nov 06 16:04:49 user nova-compute[75337]:       <nova:owner>
Nov 06 16:04:49 user nova-compute[75337]:         <nova:user uuid="2e47bf9ad49645deb2c1f834938fa39f">tempest-ServerActionsTestOtherA-783619975-project-member</nova:user>
Nov 06 16:04:49 user nova-compute[75337]:         <nova:project uuid="243647103fd44f629e0f40be0b56407e">tempest-ServerActionsTestOtherA-783619975</nova:project>
Nov 06 16:04:49 user nova-compute[75337]:       </nova:owner>
Nov 06 16:04:49 user nova-compute[75337]:       <nova:ports>
Nov 06 16:04:49 user nova-compute[75337]:         <nova:port uuid="99bb43c1-3b95-4be2-a534-845c37778773">
Nov 06 16:04:49 user nova-compute[75337]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 06 16:04:49 user nova-compute[75337]:         </nova:port>
Nov 06 16:04:49 user nova-compute[75337]:       </nova:ports>
Nov 06 16:04:49 user nova-compute[75337]:     </nova:instance>
Nov 06 16:04:49 user nova-compute[75337]:   </metadata>
Nov 06 16:04:49 user nova-compute[75337]:   <sysinfo type="smbios">
Nov 06 16:04:49 user nova-compute[75337]:     <system>
Nov 06 16:04:49 user nova-compute[75337]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 16:04:49 user nova-compute[75337]:       <entry name="product">OpenStack Nova</entry>
Nov 06 16:04:49 user nova-compute[75337]:       <entry name="version">0.0.0</entry>
Nov 06 16:04:49 user nova-compute[75337]:       <entry name="serial">d6eaef86-b841-4142-9549-31954fb34fa2</entry>
Nov 06 16:04:49 user nova-compute[75337]:       <entry name="uuid">d6eaef86-b841-4142-9549-31954fb34fa2</entry>
Nov 06 16:04:49 user nova-compute[75337]:       <entry name="family">Virtual Machine</entry>
Nov 06 16:04:49 user nova-compute[75337]:     </system>
Nov 06 16:04:49 user nova-compute[75337]:   </sysinfo>
Nov 06 16:04:49 user nova-compute[75337]:   <os>
Nov 06 16:04:49 user nova-compute[75337]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 16:04:49 user nova-compute[75337]:     <boot dev="hd"/>
Nov 06 16:04:49 user nova-compute[75337]:     <smbios mode="sysinfo"/>
Nov 06 16:04:49 user nova-compute[75337]:   </os>
Nov 06 16:04:49 user nova-compute[75337]:   <features>
Nov 06 16:04:49 user nova-compute[75337]:     <acpi/>
Nov 06 16:04:49 user nova-compute[75337]:     <apic/>
Nov 06 16:04:49 user nova-compute[75337]:     <vmcoreinfo/>
Nov 06 16:04:49 user nova-compute[75337]:   </features>
Nov 06 16:04:49 user nova-compute[75337]:   <clock offset="utc">
Nov 06 16:04:49 user nova-compute[75337]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 16:04:49 user nova-compute[75337]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 16:04:49 user nova-compute[75337]:     <timer name="hpet" present="no"/>
Nov 06 16:04:49 user nova-compute[75337]:   </clock>
Nov 06 16:04:49 user nova-compute[75337]:   <cpu mode="custom" match="exact">
Nov 06 16:04:49 user nova-compute[75337]:     <model>Nehalem</model>
Nov 06 16:04:49 user nova-compute[75337]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 16:04:49 user nova-compute[75337]:   </cpu>
Nov 06 16:04:49 user nova-compute[75337]:   <devices>
Nov 06 16:04:49 user nova-compute[75337]:     <disk type="block" device="disk">
Nov 06 16:04:49 user nova-compute[75337]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 16:04:49 user nova-compute[75337]:       <source dev="/dev/sdd"/>
Nov 06 16:04:49 user nova-compute[75337]:       <target dev="vda" bus="virtio"/>
Nov 06 16:04:49 user nova-compute[75337]:       <serial>58cdef33-eb5c-4ee9-a1b4-ee008e62a139</serial>
Nov 06 16:04:49 user nova-compute[75337]:     </disk>
Nov 06 16:04:49 user nova-compute[75337]:     <interface type="ethernet">
Nov 06 16:04:49 user nova-compute[75337]:       <mac address="fa:16:3e:98:6e:e3"/>
Nov 06 16:04:49 user nova-compute[75337]:       <model type="virtio"/>
Nov 06 16:04:49 user nova-compute[75337]:       <mtu size="1442"/>
Nov 06 16:04:49 user nova-compute[75337]:       <target dev="tap99bb43c1-3b"/>
Nov 06 16:04:49 user nova-compute[75337]:     </interface>
Nov 06 16:04:49 user nova-compute[75337]:     <serial type="pty">
Nov 06 16:04:49 user nova-compute[75337]:       <log file="/opt/stack/data/nova/instances/d6eaef86-b841-4142-9549-31954fb34fa2/console.log" append="off"/>
Nov 06 16:04:49 user nova-compute[75337]:     </serial>
Nov 06 16:04:49 user nova-compute[75337]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 16:04:49 user nova-compute[75337]:     <video>
Nov 06 16:04:49 user nova-compute[75337]:       <model type="virtio"/>
Nov 06 16:04:49 user nova-compute[75337]:     </video>
Nov 06 16:04:49 user nova-compute[75337]:     <rng model="virtio">
Nov 06 16:04:49 user nova-compute[75337]:       <backend model="random">/dev/urandom</backend>
Nov 06 16:04:49 user nova-compute[75337]:     </rng>
Nov 06 16:04:49 user nova-compute[75337]:     <controller type="usb" index="0" model="none"/>
Nov 06 16:04:49 user nova-compute[75337]:     <memballoon model="virtio">
Nov 06 16:04:49 user nova-compute[75337]:       <stats period="10"/>
Nov 06 16:04:49 user nova-compute[75337]:     </memballoon>
Nov 06 16:04:49 user nova-compute[75337]:   </devices>
Nov 06 16:04:49 user nova-compute[75337]: </domain>
Nov 06 16:04:49 user nova-compute[75337]:  {{(pid=75337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 16:04:49 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-2be28abf-a306-43de-b5c3-70812fd6713c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T16:04:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-861327703',display_name='tempest-ServerActionsTestOtherA-server-861327703',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-861327703',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL4qUjCjjdVsflRB1h4DRug41qRThkRpbPytYUyz/XMQHNCLS4P/DapnKkRg0/Jn7/AhFFjdzCG9PxcwwVtb8q/utJpW4U9sbkxfbmmpOTPsJTE2NdIyui4Q27o5JkMUFA==',key_name='tempest-keypair-766127816',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='243647103fd44f629e0f40be0b56407e',ramdisk_id='',reservation_id='r-zax76e41',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-783619975',owner_user_name='tempest-ServerActionsTestOtherA-783619975-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T16:04:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2e47bf9ad49645deb2c1f834938fa39f',uuid=d6eaef86-b841-4142-9549-31954fb34fa2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "99bb43c1-3b95-4be2-a534-845c37778773", "address": "fa:16:3e:98:6e:e3", "network": {"id": "7f234ecf-bfa6-4316-9dce-c15050ba7914", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1378707892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "243647103fd44f629e0f40be0b56407e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99bb43c1-3b", "ovs_interfaceid": "99bb43c1-3b95-4be2-a534-845c37778773", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 16:04:49 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-2be28abf-a306-43de-b5c3-70812fd6713c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Converting VIF {"id": "99bb43c1-3b95-4be2-a534-845c37778773", "address": "fa:16:3e:98:6e:e3", "network": {"id": "7f234ecf-bfa6-4316-9dce-c15050ba7914", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1378707892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "243647103fd44f629e0f40be0b56407e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99bb43c1-3b", "ovs_interfaceid": "99bb43c1-3b95-4be2-a534-845c37778773", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 16:04:49 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-2be28abf-a306-43de-b5c3-70812fd6713c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:6e:e3,bridge_name='br-int',has_traffic_filtering=True,id=99bb43c1-3b95-4be2-a534-845c37778773,network=Network(7f234ecf-bfa6-4316-9dce-c15050ba7914),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99bb43c1-3b') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 16:04:49 user nova-compute[75337]: DEBUG os_vif [None req-2be28abf-a306-43de-b5c3-70812fd6713c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:6e:e3,bridge_name='br-int',has_traffic_filtering=True,id=99bb43c1-3b95-4be2-a534-845c37778773,network=Network(7f234ecf-bfa6-4316-9dce-c15050ba7914),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99bb43c1-3b') {{(pid=75337) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 16:04:49 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:04:49 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 16:04:49 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 16:04:49 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:04:49 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0cad6962-afca-55ed-b3c2-304f3e0fd4e5', '_type': 'linux-noop'}}, row=False) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 16:04:49 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:04:49 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:04:49 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:04:49 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap99bb43c1-3b, may_exist=True, interface_attrs={}) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 16:04:49 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap99bb43c1-3b, col_values=(('qos', UUID('c5bef8fc-1543-444b-a4e1-5249c1c919a5')),), if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 16:04:49 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap99bb43c1-3b, col_values=(('external_ids', {'iface-id': '99bb43c1-3b95-4be2-a534-845c37778773', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:98:6e:e3', 'vm-uuid': 'd6eaef86-b841-4142-9549-31954fb34fa2'}),), if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 16:04:49 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:04:49 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:04:49 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:04:49 user nova-compute[75337]: INFO os_vif [None req-2be28abf-a306-43de-b5c3-70812fd6713c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:6e:e3,bridge_name='br-int',has_traffic_filtering=True,id=99bb43c1-3b95-4be2-a534-845c37778773,network=Network(7f234ecf-bfa6-4316-9dce-c15050ba7914),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99bb43c1-3b')
Nov 06 16:04:49 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-2be28abf-a306-43de-b5c3-70812fd6713c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] No BDM found with device name vda, not building metadata. {{(pid=75337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 16:04:49 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-2be28abf-a306-43de-b5c3-70812fd6713c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] No VIF found with MAC fa:16:3e:98:6e:e3, not building metadata {{(pid=75337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 16:04:49 user nova-compute[75337]: DEBUG nova.virt.libvirt.guest [None req-92fde145-9057-4b59-8f52-20d1ec1f8d81 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=75337) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 06 16:04:50 user nova-compute[75337]: DEBUG nova.virt.libvirt.guest [None req-92fde145-9057-4b59-8f52-20d1ec1f8d81 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] COPY block job progress, current cursor: 24444928 final cursor: 75563008 {{(pid=75337) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 06 16:04:51 user nova-compute[75337]: DEBUG nova.virt.libvirt.guest [None req-92fde145-9057-4b59-8f52-20d1ec1f8d81 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=75337) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 06 16:04:51 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-92fde145-9057-4b59-8f52-20d1ec1f8d81 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] [instance: 01b61f9a-2591-4714-b18e-54f674a441ab] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 06 16:04:51 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:04:51 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:04:51 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:04:51 user nova-compute[75337]: DEBUG nova.privsep.utils [None req-92fde145-9057-4b59-8f52-20d1ec1f8d81 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75337) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 06 16:04:51 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-92fde145-9057-4b59-8f52-20d1ec1f8d81 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpnuaw_o56/78731050d27e4a808892ffafe0d5168f.delta /opt/stack/data/nova/instances/snapshots/tmpnuaw_o56/78731050d27e4a808892ffafe0d5168f {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:04:51 user nova-compute[75337]: DEBUG nova.compute.manager [req-619e0365-3094-4fb9-8f10-3140d2970233 req-799d63c1-d34b-46be-b0ab-010336c1df0a service nova] [instance: d6eaef86-b841-4142-9549-31954fb34fa2] Received event network-vif-plugged-99bb43c1-3b95-4be2-a534-845c37778773 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:04:51 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-619e0365-3094-4fb9-8f10-3140d2970233 req-799d63c1-d34b-46be-b0ab-010336c1df0a service nova] Acquiring lock "d6eaef86-b841-4142-9549-31954fb34fa2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:04:51 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-619e0365-3094-4fb9-8f10-3140d2970233 req-799d63c1-d34b-46be-b0ab-010336c1df0a service nova] Lock "d6eaef86-b841-4142-9549-31954fb34fa2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:04:51 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-619e0365-3094-4fb9-8f10-3140d2970233 req-799d63c1-d34b-46be-b0ab-010336c1df0a service nova] Lock "d6eaef86-b841-4142-9549-31954fb34fa2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:04:51 user nova-compute[75337]: DEBUG nova.compute.manager [req-619e0365-3094-4fb9-8f10-3140d2970233 req-799d63c1-d34b-46be-b0ab-010336c1df0a service nova] [instance: d6eaef86-b841-4142-9549-31954fb34fa2] No waiting events found dispatching network-vif-plugged-99bb43c1-3b95-4be2-a534-845c37778773 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 16:04:51 user nova-compute[75337]: WARNING nova.compute.manager [req-619e0365-3094-4fb9-8f10-3140d2970233 req-799d63c1-d34b-46be-b0ab-010336c1df0a service nova] [instance: d6eaef86-b841-4142-9549-31954fb34fa2] Received unexpected event network-vif-plugged-99bb43c1-3b95-4be2-a534-845c37778773 for instance with vm_state building and task_state spawning.
Nov 06 16:04:51 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:04:51 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:04:52 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-92fde145-9057-4b59-8f52-20d1ec1f8d81 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpnuaw_o56/78731050d27e4a808892ffafe0d5168f.delta /opt/stack/data/nova/instances/snapshots/tmpnuaw_o56/78731050d27e4a808892ffafe0d5168f" returned: 0 in 0.751s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:04:52 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-92fde145-9057-4b59-8f52-20d1ec1f8d81 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] [instance: 01b61f9a-2591-4714-b18e-54f674a441ab] Snapshot extracted, beginning image upload
Nov 06 16:04:53 user nova-compute[75337]: DEBUG nova.compute.manager [req-ac7f9985-59a3-4c92-a4df-191f7e7b8af2 req-e1b81adc-5aff-4892-9c39-a1c11796f955 service nova] [instance: d6eaef86-b841-4142-9549-31954fb34fa2] Received event network-vif-plugged-99bb43c1-3b95-4be2-a534-845c37778773 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:04:53 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-ac7f9985-59a3-4c92-a4df-191f7e7b8af2 req-e1b81adc-5aff-4892-9c39-a1c11796f955 service nova] Acquiring lock "d6eaef86-b841-4142-9549-31954fb34fa2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:04:53 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-ac7f9985-59a3-4c92-a4df-191f7e7b8af2 req-e1b81adc-5aff-4892-9c39-a1c11796f955 service nova] Lock "d6eaef86-b841-4142-9549-31954fb34fa2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:04:53 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-ac7f9985-59a3-4c92-a4df-191f7e7b8af2 req-e1b81adc-5aff-4892-9c39-a1c11796f955 service nova] Lock "d6eaef86-b841-4142-9549-31954fb34fa2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:04:53 user nova-compute[75337]: DEBUG nova.compute.manager [req-ac7f9985-59a3-4c92-a4df-191f7e7b8af2 req-e1b81adc-5aff-4892-9c39-a1c11796f955 service nova] [instance: d6eaef86-b841-4142-9549-31954fb34fa2] No waiting events found dispatching network-vif-plugged-99bb43c1-3b95-4be2-a534-845c37778773 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 16:04:53 user nova-compute[75337]: WARNING nova.compute.manager [req-ac7f9985-59a3-4c92-a4df-191f7e7b8af2 req-e1b81adc-5aff-4892-9c39-a1c11796f955 service nova] [instance: d6eaef86-b841-4142-9549-31954fb34fa2] Received unexpected event network-vif-plugged-99bb43c1-3b95-4be2-a534-845c37778773 for instance with vm_state building and task_state spawning.
Nov 06 16:04:53 user nova-compute[75337]: DEBUG nova.compute.manager [None req-2be28abf-a306-43de-b5c3-70812fd6713c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: d6eaef86-b841-4142-9549-31954fb34fa2] Instance event wait completed in 0 seconds for  {{(pid=75337) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 16:04:53 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-2be28abf-a306-43de-b5c3-70812fd6713c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: d6eaef86-b841-4142-9549-31954fb34fa2] Guest created on hypervisor {{(pid=75337) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 16:04:53 user nova-compute[75337]: INFO nova.virt.libvirt.driver [-] [instance: d6eaef86-b841-4142-9549-31954fb34fa2] Instance spawned successfully.
Nov 06 16:04:53 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-2be28abf-a306-43de-b5c3-70812fd6713c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: d6eaef86-b841-4142-9549-31954fb34fa2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 16:04:53 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-2be28abf-a306-43de-b5c3-70812fd6713c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: d6eaef86-b841-4142-9549-31954fb34fa2] Found default for hw_cdrom_bus of ide {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 16:04:53 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-2be28abf-a306-43de-b5c3-70812fd6713c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: d6eaef86-b841-4142-9549-31954fb34fa2] Found default for hw_disk_bus of virtio {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 16:04:53 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-2be28abf-a306-43de-b5c3-70812fd6713c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: d6eaef86-b841-4142-9549-31954fb34fa2] Found default for hw_input_bus of None {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 16:04:53 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-2be28abf-a306-43de-b5c3-70812fd6713c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: d6eaef86-b841-4142-9549-31954fb34fa2] Found default for hw_pointer_model of None {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 16:04:53 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-2be28abf-a306-43de-b5c3-70812fd6713c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: d6eaef86-b841-4142-9549-31954fb34fa2] Found default for hw_video_model of virtio {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 16:04:53 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-2be28abf-a306-43de-b5c3-70812fd6713c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: d6eaef86-b841-4142-9549-31954fb34fa2] Found default for hw_vif_model of virtio {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 16:04:53 user nova-compute[75337]: INFO nova.compute.manager [None req-2be28abf-a306-43de-b5c3-70812fd6713c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: d6eaef86-b841-4142-9549-31954fb34fa2] Took 6.13 seconds to spawn the instance on the hypervisor.
Nov 06 16:04:53 user nova-compute[75337]: DEBUG nova.compute.manager [None req-2be28abf-a306-43de-b5c3-70812fd6713c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: d6eaef86-b841-4142-9549-31954fb34fa2] Checking state {{(pid=75337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 16:04:53 user nova-compute[75337]: INFO nova.compute.manager [None req-2be28abf-a306-43de-b5c3-70812fd6713c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: d6eaef86-b841-4142-9549-31954fb34fa2] Took 49.83 seconds to build instance.
Nov 06 16:04:53 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-2be28abf-a306-43de-b5c3-70812fd6713c tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Lock "d6eaef86-b841-4142-9549-31954fb34fa2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 49.927s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:04:54 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:04:54 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:04:54 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-92fde145-9057-4b59-8f52-20d1ec1f8d81 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] [instance: 01b61f9a-2591-4714-b18e-54f674a441ab] Snapshot image upload complete
Nov 06 16:04:54 user nova-compute[75337]: INFO nova.compute.manager [None req-92fde145-9057-4b59-8f52-20d1ec1f8d81 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] [instance: 01b61f9a-2591-4714-b18e-54f674a441ab] Took 6.73 seconds to snapshot the instance on the hypervisor.
Nov 06 16:04:57 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-ff591e64-be18-4f05-9dc6-eef5efec94dd tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Acquiring lock "9e2043cc-ff4e-43e9-9867-920de4809cc4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:04:57 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-ff591e64-be18-4f05-9dc6-eef5efec94dd tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Lock "9e2043cc-ff4e-43e9-9867-920de4809cc4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:04:57 user nova-compute[75337]: DEBUG nova.compute.manager [None req-ff591e64-be18-4f05-9dc6-eef5efec94dd tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] [instance: 9e2043cc-ff4e-43e9-9867-920de4809cc4] Starting instance... {{(pid=75337) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 16:04:57 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-ff591e64-be18-4f05-9dc6-eef5efec94dd tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:04:57 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-ff591e64-be18-4f05-9dc6-eef5efec94dd tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:04:57 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-ff591e64-be18-4f05-9dc6-eef5efec94dd tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75337) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 16:04:57 user nova-compute[75337]: INFO nova.compute.claims [None req-ff591e64-be18-4f05-9dc6-eef5efec94dd tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] [instance: 9e2043cc-ff4e-43e9-9867-920de4809cc4] Claim successful on node user
Nov 06 16:04:57 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-ff591e64-be18-4f05-9dc6-eef5efec94dd tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 16:04:57 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-ff591e64-be18-4f05-9dc6-eef5efec94dd tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 16:04:57 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-ff591e64-be18-4f05-9dc6-eef5efec94dd tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.483s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:04:57 user nova-compute[75337]: DEBUG nova.compute.manager [None req-ff591e64-be18-4f05-9dc6-eef5efec94dd tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] [instance: 9e2043cc-ff4e-43e9-9867-920de4809cc4] Start building networks asynchronously for instance. {{(pid=75337) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 16:04:57 user nova-compute[75337]: DEBUG nova.compute.manager [None req-ff591e64-be18-4f05-9dc6-eef5efec94dd tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] [instance: 9e2043cc-ff4e-43e9-9867-920de4809cc4] Allocating IP information in the background. {{(pid=75337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 16:04:57 user nova-compute[75337]: DEBUG nova.network.neutron [None req-ff591e64-be18-4f05-9dc6-eef5efec94dd tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] [instance: 9e2043cc-ff4e-43e9-9867-920de4809cc4] allocate_for_instance() {{(pid=75337) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 16:04:57 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-ff591e64-be18-4f05-9dc6-eef5efec94dd tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] [instance: 9e2043cc-ff4e-43e9-9867-920de4809cc4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 16:04:57 user nova-compute[75337]: DEBUG nova.compute.manager [None req-ff591e64-be18-4f05-9dc6-eef5efec94dd tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] [instance: 9e2043cc-ff4e-43e9-9867-920de4809cc4] Start building block device mappings for instance. {{(pid=75337) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 16:04:58 user nova-compute[75337]: DEBUG nova.policy [None req-ff591e64-be18-4f05-9dc6-eef5efec94dd tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b551ef2185264d24b3af5f38bd583701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b65a37b3ac4a92af0279d7ef3b9637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75337) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 16:04:58 user nova-compute[75337]: DEBUG nova.compute.manager [None req-ff591e64-be18-4f05-9dc6-eef5efec94dd tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] [instance: 9e2043cc-ff4e-43e9-9867-920de4809cc4] Start spawning the instance on the hypervisor. {{(pid=75337) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 16:04:58 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-ff591e64-be18-4f05-9dc6-eef5efec94dd tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] [instance: 9e2043cc-ff4e-43e9-9867-920de4809cc4] Creating instance directory {{(pid=75337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 16:04:58 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-ff591e64-be18-4f05-9dc6-eef5efec94dd tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] [instance: 9e2043cc-ff4e-43e9-9867-920de4809cc4] Creating image(s)
Nov 06 16:04:58 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-ff591e64-be18-4f05-9dc6-eef5efec94dd tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Acquiring lock "/opt/stack/data/nova/instances/9e2043cc-ff4e-43e9-9867-920de4809cc4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:04:58 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-ff591e64-be18-4f05-9dc6-eef5efec94dd tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Lock "/opt/stack/data/nova/instances/9e2043cc-ff4e-43e9-9867-920de4809cc4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:04:58 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-ff591e64-be18-4f05-9dc6-eef5efec94dd tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Lock "/opt/stack/data/nova/instances/9e2043cc-ff4e-43e9-9867-920de4809cc4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:04:58 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-ff591e64-be18-4f05-9dc6-eef5efec94dd tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Acquiring lock "380623bf17d3cffe94ad1c10fb9e5fd681de8626" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:04:58 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-ff591e64-be18-4f05-9dc6-eef5efec94dd tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Lock "380623bf17d3cffe94ad1c10fb9e5fd681de8626" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:04:59 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-ff591e64-be18-4f05-9dc6-eef5efec94dd tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/380623bf17d3cffe94ad1c10fb9e5fd681de8626.part --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:04:59 user nova-compute[75337]: DEBUG nova.network.neutron [None req-ff591e64-be18-4f05-9dc6-eef5efec94dd tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] [instance: 9e2043cc-ff4e-43e9-9867-920de4809cc4] Successfully created port: 36f87e2c-dbfb-484a-99b8-6a77e3bb986a {{(pid=75337) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 16:04:59 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:04:59 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-22e56532-ba7a-487a-9ee2-28e06dfe6f9d tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Acquiring lock "69df3824-b28c-43c0-9f20-52fa956642cc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:04:59 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-22e56532-ba7a-487a-9ee2-28e06dfe6f9d tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Lock "69df3824-b28c-43c0-9f20-52fa956642cc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:04:59 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-22e56532-ba7a-487a-9ee2-28e06dfe6f9d tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Acquiring lock "69df3824-b28c-43c0-9f20-52fa956642cc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:04:59 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-22e56532-ba7a-487a-9ee2-28e06dfe6f9d tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Lock "69df3824-b28c-43c0-9f20-52fa956642cc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:04:59 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-22e56532-ba7a-487a-9ee2-28e06dfe6f9d tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Lock "69df3824-b28c-43c0-9f20-52fa956642cc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:04:59 user nova-compute[75337]: INFO nova.compute.manager [None req-22e56532-ba7a-487a-9ee2-28e06dfe6f9d tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] [instance: 69df3824-b28c-43c0-9f20-52fa956642cc] Terminating instance
Nov 06 16:04:59 user nova-compute[75337]: DEBUG nova.compute.manager [None req-22e56532-ba7a-487a-9ee2-28e06dfe6f9d tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] [instance: 69df3824-b28c-43c0-9f20-52fa956642cc] Start destroying the instance on the hypervisor. {{(pid=75337) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 16:04:59 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-ff591e64-be18-4f05-9dc6-eef5efec94dd tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/380623bf17d3cffe94ad1c10fb9e5fd681de8626.part --force-share --output=json" returned: 0 in 0.382s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:04:59 user nova-compute[75337]: DEBUG nova.virt.images [None req-ff591e64-be18-4f05-9dc6-eef5efec94dd tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] 3deab4bc-5690-40b0-91cd-fced7f8b39bd was qcow2, converting to raw {{(pid=75337) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 06 16:04:59 user nova-compute[75337]: DEBUG nova.privsep.utils [None req-ff591e64-be18-4f05-9dc6-eef5efec94dd tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75337) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 06 16:04:59 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-ff591e64-be18-4f05-9dc6-eef5efec94dd tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/380623bf17d3cffe94ad1c10fb9e5fd681de8626.part /opt/stack/data/nova/instances/_base/380623bf17d3cffe94ad1c10fb9e5fd681de8626.converted {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:04:59 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:04:59 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:04:59 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:04:59 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:04:59 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-ff591e64-be18-4f05-9dc6-eef5efec94dd tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/380623bf17d3cffe94ad1c10fb9e5fd681de8626.part /opt/stack/data/nova/instances/_base/380623bf17d3cffe94ad1c10fb9e5fd681de8626.converted" returned: 0 in 0.322s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:05:00 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-ff591e64-be18-4f05-9dc6-eef5efec94dd tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/380623bf17d3cffe94ad1c10fb9e5fd681de8626.converted --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:05:00 user nova-compute[75337]: DEBUG nova.compute.manager [req-abf153d7-2bb7-4317-a6bf-af1e8813ce6c req-f70ececd-8e45-4829-89db-5777651b81cb service nova] [instance: 69df3824-b28c-43c0-9f20-52fa956642cc] Received event network-vif-unplugged-c3d051e2-c3b7-4ee0-aab0-dcf3c0d1d578 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:05:00 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-abf153d7-2bb7-4317-a6bf-af1e8813ce6c req-f70ececd-8e45-4829-89db-5777651b81cb service nova] Acquiring lock "69df3824-b28c-43c0-9f20-52fa956642cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:05:00 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-abf153d7-2bb7-4317-a6bf-af1e8813ce6c req-f70ececd-8e45-4829-89db-5777651b81cb service nova] Lock "69df3824-b28c-43c0-9f20-52fa956642cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:05:00 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-abf153d7-2bb7-4317-a6bf-af1e8813ce6c req-f70ececd-8e45-4829-89db-5777651b81cb service nova] Lock "69df3824-b28c-43c0-9f20-52fa956642cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:05:00 user nova-compute[75337]: DEBUG nova.compute.manager [req-abf153d7-2bb7-4317-a6bf-af1e8813ce6c req-f70ececd-8e45-4829-89db-5777651b81cb service nova] [instance: 69df3824-b28c-43c0-9f20-52fa956642cc] No waiting events found dispatching network-vif-unplugged-c3d051e2-c3b7-4ee0-aab0-dcf3c0d1d578 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 16:05:00 user nova-compute[75337]: DEBUG nova.compute.manager [req-abf153d7-2bb7-4317-a6bf-af1e8813ce6c req-f70ececd-8e45-4829-89db-5777651b81cb service nova] [instance: 69df3824-b28c-43c0-9f20-52fa956642cc] Received event network-vif-unplugged-c3d051e2-c3b7-4ee0-aab0-dcf3c0d1d578 for instance with task_state deleting. {{(pid=75337) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 16:05:00 user nova-compute[75337]: INFO nova.virt.libvirt.driver [-] [instance: 69df3824-b28c-43c0-9f20-52fa956642cc] Instance destroyed successfully.
Nov 06 16:05:00 user nova-compute[75337]: DEBUG nova.objects.instance [None req-22e56532-ba7a-487a-9ee2-28e06dfe6f9d tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Lazy-loading 'resources' on Instance uuid 69df3824-b28c-43c0-9f20-52fa956642cc {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 16:05:00 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-22e56532-ba7a-487a-9ee2-28e06dfe6f9d tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T15:54:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1515449710',display_name='tempest-AttachVolumeTestJSON-server-1515449710',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1515449710',id=32,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOuljMPp9i9MDAKWBD5G58tmj+9Tb6PUeli8EGD2jPfBvIyOYYOj/xbR7lXnFQzbgbAGvrz08EfcDEZH0CAoflAb7Id49fT3SM4gKBFBAbvsmqhfX3tP82mW2VMhPkafYg==',key_name='tempest-keypair-396223312',keypairs=<?>,launch_index=0,launched_at=2023-11-06T15:54:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='98fac9096a3b4f21ba805ba1437d9d38',ramdisk_id='',reservation_id='r-ynykuy84',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-636759182',owner_user_name='tempest-AttachVolumeTestJSON-636759182-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T16:03:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ef1008574bea4cfca8a20b2edcf0aacd',uuid=69df3824-b28c-43c0-9f20-52fa956642cc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c3d051e2-c3b7-4ee0-aab0-dcf3c0d1d578", "address": "fa:16:3e:7e:b4:bf", "network": {"id": "8b217731-de9e-49bc-84bb-130fd42ede51", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-314618758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98fac9096a3b4f21ba805ba1437d9d38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3d051e2-c3", "ovs_interfaceid": "c3d051e2-c3b7-4ee0-aab0-dcf3c0d1d578", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 16:05:00 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-22e56532-ba7a-487a-9ee2-28e06dfe6f9d tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Converting VIF {"id": "c3d051e2-c3b7-4ee0-aab0-dcf3c0d1d578", "address": "fa:16:3e:7e:b4:bf", "network": {"id": "8b217731-de9e-49bc-84bb-130fd42ede51", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-314618758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98fac9096a3b4f21ba805ba1437d9d38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3d051e2-c3", "ovs_interfaceid": "c3d051e2-c3b7-4ee0-aab0-dcf3c0d1d578", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 16:05:00 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-22e56532-ba7a-487a-9ee2-28e06dfe6f9d tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:b4:bf,bridge_name='br-int',has_traffic_filtering=True,id=c3d051e2-c3b7-4ee0-aab0-dcf3c0d1d578,network=Network(8b217731-de9e-49bc-84bb-130fd42ede51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3d051e2-c3') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 16:05:00 user nova-compute[75337]: DEBUG os_vif [None req-22e56532-ba7a-487a-9ee2-28e06dfe6f9d tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:b4:bf,bridge_name='br-int',has_traffic_filtering=True,id=c3d051e2-c3b7-4ee0-aab0-dcf3c0d1d578,network=Network(8b217731-de9e-49bc-84bb-130fd42ede51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3d051e2-c3') {{(pid=75337) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 16:05:00 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:05:00 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc3d051e2-c3, bridge=br-int, if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 16:05:00 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:05:00 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-ff591e64-be18-4f05-9dc6-eef5efec94dd tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/380623bf17d3cffe94ad1c10fb9e5fd681de8626.converted --force-share --output=json" returned: 0 in 0.251s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:05:00 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:05:00 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-ff591e64-be18-4f05-9dc6-eef5efec94dd tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Lock "380623bf17d3cffe94ad1c10fb9e5fd681de8626" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.138s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:05:00 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:05:00 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5f437363-4062-4190-be8b-f3e57964465b) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 16:05:00 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-ff591e64-be18-4f05-9dc6-eef5efec94dd tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/380623bf17d3cffe94ad1c10fb9e5fd681de8626 --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:05:00 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:05:00 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:05:00 user nova-compute[75337]: INFO os_vif [None req-22e56532-ba7a-487a-9ee2-28e06dfe6f9d tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:b4:bf,bridge_name='br-int',has_traffic_filtering=True,id=c3d051e2-c3b7-4ee0-aab0-dcf3c0d1d578,network=Network(8b217731-de9e-49bc-84bb-130fd42ede51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3d051e2-c3')
Nov 06 16:05:00 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-22e56532-ba7a-487a-9ee2-28e06dfe6f9d tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] [instance: 69df3824-b28c-43c0-9f20-52fa956642cc] Deleting instance files /opt/stack/data/nova/instances/69df3824-b28c-43c0-9f20-52fa956642cc_del
Nov 06 16:05:00 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-22e56532-ba7a-487a-9ee2-28e06dfe6f9d tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] [instance: 69df3824-b28c-43c0-9f20-52fa956642cc] Deletion of /opt/stack/data/nova/instances/69df3824-b28c-43c0-9f20-52fa956642cc_del complete
Nov 06 16:05:00 user nova-compute[75337]: DEBUG nova.network.neutron [None req-ff591e64-be18-4f05-9dc6-eef5efec94dd tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] [instance: 9e2043cc-ff4e-43e9-9867-920de4809cc4] Successfully updated port: 36f87e2c-dbfb-484a-99b8-6a77e3bb986a {{(pid=75337) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 16:05:00 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-ff591e64-be18-4f05-9dc6-eef5efec94dd tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Acquiring lock "refresh_cache-9e2043cc-ff4e-43e9-9867-920de4809cc4" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 16:05:00 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-ff591e64-be18-4f05-9dc6-eef5efec94dd tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Acquired lock "refresh_cache-9e2043cc-ff4e-43e9-9867-920de4809cc4" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 16:05:00 user nova-compute[75337]: DEBUG nova.network.neutron [None req-ff591e64-be18-4f05-9dc6-eef5efec94dd tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] [instance: 9e2043cc-ff4e-43e9-9867-920de4809cc4] Building network info cache for instance {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 16:05:00 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-ff591e64-be18-4f05-9dc6-eef5efec94dd tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/380623bf17d3cffe94ad1c10fb9e5fd681de8626 --force-share --output=json" returned: 0 in 0.197s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:05:00 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-ff591e64-be18-4f05-9dc6-eef5efec94dd tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Acquiring lock "380623bf17d3cffe94ad1c10fb9e5fd681de8626" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:05:00 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-ff591e64-be18-4f05-9dc6-eef5efec94dd tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Lock "380623bf17d3cffe94ad1c10fb9e5fd681de8626" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:05:00 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-ff591e64-be18-4f05-9dc6-eef5efec94dd tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/380623bf17d3cffe94ad1c10fb9e5fd681de8626 --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:05:00 user nova-compute[75337]: INFO nova.compute.manager [None req-22e56532-ba7a-487a-9ee2-28e06dfe6f9d tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] [instance: 69df3824-b28c-43c0-9f20-52fa956642cc] Took 0.95 seconds to destroy the instance on the hypervisor.
Nov 06 16:05:00 user nova-compute[75337]: DEBUG oslo.service.loopingcall [None req-22e56532-ba7a-487a-9ee2-28e06dfe6f9d tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75337) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 16:05:00 user nova-compute[75337]: DEBUG nova.compute.manager [-] [instance: 69df3824-b28c-43c0-9f20-52fa956642cc] Deallocating network for instance {{(pid=75337) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 16:05:00 user nova-compute[75337]: DEBUG nova.network.neutron [-] [instance: 69df3824-b28c-43c0-9f20-52fa956642cc] deallocate_for_instance() {{(pid=75337) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 16:05:00 user nova-compute[75337]: DEBUG nova.compute.manager [req-a6360df3-812e-4103-9092-0f46d73cb50f req-5cf0e3c3-f045-45b9-b95a-0aa44713422a service nova] [instance: 9e2043cc-ff4e-43e9-9867-920de4809cc4] Received event network-changed-36f87e2c-dbfb-484a-99b8-6a77e3bb986a {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:05:00 user nova-compute[75337]: DEBUG nova.compute.manager [req-a6360df3-812e-4103-9092-0f46d73cb50f req-5cf0e3c3-f045-45b9-b95a-0aa44713422a service nova] [instance: 9e2043cc-ff4e-43e9-9867-920de4809cc4] Refreshing instance network info cache due to event network-changed-36f87e2c-dbfb-484a-99b8-6a77e3bb986a. {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 16:05:00 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-a6360df3-812e-4103-9092-0f46d73cb50f req-5cf0e3c3-f045-45b9-b95a-0aa44713422a service nova] Acquiring lock "refresh_cache-9e2043cc-ff4e-43e9-9867-920de4809cc4" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 16:05:00 user nova-compute[75337]: DEBUG nova.network.neutron [None req-ff591e64-be18-4f05-9dc6-eef5efec94dd tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] [instance: 9e2043cc-ff4e-43e9-9867-920de4809cc4] Instance cache missing network info. {{(pid=75337) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 16:05:00 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-ff591e64-be18-4f05-9dc6-eef5efec94dd tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/380623bf17d3cffe94ad1c10fb9e5fd681de8626 --force-share --output=json" returned: 0 in 0.211s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:05:00 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-ff591e64-be18-4f05-9dc6-eef5efec94dd tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/380623bf17d3cffe94ad1c10fb9e5fd681de8626,backing_fmt=raw /opt/stack/data/nova/instances/9e2043cc-ff4e-43e9-9867-920de4809cc4/disk 1073741824 {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:05:00 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-ff591e64-be18-4f05-9dc6-eef5efec94dd tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/380623bf17d3cffe94ad1c10fb9e5fd681de8626,backing_fmt=raw /opt/stack/data/nova/instances/9e2043cc-ff4e-43e9-9867-920de4809cc4/disk 1073741824" returned: 0 in 0.056s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:05:00 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-ff591e64-be18-4f05-9dc6-eef5efec94dd tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Lock "380623bf17d3cffe94ad1c10fb9e5fd681de8626" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.271s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:05:00 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-ff591e64-be18-4f05-9dc6-eef5efec94dd tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/380623bf17d3cffe94ad1c10fb9e5fd681de8626 --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:05:00 user nova-compute[75337]: DEBUG nova.compute.manager [req-4e3ce4b7-ebc1-4fc1-9023-cf8acd8b7120 req-2e06d7bc-81b8-4f1b-b782-195ec5999175 service nova] [instance: e558736d-848f-4a79-a7aa-1e46638a85dc] Received event network-changed-0ed5847d-dcc9-43c0-96ae-02b3d24d1416 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:05:00 user nova-compute[75337]: DEBUG nova.compute.manager [req-4e3ce4b7-ebc1-4fc1-9023-cf8acd8b7120 req-2e06d7bc-81b8-4f1b-b782-195ec5999175 service nova] [instance: e558736d-848f-4a79-a7aa-1e46638a85dc] Refreshing instance network info cache due to event network-changed-0ed5847d-dcc9-43c0-96ae-02b3d24d1416. {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 16:05:00 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-4e3ce4b7-ebc1-4fc1-9023-cf8acd8b7120 req-2e06d7bc-81b8-4f1b-b782-195ec5999175 service nova] Acquiring lock "refresh_cache-e558736d-848f-4a79-a7aa-1e46638a85dc" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 16:05:00 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-4e3ce4b7-ebc1-4fc1-9023-cf8acd8b7120 req-2e06d7bc-81b8-4f1b-b782-195ec5999175 service nova] Acquired lock "refresh_cache-e558736d-848f-4a79-a7aa-1e46638a85dc" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 16:05:00 user nova-compute[75337]: DEBUG nova.network.neutron [req-4e3ce4b7-ebc1-4fc1-9023-cf8acd8b7120 req-2e06d7bc-81b8-4f1b-b782-195ec5999175 service nova] [instance: e558736d-848f-4a79-a7aa-1e46638a85dc] Refreshing network info cache for port 0ed5847d-dcc9-43c0-96ae-02b3d24d1416 {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 16:05:00 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-ff591e64-be18-4f05-9dc6-eef5efec94dd tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/380623bf17d3cffe94ad1c10fb9e5fd681de8626 --force-share --output=json" returned: 0 in 0.208s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:05:00 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-ff591e64-be18-4f05-9dc6-eef5efec94dd tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] [instance: 9e2043cc-ff4e-43e9-9867-920de4809cc4] Created local disks {{(pid=75337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 16:05:00 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-ff591e64-be18-4f05-9dc6-eef5efec94dd tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] [instance: 9e2043cc-ff4e-43e9-9867-920de4809cc4] Ensure instance console log exists: /opt/stack/data/nova/instances/9e2043cc-ff4e-43e9-9867-920de4809cc4/console.log {{(pid=75337) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 16:05:00 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-ff591e64-be18-4f05-9dc6-eef5efec94dd tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:05:00 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-ff591e64-be18-4f05-9dc6-eef5efec94dd tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:05:00 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-ff591e64-be18-4f05-9dc6-eef5efec94dd tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:05:00 user nova-compute[75337]: DEBUG nova.network.neutron [None req-ff591e64-be18-4f05-9dc6-eef5efec94dd tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] [instance: 9e2043cc-ff4e-43e9-9867-920de4809cc4] Updating instance_info_cache with network_info: [{"id": "36f87e2c-dbfb-484a-99b8-6a77e3bb986a", "address": "fa:16:3e:a0:7d:db", "network": {"id": "df5f1c2e-c934-4237-aee6-f070a198c4ac", "bridge": "br-int", "label": "tempest-TestStampPattern-1883369969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37b65a37b3ac4a92af0279d7ef3b9637", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36f87e2c-db", "ovs_interfaceid": "36f87e2c-dbfb-484a-99b8-6a77e3bb986a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 16:05:00 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-c100af3a-1df7-41ec-b3f9-3e71b681480b tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Acquiring lock "e558736d-848f-4a79-a7aa-1e46638a85dc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:05:00 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-c100af3a-1df7-41ec-b3f9-3e71b681480b tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Lock "e558736d-848f-4a79-a7aa-1e46638a85dc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:05:00 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-c100af3a-1df7-41ec-b3f9-3e71b681480b tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Acquiring lock "e558736d-848f-4a79-a7aa-1e46638a85dc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:05:00 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-c100af3a-1df7-41ec-b3f9-3e71b681480b tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Lock "e558736d-848f-4a79-a7aa-1e46638a85dc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:05:00 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-c100af3a-1df7-41ec-b3f9-3e71b681480b tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Lock "e558736d-848f-4a79-a7aa-1e46638a85dc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:05:00 user nova-compute[75337]: INFO nova.compute.manager [None req-c100af3a-1df7-41ec-b3f9-3e71b681480b tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: e558736d-848f-4a79-a7aa-1e46638a85dc] Terminating instance
Nov 06 16:05:00 user nova-compute[75337]: DEBUG nova.compute.manager [None req-c100af3a-1df7-41ec-b3f9-3e71b681480b tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: e558736d-848f-4a79-a7aa-1e46638a85dc] Start destroying the instance on the hypervisor. {{(pid=75337) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 16:05:00 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-ff591e64-be18-4f05-9dc6-eef5efec94dd tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Releasing lock "refresh_cache-9e2043cc-ff4e-43e9-9867-920de4809cc4" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 16:05:00 user nova-compute[75337]: DEBUG nova.compute.manager [None req-ff591e64-be18-4f05-9dc6-eef5efec94dd tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] [instance: 9e2043cc-ff4e-43e9-9867-920de4809cc4] Instance network_info: |[{"id": "36f87e2c-dbfb-484a-99b8-6a77e3bb986a", "address": "fa:16:3e:a0:7d:db", "network": {"id": "df5f1c2e-c934-4237-aee6-f070a198c4ac", "bridge": "br-int", "label": "tempest-TestStampPattern-1883369969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37b65a37b3ac4a92af0279d7ef3b9637", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36f87e2c-db", "ovs_interfaceid": "36f87e2c-dbfb-484a-99b8-6a77e3bb986a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 16:05:00 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-a6360df3-812e-4103-9092-0f46d73cb50f req-5cf0e3c3-f045-45b9-b95a-0aa44713422a service nova] Acquired lock "refresh_cache-9e2043cc-ff4e-43e9-9867-920de4809cc4" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 16:05:01 user nova-compute[75337]: DEBUG nova.network.neutron [req-a6360df3-812e-4103-9092-0f46d73cb50f req-5cf0e3c3-f045-45b9-b95a-0aa44713422a service nova] [instance: 9e2043cc-ff4e-43e9-9867-920de4809cc4] Refreshing network info cache for port 36f87e2c-dbfb-484a-99b8-6a77e3bb986a {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 16:05:01 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-ff591e64-be18-4f05-9dc6-eef5efec94dd tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] [instance: 9e2043cc-ff4e-43e9-9867-920de4809cc4] Start _get_guest_xml network_info=[{"id": "36f87e2c-dbfb-484a-99b8-6a77e3bb986a", "address": "fa:16:3e:a0:7d:db", "network": {"id": "df5f1c2e-c934-4237-aee6-f070a198c4ac", "bridge": "br-int", "label": "tempest-TestStampPattern-1883369969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37b65a37b3ac4a92af0279d7ef3b9637", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36f87e2c-db", "ovs_interfaceid": "36f87e2c-dbfb-484a-99b8-6a77e3bb986a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='73f9d30f54ba499a1cd43f8f01bfd9e6',container_format='bare',created_at=2023-11-06T16:04:48Z,direct_url=<?>,disk_format='qcow2',id=3deab4bc-5690-40b0-91cd-fced7f8b39bd,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-982667796',owner='37b65a37b3ac4a92af0279d7ef3b9637',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-06T16:04:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'guest_format': None, 'size': 0, 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '3deab4bc-5690-40b0-91cd-fced7f8b39bd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 16:05:01 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-ff591e64-be18-4f05-9dc6-eef5efec94dd tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 16:05:01 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-ff591e64-be18-4f05-9dc6-eef5efec94dd tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 16:05:01 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-ff591e64-be18-4f05-9dc6-eef5efec94dd tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 16:05:01 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-ff591e64-be18-4f05-9dc6-eef5efec94dd tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] CPU controller missing on host. {{(pid=75337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 16:05:01 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-ff591e64-be18-4f05-9dc6-eef5efec94dd tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 16:05:01 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-ff591e64-be18-4f05-9dc6-eef5efec94dd tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] CPU controller found on host. {{(pid=75337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 16:05:01 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-ff591e64-be18-4f05-9dc6-eef5efec94dd tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75337) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 16:05:01 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-ff591e64-be18-4f05-9dc6-eef5efec94dd tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T15:34:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='73f9d30f54ba499a1cd43f8f01bfd9e6',container_format='bare',created_at=2023-11-06T16:04:48Z,direct_url=<?>,disk_format='qcow2',id=3deab4bc-5690-40b0-91cd-fced7f8b39bd,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-982667796',owner='37b65a37b3ac4a92af0279d7ef3b9637',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-06T16:04:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 16:05:01 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-ff591e64-be18-4f05-9dc6-eef5efec94dd tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Flavor limits 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 16:05:01 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-ff591e64-be18-4f05-9dc6-eef5efec94dd tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Image limits 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 16:05:01 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-ff591e64-be18-4f05-9dc6-eef5efec94dd tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Flavor pref 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 16:05:01 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-ff591e64-be18-4f05-9dc6-eef5efec94dd tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Image pref 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 16:05:01 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-ff591e64-be18-4f05-9dc6-eef5efec94dd tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 16:05:01 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-ff591e64-be18-4f05-9dc6-eef5efec94dd tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 16:05:01 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-ff591e64-be18-4f05-9dc6-eef5efec94dd tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 16:05:01 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-ff591e64-be18-4f05-9dc6-eef5efec94dd tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Got 1 possible topologies {{(pid=75337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 16:05:01 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-ff591e64-be18-4f05-9dc6-eef5efec94dd tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 16:05:01 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-ff591e64-be18-4f05-9dc6-eef5efec94dd tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 16:05:01 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-ff591e64-be18-4f05-9dc6-eef5efec94dd tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T16:04:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1239054997',display_name='tempest-TestStampPattern-server-1239054997',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1239054997',id=43,image_ref='3deab4bc-5690-40b0-91cd-fced7f8b39bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMMCtkcnnPytdqY3MPUgpmiSS7xeTmnpNw4yaIWZePSkgldKNk3oCL2U4/sFc1ScnWZoqLzBjkjfNxl1aD3owimjf0HTAAfgYQIOjLMlBJeg0uRD4v0ywlrz4Y1mxBwe3Q==',key_name='tempest-TestStampPattern-1350094120',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='37b65a37b3ac4a92af0279d7ef3b9637',ramdisk_id='',reservation_id='r-ips8c99q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='01b61f9a-2591-4714-b18e-54f674a441ab',image_min_disk='1',image_min_ram='0',image_owner_id='37b65a37b3ac4a92af0279d7ef3b9637',image_owner_project_name='tempest-TestStampPattern-2127170584',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-2127170584-project-member',image_user_id='b551ef2185264d24b3af5f38bd583701',network_allocated='True',owner_project_name='tempest-TestStampPattern-2127170584',owner_user_name='tempest-TestStampPattern-2127170584-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T16:04:58Z,user_data=None,user_id='b551ef2185264d24b3af5f38bd583701',uuid=9e2043cc-ff4e-43e9-9867-920de4809cc4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "36f87e2c-dbfb-484a-99b8-6a77e3bb986a", "address": "fa:16:3e:a0:7d:db", "network": {"id": "df5f1c2e-c934-4237-aee6-f070a198c4ac", "bridge": "br-int", "label": "tempest-TestStampPattern-1883369969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37b65a37b3ac4a92af0279d7ef3b9637", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36f87e2c-db", "ovs_interfaceid": "36f87e2c-dbfb-484a-99b8-6a77e3bb986a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75337) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 16:05:01 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-ff591e64-be18-4f05-9dc6-eef5efec94dd tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Converting VIF {"id": "36f87e2c-dbfb-484a-99b8-6a77e3bb986a", "address": "fa:16:3e:a0:7d:db", "network": {"id": "df5f1c2e-c934-4237-aee6-f070a198c4ac", "bridge": "br-int", "label": "tempest-TestStampPattern-1883369969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37b65a37b3ac4a92af0279d7ef3b9637", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36f87e2c-db", "ovs_interfaceid": "36f87e2c-dbfb-484a-99b8-6a77e3bb986a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 16:05:01 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-ff591e64-be18-4f05-9dc6-eef5efec94dd tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:7d:db,bridge_name='br-int',has_traffic_filtering=True,id=36f87e2c-dbfb-484a-99b8-6a77e3bb986a,network=Network(df5f1c2e-c934-4237-aee6-f070a198c4ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36f87e2c-db') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 16:05:01 user nova-compute[75337]: DEBUG nova.objects.instance [None req-ff591e64-be18-4f05-9dc6-eef5efec94dd tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Lazy-loading 'pci_devices' on Instance uuid 9e2043cc-ff4e-43e9-9867-920de4809cc4 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 16:05:01 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:05:01 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-ff591e64-be18-4f05-9dc6-eef5efec94dd tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] [instance: 9e2043cc-ff4e-43e9-9867-920de4809cc4] End _get_guest_xml xml=<domain type="kvm">
Nov 06 16:05:01 user nova-compute[75337]:   <uuid>9e2043cc-ff4e-43e9-9867-920de4809cc4</uuid>
Nov 06 16:05:01 user nova-compute[75337]:   <name>instance-0000002b</name>
Nov 06 16:05:01 user nova-compute[75337]:   <memory>524288</memory>
Nov 06 16:05:01 user nova-compute[75337]:   <vcpu>1</vcpu>
Nov 06 16:05:01 user nova-compute[75337]:   <metadata>
Nov 06 16:05:01 user nova-compute[75337]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 16:05:01 user nova-compute[75337]:       <nova:package version="0.0.0"/>
Nov 06 16:05:01 user nova-compute[75337]:       <nova:name>tempest-TestStampPattern-server-1239054997</nova:name>
Nov 06 16:05:01 user nova-compute[75337]:       <nova:creationTime>2023-11-06 16:05:01</nova:creationTime>
Nov 06 16:05:01 user nova-compute[75337]:       <nova:flavor name="m1.tiny">
Nov 06 16:05:01 user nova-compute[75337]:         <nova:memory>512</nova:memory>
Nov 06 16:05:01 user nova-compute[75337]:         <nova:disk>1</nova:disk>
Nov 06 16:05:01 user nova-compute[75337]:         <nova:swap>0</nova:swap>
Nov 06 16:05:01 user nova-compute[75337]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 16:05:01 user nova-compute[75337]:         <nova:vcpus>1</nova:vcpus>
Nov 06 16:05:01 user nova-compute[75337]:       </nova:flavor>
Nov 06 16:05:01 user nova-compute[75337]:       <nova:owner>
Nov 06 16:05:01 user nova-compute[75337]:         <nova:user uuid="b551ef2185264d24b3af5f38bd583701">tempest-TestStampPattern-2127170584-project-member</nova:user>
Nov 06 16:05:01 user nova-compute[75337]:         <nova:project uuid="37b65a37b3ac4a92af0279d7ef3b9637">tempest-TestStampPattern-2127170584</nova:project>
Nov 06 16:05:01 user nova-compute[75337]:       </nova:owner>
Nov 06 16:05:01 user nova-compute[75337]:       <nova:root type="image" uuid="3deab4bc-5690-40b0-91cd-fced7f8b39bd"/>
Nov 06 16:05:01 user nova-compute[75337]:       <nova:ports>
Nov 06 16:05:01 user nova-compute[75337]:         <nova:port uuid="36f87e2c-dbfb-484a-99b8-6a77e3bb986a">
Nov 06 16:05:01 user nova-compute[75337]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 06 16:05:01 user nova-compute[75337]:         </nova:port>
Nov 06 16:05:01 user nova-compute[75337]:       </nova:ports>
Nov 06 16:05:01 user nova-compute[75337]:     </nova:instance>
Nov 06 16:05:01 user nova-compute[75337]:   </metadata>
Nov 06 16:05:01 user nova-compute[75337]:   <sysinfo type="smbios">
Nov 06 16:05:01 user nova-compute[75337]:     <system>
Nov 06 16:05:01 user nova-compute[75337]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 16:05:01 user nova-compute[75337]:       <entry name="product">OpenStack Nova</entry>
Nov 06 16:05:01 user nova-compute[75337]:       <entry name="version">0.0.0</entry>
Nov 06 16:05:01 user nova-compute[75337]:       <entry name="serial">9e2043cc-ff4e-43e9-9867-920de4809cc4</entry>
Nov 06 16:05:01 user nova-compute[75337]:       <entry name="uuid">9e2043cc-ff4e-43e9-9867-920de4809cc4</entry>
Nov 06 16:05:01 user nova-compute[75337]:       <entry name="family">Virtual Machine</entry>
Nov 06 16:05:01 user nova-compute[75337]:     </system>
Nov 06 16:05:01 user nova-compute[75337]:   </sysinfo>
Nov 06 16:05:01 user nova-compute[75337]:   <os>
Nov 06 16:05:01 user nova-compute[75337]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 16:05:01 user nova-compute[75337]:     <boot dev="hd"/>
Nov 06 16:05:01 user nova-compute[75337]:     <smbios mode="sysinfo"/>
Nov 06 16:05:01 user nova-compute[75337]:   </os>
Nov 06 16:05:01 user nova-compute[75337]:   <features>
Nov 06 16:05:01 user nova-compute[75337]:     <acpi/>
Nov 06 16:05:01 user nova-compute[75337]:     <apic/>
Nov 06 16:05:01 user nova-compute[75337]:     <vmcoreinfo/>
Nov 06 16:05:01 user nova-compute[75337]:   </features>
Nov 06 16:05:01 user nova-compute[75337]:   <clock offset="utc">
Nov 06 16:05:01 user nova-compute[75337]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 16:05:01 user nova-compute[75337]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 16:05:01 user nova-compute[75337]:     <timer name="hpet" present="no"/>
Nov 06 16:05:01 user nova-compute[75337]:   </clock>
Nov 06 16:05:01 user nova-compute[75337]:   <cpu mode="custom" match="exact">
Nov 06 16:05:01 user nova-compute[75337]:     <model>Nehalem</model>
Nov 06 16:05:01 user nova-compute[75337]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 16:05:01 user nova-compute[75337]:   </cpu>
Nov 06 16:05:01 user nova-compute[75337]:   <devices>
Nov 06 16:05:01 user nova-compute[75337]:     <disk type="file" device="disk">
Nov 06 16:05:01 user nova-compute[75337]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 16:05:01 user nova-compute[75337]:       <source file="/opt/stack/data/nova/instances/9e2043cc-ff4e-43e9-9867-920de4809cc4/disk"/>
Nov 06 16:05:01 user nova-compute[75337]:       <target dev="vda" bus="virtio"/>
Nov 06 16:05:01 user nova-compute[75337]:     </disk>
Nov 06 16:05:01 user nova-compute[75337]:     <interface type="ethernet">
Nov 06 16:05:01 user nova-compute[75337]:       <mac address="fa:16:3e:a0:7d:db"/>
Nov 06 16:05:01 user nova-compute[75337]:       <model type="virtio"/>
Nov 06 16:05:01 user nova-compute[75337]:       <mtu size="1442"/>
Nov 06 16:05:01 user nova-compute[75337]:       <target dev="tap36f87e2c-db"/>
Nov 06 16:05:01 user nova-compute[75337]:     </interface>
Nov 06 16:05:01 user nova-compute[75337]:     <serial type="pty">
Nov 06 16:05:01 user nova-compute[75337]:       <log file="/opt/stack/data/nova/instances/9e2043cc-ff4e-43e9-9867-920de4809cc4/console.log" append="off"/>
Nov 06 16:05:01 user nova-compute[75337]:     </serial>
Nov 06 16:05:01 user nova-compute[75337]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 16:05:01 user nova-compute[75337]:     <video>
Nov 06 16:05:01 user nova-compute[75337]:       <model type="virtio"/>
Nov 06 16:05:01 user nova-compute[75337]:     </video>
Nov 06 16:05:01 user nova-compute[75337]:     <rng model="virtio">
Nov 06 16:05:01 user nova-compute[75337]:       <backend model="random">/dev/urandom</backend>
Nov 06 16:05:01 user nova-compute[75337]:     </rng>
Nov 06 16:05:01 user nova-compute[75337]:     <controller type="usb" index="0" model="none"/>
Nov 06 16:05:01 user nova-compute[75337]:     <memballoon model="virtio">
Nov 06 16:05:01 user nova-compute[75337]:       <stats period="10"/>
Nov 06 16:05:01 user nova-compute[75337]:     </memballoon>
Nov 06 16:05:01 user nova-compute[75337]:   </devices>
Nov 06 16:05:01 user nova-compute[75337]: </domain>
Nov 06 16:05:01 user nova-compute[75337]:  {{(pid=75337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 16:05:01 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-ff591e64-be18-4f05-9dc6-eef5efec94dd tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T16:04:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1239054997',display_name='tempest-TestStampPattern-server-1239054997',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1239054997',id=43,image_ref='3deab4bc-5690-40b0-91cd-fced7f8b39bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMMCtkcnnPytdqY3MPUgpmiSS7xeTmnpNw4yaIWZePSkgldKNk3oCL2U4/sFc1ScnWZoqLzBjkjfNxl1aD3owimjf0HTAAfgYQIOjLMlBJeg0uRD4v0ywlrz4Y1mxBwe3Q==',key_name='tempest-TestStampPattern-1350094120',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='37b65a37b3ac4a92af0279d7ef3b9637',ramdisk_id='',reservation_id='r-ips8c99q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='01b61f9a-2591-4714-b18e-54f674a441ab',image_min_disk='1',image_min_ram='0',image_owner_id='37b65a37b3ac4a92af0279d7ef3b9637',image_owner_project_name='tempest-TestStampPattern-2127170584',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-2127170584-project-member',image_user_id='b551ef2185264d24b3af5f38bd583701',network_allocated='True',owner_project_name='tempest-TestStampPattern-2127170584',owner_user_name='tempest-TestStampPattern-2127170584-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T16:04:58Z,user_data=None,user_id='b551ef2185264d24b3af5f38bd583701',uuid=9e2043cc-ff4e-43e9-9867-920de4809cc4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "36f87e2c-dbfb-484a-99b8-6a77e3bb986a", "address": "fa:16:3e:a0:7d:db", "network": {"id": "df5f1c2e-c934-4237-aee6-f070a198c4ac", "bridge": "br-int", "label": "tempest-TestStampPattern-1883369969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37b65a37b3ac4a92af0279d7ef3b9637", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36f87e2c-db", "ovs_interfaceid": "36f87e2c-dbfb-484a-99b8-6a77e3bb986a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 16:05:01 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-ff591e64-be18-4f05-9dc6-eef5efec94dd tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Converting VIF {"id": "36f87e2c-dbfb-484a-99b8-6a77e3bb986a", "address": "fa:16:3e:a0:7d:db", "network": {"id": "df5f1c2e-c934-4237-aee6-f070a198c4ac", "bridge": "br-int", "label": "tempest-TestStampPattern-1883369969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37b65a37b3ac4a92af0279d7ef3b9637", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36f87e2c-db", "ovs_interfaceid": "36f87e2c-dbfb-484a-99b8-6a77e3bb986a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 16:05:01 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-ff591e64-be18-4f05-9dc6-eef5efec94dd tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:7d:db,bridge_name='br-int',has_traffic_filtering=True,id=36f87e2c-dbfb-484a-99b8-6a77e3bb986a,network=Network(df5f1c2e-c934-4237-aee6-f070a198c4ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36f87e2c-db') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 16:05:01 user nova-compute[75337]: DEBUG os_vif [None req-ff591e64-be18-4f05-9dc6-eef5efec94dd tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:7d:db,bridge_name='br-int',has_traffic_filtering=True,id=36f87e2c-dbfb-484a-99b8-6a77e3bb986a,network=Network(df5f1c2e-c934-4237-aee6-f070a198c4ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36f87e2c-db') {{(pid=75337) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 16:05:01 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:05:01 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 16:05:01 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 16:05:01 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:05:01 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b10a23f3-738e-5112-8ce3-000e4caecd19', '_type': 'linux-noop'}}, row=False) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 16:05:01 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:05:01 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:05:01 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:05:01 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:05:01 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap36f87e2c-db, may_exist=True, interface_attrs={}) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 16:05:01 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap36f87e2c-db, col_values=(('qos', UUID('09056f81-6aa3-4218-aa16-b4f1b3f139e6')),), if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 16:05:01 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap36f87e2c-db, col_values=(('external_ids', {'iface-id': '36f87e2c-dbfb-484a-99b8-6a77e3bb986a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a0:7d:db', 'vm-uuid': '9e2043cc-ff4e-43e9-9867-920de4809cc4'}),), if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 16:05:01 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:05:01 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:05:01 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:05:01 user nova-compute[75337]: INFO os_vif [None req-ff591e64-be18-4f05-9dc6-eef5efec94dd tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:7d:db,bridge_name='br-int',has_traffic_filtering=True,id=36f87e2c-dbfb-484a-99b8-6a77e3bb986a,network=Network(df5f1c2e-c934-4237-aee6-f070a198c4ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36f87e2c-db')
Nov 06 16:05:01 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-ff591e64-be18-4f05-9dc6-eef5efec94dd tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] No BDM found with device name vda, not building metadata. {{(pid=75337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 16:05:01 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-ff591e64-be18-4f05-9dc6-eef5efec94dd tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] No VIF found with MAC fa:16:3e:a0:7d:db, not building metadata {{(pid=75337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 16:05:01 user nova-compute[75337]: DEBUG nova.network.neutron [req-a6360df3-812e-4103-9092-0f46d73cb50f req-5cf0e3c3-f045-45b9-b95a-0aa44713422a service nova] [instance: 9e2043cc-ff4e-43e9-9867-920de4809cc4] Updated VIF entry in instance network info cache for port 36f87e2c-dbfb-484a-99b8-6a77e3bb986a. {{(pid=75337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 16:05:01 user nova-compute[75337]: DEBUG nova.network.neutron [req-a6360df3-812e-4103-9092-0f46d73cb50f req-5cf0e3c3-f045-45b9-b95a-0aa44713422a service nova] [instance: 9e2043cc-ff4e-43e9-9867-920de4809cc4] Updating instance_info_cache with network_info: [{"id": "36f87e2c-dbfb-484a-99b8-6a77e3bb986a", "address": "fa:16:3e:a0:7d:db", "network": {"id": "df5f1c2e-c934-4237-aee6-f070a198c4ac", "bridge": "br-int", "label": "tempest-TestStampPattern-1883369969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37b65a37b3ac4a92af0279d7ef3b9637", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36f87e2c-db", "ovs_interfaceid": "36f87e2c-dbfb-484a-99b8-6a77e3bb986a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 16:05:01 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-a6360df3-812e-4103-9092-0f46d73cb50f req-5cf0e3c3-f045-45b9-b95a-0aa44713422a service nova] Releasing lock "refresh_cache-9e2043cc-ff4e-43e9-9867-920de4809cc4" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 16:05:01 user nova-compute[75337]: DEBUG nova.network.neutron [req-4e3ce4b7-ebc1-4fc1-9023-cf8acd8b7120 req-2e06d7bc-81b8-4f1b-b782-195ec5999175 service nova] [instance: e558736d-848f-4a79-a7aa-1e46638a85dc] Updated VIF entry in instance network info cache for port 0ed5847d-dcc9-43c0-96ae-02b3d24d1416. {{(pid=75337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 16:05:01 user nova-compute[75337]: DEBUG nova.network.neutron [req-4e3ce4b7-ebc1-4fc1-9023-cf8acd8b7120 req-2e06d7bc-81b8-4f1b-b782-195ec5999175 service nova] [instance: e558736d-848f-4a79-a7aa-1e46638a85dc] Updating instance_info_cache with network_info: [{"id": "0ed5847d-dcc9-43c0-96ae-02b3d24d1416", "address": "fa:16:3e:22:e2:a6", "network": {"id": "4e47319f-de1d-4dfe-9915-7d2d5131704d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-895093240-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "915211c6a2734c36b34ff92a56b085f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ed5847d-dc", "ovs_interfaceid": "0ed5847d-dcc9-43c0-96ae-02b3d24d1416", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 16:05:01 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-4e3ce4b7-ebc1-4fc1-9023-cf8acd8b7120 req-2e06d7bc-81b8-4f1b-b782-195ec5999175 service nova] Releasing lock "refresh_cache-e558736d-848f-4a79-a7aa-1e46638a85dc" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 16:05:01 user nova-compute[75337]: DEBUG nova.network.neutron [-] [instance: 69df3824-b28c-43c0-9f20-52fa956642cc] Updating instance_info_cache with network_info: [] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 16:05:01 user nova-compute[75337]: INFO nova.compute.manager [-] [instance: 69df3824-b28c-43c0-9f20-52fa956642cc] Took 1.21 seconds to deallocate network for instance.
Nov 06 16:05:01 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-22e56532-ba7a-487a-9ee2-28e06dfe6f9d tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:05:01 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-22e56532-ba7a-487a-9ee2-28e06dfe6f9d tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:05:02 user nova-compute[75337]: DEBUG nova.compute.manager [req-cb6b4288-f36f-406d-b7e2-a55270616bd3 req-9115d344-e7c6-4456-b222-e0263369aebc service nova] [instance: 69df3824-b28c-43c0-9f20-52fa956642cc] Received event network-vif-plugged-c3d051e2-c3b7-4ee0-aab0-dcf3c0d1d578 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:05:02 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-cb6b4288-f36f-406d-b7e2-a55270616bd3 req-9115d344-e7c6-4456-b222-e0263369aebc service nova] Acquiring lock "69df3824-b28c-43c0-9f20-52fa956642cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:05:02 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-cb6b4288-f36f-406d-b7e2-a55270616bd3 req-9115d344-e7c6-4456-b222-e0263369aebc service nova] Lock "69df3824-b28c-43c0-9f20-52fa956642cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:05:02 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-cb6b4288-f36f-406d-b7e2-a55270616bd3 req-9115d344-e7c6-4456-b222-e0263369aebc service nova] Lock "69df3824-b28c-43c0-9f20-52fa956642cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:05:02 user nova-compute[75337]: DEBUG nova.compute.manager [req-cb6b4288-f36f-406d-b7e2-a55270616bd3 req-9115d344-e7c6-4456-b222-e0263369aebc service nova] [instance: 69df3824-b28c-43c0-9f20-52fa956642cc] No waiting events found dispatching network-vif-plugged-c3d051e2-c3b7-4ee0-aab0-dcf3c0d1d578 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 16:05:02 user nova-compute[75337]: WARNING nova.compute.manager [req-cb6b4288-f36f-406d-b7e2-a55270616bd3 req-9115d344-e7c6-4456-b222-e0263369aebc service nova] [instance: 69df3824-b28c-43c0-9f20-52fa956642cc] Received unexpected event network-vif-plugged-c3d051e2-c3b7-4ee0-aab0-dcf3c0d1d578 for instance with vm_state deleted and task_state None.
Nov 06 16:05:02 user nova-compute[75337]: DEBUG nova.compute.manager [req-cb6b4288-f36f-406d-b7e2-a55270616bd3 req-9115d344-e7c6-4456-b222-e0263369aebc service nova] [instance: 69df3824-b28c-43c0-9f20-52fa956642cc] Received event network-vif-deleted-c3d051e2-c3b7-4ee0-aab0-dcf3c0d1d578 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:05:02 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-22e56532-ba7a-487a-9ee2-28e06dfe6f9d tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 16:05:02 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-22e56532-ba7a-487a-9ee2-28e06dfe6f9d tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 16:05:02 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-22e56532-ba7a-487a-9ee2-28e06dfe6f9d tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.365s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:05:02 user nova-compute[75337]: INFO nova.scheduler.client.report [None req-22e56532-ba7a-487a-9ee2-28e06dfe6f9d tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Deleted allocations for instance 69df3824-b28c-43c0-9f20-52fa956642cc
Nov 06 16:05:02 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-22e56532-ba7a-487a-9ee2-28e06dfe6f9d tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Lock "69df3824-b28c-43c0-9f20-52fa956642cc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.752s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:05:02 user nova-compute[75337]: INFO nova.virt.libvirt.driver [-] [instance: e558736d-848f-4a79-a7aa-1e46638a85dc] Instance destroyed successfully.
Nov 06 16:05:02 user nova-compute[75337]: DEBUG nova.objects.instance [None req-c100af3a-1df7-41ec-b3f9-3e71b681480b tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Lazy-loading 'resources' on Instance uuid e558736d-848f-4a79-a7aa-1e46638a85dc {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 16:05:02 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-c100af3a-1df7-41ec-b3f9-3e71b681480b tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T15:59:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1536076217',display_name='tempest-TestVolumeBootPattern-server-1536076217',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1536076217',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGSEIi3g934sMLPVz4vXQXFZs0uPpfou1A8cQ+7f5EeoH+XvyrzPDAqzu7FTAOU7yXRJ8IemF+WnLjTlXTwpg+PX5Yor65g2g46SgdNmwrUcBQAy+H25S13pZzToJUCwGA==',key_name='tempest-TestVolumeBootPattern-1419808121',keypairs=<?>,launch_index=0,launched_at=2023-11-06T16:00:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='915211c6a2734c36b34ff92a56b085f6',ramdisk_id='',reservation_id='r-w3ek0o6w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1055092640',owner_user_name='tempest-TestVolumeBootPattern-1055092640-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T16:00:06Z,user_data=None,user_id='bb8d5f0200124588be1cfde107341a45',uuid=e558736d-848f-4a79-a7aa-1e46638a85dc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0ed5847d-dcc9-43c0-96ae-02b3d24d1416", "address": "fa:16:3e:22:e2:a6", "network": {"id": "4e47319f-de1d-4dfe-9915-7d2d5131704d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-895093240-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "915211c6a2734c36b34ff92a56b085f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ed5847d-dc", "ovs_interfaceid": "0ed5847d-dcc9-43c0-96ae-02b3d24d1416", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 16:05:02 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-c100af3a-1df7-41ec-b3f9-3e71b681480b tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Converting VIF {"id": "0ed5847d-dcc9-43c0-96ae-02b3d24d1416", "address": "fa:16:3e:22:e2:a6", "network": {"id": "4e47319f-de1d-4dfe-9915-7d2d5131704d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-895093240-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "915211c6a2734c36b34ff92a56b085f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ed5847d-dc", "ovs_interfaceid": "0ed5847d-dcc9-43c0-96ae-02b3d24d1416", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 16:05:02 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-c100af3a-1df7-41ec-b3f9-3e71b681480b tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:22:e2:a6,bridge_name='br-int',has_traffic_filtering=True,id=0ed5847d-dcc9-43c0-96ae-02b3d24d1416,network=Network(4e47319f-de1d-4dfe-9915-7d2d5131704d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ed5847d-dc') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 16:05:02 user nova-compute[75337]: DEBUG os_vif [None req-c100af3a-1df7-41ec-b3f9-3e71b681480b tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:22:e2:a6,bridge_name='br-int',has_traffic_filtering=True,id=0ed5847d-dcc9-43c0-96ae-02b3d24d1416,network=Network(4e47319f-de1d-4dfe-9915-7d2d5131704d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ed5847d-dc') {{(pid=75337) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 16:05:02 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:05:02 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0ed5847d-dc, bridge=br-int, if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 16:05:02 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:05:02 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:05:02 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:05:02 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:05:02 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=40b885e9-b7d5-4ac6-92a4-6e9e64530fa5) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 16:05:02 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:05:02 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:05:02 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:05:02 user nova-compute[75337]: INFO os_vif [None req-c100af3a-1df7-41ec-b3f9-3e71b681480b tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:22:e2:a6,bridge_name='br-int',has_traffic_filtering=True,id=0ed5847d-dcc9-43c0-96ae-02b3d24d1416,network=Network(4e47319f-de1d-4dfe-9915-7d2d5131704d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ed5847d-dc')
Nov 06 16:05:02 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c100af3a-1df7-41ec-b3f9-3e71b681480b tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: e558736d-848f-4a79-a7aa-1e46638a85dc] calling os-brick to detach iSCSI Volume {{(pid=75337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 16:05:02 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c100af3a-1df7-41ec-b3f9-3e71b681480b tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2abc33d0c0>, {'target_iqn': 'iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CPtyXLsv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 16:05:02 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-c100af3a-1df7-41ec-b3f9-3e71b681480b tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 16:05:02 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-c100af3a-1df7-41ec-b3f9-3e71b681480b tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 16:05:02 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-c100af3a-1df7-41ec-b3f9-3e71b681480b tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 16:05:02 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:05:02 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:05:02 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3f624a5-6988-4e10-a5af-3b8931356e79]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c4a5e7b2-ad62-4972-974e-83b84afac437\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:05:02 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c100af3a-1df7-41ec-b3f9-3e71b681480b tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 16:05:02 user nova-compute[75337]: No targets found.
Nov 06 16:05:02 user nova-compute[75337]: iSNS:
Nov 06 16:05:02 user nova-compute[75337]: No targets found.
Nov 06 16:05:02 user nova-compute[75337]: STATIC:
Nov 06 16:05:02 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:c4a5e7b2-ad62-4972-974e-83b84afac437
Nov 06 16:05:02 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 16:05:02 user nova-compute[75337]:                 Iface Name: default
Nov 06 16:05:02 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139
Nov 06 16:05:02 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 16:05:02 user nova-compute[75337]:                 Iface Name: default
Nov 06 16:05:02 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673
Nov 06 16:05:02 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 16:05:02 user nova-compute[75337]:                 Iface Name: default
Nov 06 16:05:02 user nova-compute[75337]: FIRMWARE:
Nov 06 16:05:02 user nova-compute[75337]: No targets found.
Nov 06 16:05:02 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 16:05:02 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c100af3a-1df7-41ec-b3f9-3e71b681480b tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 16:05:02 user nova-compute[75337]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 16:05:02 user nova-compute[75337]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75337) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 16:05:02 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c100af3a-1df7-41ec-b3f9-3e71b681480b tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673', 0)] {{(pid=75337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 16:05:02 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:05:02 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:05:02 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[57e5b7cc-d467-4e9f-b841-722599fe4477]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4a5e7b2-ad62-4972-974e-83b84afac437\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:05:02 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:05:02 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:05:02 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[020b5d13-234a-497d-af9e-fe0044ae2a6e]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a5e7b2-ad62-4972-974e-83b84afac437 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139 (non-flash)\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:05:02 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c100af3a-1df7-41ec-b3f9-3e71b681480b tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673 (non-flash)
Nov 06 16:05:02 user nova-compute[75337]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a5e7b2-ad62-4972-974e-83b84afac437 (non-flash)
Nov 06 16:05:02 user nova-compute[75337]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139 (non-flash)
Nov 06 16:05:02 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 16:05:02 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c100af3a-1df7-41ec-b3f9-3e71b681480b tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673 (non-flash)
Nov 06 16:05:02 user nova-compute[75337]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a5e7b2-ad62-4972-974e-83b84afac437 (non-flash)
Nov 06 16:05:02 user nova-compute[75337]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139 (non-flash)
Nov 06 16:05:02 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 16:05:02 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c100af3a-1df7-41ec-b3f9-3e71b681480b tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2abc1293f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673'): ({'sdb'}, set())}) {{(pid=75337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 16:05:02 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-c100af3a-1df7-41ec-b3f9-3e71b681480b tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Removing single pathed devices sdb {{(pid=75337) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 16:05:02 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:05:02 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:05:02 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[2039bea5-3559-4d6e-8515-49b13a7b65b9]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:05:02 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:05:02 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.028s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:05:02 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[07cb3890-b390-4df6-9e5c-9d2e523b61c1]: (4, ('ok\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:05:02 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-c100af3a-1df7-41ec-b3f9-3e71b681480b tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Flushing IO for device /dev/sdb {{(pid=75337) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 16:05:02 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:05:02 user nova-compute[75337]: DEBUG nova.compute.manager [req-4b25e448-7803-4f68-8711-ca5c4b143325 req-50d3fe6f-6743-4163-b433-db891ca82a72 service nova] [instance: e558736d-848f-4a79-a7aa-1e46638a85dc] Received event network-vif-unplugged-0ed5847d-dcc9-43c0-96ae-02b3d24d1416 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:05:02 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-4b25e448-7803-4f68-8711-ca5c4b143325 req-50d3fe6f-6743-4163-b433-db891ca82a72 service nova] Acquiring lock "e558736d-848f-4a79-a7aa-1e46638a85dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:05:02 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-4b25e448-7803-4f68-8711-ca5c4b143325 req-50d3fe6f-6743-4163-b433-db891ca82a72 service nova] Lock "e558736d-848f-4a79-a7aa-1e46638a85dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:05:02 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-4b25e448-7803-4f68-8711-ca5c4b143325 req-50d3fe6f-6743-4163-b433-db891ca82a72 service nova] Lock "e558736d-848f-4a79-a7aa-1e46638a85dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:05:02 user nova-compute[75337]: DEBUG nova.compute.manager [req-4b25e448-7803-4f68-8711-ca5c4b143325 req-50d3fe6f-6743-4163-b433-db891ca82a72 service nova] [instance: e558736d-848f-4a79-a7aa-1e46638a85dc] No waiting events found dispatching network-vif-unplugged-0ed5847d-dcc9-43c0-96ae-02b3d24d1416 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 16:05:02 user nova-compute[75337]: DEBUG nova.compute.manager [req-4b25e448-7803-4f68-8711-ca5c4b143325 req-50d3fe6f-6743-4163-b433-db891ca82a72 service nova] [instance: e558736d-848f-4a79-a7aa-1e46638a85dc] Received event network-vif-unplugged-0ed5847d-dcc9-43c0-96ae-02b3d24d1416 for instance with task_state deleting. {{(pid=75337) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 16:05:02 user nova-compute[75337]: DEBUG nova.compute.manager [req-4b25e448-7803-4f68-8711-ca5c4b143325 req-50d3fe6f-6743-4163-b433-db891ca82a72 service nova] [instance: e558736d-848f-4a79-a7aa-1e46638a85dc] Received event network-vif-plugged-0ed5847d-dcc9-43c0-96ae-02b3d24d1416 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:05:02 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-4b25e448-7803-4f68-8711-ca5c4b143325 req-50d3fe6f-6743-4163-b433-db891ca82a72 service nova] Acquiring lock "e558736d-848f-4a79-a7aa-1e46638a85dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:05:02 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-4b25e448-7803-4f68-8711-ca5c4b143325 req-50d3fe6f-6743-4163-b433-db891ca82a72 service nova] Lock "e558736d-848f-4a79-a7aa-1e46638a85dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:05:02 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-4b25e448-7803-4f68-8711-ca5c4b143325 req-50d3fe6f-6743-4163-b433-db891ca82a72 service nova] Lock "e558736d-848f-4a79-a7aa-1e46638a85dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:05:02 user nova-compute[75337]: DEBUG nova.compute.manager [req-4b25e448-7803-4f68-8711-ca5c4b143325 req-50d3fe6f-6743-4163-b433-db891ca82a72 service nova] [instance: e558736d-848f-4a79-a7aa-1e46638a85dc] No waiting events found dispatching network-vif-plugged-0ed5847d-dcc9-43c0-96ae-02b3d24d1416 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 16:05:02 user nova-compute[75337]: WARNING nova.compute.manager [req-4b25e448-7803-4f68-8711-ca5c4b143325 req-50d3fe6f-6743-4163-b433-db891ca82a72 service nova] [instance: e558736d-848f-4a79-a7aa-1e46638a85dc] Received unexpected event network-vif-plugged-0ed5847d-dcc9-43c0-96ae-02b3d24d1416 for instance with vm_state active and task_state deleting.
Nov 06 16:05:02 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:05:02 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dfcd92e-1dfd-4e0d-95bd-08e06142e15d]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:05:02 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-c100af3a-1df7-41ec-b3f9-3e71b681480b tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75337) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 16:05:02 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:05:02 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:05:02 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[934b4858-1e33-43e0-a686-e0cfd008a726]: (4, ('1', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:05:02 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-c100af3a-1df7-41ec-b3f9-3e71b681480b tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 16:05:02 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-c100af3a-1df7-41ec-b3f9-3e71b681480b tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] SCSI volumes sdb have been removed. {{(pid=75337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 16:05:02 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c100af3a-1df7-41ec-b3f9-3e71b681480b tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673')] {{(pid=75337) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 16:05:02 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:05:02 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:05:02 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e5e3504-3853-4649-bf87-b7fc499d890f]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:05:02 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c100af3a-1df7-41ec-b3f9-3e71b681480b tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:05:02 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673 -p 172.16.0.220:3260 --logout {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:05:02 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:05:02 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[b612e9c0-688d-446e-a9eb-8f0fa0bf0881]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:05:02 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c100af3a-1df7-41ec-b3f9-3e71b681480b tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673, portal: 172.16.0.220,3260]
Nov 06 16:05:02 user nova-compute[75337]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673, portal: 172.16.0.220,3260] successful.
Nov 06 16:05:02 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:05:02 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673 -p 172.16.0.220:3260 --op delete {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:05:02 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:324f5822-eef0-4ecf-93e4-791b0677d673 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:05:02 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[9007a29e-8d80-40f7-b3a4-888eb5283b99]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:05:02 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c100af3a-1df7-41ec-b3f9-3e71b681480b tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:05:02 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-c100af3a-1df7-41ec-b3f9-3e71b681480b tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.353s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 16:05:02 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c100af3a-1df7-41ec-b3f9-3e71b681480b tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] <== disconnect_volume: return (354ms) None {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 16:05:02 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c100af3a-1df7-41ec-b3f9-3e71b681480b tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: e558736d-848f-4a79-a7aa-1e46638a85dc] Disconnected iSCSI Volume {{(pid=75337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 16:05:02 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-c100af3a-1df7-41ec-b3f9-3e71b681480b tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: e558736d-848f-4a79-a7aa-1e46638a85dc] Deleting instance files /opt/stack/data/nova/instances/e558736d-848f-4a79-a7aa-1e46638a85dc_del
Nov 06 16:05:02 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-c100af3a-1df7-41ec-b3f9-3e71b681480b tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: e558736d-848f-4a79-a7aa-1e46638a85dc] Deletion of /opt/stack/data/nova/instances/e558736d-848f-4a79-a7aa-1e46638a85dc_del complete
Nov 06 16:05:02 user nova-compute[75337]: INFO nova.compute.manager [None req-c100af3a-1df7-41ec-b3f9-3e71b681480b tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: e558736d-848f-4a79-a7aa-1e46638a85dc] Took 1.89 seconds to destroy the instance on the hypervisor.
Nov 06 16:05:02 user nova-compute[75337]: DEBUG oslo.service.loopingcall [None req-c100af3a-1df7-41ec-b3f9-3e71b681480b tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75337) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 16:05:02 user nova-compute[75337]: DEBUG nova.compute.manager [-] [instance: e558736d-848f-4a79-a7aa-1e46638a85dc] Deallocating network for instance {{(pid=75337) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 16:05:02 user nova-compute[75337]: DEBUG nova.network.neutron [-] [instance: e558736d-848f-4a79-a7aa-1e46638a85dc] deallocate_for_instance() {{(pid=75337) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 16:05:03 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:05:03 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:05:03 user nova-compute[75337]: DEBUG nova.network.neutron [-] [instance: e558736d-848f-4a79-a7aa-1e46638a85dc] Updating instance_info_cache with network_info: [] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 16:05:03 user nova-compute[75337]: INFO nova.compute.manager [-] [instance: e558736d-848f-4a79-a7aa-1e46638a85dc] Took 0.46 seconds to deallocate network for instance.
Nov 06 16:05:03 user nova-compute[75337]: DEBUG nova.compute.manager [req-a908fc5e-3098-4aea-bc1c-ee5ce9c42fbc req-0e2c31d1-40a3-4781-9fe0-4f24bcef0192 service nova] [instance: 9e2043cc-ff4e-43e9-9867-920de4809cc4] Received event network-vif-plugged-36f87e2c-dbfb-484a-99b8-6a77e3bb986a {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:05:03 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-a908fc5e-3098-4aea-bc1c-ee5ce9c42fbc req-0e2c31d1-40a3-4781-9fe0-4f24bcef0192 service nova] Acquiring lock "9e2043cc-ff4e-43e9-9867-920de4809cc4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:05:03 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-a908fc5e-3098-4aea-bc1c-ee5ce9c42fbc req-0e2c31d1-40a3-4781-9fe0-4f24bcef0192 service nova] Lock "9e2043cc-ff4e-43e9-9867-920de4809cc4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:05:03 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-a908fc5e-3098-4aea-bc1c-ee5ce9c42fbc req-0e2c31d1-40a3-4781-9fe0-4f24bcef0192 service nova] Lock "9e2043cc-ff4e-43e9-9867-920de4809cc4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:05:03 user nova-compute[75337]: DEBUG nova.compute.manager [req-a908fc5e-3098-4aea-bc1c-ee5ce9c42fbc req-0e2c31d1-40a3-4781-9fe0-4f24bcef0192 service nova] [instance: 9e2043cc-ff4e-43e9-9867-920de4809cc4] No waiting events found dispatching network-vif-plugged-36f87e2c-dbfb-484a-99b8-6a77e3bb986a {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 16:05:03 user nova-compute[75337]: WARNING nova.compute.manager [req-a908fc5e-3098-4aea-bc1c-ee5ce9c42fbc req-0e2c31d1-40a3-4781-9fe0-4f24bcef0192 service nova] [instance: 9e2043cc-ff4e-43e9-9867-920de4809cc4] Received unexpected event network-vif-plugged-36f87e2c-dbfb-484a-99b8-6a77e3bb986a for instance with vm_state building and task_state spawning.
Nov 06 16:05:03 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:05:04 user nova-compute[75337]: DEBUG nova.compute.manager [req-ad7cf0ae-efcc-4326-b5ae-7c5589ef71e3 req-c17475f9-83bc-41bd-a252-440957d60375 service nova] [instance: e558736d-848f-4a79-a7aa-1e46638a85dc] Received event network-vif-deleted-0ed5847d-dcc9-43c0-96ae-02b3d24d1416 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:05:04 user nova-compute[75337]: INFO nova.compute.manager [None req-c100af3a-1df7-41ec-b3f9-3e71b681480b tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] [instance: e558736d-848f-4a79-a7aa-1e46638a85dc] Took 1.33 seconds to detach 1 volumes for instance.
Nov 06 16:05:04 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:05:04 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-c100af3a-1df7-41ec-b3f9-3e71b681480b tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:05:04 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-c100af3a-1df7-41ec-b3f9-3e71b681480b tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:05:05 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-c100af3a-1df7-41ec-b3f9-3e71b681480b tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 16:05:05 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-c100af3a-1df7-41ec-b3f9-3e71b681480b tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 16:05:05 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-c100af3a-1df7-41ec-b3f9-3e71b681480b tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.284s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:05:05 user nova-compute[75337]: INFO nova.scheduler.client.report [None req-c100af3a-1df7-41ec-b3f9-3e71b681480b tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Deleted allocations for instance e558736d-848f-4a79-a7aa-1e46638a85dc
Nov 06 16:05:05 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-c100af3a-1df7-41ec-b3f9-3e71b681480b tempest-TestVolumeBootPattern-1055092640 tempest-TestVolumeBootPattern-1055092640-project-member] Lock "e558736d-848f-4a79-a7aa-1e46638a85dc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.390s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:05:05 user nova-compute[75337]: DEBUG nova.compute.manager [None req-ff591e64-be18-4f05-9dc6-eef5efec94dd tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] [instance: 9e2043cc-ff4e-43e9-9867-920de4809cc4] Instance event wait completed in 0 seconds for  {{(pid=75337) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 16:05:05 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-ff591e64-be18-4f05-9dc6-eef5efec94dd tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] [instance: 9e2043cc-ff4e-43e9-9867-920de4809cc4] Guest created on hypervisor {{(pid=75337) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 16:05:05 user nova-compute[75337]: INFO nova.virt.libvirt.driver [-] [instance: 9e2043cc-ff4e-43e9-9867-920de4809cc4] Instance spawned successfully.
Nov 06 16:05:05 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-ff591e64-be18-4f05-9dc6-eef5efec94dd tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] [instance: 9e2043cc-ff4e-43e9-9867-920de4809cc4] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 16:05:05 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-ff591e64-be18-4f05-9dc6-eef5efec94dd tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] [instance: 9e2043cc-ff4e-43e9-9867-920de4809cc4] Found default for hw_input_bus of None {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 16:05:05 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-ff591e64-be18-4f05-9dc6-eef5efec94dd tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] [instance: 9e2043cc-ff4e-43e9-9867-920de4809cc4] Found default for hw_pointer_model of None {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 16:05:05 user nova-compute[75337]: DEBUG nova.compute.manager [req-aa507806-789e-47ca-9e45-d9909bddcf62 req-6a5037f1-0d98-4f69-97b8-e795ee712d01 service nova] [instance: 9e2043cc-ff4e-43e9-9867-920de4809cc4] Received event network-vif-plugged-36f87e2c-dbfb-484a-99b8-6a77e3bb986a {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:05:05 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-aa507806-789e-47ca-9e45-d9909bddcf62 req-6a5037f1-0d98-4f69-97b8-e795ee712d01 service nova] Acquiring lock "9e2043cc-ff4e-43e9-9867-920de4809cc4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:05:05 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-aa507806-789e-47ca-9e45-d9909bddcf62 req-6a5037f1-0d98-4f69-97b8-e795ee712d01 service nova] Lock "9e2043cc-ff4e-43e9-9867-920de4809cc4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:05:05 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-aa507806-789e-47ca-9e45-d9909bddcf62 req-6a5037f1-0d98-4f69-97b8-e795ee712d01 service nova] Lock "9e2043cc-ff4e-43e9-9867-920de4809cc4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:05:05 user nova-compute[75337]: DEBUG nova.compute.manager [req-aa507806-789e-47ca-9e45-d9909bddcf62 req-6a5037f1-0d98-4f69-97b8-e795ee712d01 service nova] [instance: 9e2043cc-ff4e-43e9-9867-920de4809cc4] No waiting events found dispatching network-vif-plugged-36f87e2c-dbfb-484a-99b8-6a77e3bb986a {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 16:05:05 user nova-compute[75337]: WARNING nova.compute.manager [req-aa507806-789e-47ca-9e45-d9909bddcf62 req-6a5037f1-0d98-4f69-97b8-e795ee712d01 service nova] [instance: 9e2043cc-ff4e-43e9-9867-920de4809cc4] Received unexpected event network-vif-plugged-36f87e2c-dbfb-484a-99b8-6a77e3bb986a for instance with vm_state building and task_state spawning.
Nov 06 16:05:05 user nova-compute[75337]: INFO nova.compute.manager [None req-ff591e64-be18-4f05-9dc6-eef5efec94dd tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] [instance: 9e2043cc-ff4e-43e9-9867-920de4809cc4] Took 7.75 seconds to spawn the instance on the hypervisor.
Nov 06 16:05:05 user nova-compute[75337]: DEBUG nova.compute.manager [None req-ff591e64-be18-4f05-9dc6-eef5efec94dd tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] [instance: 9e2043cc-ff4e-43e9-9867-920de4809cc4] Checking state {{(pid=75337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 16:05:05 user nova-compute[75337]: INFO nova.compute.manager [None req-ff591e64-be18-4f05-9dc6-eef5efec94dd tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] [instance: 9e2043cc-ff4e-43e9-9867-920de4809cc4] Took 8.68 seconds to build instance.
Nov 06 16:05:05 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._sync_power_states {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:05:05 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-ff591e64-be18-4f05-9dc6-eef5efec94dd tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Lock "9e2043cc-ff4e-43e9-9867-920de4809cc4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.865s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:05:06 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Triggering sync for uuid 6110b34a-6fd3-45fc-911d-4e5d3c7f2d78 {{(pid=75337) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 06 16:05:06 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Triggering sync for uuid 01b61f9a-2591-4714-b18e-54f674a441ab {{(pid=75337) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 06 16:05:06 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Triggering sync for uuid ba20919c-b506-458e-ac17-70bcb8900bb7 {{(pid=75337) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 06 16:05:06 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Triggering sync for uuid d6eaef86-b841-4142-9549-31954fb34fa2 {{(pid=75337) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 06 16:05:06 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Triggering sync for uuid 9e2043cc-ff4e-43e9-9867-920de4809cc4 {{(pid=75337) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 06 16:05:06 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "6110b34a-6fd3-45fc-911d-4e5d3c7f2d78" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:05:06 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "6110b34a-6fd3-45fc-911d-4e5d3c7f2d78" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:05:06 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "01b61f9a-2591-4714-b18e-54f674a441ab" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:05:06 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "01b61f9a-2591-4714-b18e-54f674a441ab" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:05:06 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "ba20919c-b506-458e-ac17-70bcb8900bb7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:05:06 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "ba20919c-b506-458e-ac17-70bcb8900bb7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:05:06 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "d6eaef86-b841-4142-9549-31954fb34fa2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:05:06 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "d6eaef86-b841-4142-9549-31954fb34fa2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:05:06 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "9e2043cc-ff4e-43e9-9867-920de4809cc4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:05:06 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "9e2043cc-ff4e-43e9-9867-920de4809cc4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:05:06 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "ba20919c-b506-458e-ac17-70bcb8900bb7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.043s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:05:06 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "6110b34a-6fd3-45fc-911d-4e5d3c7f2d78" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.059s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:05:06 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "9e2043cc-ff4e-43e9-9867-920de4809cc4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.060s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:05:06 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "d6eaef86-b841-4142-9549-31954fb34fa2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.066s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:05:06 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "01b61f9a-2591-4714-b18e-54f674a441ab" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.093s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:05:07 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:05:10 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:05:11 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:05:11 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:05:11 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75337) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 16:05:12 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:05:14 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:05:14 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:05:14 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:05:14 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:05:17 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:05:17 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:05:18 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:05:19 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:05:19 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:05:22 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:05:22 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:05:22 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Starting heal instance info cache {{(pid=75337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 16:05:22 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Didn't find any instances for network info cache update. {{(pid=75337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 06 16:05:24 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager.update_available_resource {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:05:24 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:05:24 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:05:24 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:05:24 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Auditing locally available compute resources for user (node: user) {{(pid=75337) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 16:05:24 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01b61f9a-2591-4714-b18e-54f674a441ab/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:05:24 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:05:24 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01b61f9a-2591-4714-b18e-54f674a441ab/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:05:24 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01b61f9a-2591-4714-b18e-54f674a441ab/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:05:25 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01b61f9a-2591-4714-b18e-54f674a441ab/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:05:25 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 16:05:25 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6110b34a-6fd3-45fc-911d-4e5d3c7f2d78/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:05:25 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6110b34a-6fd3-45fc-911d-4e5d3c7f2d78/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:05:25 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6110b34a-6fd3-45fc-911d-4e5d3c7f2d78/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:05:25 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6110b34a-6fd3-45fc-911d-4e5d3c7f2d78/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:05:25 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e2043cc-ff4e-43e9-9867-920de4809cc4/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:05:25 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e2043cc-ff4e-43e9-9867-920de4809cc4/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:05:25 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e2043cc-ff4e-43e9-9867-920de4809cc4/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:05:25 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e2043cc-ff4e-43e9-9867-920de4809cc4/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:05:25 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba20919c-b506-458e-ac17-70bcb8900bb7/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:05:25 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba20919c-b506-458e-ac17-70bcb8900bb7/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:05:25 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba20919c-b506-458e-ac17-70bcb8900bb7/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:05:26 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba20919c-b506-458e-ac17-70bcb8900bb7/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:05:26 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 16:05:26 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 16:05:26 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 16:05:26 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Hypervisor/Node resource view: name=user free_ram=8158MB free_disk=24.95372772216797GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75337) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 16:05:26 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:05:26 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:05:26 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 6110b34a-6fd3-45fc-911d-4e5d3c7f2d78 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 16:05:26 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 01b61f9a-2591-4714-b18e-54f674a441ab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 16:05:26 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance ba20919c-b506-458e-ac17-70bcb8900bb7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 16:05:26 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance d6eaef86-b841-4142-9549-31954fb34fa2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 16:05:26 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 9e2043cc-ff4e-43e9-9867-920de4809cc4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 16:05:26 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 16:05:26 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 16:05:26 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 16:05:26 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 16:05:26 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Compute_service record updated for user:user {{(pid=75337) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 16:05:26 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.315s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:05:27 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:05:29 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:05:31 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-ffad1368-e6aa-400a-b946-2c40ab983028 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Acquiring lock "ba20919c-b506-458e-ac17-70bcb8900bb7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:05:31 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-ffad1368-e6aa-400a-b946-2c40ab983028 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Lock "ba20919c-b506-458e-ac17-70bcb8900bb7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:05:31 user nova-compute[75337]: INFO nova.compute.manager [None req-ffad1368-e6aa-400a-b946-2c40ab983028 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] [instance: ba20919c-b506-458e-ac17-70bcb8900bb7] Detaching volume c4a5e7b2-ad62-4972-974e-83b84afac437
Nov 06 16:05:31 user nova-compute[75337]: INFO nova.virt.block_device [None req-ffad1368-e6aa-400a-b946-2c40ab983028 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] [instance: ba20919c-b506-458e-ac17-70bcb8900bb7] Attempting to driver detach volume c4a5e7b2-ad62-4972-974e-83b84afac437 from mountpoint /dev/vdb
Nov 06 16:05:31 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-ffad1368-e6aa-400a-b946-2c40ab983028 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Attempting to detach device vdb from instance ba20919c-b506-458e-ac17-70bcb8900bb7 from the persistent domain config. {{(pid=75337) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 06 16:05:31 user nova-compute[75337]: DEBUG nova.virt.libvirt.guest [None req-ffad1368-e6aa-400a-b946-2c40ab983028 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 16:05:31 user nova-compute[75337]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 16:05:31 user nova-compute[75337]:   <source dev="/dev/sdc"/>
Nov 06 16:05:31 user nova-compute[75337]:   <target dev="vdb" bus="virtio"/>
Nov 06 16:05:31 user nova-compute[75337]:   <serial>c4a5e7b2-ad62-4972-974e-83b84afac437</serial>
Nov 06 16:05:31 user nova-compute[75337]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 06 16:05:31 user nova-compute[75337]: </disk>
Nov 06 16:05:31 user nova-compute[75337]:  {{(pid=75337) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 16:05:31 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-ffad1368-e6aa-400a-b946-2c40ab983028 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Successfully detached device vdb from instance ba20919c-b506-458e-ac17-70bcb8900bb7 from the persistent domain config.
Nov 06 16:05:31 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-ffad1368-e6aa-400a-b946-2c40ab983028 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ba20919c-b506-458e-ac17-70bcb8900bb7 from the live domain config. {{(pid=75337) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 06 16:05:31 user nova-compute[75337]: DEBUG nova.virt.libvirt.guest [None req-ffad1368-e6aa-400a-b946-2c40ab983028 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 16:05:31 user nova-compute[75337]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 16:05:31 user nova-compute[75337]:   <source dev="/dev/sdc"/>
Nov 06 16:05:31 user nova-compute[75337]:   <target dev="vdb" bus="virtio"/>
Nov 06 16:05:31 user nova-compute[75337]:   <serial>c4a5e7b2-ad62-4972-974e-83b84afac437</serial>
Nov 06 16:05:31 user nova-compute[75337]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 06 16:05:31 user nova-compute[75337]: </disk>
Nov 06 16:05:31 user nova-compute[75337]:  {{(pid=75337) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 16:05:31 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-f4c73c66-6ecf-4163-8b38-c3c80cb306c5 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Acquiring lock "ba20919c-b506-458e-ac17-70bcb8900bb7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:05:32 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-ffad1368-e6aa-400a-b946-2c40ab983028 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ba20919c-b506-458e-ac17-70bcb8900bb7 {{(pid=75337) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 06 16:05:32 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:05:34 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:05:37 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:05:42 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:05:47 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:05:47 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:05:47 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75337) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 16:05:47 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 16:05:47 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 16:05:47 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:05:52 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-ffad1368-e6aa-400a-b946-2c40ab983028 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance ba20919c-b506-458e-ac17-70bcb8900bb7 is timed out.
Nov 06 16:05:52 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-ffad1368-e6aa-400a-b946-2c40ab983028 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Successfully detached device vdb from instance ba20919c-b506-458e-ac17-70bcb8900bb7 from the live domain config.
Nov 06 16:05:52 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ffad1368-e6aa-400a-b946-2c40ab983028 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] [instance: ba20919c-b506-458e-ac17-70bcb8900bb7] calling os-brick to detach iSCSI Volume {{(pid=75337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 16:05:52 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffad1368-e6aa-400a-b946-2c40ab983028 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2abc33d0c0>, {'target_iqn': 'iqn.2010-10.org.openstack:c4a5e7b2-ad62-4972-974e-83b84afac437', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YjkNSVmd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 16:05:52 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-ffad1368-e6aa-400a-b946-2c40ab983028 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 16:05:52 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-ffad1368-e6aa-400a-b946-2c40ab983028 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 16:05:52 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-ffad1368-e6aa-400a-b946-2c40ab983028 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 16:05:52 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:05:52 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:05:52 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceb03a9b-1fee-4ad3-9a48-a013652f745c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c4a5e7b2-ad62-4972-974e-83b84afac437\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:05:52 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffad1368-e6aa-400a-b946-2c40ab983028 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 16:05:52 user nova-compute[75337]: No targets found.
Nov 06 16:05:52 user nova-compute[75337]: iSNS:
Nov 06 16:05:52 user nova-compute[75337]: No targets found.
Nov 06 16:05:52 user nova-compute[75337]: STATIC:
Nov 06 16:05:52 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:c4a5e7b2-ad62-4972-974e-83b84afac437
Nov 06 16:05:52 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 16:05:52 user nova-compute[75337]:                 Iface Name: default
Nov 06 16:05:52 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139
Nov 06 16:05:52 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 16:05:52 user nova-compute[75337]:                 Iface Name: default
Nov 06 16:05:52 user nova-compute[75337]: FIRMWARE:
Nov 06 16:05:52 user nova-compute[75337]: No targets found.
Nov 06 16:05:52 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 16:05:52 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffad1368-e6aa-400a-b946-2c40ab983028 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 16:05:52 user nova-compute[75337]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 16:05:52 user nova-compute[75337]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75337) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 16:05:52 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffad1368-e6aa-400a-b946-2c40ab983028 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c4a5e7b2-ad62-4972-974e-83b84afac437', 0)] {{(pid=75337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 16:05:52 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:05:52 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-5101ec98-257b-4023-a8ac-e3bf6086672f tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Acquiring lock "f9c98d28-41f9-498f-8c1f-43517999775a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:05:52 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-5101ec98-257b-4023-a8ac-e3bf6086672f tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Lock "f9c98d28-41f9-498f-8c1f-43517999775a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:05:52 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:05:52 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec92f6bb-9b43-4069-94f3-df03dbe803a2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4a5e7b2-ad62-4972-974e-83b84afac437\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:05:52 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:05:52 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:05:52 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0813137-60da-4563-b852-33aa14b55848]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a5e7b2-ad62-4972-974e-83b84afac437 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139 (non-flash)\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:05:52 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffad1368-e6aa-400a-b946-2c40ab983028 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a5e7b2-ad62-4972-974e-83b84afac437 (non-flash)
Nov 06 16:05:52 user nova-compute[75337]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139 (non-flash)
Nov 06 16:05:52 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 16:05:52 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffad1368-e6aa-400a-b946-2c40ab983028 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a5e7b2-ad62-4972-974e-83b84afac437 (non-flash)
Nov 06 16:05:52 user nova-compute[75337]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139 (non-flash)
Nov 06 16:05:52 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 16:05:52 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffad1368-e6aa-400a-b946-2c40ab983028 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2acd428550>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c4a5e7b2-ad62-4972-974e-83b84afac437'): ({'sdc'}, set())}) {{(pid=75337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 16:05:52 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-ffad1368-e6aa-400a-b946-2c40ab983028 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Removing single pathed devices sdc {{(pid=75337) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 16:05:52 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:05:52 user nova-compute[75337]: DEBUG nova.compute.manager [None req-5101ec98-257b-4023-a8ac-e3bf6086672f tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] [instance: f9c98d28-41f9-498f-8c1f-43517999775a] Starting instance... {{(pid=75337) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 16:05:52 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:05:52 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c00a4d2-1778-471c-9139-d6aab95c5cca]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:05:52 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:05:52 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:05:52 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:05:52 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bb5bff9-6b9f-4fd8-885f-422b35fe0a32]: (4, ('ok\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:05:52 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-ffad1368-e6aa-400a-b946-2c40ab983028 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Flushing IO for device /dev/sdc {{(pid=75337) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 16:05:52 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:05:52 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:05:52 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c0beaab-9708-44f9-a225-352c37d68633]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:05:52 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-ffad1368-e6aa-400a-b946-2c40ab983028 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75337) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 16:05:52 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:05:52 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-5101ec98-257b-4023-a8ac-e3bf6086672f tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:05:52 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-5101ec98-257b-4023-a8ac-e3bf6086672f tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:05:52 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-5101ec98-257b-4023-a8ac-e3bf6086672f tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75337) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 16:05:52 user nova-compute[75337]: INFO nova.compute.claims [None req-5101ec98-257b-4023-a8ac-e3bf6086672f tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] [instance: f9c98d28-41f9-498f-8c1f-43517999775a] Claim successful on node user
Nov 06 16:05:52 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.051s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:05:52 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[738581a5-eadc-47ba-a8c2-71d9e4ab21cd]: (4, ('1', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:05:52 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-ffad1368-e6aa-400a-b946-2c40ab983028 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 16:05:52 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-ffad1368-e6aa-400a-b946-2c40ab983028 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] SCSI volumes sdc have been removed. {{(pid=75337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 16:05:52 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffad1368-e6aa-400a-b946-2c40ab983028 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c4a5e7b2-ad62-4972-974e-83b84afac437')] {{(pid=75337) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 16:05:52 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4a5e7b2-ad62-4972-974e-83b84afac437 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:05:52 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4a5e7b2-ad62-4972-974e-83b84afac437 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:05:52 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[94a1a455-0722-4935-95e1-49ceaa94f542]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:05:52 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffad1368-e6aa-400a-b946-2c40ab983028 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:05:52 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4a5e7b2-ad62-4972-974e-83b84afac437 -p 172.16.0.220:3260 --logout {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:05:52 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4a5e7b2-ad62-4972-974e-83b84afac437 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:05:52 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cbcd81d-1ed6-4d71-8bc2-b82bfaa27fd2]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:c4a5e7b2-ad62-4972-974e-83b84afac437, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:c4a5e7b2-ad62-4972-974e-83b84afac437, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:05:52 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffad1368-e6aa-400a-b946-2c40ab983028 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:c4a5e7b2-ad62-4972-974e-83b84afac437, portal: 172.16.0.220,3260]
Nov 06 16:05:52 user nova-compute[75337]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:c4a5e7b2-ad62-4972-974e-83b84afac437, portal: 172.16.0.220,3260] successful.
Nov 06 16:05:52 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:05:52 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4a5e7b2-ad62-4972-974e-83b84afac437 -p 172.16.0.220:3260 --op delete {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:05:52 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4a5e7b2-ad62-4972-974e-83b84afac437 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:05:52 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aee3caa-0e54-4803-aa9a-54d773413095]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:05:52 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffad1368-e6aa-400a-b946-2c40ab983028 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:05:52 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-ffad1368-e6aa-400a-b946-2c40ab983028 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.343s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 16:05:52 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffad1368-e6aa-400a-b946-2c40ab983028 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] <== disconnect_volume: return (345ms) None {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 16:05:52 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ffad1368-e6aa-400a-b946-2c40ab983028 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] [instance: ba20919c-b506-458e-ac17-70bcb8900bb7] Disconnected iSCSI Volume {{(pid=75337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 16:05:52 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-5101ec98-257b-4023-a8ac-e3bf6086672f tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 16:05:52 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-5101ec98-257b-4023-a8ac-e3bf6086672f tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 16:05:52 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-5101ec98-257b-4023-a8ac-e3bf6086672f tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.406s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:05:52 user nova-compute[75337]: DEBUG nova.compute.manager [None req-5101ec98-257b-4023-a8ac-e3bf6086672f tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] [instance: f9c98d28-41f9-498f-8c1f-43517999775a] Start building networks asynchronously for instance. {{(pid=75337) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 16:05:53 user nova-compute[75337]: DEBUG nova.compute.manager [None req-5101ec98-257b-4023-a8ac-e3bf6086672f tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] [instance: f9c98d28-41f9-498f-8c1f-43517999775a] Allocating IP information in the background. {{(pid=75337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 16:05:53 user nova-compute[75337]: DEBUG nova.network.neutron [None req-5101ec98-257b-4023-a8ac-e3bf6086672f tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] [instance: f9c98d28-41f9-498f-8c1f-43517999775a] allocate_for_instance() {{(pid=75337) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 16:05:53 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-5101ec98-257b-4023-a8ac-e3bf6086672f tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] [instance: f9c98d28-41f9-498f-8c1f-43517999775a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 16:05:53 user nova-compute[75337]: DEBUG nova.compute.manager [None req-5101ec98-257b-4023-a8ac-e3bf6086672f tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] [instance: f9c98d28-41f9-498f-8c1f-43517999775a] Start building block device mappings for instance. {{(pid=75337) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 16:05:53 user nova-compute[75337]: DEBUG nova.policy [None req-5101ec98-257b-4023-a8ac-e3bf6086672f tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ef1008574bea4cfca8a20b2edcf0aacd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98fac9096a3b4f21ba805ba1437d9d38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75337) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 16:05:53 user nova-compute[75337]: DEBUG nova.compute.manager [None req-5101ec98-257b-4023-a8ac-e3bf6086672f tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] [instance: f9c98d28-41f9-498f-8c1f-43517999775a] Start spawning the instance on the hypervisor. {{(pid=75337) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 16:05:53 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-5101ec98-257b-4023-a8ac-e3bf6086672f tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] [instance: f9c98d28-41f9-498f-8c1f-43517999775a] Creating instance directory {{(pid=75337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 16:05:53 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-5101ec98-257b-4023-a8ac-e3bf6086672f tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] [instance: f9c98d28-41f9-498f-8c1f-43517999775a] Creating image(s)
Nov 06 16:05:53 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-5101ec98-257b-4023-a8ac-e3bf6086672f tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Acquiring lock "/opt/stack/data/nova/instances/f9c98d28-41f9-498f-8c1f-43517999775a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:05:53 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-5101ec98-257b-4023-a8ac-e3bf6086672f tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Lock "/opt/stack/data/nova/instances/f9c98d28-41f9-498f-8c1f-43517999775a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:05:53 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-5101ec98-257b-4023-a8ac-e3bf6086672f tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Lock "/opt/stack/data/nova/instances/f9c98d28-41f9-498f-8c1f-43517999775a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:05:53 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-5101ec98-257b-4023-a8ac-e3bf6086672f tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:05:53 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-5101ec98-257b-4023-a8ac-e3bf6086672f tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json" returned: 0 in 0.198s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:05:53 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-5101ec98-257b-4023-a8ac-e3bf6086672f tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Acquiring lock "06ba3c914798499e686c5ac75886932347225275" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:05:53 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-5101ec98-257b-4023-a8ac-e3bf6086672f tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Lock "06ba3c914798499e686c5ac75886932347225275" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:05:53 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-5101ec98-257b-4023-a8ac-e3bf6086672f tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:05:53 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-5101ec98-257b-4023-a8ac-e3bf6086672f tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json" returned: 0 in 0.175s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:05:53 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-5101ec98-257b-4023-a8ac-e3bf6086672f tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275,backing_fmt=raw /opt/stack/data/nova/instances/f9c98d28-41f9-498f-8c1f-43517999775a/disk 1073741824 {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:05:53 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-5101ec98-257b-4023-a8ac-e3bf6086672f tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275,backing_fmt=raw /opt/stack/data/nova/instances/f9c98d28-41f9-498f-8c1f-43517999775a/disk 1073741824" returned: 0 in 0.053s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:05:53 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-5101ec98-257b-4023-a8ac-e3bf6086672f tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Lock "06ba3c914798499e686c5ac75886932347225275" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:05:53 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-5101ec98-257b-4023-a8ac-e3bf6086672f tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:05:53 user nova-compute[75337]: DEBUG nova.network.neutron [None req-5101ec98-257b-4023-a8ac-e3bf6086672f tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] [instance: f9c98d28-41f9-498f-8c1f-43517999775a] Successfully created port: 65003741-14af-48d8-9ca6-0e075aab5008 {{(pid=75337) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 16:05:53 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-5101ec98-257b-4023-a8ac-e3bf6086672f tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json" returned: 0 in 0.191s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:05:53 user nova-compute[75337]: DEBUG nova.virt.disk.api [None req-5101ec98-257b-4023-a8ac-e3bf6086672f tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f9c98d28-41f9-498f-8c1f-43517999775a/disk. size=1073741824 {{(pid=75337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 16:05:53 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-5101ec98-257b-4023-a8ac-e3bf6086672f tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9c98d28-41f9-498f-8c1f-43517999775a/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:05:54 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-5101ec98-257b-4023-a8ac-e3bf6086672f tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9c98d28-41f9-498f-8c1f-43517999775a/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:05:54 user nova-compute[75337]: DEBUG nova.virt.disk.api [None req-5101ec98-257b-4023-a8ac-e3bf6086672f tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Cannot resize image /opt/stack/data/nova/instances/f9c98d28-41f9-498f-8c1f-43517999775a/disk to a smaller size. {{(pid=75337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 06 16:05:54 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-5101ec98-257b-4023-a8ac-e3bf6086672f tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] [instance: f9c98d28-41f9-498f-8c1f-43517999775a] Created local disks {{(pid=75337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 16:05:54 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-5101ec98-257b-4023-a8ac-e3bf6086672f tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] [instance: f9c98d28-41f9-498f-8c1f-43517999775a] Ensure instance console log exists: /opt/stack/data/nova/instances/f9c98d28-41f9-498f-8c1f-43517999775a/console.log {{(pid=75337) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 16:05:54 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-5101ec98-257b-4023-a8ac-e3bf6086672f tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:05:54 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-5101ec98-257b-4023-a8ac-e3bf6086672f tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:05:54 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-5101ec98-257b-4023-a8ac-e3bf6086672f tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:05:54 user nova-compute[75337]: DEBUG nova.network.neutron [None req-5101ec98-257b-4023-a8ac-e3bf6086672f tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] [instance: f9c98d28-41f9-498f-8c1f-43517999775a] Successfully updated port: 65003741-14af-48d8-9ca6-0e075aab5008 {{(pid=75337) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 16:05:54 user nova-compute[75337]: DEBUG nova.compute.manager [req-0ef3bfcc-2ed5-4a38-a41b-b26bf00cb475 req-8dbe3ff0-351e-42ca-82b6-8001ee246466 service nova] [instance: f9c98d28-41f9-498f-8c1f-43517999775a] Received event network-changed-65003741-14af-48d8-9ca6-0e075aab5008 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:05:54 user nova-compute[75337]: DEBUG nova.compute.manager [req-0ef3bfcc-2ed5-4a38-a41b-b26bf00cb475 req-8dbe3ff0-351e-42ca-82b6-8001ee246466 service nova] [instance: f9c98d28-41f9-498f-8c1f-43517999775a] Refreshing instance network info cache due to event network-changed-65003741-14af-48d8-9ca6-0e075aab5008. {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 16:05:54 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-0ef3bfcc-2ed5-4a38-a41b-b26bf00cb475 req-8dbe3ff0-351e-42ca-82b6-8001ee246466 service nova] Acquiring lock "refresh_cache-f9c98d28-41f9-498f-8c1f-43517999775a" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 16:05:54 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-0ef3bfcc-2ed5-4a38-a41b-b26bf00cb475 req-8dbe3ff0-351e-42ca-82b6-8001ee246466 service nova] Acquired lock "refresh_cache-f9c98d28-41f9-498f-8c1f-43517999775a" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 16:05:54 user nova-compute[75337]: DEBUG nova.network.neutron [req-0ef3bfcc-2ed5-4a38-a41b-b26bf00cb475 req-8dbe3ff0-351e-42ca-82b6-8001ee246466 service nova] [instance: f9c98d28-41f9-498f-8c1f-43517999775a] Refreshing network info cache for port 65003741-14af-48d8-9ca6-0e075aab5008 {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 16:05:54 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-5101ec98-257b-4023-a8ac-e3bf6086672f tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Acquiring lock "refresh_cache-f9c98d28-41f9-498f-8c1f-43517999775a" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 16:05:54 user nova-compute[75337]: DEBUG nova.network.neutron [req-0ef3bfcc-2ed5-4a38-a41b-b26bf00cb475 req-8dbe3ff0-351e-42ca-82b6-8001ee246466 service nova] [instance: f9c98d28-41f9-498f-8c1f-43517999775a] Instance cache missing network info. {{(pid=75337) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 16:05:54 user nova-compute[75337]: DEBUG nova.network.neutron [req-0ef3bfcc-2ed5-4a38-a41b-b26bf00cb475 req-8dbe3ff0-351e-42ca-82b6-8001ee246466 service nova] [instance: f9c98d28-41f9-498f-8c1f-43517999775a] Updating instance_info_cache with network_info: [] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 16:05:54 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-0ef3bfcc-2ed5-4a38-a41b-b26bf00cb475 req-8dbe3ff0-351e-42ca-82b6-8001ee246466 service nova] Releasing lock "refresh_cache-f9c98d28-41f9-498f-8c1f-43517999775a" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 16:05:54 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-5101ec98-257b-4023-a8ac-e3bf6086672f tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Acquired lock "refresh_cache-f9c98d28-41f9-498f-8c1f-43517999775a" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 16:05:54 user nova-compute[75337]: DEBUG nova.network.neutron [None req-5101ec98-257b-4023-a8ac-e3bf6086672f tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] [instance: f9c98d28-41f9-498f-8c1f-43517999775a] Building network info cache for instance {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 16:05:54 user nova-compute[75337]: DEBUG nova.network.neutron [None req-5101ec98-257b-4023-a8ac-e3bf6086672f tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] [instance: f9c98d28-41f9-498f-8c1f-43517999775a] Instance cache missing network info. {{(pid=75337) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 16:05:54 user nova-compute[75337]: DEBUG nova.network.neutron [None req-5101ec98-257b-4023-a8ac-e3bf6086672f tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] [instance: f9c98d28-41f9-498f-8c1f-43517999775a] Updating instance_info_cache with network_info: [{"id": "65003741-14af-48d8-9ca6-0e075aab5008", "address": "fa:16:3e:d6:6c:ea", "network": {"id": "8b217731-de9e-49bc-84bb-130fd42ede51", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-314618758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98fac9096a3b4f21ba805ba1437d9d38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65003741-14", "ovs_interfaceid": "65003741-14af-48d8-9ca6-0e075aab5008", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 16:05:55 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-5101ec98-257b-4023-a8ac-e3bf6086672f tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Releasing lock "refresh_cache-f9c98d28-41f9-498f-8c1f-43517999775a" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 16:05:55 user nova-compute[75337]: DEBUG nova.compute.manager [None req-5101ec98-257b-4023-a8ac-e3bf6086672f tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] [instance: f9c98d28-41f9-498f-8c1f-43517999775a] Instance network_info: |[{"id": "65003741-14af-48d8-9ca6-0e075aab5008", "address": "fa:16:3e:d6:6c:ea", "network": {"id": "8b217731-de9e-49bc-84bb-130fd42ede51", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-314618758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98fac9096a3b4f21ba805ba1437d9d38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65003741-14", "ovs_interfaceid": "65003741-14af-48d8-9ca6-0e075aab5008", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 16:05:55 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-5101ec98-257b-4023-a8ac-e3bf6086672f tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] [instance: f9c98d28-41f9-498f-8c1f-43517999775a] Start _get_guest_xml network_info=[{"id": "65003741-14af-48d8-9ca6-0e075aab5008", "address": "fa:16:3e:d6:6c:ea", "network": {"id": "8b217731-de9e-49bc-84bb-130fd42ede51", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-314618758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98fac9096a3b4f21ba805ba1437d9d38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65003741-14", "ovs_interfaceid": "65003741-14af-48d8-9ca6-0e075aab5008", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T15:34:14Z,direct_url=<?>,disk_format='qcow2',id=16b903ae-a40f-41a7-985b-4804cce92c62,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6549a15819f1469bbd5eeae8190e3d44',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T15:34:15Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'guest_format': None, 'size': 0, 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '16b903ae-a40f-41a7-985b-4804cce92c62'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 16:05:55 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-5101ec98-257b-4023-a8ac-e3bf6086672f tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 16:05:55 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-5101ec98-257b-4023-a8ac-e3bf6086672f tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 16:05:55 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-5101ec98-257b-4023-a8ac-e3bf6086672f tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 16:05:55 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-5101ec98-257b-4023-a8ac-e3bf6086672f tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] CPU controller missing on host. {{(pid=75337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 16:05:55 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-5101ec98-257b-4023-a8ac-e3bf6086672f tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 16:05:55 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-5101ec98-257b-4023-a8ac-e3bf6086672f tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] CPU controller found on host. {{(pid=75337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 16:05:55 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-5101ec98-257b-4023-a8ac-e3bf6086672f tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75337) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 16:05:55 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-5101ec98-257b-4023-a8ac-e3bf6086672f tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T15:34:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T15:34:14Z,direct_url=<?>,disk_format='qcow2',id=16b903ae-a40f-41a7-985b-4804cce92c62,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6549a15819f1469bbd5eeae8190e3d44',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T15:34:15Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 16:05:55 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-5101ec98-257b-4023-a8ac-e3bf6086672f tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Flavor limits 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 16:05:55 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-5101ec98-257b-4023-a8ac-e3bf6086672f tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Image limits 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 16:05:55 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-5101ec98-257b-4023-a8ac-e3bf6086672f tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Flavor pref 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 16:05:55 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-5101ec98-257b-4023-a8ac-e3bf6086672f tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Image pref 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 16:05:55 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-5101ec98-257b-4023-a8ac-e3bf6086672f tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 16:05:55 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-5101ec98-257b-4023-a8ac-e3bf6086672f tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 16:05:55 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-5101ec98-257b-4023-a8ac-e3bf6086672f tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 16:05:55 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-5101ec98-257b-4023-a8ac-e3bf6086672f tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Got 1 possible topologies {{(pid=75337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 16:05:55 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-5101ec98-257b-4023-a8ac-e3bf6086672f tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 16:05:55 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-5101ec98-257b-4023-a8ac-e3bf6086672f tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 16:05:55 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-5101ec98-257b-4023-a8ac-e3bf6086672f tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T16:05:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-952331388',display_name='tempest-AttachVolumeTestJSON-server-952331388',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-952331388',id=44,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOwKk9UoWoYFREe74ue/NAz48AjEU4QGi+Ck6n56tqRpGczSYurRXfrnD2NeGuCcYFTR415eQw2oqSOfOBlcvid8kAIrK7gJY4ux7BfEgumK8nDPb8eiQLXHwNEW5VCa/A==',key_name='tempest-keypair-493283673',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='98fac9096a3b4f21ba805ba1437d9d38',ramdisk_id='',reservation_id='r-yb5ac200',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-636759182',owner_user_name='tempest-AttachVolumeTestJSON-636759182-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T16:05:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ef1008574bea4cfca8a20b2edcf0aacd',uuid=f9c98d28-41f9-498f-8c1f-43517999775a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "65003741-14af-48d8-9ca6-0e075aab5008", "address": "fa:16:3e:d6:6c:ea", "network": {"id": "8b217731-de9e-49bc-84bb-130fd42ede51", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-314618758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98fac9096a3b4f21ba805ba1437d9d38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65003741-14", "ovs_interfaceid": "65003741-14af-48d8-9ca6-0e075aab5008", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75337) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 16:05:55 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-5101ec98-257b-4023-a8ac-e3bf6086672f tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Converting VIF {"id": "65003741-14af-48d8-9ca6-0e075aab5008", "address": "fa:16:3e:d6:6c:ea", "network": {"id": "8b217731-de9e-49bc-84bb-130fd42ede51", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-314618758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98fac9096a3b4f21ba805ba1437d9d38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65003741-14", "ovs_interfaceid": "65003741-14af-48d8-9ca6-0e075aab5008", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 16:05:55 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-5101ec98-257b-4023-a8ac-e3bf6086672f tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:6c:ea,bridge_name='br-int',has_traffic_filtering=True,id=65003741-14af-48d8-9ca6-0e075aab5008,network=Network(8b217731-de9e-49bc-84bb-130fd42ede51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65003741-14') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 16:05:55 user nova-compute[75337]: DEBUG nova.objects.instance [None req-5101ec98-257b-4023-a8ac-e3bf6086672f tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Lazy-loading 'pci_devices' on Instance uuid f9c98d28-41f9-498f-8c1f-43517999775a {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 16:05:55 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-5101ec98-257b-4023-a8ac-e3bf6086672f tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] [instance: f9c98d28-41f9-498f-8c1f-43517999775a] End _get_guest_xml xml=<domain type="kvm">
Nov 06 16:05:55 user nova-compute[75337]:   <uuid>f9c98d28-41f9-498f-8c1f-43517999775a</uuid>
Nov 06 16:05:55 user nova-compute[75337]:   <name>instance-0000002c</name>
Nov 06 16:05:55 user nova-compute[75337]:   <memory>524288</memory>
Nov 06 16:05:55 user nova-compute[75337]:   <vcpu>1</vcpu>
Nov 06 16:05:55 user nova-compute[75337]:   <metadata>
Nov 06 16:05:55 user nova-compute[75337]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 16:05:55 user nova-compute[75337]:       <nova:package version="0.0.0"/>
Nov 06 16:05:55 user nova-compute[75337]:       <nova:name>tempest-AttachVolumeTestJSON-server-952331388</nova:name>
Nov 06 16:05:55 user nova-compute[75337]:       <nova:creationTime>2023-11-06 16:05:55</nova:creationTime>
Nov 06 16:05:55 user nova-compute[75337]:       <nova:flavor name="m1.tiny">
Nov 06 16:05:55 user nova-compute[75337]:         <nova:memory>512</nova:memory>
Nov 06 16:05:55 user nova-compute[75337]:         <nova:disk>1</nova:disk>
Nov 06 16:05:55 user nova-compute[75337]:         <nova:swap>0</nova:swap>
Nov 06 16:05:55 user nova-compute[75337]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 16:05:55 user nova-compute[75337]:         <nova:vcpus>1</nova:vcpus>
Nov 06 16:05:55 user nova-compute[75337]:       </nova:flavor>
Nov 06 16:05:55 user nova-compute[75337]:       <nova:owner>
Nov 06 16:05:55 user nova-compute[75337]:         <nova:user uuid="ef1008574bea4cfca8a20b2edcf0aacd">tempest-AttachVolumeTestJSON-636759182-project-member</nova:user>
Nov 06 16:05:55 user nova-compute[75337]:         <nova:project uuid="98fac9096a3b4f21ba805ba1437d9d38">tempest-AttachVolumeTestJSON-636759182</nova:project>
Nov 06 16:05:55 user nova-compute[75337]:       </nova:owner>
Nov 06 16:05:55 user nova-compute[75337]:       <nova:root type="image" uuid="16b903ae-a40f-41a7-985b-4804cce92c62"/>
Nov 06 16:05:55 user nova-compute[75337]:       <nova:ports>
Nov 06 16:05:55 user nova-compute[75337]:         <nova:port uuid="65003741-14af-48d8-9ca6-0e075aab5008">
Nov 06 16:05:55 user nova-compute[75337]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 06 16:05:55 user nova-compute[75337]:         </nova:port>
Nov 06 16:05:55 user nova-compute[75337]:       </nova:ports>
Nov 06 16:05:55 user nova-compute[75337]:     </nova:instance>
Nov 06 16:05:55 user nova-compute[75337]:   </metadata>
Nov 06 16:05:55 user nova-compute[75337]:   <sysinfo type="smbios">
Nov 06 16:05:55 user nova-compute[75337]:     <system>
Nov 06 16:05:55 user nova-compute[75337]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 16:05:55 user nova-compute[75337]:       <entry name="product">OpenStack Nova</entry>
Nov 06 16:05:55 user nova-compute[75337]:       <entry name="version">0.0.0</entry>
Nov 06 16:05:55 user nova-compute[75337]:       <entry name="serial">f9c98d28-41f9-498f-8c1f-43517999775a</entry>
Nov 06 16:05:55 user nova-compute[75337]:       <entry name="uuid">f9c98d28-41f9-498f-8c1f-43517999775a</entry>
Nov 06 16:05:55 user nova-compute[75337]:       <entry name="family">Virtual Machine</entry>
Nov 06 16:05:55 user nova-compute[75337]:     </system>
Nov 06 16:05:55 user nova-compute[75337]:   </sysinfo>
Nov 06 16:05:55 user nova-compute[75337]:   <os>
Nov 06 16:05:55 user nova-compute[75337]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 16:05:55 user nova-compute[75337]:     <boot dev="hd"/>
Nov 06 16:05:55 user nova-compute[75337]:     <smbios mode="sysinfo"/>
Nov 06 16:05:55 user nova-compute[75337]:   </os>
Nov 06 16:05:55 user nova-compute[75337]:   <features>
Nov 06 16:05:55 user nova-compute[75337]:     <acpi/>
Nov 06 16:05:55 user nova-compute[75337]:     <apic/>
Nov 06 16:05:55 user nova-compute[75337]:     <vmcoreinfo/>
Nov 06 16:05:55 user nova-compute[75337]:   </features>
Nov 06 16:05:55 user nova-compute[75337]:   <clock offset="utc">
Nov 06 16:05:55 user nova-compute[75337]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 16:05:55 user nova-compute[75337]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 16:05:55 user nova-compute[75337]:     <timer name="hpet" present="no"/>
Nov 06 16:05:55 user nova-compute[75337]:   </clock>
Nov 06 16:05:55 user nova-compute[75337]:   <cpu mode="custom" match="exact">
Nov 06 16:05:55 user nova-compute[75337]:     <model>Nehalem</model>
Nov 06 16:05:55 user nova-compute[75337]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 16:05:55 user nova-compute[75337]:   </cpu>
Nov 06 16:05:55 user nova-compute[75337]:   <devices>
Nov 06 16:05:55 user nova-compute[75337]:     <disk type="file" device="disk">
Nov 06 16:05:55 user nova-compute[75337]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 16:05:55 user nova-compute[75337]:       <source file="/opt/stack/data/nova/instances/f9c98d28-41f9-498f-8c1f-43517999775a/disk"/>
Nov 06 16:05:55 user nova-compute[75337]:       <target dev="vda" bus="virtio"/>
Nov 06 16:05:55 user nova-compute[75337]:     </disk>
Nov 06 16:05:55 user nova-compute[75337]:     <interface type="ethernet">
Nov 06 16:05:55 user nova-compute[75337]:       <mac address="fa:16:3e:d6:6c:ea"/>
Nov 06 16:05:55 user nova-compute[75337]:       <model type="virtio"/>
Nov 06 16:05:55 user nova-compute[75337]:       <mtu size="1442"/>
Nov 06 16:05:55 user nova-compute[75337]:       <target dev="tap65003741-14"/>
Nov 06 16:05:55 user nova-compute[75337]:     </interface>
Nov 06 16:05:55 user nova-compute[75337]:     <serial type="pty">
Nov 06 16:05:55 user nova-compute[75337]:       <log file="/opt/stack/data/nova/instances/f9c98d28-41f9-498f-8c1f-43517999775a/console.log" append="off"/>
Nov 06 16:05:55 user nova-compute[75337]:     </serial>
Nov 06 16:05:55 user nova-compute[75337]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 16:05:55 user nova-compute[75337]:     <video>
Nov 06 16:05:55 user nova-compute[75337]:       <model type="virtio"/>
Nov 06 16:05:55 user nova-compute[75337]:     </video>
Nov 06 16:05:55 user nova-compute[75337]:     <rng model="virtio">
Nov 06 16:05:55 user nova-compute[75337]:       <backend model="random">/dev/urandom</backend>
Nov 06 16:05:55 user nova-compute[75337]:     </rng>
Nov 06 16:05:55 user nova-compute[75337]:     <controller type="usb" index="0" model="none"/>
Nov 06 16:05:55 user nova-compute[75337]:     <memballoon model="virtio">
Nov 06 16:05:55 user nova-compute[75337]:       <stats period="10"/>
Nov 06 16:05:55 user nova-compute[75337]:     </memballoon>
Nov 06 16:05:55 user nova-compute[75337]:   </devices>
Nov 06 16:05:55 user nova-compute[75337]: </domain>
Nov 06 16:05:55 user nova-compute[75337]:  {{(pid=75337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 16:05:55 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-5101ec98-257b-4023-a8ac-e3bf6086672f tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T16:05:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-952331388',display_name='tempest-AttachVolumeTestJSON-server-952331388',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-952331388',id=44,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOwKk9UoWoYFREe74ue/NAz48AjEU4QGi+Ck6n56tqRpGczSYurRXfrnD2NeGuCcYFTR415eQw2oqSOfOBlcvid8kAIrK7gJY4ux7BfEgumK8nDPb8eiQLXHwNEW5VCa/A==',key_name='tempest-keypair-493283673',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='98fac9096a3b4f21ba805ba1437d9d38',ramdisk_id='',reservation_id='r-yb5ac200',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-636759182',owner_user_name='tempest-AttachVolumeTestJSON-636759182-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T16:05:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ef1008574bea4cfca8a20b2edcf0aacd',uuid=f9c98d28-41f9-498f-8c1f-43517999775a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "65003741-14af-48d8-9ca6-0e075aab5008", "address": "fa:16:3e:d6:6c:ea", "network": {"id": "8b217731-de9e-49bc-84bb-130fd42ede51", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-314618758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98fac9096a3b4f21ba805ba1437d9d38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65003741-14", "ovs_interfaceid": "65003741-14af-48d8-9ca6-0e075aab5008", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 16:05:55 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-5101ec98-257b-4023-a8ac-e3bf6086672f tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Converting VIF {"id": "65003741-14af-48d8-9ca6-0e075aab5008", "address": "fa:16:3e:d6:6c:ea", "network": {"id": "8b217731-de9e-49bc-84bb-130fd42ede51", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-314618758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98fac9096a3b4f21ba805ba1437d9d38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65003741-14", "ovs_interfaceid": "65003741-14af-48d8-9ca6-0e075aab5008", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 16:05:55 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-5101ec98-257b-4023-a8ac-e3bf6086672f tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:6c:ea,bridge_name='br-int',has_traffic_filtering=True,id=65003741-14af-48d8-9ca6-0e075aab5008,network=Network(8b217731-de9e-49bc-84bb-130fd42ede51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65003741-14') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 16:05:55 user nova-compute[75337]: DEBUG os_vif [None req-5101ec98-257b-4023-a8ac-e3bf6086672f tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:6c:ea,bridge_name='br-int',has_traffic_filtering=True,id=65003741-14af-48d8-9ca6-0e075aab5008,network=Network(8b217731-de9e-49bc-84bb-130fd42ede51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65003741-14') {{(pid=75337) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 16:05:55 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:05:55 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 16:05:55 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 16:05:55 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:05:55 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f948bcf6-e5d2-51be-823c-c44efdc55cd8', '_type': 'linux-noop'}}, row=False) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 16:05:55 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:05:55 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:05:55 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap65003741-14, may_exist=True, interface_attrs={}) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 16:05:55 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap65003741-14, col_values=(('qos', UUID('f119c606-6d49-49e9-99d2-89345a6b0e84')),), if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 16:05:55 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap65003741-14, col_values=(('external_ids', {'iface-id': '65003741-14af-48d8-9ca6-0e075aab5008', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d6:6c:ea', 'vm-uuid': 'f9c98d28-41f9-498f-8c1f-43517999775a'}),), if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 16:05:55 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:05:55 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:05:55 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:05:55 user nova-compute[75337]: INFO os_vif [None req-5101ec98-257b-4023-a8ac-e3bf6086672f tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:6c:ea,bridge_name='br-int',has_traffic_filtering=True,id=65003741-14af-48d8-9ca6-0e075aab5008,network=Network(8b217731-de9e-49bc-84bb-130fd42ede51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65003741-14')
Nov 06 16:05:55 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-5101ec98-257b-4023-a8ac-e3bf6086672f tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] No BDM found with device name vda, not building metadata. {{(pid=75337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 16:05:55 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-5101ec98-257b-4023-a8ac-e3bf6086672f tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] No VIF found with MAC fa:16:3e:d6:6c:ea, not building metadata {{(pid=75337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 16:05:56 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:05:56 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:05:56 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:05:56 user nova-compute[75337]: DEBUG nova.compute.manager [req-d2c667d6-868d-4d29-b571-93ab6840fd27 req-6a42c628-4f41-4489-a034-52944326464d service nova] [instance: f9c98d28-41f9-498f-8c1f-43517999775a] Received event network-vif-plugged-65003741-14af-48d8-9ca6-0e075aab5008 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:05:56 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-d2c667d6-868d-4d29-b571-93ab6840fd27 req-6a42c628-4f41-4489-a034-52944326464d service nova] Acquiring lock "f9c98d28-41f9-498f-8c1f-43517999775a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:05:56 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-d2c667d6-868d-4d29-b571-93ab6840fd27 req-6a42c628-4f41-4489-a034-52944326464d service nova] Lock "f9c98d28-41f9-498f-8c1f-43517999775a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:05:56 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-d2c667d6-868d-4d29-b571-93ab6840fd27 req-6a42c628-4f41-4489-a034-52944326464d service nova] Lock "f9c98d28-41f9-498f-8c1f-43517999775a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:05:56 user nova-compute[75337]: DEBUG nova.compute.manager [req-d2c667d6-868d-4d29-b571-93ab6840fd27 req-6a42c628-4f41-4489-a034-52944326464d service nova] [instance: f9c98d28-41f9-498f-8c1f-43517999775a] No waiting events found dispatching network-vif-plugged-65003741-14af-48d8-9ca6-0e075aab5008 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 16:05:56 user nova-compute[75337]: WARNING nova.compute.manager [req-d2c667d6-868d-4d29-b571-93ab6840fd27 req-6a42c628-4f41-4489-a034-52944326464d service nova] [instance: f9c98d28-41f9-498f-8c1f-43517999775a] Received unexpected event network-vif-plugged-65003741-14af-48d8-9ca6-0e075aab5008 for instance with vm_state building and task_state spawning.
Nov 06 16:05:56 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:05:57 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:05:57 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:05:57 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:05:57 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:05:58 user nova-compute[75337]: DEBUG nova.compute.manager [None req-5101ec98-257b-4023-a8ac-e3bf6086672f tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] [instance: f9c98d28-41f9-498f-8c1f-43517999775a] Instance event wait completed in 0 seconds for  {{(pid=75337) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 16:05:58 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-5101ec98-257b-4023-a8ac-e3bf6086672f tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] [instance: f9c98d28-41f9-498f-8c1f-43517999775a] Guest created on hypervisor {{(pid=75337) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 16:05:58 user nova-compute[75337]: INFO nova.virt.libvirt.driver [-] [instance: f9c98d28-41f9-498f-8c1f-43517999775a] Instance spawned successfully.
Nov 06 16:05:58 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-5101ec98-257b-4023-a8ac-e3bf6086672f tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] [instance: f9c98d28-41f9-498f-8c1f-43517999775a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 16:05:58 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-5101ec98-257b-4023-a8ac-e3bf6086672f tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] [instance: f9c98d28-41f9-498f-8c1f-43517999775a] Found default for hw_cdrom_bus of ide {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 16:05:58 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-5101ec98-257b-4023-a8ac-e3bf6086672f tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] [instance: f9c98d28-41f9-498f-8c1f-43517999775a] Found default for hw_disk_bus of virtio {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 16:05:58 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-5101ec98-257b-4023-a8ac-e3bf6086672f tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] [instance: f9c98d28-41f9-498f-8c1f-43517999775a] Found default for hw_input_bus of None {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 16:05:58 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-5101ec98-257b-4023-a8ac-e3bf6086672f tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] [instance: f9c98d28-41f9-498f-8c1f-43517999775a] Found default for hw_pointer_model of None {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 16:05:58 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-5101ec98-257b-4023-a8ac-e3bf6086672f tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] [instance: f9c98d28-41f9-498f-8c1f-43517999775a] Found default for hw_video_model of virtio {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 16:05:58 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-5101ec98-257b-4023-a8ac-e3bf6086672f tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] [instance: f9c98d28-41f9-498f-8c1f-43517999775a] Found default for hw_vif_model of virtio {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 16:05:58 user nova-compute[75337]: DEBUG nova.compute.manager [req-bdb915a7-b23a-4474-83e2-9d3233d4088b req-679b494e-7087-4804-a92a-9c433e5e83ce service nova] [instance: f9c98d28-41f9-498f-8c1f-43517999775a] Received event network-vif-plugged-65003741-14af-48d8-9ca6-0e075aab5008 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:05:58 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-bdb915a7-b23a-4474-83e2-9d3233d4088b req-679b494e-7087-4804-a92a-9c433e5e83ce service nova] Acquiring lock "f9c98d28-41f9-498f-8c1f-43517999775a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:05:58 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-bdb915a7-b23a-4474-83e2-9d3233d4088b req-679b494e-7087-4804-a92a-9c433e5e83ce service nova] Lock "f9c98d28-41f9-498f-8c1f-43517999775a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:05:58 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-bdb915a7-b23a-4474-83e2-9d3233d4088b req-679b494e-7087-4804-a92a-9c433e5e83ce service nova] Lock "f9c98d28-41f9-498f-8c1f-43517999775a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:05:58 user nova-compute[75337]: DEBUG nova.compute.manager [req-bdb915a7-b23a-4474-83e2-9d3233d4088b req-679b494e-7087-4804-a92a-9c433e5e83ce service nova] [instance: f9c98d28-41f9-498f-8c1f-43517999775a] No waiting events found dispatching network-vif-plugged-65003741-14af-48d8-9ca6-0e075aab5008 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 16:05:58 user nova-compute[75337]: WARNING nova.compute.manager [req-bdb915a7-b23a-4474-83e2-9d3233d4088b req-679b494e-7087-4804-a92a-9c433e5e83ce service nova] [instance: f9c98d28-41f9-498f-8c1f-43517999775a] Received unexpected event network-vif-plugged-65003741-14af-48d8-9ca6-0e075aab5008 for instance with vm_state building and task_state spawning.
Nov 06 16:05:58 user nova-compute[75337]: INFO nova.compute.manager [None req-5101ec98-257b-4023-a8ac-e3bf6086672f tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] [instance: f9c98d28-41f9-498f-8c1f-43517999775a] Took 5.63 seconds to spawn the instance on the hypervisor.
Nov 06 16:05:58 user nova-compute[75337]: DEBUG nova.compute.manager [None req-5101ec98-257b-4023-a8ac-e3bf6086672f tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] [instance: f9c98d28-41f9-498f-8c1f-43517999775a] Checking state {{(pid=75337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 16:05:58 user nova-compute[75337]: INFO nova.compute.manager [None req-5101ec98-257b-4023-a8ac-e3bf6086672f tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] [instance: f9c98d28-41f9-498f-8c1f-43517999775a] Took 6.40 seconds to build instance.
Nov 06 16:05:58 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-5101ec98-257b-4023-a8ac-e3bf6086672f tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Lock "f9c98d28-41f9-498f-8c1f-43517999775a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.542s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:05:59 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:06:00 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:06:05 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:06:05 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:06:05 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75337) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 16:06:05 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 16:06:05 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 16:06:05 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:06:10 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:06:10 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:06:10 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75337) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 16:06:10 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 16:06:10 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 16:06:10 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:06:12 user nova-compute[75337]: DEBUG nova.objects.instance [None req-ffad1368-e6aa-400a-b946-2c40ab983028 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Lazy-loading 'flavor' on Instance uuid ba20919c-b506-458e-ac17-70bcb8900bb7 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 16:06:12 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-ffad1368-e6aa-400a-b946-2c40ab983028 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Lock "ba20919c-b506-458e-ac17-70bcb8900bb7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 40.863s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:06:12 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-f4c73c66-6ecf-4163-8b38-c3c80cb306c5 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Lock "ba20919c-b506-458e-ac17-70bcb8900bb7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 40.728s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:06:12 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-f4c73c66-6ecf-4163-8b38-c3c80cb306c5 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Acquiring lock "ba20919c-b506-458e-ac17-70bcb8900bb7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:06:12 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-f4c73c66-6ecf-4163-8b38-c3c80cb306c5 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Lock "ba20919c-b506-458e-ac17-70bcb8900bb7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:06:12 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-f4c73c66-6ecf-4163-8b38-c3c80cb306c5 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Lock "ba20919c-b506-458e-ac17-70bcb8900bb7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:06:12 user nova-compute[75337]: INFO nova.compute.manager [None req-f4c73c66-6ecf-4163-8b38-c3c80cb306c5 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] [instance: ba20919c-b506-458e-ac17-70bcb8900bb7] Terminating instance
Nov 06 16:06:12 user nova-compute[75337]: DEBUG nova.compute.manager [None req-f4c73c66-6ecf-4163-8b38-c3c80cb306c5 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] [instance: ba20919c-b506-458e-ac17-70bcb8900bb7] Start destroying the instance on the hypervisor. {{(pid=75337) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 16:06:12 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:06:12 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:06:12 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:06:12 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:06:12 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:06:13 user nova-compute[75337]: DEBUG nova.compute.manager [req-a13f6232-df89-4797-a1c0-709508882037 req-489e6dc2-fe5d-4cd7-ba4e-fb18fdabc0ff service nova] [instance: ba20919c-b506-458e-ac17-70bcb8900bb7] Received event network-vif-unplugged-18a22e63-f67e-4843-8d5c-97e4f4d7eb31 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:06:13 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-a13f6232-df89-4797-a1c0-709508882037 req-489e6dc2-fe5d-4cd7-ba4e-fb18fdabc0ff service nova] Acquiring lock "ba20919c-b506-458e-ac17-70bcb8900bb7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:06:13 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-a13f6232-df89-4797-a1c0-709508882037 req-489e6dc2-fe5d-4cd7-ba4e-fb18fdabc0ff service nova] Lock "ba20919c-b506-458e-ac17-70bcb8900bb7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:06:13 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-a13f6232-df89-4797-a1c0-709508882037 req-489e6dc2-fe5d-4cd7-ba4e-fb18fdabc0ff service nova] Lock "ba20919c-b506-458e-ac17-70bcb8900bb7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:06:13 user nova-compute[75337]: DEBUG nova.compute.manager [req-a13f6232-df89-4797-a1c0-709508882037 req-489e6dc2-fe5d-4cd7-ba4e-fb18fdabc0ff service nova] [instance: ba20919c-b506-458e-ac17-70bcb8900bb7] No waiting events found dispatching network-vif-unplugged-18a22e63-f67e-4843-8d5c-97e4f4d7eb31 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 16:06:13 user nova-compute[75337]: DEBUG nova.compute.manager [req-a13f6232-df89-4797-a1c0-709508882037 req-489e6dc2-fe5d-4cd7-ba4e-fb18fdabc0ff service nova] [instance: ba20919c-b506-458e-ac17-70bcb8900bb7] Received event network-vif-unplugged-18a22e63-f67e-4843-8d5c-97e4f4d7eb31 for instance with task_state deleting. {{(pid=75337) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 16:06:13 user nova-compute[75337]: INFO nova.virt.libvirt.driver [-] [instance: ba20919c-b506-458e-ac17-70bcb8900bb7] Instance destroyed successfully.
Nov 06 16:06:13 user nova-compute[75337]: DEBUG nova.objects.instance [None req-f4c73c66-6ecf-4163-8b38-c3c80cb306c5 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Lazy-loading 'resources' on Instance uuid ba20919c-b506-458e-ac17-70bcb8900bb7 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 16:06:13 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-f4c73c66-6ecf-4163-8b38-c3c80cb306c5 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T16:02:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-859962119',display_name='tempest-VolumesSnapshotTestJSON-instance-859962119',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-859962119',id=41,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMahMmBI48/EJ8R5Z/+uTLcZCdIoAGXjosrdj3y+PwQmOzlZ50q9XJSmCe74o+PJ6UXlCflqsjgci9QOjGzR3EcPp1WVToliUVXMm+xH+6jZ08NupzmZoscIbYzSElIW1w==',key_name='tempest-keypair-403348999',keypairs=<?>,launch_index=0,launched_at=2023-11-06T16:02:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='398008f06ed645099ae8be04ac48a3ff',ramdisk_id='',reservation_id='r-3usnlrdi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-208809405',owner_user_name='tempest-VolumesSnapshotTestJSON-208809405-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T16:02:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5b2c5ab3c4244bca99bcc3b143c46ecd',uuid=ba20919c-b506-458e-ac17-70bcb8900bb7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "18a22e63-f67e-4843-8d5c-97e4f4d7eb31", "address": "fa:16:3e:5d:7f:5e", "network": {"id": "8618d6aa-9df1-421d-916b-422978dc518d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1705024451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "398008f06ed645099ae8be04ac48a3ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18a22e63-f6", "ovs_interfaceid": "18a22e63-f67e-4843-8d5c-97e4f4d7eb31", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 16:06:13 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-f4c73c66-6ecf-4163-8b38-c3c80cb306c5 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Converting VIF {"id": "18a22e63-f67e-4843-8d5c-97e4f4d7eb31", "address": "fa:16:3e:5d:7f:5e", "network": {"id": "8618d6aa-9df1-421d-916b-422978dc518d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1705024451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "398008f06ed645099ae8be04ac48a3ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18a22e63-f6", "ovs_interfaceid": "18a22e63-f67e-4843-8d5c-97e4f4d7eb31", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 16:06:13 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-f4c73c66-6ecf-4163-8b38-c3c80cb306c5 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5d:7f:5e,bridge_name='br-int',has_traffic_filtering=True,id=18a22e63-f67e-4843-8d5c-97e4f4d7eb31,network=Network(8618d6aa-9df1-421d-916b-422978dc518d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18a22e63-f6') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 16:06:13 user nova-compute[75337]: DEBUG os_vif [None req-f4c73c66-6ecf-4163-8b38-c3c80cb306c5 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5d:7f:5e,bridge_name='br-int',has_traffic_filtering=True,id=18a22e63-f67e-4843-8d5c-97e4f4d7eb31,network=Network(8618d6aa-9df1-421d-916b-422978dc518d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18a22e63-f6') {{(pid=75337) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 16:06:13 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:06:13 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap18a22e63-f6, bridge=br-int, if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 16:06:13 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:06:13 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:06:13 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:06:13 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=15d2875a-7e8a-497c-87ce-52e3fca6347d) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 16:06:13 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:06:13 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:06:13 user nova-compute[75337]: INFO os_vif [None req-f4c73c66-6ecf-4163-8b38-c3c80cb306c5 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5d:7f:5e,bridge_name='br-int',has_traffic_filtering=True,id=18a22e63-f67e-4843-8d5c-97e4f4d7eb31,network=Network(8618d6aa-9df1-421d-916b-422978dc518d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18a22e63-f6')
Nov 06 16:06:13 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f4c73c66-6ecf-4163-8b38-c3c80cb306c5 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] [instance: ba20919c-b506-458e-ac17-70bcb8900bb7] calling os-brick to detach iSCSI Volume {{(pid=75337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 16:06:13 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4c73c66-6ecf-4163-8b38-c3c80cb306c5 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2abc33d0c0>, {'target_iqn': 'iqn.2010-10.org.openstack:c4a5e7b2-ad62-4972-974e-83b84afac437', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YjkNSVmd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 16:06:13 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-f4c73c66-6ecf-4163-8b38-c3c80cb306c5 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 16:06:13 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-f4c73c66-6ecf-4163-8b38-c3c80cb306c5 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 16:06:13 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-f4c73c66-6ecf-4163-8b38-c3c80cb306c5 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 16:06:13 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:06:13 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:06:13 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7148041-2148-4b76-a31a-95e02ac1d892]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:06:13 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4c73c66-6ecf-4163-8b38-c3c80cb306c5 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 16:06:13 user nova-compute[75337]: No targets found.
Nov 06 16:06:13 user nova-compute[75337]: iSNS:
Nov 06 16:06:13 user nova-compute[75337]: No targets found.
Nov 06 16:06:13 user nova-compute[75337]: STATIC:
Nov 06 16:06:13 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139
Nov 06 16:06:13 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 16:06:13 user nova-compute[75337]:                 Iface Name: default
Nov 06 16:06:13 user nova-compute[75337]: FIRMWARE:
Nov 06 16:06:13 user nova-compute[75337]: No targets found.
Nov 06 16:06:13 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 16:06:13 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4c73c66-6ecf-4163-8b38-c3c80cb306c5 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 16:06:13 user nova-compute[75337]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 16:06:13 user nova-compute[75337]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75337) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 16:06:13 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4c73c66-6ecf-4163-8b38-c3c80cb306c5 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c4a5e7b2-ad62-4972-974e-83b84afac437', 0)] {{(pid=75337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 16:06:13 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:06:13 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:06:13 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[882c03c2-8940-49b4-808f-e1ce6d509b4d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:06:13 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:06:13 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:06:13 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[73cddda1-5fb3-43b2-b727-393837be2501]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139 (non-flash)\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:06:13 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4c73c66-6ecf-4163-8b38-c3c80cb306c5 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139 (non-flash)
Nov 06 16:06:13 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 16:06:13 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4c73c66-6ecf-4163-8b38-c3c80cb306c5 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139 (non-flash)
Nov 06 16:06:13 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 16:06:13 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4c73c66-6ecf-4163-8b38-c3c80cb306c5 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2a9c216290>, {}) {{(pid=75337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 16:06:13 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4c73c66-6ecf-4163-8b38-c3c80cb306c5 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Disconnecting from: [] {{(pid=75337) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 16:06:13 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-f4c73c66-6ecf-4163-8b38-c3c80cb306c5 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.066s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 16:06:13 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4c73c66-6ecf-4163-8b38-c3c80cb306c5 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] <== disconnect_volume: return (67ms) None {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 16:06:13 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f4c73c66-6ecf-4163-8b38-c3c80cb306c5 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] [instance: ba20919c-b506-458e-ac17-70bcb8900bb7] Disconnected iSCSI Volume {{(pid=75337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 16:06:13 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-f4c73c66-6ecf-4163-8b38-c3c80cb306c5 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] [instance: ba20919c-b506-458e-ac17-70bcb8900bb7] Deleting instance files /opt/stack/data/nova/instances/ba20919c-b506-458e-ac17-70bcb8900bb7_del
Nov 06 16:06:13 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-f4c73c66-6ecf-4163-8b38-c3c80cb306c5 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] [instance: ba20919c-b506-458e-ac17-70bcb8900bb7] Deletion of /opt/stack/data/nova/instances/ba20919c-b506-458e-ac17-70bcb8900bb7_del complete
Nov 06 16:06:13 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:06:13 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75337) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 16:06:13 user nova-compute[75337]: INFO nova.compute.manager [None req-f4c73c66-6ecf-4163-8b38-c3c80cb306c5 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] [instance: ba20919c-b506-458e-ac17-70bcb8900bb7] Took 0.99 seconds to destroy the instance on the hypervisor.
Nov 06 16:06:13 user nova-compute[75337]: DEBUG oslo.service.loopingcall [None req-f4c73c66-6ecf-4163-8b38-c3c80cb306c5 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75337) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 16:06:13 user nova-compute[75337]: DEBUG nova.compute.manager [-] [instance: ba20919c-b506-458e-ac17-70bcb8900bb7] Deallocating network for instance {{(pid=75337) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 16:06:13 user nova-compute[75337]: DEBUG nova.network.neutron [-] [instance: ba20919c-b506-458e-ac17-70bcb8900bb7] deallocate_for_instance() {{(pid=75337) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 16:06:14 user nova-compute[75337]: DEBUG nova.network.neutron [-] [instance: ba20919c-b506-458e-ac17-70bcb8900bb7] Updating instance_info_cache with network_info: [] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 16:06:14 user nova-compute[75337]: INFO nova.compute.manager [-] [instance: ba20919c-b506-458e-ac17-70bcb8900bb7] Took 0.84 seconds to deallocate network for instance.
Nov 06 16:06:14 user nova-compute[75337]: WARNING nova.volume.cinder [None req-f4c73c66-6ecf-4163-8b38-c3c80cb306c5 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Attachment acab67b8-71c2-4850-95cf-e0e769178894 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = acab67b8-71c2-4850-95cf-e0e769178894. (HTTP 404) (Request-ID: req-67e5004f-04bb-482d-9a30-794631d7dc47)
Nov 06 16:06:14 user nova-compute[75337]: INFO nova.compute.manager [None req-f4c73c66-6ecf-4163-8b38-c3c80cb306c5 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] [instance: ba20919c-b506-458e-ac17-70bcb8900bb7] Took 0.03 seconds to detach 1 volumes for instance.
Nov 06 16:06:14 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:06:14 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-f4c73c66-6ecf-4163-8b38-c3c80cb306c5 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:06:14 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-f4c73c66-6ecf-4163-8b38-c3c80cb306c5 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:06:14 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-f4c73c66-6ecf-4163-8b38-c3c80cb306c5 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 16:06:14 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-f4c73c66-6ecf-4163-8b38-c3c80cb306c5 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 16:06:14 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-f4c73c66-6ecf-4163-8b38-c3c80cb306c5 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.240s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:06:14 user nova-compute[75337]: INFO nova.scheduler.client.report [None req-f4c73c66-6ecf-4163-8b38-c3c80cb306c5 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Deleted allocations for instance ba20919c-b506-458e-ac17-70bcb8900bb7
Nov 06 16:06:14 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:06:14 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-f4c73c66-6ecf-4163-8b38-c3c80cb306c5 tempest-VolumesSnapshotTestJSON-208809405 tempest-VolumesSnapshotTestJSON-208809405-project-member] Lock "ba20919c-b506-458e-ac17-70bcb8900bb7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.279s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:06:15 user nova-compute[75337]: DEBUG nova.compute.manager [req-cf9e4dcc-8575-4970-90d1-08fc572828ea req-3ef54897-6a9e-4a10-90fd-77c4a869a259 service nova] [instance: ba20919c-b506-458e-ac17-70bcb8900bb7] Received event network-vif-plugged-18a22e63-f67e-4843-8d5c-97e4f4d7eb31 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:06:15 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-cf9e4dcc-8575-4970-90d1-08fc572828ea req-3ef54897-6a9e-4a10-90fd-77c4a869a259 service nova] Acquiring lock "ba20919c-b506-458e-ac17-70bcb8900bb7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:06:15 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-cf9e4dcc-8575-4970-90d1-08fc572828ea req-3ef54897-6a9e-4a10-90fd-77c4a869a259 service nova] Lock "ba20919c-b506-458e-ac17-70bcb8900bb7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:06:15 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-cf9e4dcc-8575-4970-90d1-08fc572828ea req-3ef54897-6a9e-4a10-90fd-77c4a869a259 service nova] Lock "ba20919c-b506-458e-ac17-70bcb8900bb7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:06:15 user nova-compute[75337]: DEBUG nova.compute.manager [req-cf9e4dcc-8575-4970-90d1-08fc572828ea req-3ef54897-6a9e-4a10-90fd-77c4a869a259 service nova] [instance: ba20919c-b506-458e-ac17-70bcb8900bb7] No waiting events found dispatching network-vif-plugged-18a22e63-f67e-4843-8d5c-97e4f4d7eb31 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 16:06:15 user nova-compute[75337]: WARNING nova.compute.manager [req-cf9e4dcc-8575-4970-90d1-08fc572828ea req-3ef54897-6a9e-4a10-90fd-77c4a869a259 service nova] [instance: ba20919c-b506-458e-ac17-70bcb8900bb7] Received unexpected event network-vif-plugged-18a22e63-f67e-4843-8d5c-97e4f4d7eb31 for instance with vm_state deleted and task_state None.
Nov 06 16:06:15 user nova-compute[75337]: DEBUG nova.compute.manager [req-cf9e4dcc-8575-4970-90d1-08fc572828ea req-3ef54897-6a9e-4a10-90fd-77c4a869a259 service nova] [instance: ba20919c-b506-458e-ac17-70bcb8900bb7] Received event network-vif-deleted-18a22e63-f67e-4843-8d5c-97e4f4d7eb31 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:06:16 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:06:18 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:06:18 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:06:19 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:06:19 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:06:19 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:06:20 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:06:21 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:06:23 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:06:23 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:06:23 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Starting heal instance info cache {{(pid=75337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 16:06:23 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Rebuilding the list of instances to heal {{(pid=75337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 06 16:06:23 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "refresh_cache-6110b34a-6fd3-45fc-911d-4e5d3c7f2d78" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 16:06:23 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquired lock "refresh_cache-6110b34a-6fd3-45fc-911d-4e5d3c7f2d78" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 16:06:23 user nova-compute[75337]: DEBUG nova.network.neutron [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] [instance: 6110b34a-6fd3-45fc-911d-4e5d3c7f2d78] Forcefully refreshing network info cache for instance {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 16:06:23 user nova-compute[75337]: DEBUG nova.objects.instance [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lazy-loading 'info_cache' on Instance uuid 6110b34a-6fd3-45fc-911d-4e5d3c7f2d78 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 16:06:24 user nova-compute[75337]: DEBUG nova.network.neutron [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] [instance: 6110b34a-6fd3-45fc-911d-4e5d3c7f2d78] Updating instance_info_cache with network_info: [{"id": "fa3c6657-452e-4a95-b9c8-c59002be4e31", "address": "fa:16:3e:18:69:52", "network": {"id": "7f234ecf-bfa6-4316-9dce-c15050ba7914", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1378707892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "243647103fd44f629e0f40be0b56407e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa3c6657-45", "ovs_interfaceid": "fa3c6657-452e-4a95-b9c8-c59002be4e31", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 16:06:24 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Releasing lock "refresh_cache-6110b34a-6fd3-45fc-911d-4e5d3c7f2d78" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 16:06:24 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] [instance: 6110b34a-6fd3-45fc-911d-4e5d3c7f2d78] Updated the network info_cache for instance {{(pid=75337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 16:06:24 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:06:26 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager.update_available_resource {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:06:26 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:06:26 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:06:26 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:06:26 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Auditing locally available compute resources for user (node: user) {{(pid=75337) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 16:06:26 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9c98d28-41f9-498f-8c1f-43517999775a/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:06:27 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9c98d28-41f9-498f-8c1f-43517999775a/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:06:27 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9c98d28-41f9-498f-8c1f-43517999775a/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:06:27 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9c98d28-41f9-498f-8c1f-43517999775a/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:06:27 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01b61f9a-2591-4714-b18e-54f674a441ab/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:06:27 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01b61f9a-2591-4714-b18e-54f674a441ab/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:06:27 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01b61f9a-2591-4714-b18e-54f674a441ab/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:06:27 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01b61f9a-2591-4714-b18e-54f674a441ab/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:06:27 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 16:06:27 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6110b34a-6fd3-45fc-911d-4e5d3c7f2d78/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:06:27 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6110b34a-6fd3-45fc-911d-4e5d3c7f2d78/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:06:27 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6110b34a-6fd3-45fc-911d-4e5d3c7f2d78/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:06:28 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:06:28 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6110b34a-6fd3-45fc-911d-4e5d3c7f2d78/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:06:28 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e2043cc-ff4e-43e9-9867-920de4809cc4/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:06:28 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e2043cc-ff4e-43e9-9867-920de4809cc4/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:06:28 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e2043cc-ff4e-43e9-9867-920de4809cc4/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:06:28 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:06:28 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e2043cc-ff4e-43e9-9867-920de4809cc4/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:06:29 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 16:06:29 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 16:06:29 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Hypervisor/Node resource view: name=user free_ram=8185MB free_disk=24.948902130126953GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75337) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 16:06:29 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:06:29 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:06:29 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 6110b34a-6fd3-45fc-911d-4e5d3c7f2d78 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 16:06:29 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 01b61f9a-2591-4714-b18e-54f674a441ab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 16:06:29 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance d6eaef86-b841-4142-9549-31954fb34fa2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 16:06:29 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 9e2043cc-ff4e-43e9-9867-920de4809cc4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 16:06:29 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance f9c98d28-41f9-498f-8c1f-43517999775a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 16:06:29 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 16:06:29 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 16:06:29 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 16:06:29 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 16:06:29 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Compute_service record updated for user:user {{(pid=75337) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 16:06:29 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.381s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:06:29 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:06:29 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:06:31 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:06:33 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:06:33 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:06:34 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:06:35 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:06:38 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:06:39 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:06:40 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-39098b41-9e54-4b30-9a48-e5a54b7b443a tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Acquiring lock "88330c21-69e0-4d82-ac4d-b9e5e849f487" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:06:40 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-39098b41-9e54-4b30-9a48-e5a54b7b443a tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Lock "88330c21-69e0-4d82-ac4d-b9e5e849f487" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:06:40 user nova-compute[75337]: DEBUG nova.compute.manager [None req-39098b41-9e54-4b30-9a48-e5a54b7b443a tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] [instance: 88330c21-69e0-4d82-ac4d-b9e5e849f487] Starting instance... {{(pid=75337) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 16:06:40 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-39098b41-9e54-4b30-9a48-e5a54b7b443a tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:06:40 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-39098b41-9e54-4b30-9a48-e5a54b7b443a tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:06:40 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-39098b41-9e54-4b30-9a48-e5a54b7b443a tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75337) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 16:06:40 user nova-compute[75337]: INFO nova.compute.claims [None req-39098b41-9e54-4b30-9a48-e5a54b7b443a tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] [instance: 88330c21-69e0-4d82-ac4d-b9e5e849f487] Claim successful on node user
Nov 06 16:06:41 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-39098b41-9e54-4b30-9a48-e5a54b7b443a tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 16:06:41 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-39098b41-9e54-4b30-9a48-e5a54b7b443a tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 16:06:41 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-39098b41-9e54-4b30-9a48-e5a54b7b443a tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.309s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:06:41 user nova-compute[75337]: DEBUG nova.compute.manager [None req-39098b41-9e54-4b30-9a48-e5a54b7b443a tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] [instance: 88330c21-69e0-4d82-ac4d-b9e5e849f487] Start building networks asynchronously for instance. {{(pid=75337) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 16:06:41 user nova-compute[75337]: DEBUG nova.compute.manager [None req-39098b41-9e54-4b30-9a48-e5a54b7b443a tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] [instance: 88330c21-69e0-4d82-ac4d-b9e5e849f487] Allocating IP information in the background. {{(pid=75337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 16:06:41 user nova-compute[75337]: DEBUG nova.network.neutron [None req-39098b41-9e54-4b30-9a48-e5a54b7b443a tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] [instance: 88330c21-69e0-4d82-ac4d-b9e5e849f487] allocate_for_instance() {{(pid=75337) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 16:06:41 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-39098b41-9e54-4b30-9a48-e5a54b7b443a tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] [instance: 88330c21-69e0-4d82-ac4d-b9e5e849f487] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 16:06:41 user nova-compute[75337]: DEBUG nova.compute.manager [None req-39098b41-9e54-4b30-9a48-e5a54b7b443a tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] [instance: 88330c21-69e0-4d82-ac4d-b9e5e849f487] Start building block device mappings for instance. {{(pid=75337) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 16:06:41 user nova-compute[75337]: DEBUG nova.policy [None req-39098b41-9e54-4b30-9a48-e5a54b7b443a tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1f529c0585334b539f0235a5464b4567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b8417f9bf0f4ccbbcb9823c8825a3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75337) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 16:06:41 user nova-compute[75337]: DEBUG nova.compute.manager [None req-39098b41-9e54-4b30-9a48-e5a54b7b443a tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] [instance: 88330c21-69e0-4d82-ac4d-b9e5e849f487] Start spawning the instance on the hypervisor. {{(pid=75337) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 16:06:41 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-39098b41-9e54-4b30-9a48-e5a54b7b443a tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] [instance: 88330c21-69e0-4d82-ac4d-b9e5e849f487] Creating instance directory {{(pid=75337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 16:06:41 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-39098b41-9e54-4b30-9a48-e5a54b7b443a tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] [instance: 88330c21-69e0-4d82-ac4d-b9e5e849f487] Creating image(s)
Nov 06 16:06:41 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-39098b41-9e54-4b30-9a48-e5a54b7b443a tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Acquiring lock "/opt/stack/data/nova/instances/88330c21-69e0-4d82-ac4d-b9e5e849f487/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:06:41 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-39098b41-9e54-4b30-9a48-e5a54b7b443a tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Lock "/opt/stack/data/nova/instances/88330c21-69e0-4d82-ac4d-b9e5e849f487/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:06:41 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-39098b41-9e54-4b30-9a48-e5a54b7b443a tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Lock "/opt/stack/data/nova/instances/88330c21-69e0-4d82-ac4d-b9e5e849f487/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:06:41 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-39098b41-9e54-4b30-9a48-e5a54b7b443a tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:06:41 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-39098b41-9e54-4b30-9a48-e5a54b7b443a tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json" returned: 0 in 0.216s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:06:41 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-39098b41-9e54-4b30-9a48-e5a54b7b443a tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Acquiring lock "06ba3c914798499e686c5ac75886932347225275" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:06:41 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-39098b41-9e54-4b30-9a48-e5a54b7b443a tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Lock "06ba3c914798499e686c5ac75886932347225275" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:06:41 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-39098b41-9e54-4b30-9a48-e5a54b7b443a tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:06:41 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-39098b41-9e54-4b30-9a48-e5a54b7b443a tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json" returned: 0 in 0.226s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:06:41 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-39098b41-9e54-4b30-9a48-e5a54b7b443a tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275,backing_fmt=raw /opt/stack/data/nova/instances/88330c21-69e0-4d82-ac4d-b9e5e849f487/disk 1073741824 {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:06:42 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-39098b41-9e54-4b30-9a48-e5a54b7b443a tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275,backing_fmt=raw /opt/stack/data/nova/instances/88330c21-69e0-4d82-ac4d-b9e5e849f487/disk 1073741824" returned: 0 in 0.057s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:06:42 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-39098b41-9e54-4b30-9a48-e5a54b7b443a tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Lock "06ba3c914798499e686c5ac75886932347225275" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.291s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:06:42 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-39098b41-9e54-4b30-9a48-e5a54b7b443a tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:06:42 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-39098b41-9e54-4b30-9a48-e5a54b7b443a tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json" returned: 0 in 0.173s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:06:42 user nova-compute[75337]: DEBUG nova.virt.disk.api [None req-39098b41-9e54-4b30-9a48-e5a54b7b443a tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Checking if we can resize image /opt/stack/data/nova/instances/88330c21-69e0-4d82-ac4d-b9e5e849f487/disk. size=1073741824 {{(pid=75337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 16:06:42 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-39098b41-9e54-4b30-9a48-e5a54b7b443a tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88330c21-69e0-4d82-ac4d-b9e5e849f487/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:06:42 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-39098b41-9e54-4b30-9a48-e5a54b7b443a tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88330c21-69e0-4d82-ac4d-b9e5e849f487/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:06:42 user nova-compute[75337]: DEBUG nova.virt.disk.api [None req-39098b41-9e54-4b30-9a48-e5a54b7b443a tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Cannot resize image /opt/stack/data/nova/instances/88330c21-69e0-4d82-ac4d-b9e5e849f487/disk to a smaller size. {{(pid=75337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 06 16:06:42 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-39098b41-9e54-4b30-9a48-e5a54b7b443a tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] [instance: 88330c21-69e0-4d82-ac4d-b9e5e849f487] Created local disks {{(pid=75337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 16:06:42 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-39098b41-9e54-4b30-9a48-e5a54b7b443a tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] [instance: 88330c21-69e0-4d82-ac4d-b9e5e849f487] Ensure instance console log exists: /opt/stack/data/nova/instances/88330c21-69e0-4d82-ac4d-b9e5e849f487/console.log {{(pid=75337) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 16:06:42 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-39098b41-9e54-4b30-9a48-e5a54b7b443a tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:06:42 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-39098b41-9e54-4b30-9a48-e5a54b7b443a tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:06:42 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-39098b41-9e54-4b30-9a48-e5a54b7b443a tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:06:42 user nova-compute[75337]: DEBUG nova.network.neutron [None req-39098b41-9e54-4b30-9a48-e5a54b7b443a tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] [instance: 88330c21-69e0-4d82-ac4d-b9e5e849f487] Successfully created port: 4ae4cf27-266c-40f8-a268-1d03f150f318 {{(pid=75337) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 16:06:43 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:06:43 user nova-compute[75337]: DEBUG nova.network.neutron [None req-39098b41-9e54-4b30-9a48-e5a54b7b443a tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] [instance: 88330c21-69e0-4d82-ac4d-b9e5e849f487] Successfully updated port: 4ae4cf27-266c-40f8-a268-1d03f150f318 {{(pid=75337) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 16:06:43 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-39098b41-9e54-4b30-9a48-e5a54b7b443a tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Acquiring lock "refresh_cache-88330c21-69e0-4d82-ac4d-b9e5e849f487" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 16:06:43 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-39098b41-9e54-4b30-9a48-e5a54b7b443a tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Acquired lock "refresh_cache-88330c21-69e0-4d82-ac4d-b9e5e849f487" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 16:06:43 user nova-compute[75337]: DEBUG nova.network.neutron [None req-39098b41-9e54-4b30-9a48-e5a54b7b443a tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] [instance: 88330c21-69e0-4d82-ac4d-b9e5e849f487] Building network info cache for instance {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 16:06:43 user nova-compute[75337]: DEBUG nova.compute.manager [req-79c58bc7-cff6-4397-89c9-2f3faabf548a req-bc3ff83f-dda5-412b-9e53-4a046ee55d57 service nova] [instance: 88330c21-69e0-4d82-ac4d-b9e5e849f487] Received event network-changed-4ae4cf27-266c-40f8-a268-1d03f150f318 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:06:43 user nova-compute[75337]: DEBUG nova.compute.manager [req-79c58bc7-cff6-4397-89c9-2f3faabf548a req-bc3ff83f-dda5-412b-9e53-4a046ee55d57 service nova] [instance: 88330c21-69e0-4d82-ac4d-b9e5e849f487] Refreshing instance network info cache due to event network-changed-4ae4cf27-266c-40f8-a268-1d03f150f318. {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 16:06:43 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-79c58bc7-cff6-4397-89c9-2f3faabf548a req-bc3ff83f-dda5-412b-9e53-4a046ee55d57 service nova] Acquiring lock "refresh_cache-88330c21-69e0-4d82-ac4d-b9e5e849f487" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 16:06:43 user nova-compute[75337]: DEBUG nova.network.neutron [None req-39098b41-9e54-4b30-9a48-e5a54b7b443a tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] [instance: 88330c21-69e0-4d82-ac4d-b9e5e849f487] Instance cache missing network info. {{(pid=75337) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 16:06:43 user nova-compute[75337]: DEBUG nova.network.neutron [None req-39098b41-9e54-4b30-9a48-e5a54b7b443a tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] [instance: 88330c21-69e0-4d82-ac4d-b9e5e849f487] Updating instance_info_cache with network_info: [{"id": "4ae4cf27-266c-40f8-a268-1d03f150f318", "address": "fa:16:3e:d4:3f:d4", "network": {"id": "40ec2d9f-fe05-45bb-8321-e065c7c5cab0", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-863555405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b8417f9bf0f4ccbbcb9823c8825a3d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ae4cf27-26", "ovs_interfaceid": "4ae4cf27-266c-40f8-a268-1d03f150f318", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 16:06:43 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-39098b41-9e54-4b30-9a48-e5a54b7b443a tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Releasing lock "refresh_cache-88330c21-69e0-4d82-ac4d-b9e5e849f487" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 16:06:43 user nova-compute[75337]: DEBUG nova.compute.manager [None req-39098b41-9e54-4b30-9a48-e5a54b7b443a tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] [instance: 88330c21-69e0-4d82-ac4d-b9e5e849f487] Instance network_info: |[{"id": "4ae4cf27-266c-40f8-a268-1d03f150f318", "address": "fa:16:3e:d4:3f:d4", "network": {"id": "40ec2d9f-fe05-45bb-8321-e065c7c5cab0", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-863555405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b8417f9bf0f4ccbbcb9823c8825a3d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ae4cf27-26", "ovs_interfaceid": "4ae4cf27-266c-40f8-a268-1d03f150f318", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 16:06:43 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-79c58bc7-cff6-4397-89c9-2f3faabf548a req-bc3ff83f-dda5-412b-9e53-4a046ee55d57 service nova] Acquired lock "refresh_cache-88330c21-69e0-4d82-ac4d-b9e5e849f487" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 16:06:43 user nova-compute[75337]: DEBUG nova.network.neutron [req-79c58bc7-cff6-4397-89c9-2f3faabf548a req-bc3ff83f-dda5-412b-9e53-4a046ee55d57 service nova] [instance: 88330c21-69e0-4d82-ac4d-b9e5e849f487] Refreshing network info cache for port 4ae4cf27-266c-40f8-a268-1d03f150f318 {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 16:06:43 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-39098b41-9e54-4b30-9a48-e5a54b7b443a tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] [instance: 88330c21-69e0-4d82-ac4d-b9e5e849f487] Start _get_guest_xml network_info=[{"id": "4ae4cf27-266c-40f8-a268-1d03f150f318", "address": "fa:16:3e:d4:3f:d4", "network": {"id": "40ec2d9f-fe05-45bb-8321-e065c7c5cab0", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-863555405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b8417f9bf0f4ccbbcb9823c8825a3d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ae4cf27-26", "ovs_interfaceid": "4ae4cf27-266c-40f8-a268-1d03f150f318", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T15:34:14Z,direct_url=<?>,disk_format='qcow2',id=16b903ae-a40f-41a7-985b-4804cce92c62,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6549a15819f1469bbd5eeae8190e3d44',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T15:34:15Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'guest_format': None, 'size': 0, 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '16b903ae-a40f-41a7-985b-4804cce92c62'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 16:06:43 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-39098b41-9e54-4b30-9a48-e5a54b7b443a tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 16:06:43 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-39098b41-9e54-4b30-9a48-e5a54b7b443a tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 16:06:43 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-39098b41-9e54-4b30-9a48-e5a54b7b443a tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 16:06:43 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-39098b41-9e54-4b30-9a48-e5a54b7b443a tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] CPU controller missing on host. {{(pid=75337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 16:06:43 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-39098b41-9e54-4b30-9a48-e5a54b7b443a tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 16:06:43 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-39098b41-9e54-4b30-9a48-e5a54b7b443a tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] CPU controller found on host. {{(pid=75337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 16:06:44 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-39098b41-9e54-4b30-9a48-e5a54b7b443a tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75337) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 16:06:44 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-39098b41-9e54-4b30-9a48-e5a54b7b443a tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T15:34:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T15:34:14Z,direct_url=<?>,disk_format='qcow2',id=16b903ae-a40f-41a7-985b-4804cce92c62,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6549a15819f1469bbd5eeae8190e3d44',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T15:34:15Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 16:06:44 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-39098b41-9e54-4b30-9a48-e5a54b7b443a tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Flavor limits 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 16:06:44 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-39098b41-9e54-4b30-9a48-e5a54b7b443a tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Image limits 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 16:06:44 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-39098b41-9e54-4b30-9a48-e5a54b7b443a tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Flavor pref 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 16:06:44 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-39098b41-9e54-4b30-9a48-e5a54b7b443a tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Image pref 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 16:06:44 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-39098b41-9e54-4b30-9a48-e5a54b7b443a tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 16:06:44 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-39098b41-9e54-4b30-9a48-e5a54b7b443a tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 16:06:44 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-39098b41-9e54-4b30-9a48-e5a54b7b443a tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 16:06:44 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-39098b41-9e54-4b30-9a48-e5a54b7b443a tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Got 1 possible topologies {{(pid=75337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 16:06:44 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-39098b41-9e54-4b30-9a48-e5a54b7b443a tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 16:06:44 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-39098b41-9e54-4b30-9a48-e5a54b7b443a tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 16:06:44 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-39098b41-9e54-4b30-9a48-e5a54b7b443a tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T16:06:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-307149588',display_name='tempest-SnapshotDataIntegrityTests-server-307149588',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-307149588',id=45,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH1LqK7urhxtmlD+dHJNix1u7YK0/vHOvLaVUP45fm3AZUTXI1SutvrmQqyqFK5QAihENEb2S35GcZM+k1Cd4KwmJwEqlw80fwBG6OZQDBSXRlQArqDcbk/695qlrAk5Uw==',key_name='tempest-keypair-1834344123',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5b8417f9bf0f4ccbbcb9823c8825a3d1',ramdisk_id='',reservation_id='r-8mvz0su0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-175285321',owner_user_name='tempest-SnapshotDataIntegrityTests-175285321-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T16:06:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1f529c0585334b539f0235a5464b4567',uuid=88330c21-69e0-4d82-ac4d-b9e5e849f487,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4ae4cf27-266c-40f8-a268-1d03f150f318", "address": "fa:16:3e:d4:3f:d4", "network": {"id": "40ec2d9f-fe05-45bb-8321-e065c7c5cab0", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-863555405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b8417f9bf0f4ccbbcb9823c8825a3d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ae4cf27-26", "ovs_interfaceid": "4ae4cf27-266c-40f8-a268-1d03f150f318", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75337) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 16:06:44 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-39098b41-9e54-4b30-9a48-e5a54b7b443a tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Converting VIF {"id": "4ae4cf27-266c-40f8-a268-1d03f150f318", "address": "fa:16:3e:d4:3f:d4", "network": {"id": "40ec2d9f-fe05-45bb-8321-e065c7c5cab0", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-863555405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b8417f9bf0f4ccbbcb9823c8825a3d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ae4cf27-26", "ovs_interfaceid": "4ae4cf27-266c-40f8-a268-1d03f150f318", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 16:06:44 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-39098b41-9e54-4b30-9a48-e5a54b7b443a tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:3f:d4,bridge_name='br-int',has_traffic_filtering=True,id=4ae4cf27-266c-40f8-a268-1d03f150f318,network=Network(40ec2d9f-fe05-45bb-8321-e065c7c5cab0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ae4cf27-26') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 16:06:44 user nova-compute[75337]: DEBUG nova.objects.instance [None req-39098b41-9e54-4b30-9a48-e5a54b7b443a tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Lazy-loading 'pci_devices' on Instance uuid 88330c21-69e0-4d82-ac4d-b9e5e849f487 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 16:06:44 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-39098b41-9e54-4b30-9a48-e5a54b7b443a tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] [instance: 88330c21-69e0-4d82-ac4d-b9e5e849f487] End _get_guest_xml xml=<domain type="kvm">
Nov 06 16:06:44 user nova-compute[75337]:   <uuid>88330c21-69e0-4d82-ac4d-b9e5e849f487</uuid>
Nov 06 16:06:44 user nova-compute[75337]:   <name>instance-0000002d</name>
Nov 06 16:06:44 user nova-compute[75337]:   <memory>524288</memory>
Nov 06 16:06:44 user nova-compute[75337]:   <vcpu>1</vcpu>
Nov 06 16:06:44 user nova-compute[75337]:   <metadata>
Nov 06 16:06:44 user nova-compute[75337]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 16:06:44 user nova-compute[75337]:       <nova:package version="0.0.0"/>
Nov 06 16:06:44 user nova-compute[75337]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-307149588</nova:name>
Nov 06 16:06:44 user nova-compute[75337]:       <nova:creationTime>2023-11-06 16:06:43</nova:creationTime>
Nov 06 16:06:44 user nova-compute[75337]:       <nova:flavor name="m1.tiny">
Nov 06 16:06:44 user nova-compute[75337]:         <nova:memory>512</nova:memory>
Nov 06 16:06:44 user nova-compute[75337]:         <nova:disk>1</nova:disk>
Nov 06 16:06:44 user nova-compute[75337]:         <nova:swap>0</nova:swap>
Nov 06 16:06:44 user nova-compute[75337]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 16:06:44 user nova-compute[75337]:         <nova:vcpus>1</nova:vcpus>
Nov 06 16:06:44 user nova-compute[75337]:       </nova:flavor>
Nov 06 16:06:44 user nova-compute[75337]:       <nova:owner>
Nov 06 16:06:44 user nova-compute[75337]:         <nova:user uuid="1f529c0585334b539f0235a5464b4567">tempest-SnapshotDataIntegrityTests-175285321-project-member</nova:user>
Nov 06 16:06:44 user nova-compute[75337]:         <nova:project uuid="5b8417f9bf0f4ccbbcb9823c8825a3d1">tempest-SnapshotDataIntegrityTests-175285321</nova:project>
Nov 06 16:06:44 user nova-compute[75337]:       </nova:owner>
Nov 06 16:06:44 user nova-compute[75337]:       <nova:root type="image" uuid="16b903ae-a40f-41a7-985b-4804cce92c62"/>
Nov 06 16:06:44 user nova-compute[75337]:       <nova:ports>
Nov 06 16:06:44 user nova-compute[75337]:         <nova:port uuid="4ae4cf27-266c-40f8-a268-1d03f150f318">
Nov 06 16:06:44 user nova-compute[75337]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 06 16:06:44 user nova-compute[75337]:         </nova:port>
Nov 06 16:06:44 user nova-compute[75337]:       </nova:ports>
Nov 06 16:06:44 user nova-compute[75337]:     </nova:instance>
Nov 06 16:06:44 user nova-compute[75337]:   </metadata>
Nov 06 16:06:44 user nova-compute[75337]:   <sysinfo type="smbios">
Nov 06 16:06:44 user nova-compute[75337]:     <system>
Nov 06 16:06:44 user nova-compute[75337]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 16:06:44 user nova-compute[75337]:       <entry name="product">OpenStack Nova</entry>
Nov 06 16:06:44 user nova-compute[75337]:       <entry name="version">0.0.0</entry>
Nov 06 16:06:44 user nova-compute[75337]:       <entry name="serial">88330c21-69e0-4d82-ac4d-b9e5e849f487</entry>
Nov 06 16:06:44 user nova-compute[75337]:       <entry name="uuid">88330c21-69e0-4d82-ac4d-b9e5e849f487</entry>
Nov 06 16:06:44 user nova-compute[75337]:       <entry name="family">Virtual Machine</entry>
Nov 06 16:06:44 user nova-compute[75337]:     </system>
Nov 06 16:06:44 user nova-compute[75337]:   </sysinfo>
Nov 06 16:06:44 user nova-compute[75337]:   <os>
Nov 06 16:06:44 user nova-compute[75337]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 16:06:44 user nova-compute[75337]:     <boot dev="hd"/>
Nov 06 16:06:44 user nova-compute[75337]:     <smbios mode="sysinfo"/>
Nov 06 16:06:44 user nova-compute[75337]:   </os>
Nov 06 16:06:44 user nova-compute[75337]:   <features>
Nov 06 16:06:44 user nova-compute[75337]:     <acpi/>
Nov 06 16:06:44 user nova-compute[75337]:     <apic/>
Nov 06 16:06:44 user nova-compute[75337]:     <vmcoreinfo/>
Nov 06 16:06:44 user nova-compute[75337]:   </features>
Nov 06 16:06:44 user nova-compute[75337]:   <clock offset="utc">
Nov 06 16:06:44 user nova-compute[75337]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 16:06:44 user nova-compute[75337]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 16:06:44 user nova-compute[75337]:     <timer name="hpet" present="no"/>
Nov 06 16:06:44 user nova-compute[75337]:   </clock>
Nov 06 16:06:44 user nova-compute[75337]:   <cpu mode="custom" match="exact">
Nov 06 16:06:44 user nova-compute[75337]:     <model>Nehalem</model>
Nov 06 16:06:44 user nova-compute[75337]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 16:06:44 user nova-compute[75337]:   </cpu>
Nov 06 16:06:44 user nova-compute[75337]:   <devices>
Nov 06 16:06:44 user nova-compute[75337]:     <disk type="file" device="disk">
Nov 06 16:06:44 user nova-compute[75337]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 16:06:44 user nova-compute[75337]:       <source file="/opt/stack/data/nova/instances/88330c21-69e0-4d82-ac4d-b9e5e849f487/disk"/>
Nov 06 16:06:44 user nova-compute[75337]:       <target dev="vda" bus="virtio"/>
Nov 06 16:06:44 user nova-compute[75337]:     </disk>
Nov 06 16:06:44 user nova-compute[75337]:     <interface type="ethernet">
Nov 06 16:06:44 user nova-compute[75337]:       <mac address="fa:16:3e:d4:3f:d4"/>
Nov 06 16:06:44 user nova-compute[75337]:       <model type="virtio"/>
Nov 06 16:06:44 user nova-compute[75337]:       <mtu size="1442"/>
Nov 06 16:06:44 user nova-compute[75337]:       <target dev="tap4ae4cf27-26"/>
Nov 06 16:06:44 user nova-compute[75337]:     </interface>
Nov 06 16:06:44 user nova-compute[75337]:     <serial type="pty">
Nov 06 16:06:44 user nova-compute[75337]:       <log file="/opt/stack/data/nova/instances/88330c21-69e0-4d82-ac4d-b9e5e849f487/console.log" append="off"/>
Nov 06 16:06:44 user nova-compute[75337]:     </serial>
Nov 06 16:06:44 user nova-compute[75337]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 16:06:44 user nova-compute[75337]:     <video>
Nov 06 16:06:44 user nova-compute[75337]:       <model type="virtio"/>
Nov 06 16:06:44 user nova-compute[75337]:     </video>
Nov 06 16:06:44 user nova-compute[75337]:     <rng model="virtio">
Nov 06 16:06:44 user nova-compute[75337]:       <backend model="random">/dev/urandom</backend>
Nov 06 16:06:44 user nova-compute[75337]:     </rng>
Nov 06 16:06:44 user nova-compute[75337]:     <controller type="usb" index="0" model="none"/>
Nov 06 16:06:44 user nova-compute[75337]:     <memballoon model="virtio">
Nov 06 16:06:44 user nova-compute[75337]:       <stats period="10"/>
Nov 06 16:06:44 user nova-compute[75337]:     </memballoon>
Nov 06 16:06:44 user nova-compute[75337]:   </devices>
Nov 06 16:06:44 user nova-compute[75337]: </domain>
Nov 06 16:06:44 user nova-compute[75337]:  {{(pid=75337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 16:06:44 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-39098b41-9e54-4b30-9a48-e5a54b7b443a tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T16:06:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-307149588',display_name='tempest-SnapshotDataIntegrityTests-server-307149588',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-307149588',id=45,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH1LqK7urhxtmlD+dHJNix1u7YK0/vHOvLaVUP45fm3AZUTXI1SutvrmQqyqFK5QAihENEb2S35GcZM+k1Cd4KwmJwEqlw80fwBG6OZQDBSXRlQArqDcbk/695qlrAk5Uw==',key_name='tempest-keypair-1834344123',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5b8417f9bf0f4ccbbcb9823c8825a3d1',ramdisk_id='',reservation_id='r-8mvz0su0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-175285321',owner_user_name='tempest-SnapshotDataIntegrityTests-175285321-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T16:06:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1f529c0585334b539f0235a5464b4567',uuid=88330c21-69e0-4d82-ac4d-b9e5e849f487,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4ae4cf27-266c-40f8-a268-1d03f150f318", "address": "fa:16:3e:d4:3f:d4", "network": {"id": "40ec2d9f-fe05-45bb-8321-e065c7c5cab0", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-863555405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b8417f9bf0f4ccbbcb9823c8825a3d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ae4cf27-26", "ovs_interfaceid": "4ae4cf27-266c-40f8-a268-1d03f150f318", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 16:06:44 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-39098b41-9e54-4b30-9a48-e5a54b7b443a tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Converting VIF {"id": "4ae4cf27-266c-40f8-a268-1d03f150f318", "address": "fa:16:3e:d4:3f:d4", "network": {"id": "40ec2d9f-fe05-45bb-8321-e065c7c5cab0", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-863555405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b8417f9bf0f4ccbbcb9823c8825a3d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ae4cf27-26", "ovs_interfaceid": "4ae4cf27-266c-40f8-a268-1d03f150f318", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 16:06:44 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-39098b41-9e54-4b30-9a48-e5a54b7b443a tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:3f:d4,bridge_name='br-int',has_traffic_filtering=True,id=4ae4cf27-266c-40f8-a268-1d03f150f318,network=Network(40ec2d9f-fe05-45bb-8321-e065c7c5cab0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ae4cf27-26') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 16:06:44 user nova-compute[75337]: DEBUG os_vif [None req-39098b41-9e54-4b30-9a48-e5a54b7b443a tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:3f:d4,bridge_name='br-int',has_traffic_filtering=True,id=4ae4cf27-266c-40f8-a268-1d03f150f318,network=Network(40ec2d9f-fe05-45bb-8321-e065c7c5cab0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ae4cf27-26') {{(pid=75337) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 16:06:44 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:06:44 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 16:06:44 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 16:06:44 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:06:44 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '45ca9c9b-3d7b-5146-8a5d-e7de9cd717ec', '_type': 'linux-noop'}}, row=False) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 16:06:44 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:06:44 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:06:44 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:06:44 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4ae4cf27-26, may_exist=True, interface_attrs={}) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 16:06:44 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4ae4cf27-26, col_values=(('qos', UUID('9c3a3712-7d20-4961-8386-8db7b3f7b98b')),), if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 16:06:44 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4ae4cf27-26, col_values=(('external_ids', {'iface-id': '4ae4cf27-266c-40f8-a268-1d03f150f318', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d4:3f:d4', 'vm-uuid': '88330c21-69e0-4d82-ac4d-b9e5e849f487'}),), if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 16:06:44 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:06:44 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:06:44 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:06:44 user nova-compute[75337]: INFO os_vif [None req-39098b41-9e54-4b30-9a48-e5a54b7b443a tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:3f:d4,bridge_name='br-int',has_traffic_filtering=True,id=4ae4cf27-266c-40f8-a268-1d03f150f318,network=Network(40ec2d9f-fe05-45bb-8321-e065c7c5cab0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ae4cf27-26')
Nov 06 16:06:44 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-39098b41-9e54-4b30-9a48-e5a54b7b443a tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] No BDM found with device name vda, not building metadata. {{(pid=75337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 16:06:44 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-39098b41-9e54-4b30-9a48-e5a54b7b443a tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] No VIF found with MAC fa:16:3e:d4:3f:d4, not building metadata {{(pid=75337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 16:06:44 user nova-compute[75337]: DEBUG nova.network.neutron [req-79c58bc7-cff6-4397-89c9-2f3faabf548a req-bc3ff83f-dda5-412b-9e53-4a046ee55d57 service nova] [instance: 88330c21-69e0-4d82-ac4d-b9e5e849f487] Updated VIF entry in instance network info cache for port 4ae4cf27-266c-40f8-a268-1d03f150f318. {{(pid=75337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 16:06:44 user nova-compute[75337]: DEBUG nova.network.neutron [req-79c58bc7-cff6-4397-89c9-2f3faabf548a req-bc3ff83f-dda5-412b-9e53-4a046ee55d57 service nova] [instance: 88330c21-69e0-4d82-ac4d-b9e5e849f487] Updating instance_info_cache with network_info: [{"id": "4ae4cf27-266c-40f8-a268-1d03f150f318", "address": "fa:16:3e:d4:3f:d4", "network": {"id": "40ec2d9f-fe05-45bb-8321-e065c7c5cab0", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-863555405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b8417f9bf0f4ccbbcb9823c8825a3d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ae4cf27-26", "ovs_interfaceid": "4ae4cf27-266c-40f8-a268-1d03f150f318", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 16:06:44 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-79c58bc7-cff6-4397-89c9-2f3faabf548a req-bc3ff83f-dda5-412b-9e53-4a046ee55d57 service nova] Releasing lock "refresh_cache-88330c21-69e0-4d82-ac4d-b9e5e849f487" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 16:06:44 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:06:45 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:06:45 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:06:45 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:06:46 user nova-compute[75337]: DEBUG nova.compute.manager [req-0832b0a0-4a9a-49f2-98a3-02d5c30b9e5e req-b0ae2d87-15b7-4b88-ad2f-2723107a1acc service nova] [instance: 88330c21-69e0-4d82-ac4d-b9e5e849f487] Received event network-vif-plugged-4ae4cf27-266c-40f8-a268-1d03f150f318 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:06:46 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-0832b0a0-4a9a-49f2-98a3-02d5c30b9e5e req-b0ae2d87-15b7-4b88-ad2f-2723107a1acc service nova] Acquiring lock "88330c21-69e0-4d82-ac4d-b9e5e849f487-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:06:46 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-0832b0a0-4a9a-49f2-98a3-02d5c30b9e5e req-b0ae2d87-15b7-4b88-ad2f-2723107a1acc service nova] Lock "88330c21-69e0-4d82-ac4d-b9e5e849f487-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:06:46 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-0832b0a0-4a9a-49f2-98a3-02d5c30b9e5e req-b0ae2d87-15b7-4b88-ad2f-2723107a1acc service nova] Lock "88330c21-69e0-4d82-ac4d-b9e5e849f487-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:06:46 user nova-compute[75337]: DEBUG nova.compute.manager [req-0832b0a0-4a9a-49f2-98a3-02d5c30b9e5e req-b0ae2d87-15b7-4b88-ad2f-2723107a1acc service nova] [instance: 88330c21-69e0-4d82-ac4d-b9e5e849f487] No waiting events found dispatching network-vif-plugged-4ae4cf27-266c-40f8-a268-1d03f150f318 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 16:06:46 user nova-compute[75337]: WARNING nova.compute.manager [req-0832b0a0-4a9a-49f2-98a3-02d5c30b9e5e req-b0ae2d87-15b7-4b88-ad2f-2723107a1acc service nova] [instance: 88330c21-69e0-4d82-ac4d-b9e5e849f487] Received unexpected event network-vif-plugged-4ae4cf27-266c-40f8-a268-1d03f150f318 for instance with vm_state building and task_state spawning.
Nov 06 16:06:46 user nova-compute[75337]: DEBUG nova.compute.manager [req-400a1af1-4d64-4054-a196-32303c2a7712 req-b4bdbb97-6ec4-4094-b07b-e85246c6a84f service nova] [instance: 6110b34a-6fd3-45fc-911d-4e5d3c7f2d78] Received event network-changed-fa3c6657-452e-4a95-b9c8-c59002be4e31 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:06:46 user nova-compute[75337]: DEBUG nova.compute.manager [req-400a1af1-4d64-4054-a196-32303c2a7712 req-b4bdbb97-6ec4-4094-b07b-e85246c6a84f service nova] [instance: 6110b34a-6fd3-45fc-911d-4e5d3c7f2d78] Refreshing instance network info cache due to event network-changed-fa3c6657-452e-4a95-b9c8-c59002be4e31. {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 16:06:46 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-400a1af1-4d64-4054-a196-32303c2a7712 req-b4bdbb97-6ec4-4094-b07b-e85246c6a84f service nova] Acquiring lock "refresh_cache-6110b34a-6fd3-45fc-911d-4e5d3c7f2d78" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 16:06:46 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-400a1af1-4d64-4054-a196-32303c2a7712 req-b4bdbb97-6ec4-4094-b07b-e85246c6a84f service nova] Acquired lock "refresh_cache-6110b34a-6fd3-45fc-911d-4e5d3c7f2d78" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 16:06:46 user nova-compute[75337]: DEBUG nova.network.neutron [req-400a1af1-4d64-4054-a196-32303c2a7712 req-b4bdbb97-6ec4-4094-b07b-e85246c6a84f service nova] [instance: 6110b34a-6fd3-45fc-911d-4e5d3c7f2d78] Refreshing network info cache for port fa3c6657-452e-4a95-b9c8-c59002be4e31 {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 16:06:46 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:06:46 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:06:46 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:06:46 user nova-compute[75337]: DEBUG nova.network.neutron [req-400a1af1-4d64-4054-a196-32303c2a7712 req-b4bdbb97-6ec4-4094-b07b-e85246c6a84f service nova] [instance: 6110b34a-6fd3-45fc-911d-4e5d3c7f2d78] Updated VIF entry in instance network info cache for port fa3c6657-452e-4a95-b9c8-c59002be4e31. {{(pid=75337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 16:06:46 user nova-compute[75337]: DEBUG nova.network.neutron [req-400a1af1-4d64-4054-a196-32303c2a7712 req-b4bdbb97-6ec4-4094-b07b-e85246c6a84f service nova] [instance: 6110b34a-6fd3-45fc-911d-4e5d3c7f2d78] Updating instance_info_cache with network_info: [{"id": "fa3c6657-452e-4a95-b9c8-c59002be4e31", "address": "fa:16:3e:18:69:52", "network": {"id": "7f234ecf-bfa6-4316-9dce-c15050ba7914", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1378707892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "243647103fd44f629e0f40be0b56407e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa3c6657-45", "ovs_interfaceid": "fa3c6657-452e-4a95-b9c8-c59002be4e31", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 16:06:46 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-400a1af1-4d64-4054-a196-32303c2a7712 req-b4bdbb97-6ec4-4094-b07b-e85246c6a84f service nova] Releasing lock "refresh_cache-6110b34a-6fd3-45fc-911d-4e5d3c7f2d78" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 16:06:48 user nova-compute[75337]: DEBUG nova.compute.manager [req-0439034d-1b8a-44c9-9e30-2fd87171cb4a req-d1303f50-7391-40b6-ad77-184e840d2a19 service nova] [instance: 88330c21-69e0-4d82-ac4d-b9e5e849f487] Received event network-vif-plugged-4ae4cf27-266c-40f8-a268-1d03f150f318 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:06:48 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-0439034d-1b8a-44c9-9e30-2fd87171cb4a req-d1303f50-7391-40b6-ad77-184e840d2a19 service nova] Acquiring lock "88330c21-69e0-4d82-ac4d-b9e5e849f487-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:06:48 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-0439034d-1b8a-44c9-9e30-2fd87171cb4a req-d1303f50-7391-40b6-ad77-184e840d2a19 service nova] Lock "88330c21-69e0-4d82-ac4d-b9e5e849f487-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:06:48 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-0439034d-1b8a-44c9-9e30-2fd87171cb4a req-d1303f50-7391-40b6-ad77-184e840d2a19 service nova] Lock "88330c21-69e0-4d82-ac4d-b9e5e849f487-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:06:48 user nova-compute[75337]: DEBUG nova.compute.manager [req-0439034d-1b8a-44c9-9e30-2fd87171cb4a req-d1303f50-7391-40b6-ad77-184e840d2a19 service nova] [instance: 88330c21-69e0-4d82-ac4d-b9e5e849f487] No waiting events found dispatching network-vif-plugged-4ae4cf27-266c-40f8-a268-1d03f150f318 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 16:06:48 user nova-compute[75337]: WARNING nova.compute.manager [req-0439034d-1b8a-44c9-9e30-2fd87171cb4a req-d1303f50-7391-40b6-ad77-184e840d2a19 service nova] [instance: 88330c21-69e0-4d82-ac4d-b9e5e849f487] Received unexpected event network-vif-plugged-4ae4cf27-266c-40f8-a268-1d03f150f318 for instance with vm_state building and task_state spawning.
Nov 06 16:06:48 user nova-compute[75337]: DEBUG nova.compute.manager [req-7beb1f98-ed22-45ae-8d80-2ba47fd39c17 req-0dcd5342-c1bc-4d87-a0b7-9edc667ba07d service nova] [instance: d6eaef86-b841-4142-9549-31954fb34fa2] Received event network-changed-99bb43c1-3b95-4be2-a534-845c37778773 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:06:48 user nova-compute[75337]: DEBUG nova.compute.manager [req-7beb1f98-ed22-45ae-8d80-2ba47fd39c17 req-0dcd5342-c1bc-4d87-a0b7-9edc667ba07d service nova] [instance: d6eaef86-b841-4142-9549-31954fb34fa2] Refreshing instance network info cache due to event network-changed-99bb43c1-3b95-4be2-a534-845c37778773. {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 16:06:48 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-7beb1f98-ed22-45ae-8d80-2ba47fd39c17 req-0dcd5342-c1bc-4d87-a0b7-9edc667ba07d service nova] Acquiring lock "refresh_cache-d6eaef86-b841-4142-9549-31954fb34fa2" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 16:06:48 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-7beb1f98-ed22-45ae-8d80-2ba47fd39c17 req-0dcd5342-c1bc-4d87-a0b7-9edc667ba07d service nova] Acquired lock "refresh_cache-d6eaef86-b841-4142-9549-31954fb34fa2" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 16:06:48 user nova-compute[75337]: DEBUG nova.network.neutron [req-7beb1f98-ed22-45ae-8d80-2ba47fd39c17 req-0dcd5342-c1bc-4d87-a0b7-9edc667ba07d service nova] [instance: d6eaef86-b841-4142-9549-31954fb34fa2] Refreshing network info cache for port 99bb43c1-3b95-4be2-a534-845c37778773 {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 16:06:48 user nova-compute[75337]: DEBUG nova.compute.manager [None req-39098b41-9e54-4b30-9a48-e5a54b7b443a tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] [instance: 88330c21-69e0-4d82-ac4d-b9e5e849f487] Instance event wait completed in 0 seconds for  {{(pid=75337) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 16:06:48 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-39098b41-9e54-4b30-9a48-e5a54b7b443a tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] [instance: 88330c21-69e0-4d82-ac4d-b9e5e849f487] Guest created on hypervisor {{(pid=75337) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 16:06:48 user nova-compute[75337]: INFO nova.virt.libvirt.driver [-] [instance: 88330c21-69e0-4d82-ac4d-b9e5e849f487] Instance spawned successfully.
Nov 06 16:06:48 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-39098b41-9e54-4b30-9a48-e5a54b7b443a tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] [instance: 88330c21-69e0-4d82-ac4d-b9e5e849f487] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 16:06:48 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-39098b41-9e54-4b30-9a48-e5a54b7b443a tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] [instance: 88330c21-69e0-4d82-ac4d-b9e5e849f487] Found default for hw_cdrom_bus of ide {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 16:06:48 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-39098b41-9e54-4b30-9a48-e5a54b7b443a tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] [instance: 88330c21-69e0-4d82-ac4d-b9e5e849f487] Found default for hw_disk_bus of virtio {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 16:06:48 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-39098b41-9e54-4b30-9a48-e5a54b7b443a tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] [instance: 88330c21-69e0-4d82-ac4d-b9e5e849f487] Found default for hw_input_bus of None {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 16:06:48 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-39098b41-9e54-4b30-9a48-e5a54b7b443a tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] [instance: 88330c21-69e0-4d82-ac4d-b9e5e849f487] Found default for hw_pointer_model of None {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 16:06:48 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-39098b41-9e54-4b30-9a48-e5a54b7b443a tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] [instance: 88330c21-69e0-4d82-ac4d-b9e5e849f487] Found default for hw_video_model of virtio {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 16:06:48 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-39098b41-9e54-4b30-9a48-e5a54b7b443a tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] [instance: 88330c21-69e0-4d82-ac4d-b9e5e849f487] Found default for hw_vif_model of virtio {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 16:06:48 user nova-compute[75337]: DEBUG nova.compute.manager [None req-e44d4b33-0b85-491f-8d42-9a35be2edcea tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: d6eaef86-b841-4142-9549-31954fb34fa2] Stashing vm_state: active {{(pid=75337) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 06 16:06:48 user nova-compute[75337]: INFO nova.compute.manager [None req-39098b41-9e54-4b30-9a48-e5a54b7b443a tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] [instance: 88330c21-69e0-4d82-ac4d-b9e5e849f487] Took 6.85 seconds to spawn the instance on the hypervisor.
Nov 06 16:06:48 user nova-compute[75337]: DEBUG nova.compute.manager [None req-39098b41-9e54-4b30-9a48-e5a54b7b443a tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] [instance: 88330c21-69e0-4d82-ac4d-b9e5e849f487] Checking state {{(pid=75337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 16:06:48 user nova-compute[75337]: INFO nova.compute.manager [None req-39098b41-9e54-4b30-9a48-e5a54b7b443a tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] [instance: 88330c21-69e0-4d82-ac4d-b9e5e849f487] Took 7.60 seconds to build instance.
Nov 06 16:06:48 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-e44d4b33-0b85-491f-8d42-9a35be2edcea tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:06:48 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-e44d4b33-0b85-491f-8d42-9a35be2edcea tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:06:48 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-39098b41-9e54-4b30-9a48-e5a54b7b443a tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Lock "88330c21-69e0-4d82-ac4d-b9e5e849f487" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.727s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:06:48 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-e44d4b33-0b85-491f-8d42-9a35be2edcea tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75337) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 16:06:48 user nova-compute[75337]: INFO nova.compute.claims [None req-e44d4b33-0b85-491f-8d42-9a35be2edcea tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: d6eaef86-b841-4142-9549-31954fb34fa2] Claim successful on node user
Nov 06 16:06:48 user nova-compute[75337]: INFO nova.compute.resource_tracker [None req-e44d4b33-0b85-491f-8d42-9a35be2edcea tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: d6eaef86-b841-4142-9549-31954fb34fa2] Updating resource usage from migration 9b362311-b7f0-4a00-b157-930adde8974f
Nov 06 16:06:48 user nova-compute[75337]: DEBUG nova.network.neutron [req-7beb1f98-ed22-45ae-8d80-2ba47fd39c17 req-0dcd5342-c1bc-4d87-a0b7-9edc667ba07d service nova] [instance: d6eaef86-b841-4142-9549-31954fb34fa2] Updated VIF entry in instance network info cache for port 99bb43c1-3b95-4be2-a534-845c37778773. {{(pid=75337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 16:06:48 user nova-compute[75337]: DEBUG nova.network.neutron [req-7beb1f98-ed22-45ae-8d80-2ba47fd39c17 req-0dcd5342-c1bc-4d87-a0b7-9edc667ba07d service nova] [instance: d6eaef86-b841-4142-9549-31954fb34fa2] Updating instance_info_cache with network_info: [{"id": "99bb43c1-3b95-4be2-a534-845c37778773", "address": "fa:16:3e:98:6e:e3", "network": {"id": "7f234ecf-bfa6-4316-9dce-c15050ba7914", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1378707892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "243647103fd44f629e0f40be0b56407e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99bb43c1-3b", "ovs_interfaceid": "99bb43c1-3b95-4be2-a534-845c37778773", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 16:06:48 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-7beb1f98-ed22-45ae-8d80-2ba47fd39c17 req-0dcd5342-c1bc-4d87-a0b7-9edc667ba07d service nova] Releasing lock "refresh_cache-d6eaef86-b841-4142-9549-31954fb34fa2" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 16:06:48 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-e44d4b33-0b85-491f-8d42-9a35be2edcea tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 16:06:48 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-e44d4b33-0b85-491f-8d42-9a35be2edcea tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 16:06:48 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-e44d4b33-0b85-491f-8d42-9a35be2edcea tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.506s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:06:48 user nova-compute[75337]: INFO nova.compute.manager [None req-e44d4b33-0b85-491f-8d42-9a35be2edcea tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: d6eaef86-b841-4142-9549-31954fb34fa2] Migrating
Nov 06 16:06:49 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-e44d4b33-0b85-491f-8d42-9a35be2edcea tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Acquiring lock "refresh_cache-d6eaef86-b841-4142-9549-31954fb34fa2" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 16:06:49 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-e44d4b33-0b85-491f-8d42-9a35be2edcea tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Acquired lock "refresh_cache-d6eaef86-b841-4142-9549-31954fb34fa2" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 16:06:49 user nova-compute[75337]: DEBUG nova.network.neutron [None req-e44d4b33-0b85-491f-8d42-9a35be2edcea tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: d6eaef86-b841-4142-9549-31954fb34fa2] Building network info cache for instance {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 16:06:49 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:06:49 user nova-compute[75337]: DEBUG nova.network.neutron [None req-e44d4b33-0b85-491f-8d42-9a35be2edcea tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: d6eaef86-b841-4142-9549-31954fb34fa2] Updating instance_info_cache with network_info: [{"id": "99bb43c1-3b95-4be2-a534-845c37778773", "address": "fa:16:3e:98:6e:e3", "network": {"id": "7f234ecf-bfa6-4316-9dce-c15050ba7914", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1378707892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "243647103fd44f629e0f40be0b56407e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99bb43c1-3b", "ovs_interfaceid": "99bb43c1-3b95-4be2-a534-845c37778773", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 16:06:49 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-e44d4b33-0b85-491f-8d42-9a35be2edcea tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Releasing lock "refresh_cache-d6eaef86-b841-4142-9549-31954fb34fa2" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 16:06:49 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-e44d4b33-0b85-491f-8d42-9a35be2edcea tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: d6eaef86-b841-4142-9549-31954fb34fa2] Starting migrate_disk_and_power_off {{(pid=75337) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 06 16:06:49 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:06:49 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:06:49 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:06:50 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:06:50 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:06:50 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-bc2369ee-cc45-43f5-b3f9-29d82e3dbd5c tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Acquiring lock "9e2043cc-ff4e-43e9-9867-920de4809cc4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:06:50 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-bc2369ee-cc45-43f5-b3f9-29d82e3dbd5c tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Lock "9e2043cc-ff4e-43e9-9867-920de4809cc4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:06:50 user nova-compute[75337]: DEBUG nova.objects.instance [None req-bc2369ee-cc45-43f5-b3f9-29d82e3dbd5c tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Lazy-loading 'flavor' on Instance uuid 9e2043cc-ff4e-43e9-9867-920de4809cc4 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 16:06:50 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-bc2369ee-cc45-43f5-b3f9-29d82e3dbd5c tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Lock "9e2043cc-ff4e-43e9-9867-920de4809cc4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.072s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:06:50 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:06:50 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:06:50 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:06:50 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:06:50 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:06:50 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:06:50 user nova-compute[75337]: INFO nova.virt.libvirt.driver [-] [instance: d6eaef86-b841-4142-9549-31954fb34fa2] Instance destroyed successfully.
Nov 06 16:06:50 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-e44d4b33-0b85-491f-8d42-9a35be2edcea tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T16:04:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-861327703',display_name='tempest-ServerActionsTestOtherA-server-861327703',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-861327703',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL4qUjCjjdVsflRB1h4DRug41qRThkRpbPytYUyz/XMQHNCLS4P/DapnKkRg0/Jn7/AhFFjdzCG9PxcwwVtb8q/utJpW4U9sbkxfbmmpOTPsJTE2NdIyui4Q27o5JkMUFA==',key_name='tempest-keypair-766127816',keypairs=<?>,launch_index=0,launched_at=2023-11-06T16:04:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='243647103fd44f629e0f40be0b56407e',ramdisk_id='',reservation_id='r-zax76e41',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-783619975',owner_user_name='tempest-ServerActionsTestOtherA-783619975-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T16:06:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2e47bf9ad49645deb2c1f834938fa39f',uuid=d6eaef86-b841-4142-9549-31954fb34fa2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "99bb43c1-3b95-4be2-a534-845c37778773", "address": "fa:16:3e:98:6e:e3", "network": {"id": "7f234ecf-bfa6-4316-9dce-c15050ba7914", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1378707892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1378707892-network", "vif_mac": "fa:16:3e:98:6e:e3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "243647103fd44f629e0f40be0b56407e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99bb43c1-3b", "ovs_interfaceid": "99bb43c1-3b95-4be2-a534-845c37778773", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 16:06:50 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-e44d4b33-0b85-491f-8d42-9a35be2edcea tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Converting VIF {"id": "99bb43c1-3b95-4be2-a534-845c37778773", "address": "fa:16:3e:98:6e:e3", "network": {"id": "7f234ecf-bfa6-4316-9dce-c15050ba7914", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1378707892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1378707892-network", "vif_mac": "fa:16:3e:98:6e:e3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "243647103fd44f629e0f40be0b56407e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99bb43c1-3b", "ovs_interfaceid": "99bb43c1-3b95-4be2-a534-845c37778773", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 16:06:50 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-e44d4b33-0b85-491f-8d42-9a35be2edcea tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:98:6e:e3,bridge_name='br-int',has_traffic_filtering=True,id=99bb43c1-3b95-4be2-a534-845c37778773,network=Network(7f234ecf-bfa6-4316-9dce-c15050ba7914),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99bb43c1-3b') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 16:06:50 user nova-compute[75337]: DEBUG os_vif [None req-e44d4b33-0b85-491f-8d42-9a35be2edcea tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:98:6e:e3,bridge_name='br-int',has_traffic_filtering=True,id=99bb43c1-3b95-4be2-a534-845c37778773,network=Network(7f234ecf-bfa6-4316-9dce-c15050ba7914),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99bb43c1-3b') {{(pid=75337) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 16:06:50 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:06:50 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap99bb43c1-3b, bridge=br-int, if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 16:06:50 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:06:50 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:06:50 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:06:50 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c5bef8fc-1543-444b-a4e1-5249c1c919a5) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 16:06:50 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:06:50 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:06:50 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:06:50 user nova-compute[75337]: INFO os_vif [None req-e44d4b33-0b85-491f-8d42-9a35be2edcea tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:98:6e:e3,bridge_name='br-int',has_traffic_filtering=True,id=99bb43c1-3b95-4be2-a534-845c37778773,network=Network(7f234ecf-bfa6-4316-9dce-c15050ba7914),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99bb43c1-3b')
Nov 06 16:06:50 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e44d4b33-0b85-491f-8d42-9a35be2edcea tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: d6eaef86-b841-4142-9549-31954fb34fa2] calling os-brick to detach iSCSI Volume {{(pid=75337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 16:06:50 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e44d4b33-0b85-491f-8d42-9a35be2edcea tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2abc33d0c0>, {'target_iqn': 'iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wZVTXPEQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 16:06:50 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-e44d4b33-0b85-491f-8d42-9a35be2edcea tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 16:06:50 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-e44d4b33-0b85-491f-8d42-9a35be2edcea tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 16:06:50 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-e44d4b33-0b85-491f-8d42-9a35be2edcea tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.006s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 16:06:50 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:06:50 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:06:50 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[646a31f8-0fdc-44ee-bc8c-a62b6f163537]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:06:50 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e44d4b33-0b85-491f-8d42-9a35be2edcea tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 16:06:50 user nova-compute[75337]: No targets found.
Nov 06 16:06:50 user nova-compute[75337]: iSNS:
Nov 06 16:06:50 user nova-compute[75337]: No targets found.
Nov 06 16:06:50 user nova-compute[75337]: STATIC:
Nov 06 16:06:50 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139
Nov 06 16:06:50 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 16:06:50 user nova-compute[75337]:                 Iface Name: default
Nov 06 16:06:50 user nova-compute[75337]: FIRMWARE:
Nov 06 16:06:50 user nova-compute[75337]: No targets found.
Nov 06 16:06:50 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 16:06:50 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e44d4b33-0b85-491f-8d42-9a35be2edcea tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 16:06:50 user nova-compute[75337]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 16:06:50 user nova-compute[75337]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75337) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 16:06:50 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e44d4b33-0b85-491f-8d42-9a35be2edcea tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139', 0)] {{(pid=75337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 16:06:50 user nova-compute[75337]: DEBUG nova.compute.manager [req-39fb1558-afab-43c6-adae-1374e2d27f2a req-07b6b28e-d2bd-4b82-8e6d-1d4e38004e9b service nova] [instance: 9e2043cc-ff4e-43e9-9867-920de4809cc4] Received event network-changed-36f87e2c-dbfb-484a-99b8-6a77e3bb986a {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:06:50 user nova-compute[75337]: DEBUG nova.compute.manager [req-39fb1558-afab-43c6-adae-1374e2d27f2a req-07b6b28e-d2bd-4b82-8e6d-1d4e38004e9b service nova] [instance: 9e2043cc-ff4e-43e9-9867-920de4809cc4] Refreshing instance network info cache due to event network-changed-36f87e2c-dbfb-484a-99b8-6a77e3bb986a. {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 16:06:50 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-39fb1558-afab-43c6-adae-1374e2d27f2a req-07b6b28e-d2bd-4b82-8e6d-1d4e38004e9b service nova] Acquiring lock "refresh_cache-9e2043cc-ff4e-43e9-9867-920de4809cc4" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 16:06:50 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-39fb1558-afab-43c6-adae-1374e2d27f2a req-07b6b28e-d2bd-4b82-8e6d-1d4e38004e9b service nova] Acquired lock "refresh_cache-9e2043cc-ff4e-43e9-9867-920de4809cc4" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 16:06:50 user nova-compute[75337]: DEBUG nova.network.neutron [req-39fb1558-afab-43c6-adae-1374e2d27f2a req-07b6b28e-d2bd-4b82-8e6d-1d4e38004e9b service nova] [instance: 9e2043cc-ff4e-43e9-9867-920de4809cc4] Refreshing network info cache for port 36f87e2c-dbfb-484a-99b8-6a77e3bb986a {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 16:06:50 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:06:50 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:06:50 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b4b06d2-8e9a-4079-9d18-b79349aa7523]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:06:50 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:06:50 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:06:50 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1c01a70-bea2-4c60-8908-f13badef07a5]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139 (non-flash)\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:06:50 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e44d4b33-0b85-491f-8d42-9a35be2edcea tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139 (non-flash)
Nov 06 16:06:50 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 16:06:50 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e44d4b33-0b85-491f-8d42-9a35be2edcea tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139 (non-flash)
Nov 06 16:06:50 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 16:06:50 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e44d4b33-0b85-491f-8d42-9a35be2edcea tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2a9c44b760>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139'): ({'sdd'}, set())}) {{(pid=75337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 16:06:50 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-e44d4b33-0b85-491f-8d42-9a35be2edcea tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Removing single pathed devices sdd {{(pid=75337) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 16:06:50 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-bc2369ee-cc45-43f5-b3f9-29d82e3dbd5c tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Acquiring lock "9e2043cc-ff4e-43e9-9867-920de4809cc4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:06:50 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-bc2369ee-cc45-43f5-b3f9-29d82e3dbd5c tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Lock "9e2043cc-ff4e-43e9-9867-920de4809cc4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:06:50 user nova-compute[75337]: INFO nova.compute.manager [None req-bc2369ee-cc45-43f5-b3f9-29d82e3dbd5c tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] [instance: 9e2043cc-ff4e-43e9-9867-920de4809cc4] Attaching volume 59596733-e5c9-4e48-8904-9251c84172c0 to /dev/vdb
Nov 06 16:06:50 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:06:50 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.033s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:06:50 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[2500a17b-6d77-47e5-a5a9-ea2d0615c00e]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:06:50 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:06:50 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.023s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:06:50 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf7735ba-db18-4299-a3df-de92890018cb]: (4, ('ok\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:06:50 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-e44d4b33-0b85-491f-8d42-9a35be2edcea tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Flushing IO for device /dev/sdd {{(pid=75337) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 16:06:50 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:06:50 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:06:50 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:06:50 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[39d9d208-2f79-42f1-b9bb-6ccbdd84d864]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:06:50 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-e44d4b33-0b85-491f-8d42-9a35be2edcea tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75337) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 16:06:50 user nova-compute[75337]: DEBUG os_brick.utils [None req-bc2369ee-cc45-43f5-b3f9-29d82e3dbd5c tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 16:06:50 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:06:50 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:06:50 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.036s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:06:50 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef1b6e46-dd0a-421a-a2e2-e60d90d4e2b3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4ff6411e45b8\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:06:50 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:06:50 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.054s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:06:50 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[1025ac15-743e-457e-9b22-e604b9e64e21]: (4, ('1', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:06:50 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-e44d4b33-0b85-491f-8d42-9a35be2edcea tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 16:06:50 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-e44d4b33-0b85-491f-8d42-9a35be2edcea tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] SCSI volumes sdd have been removed. {{(pid=75337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 16:06:50 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e44d4b33-0b85-491f-8d42-9a35be2edcea tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139')] {{(pid=75337) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 16:06:50 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:06:50 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.027s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:06:50 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c105910-18f6-4d2c-b7c3-43ce81d2bb7d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:06:50 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:06:50 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.031s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:06:50 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c6deb37-7f73-4238-885a-be04a027829a]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:06:50 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e44d4b33-0b85-491f-8d42-9a35be2edcea tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:06:50 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139 -p 172.16.0.220:3260 --logout {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:06:50 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:06:50 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae3eaa60-8f00-4d79-9c1f-3b71db9cdb5a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:06:50 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4db432c-a25c-41df-aff6-6b191a91b938]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:06:50 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-bc2369ee-cc45-43f5-b3f9-29d82e3dbd5c tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Running cmd (subprocess): nvme version {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:06:50 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-bc2369ee-cc45-43f5-b3f9-29d82e3dbd5c tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] 'nvme version' failed. Not Retrying. {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 16:06:50 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bc2369ee-cc45-43f5-b3f9-29d82e3dbd5c tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] nvme not present on system {{(pid=75337) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 16:06:51 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139 -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:06:51 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[81cfca84-ba34-4525-ad1d-6df897649313]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:06:51 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e44d4b33-0b85-491f-8d42-9a35be2edcea tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139, portal: 172.16.0.220,3260]
Nov 06 16:06:51 user nova-compute[75337]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139, portal: 172.16.0.220,3260] successful.
Nov 06 16:06:51 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:06:51 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:06:51 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139 -p 172.16.0.220:3260 --op delete {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:06:51 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 16:06:51 user nova-compute[75337]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 16:06:51 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[68956f7d-5f1f-419c-ad77-eccda4a72e0c]: (4, '') {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:06:51 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.lightos [None req-bc2369ee-cc45-43f5-b3f9-29d82e3dbd5c tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75337) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 16:06:51 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.lightos [None req-bc2369ee-cc45-43f5-b3f9-29d82e3dbd5c tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 16:06:51 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.lightos [None req-bc2369ee-cc45-43f5-b3f9-29d82e3dbd5c tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] LIGHTOS: no hostnqn found. {{(pid=75337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 16:06:51 user nova-compute[75337]: DEBUG os_brick.utils [None req-bc2369ee-cc45-43f5-b3f9-29d82e3dbd5c tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] <== get_connector_properties: return (209ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4ff6411e45b8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 16:06:51 user nova-compute[75337]: DEBUG nova.virt.block_device [None req-bc2369ee-cc45-43f5-b3f9-29d82e3dbd5c tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] [instance: 9e2043cc-ff4e-43e9-9867-920de4809cc4] Updating existing volume attachment record: 93f1e31b-725f-4f6f-955b-b3fd770d866d {{(pid=75337) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 16:06:51 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:06:51 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc2ab90b-60dd-462a-8bd3-699ff0b2d55b]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:06:51 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e44d4b33-0b85-491f-8d42-9a35be2edcea tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:06:51 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-e44d4b33-0b85-491f-8d42-9a35be2edcea tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.427s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 16:06:51 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e44d4b33-0b85-491f-8d42-9a35be2edcea tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] <== disconnect_volume: return (433ms) None {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 16:06:51 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e44d4b33-0b85-491f-8d42-9a35be2edcea tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: d6eaef86-b841-4142-9549-31954fb34fa2] Disconnected iSCSI Volume {{(pid=75337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 16:06:51 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-e44d4b33-0b85-491f-8d42-9a35be2edcea tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 16:06:51 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:06:51 user nova-compute[75337]: DEBUG nova.network.neutron [req-39fb1558-afab-43c6-adae-1374e2d27f2a req-07b6b28e-d2bd-4b82-8e6d-1d4e38004e9b service nova] [instance: 9e2043cc-ff4e-43e9-9867-920de4809cc4] Updated VIF entry in instance network info cache for port 36f87e2c-dbfb-484a-99b8-6a77e3bb986a. {{(pid=75337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 16:06:51 user nova-compute[75337]: DEBUG nova.network.neutron [req-39fb1558-afab-43c6-adae-1374e2d27f2a req-07b6b28e-d2bd-4b82-8e6d-1d4e38004e9b service nova] [instance: 9e2043cc-ff4e-43e9-9867-920de4809cc4] Updating instance_info_cache with network_info: [{"id": "36f87e2c-dbfb-484a-99b8-6a77e3bb986a", "address": "fa:16:3e:a0:7d:db", "network": {"id": "df5f1c2e-c934-4237-aee6-f070a198c4ac", "bridge": "br-int", "label": "tempest-TestStampPattern-1883369969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37b65a37b3ac4a92af0279d7ef3b9637", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36f87e2c-db", "ovs_interfaceid": "36f87e2c-dbfb-484a-99b8-6a77e3bb986a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 16:06:51 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-39fb1558-afab-43c6-adae-1374e2d27f2a req-07b6b28e-d2bd-4b82-8e6d-1d4e38004e9b service nova] Releasing lock "refresh_cache-9e2043cc-ff4e-43e9-9867-920de4809cc4" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 16:06:51 user nova-compute[75337]: DEBUG nova.compute.manager [req-39fb1558-afab-43c6-adae-1374e2d27f2a req-07b6b28e-d2bd-4b82-8e6d-1d4e38004e9b service nova] [instance: d6eaef86-b841-4142-9549-31954fb34fa2] Received event network-vif-unplugged-99bb43c1-3b95-4be2-a534-845c37778773 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:06:51 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-39fb1558-afab-43c6-adae-1374e2d27f2a req-07b6b28e-d2bd-4b82-8e6d-1d4e38004e9b service nova] Acquiring lock "d6eaef86-b841-4142-9549-31954fb34fa2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:06:51 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-39fb1558-afab-43c6-adae-1374e2d27f2a req-07b6b28e-d2bd-4b82-8e6d-1d4e38004e9b service nova] Lock "d6eaef86-b841-4142-9549-31954fb34fa2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:06:51 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-39fb1558-afab-43c6-adae-1374e2d27f2a req-07b6b28e-d2bd-4b82-8e6d-1d4e38004e9b service nova] Lock "d6eaef86-b841-4142-9549-31954fb34fa2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:06:51 user nova-compute[75337]: DEBUG nova.compute.manager [req-39fb1558-afab-43c6-adae-1374e2d27f2a req-07b6b28e-d2bd-4b82-8e6d-1d4e38004e9b service nova] [instance: d6eaef86-b841-4142-9549-31954fb34fa2] No waiting events found dispatching network-vif-unplugged-99bb43c1-3b95-4be2-a534-845c37778773 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 16:06:51 user nova-compute[75337]: WARNING nova.compute.manager [req-39fb1558-afab-43c6-adae-1374e2d27f2a req-07b6b28e-d2bd-4b82-8e6d-1d4e38004e9b service nova] [instance: d6eaef86-b841-4142-9549-31954fb34fa2] Received unexpected event network-vif-unplugged-99bb43c1-3b95-4be2-a534-845c37778773 for instance with vm_state active and task_state resize_migrating.
Nov 06 16:06:52 user nova-compute[75337]: DEBUG nova.compute.manager [req-f355b9af-2d78-4baf-b80b-2d927fcd2631 req-12d39203-cedf-4878-b7e7-263f34a95930 service nova] [instance: d6eaef86-b841-4142-9549-31954fb34fa2] Received event network-vif-plugged-99bb43c1-3b95-4be2-a534-845c37778773 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:06:52 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-f355b9af-2d78-4baf-b80b-2d927fcd2631 req-12d39203-cedf-4878-b7e7-263f34a95930 service nova] Acquiring lock "d6eaef86-b841-4142-9549-31954fb34fa2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:06:52 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-f355b9af-2d78-4baf-b80b-2d927fcd2631 req-12d39203-cedf-4878-b7e7-263f34a95930 service nova] Lock "d6eaef86-b841-4142-9549-31954fb34fa2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:06:52 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-f355b9af-2d78-4baf-b80b-2d927fcd2631 req-12d39203-cedf-4878-b7e7-263f34a95930 service nova] Lock "d6eaef86-b841-4142-9549-31954fb34fa2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:06:52 user nova-compute[75337]: DEBUG nova.compute.manager [req-f355b9af-2d78-4baf-b80b-2d927fcd2631 req-12d39203-cedf-4878-b7e7-263f34a95930 service nova] [instance: d6eaef86-b841-4142-9549-31954fb34fa2] No waiting events found dispatching network-vif-plugged-99bb43c1-3b95-4be2-a534-845c37778773 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 16:06:52 user nova-compute[75337]: WARNING nova.compute.manager [req-f355b9af-2d78-4baf-b80b-2d927fcd2631 req-12d39203-cedf-4878-b7e7-263f34a95930 service nova] [instance: d6eaef86-b841-4142-9549-31954fb34fa2] Received unexpected event network-vif-plugged-99bb43c1-3b95-4be2-a534-845c37778773 for instance with vm_state active and task_state resize_migrating.
Nov 06 16:06:52 user nova-compute[75337]: DEBUG nova.compute.manager [req-f355b9af-2d78-4baf-b80b-2d927fcd2631 req-12d39203-cedf-4878-b7e7-263f34a95930 service nova] [instance: d6eaef86-b841-4142-9549-31954fb34fa2] Received event network-vif-plugged-99bb43c1-3b95-4be2-a534-845c37778773 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:06:52 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-f355b9af-2d78-4baf-b80b-2d927fcd2631 req-12d39203-cedf-4878-b7e7-263f34a95930 service nova] Acquiring lock "d6eaef86-b841-4142-9549-31954fb34fa2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:06:52 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-f355b9af-2d78-4baf-b80b-2d927fcd2631 req-12d39203-cedf-4878-b7e7-263f34a95930 service nova] Lock "d6eaef86-b841-4142-9549-31954fb34fa2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:06:52 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-f355b9af-2d78-4baf-b80b-2d927fcd2631 req-12d39203-cedf-4878-b7e7-263f34a95930 service nova] Lock "d6eaef86-b841-4142-9549-31954fb34fa2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:06:52 user nova-compute[75337]: DEBUG nova.compute.manager [req-f355b9af-2d78-4baf-b80b-2d927fcd2631 req-12d39203-cedf-4878-b7e7-263f34a95930 service nova] [instance: d6eaef86-b841-4142-9549-31954fb34fa2] No waiting events found dispatching network-vif-plugged-99bb43c1-3b95-4be2-a534-845c37778773 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 16:06:52 user nova-compute[75337]: WARNING nova.compute.manager [req-f355b9af-2d78-4baf-b80b-2d927fcd2631 req-12d39203-cedf-4878-b7e7-263f34a95930 service nova] [instance: d6eaef86-b841-4142-9549-31954fb34fa2] Received unexpected event network-vif-plugged-99bb43c1-3b95-4be2-a534-845c37778773 for instance with vm_state active and task_state resize_migrating.
Nov 06 16:06:52 user nova-compute[75337]: DEBUG nova.compute.manager [req-f355b9af-2d78-4baf-b80b-2d927fcd2631 req-12d39203-cedf-4878-b7e7-263f34a95930 service nova] [instance: d6eaef86-b841-4142-9549-31954fb34fa2] Received event network-vif-plugged-99bb43c1-3b95-4be2-a534-845c37778773 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:06:52 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-f355b9af-2d78-4baf-b80b-2d927fcd2631 req-12d39203-cedf-4878-b7e7-263f34a95930 service nova] Acquiring lock "d6eaef86-b841-4142-9549-31954fb34fa2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:06:52 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-f355b9af-2d78-4baf-b80b-2d927fcd2631 req-12d39203-cedf-4878-b7e7-263f34a95930 service nova] Lock "d6eaef86-b841-4142-9549-31954fb34fa2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:06:52 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-f355b9af-2d78-4baf-b80b-2d927fcd2631 req-12d39203-cedf-4878-b7e7-263f34a95930 service nova] Lock "d6eaef86-b841-4142-9549-31954fb34fa2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:06:52 user nova-compute[75337]: DEBUG nova.compute.manager [req-f355b9af-2d78-4baf-b80b-2d927fcd2631 req-12d39203-cedf-4878-b7e7-263f34a95930 service nova] [instance: d6eaef86-b841-4142-9549-31954fb34fa2] No waiting events found dispatching network-vif-plugged-99bb43c1-3b95-4be2-a534-845c37778773 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 16:06:52 user nova-compute[75337]: WARNING nova.compute.manager [req-f355b9af-2d78-4baf-b80b-2d927fcd2631 req-12d39203-cedf-4878-b7e7-263f34a95930 service nova] [instance: d6eaef86-b841-4142-9549-31954fb34fa2] Received unexpected event network-vif-plugged-99bb43c1-3b95-4be2-a534-845c37778773 for instance with vm_state active and task_state resize_migrating.
Nov 06 16:06:52 user nova-compute[75337]: DEBUG nova.compute.manager [req-f355b9af-2d78-4baf-b80b-2d927fcd2631 req-12d39203-cedf-4878-b7e7-263f34a95930 service nova] [instance: d6eaef86-b841-4142-9549-31954fb34fa2] Received event network-vif-unplugged-99bb43c1-3b95-4be2-a534-845c37778773 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:06:52 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-f355b9af-2d78-4baf-b80b-2d927fcd2631 req-12d39203-cedf-4878-b7e7-263f34a95930 service nova] Acquiring lock "d6eaef86-b841-4142-9549-31954fb34fa2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:06:52 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-f355b9af-2d78-4baf-b80b-2d927fcd2631 req-12d39203-cedf-4878-b7e7-263f34a95930 service nova] Lock "d6eaef86-b841-4142-9549-31954fb34fa2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:06:52 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-f355b9af-2d78-4baf-b80b-2d927fcd2631 req-12d39203-cedf-4878-b7e7-263f34a95930 service nova] Lock "d6eaef86-b841-4142-9549-31954fb34fa2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:06:52 user nova-compute[75337]: DEBUG nova.compute.manager [req-f355b9af-2d78-4baf-b80b-2d927fcd2631 req-12d39203-cedf-4878-b7e7-263f34a95930 service nova] [instance: d6eaef86-b841-4142-9549-31954fb34fa2] No waiting events found dispatching network-vif-unplugged-99bb43c1-3b95-4be2-a534-845c37778773 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 16:06:52 user nova-compute[75337]: WARNING nova.compute.manager [req-f355b9af-2d78-4baf-b80b-2d927fcd2631 req-12d39203-cedf-4878-b7e7-263f34a95930 service nova] [instance: d6eaef86-b841-4142-9549-31954fb34fa2] Received unexpected event network-vif-unplugged-99bb43c1-3b95-4be2-a534-845c37778773 for instance with vm_state active and task_state resize_migrating.
Nov 06 16:06:52 user nova-compute[75337]: DEBUG nova.compute.manager [req-f355b9af-2d78-4baf-b80b-2d927fcd2631 req-12d39203-cedf-4878-b7e7-263f34a95930 service nova] [instance: d6eaef86-b841-4142-9549-31954fb34fa2] Received event network-vif-plugged-99bb43c1-3b95-4be2-a534-845c37778773 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:06:52 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-f355b9af-2d78-4baf-b80b-2d927fcd2631 req-12d39203-cedf-4878-b7e7-263f34a95930 service nova] Acquiring lock "d6eaef86-b841-4142-9549-31954fb34fa2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:06:52 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-f355b9af-2d78-4baf-b80b-2d927fcd2631 req-12d39203-cedf-4878-b7e7-263f34a95930 service nova] Lock "d6eaef86-b841-4142-9549-31954fb34fa2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:06:52 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-f355b9af-2d78-4baf-b80b-2d927fcd2631 req-12d39203-cedf-4878-b7e7-263f34a95930 service nova] Lock "d6eaef86-b841-4142-9549-31954fb34fa2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:06:52 user nova-compute[75337]: DEBUG nova.compute.manager [req-f355b9af-2d78-4baf-b80b-2d927fcd2631 req-12d39203-cedf-4878-b7e7-263f34a95930 service nova] [instance: d6eaef86-b841-4142-9549-31954fb34fa2] No waiting events found dispatching network-vif-plugged-99bb43c1-3b95-4be2-a534-845c37778773 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 16:06:52 user nova-compute[75337]: WARNING nova.compute.manager [req-f355b9af-2d78-4baf-b80b-2d927fcd2631 req-12d39203-cedf-4878-b7e7-263f34a95930 service nova] [instance: d6eaef86-b841-4142-9549-31954fb34fa2] Received unexpected event network-vif-plugged-99bb43c1-3b95-4be2-a534-845c37778773 for instance with vm_state active and task_state resize_migrating.
Nov 06 16:06:54 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:06:55 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:06:59 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:07:00 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:07:00 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:07:04 user nova-compute[75337]: DEBUG nova.network.neutron [None req-e44d4b33-0b85-491f-8d42-9a35be2edcea tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: d6eaef86-b841-4142-9549-31954fb34fa2] Port 99bb43c1-3b95-4be2-a534-845c37778773 binding to destination host user is already ACTIVE {{(pid=75337) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 06 16:07:04 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-e44d4b33-0b85-491f-8d42-9a35be2edcea tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Acquiring lock "d6eaef86-b841-4142-9549-31954fb34fa2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:07:04 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-e44d4b33-0b85-491f-8d42-9a35be2edcea tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Lock "d6eaef86-b841-4142-9549-31954fb34fa2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:07:04 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-e44d4b33-0b85-491f-8d42-9a35be2edcea tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Lock "d6eaef86-b841-4142-9549-31954fb34fa2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:07:04 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-e44d4b33-0b85-491f-8d42-9a35be2edcea tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Acquiring lock "refresh_cache-d6eaef86-b841-4142-9549-31954fb34fa2" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 16:07:04 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-e44d4b33-0b85-491f-8d42-9a35be2edcea tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Acquired lock "refresh_cache-d6eaef86-b841-4142-9549-31954fb34fa2" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 16:07:04 user nova-compute[75337]: DEBUG nova.network.neutron [None req-e44d4b33-0b85-491f-8d42-9a35be2edcea tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: d6eaef86-b841-4142-9549-31954fb34fa2] Building network info cache for instance {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 16:07:04 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:07:04 user nova-compute[75337]: DEBUG nova.network.neutron [None req-e44d4b33-0b85-491f-8d42-9a35be2edcea tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: d6eaef86-b841-4142-9549-31954fb34fa2] Updating instance_info_cache with network_info: [{"id": "99bb43c1-3b95-4be2-a534-845c37778773", "address": "fa:16:3e:98:6e:e3", "network": {"id": "7f234ecf-bfa6-4316-9dce-c15050ba7914", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1378707892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "243647103fd44f629e0f40be0b56407e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99bb43c1-3b", "ovs_interfaceid": "99bb43c1-3b95-4be2-a534-845c37778773", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 16:07:04 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-e44d4b33-0b85-491f-8d42-9a35be2edcea tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Releasing lock "refresh_cache-d6eaef86-b841-4142-9549-31954fb34fa2" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 16:07:05 user nova-compute[75337]: DEBUG os_brick.utils [None req-e44d4b33-0b85-491f-8d42-9a35be2edcea tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 16:07:05 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:07:05 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:07:05 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[a09fb757-a03f-4ddb-913f-3212e9e580f8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4ff6411e45b8\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:07:05 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:07:05 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:07:05 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[f42aa1da-91e1-4994-96ce-ec6aeb4ad173]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:07:05 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:07:05 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:07:05 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a08006d-23ad-4572-b778-8c02d02bad65]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:07:05 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[9336e27e-57b7-4cbd-bc0f-f6f6194b6cf1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:07:05 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-e44d4b33-0b85-491f-8d42-9a35be2edcea tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Running cmd (subprocess): nvme version {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:07:05 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-e44d4b33-0b85-491f-8d42-9a35be2edcea tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] 'nvme version' failed. Not Retrying. {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 16:07:05 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e44d4b33-0b85-491f-8d42-9a35be2edcea tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] nvme not present on system {{(pid=75337) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 16:07:05 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:07:05 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 16:07:05 user nova-compute[75337]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 16:07:05 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[41342327-e3da-41de-b8a8-fe3a4d16c8fb]: (4, '') {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:07:05 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.lightos [None req-e44d4b33-0b85-491f-8d42-9a35be2edcea tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75337) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 16:07:05 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.lightos [None req-e44d4b33-0b85-491f-8d42-9a35be2edcea tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 16:07:05 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.lightos [None req-e44d4b33-0b85-491f-8d42-9a35be2edcea tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] LIGHTOS: no hostnqn found. {{(pid=75337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 16:07:05 user nova-compute[75337]: DEBUG os_brick.utils [None req-e44d4b33-0b85-491f-8d42-9a35be2edcea tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4ff6411e45b8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 16:07:05 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:07:09 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:07:10 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:07:11 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:07:14 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:07:14 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75337) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 16:07:14 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:07:15 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:07:15 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:07:16 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:07:16 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:07:18 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:07:19 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:07:20 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:07:20 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:07:21 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:07:22 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:07:24 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:07:25 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:07:25 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Starting heal instance info cache {{(pid=75337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 16:07:25 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "refresh_cache-01b61f9a-2591-4714-b18e-54f674a441ab" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 16:07:25 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquired lock "refresh_cache-01b61f9a-2591-4714-b18e-54f674a441ab" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 16:07:25 user nova-compute[75337]: DEBUG nova.network.neutron [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] [instance: 01b61f9a-2591-4714-b18e-54f674a441ab] Forcefully refreshing network info cache for instance {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 16:07:25 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:07:26 user nova-compute[75337]: DEBUG nova.network.neutron [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] [instance: 01b61f9a-2591-4714-b18e-54f674a441ab] Updating instance_info_cache with network_info: [{"id": "b5784ac8-0dc1-41ef-bb91-1e6b7d8a61fe", "address": "fa:16:3e:2c:49:a1", "network": {"id": "df5f1c2e-c934-4237-aee6-f070a198c4ac", "bridge": "br-int", "label": "tempest-TestStampPattern-1883369969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37b65a37b3ac4a92af0279d7ef3b9637", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5784ac8-0d", "ovs_interfaceid": "b5784ac8-0dc1-41ef-bb91-1e6b7d8a61fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 16:07:26 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Releasing lock "refresh_cache-01b61f9a-2591-4714-b18e-54f674a441ab" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 16:07:26 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] [instance: 01b61f9a-2591-4714-b18e-54f674a441ab] Updated the network info_cache for instance {{(pid=75337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 16:07:26 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager.update_available_resource {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:07:26 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:07:26 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:07:26 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:07:26 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Auditing locally available compute resources for user (node: user) {{(pid=75337) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 16:07:26 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9c98d28-41f9-498f-8c1f-43517999775a/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:07:26 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9c98d28-41f9-498f-8c1f-43517999775a/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:07:26 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9c98d28-41f9-498f-8c1f-43517999775a/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:07:27 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9c98d28-41f9-498f-8c1f-43517999775a/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:07:27 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01b61f9a-2591-4714-b18e-54f674a441ab/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:07:27 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01b61f9a-2591-4714-b18e-54f674a441ab/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:07:27 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01b61f9a-2591-4714-b18e-54f674a441ab/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:07:27 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01b61f9a-2591-4714-b18e-54f674a441ab/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:07:27 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 16:07:27 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6110b34a-6fd3-45fc-911d-4e5d3c7f2d78/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:07:27 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6110b34a-6fd3-45fc-911d-4e5d3c7f2d78/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:07:27 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6110b34a-6fd3-45fc-911d-4e5d3c7f2d78/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:07:27 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6110b34a-6fd3-45fc-911d-4e5d3c7f2d78/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:07:27 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e2043cc-ff4e-43e9-9867-920de4809cc4/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:07:27 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e2043cc-ff4e-43e9-9867-920de4809cc4/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:07:27 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e2043cc-ff4e-43e9-9867-920de4809cc4/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:07:28 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e2043cc-ff4e-43e9-9867-920de4809cc4/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:07:28 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88330c21-69e0-4d82-ac4d-b9e5e849f487/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:07:28 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88330c21-69e0-4d82-ac4d-b9e5e849f487/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:07:28 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88330c21-69e0-4d82-ac4d-b9e5e849f487/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:07:28 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88330c21-69e0-4d82-ac4d-b9e5e849f487/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:07:28 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 16:07:28 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 16:07:28 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Hypervisor/Node resource view: name=user free_ram=8167MB free_disk=24.907352447509766GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75337) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 16:07:28 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:07:28 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:07:29 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Applying migration context for instance d6eaef86-b841-4142-9549-31954fb34fa2 as it has an incoming, in-progress migration 9b362311-b7f0-4a00-b157-930adde8974f. Migration status is post-migrating {{(pid=75337) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 06 16:07:29 user nova-compute[75337]: INFO nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] [instance: d6eaef86-b841-4142-9549-31954fb34fa2] Updating resource usage from migration 9b362311-b7f0-4a00-b157-930adde8974f
Nov 06 16:07:29 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 6110b34a-6fd3-45fc-911d-4e5d3c7f2d78 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 16:07:29 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 01b61f9a-2591-4714-b18e-54f674a441ab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 16:07:29 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 9e2043cc-ff4e-43e9-9867-920de4809cc4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 16:07:29 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance f9c98d28-41f9-498f-8c1f-43517999775a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 16:07:29 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 88330c21-69e0-4d82-ac4d-b9e5e849f487 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 16:07:29 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Migration 9b362311-b7f0-4a00-b157-930adde8974f is active on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 06 16:07:29 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance d6eaef86-b841-4142-9549-31954fb34fa2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 16:07:29 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 16:07:29 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 16:07:29 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 16:07:29 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 16:07:29 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Compute_service record updated for user:user {{(pid=75337) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 16:07:29 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.367s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:07:30 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:07:34 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:07:35 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:07:40 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:07:43 user nova-compute[75337]: DEBUG nova.compute.manager [req-c65a36a3-3c96-4201-bd09-7dfa596aa1da req-1531b16f-2335-4839-a310-ffd2fafcf55f service nova] [instance: f9c98d28-41f9-498f-8c1f-43517999775a] Received event network-changed-65003741-14af-48d8-9ca6-0e075aab5008 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:07:43 user nova-compute[75337]: DEBUG nova.compute.manager [req-c65a36a3-3c96-4201-bd09-7dfa596aa1da req-1531b16f-2335-4839-a310-ffd2fafcf55f service nova] [instance: f9c98d28-41f9-498f-8c1f-43517999775a] Refreshing instance network info cache due to event network-changed-65003741-14af-48d8-9ca6-0e075aab5008. {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 16:07:43 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-c65a36a3-3c96-4201-bd09-7dfa596aa1da req-1531b16f-2335-4839-a310-ffd2fafcf55f service nova] Acquiring lock "refresh_cache-f9c98d28-41f9-498f-8c1f-43517999775a" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 16:07:43 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-c65a36a3-3c96-4201-bd09-7dfa596aa1da req-1531b16f-2335-4839-a310-ffd2fafcf55f service nova] Acquired lock "refresh_cache-f9c98d28-41f9-498f-8c1f-43517999775a" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 16:07:43 user nova-compute[75337]: DEBUG nova.network.neutron [req-c65a36a3-3c96-4201-bd09-7dfa596aa1da req-1531b16f-2335-4839-a310-ffd2fafcf55f service nova] [instance: f9c98d28-41f9-498f-8c1f-43517999775a] Refreshing network info cache for port 65003741-14af-48d8-9ca6-0e075aab5008 {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 16:07:44 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:07:44 user nova-compute[75337]: DEBUG nova.network.neutron [req-c65a36a3-3c96-4201-bd09-7dfa596aa1da req-1531b16f-2335-4839-a310-ffd2fafcf55f service nova] [instance: f9c98d28-41f9-498f-8c1f-43517999775a] Updated VIF entry in instance network info cache for port 65003741-14af-48d8-9ca6-0e075aab5008. {{(pid=75337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 16:07:44 user nova-compute[75337]: DEBUG nova.network.neutron [req-c65a36a3-3c96-4201-bd09-7dfa596aa1da req-1531b16f-2335-4839-a310-ffd2fafcf55f service nova] [instance: f9c98d28-41f9-498f-8c1f-43517999775a] Updating instance_info_cache with network_info: [{"id": "65003741-14af-48d8-9ca6-0e075aab5008", "address": "fa:16:3e:d6:6c:ea", "network": {"id": "8b217731-de9e-49bc-84bb-130fd42ede51", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-314618758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98fac9096a3b4f21ba805ba1437d9d38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65003741-14", "ovs_interfaceid": "65003741-14af-48d8-9ca6-0e075aab5008", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 16:07:45 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-c65a36a3-3c96-4201-bd09-7dfa596aa1da req-1531b16f-2335-4839-a310-ffd2fafcf55f service nova] Releasing lock "refresh_cache-f9c98d28-41f9-498f-8c1f-43517999775a" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 16:07:45 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:07:48 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-08b95f86-0f34-4e7c-92b7-951d48670345 tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] Acquiring lock "04bedc8f-088d-41c4-8cbf-c68602e916c6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:07:48 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-08b95f86-0f34-4e7c-92b7-951d48670345 tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] Lock "04bedc8f-088d-41c4-8cbf-c68602e916c6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:07:48 user nova-compute[75337]: DEBUG nova.compute.manager [None req-08b95f86-0f34-4e7c-92b7-951d48670345 tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] [instance: 04bedc8f-088d-41c4-8cbf-c68602e916c6] Starting instance... {{(pid=75337) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 16:07:48 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-08b95f86-0f34-4e7c-92b7-951d48670345 tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:07:48 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-08b95f86-0f34-4e7c-92b7-951d48670345 tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:07:48 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-08b95f86-0f34-4e7c-92b7-951d48670345 tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75337) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 16:07:48 user nova-compute[75337]: INFO nova.compute.claims [None req-08b95f86-0f34-4e7c-92b7-951d48670345 tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] [instance: 04bedc8f-088d-41c4-8cbf-c68602e916c6] Claim successful on node user
Nov 06 16:07:49 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-08b95f86-0f34-4e7c-92b7-951d48670345 tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 16:07:49 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-08b95f86-0f34-4e7c-92b7-951d48670345 tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 16:07:49 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-08b95f86-0f34-4e7c-92b7-951d48670345 tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.485s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:07:49 user nova-compute[75337]: DEBUG nova.compute.manager [None req-08b95f86-0f34-4e7c-92b7-951d48670345 tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] [instance: 04bedc8f-088d-41c4-8cbf-c68602e916c6] Start building networks asynchronously for instance. {{(pid=75337) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 16:07:49 user nova-compute[75337]: DEBUG nova.compute.manager [None req-08b95f86-0f34-4e7c-92b7-951d48670345 tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] [instance: 04bedc8f-088d-41c4-8cbf-c68602e916c6] Allocating IP information in the background. {{(pid=75337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 16:07:49 user nova-compute[75337]: DEBUG nova.network.neutron [None req-08b95f86-0f34-4e7c-92b7-951d48670345 tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] [instance: 04bedc8f-088d-41c4-8cbf-c68602e916c6] allocate_for_instance() {{(pid=75337) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 16:07:49 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-08b95f86-0f34-4e7c-92b7-951d48670345 tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] [instance: 04bedc8f-088d-41c4-8cbf-c68602e916c6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 16:07:49 user nova-compute[75337]: DEBUG nova.compute.manager [None req-08b95f86-0f34-4e7c-92b7-951d48670345 tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] [instance: 04bedc8f-088d-41c4-8cbf-c68602e916c6] Start building block device mappings for instance. {{(pid=75337) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 16:07:49 user nova-compute[75337]: DEBUG nova.policy [None req-08b95f86-0f34-4e7c-92b7-951d48670345 tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4e0147898e9b4af9aaaa3379f431303e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '888a739f27694bd5a56badca064a56b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75337) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 16:07:49 user nova-compute[75337]: DEBUG nova.compute.manager [None req-08b95f86-0f34-4e7c-92b7-951d48670345 tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] [instance: 04bedc8f-088d-41c4-8cbf-c68602e916c6] Start spawning the instance on the hypervisor. {{(pid=75337) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 16:07:49 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-08b95f86-0f34-4e7c-92b7-951d48670345 tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] [instance: 04bedc8f-088d-41c4-8cbf-c68602e916c6] Creating instance directory {{(pid=75337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 16:07:49 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-08b95f86-0f34-4e7c-92b7-951d48670345 tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] [instance: 04bedc8f-088d-41c4-8cbf-c68602e916c6] Creating image(s)
Nov 06 16:07:49 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-08b95f86-0f34-4e7c-92b7-951d48670345 tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] Acquiring lock "/opt/stack/data/nova/instances/04bedc8f-088d-41c4-8cbf-c68602e916c6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:07:49 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-08b95f86-0f34-4e7c-92b7-951d48670345 tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] Lock "/opt/stack/data/nova/instances/04bedc8f-088d-41c4-8cbf-c68602e916c6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:07:49 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-08b95f86-0f34-4e7c-92b7-951d48670345 tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] Lock "/opt/stack/data/nova/instances/04bedc8f-088d-41c4-8cbf-c68602e916c6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:07:49 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-08b95f86-0f34-4e7c-92b7-951d48670345 tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:07:49 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:07:49 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-08b95f86-0f34-4e7c-92b7-951d48670345 tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json" returned: 0 in 0.208s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:07:49 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-08b95f86-0f34-4e7c-92b7-951d48670345 tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] Acquiring lock "06ba3c914798499e686c5ac75886932347225275" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:07:49 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-08b95f86-0f34-4e7c-92b7-951d48670345 tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] Lock "06ba3c914798499e686c5ac75886932347225275" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:07:49 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-08b95f86-0f34-4e7c-92b7-951d48670345 tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:07:50 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-08b95f86-0f34-4e7c-92b7-951d48670345 tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json" returned: 0 in 0.199s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:07:50 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-08b95f86-0f34-4e7c-92b7-951d48670345 tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275,backing_fmt=raw /opt/stack/data/nova/instances/04bedc8f-088d-41c4-8cbf-c68602e916c6/disk 1073741824 {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:07:50 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-08b95f86-0f34-4e7c-92b7-951d48670345 tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275,backing_fmt=raw /opt/stack/data/nova/instances/04bedc8f-088d-41c4-8cbf-c68602e916c6/disk 1073741824" returned: 0 in 0.061s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:07:50 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-08b95f86-0f34-4e7c-92b7-951d48670345 tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] Lock "06ba3c914798499e686c5ac75886932347225275" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.269s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:07:50 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-08b95f86-0f34-4e7c-92b7-951d48670345 tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:07:50 user nova-compute[75337]: DEBUG nova.network.neutron [None req-08b95f86-0f34-4e7c-92b7-951d48670345 tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] [instance: 04bedc8f-088d-41c4-8cbf-c68602e916c6] Successfully created port: ebfae3b1-c97c-400b-bcb8-74b0c998eae6 {{(pid=75337) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 16:07:50 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-08b95f86-0f34-4e7c-92b7-951d48670345 tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json" returned: 0 in 0.227s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:07:50 user nova-compute[75337]: DEBUG nova.virt.disk.api [None req-08b95f86-0f34-4e7c-92b7-951d48670345 tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] Checking if we can resize image /opt/stack/data/nova/instances/04bedc8f-088d-41c4-8cbf-c68602e916c6/disk. size=1073741824 {{(pid=75337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 16:07:50 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-08b95f86-0f34-4e7c-92b7-951d48670345 tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04bedc8f-088d-41c4-8cbf-c68602e916c6/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:07:50 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:07:50 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-08b95f86-0f34-4e7c-92b7-951d48670345 tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04bedc8f-088d-41c4-8cbf-c68602e916c6/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:07:50 user nova-compute[75337]: DEBUG nova.virt.disk.api [None req-08b95f86-0f34-4e7c-92b7-951d48670345 tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] Cannot resize image /opt/stack/data/nova/instances/04bedc8f-088d-41c4-8cbf-c68602e916c6/disk to a smaller size. {{(pid=75337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 06 16:07:50 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-08b95f86-0f34-4e7c-92b7-951d48670345 tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] [instance: 04bedc8f-088d-41c4-8cbf-c68602e916c6] Created local disks {{(pid=75337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 16:07:50 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-08b95f86-0f34-4e7c-92b7-951d48670345 tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] [instance: 04bedc8f-088d-41c4-8cbf-c68602e916c6] Ensure instance console log exists: /opt/stack/data/nova/instances/04bedc8f-088d-41c4-8cbf-c68602e916c6/console.log {{(pid=75337) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 16:07:50 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-08b95f86-0f34-4e7c-92b7-951d48670345 tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:07:50 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-08b95f86-0f34-4e7c-92b7-951d48670345 tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:07:50 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-08b95f86-0f34-4e7c-92b7-951d48670345 tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:07:50 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-26728e3b-9ac9-43f6-82b6-740c1ddb393c tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Acquiring lock "f9c98d28-41f9-498f-8c1f-43517999775a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:07:50 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-26728e3b-9ac9-43f6-82b6-740c1ddb393c tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Lock "f9c98d28-41f9-498f-8c1f-43517999775a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:07:50 user nova-compute[75337]: DEBUG nova.objects.instance [None req-26728e3b-9ac9-43f6-82b6-740c1ddb393c tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Lazy-loading 'flavor' on Instance uuid f9c98d28-41f9-498f-8c1f-43517999775a {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 16:07:50 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-26728e3b-9ac9-43f6-82b6-740c1ddb393c tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Lock "f9c98d28-41f9-498f-8c1f-43517999775a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.070s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:07:51 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-26728e3b-9ac9-43f6-82b6-740c1ddb393c tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Acquiring lock "f9c98d28-41f9-498f-8c1f-43517999775a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:07:51 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-26728e3b-9ac9-43f6-82b6-740c1ddb393c tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Lock "f9c98d28-41f9-498f-8c1f-43517999775a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:07:51 user nova-compute[75337]: INFO nova.compute.manager [None req-26728e3b-9ac9-43f6-82b6-740c1ddb393c tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] [instance: f9c98d28-41f9-498f-8c1f-43517999775a] Attaching volume 81b76252-f172-4a13-954b-87087c5eb447 to /dev/vdb
Nov 06 16:07:51 user nova-compute[75337]: DEBUG nova.network.neutron [None req-08b95f86-0f34-4e7c-92b7-951d48670345 tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] [instance: 04bedc8f-088d-41c4-8cbf-c68602e916c6] Successfully updated port: ebfae3b1-c97c-400b-bcb8-74b0c998eae6 {{(pid=75337) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 16:07:51 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-08b95f86-0f34-4e7c-92b7-951d48670345 tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] Acquiring lock "refresh_cache-04bedc8f-088d-41c4-8cbf-c68602e916c6" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 16:07:51 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-08b95f86-0f34-4e7c-92b7-951d48670345 tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] Acquired lock "refresh_cache-04bedc8f-088d-41c4-8cbf-c68602e916c6" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 16:07:51 user nova-compute[75337]: DEBUG nova.network.neutron [None req-08b95f86-0f34-4e7c-92b7-951d48670345 tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] [instance: 04bedc8f-088d-41c4-8cbf-c68602e916c6] Building network info cache for instance {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 16:07:51 user nova-compute[75337]: DEBUG nova.compute.manager [req-e24adebd-922f-4ea6-9ed6-69db86832e67 req-236e5eb2-6d7d-420f-835b-e31f5f5b8a48 service nova] [instance: 04bedc8f-088d-41c4-8cbf-c68602e916c6] Received event network-changed-ebfae3b1-c97c-400b-bcb8-74b0c998eae6 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:07:51 user nova-compute[75337]: DEBUG nova.compute.manager [req-e24adebd-922f-4ea6-9ed6-69db86832e67 req-236e5eb2-6d7d-420f-835b-e31f5f5b8a48 service nova] [instance: 04bedc8f-088d-41c4-8cbf-c68602e916c6] Refreshing instance network info cache due to event network-changed-ebfae3b1-c97c-400b-bcb8-74b0c998eae6. {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 16:07:51 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-e24adebd-922f-4ea6-9ed6-69db86832e67 req-236e5eb2-6d7d-420f-835b-e31f5f5b8a48 service nova] Acquiring lock "refresh_cache-04bedc8f-088d-41c4-8cbf-c68602e916c6" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 16:07:51 user nova-compute[75337]: DEBUG os_brick.utils [None req-26728e3b-9ac9-43f6-82b6-740c1ddb393c tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 16:07:51 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:07:51 user nova-compute[75337]: DEBUG nova.network.neutron [None req-08b95f86-0f34-4e7c-92b7-951d48670345 tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] [instance: 04bedc8f-088d-41c4-8cbf-c68602e916c6] Instance cache missing network info. {{(pid=75337) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 16:07:51 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:07:51 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[3212609f-e97a-4909-a8ff-5c7cefaed500]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4ff6411e45b8\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:07:51 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:07:51 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:07:51 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[695c66cc-a98d-495b-a569-081c382b24df]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:07:51 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:07:51 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:07:51 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[e86a284f-70f7-4dac-995b-259354f8e78f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:07:51 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[64e484ea-2180-4618-81b7-ab3f6f3fb215]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:07:51 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-26728e3b-9ac9-43f6-82b6-740c1ddb393c tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Running cmd (subprocess): nvme version {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:07:51 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-26728e3b-9ac9-43f6-82b6-740c1ddb393c tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] 'nvme version' failed. Not Retrying. {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 16:07:51 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.nvmeof [None req-26728e3b-9ac9-43f6-82b6-740c1ddb393c tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] nvme not present on system {{(pid=75337) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 16:07:51 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:07:51 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 16:07:51 user nova-compute[75337]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 16:07:51 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaf4ddcf-1b12-426c-8216-595be0941866]: (4, '') {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:07:51 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.lightos [None req-26728e3b-9ac9-43f6-82b6-740c1ddb393c tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75337) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 16:07:51 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.lightos [None req-26728e3b-9ac9-43f6-82b6-740c1ddb393c tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 16:07:51 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.lightos [None req-26728e3b-9ac9-43f6-82b6-740c1ddb393c tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] LIGHTOS: no hostnqn found. {{(pid=75337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 16:07:51 user nova-compute[75337]: DEBUG os_brick.utils [None req-26728e3b-9ac9-43f6-82b6-740c1ddb393c tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4ff6411e45b8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 16:07:51 user nova-compute[75337]: DEBUG nova.virt.block_device [None req-26728e3b-9ac9-43f6-82b6-740c1ddb393c tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] [instance: f9c98d28-41f9-498f-8c1f-43517999775a] Updating existing volume attachment record: 92b8b140-44ee-44a7-acba-bf87da9acf60 {{(pid=75337) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 16:07:51 user nova-compute[75337]: DEBUG nova.network.neutron [None req-08b95f86-0f34-4e7c-92b7-951d48670345 tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] [instance: 04bedc8f-088d-41c4-8cbf-c68602e916c6] Updating instance_info_cache with network_info: [{"id": "ebfae3b1-c97c-400b-bcb8-74b0c998eae6", "address": "fa:16:3e:4c:57:9e", "network": {"id": "6b7d7f72-e0a2-49a1-a1d8-927c62316dd2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-716305394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "888a739f27694bd5a56badca064a56b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebfae3b1-c9", "ovs_interfaceid": "ebfae3b1-c97c-400b-bcb8-74b0c998eae6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 16:07:51 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-08b95f86-0f34-4e7c-92b7-951d48670345 tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] Releasing lock "refresh_cache-04bedc8f-088d-41c4-8cbf-c68602e916c6" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 16:07:51 user nova-compute[75337]: DEBUG nova.compute.manager [None req-08b95f86-0f34-4e7c-92b7-951d48670345 tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] [instance: 04bedc8f-088d-41c4-8cbf-c68602e916c6] Instance network_info: |[{"id": "ebfae3b1-c97c-400b-bcb8-74b0c998eae6", "address": "fa:16:3e:4c:57:9e", "network": {"id": "6b7d7f72-e0a2-49a1-a1d8-927c62316dd2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-716305394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "888a739f27694bd5a56badca064a56b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebfae3b1-c9", "ovs_interfaceid": "ebfae3b1-c97c-400b-bcb8-74b0c998eae6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 16:07:51 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-e24adebd-922f-4ea6-9ed6-69db86832e67 req-236e5eb2-6d7d-420f-835b-e31f5f5b8a48 service nova] Acquired lock "refresh_cache-04bedc8f-088d-41c4-8cbf-c68602e916c6" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 16:07:51 user nova-compute[75337]: DEBUG nova.network.neutron [req-e24adebd-922f-4ea6-9ed6-69db86832e67 req-236e5eb2-6d7d-420f-835b-e31f5f5b8a48 service nova] [instance: 04bedc8f-088d-41c4-8cbf-c68602e916c6] Refreshing network info cache for port ebfae3b1-c97c-400b-bcb8-74b0c998eae6 {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 16:07:51 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-08b95f86-0f34-4e7c-92b7-951d48670345 tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] [instance: 04bedc8f-088d-41c4-8cbf-c68602e916c6] Start _get_guest_xml network_info=[{"id": "ebfae3b1-c97c-400b-bcb8-74b0c998eae6", "address": "fa:16:3e:4c:57:9e", "network": {"id": "6b7d7f72-e0a2-49a1-a1d8-927c62316dd2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-716305394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "888a739f27694bd5a56badca064a56b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebfae3b1-c9", "ovs_interfaceid": "ebfae3b1-c97c-400b-bcb8-74b0c998eae6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T15:34:14Z,direct_url=<?>,disk_format='qcow2',id=16b903ae-a40f-41a7-985b-4804cce92c62,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6549a15819f1469bbd5eeae8190e3d44',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T15:34:15Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'guest_format': None, 'size': 0, 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '16b903ae-a40f-41a7-985b-4804cce92c62'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 16:07:51 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-08b95f86-0f34-4e7c-92b7-951d48670345 tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 16:07:51 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-08b95f86-0f34-4e7c-92b7-951d48670345 tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 16:07:51 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-08b95f86-0f34-4e7c-92b7-951d48670345 tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 16:07:51 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-08b95f86-0f34-4e7c-92b7-951d48670345 tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] CPU controller missing on host. {{(pid=75337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 16:07:51 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-08b95f86-0f34-4e7c-92b7-951d48670345 tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 16:07:51 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-08b95f86-0f34-4e7c-92b7-951d48670345 tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] CPU controller found on host. {{(pid=75337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 16:07:51 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-08b95f86-0f34-4e7c-92b7-951d48670345 tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75337) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 16:07:51 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-08b95f86-0f34-4e7c-92b7-951d48670345 tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T15:34:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T15:34:14Z,direct_url=<?>,disk_format='qcow2',id=16b903ae-a40f-41a7-985b-4804cce92c62,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6549a15819f1469bbd5eeae8190e3d44',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T15:34:15Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 16:07:51 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-08b95f86-0f34-4e7c-92b7-951d48670345 tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] Flavor limits 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 16:07:51 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-08b95f86-0f34-4e7c-92b7-951d48670345 tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] Image limits 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 16:07:51 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-08b95f86-0f34-4e7c-92b7-951d48670345 tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] Flavor pref 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 16:07:51 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-08b95f86-0f34-4e7c-92b7-951d48670345 tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] Image pref 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 16:07:51 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-08b95f86-0f34-4e7c-92b7-951d48670345 tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 16:07:51 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-08b95f86-0f34-4e7c-92b7-951d48670345 tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 16:07:51 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-08b95f86-0f34-4e7c-92b7-951d48670345 tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 16:07:51 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-08b95f86-0f34-4e7c-92b7-951d48670345 tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] Got 1 possible topologies {{(pid=75337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 16:07:51 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-08b95f86-0f34-4e7c-92b7-951d48670345 tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 16:07:51 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-08b95f86-0f34-4e7c-92b7-951d48670345 tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 16:07:51 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-08b95f86-0f34-4e7c-92b7-951d48670345 tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T16:07:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-469045642',display_name='tempest-VolumesActionsTest-instance-469045642',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-469045642',id=46,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='888a739f27694bd5a56badca064a56b4',ramdisk_id='',reservation_id='r-wxzg1jio',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1546215062',owner_user_name='tempest-VolumesActionsTest-1546215062-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T16:07:50Z,user_data=None,user_id='4e0147898e9b4af9aaaa3379f431303e',uuid=04bedc8f-088d-41c4-8cbf-c68602e916c6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ebfae3b1-c97c-400b-bcb8-74b0c998eae6", "address": "fa:16:3e:4c:57:9e", "network": {"id": "6b7d7f72-e0a2-49a1-a1d8-927c62316dd2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-716305394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "888a739f27694bd5a56badca064a56b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebfae3b1-c9", "ovs_interfaceid": "ebfae3b1-c97c-400b-bcb8-74b0c998eae6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75337) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 16:07:51 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-08b95f86-0f34-4e7c-92b7-951d48670345 tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] Converting VIF {"id": "ebfae3b1-c97c-400b-bcb8-74b0c998eae6", "address": "fa:16:3e:4c:57:9e", "network": {"id": "6b7d7f72-e0a2-49a1-a1d8-927c62316dd2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-716305394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "888a739f27694bd5a56badca064a56b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebfae3b1-c9", "ovs_interfaceid": "ebfae3b1-c97c-400b-bcb8-74b0c998eae6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 16:07:51 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-08b95f86-0f34-4e7c-92b7-951d48670345 tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:57:9e,bridge_name='br-int',has_traffic_filtering=True,id=ebfae3b1-c97c-400b-bcb8-74b0c998eae6,network=Network(6b7d7f72-e0a2-49a1-a1d8-927c62316dd2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebfae3b1-c9') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 16:07:51 user nova-compute[75337]: DEBUG nova.objects.instance [None req-08b95f86-0f34-4e7c-92b7-951d48670345 tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] Lazy-loading 'pci_devices' on Instance uuid 04bedc8f-088d-41c4-8cbf-c68602e916c6 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 16:07:51 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-08b95f86-0f34-4e7c-92b7-951d48670345 tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] [instance: 04bedc8f-088d-41c4-8cbf-c68602e916c6] End _get_guest_xml xml=<domain type="kvm">
Nov 06 16:07:51 user nova-compute[75337]:   <uuid>04bedc8f-088d-41c4-8cbf-c68602e916c6</uuid>
Nov 06 16:07:51 user nova-compute[75337]:   <name>instance-0000002e</name>
Nov 06 16:07:51 user nova-compute[75337]:   <memory>524288</memory>
Nov 06 16:07:51 user nova-compute[75337]:   <vcpu>1</vcpu>
Nov 06 16:07:51 user nova-compute[75337]:   <metadata>
Nov 06 16:07:51 user nova-compute[75337]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 16:07:51 user nova-compute[75337]:       <nova:package version="0.0.0"/>
Nov 06 16:07:51 user nova-compute[75337]:       <nova:name>tempest-VolumesActionsTest-instance-469045642</nova:name>
Nov 06 16:07:51 user nova-compute[75337]:       <nova:creationTime>2023-11-06 16:07:51</nova:creationTime>
Nov 06 16:07:51 user nova-compute[75337]:       <nova:flavor name="m1.tiny">
Nov 06 16:07:51 user nova-compute[75337]:         <nova:memory>512</nova:memory>
Nov 06 16:07:51 user nova-compute[75337]:         <nova:disk>1</nova:disk>
Nov 06 16:07:51 user nova-compute[75337]:         <nova:swap>0</nova:swap>
Nov 06 16:07:51 user nova-compute[75337]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 16:07:51 user nova-compute[75337]:         <nova:vcpus>1</nova:vcpus>
Nov 06 16:07:51 user nova-compute[75337]:       </nova:flavor>
Nov 06 16:07:51 user nova-compute[75337]:       <nova:owner>
Nov 06 16:07:51 user nova-compute[75337]:         <nova:user uuid="4e0147898e9b4af9aaaa3379f431303e">tempest-VolumesActionsTest-1546215062-project-member</nova:user>
Nov 06 16:07:51 user nova-compute[75337]:         <nova:project uuid="888a739f27694bd5a56badca064a56b4">tempest-VolumesActionsTest-1546215062</nova:project>
Nov 06 16:07:51 user nova-compute[75337]:       </nova:owner>
Nov 06 16:07:51 user nova-compute[75337]:       <nova:root type="image" uuid="16b903ae-a40f-41a7-985b-4804cce92c62"/>
Nov 06 16:07:51 user nova-compute[75337]:       <nova:ports>
Nov 06 16:07:51 user nova-compute[75337]:         <nova:port uuid="ebfae3b1-c97c-400b-bcb8-74b0c998eae6">
Nov 06 16:07:51 user nova-compute[75337]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 06 16:07:51 user nova-compute[75337]:         </nova:port>
Nov 06 16:07:51 user nova-compute[75337]:       </nova:ports>
Nov 06 16:07:51 user nova-compute[75337]:     </nova:instance>
Nov 06 16:07:51 user nova-compute[75337]:   </metadata>
Nov 06 16:07:51 user nova-compute[75337]:   <sysinfo type="smbios">
Nov 06 16:07:51 user nova-compute[75337]:     <system>
Nov 06 16:07:51 user nova-compute[75337]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 16:07:51 user nova-compute[75337]:       <entry name="product">OpenStack Nova</entry>
Nov 06 16:07:51 user nova-compute[75337]:       <entry name="version">0.0.0</entry>
Nov 06 16:07:51 user nova-compute[75337]:       <entry name="serial">04bedc8f-088d-41c4-8cbf-c68602e916c6</entry>
Nov 06 16:07:51 user nova-compute[75337]:       <entry name="uuid">04bedc8f-088d-41c4-8cbf-c68602e916c6</entry>
Nov 06 16:07:51 user nova-compute[75337]:       <entry name="family">Virtual Machine</entry>
Nov 06 16:07:51 user nova-compute[75337]:     </system>
Nov 06 16:07:51 user nova-compute[75337]:   </sysinfo>
Nov 06 16:07:51 user nova-compute[75337]:   <os>
Nov 06 16:07:51 user nova-compute[75337]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 16:07:51 user nova-compute[75337]:     <boot dev="hd"/>
Nov 06 16:07:51 user nova-compute[75337]:     <smbios mode="sysinfo"/>
Nov 06 16:07:51 user nova-compute[75337]:   </os>
Nov 06 16:07:51 user nova-compute[75337]:   <features>
Nov 06 16:07:51 user nova-compute[75337]:     <acpi/>
Nov 06 16:07:51 user nova-compute[75337]:     <apic/>
Nov 06 16:07:51 user nova-compute[75337]:     <vmcoreinfo/>
Nov 06 16:07:51 user nova-compute[75337]:   </features>
Nov 06 16:07:51 user nova-compute[75337]:   <clock offset="utc">
Nov 06 16:07:51 user nova-compute[75337]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 16:07:51 user nova-compute[75337]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 16:07:51 user nova-compute[75337]:     <timer name="hpet" present="no"/>
Nov 06 16:07:51 user nova-compute[75337]:   </clock>
Nov 06 16:07:51 user nova-compute[75337]:   <cpu mode="custom" match="exact">
Nov 06 16:07:51 user nova-compute[75337]:     <model>Nehalem</model>
Nov 06 16:07:51 user nova-compute[75337]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 16:07:51 user nova-compute[75337]:   </cpu>
Nov 06 16:07:51 user nova-compute[75337]:   <devices>
Nov 06 16:07:51 user nova-compute[75337]:     <disk type="file" device="disk">
Nov 06 16:07:51 user nova-compute[75337]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 16:07:51 user nova-compute[75337]:       <source file="/opt/stack/data/nova/instances/04bedc8f-088d-41c4-8cbf-c68602e916c6/disk"/>
Nov 06 16:07:51 user nova-compute[75337]:       <target dev="vda" bus="virtio"/>
Nov 06 16:07:51 user nova-compute[75337]:     </disk>
Nov 06 16:07:51 user nova-compute[75337]:     <interface type="ethernet">
Nov 06 16:07:51 user nova-compute[75337]:       <mac address="fa:16:3e:4c:57:9e"/>
Nov 06 16:07:51 user nova-compute[75337]:       <model type="virtio"/>
Nov 06 16:07:51 user nova-compute[75337]:       <mtu size="1442"/>
Nov 06 16:07:51 user nova-compute[75337]:       <target dev="tapebfae3b1-c9"/>
Nov 06 16:07:51 user nova-compute[75337]:     </interface>
Nov 06 16:07:51 user nova-compute[75337]:     <serial type="pty">
Nov 06 16:07:51 user nova-compute[75337]:       <log file="/opt/stack/data/nova/instances/04bedc8f-088d-41c4-8cbf-c68602e916c6/console.log" append="off"/>
Nov 06 16:07:51 user nova-compute[75337]:     </serial>
Nov 06 16:07:51 user nova-compute[75337]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 16:07:51 user nova-compute[75337]:     <video>
Nov 06 16:07:51 user nova-compute[75337]:       <model type="virtio"/>
Nov 06 16:07:51 user nova-compute[75337]:     </video>
Nov 06 16:07:51 user nova-compute[75337]:     <rng model="virtio">
Nov 06 16:07:51 user nova-compute[75337]:       <backend model="random">/dev/urandom</backend>
Nov 06 16:07:51 user nova-compute[75337]:     </rng>
Nov 06 16:07:51 user nova-compute[75337]:     <controller type="usb" index="0" model="none"/>
Nov 06 16:07:51 user nova-compute[75337]:     <memballoon model="virtio">
Nov 06 16:07:51 user nova-compute[75337]:       <stats period="10"/>
Nov 06 16:07:51 user nova-compute[75337]:     </memballoon>
Nov 06 16:07:51 user nova-compute[75337]:   </devices>
Nov 06 16:07:51 user nova-compute[75337]: </domain>
Nov 06 16:07:51 user nova-compute[75337]:  {{(pid=75337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 16:07:51 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-08b95f86-0f34-4e7c-92b7-951d48670345 tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T16:07:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-469045642',display_name='tempest-VolumesActionsTest-instance-469045642',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-469045642',id=46,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='888a739f27694bd5a56badca064a56b4',ramdisk_id='',reservation_id='r-wxzg1jio',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1546215062',owner_user_name='tempest-VolumesActionsTest-1546215062-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T16:07:50Z,user_data=None,user_id='4e0147898e9b4af9aaaa3379f431303e',uuid=04bedc8f-088d-41c4-8cbf-c68602e916c6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ebfae3b1-c97c-400b-bcb8-74b0c998eae6", "address": "fa:16:3e:4c:57:9e", "network": {"id": "6b7d7f72-e0a2-49a1-a1d8-927c62316dd2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-716305394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "888a739f27694bd5a56badca064a56b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebfae3b1-c9", "ovs_interfaceid": "ebfae3b1-c97c-400b-bcb8-74b0c998eae6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 16:07:51 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-08b95f86-0f34-4e7c-92b7-951d48670345 tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] Converting VIF {"id": "ebfae3b1-c97c-400b-bcb8-74b0c998eae6", "address": "fa:16:3e:4c:57:9e", "network": {"id": "6b7d7f72-e0a2-49a1-a1d8-927c62316dd2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-716305394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "888a739f27694bd5a56badca064a56b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebfae3b1-c9", "ovs_interfaceid": "ebfae3b1-c97c-400b-bcb8-74b0c998eae6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 16:07:51 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-08b95f86-0f34-4e7c-92b7-951d48670345 tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:57:9e,bridge_name='br-int',has_traffic_filtering=True,id=ebfae3b1-c97c-400b-bcb8-74b0c998eae6,network=Network(6b7d7f72-e0a2-49a1-a1d8-927c62316dd2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebfae3b1-c9') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 16:07:51 user nova-compute[75337]: DEBUG os_vif [None req-08b95f86-0f34-4e7c-92b7-951d48670345 tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:57:9e,bridge_name='br-int',has_traffic_filtering=True,id=ebfae3b1-c97c-400b-bcb8-74b0c998eae6,network=Network(6b7d7f72-e0a2-49a1-a1d8-927c62316dd2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebfae3b1-c9') {{(pid=75337) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 16:07:51 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:07:51 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 16:07:51 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 16:07:51 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:07:51 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e63f7564-4fbb-5f94-a227-c6db769b2b07', '_type': 'linux-noop'}}, row=False) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 16:07:51 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:07:51 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:07:51 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:07:51 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapebfae3b1-c9, may_exist=True, interface_attrs={}) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 16:07:51 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapebfae3b1-c9, col_values=(('qos', UUID('676a047b-a0f9-4a22-8985-1e871bbd9086')),), if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 16:07:51 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapebfae3b1-c9, col_values=(('external_ids', {'iface-id': 'ebfae3b1-c97c-400b-bcb8-74b0c998eae6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4c:57:9e', 'vm-uuid': '04bedc8f-088d-41c4-8cbf-c68602e916c6'}),), if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 16:07:51 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:07:51 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:07:51 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:07:51 user nova-compute[75337]: INFO os_vif [None req-08b95f86-0f34-4e7c-92b7-951d48670345 tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:57:9e,bridge_name='br-int',has_traffic_filtering=True,id=ebfae3b1-c97c-400b-bcb8-74b0c998eae6,network=Network(6b7d7f72-e0a2-49a1-a1d8-927c62316dd2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebfae3b1-c9')
Nov 06 16:07:51 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-08b95f86-0f34-4e7c-92b7-951d48670345 tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] No BDM found with device name vda, not building metadata. {{(pid=75337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 16:07:51 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-08b95f86-0f34-4e7c-92b7-951d48670345 tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] No VIF found with MAC fa:16:3e:4c:57:9e, not building metadata {{(pid=75337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 16:07:52 user nova-compute[75337]: DEBUG nova.network.neutron [req-e24adebd-922f-4ea6-9ed6-69db86832e67 req-236e5eb2-6d7d-420f-835b-e31f5f5b8a48 service nova] [instance: 04bedc8f-088d-41c4-8cbf-c68602e916c6] Updated VIF entry in instance network info cache for port ebfae3b1-c97c-400b-bcb8-74b0c998eae6. {{(pid=75337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 16:07:52 user nova-compute[75337]: DEBUG nova.network.neutron [req-e24adebd-922f-4ea6-9ed6-69db86832e67 req-236e5eb2-6d7d-420f-835b-e31f5f5b8a48 service nova] [instance: 04bedc8f-088d-41c4-8cbf-c68602e916c6] Updating instance_info_cache with network_info: [{"id": "ebfae3b1-c97c-400b-bcb8-74b0c998eae6", "address": "fa:16:3e:4c:57:9e", "network": {"id": "6b7d7f72-e0a2-49a1-a1d8-927c62316dd2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-716305394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "888a739f27694bd5a56badca064a56b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebfae3b1-c9", "ovs_interfaceid": "ebfae3b1-c97c-400b-bcb8-74b0c998eae6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 16:07:52 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-e24adebd-922f-4ea6-9ed6-69db86832e67 req-236e5eb2-6d7d-420f-835b-e31f5f5b8a48 service nova] Releasing lock "refresh_cache-04bedc8f-088d-41c4-8cbf-c68602e916c6" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 16:07:53 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:07:53 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:07:53 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:07:53 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:07:53 user nova-compute[75337]: DEBUG nova.compute.manager [req-46fc9790-1f71-40fb-842f-346e9f3876cf req-872da233-cc32-4a08-9220-2ee562bc2e8a service nova] [instance: 04bedc8f-088d-41c4-8cbf-c68602e916c6] Received event network-vif-plugged-ebfae3b1-c97c-400b-bcb8-74b0c998eae6 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:07:53 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-46fc9790-1f71-40fb-842f-346e9f3876cf req-872da233-cc32-4a08-9220-2ee562bc2e8a service nova] Acquiring lock "04bedc8f-088d-41c4-8cbf-c68602e916c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:07:53 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-46fc9790-1f71-40fb-842f-346e9f3876cf req-872da233-cc32-4a08-9220-2ee562bc2e8a service nova] Lock "04bedc8f-088d-41c4-8cbf-c68602e916c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:07:53 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-46fc9790-1f71-40fb-842f-346e9f3876cf req-872da233-cc32-4a08-9220-2ee562bc2e8a service nova] Lock "04bedc8f-088d-41c4-8cbf-c68602e916c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:07:53 user nova-compute[75337]: DEBUG nova.compute.manager [req-46fc9790-1f71-40fb-842f-346e9f3876cf req-872da233-cc32-4a08-9220-2ee562bc2e8a service nova] [instance: 04bedc8f-088d-41c4-8cbf-c68602e916c6] No waiting events found dispatching network-vif-plugged-ebfae3b1-c97c-400b-bcb8-74b0c998eae6 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 16:07:53 user nova-compute[75337]: WARNING nova.compute.manager [req-46fc9790-1f71-40fb-842f-346e9f3876cf req-872da233-cc32-4a08-9220-2ee562bc2e8a service nova] [instance: 04bedc8f-088d-41c4-8cbf-c68602e916c6] Received unexpected event network-vif-plugged-ebfae3b1-c97c-400b-bcb8-74b0c998eae6 for instance with vm_state building and task_state spawning.
Nov 06 16:07:53 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:07:53 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:07:54 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:07:55 user nova-compute[75337]: DEBUG nova.compute.manager [None req-08b95f86-0f34-4e7c-92b7-951d48670345 tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] [instance: 04bedc8f-088d-41c4-8cbf-c68602e916c6] Instance event wait completed in 0 seconds for  {{(pid=75337) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 16:07:55 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-08b95f86-0f34-4e7c-92b7-951d48670345 tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] [instance: 04bedc8f-088d-41c4-8cbf-c68602e916c6] Guest created on hypervisor {{(pid=75337) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 16:07:55 user nova-compute[75337]: INFO nova.virt.libvirt.driver [-] [instance: 04bedc8f-088d-41c4-8cbf-c68602e916c6] Instance spawned successfully.
Nov 06 16:07:55 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-08b95f86-0f34-4e7c-92b7-951d48670345 tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] [instance: 04bedc8f-088d-41c4-8cbf-c68602e916c6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 16:07:55 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-08b95f86-0f34-4e7c-92b7-951d48670345 tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] [instance: 04bedc8f-088d-41c4-8cbf-c68602e916c6] Found default for hw_cdrom_bus of ide {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 16:07:55 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-08b95f86-0f34-4e7c-92b7-951d48670345 tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] [instance: 04bedc8f-088d-41c4-8cbf-c68602e916c6] Found default for hw_disk_bus of virtio {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 16:07:55 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-08b95f86-0f34-4e7c-92b7-951d48670345 tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] [instance: 04bedc8f-088d-41c4-8cbf-c68602e916c6] Found default for hw_input_bus of None {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 16:07:55 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-08b95f86-0f34-4e7c-92b7-951d48670345 tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] [instance: 04bedc8f-088d-41c4-8cbf-c68602e916c6] Found default for hw_pointer_model of None {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 16:07:55 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-08b95f86-0f34-4e7c-92b7-951d48670345 tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] [instance: 04bedc8f-088d-41c4-8cbf-c68602e916c6] Found default for hw_video_model of virtio {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 16:07:55 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-08b95f86-0f34-4e7c-92b7-951d48670345 tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] [instance: 04bedc8f-088d-41c4-8cbf-c68602e916c6] Found default for hw_vif_model of virtio {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 16:07:55 user nova-compute[75337]: INFO nova.compute.manager [None req-08b95f86-0f34-4e7c-92b7-951d48670345 tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] [instance: 04bedc8f-088d-41c4-8cbf-c68602e916c6] Took 5.75 seconds to spawn the instance on the hypervisor.
Nov 06 16:07:55 user nova-compute[75337]: DEBUG nova.compute.manager [None req-08b95f86-0f34-4e7c-92b7-951d48670345 tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] [instance: 04bedc8f-088d-41c4-8cbf-c68602e916c6] Checking state {{(pid=75337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 16:07:55 user nova-compute[75337]: DEBUG nova.compute.manager [req-a8bfe041-24d5-4752-ac97-70e21755acab req-c3d2d6d2-c658-4249-a8e3-d37a2095795d service nova] [instance: 04bedc8f-088d-41c4-8cbf-c68602e916c6] Received event network-vif-plugged-ebfae3b1-c97c-400b-bcb8-74b0c998eae6 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:07:55 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-a8bfe041-24d5-4752-ac97-70e21755acab req-c3d2d6d2-c658-4249-a8e3-d37a2095795d service nova] Acquiring lock "04bedc8f-088d-41c4-8cbf-c68602e916c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:07:55 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-a8bfe041-24d5-4752-ac97-70e21755acab req-c3d2d6d2-c658-4249-a8e3-d37a2095795d service nova] Lock "04bedc8f-088d-41c4-8cbf-c68602e916c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:07:55 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-a8bfe041-24d5-4752-ac97-70e21755acab req-c3d2d6d2-c658-4249-a8e3-d37a2095795d service nova] Lock "04bedc8f-088d-41c4-8cbf-c68602e916c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:07:55 user nova-compute[75337]: DEBUG nova.compute.manager [req-a8bfe041-24d5-4752-ac97-70e21755acab req-c3d2d6d2-c658-4249-a8e3-d37a2095795d service nova] [instance: 04bedc8f-088d-41c4-8cbf-c68602e916c6] No waiting events found dispatching network-vif-plugged-ebfae3b1-c97c-400b-bcb8-74b0c998eae6 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 16:07:55 user nova-compute[75337]: WARNING nova.compute.manager [req-a8bfe041-24d5-4752-ac97-70e21755acab req-c3d2d6d2-c658-4249-a8e3-d37a2095795d service nova] [instance: 04bedc8f-088d-41c4-8cbf-c68602e916c6] Received unexpected event network-vif-plugged-ebfae3b1-c97c-400b-bcb8-74b0c998eae6 for instance with vm_state building and task_state spawning.
Nov 06 16:07:55 user nova-compute[75337]: INFO nova.compute.manager [None req-08b95f86-0f34-4e7c-92b7-951d48670345 tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] [instance: 04bedc8f-088d-41c4-8cbf-c68602e916c6] Took 6.63 seconds to build instance.
Nov 06 16:07:55 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-08b95f86-0f34-4e7c-92b7-951d48670345 tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] Lock "04bedc8f-088d-41c4-8cbf-c68602e916c6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.757s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:07:56 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:07:59 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:08:01 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:08:06 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:08:09 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:08:10 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc2369ee-cc45-43f5-b3f9-29d82e3dbd5c tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] [instance: 9e2043cc-ff4e-43e9-9867-920de4809cc4] Calling os-brick to attach iSCSI Volume {{(pid=75337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 16:08:10 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc2369ee-cc45-43f5-b3f9-29d82e3dbd5c tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2abc33d0c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:59596733-e5c9-4e48-8904-9251c84172c0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aXDTwxOo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 16:08:10 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-bc2369ee-cc45-43f5-b3f9-29d82e3dbd5c tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 16:08:10 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-bc2369ee-cc45-43f5-b3f9-29d82e3dbd5c tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 16:08:10 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-bc2369ee-cc45-43f5-b3f9-29d82e3dbd5c tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 16:08:10 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-bc2369ee-cc45-43f5-b3f9-29d82e3dbd5c tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 16:08:10 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-bc2369ee-cc45-43f5-b3f9-29d82e3dbd5c tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:59596733-e5c9-4e48-8904-9251c84172c0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 16:08:10 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-bc2369ee-cc45-43f5-b3f9-29d82e3dbd5c tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:59596733-e5c9-4e48-8904-9251c84172c0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 16:08:10 user nova-compute[75337]: INFO os_brick.initiator.connectors.iscsi [None req-bc2369ee-cc45-43f5-b3f9-29d82e3dbd5c tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 16:08:10 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59596733-e5c9-4e48-8904-9251c84172c0 -p 172.16.0.220:3260 {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:08:10 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59596733-e5c9-4e48-8904-9251c84172c0 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:08:10 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b156b77-1e0d-4319-a505-369633c0c3ff]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:08:10 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc2369ee-cc45-43f5-b3f9-29d82e3dbd5c tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 16:08:10 user nova-compute[75337]:  {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:08:10 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59596733-e5c9-4e48-8904-9251c84172c0 -p 172.16.0.220:3260 --interface default --op new {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:08:10 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59596733-e5c9-4e48-8904-9251c84172c0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:08:10 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[55bd6fdb-e514-4bd9-aace-6ecb1aadf013]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:59596733-e5c9-4e48-8904-9251c84172c0] added\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:08:10 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc2369ee-cc45-43f5-b3f9-29d82e3dbd5c tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:59596733-e5c9-4e48-8904-9251c84172c0] added
Nov 06 16:08:10 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:08:10 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59596733-e5c9-4e48-8904-9251c84172c0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:08:10 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59596733-e5c9-4e48-8904-9251c84172c0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:08:10 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[7df7d7e2-2d9e-4b22-9fd0-20cc42440959]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:08:10 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc2369ee-cc45-43f5-b3f9-29d82e3dbd5c tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:08:10 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59596733-e5c9-4e48-8904-9251c84172c0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:08:10 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59596733-e5c9-4e48-8904-9251c84172c0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:08:10 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[358cf5b0-fe52-4ca7-96c9-f534ddfb22b2]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:08:10 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc2369ee-cc45-43f5-b3f9-29d82e3dbd5c tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:08:10 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59596733-e5c9-4e48-8904-9251c84172c0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aXDTwxOo {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:08:10 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59596733-e5c9-4e48-8904-9251c84172c0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aXDTwxOo" returned: 0 in 0.021s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:08:10 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[794c47e7-ed0f-4901-91c3-550d9179b90a]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:08:10 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc2369ee-cc45-43f5-b3f9-29d82e3dbd5c tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aXDTwxOo'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:08:10 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59596733-e5c9-4e48-8904-9251c84172c0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:08:10 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59596733-e5c9-4e48-8904-9251c84172c0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:08:10 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[13c61595-67df-44a3-96a9-c135584bf8c9]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:08:10 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc2369ee-cc45-43f5-b3f9-29d82e3dbd5c tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:08:10 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:08:10 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.020s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:08:10 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[56fef298-0500-46e8-896c-6d5f728ff562]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:08:10 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc2369ee-cc45-43f5-b3f9-29d82e3dbd5c tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 06 16:08:10 user nova-compute[75337]:  {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 16:08:10 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc2369ee-cc45-43f5-b3f9-29d82e3dbd5c tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 06 16:08:10 user nova-compute[75337]:  {{(pid=75337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 16:08:10 user nova-compute[75337]: WARNING os_brick.initiator.connectors.iscsi [None req-bc2369ee-cc45-43f5-b3f9-29d82e3dbd5c tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 06 16:08:10 user nova-compute[75337]: 
Nov 06 16:08:10 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59596733-e5c9-4e48-8904-9251c84172c0 -p 172.16.0.220:3260 --login {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:08:10 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-e44d4b33-0b85-491f-8d42-9a35be2edcea tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: d6eaef86-b841-4142-9549-31954fb34fa2] Starting finish_migration {{(pid=75337) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Nov 06 16:08:10 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-e44d4b33-0b85-491f-8d42-9a35be2edcea tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: d6eaef86-b841-4142-9549-31954fb34fa2] Instance directory exists: not creating {{(pid=75337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 06 16:08:10 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-e44d4b33-0b85-491f-8d42-9a35be2edcea tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: d6eaef86-b841-4142-9549-31954fb34fa2] Creating image(s)
Nov 06 16:08:10 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-e44d4b33-0b85-491f-8d42-9a35be2edcea tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: d6eaef86-b841-4142-9549-31954fb34fa2] Did not create local disks {{(pid=75337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 06 16:08:10 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-e44d4b33-0b85-491f-8d42-9a35be2edcea tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: d6eaef86-b841-4142-9549-31954fb34fa2] Ensure instance console log exists: /opt/stack/data/nova/instances/d6eaef86-b841-4142-9549-31954fb34fa2/console.log {{(pid=75337) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 16:08:10 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-e44d4b33-0b85-491f-8d42-9a35be2edcea tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:08:10 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-e44d4b33-0b85-491f-8d42-9a35be2edcea tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:08:10 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-e44d4b33-0b85-491f-8d42-9a35be2edcea tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:08:10 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-e44d4b33-0b85-491f-8d42-9a35be2edcea tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: d6eaef86-b841-4142-9549-31954fb34fa2] Start _get_guest_xml network_info=[{"id": "99bb43c1-3b95-4be2-a534-845c37778773", "address": "fa:16:3e:98:6e:e3", "network": {"id": "7f234ecf-bfa6-4316-9dce-c15050ba7914", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1378707892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1378707892-network", "vif_mac": "fa:16:3e:98:6e:e3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "243647103fd44f629e0f40be0b56407e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99bb43c1-3b", "ovs_interfaceid": "99bb43c1-3b95-4be2-a534-845c37778773", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'attachment_id': '67c8c56c-1d8c-4390-9cd2-5de4b12133c7', 'guest_format': None, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wZVTXPEQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'd6eaef86-b841-4142-9549-31954fb34fa2', 'attached_at': '2023-11-06T16:08:11.000000', 'detached_at': '', 'volume_id': '58cdef33-eb5c-4ee9-a1b4-ee008e62a139', 'serial': '58cdef33-eb5c-4ee9-a1b4-ee008e62a139'}, 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=75337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 16:08:10 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-e44d4b33-0b85-491f-8d42-9a35be2edcea tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 16:08:10 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-e44d4b33-0b85-491f-8d42-9a35be2edcea tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 16:08:10 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-e44d4b33-0b85-491f-8d42-9a35be2edcea tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 16:08:10 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-e44d4b33-0b85-491f-8d42-9a35be2edcea tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] CPU controller missing on host. {{(pid=75337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 16:08:10 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-e44d4b33-0b85-491f-8d42-9a35be2edcea tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 16:08:10 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-e44d4b33-0b85-491f-8d42-9a35be2edcea tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] CPU controller found on host. {{(pid=75337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 16:08:10 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-e44d4b33-0b85-491f-8d42-9a35be2edcea tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75337) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 16:08:10 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-e44d4b33-0b85-491f-8d42-9a35be2edcea tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T15:34:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 16:08:10 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-e44d4b33-0b85-491f-8d42-9a35be2edcea tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Flavor limits 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 16:08:10 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-e44d4b33-0b85-491f-8d42-9a35be2edcea tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Image limits 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 16:08:10 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-e44d4b33-0b85-491f-8d42-9a35be2edcea tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Flavor pref 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 16:08:10 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-e44d4b33-0b85-491f-8d42-9a35be2edcea tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Image pref 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 16:08:10 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-e44d4b33-0b85-491f-8d42-9a35be2edcea tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 16:08:10 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-e44d4b33-0b85-491f-8d42-9a35be2edcea tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 16:08:10 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-e44d4b33-0b85-491f-8d42-9a35be2edcea tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 16:08:10 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-e44d4b33-0b85-491f-8d42-9a35be2edcea tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Got 1 possible topologies {{(pid=75337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 16:08:10 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-e44d4b33-0b85-491f-8d42-9a35be2edcea tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 16:08:10 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-e44d4b33-0b85-491f-8d42-9a35be2edcea tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 16:08:10 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e44d4b33-0b85-491f-8d42-9a35be2edcea tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: d6eaef86-b841-4142-9549-31954fb34fa2] Calling os-brick to attach iSCSI Volume {{(pid=75337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 16:08:10 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e44d4b33-0b85-491f-8d42-9a35be2edcea tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2abc33d0c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wZVTXPEQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 16:08:10 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-e44d4b33-0b85-491f-8d42-9a35be2edcea tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 16:08:10 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-e44d4b33-0b85-491f-8d42-9a35be2edcea tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 16:08:10 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59596733-e5c9-4e48-8904-9251c84172c0 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:08:10 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[7abdabf9-f25d-44c9-af02-ec38c24585ff]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:59596733-e5c9-4e48-8904-9251c84172c0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:59596733-e5c9-4e48-8904-9251c84172c0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:08:10 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc2369ee-cc45-43f5-b3f9-29d82e3dbd5c tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:59596733-e5c9-4e48-8904-9251c84172c0, portal: 172.16.0.220,3260]
Nov 06 16:08:10 user nova-compute[75337]: Login to [iface: default, target: iqn.2010-10.org.openstack:59596733-e5c9-4e48-8904-9251c84172c0, portal: 172.16.0.220,3260] successful.
Nov 06 16:08:10 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:08:10 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59596733-e5c9-4e48-8904-9251c84172c0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:08:10 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59596733-e5c9-4e48-8904-9251c84172c0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:08:10 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[03e083f1-4b7a-47a4-8f37-7dc657f0bc76]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:08:10 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc2369ee-cc45-43f5-b3f9-29d82e3dbd5c tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:08:10 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:08:10 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:08:10 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[e93322f3-70a2-4dab-8ad3-66f8c4ee54be]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59596733-e5c9-4e48-8904-9251c84172c0 (non-flash)\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:08:10 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc2369ee-cc45-43f5-b3f9-29d82e3dbd5c tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59596733-e5c9-4e48-8904-9251c84172c0 (non-flash)
Nov 06 16:08:10 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 16:08:10 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc2369ee-cc45-43f5-b3f9-29d82e3dbd5c tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59596733-e5c9-4e48-8904-9251c84172c0 (non-flash)
Nov 06 16:08:10 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 16:08:10 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-bc2369ee-cc45-43f5-b3f9-29d82e3dbd5c tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:59596733-e5c9-4e48-8904-9251c84172c0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.309s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 16:08:10 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc2369ee-cc45-43f5-b3f9-29d82e3dbd5c tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Connected to 172.16.0.220:3260 {{(pid=75337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 16:08:10 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-bc2369ee-cc45-43f5-b3f9-29d82e3dbd5c tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] HCTL ('33', '-', '-', 0) found on session 48 with lun 0 {{(pid=75337) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 16:08:10 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-bc2369ee-cc45-43f5-b3f9-29d82e3dbd5c tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75337) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 16:08:10 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:08:10 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:08:10 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a09fa0a-5ec8-4d3b-b58f-bf42b3fe4894]: (4, ('- - 0', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:08:10 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-bc2369ee-cc45-43f5-b3f9-29d82e3dbd5c tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Searching for a device in session 48 and hctl ['33', '*', '*', 0] yield: None {{(pid=75337) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 16:08:11 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:08:11 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-bc2369ee-cc45-43f5-b3f9-29d82e3dbd5c tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Searching for a device in session 48 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75337) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 16:08:11 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc2369ee-cc45-43f5-b3f9-29d82e3dbd5c tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:59596733-e5c9-4e48-8904-9251c84172c0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aXDTwxOo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 16:08:11 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-bc2369ee-cc45-43f5-b3f9-29d82e3dbd5c tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.343s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 16:08:11 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc2369ee-cc45-43f5-b3f9-29d82e3dbd5c tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] <== connect_volume: return (1344ms) {'type': 'block', 'scsi_wwn': '23066333261376233', 'path': '/dev/sdb'} {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 16:08:11 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc2369ee-cc45-43f5-b3f9-29d82e3dbd5c tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] [instance: 9e2043cc-ff4e-43e9-9867-920de4809cc4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23066333261376233', 'path': '/dev/sdb'} {{(pid=75337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 16:08:11 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-e44d4b33-0b85-491f-8d42-9a35be2edcea tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.082s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 16:08:11 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-e44d4b33-0b85-491f-8d42-9a35be2edcea tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 16:08:11 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-e44d4b33-0b85-491f-8d42-9a35be2edcea tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 16:08:11 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-e44d4b33-0b85-491f-8d42-9a35be2edcea tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 16:08:11 user nova-compute[75337]: INFO os_brick.initiator.connectors.iscsi [None req-e44d4b33-0b85-491f-8d42-9a35be2edcea tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 16:08:11 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139 -p 172.16.0.220:3260 {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:08:11 user nova-compute[75337]: DEBUG nova.objects.instance [None req-bc2369ee-cc45-43f5-b3f9-29d82e3dbd5c tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Lazy-loading 'flavor' on Instance uuid 9e2043cc-ff4e-43e9-9867-920de4809cc4 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 16:08:11 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:08:11 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[0364dc2a-7bb1-4951-a2da-4eea25300d4b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:08:11 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e44d4b33-0b85-491f-8d42-9a35be2edcea tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 16:08:11 user nova-compute[75337]:  {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:08:11 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139 -p 172.16.0.220:3260 --interface default --op new {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:08:11 user nova-compute[75337]: DEBUG nova.virt.libvirt.guest [None req-bc2369ee-cc45-43f5-b3f9-29d82e3dbd5c tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] attach device xml: <disk type="block" device="disk">
Nov 06 16:08:11 user nova-compute[75337]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 16:08:11 user nova-compute[75337]:   <source dev="/dev/sdb"/>
Nov 06 16:08:11 user nova-compute[75337]:   <target dev="vdb" bus="virtio"/>
Nov 06 16:08:11 user nova-compute[75337]:   <serial>59596733-e5c9-4e48-8904-9251c84172c0</serial>
Nov 06 16:08:11 user nova-compute[75337]: </disk>
Nov 06 16:08:11 user nova-compute[75337]:  {{(pid=75337) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 06 16:08:11 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:08:11 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[97e5ad1c-8144-4b5f-a778-8f9b5086e60f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139] added\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:08:11 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e44d4b33-0b85-491f-8d42-9a35be2edcea tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139] added
Nov 06 16:08:11 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:08:11 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:08:12 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:08:12 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab18f7ed-f317-436a-a1d1-284f63c5daf8]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:08:12 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e44d4b33-0b85-491f-8d42-9a35be2edcea tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:08:12 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:08:12 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:08:12 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[bec3037c-ce49-49e7-ab0a-3f94030068c2]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:08:12 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e44d4b33-0b85-491f-8d42-9a35be2edcea tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:08:12 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wZVTXPEQ {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:08:12 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wZVTXPEQ" returned: 0 in 0.020s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:08:12 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbd1c761-c6fd-43fc-9207-361901e860a7]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:08:12 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e44d4b33-0b85-491f-8d42-9a35be2edcea tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wZVTXPEQ'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:08:12 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:08:12 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:08:12 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bf3cbe2-8f9a-4841-b349-e8087b61a92a]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:08:12 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e44d4b33-0b85-491f-8d42-9a35be2edcea tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:08:12 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:08:12 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:08:12 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a587922-1dbd-459c-8fb1-23fbcc058f81]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59596733-e5c9-4e48-8904-9251c84172c0 (non-flash)\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:08:12 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e44d4b33-0b85-491f-8d42-9a35be2edcea tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59596733-e5c9-4e48-8904-9251c84172c0 (non-flash)
Nov 06 16:08:12 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 16:08:12 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e44d4b33-0b85-491f-8d42-9a35be2edcea tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59596733-e5c9-4e48-8904-9251c84172c0 (non-flash)
Nov 06 16:08:12 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 16:08:12 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139 -p 172.16.0.220:3260 --login {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:08:12 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:08:12 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[6789cf7b-7067-46e4-9155-21c87f915160]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:08:12 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e44d4b33-0b85-491f-8d42-9a35be2edcea tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139, portal: 172.16.0.220,3260]
Nov 06 16:08:12 user nova-compute[75337]: Login to [iface: default, target: iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139, portal: 172.16.0.220,3260] successful.
Nov 06 16:08:12 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:08:12 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:08:12 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:08:12 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[7687d672-5e65-4542-8304-d932d0273706]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:08:12 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e44d4b33-0b85-491f-8d42-9a35be2edcea tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:08:12 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:08:12 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:08:12 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ac2bc3c-0b5d-432b-84d7-85d9ae118e80]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59596733-e5c9-4e48-8904-9251c84172c0 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139 (non-flash)\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:08:12 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e44d4b33-0b85-491f-8d42-9a35be2edcea tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59596733-e5c9-4e48-8904-9251c84172c0 (non-flash)
Nov 06 16:08:12 user nova-compute[75337]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139 (non-flash)
Nov 06 16:08:12 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 16:08:12 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e44d4b33-0b85-491f-8d42-9a35be2edcea tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59596733-e5c9-4e48-8904-9251c84172c0 (non-flash)
Nov 06 16:08:12 user nova-compute[75337]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139 (non-flash)
Nov 06 16:08:12 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 16:08:12 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-e44d4b33-0b85-491f-8d42-9a35be2edcea tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.288s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 16:08:12 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e44d4b33-0b85-491f-8d42-9a35be2edcea tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Connected to 172.16.0.220:3260 {{(pid=75337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 16:08:12 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-e44d4b33-0b85-491f-8d42-9a35be2edcea tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] HCTL ('34', '-', '-', 0) found on session 49 with lun 0 {{(pid=75337) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 16:08:12 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-e44d4b33-0b85-491f-8d42-9a35be2edcea tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75337) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 16:08:12 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:08:12 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:08:12 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[790146dd-6d9f-4e79-8493-385304934228]: (4, ('- - 0', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:08:12 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-e44d4b33-0b85-491f-8d42-9a35be2edcea tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Searching for a device in session 49 and hctl ['34', '*', '*', 0] yield: None {{(pid=75337) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 16:08:12 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-bc2369ee-cc45-43f5-b3f9-29d82e3dbd5c tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] No BDM found with device name vda, not building metadata. {{(pid=75337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 16:08:12 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-bc2369ee-cc45-43f5-b3f9-29d82e3dbd5c tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 16:08:12 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-bc2369ee-cc45-43f5-b3f9-29d82e3dbd5c tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] No VIF found with MAC fa:16:3e:a0:7d:db, not building metadata {{(pid=75337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 16:08:12 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-bc2369ee-cc45-43f5-b3f9-29d82e3dbd5c tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Lock "9e2043cc-ff4e-43e9-9867-920de4809cc4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 81.901s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:08:13 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-e44d4b33-0b85-491f-8d42-9a35be2edcea tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Searching for a device in session 49 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75337) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 16:08:13 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e44d4b33-0b85-491f-8d42-9a35be2edcea tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wZVTXPEQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 16:08:13 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-e44d4b33-0b85-491f-8d42-9a35be2edcea tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.317s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 16:08:13 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e44d4b33-0b85-491f-8d42-9a35be2edcea tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] <== connect_volume: return (2399ms) {'type': 'block', 'scsi_wwn': '23162376336383232', 'path': '/dev/sdc'} {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 16:08:13 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e44d4b33-0b85-491f-8d42-9a35be2edcea tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: d6eaef86-b841-4142-9549-31954fb34fa2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23162376336383232', 'path': '/dev/sdc'} {{(pid=75337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 16:08:13 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-e44d4b33-0b85-491f-8d42-9a35be2edcea tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T16:04:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-861327703',display_name='tempest-ServerActionsTestOtherA-server-861327703',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-861327703',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL4qUjCjjdVsflRB1h4DRug41qRThkRpbPytYUyz/XMQHNCLS4P/DapnKkRg0/Jn7/AhFFjdzCG9PxcwwVtb8q/utJpW4U9sbkxfbmmpOTPsJTE2NdIyui4Q27o5JkMUFA==',key_name='tempest-keypair-766127816',keypairs=<?>,launch_index=0,launched_at=2023-11-06T16:04:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='243647103fd44f629e0f40be0b56407e',ramdisk_id='',reservation_id='r-zax76e41',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-783619975',owner_user_name='tempest-ServerActionsTestOtherA-783619975-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T16:07:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2e47bf9ad49645deb2c1f834938fa39f',uuid=d6eaef86-b841-4142-9549-31954fb34fa2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "99bb43c1-3b95-4be2-a534-845c37778773", "address": "fa:16:3e:98:6e:e3", "network": {"id": "7f234ecf-bfa6-4316-9dce-c15050ba7914", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1378707892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1378707892-network", "vif_mac": "fa:16:3e:98:6e:e3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "243647103fd44f629e0f40be0b56407e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99bb43c1-3b", "ovs_interfaceid": "99bb43c1-3b95-4be2-a534-845c37778773", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75337) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 16:08:13 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-e44d4b33-0b85-491f-8d42-9a35be2edcea tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Converting VIF {"id": "99bb43c1-3b95-4be2-a534-845c37778773", "address": "fa:16:3e:98:6e:e3", "network": {"id": "7f234ecf-bfa6-4316-9dce-c15050ba7914", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1378707892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1378707892-network", "vif_mac": "fa:16:3e:98:6e:e3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "243647103fd44f629e0f40be0b56407e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99bb43c1-3b", "ovs_interfaceid": "99bb43c1-3b95-4be2-a534-845c37778773", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 16:08:13 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-e44d4b33-0b85-491f-8d42-9a35be2edcea tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:6e:e3,bridge_name='br-int',has_traffic_filtering=True,id=99bb43c1-3b95-4be2-a534-845c37778773,network=Network(7f234ecf-bfa6-4316-9dce-c15050ba7914),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99bb43c1-3b') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 16:08:13 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-e44d4b33-0b85-491f-8d42-9a35be2edcea tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: d6eaef86-b841-4142-9549-31954fb34fa2] End _get_guest_xml xml=<domain type="kvm">
Nov 06 16:08:13 user nova-compute[75337]:   <uuid>d6eaef86-b841-4142-9549-31954fb34fa2</uuid>
Nov 06 16:08:13 user nova-compute[75337]:   <name>instance-0000002a</name>
Nov 06 16:08:13 user nova-compute[75337]:   <memory>2097152</memory>
Nov 06 16:08:13 user nova-compute[75337]:   <vcpu>1</vcpu>
Nov 06 16:08:13 user nova-compute[75337]:   <metadata>
Nov 06 16:08:13 user nova-compute[75337]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 16:08:13 user nova-compute[75337]:       <nova:package version="0.0.0"/>
Nov 06 16:08:13 user nova-compute[75337]:       <nova:name>tempest-ServerActionsTestOtherA-server-861327703</nova:name>
Nov 06 16:08:13 user nova-compute[75337]:       <nova:creationTime>2023-11-06 16:08:10</nova:creationTime>
Nov 06 16:08:13 user nova-compute[75337]:       <nova:flavor name="m1.small">
Nov 06 16:08:13 user nova-compute[75337]:         <nova:memory>2048</nova:memory>
Nov 06 16:08:13 user nova-compute[75337]:         <nova:disk>20</nova:disk>
Nov 06 16:08:13 user nova-compute[75337]:         <nova:swap>0</nova:swap>
Nov 06 16:08:13 user nova-compute[75337]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 16:08:13 user nova-compute[75337]:         <nova:vcpus>1</nova:vcpus>
Nov 06 16:08:13 user nova-compute[75337]:       </nova:flavor>
Nov 06 16:08:13 user nova-compute[75337]:       <nova:owner>
Nov 06 16:08:13 user nova-compute[75337]:         <nova:user uuid="2e47bf9ad49645deb2c1f834938fa39f">tempest-ServerActionsTestOtherA-783619975-project-member</nova:user>
Nov 06 16:08:13 user nova-compute[75337]:         <nova:project uuid="243647103fd44f629e0f40be0b56407e">tempest-ServerActionsTestOtherA-783619975</nova:project>
Nov 06 16:08:13 user nova-compute[75337]:       </nova:owner>
Nov 06 16:08:13 user nova-compute[75337]:       <nova:ports>
Nov 06 16:08:13 user nova-compute[75337]:         <nova:port uuid="99bb43c1-3b95-4be2-a534-845c37778773">
Nov 06 16:08:13 user nova-compute[75337]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 06 16:08:13 user nova-compute[75337]:         </nova:port>
Nov 06 16:08:13 user nova-compute[75337]:       </nova:ports>
Nov 06 16:08:13 user nova-compute[75337]:     </nova:instance>
Nov 06 16:08:13 user nova-compute[75337]:   </metadata>
Nov 06 16:08:13 user nova-compute[75337]:   <sysinfo type="smbios">
Nov 06 16:08:13 user nova-compute[75337]:     <system>
Nov 06 16:08:13 user nova-compute[75337]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 16:08:13 user nova-compute[75337]:       <entry name="product">OpenStack Nova</entry>
Nov 06 16:08:13 user nova-compute[75337]:       <entry name="version">0.0.0</entry>
Nov 06 16:08:13 user nova-compute[75337]:       <entry name="serial">d6eaef86-b841-4142-9549-31954fb34fa2</entry>
Nov 06 16:08:13 user nova-compute[75337]:       <entry name="uuid">d6eaef86-b841-4142-9549-31954fb34fa2</entry>
Nov 06 16:08:13 user nova-compute[75337]:       <entry name="family">Virtual Machine</entry>
Nov 06 16:08:13 user nova-compute[75337]:     </system>
Nov 06 16:08:13 user nova-compute[75337]:   </sysinfo>
Nov 06 16:08:13 user nova-compute[75337]:   <os>
Nov 06 16:08:13 user nova-compute[75337]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 16:08:13 user nova-compute[75337]:     <boot dev="hd"/>
Nov 06 16:08:13 user nova-compute[75337]:     <smbios mode="sysinfo"/>
Nov 06 16:08:13 user nova-compute[75337]:   </os>
Nov 06 16:08:13 user nova-compute[75337]:   <features>
Nov 06 16:08:13 user nova-compute[75337]:     <acpi/>
Nov 06 16:08:13 user nova-compute[75337]:     <apic/>
Nov 06 16:08:13 user nova-compute[75337]:     <vmcoreinfo/>
Nov 06 16:08:13 user nova-compute[75337]:   </features>
Nov 06 16:08:13 user nova-compute[75337]:   <clock offset="utc">
Nov 06 16:08:13 user nova-compute[75337]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 16:08:13 user nova-compute[75337]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 16:08:13 user nova-compute[75337]:     <timer name="hpet" present="no"/>
Nov 06 16:08:13 user nova-compute[75337]:   </clock>
Nov 06 16:08:13 user nova-compute[75337]:   <cpu mode="custom" match="exact">
Nov 06 16:08:13 user nova-compute[75337]:     <model>Nehalem</model>
Nov 06 16:08:13 user nova-compute[75337]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 16:08:13 user nova-compute[75337]:   </cpu>
Nov 06 16:08:13 user nova-compute[75337]:   <devices>
Nov 06 16:08:13 user nova-compute[75337]:     <disk type="block" device="disk">
Nov 06 16:08:13 user nova-compute[75337]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 16:08:13 user nova-compute[75337]:       <source dev="/dev/sdc"/>
Nov 06 16:08:13 user nova-compute[75337]:       <target dev="vda" bus="virtio"/>
Nov 06 16:08:13 user nova-compute[75337]:       <serial>58cdef33-eb5c-4ee9-a1b4-ee008e62a139</serial>
Nov 06 16:08:13 user nova-compute[75337]:     </disk>
Nov 06 16:08:13 user nova-compute[75337]:     <interface type="ethernet">
Nov 06 16:08:13 user nova-compute[75337]:       <mac address="fa:16:3e:98:6e:e3"/>
Nov 06 16:08:13 user nova-compute[75337]:       <model type="virtio"/>
Nov 06 16:08:13 user nova-compute[75337]:       <mtu size="1442"/>
Nov 06 16:08:13 user nova-compute[75337]:       <target dev="tap99bb43c1-3b"/>
Nov 06 16:08:13 user nova-compute[75337]:     </interface>
Nov 06 16:08:13 user nova-compute[75337]:     <serial type="pty">
Nov 06 16:08:13 user nova-compute[75337]:       <log file="/opt/stack/data/nova/instances/d6eaef86-b841-4142-9549-31954fb34fa2/console.log" append="off"/>
Nov 06 16:08:13 user nova-compute[75337]:     </serial>
Nov 06 16:08:13 user nova-compute[75337]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 16:08:13 user nova-compute[75337]:     <video>
Nov 06 16:08:13 user nova-compute[75337]:       <model type="virtio"/>
Nov 06 16:08:13 user nova-compute[75337]:     </video>
Nov 06 16:08:13 user nova-compute[75337]:     <rng model="virtio">
Nov 06 16:08:13 user nova-compute[75337]:       <backend model="random">/dev/urandom</backend>
Nov 06 16:08:13 user nova-compute[75337]:     </rng>
Nov 06 16:08:13 user nova-compute[75337]:     <controller type="usb" index="0" model="none"/>
Nov 06 16:08:13 user nova-compute[75337]:     <memballoon model="virtio">
Nov 06 16:08:13 user nova-compute[75337]:       <stats period="10"/>
Nov 06 16:08:13 user nova-compute[75337]:     </memballoon>
Nov 06 16:08:13 user nova-compute[75337]:   </devices>
Nov 06 16:08:13 user nova-compute[75337]: </domain>
Nov 06 16:08:13 user nova-compute[75337]:  {{(pid=75337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 16:08:13 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-e44d4b33-0b85-491f-8d42-9a35be2edcea tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T16:04:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-861327703',display_name='tempest-ServerActionsTestOtherA-server-861327703',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-861327703',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL4qUjCjjdVsflRB1h4DRug41qRThkRpbPytYUyz/XMQHNCLS4P/DapnKkRg0/Jn7/AhFFjdzCG9PxcwwVtb8q/utJpW4U9sbkxfbmmpOTPsJTE2NdIyui4Q27o5JkMUFA==',key_name='tempest-keypair-766127816',keypairs=<?>,launch_index=0,launched_at=2023-11-06T16:04:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='243647103fd44f629e0f40be0b56407e',ramdisk_id='',reservation_id='r-zax76e41',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-783619975',owner_user_name='tempest-ServerActionsTestOtherA-783619975-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T16:07:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2e47bf9ad49645deb2c1f834938fa39f',uuid=d6eaef86-b841-4142-9549-31954fb34fa2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "99bb43c1-3b95-4be2-a534-845c37778773", "address": "fa:16:3e:98:6e:e3", "network": {"id": "7f234ecf-bfa6-4316-9dce-c15050ba7914", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1378707892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1378707892-network", "vif_mac": "fa:16:3e:98:6e:e3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "243647103fd44f629e0f40be0b56407e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99bb43c1-3b", "ovs_interfaceid": "99bb43c1-3b95-4be2-a534-845c37778773", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 16:08:13 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-e44d4b33-0b85-491f-8d42-9a35be2edcea tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Converting VIF {"id": "99bb43c1-3b95-4be2-a534-845c37778773", "address": "fa:16:3e:98:6e:e3", "network": {"id": "7f234ecf-bfa6-4316-9dce-c15050ba7914", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1378707892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1378707892-network", "vif_mac": "fa:16:3e:98:6e:e3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "243647103fd44f629e0f40be0b56407e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99bb43c1-3b", "ovs_interfaceid": "99bb43c1-3b95-4be2-a534-845c37778773", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 16:08:13 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-e44d4b33-0b85-491f-8d42-9a35be2edcea tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:6e:e3,bridge_name='br-int',has_traffic_filtering=True,id=99bb43c1-3b95-4be2-a534-845c37778773,network=Network(7f234ecf-bfa6-4316-9dce-c15050ba7914),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99bb43c1-3b') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 16:08:13 user nova-compute[75337]: DEBUG os_vif [None req-e44d4b33-0b85-491f-8d42-9a35be2edcea tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:6e:e3,bridge_name='br-int',has_traffic_filtering=True,id=99bb43c1-3b95-4be2-a534-845c37778773,network=Network(7f234ecf-bfa6-4316-9dce-c15050ba7914),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99bb43c1-3b') {{(pid=75337) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 16:08:13 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:08:13 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 16:08:13 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 16:08:13 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:08:13 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0cad6962-afca-55ed-b3c2-304f3e0fd4e5', '_type': 'linux-noop'}}, row=False) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 16:08:13 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:08:13 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:08:13 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:08:13 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap99bb43c1-3b, may_exist=True, interface_attrs={}) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 16:08:13 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap99bb43c1-3b, col_values=(('qos', UUID('a28d4fae-a488-491b-b617-7016c85ff67b')),), if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 16:08:13 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap99bb43c1-3b, col_values=(('external_ids', {'iface-id': '99bb43c1-3b95-4be2-a534-845c37778773', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:98:6e:e3', 'vm-uuid': 'd6eaef86-b841-4142-9549-31954fb34fa2'}),), if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 16:08:13 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:08:13 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:08:13 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:08:13 user nova-compute[75337]: INFO os_vif [None req-e44d4b33-0b85-491f-8d42-9a35be2edcea tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:6e:e3,bridge_name='br-int',has_traffic_filtering=True,id=99bb43c1-3b95-4be2-a534-845c37778773,network=Network(7f234ecf-bfa6-4316-9dce-c15050ba7914),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99bb43c1-3b')
Nov 06 16:08:13 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-e44d4b33-0b85-491f-8d42-9a35be2edcea tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] No BDM found with device name vda, not building metadata. {{(pid=75337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 16:08:13 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-e44d4b33-0b85-491f-8d42-9a35be2edcea tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] No VIF found with MAC fa:16:3e:98:6e:e3, not building metadata {{(pid=75337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 16:08:14 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-26728e3b-9ac9-43f6-82b6-740c1ddb393c tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] [instance: f9c98d28-41f9-498f-8c1f-43517999775a] Calling os-brick to attach iSCSI Volume {{(pid=75337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 16:08:14 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-26728e3b-9ac9-43f6-82b6-740c1ddb393c tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2abc33d0c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:81b76252-f172-4a13-954b-87087c5eb447', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BFwmuETd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 16:08:14 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-26728e3b-9ac9-43f6-82b6-740c1ddb393c tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 16:08:14 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-26728e3b-9ac9-43f6-82b6-740c1ddb393c tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 16:08:14 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-26728e3b-9ac9-43f6-82b6-740c1ddb393c tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 16:08:14 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-26728e3b-9ac9-43f6-82b6-740c1ddb393c tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 16:08:14 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-26728e3b-9ac9-43f6-82b6-740c1ddb393c tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:81b76252-f172-4a13-954b-87087c5eb447" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 16:08:14 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-26728e3b-9ac9-43f6-82b6-740c1ddb393c tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:81b76252-f172-4a13-954b-87087c5eb447" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 16:08:14 user nova-compute[75337]: INFO os_brick.initiator.connectors.iscsi [None req-26728e3b-9ac9-43f6-82b6-740c1ddb393c tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 16:08:14 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81b76252-f172-4a13-954b-87087c5eb447 -p 172.16.0.220:3260 {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:08:14 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81b76252-f172-4a13-954b-87087c5eb447 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:08:14 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cbd759f-1924-4927-84fd-b44fabfaeb8b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:08:14 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-26728e3b-9ac9-43f6-82b6-740c1ddb393c tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 16:08:14 user nova-compute[75337]:  {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:08:14 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81b76252-f172-4a13-954b-87087c5eb447 -p 172.16.0.220:3260 --interface default --op new {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:08:14 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81b76252-f172-4a13-954b-87087c5eb447 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:08:14 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fe81f2b-fa14-40ef-b30d-8e4c8d7f9b65]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:81b76252-f172-4a13-954b-87087c5eb447] added\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:08:14 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-26728e3b-9ac9-43f6-82b6-740c1ddb393c tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:81b76252-f172-4a13-954b-87087c5eb447] added
Nov 06 16:08:14 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:08:14 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81b76252-f172-4a13-954b-87087c5eb447 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:08:14 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81b76252-f172-4a13-954b-87087c5eb447 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:08:14 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[24002c64-bd72-4ad5-977e-3740f33fd398]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:08:14 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-26728e3b-9ac9-43f6-82b6-740c1ddb393c tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:08:14 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81b76252-f172-4a13-954b-87087c5eb447 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:08:14 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81b76252-f172-4a13-954b-87087c5eb447 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:08:14 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[60ada5a7-36d4-41e3-9b17-6764aadffc5f]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:08:14 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-26728e3b-9ac9-43f6-82b6-740c1ddb393c tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:08:14 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81b76252-f172-4a13-954b-87087c5eb447 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BFwmuETd {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:08:14 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81b76252-f172-4a13-954b-87087c5eb447 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BFwmuETd" returned: 0 in 0.025s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:08:14 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[62b8f238-5e6a-474a-b271-8d8ac22df66a]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:08:14 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-26728e3b-9ac9-43f6-82b6-740c1ddb393c tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BFwmuETd'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:08:14 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81b76252-f172-4a13-954b-87087c5eb447 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:08:14 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81b76252-f172-4a13-954b-87087c5eb447 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:08:14 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[44daa1c1-fee0-4b2a-a5c9-b35db1502967]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:08:14 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-26728e3b-9ac9-43f6-82b6-740c1ddb393c tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:08:14 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:08:14 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-b57e208d-bd2d-4704-8f64-338c06cd6c64 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Acquiring lock "9e2043cc-ff4e-43e9-9867-920de4809cc4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:08:14 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-b57e208d-bd2d-4704-8f64-338c06cd6c64 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Lock "9e2043cc-ff4e-43e9-9867-920de4809cc4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:08:14 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:08:14 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[6664c130-8250-4001-bb49-dfd2f980031c]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59596733-e5c9-4e48-8904-9251c84172c0 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139 (non-flash)\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:08:14 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-26728e3b-9ac9-43f6-82b6-740c1ddb393c tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59596733-e5c9-4e48-8904-9251c84172c0 (non-flash)
Nov 06 16:08:14 user nova-compute[75337]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139 (non-flash)
Nov 06 16:08:14 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 16:08:14 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-26728e3b-9ac9-43f6-82b6-740c1ddb393c tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59596733-e5c9-4e48-8904-9251c84172c0 (non-flash)
Nov 06 16:08:14 user nova-compute[75337]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139 (non-flash)
Nov 06 16:08:14 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 16:08:14 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81b76252-f172-4a13-954b-87087c5eb447 -p 172.16.0.220:3260 --login {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:08:14 user nova-compute[75337]: INFO nova.compute.manager [None req-b57e208d-bd2d-4704-8f64-338c06cd6c64 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] [instance: 9e2043cc-ff4e-43e9-9867-920de4809cc4] Detaching volume 59596733-e5c9-4e48-8904-9251c84172c0
Nov 06 16:08:14 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81b76252-f172-4a13-954b-87087c5eb447 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:08:14 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4388718-a53d-4da5-90fb-9994729dc526]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:81b76252-f172-4a13-954b-87087c5eb447, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:81b76252-f172-4a13-954b-87087c5eb447, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:08:14 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-26728e3b-9ac9-43f6-82b6-740c1ddb393c tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:81b76252-f172-4a13-954b-87087c5eb447, portal: 172.16.0.220,3260]
Nov 06 16:08:14 user nova-compute[75337]: Login to [iface: default, target: iqn.2010-10.org.openstack:81b76252-f172-4a13-954b-87087c5eb447, portal: 172.16.0.220,3260] successful.
Nov 06 16:08:14 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:08:14 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81b76252-f172-4a13-954b-87087c5eb447 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:08:14 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81b76252-f172-4a13-954b-87087c5eb447 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:08:14 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[56d8053a-ec99-492a-a927-fc4d8df007dd]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:08:14 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-26728e3b-9ac9-43f6-82b6-740c1ddb393c tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:08:14 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:08:14 user nova-compute[75337]: INFO nova.virt.block_device [None req-b57e208d-bd2d-4704-8f64-338c06cd6c64 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] [instance: 9e2043cc-ff4e-43e9-9867-920de4809cc4] Attempting to driver detach volume 59596733-e5c9-4e48-8904-9251c84172c0 from mountpoint /dev/vdb
Nov 06 16:08:14 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:08:14 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eda0d04-b153-4902-8319-afb0e824e287]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59596733-e5c9-4e48-8904-9251c84172c0 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b76252-f172-4a13-954b-87087c5eb447 (non-flash)\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:08:14 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-26728e3b-9ac9-43f6-82b6-740c1ddb393c tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59596733-e5c9-4e48-8904-9251c84172c0 (non-flash)
Nov 06 16:08:14 user nova-compute[75337]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139 (non-flash)
Nov 06 16:08:14 user nova-compute[75337]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b76252-f172-4a13-954b-87087c5eb447 (non-flash)
Nov 06 16:08:14 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 16:08:14 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-26728e3b-9ac9-43f6-82b6-740c1ddb393c tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59596733-e5c9-4e48-8904-9251c84172c0 (non-flash)
Nov 06 16:08:14 user nova-compute[75337]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139 (non-flash)
Nov 06 16:08:14 user nova-compute[75337]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b76252-f172-4a13-954b-87087c5eb447 (non-flash)
Nov 06 16:08:14 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 16:08:14 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-26728e3b-9ac9-43f6-82b6-740c1ddb393c tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:81b76252-f172-4a13-954b-87087c5eb447" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.308s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 16:08:14 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-26728e3b-9ac9-43f6-82b6-740c1ddb393c tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Connected to 172.16.0.220:3260 {{(pid=75337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 16:08:14 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-26728e3b-9ac9-43f6-82b6-740c1ddb393c tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] HCTL ('35', '-', '-', 0) found on session 50 with lun 0 {{(pid=75337) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 16:08:14 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-26728e3b-9ac9-43f6-82b6-740c1ddb393c tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75337) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 16:08:14 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:08:14 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:08:14 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:08:14 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f1861ec-6c31-4840-9d6c-2872778658ca]: (4, ('- - 0', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:08:14 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-26728e3b-9ac9-43f6-82b6-740c1ddb393c tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Searching for a device in session 50 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75337) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 16:08:14 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-26728e3b-9ac9-43f6-82b6-740c1ddb393c tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:81b76252-f172-4a13-954b-87087c5eb447', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BFwmuETd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 16:08:14 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-b57e208d-bd2d-4704-8f64-338c06cd6c64 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Attempting to detach device vdb from instance 9e2043cc-ff4e-43e9-9867-920de4809cc4 from the persistent domain config. {{(pid=75337) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 06 16:08:14 user nova-compute[75337]: DEBUG nova.virt.libvirt.guest [None req-b57e208d-bd2d-4704-8f64-338c06cd6c64 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 16:08:14 user nova-compute[75337]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 16:08:14 user nova-compute[75337]:   <source dev="/dev/sdb"/>
Nov 06 16:08:14 user nova-compute[75337]:   <target dev="vdb" bus="virtio"/>
Nov 06 16:08:14 user nova-compute[75337]:   <serial>59596733-e5c9-4e48-8904-9251c84172c0</serial>
Nov 06 16:08:14 user nova-compute[75337]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 06 16:08:14 user nova-compute[75337]: </disk>
Nov 06 16:08:14 user nova-compute[75337]:  {{(pid=75337) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 16:08:14 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-b57e208d-bd2d-4704-8f64-338c06cd6c64 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Successfully detached device vdb from instance 9e2043cc-ff4e-43e9-9867-920de4809cc4 from the persistent domain config.
Nov 06 16:08:14 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-b57e208d-bd2d-4704-8f64-338c06cd6c64 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9e2043cc-ff4e-43e9-9867-920de4809cc4 from the live domain config. {{(pid=75337) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 06 16:08:14 user nova-compute[75337]: DEBUG nova.virt.libvirt.guest [None req-b57e208d-bd2d-4704-8f64-338c06cd6c64 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 16:08:14 user nova-compute[75337]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 16:08:14 user nova-compute[75337]:   <source dev="/dev/sdb"/>
Nov 06 16:08:14 user nova-compute[75337]:   <target dev="vdb" bus="virtio"/>
Nov 06 16:08:14 user nova-compute[75337]:   <serial>59596733-e5c9-4e48-8904-9251c84172c0</serial>
Nov 06 16:08:14 user nova-compute[75337]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 06 16:08:14 user nova-compute[75337]: </disk>
Nov 06 16:08:14 user nova-compute[75337]:  {{(pid=75337) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 16:08:14 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:08:14 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75337) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 16:08:14 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:08:14 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:08:14 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:08:14 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:08:14 user nova-compute[75337]: DEBUG nova.compute.manager [req-e1b58a31-bf57-44fa-8716-78bbebb6afb6 req-a10da72e-0356-4236-a1b9-8b9a23b618f4 service nova] [instance: d6eaef86-b841-4142-9549-31954fb34fa2] Received event network-vif-plugged-99bb43c1-3b95-4be2-a534-845c37778773 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:08:14 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-e1b58a31-bf57-44fa-8716-78bbebb6afb6 req-a10da72e-0356-4236-a1b9-8b9a23b618f4 service nova] Acquiring lock "d6eaef86-b841-4142-9549-31954fb34fa2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:08:14 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-e1b58a31-bf57-44fa-8716-78bbebb6afb6 req-a10da72e-0356-4236-a1b9-8b9a23b618f4 service nova] Lock "d6eaef86-b841-4142-9549-31954fb34fa2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:08:14 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-e1b58a31-bf57-44fa-8716-78bbebb6afb6 req-a10da72e-0356-4236-a1b9-8b9a23b618f4 service nova] Lock "d6eaef86-b841-4142-9549-31954fb34fa2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:08:14 user nova-compute[75337]: DEBUG nova.compute.manager [req-e1b58a31-bf57-44fa-8716-78bbebb6afb6 req-a10da72e-0356-4236-a1b9-8b9a23b618f4 service nova] [instance: d6eaef86-b841-4142-9549-31954fb34fa2] No waiting events found dispatching network-vif-plugged-99bb43c1-3b95-4be2-a534-845c37778773 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 16:08:14 user nova-compute[75337]: WARNING nova.compute.manager [req-e1b58a31-bf57-44fa-8716-78bbebb6afb6 req-a10da72e-0356-4236-a1b9-8b9a23b618f4 service nova] [instance: d6eaef86-b841-4142-9549-31954fb34fa2] Received unexpected event network-vif-plugged-99bb43c1-3b95-4be2-a534-845c37778773 for instance with vm_state active and task_state resize_finish.
Nov 06 16:08:14 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:08:14 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-b57e208d-bd2d-4704-8f64-338c06cd6c64 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9e2043cc-ff4e-43e9-9867-920de4809cc4 {{(pid=75337) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 06 16:08:15 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:08:15 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-26728e3b-9ac9-43f6-82b6-740c1ddb393c tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.340s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 16:08:15 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-26728e3b-9ac9-43f6-82b6-740c1ddb393c tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] <== connect_volume: return (1342ms) {'type': 'block', 'scsi_wwn': '26531333766646134', 'path': '/dev/sdd'} {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 16:08:15 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-26728e3b-9ac9-43f6-82b6-740c1ddb393c tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] [instance: f9c98d28-41f9-498f-8c1f-43517999775a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26531333766646134', 'path': '/dev/sdd'} {{(pid=75337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 16:08:15 user nova-compute[75337]: DEBUG nova.objects.instance [None req-26728e3b-9ac9-43f6-82b6-740c1ddb393c tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Lazy-loading 'flavor' on Instance uuid f9c98d28-41f9-498f-8c1f-43517999775a {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 16:08:15 user nova-compute[75337]: DEBUG nova.virt.libvirt.guest [None req-26728e3b-9ac9-43f6-82b6-740c1ddb393c tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] attach device xml: <disk type="block" device="disk">
Nov 06 16:08:15 user nova-compute[75337]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 16:08:15 user nova-compute[75337]:   <source dev="/dev/sdd"/>
Nov 06 16:08:15 user nova-compute[75337]:   <target dev="vdb" bus="virtio"/>
Nov 06 16:08:15 user nova-compute[75337]:   <serial>81b76252-f172-4a13-954b-87087c5eb447</serial>
Nov 06 16:08:15 user nova-compute[75337]: </disk>
Nov 06 16:08:15 user nova-compute[75337]:  {{(pid=75337) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 06 16:08:15 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:08:15 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-26728e3b-9ac9-43f6-82b6-740c1ddb393c tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] No BDM found with device name vda, not building metadata. {{(pid=75337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 16:08:15 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-26728e3b-9ac9-43f6-82b6-740c1ddb393c tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 16:08:15 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-26728e3b-9ac9-43f6-82b6-740c1ddb393c tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] No VIF found with MAC fa:16:3e:d6:6c:ea, not building metadata {{(pid=75337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 16:08:16 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-26728e3b-9ac9-43f6-82b6-740c1ddb393c tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Lock "f9c98d28-41f9-498f-8c1f-43517999775a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 25.010s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:08:17 user nova-compute[75337]: DEBUG nova.compute.manager [req-bfe54a87-c120-4e95-8b6e-bdeb3b365977 req-550d21e4-ab34-45a2-9914-1f24f49864f8 service nova] [instance: d6eaef86-b841-4142-9549-31954fb34fa2] Received event network-vif-plugged-99bb43c1-3b95-4be2-a534-845c37778773 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:08:17 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-bfe54a87-c120-4e95-8b6e-bdeb3b365977 req-550d21e4-ab34-45a2-9914-1f24f49864f8 service nova] Acquiring lock "d6eaef86-b841-4142-9549-31954fb34fa2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:08:17 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-bfe54a87-c120-4e95-8b6e-bdeb3b365977 req-550d21e4-ab34-45a2-9914-1f24f49864f8 service nova] Lock "d6eaef86-b841-4142-9549-31954fb34fa2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:08:17 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-bfe54a87-c120-4e95-8b6e-bdeb3b365977 req-550d21e4-ab34-45a2-9914-1f24f49864f8 service nova] Lock "d6eaef86-b841-4142-9549-31954fb34fa2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:08:17 user nova-compute[75337]: DEBUG nova.compute.manager [req-bfe54a87-c120-4e95-8b6e-bdeb3b365977 req-550d21e4-ab34-45a2-9914-1f24f49864f8 service nova] [instance: d6eaef86-b841-4142-9549-31954fb34fa2] No waiting events found dispatching network-vif-plugged-99bb43c1-3b95-4be2-a534-845c37778773 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 16:08:17 user nova-compute[75337]: WARNING nova.compute.manager [req-bfe54a87-c120-4e95-8b6e-bdeb3b365977 req-550d21e4-ab34-45a2-9914-1f24f49864f8 service nova] [instance: d6eaef86-b841-4142-9549-31954fb34fa2] Received unexpected event network-vif-plugged-99bb43c1-3b95-4be2-a534-845c37778773 for instance with vm_state active and task_state resize_finish.
Nov 06 16:08:17 user nova-compute[75337]: DEBUG nova.compute.manager [None req-e44d4b33-0b85-491f-8d42-9a35be2edcea tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: d6eaef86-b841-4142-9549-31954fb34fa2] Instance event wait completed in 0 seconds for  {{(pid=75337) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 16:08:17 user nova-compute[75337]: INFO nova.virt.libvirt.driver [-] [instance: d6eaef86-b841-4142-9549-31954fb34fa2] Instance running successfully.
Nov 06 16:08:17 user nova-compute[75337]: DEBUG nova.virt.libvirt.guest [None req-e44d4b33-0b85-491f-8d42-9a35be2edcea tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: d6eaef86-b841-4142-9549-31954fb34fa2] Failed to set time: agent not configured {{(pid=75337) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 06 16:08:17 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-e44d4b33-0b85-491f-8d42-9a35be2edcea tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: d6eaef86-b841-4142-9549-31954fb34fa2] finish_migration finished successfully. {{(pid=75337) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Nov 06 16:08:17 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:08:18 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:08:19 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:08:21 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:08:22 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-31e267db-ca1a-40b5-9e63-0276b3f2c14e tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Acquiring lock "f9c98d28-41f9-498f-8c1f-43517999775a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:08:22 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-31e267db-ca1a-40b5-9e63-0276b3f2c14e tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Lock "f9c98d28-41f9-498f-8c1f-43517999775a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:08:22 user nova-compute[75337]: DEBUG nova.objects.instance [None req-31e267db-ca1a-40b5-9e63-0276b3f2c14e tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Lazy-loading 'flavor' on Instance uuid f9c98d28-41f9-498f-8c1f-43517999775a {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 16:08:22 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-31e267db-ca1a-40b5-9e63-0276b3f2c14e tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Lock "f9c98d28-41f9-498f-8c1f-43517999775a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:08:22 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:08:22 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-31e267db-ca1a-40b5-9e63-0276b3f2c14e tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Acquiring lock "f9c98d28-41f9-498f-8c1f-43517999775a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:08:22 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-31e267db-ca1a-40b5-9e63-0276b3f2c14e tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Lock "f9c98d28-41f9-498f-8c1f-43517999775a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:08:22 user nova-compute[75337]: INFO nova.compute.manager [None req-31e267db-ca1a-40b5-9e63-0276b3f2c14e tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] [instance: f9c98d28-41f9-498f-8c1f-43517999775a] Attaching volume e489f049-8b52-46e0-9fc4-a27475db3aea to /dev/vdc
Nov 06 16:08:22 user nova-compute[75337]: DEBUG os_brick.utils [None req-31e267db-ca1a-40b5-9e63-0276b3f2c14e tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 16:08:22 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:08:22 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:08:22 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[46557f47-90be-416c-b831-392bcba8890f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4ff6411e45b8\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:08:22 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:08:22 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:08:22 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[493f066e-7c8d-4001-a226-ae61f3df18bb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:08:22 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:08:22 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:08:22 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a853672-475d-40eb-a614-a0a1faa536e7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:08:22 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[6127fa34-8349-46d8-95a0-2fa974159faa]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:08:22 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-31e267db-ca1a-40b5-9e63-0276b3f2c14e tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Running cmd (subprocess): nvme version {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:08:22 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-31e267db-ca1a-40b5-9e63-0276b3f2c14e tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] 'nvme version' failed. Not Retrying. {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 16:08:22 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.nvmeof [None req-31e267db-ca1a-40b5-9e63-0276b3f2c14e tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] nvme not present on system {{(pid=75337) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 16:08:22 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:08:22 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 16:08:22 user nova-compute[75337]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 16:08:22 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[cadd9383-4e3d-4107-9546-7de176da3dc7]: (4, '') {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:08:22 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.lightos [None req-31e267db-ca1a-40b5-9e63-0276b3f2c14e tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75337) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 16:08:22 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.lightos [None req-31e267db-ca1a-40b5-9e63-0276b3f2c14e tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 16:08:22 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.lightos [None req-31e267db-ca1a-40b5-9e63-0276b3f2c14e tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] LIGHTOS: no hostnqn found. {{(pid=75337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 16:08:22 user nova-compute[75337]: DEBUG os_brick.utils [None req-31e267db-ca1a-40b5-9e63-0276b3f2c14e tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4ff6411e45b8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 16:08:22 user nova-compute[75337]: DEBUG nova.virt.block_device [None req-31e267db-ca1a-40b5-9e63-0276b3f2c14e tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] [instance: f9c98d28-41f9-498f-8c1f-43517999775a] Updating existing volume attachment record: 357d84bc-7636-4e9a-ac8e-d9c9cbdb5632 {{(pid=75337) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 16:08:23 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:08:23 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:08:24 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:08:27 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:08:27 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Starting heal instance info cache {{(pid=75337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 16:08:27 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "refresh_cache-d6eaef86-b841-4142-9549-31954fb34fa2" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 16:08:27 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquired lock "refresh_cache-d6eaef86-b841-4142-9549-31954fb34fa2" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 16:08:27 user nova-compute[75337]: DEBUG nova.network.neutron [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] [instance: d6eaef86-b841-4142-9549-31954fb34fa2] Forcefully refreshing network info cache for instance {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 16:08:28 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:08:28 user nova-compute[75337]: DEBUG nova.network.neutron [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] [instance: d6eaef86-b841-4142-9549-31954fb34fa2] Updating instance_info_cache with network_info: [{"id": "99bb43c1-3b95-4be2-a534-845c37778773", "address": "fa:16:3e:98:6e:e3", "network": {"id": "7f234ecf-bfa6-4316-9dce-c15050ba7914", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1378707892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "243647103fd44f629e0f40be0b56407e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99bb43c1-3b", "ovs_interfaceid": "99bb43c1-3b95-4be2-a534-845c37778773", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 16:08:28 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Releasing lock "refresh_cache-d6eaef86-b841-4142-9549-31954fb34fa2" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 16:08:28 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] [instance: d6eaef86-b841-4142-9549-31954fb34fa2] Updated the network info_cache for instance {{(pid=75337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 16:08:28 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager.update_available_resource {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:08:28 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:08:28 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:08:28 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:08:28 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Auditing locally available compute resources for user (node: user) {{(pid=75337) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 16:08:28 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9c98d28-41f9-498f-8c1f-43517999775a/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:08:28 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9c98d28-41f9-498f-8c1f-43517999775a/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:08:28 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9c98d28-41f9-498f-8c1f-43517999775a/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:08:29 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9c98d28-41f9-498f-8c1f-43517999775a/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:08:29 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 16:08:29 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04bedc8f-088d-41c4-8cbf-c68602e916c6/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:08:29 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04bedc8f-088d-41c4-8cbf-c68602e916c6/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:08:29 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04bedc8f-088d-41c4-8cbf-c68602e916c6/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:08:29 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04bedc8f-088d-41c4-8cbf-c68602e916c6/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:08:29 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01b61f9a-2591-4714-b18e-54f674a441ab/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:08:29 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01b61f9a-2591-4714-b18e-54f674a441ab/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:08:29 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01b61f9a-2591-4714-b18e-54f674a441ab/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:08:29 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01b61f9a-2591-4714-b18e-54f674a441ab/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:08:29 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 16:08:29 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6110b34a-6fd3-45fc-911d-4e5d3c7f2d78/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:08:29 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:08:29 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6110b34a-6fd3-45fc-911d-4e5d3c7f2d78/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:08:29 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6110b34a-6fd3-45fc-911d-4e5d3c7f2d78/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:08:30 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6110b34a-6fd3-45fc-911d-4e5d3c7f2d78/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:08:30 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e2043cc-ff4e-43e9-9867-920de4809cc4/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:08:30 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e2043cc-ff4e-43e9-9867-920de4809cc4/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:08:30 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e2043cc-ff4e-43e9-9867-920de4809cc4/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:08:30 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e2043cc-ff4e-43e9-9867-920de4809cc4/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:08:30 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88330c21-69e0-4d82-ac4d-b9e5e849f487/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:08:30 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88330c21-69e0-4d82-ac4d-b9e5e849f487/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:08:30 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88330c21-69e0-4d82-ac4d-b9e5e849f487/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:08:30 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88330c21-69e0-4d82-ac4d-b9e5e849f487/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:08:31 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 16:08:31 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 16:08:31 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Hypervisor/Node resource view: name=user free_ram=7920MB free_disk=24.867218017578125GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75337) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 16:08:31 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:08:31 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:08:31 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Applying migration context for instance d6eaef86-b841-4142-9549-31954fb34fa2 as it has an incoming, in-progress migration 9b362311-b7f0-4a00-b157-930adde8974f. Migration status is finished {{(pid=75337) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 06 16:08:31 user nova-compute[75337]: INFO nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] [instance: d6eaef86-b841-4142-9549-31954fb34fa2] Updating resource usage from migration 9b362311-b7f0-4a00-b157-930adde8974f
Nov 06 16:08:31 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 6110b34a-6fd3-45fc-911d-4e5d3c7f2d78 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 16:08:31 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 01b61f9a-2591-4714-b18e-54f674a441ab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 16:08:31 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 9e2043cc-ff4e-43e9-9867-920de4809cc4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 16:08:31 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance f9c98d28-41f9-498f-8c1f-43517999775a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 16:08:31 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 88330c21-69e0-4d82-ac4d-b9e5e849f487 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 16:08:31 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Migration 9b362311-b7f0-4a00-b157-930adde8974f is active on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 06 16:08:31 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance d6eaef86-b841-4142-9549-31954fb34fa2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 16:08:31 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 04bedc8f-088d-41c4-8cbf-c68602e916c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 16:08:31 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 16:08:31 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 16:08:31 user nova-compute[75337]: DEBUG nova.compute.manager [req-a703fa6b-6225-4598-af9b-747c784f21b4 req-f98d7faf-ba4b-47eb-9546-e14ecd73b66c service nova] [instance: 88330c21-69e0-4d82-ac4d-b9e5e849f487] Received event network-changed-4ae4cf27-266c-40f8-a268-1d03f150f318 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:08:31 user nova-compute[75337]: DEBUG nova.compute.manager [req-a703fa6b-6225-4598-af9b-747c784f21b4 req-f98d7faf-ba4b-47eb-9546-e14ecd73b66c service nova] [instance: 88330c21-69e0-4d82-ac4d-b9e5e849f487] Refreshing instance network info cache due to event network-changed-4ae4cf27-266c-40f8-a268-1d03f150f318. {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 16:08:31 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-a703fa6b-6225-4598-af9b-747c784f21b4 req-f98d7faf-ba4b-47eb-9546-e14ecd73b66c service nova] Acquiring lock "refresh_cache-88330c21-69e0-4d82-ac4d-b9e5e849f487" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 16:08:31 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-a703fa6b-6225-4598-af9b-747c784f21b4 req-f98d7faf-ba4b-47eb-9546-e14ecd73b66c service nova] Acquired lock "refresh_cache-88330c21-69e0-4d82-ac4d-b9e5e849f487" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 16:08:31 user nova-compute[75337]: DEBUG nova.network.neutron [req-a703fa6b-6225-4598-af9b-747c784f21b4 req-f98d7faf-ba4b-47eb-9546-e14ecd73b66c service nova] [instance: 88330c21-69e0-4d82-ac4d-b9e5e849f487] Refreshing network info cache for port 4ae4cf27-266c-40f8-a268-1d03f150f318 {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 16:08:31 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 16:08:31 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 16:08:31 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Compute_service record updated for user:user {{(pid=75337) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 16:08:31 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.467s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:08:32 user nova-compute[75337]: DEBUG nova.network.neutron [req-a703fa6b-6225-4598-af9b-747c784f21b4 req-f98d7faf-ba4b-47eb-9546-e14ecd73b66c service nova] [instance: 88330c21-69e0-4d82-ac4d-b9e5e849f487] Updated VIF entry in instance network info cache for port 4ae4cf27-266c-40f8-a268-1d03f150f318. {{(pid=75337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 16:08:32 user nova-compute[75337]: DEBUG nova.network.neutron [req-a703fa6b-6225-4598-af9b-747c784f21b4 req-f98d7faf-ba4b-47eb-9546-e14ecd73b66c service nova] [instance: 88330c21-69e0-4d82-ac4d-b9e5e849f487] Updating instance_info_cache with network_info: [{"id": "4ae4cf27-266c-40f8-a268-1d03f150f318", "address": "fa:16:3e:d4:3f:d4", "network": {"id": "40ec2d9f-fe05-45bb-8321-e065c7c5cab0", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-863555405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b8417f9bf0f4ccbbcb9823c8825a3d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ae4cf27-26", "ovs_interfaceid": "4ae4cf27-266c-40f8-a268-1d03f150f318", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 16:08:32 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-a703fa6b-6225-4598-af9b-747c784f21b4 req-f98d7faf-ba4b-47eb-9546-e14ecd73b66c service nova] Releasing lock "refresh_cache-88330c21-69e0-4d82-ac4d-b9e5e849f487" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 16:08:33 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:08:34 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:08:34 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:08:34 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-b57e208d-bd2d-4704-8f64-338c06cd6c64 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 9e2043cc-ff4e-43e9-9867-920de4809cc4 is timed out.
Nov 06 16:08:34 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-b57e208d-bd2d-4704-8f64-338c06cd6c64 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Successfully detached device vdb from instance 9e2043cc-ff4e-43e9-9867-920de4809cc4 from the live domain config.
Nov 06 16:08:34 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b57e208d-bd2d-4704-8f64-338c06cd6c64 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] [instance: 9e2043cc-ff4e-43e9-9867-920de4809cc4] calling os-brick to detach iSCSI Volume {{(pid=75337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 16:08:34 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b57e208d-bd2d-4704-8f64-338c06cd6c64 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2abc33d0c0>, {'target_iqn': 'iqn.2010-10.org.openstack:59596733-e5c9-4e48-8904-9251c84172c0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aXDTwxOo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 16:08:34 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-b57e208d-bd2d-4704-8f64-338c06cd6c64 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 16:08:34 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-b57e208d-bd2d-4704-8f64-338c06cd6c64 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 16:08:34 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-b57e208d-bd2d-4704-8f64-338c06cd6c64 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 16:08:34 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:08:35 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:08:35 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ea78ed5-a786-4380-8bd9-8a7a56c10c32]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:81b76252-f172-4a13-954b-87087c5eb447\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:59596733-e5c9-4e48-8904-9251c84172c0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:08:35 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b57e208d-bd2d-4704-8f64-338c06cd6c64 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 16:08:35 user nova-compute[75337]: No targets found.
Nov 06 16:08:35 user nova-compute[75337]: iSNS:
Nov 06 16:08:35 user nova-compute[75337]: No targets found.
Nov 06 16:08:35 user nova-compute[75337]: STATIC:
Nov 06 16:08:35 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:81b76252-f172-4a13-954b-87087c5eb447
Nov 06 16:08:35 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 16:08:35 user nova-compute[75337]:                 Iface Name: default
Nov 06 16:08:35 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:59596733-e5c9-4e48-8904-9251c84172c0
Nov 06 16:08:35 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 16:08:35 user nova-compute[75337]:                 Iface Name: default
Nov 06 16:08:35 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139
Nov 06 16:08:35 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 16:08:35 user nova-compute[75337]:                 Iface Name: default
Nov 06 16:08:35 user nova-compute[75337]: FIRMWARE:
Nov 06 16:08:35 user nova-compute[75337]: No targets found.
Nov 06 16:08:35 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 16:08:35 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b57e208d-bd2d-4704-8f64-338c06cd6c64 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 16:08:35 user nova-compute[75337]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 16:08:35 user nova-compute[75337]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75337) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 16:08:35 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b57e208d-bd2d-4704-8f64-338c06cd6c64 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:59596733-e5c9-4e48-8904-9251c84172c0', 0)] {{(pid=75337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 16:08:35 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:08:35 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:08:35 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[03cf530a-8ea7-465e-9bce-cc92ee097196]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:59596733-e5c9-4e48-8904-9251c84172c0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:81b76252-f172-4a13-954b-87087c5eb447\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:08:35 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:08:35 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:08:35 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ad88053-a2dc-47b6-9870-9444faf41f6c]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59596733-e5c9-4e48-8904-9251c84172c0 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b76252-f172-4a13-954b-87087c5eb447 (non-flash)\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:08:35 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b57e208d-bd2d-4704-8f64-338c06cd6c64 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59596733-e5c9-4e48-8904-9251c84172c0 (non-flash)
Nov 06 16:08:35 user nova-compute[75337]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139 (non-flash)
Nov 06 16:08:35 user nova-compute[75337]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b76252-f172-4a13-954b-87087c5eb447 (non-flash)
Nov 06 16:08:35 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 16:08:35 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b57e208d-bd2d-4704-8f64-338c06cd6c64 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59596733-e5c9-4e48-8904-9251c84172c0 (non-flash)
Nov 06 16:08:35 user nova-compute[75337]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139 (non-flash)
Nov 06 16:08:35 user nova-compute[75337]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b76252-f172-4a13-954b-87087c5eb447 (non-flash)
Nov 06 16:08:35 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 16:08:35 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b57e208d-bd2d-4704-8f64-338c06cd6c64 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2a9c3c8790>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:59596733-e5c9-4e48-8904-9251c84172c0'): ({'sdb'}, set())}) {{(pid=75337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 16:08:35 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-b57e208d-bd2d-4704-8f64-338c06cd6c64 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Removing single pathed devices sdb {{(pid=75337) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 16:08:35 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:08:35 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:08:35 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c490e82-a837-42bf-a6db-12d0c05c5904]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:08:35 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:08:35 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:08:35 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[c66bb5fd-eb44-4248-bb67-a380e4833b69]: (4, ('ok\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:08:35 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-b57e208d-bd2d-4704-8f64-338c06cd6c64 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Flushing IO for device /dev/sdb {{(pid=75337) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 16:08:35 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:08:35 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:08:35 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c5f8b94-3a0f-4376-b7e9-bf218d36c7b9]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:08:35 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-b57e208d-bd2d-4704-8f64-338c06cd6c64 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75337) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 16:08:35 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:08:35 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:08:35 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[1737104c-7b06-46ce-b259-dd23b65c6e8a]: (4, ('1', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:08:35 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-b57e208d-bd2d-4704-8f64-338c06cd6c64 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 16:08:35 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-b57e208d-bd2d-4704-8f64-338c06cd6c64 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] SCSI volumes sdb have been removed. {{(pid=75337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 16:08:35 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b57e208d-bd2d-4704-8f64-338c06cd6c64 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:59596733-e5c9-4e48-8904-9251c84172c0')] {{(pid=75337) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 16:08:35 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59596733-e5c9-4e48-8904-9251c84172c0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:08:35 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59596733-e5c9-4e48-8904-9251c84172c0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:08:35 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3cf2d01-b5c7-49e1-82cb-7b6133f47e6e]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:08:35 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b57e208d-bd2d-4704-8f64-338c06cd6c64 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:08:35 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59596733-e5c9-4e48-8904-9251c84172c0 -p 172.16.0.220:3260 --logout {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:08:35 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59596733-e5c9-4e48-8904-9251c84172c0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.045s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:08:35 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4b2ba6a-65c8-48da-97b4-056295722b7d]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:59596733-e5c9-4e48-8904-9251c84172c0, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:59596733-e5c9-4e48-8904-9251c84172c0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:08:35 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b57e208d-bd2d-4704-8f64-338c06cd6c64 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:59596733-e5c9-4e48-8904-9251c84172c0, portal: 172.16.0.220,3260]
Nov 06 16:08:35 user nova-compute[75337]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:59596733-e5c9-4e48-8904-9251c84172c0, portal: 172.16.0.220,3260] successful.
Nov 06 16:08:35 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:08:35 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59596733-e5c9-4e48-8904-9251c84172c0 -p 172.16.0.220:3260 --op delete {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:08:35 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59596733-e5c9-4e48-8904-9251c84172c0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:08:35 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f785544-cb22-45bb-a13c-bc40258aeb98]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:08:35 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b57e208d-bd2d-4704-8f64-338c06cd6c64 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:08:35 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-b57e208d-bd2d-4704-8f64-338c06cd6c64 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 16:08:35 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b57e208d-bd2d-4704-8f64-338c06cd6c64 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] <== disconnect_volume: return (313ms) None {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 16:08:35 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b57e208d-bd2d-4704-8f64-338c06cd6c64 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] [instance: 9e2043cc-ff4e-43e9-9867-920de4809cc4] Disconnected iSCSI Volume {{(pid=75337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 16:08:36 user nova-compute[75337]: DEBUG nova.objects.instance [None req-b57e208d-bd2d-4704-8f64-338c06cd6c64 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Lazy-loading 'flavor' on Instance uuid 9e2043cc-ff4e-43e9-9867-920de4809cc4 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 16:08:36 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-b57e208d-bd2d-4704-8f64-338c06cd6c64 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Lock "9e2043cc-ff4e-43e9-9867-920de4809cc4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.030s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:08:38 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:08:39 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:08:41 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-0e8e0cc8-d8c5-4d96-a9d5-aa801b469edf tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Acquiring lock "88330c21-69e0-4d82-ac4d-b9e5e849f487" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:08:41 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-0e8e0cc8-d8c5-4d96-a9d5-aa801b469edf tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Lock "88330c21-69e0-4d82-ac4d-b9e5e849f487" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.003s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:08:41 user nova-compute[75337]: DEBUG nova.objects.instance [None req-0e8e0cc8-d8c5-4d96-a9d5-aa801b469edf tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Lazy-loading 'flavor' on Instance uuid 88330c21-69e0-4d82-ac4d-b9e5e849f487 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 16:08:41 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-0e8e0cc8-d8c5-4d96-a9d5-aa801b469edf tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Lock "88330c21-69e0-4d82-ac4d-b9e5e849f487" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:08:41 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-0e8e0cc8-d8c5-4d96-a9d5-aa801b469edf tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Acquiring lock "88330c21-69e0-4d82-ac4d-b9e5e849f487" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:08:41 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-0e8e0cc8-d8c5-4d96-a9d5-aa801b469edf tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Lock "88330c21-69e0-4d82-ac4d-b9e5e849f487" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:08:41 user nova-compute[75337]: INFO nova.compute.manager [None req-0e8e0cc8-d8c5-4d96-a9d5-aa801b469edf tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] [instance: 88330c21-69e0-4d82-ac4d-b9e5e849f487] Attaching volume fd402fa7-6910-4e0a-8539-e467e32c337d to /dev/vdb
Nov 06 16:08:41 user nova-compute[75337]: DEBUG os_brick.utils [None req-0e8e0cc8-d8c5-4d96-a9d5-aa801b469edf tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 16:08:41 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:08:41 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:08:41 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[239ea89e-3948-408b-8987-92fed3a37aec]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4ff6411e45b8\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:08:41 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:08:41 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:08:41 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cf61119-8e58-4c18-bf76-c49eddd7e419]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:08:41 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:08:41 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:08:41 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[867bd7d9-fe70-4803-a953-02bd0c279238]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:08:41 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[14006fda-00db-452f-9d8e-1144634f4df3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:08:41 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-0e8e0cc8-d8c5-4d96-a9d5-aa801b469edf tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Running cmd (subprocess): nvme version {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:08:42 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-0e8e0cc8-d8c5-4d96-a9d5-aa801b469edf tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] 'nvme version' failed. Not Retrying. {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 16:08:42 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0e8e0cc8-d8c5-4d96-a9d5-aa801b469edf tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] nvme not present on system {{(pid=75337) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 16:08:42 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:08:42 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 16:08:42 user nova-compute[75337]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 16:08:42 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cb29ecd-2c31-45f0-b357-e206dffc6f6d]: (4, '') {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:08:42 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.lightos [None req-0e8e0cc8-d8c5-4d96-a9d5-aa801b469edf tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75337) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 16:08:42 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.lightos [None req-0e8e0cc8-d8c5-4d96-a9d5-aa801b469edf tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 16:08:42 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.lightos [None req-0e8e0cc8-d8c5-4d96-a9d5-aa801b469edf tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] LIGHTOS: no hostnqn found. {{(pid=75337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 16:08:42 user nova-compute[75337]: DEBUG os_brick.utils [None req-0e8e0cc8-d8c5-4d96-a9d5-aa801b469edf tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4ff6411e45b8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 16:08:42 user nova-compute[75337]: DEBUG nova.virt.block_device [None req-0e8e0cc8-d8c5-4d96-a9d5-aa801b469edf tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] [instance: 88330c21-69e0-4d82-ac4d-b9e5e849f487] Updating existing volume attachment record: 55e8448e-9aa7-4069-92a4-5737c26d9bfe {{(pid=75337) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 16:08:43 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:08:44 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:08:48 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:08:49 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:08:49 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:08:53 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:08:55 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:08:57 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:08:58 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:08:59 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:09:01 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:09:03 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:09:04 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:09:04 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:09:05 user nova-compute[75337]: DEBUG nova.compute.manager [req-8bc1c370-ca41-4a93-bd3e-e5a14c270c37 req-ed69a9c3-c8c0-4de4-b8ec-e21451cf512f service nova] [instance: 9e2043cc-ff4e-43e9-9867-920de4809cc4] Received event network-changed-36f87e2c-dbfb-484a-99b8-6a77e3bb986a {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:09:05 user nova-compute[75337]: DEBUG nova.compute.manager [req-8bc1c370-ca41-4a93-bd3e-e5a14c270c37 req-ed69a9c3-c8c0-4de4-b8ec-e21451cf512f service nova] [instance: 9e2043cc-ff4e-43e9-9867-920de4809cc4] Refreshing instance network info cache due to event network-changed-36f87e2c-dbfb-484a-99b8-6a77e3bb986a. {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 16:09:05 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-8bc1c370-ca41-4a93-bd3e-e5a14c270c37 req-ed69a9c3-c8c0-4de4-b8ec-e21451cf512f service nova] Acquiring lock "refresh_cache-9e2043cc-ff4e-43e9-9867-920de4809cc4" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 16:09:05 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-8bc1c370-ca41-4a93-bd3e-e5a14c270c37 req-ed69a9c3-c8c0-4de4-b8ec-e21451cf512f service nova] Acquired lock "refresh_cache-9e2043cc-ff4e-43e9-9867-920de4809cc4" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 16:09:05 user nova-compute[75337]: DEBUG nova.network.neutron [req-8bc1c370-ca41-4a93-bd3e-e5a14c270c37 req-ed69a9c3-c8c0-4de4-b8ec-e21451cf512f service nova] [instance: 9e2043cc-ff4e-43e9-9867-920de4809cc4] Refreshing network info cache for port 36f87e2c-dbfb-484a-99b8-6a77e3bb986a {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 16:09:05 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-d198019d-7c4b-41f1-949d-81c1108d5717 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Acquiring lock "9e2043cc-ff4e-43e9-9867-920de4809cc4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:09:05 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-d198019d-7c4b-41f1-949d-81c1108d5717 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Lock "9e2043cc-ff4e-43e9-9867-920de4809cc4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:09:05 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-d198019d-7c4b-41f1-949d-81c1108d5717 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Acquiring lock "9e2043cc-ff4e-43e9-9867-920de4809cc4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:09:05 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-d198019d-7c4b-41f1-949d-81c1108d5717 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Lock "9e2043cc-ff4e-43e9-9867-920de4809cc4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:09:05 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-d198019d-7c4b-41f1-949d-81c1108d5717 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Lock "9e2043cc-ff4e-43e9-9867-920de4809cc4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:09:05 user nova-compute[75337]: INFO nova.compute.manager [None req-d198019d-7c4b-41f1-949d-81c1108d5717 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] [instance: 9e2043cc-ff4e-43e9-9867-920de4809cc4] Terminating instance
Nov 06 16:09:05 user nova-compute[75337]: DEBUG nova.compute.manager [None req-d198019d-7c4b-41f1-949d-81c1108d5717 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] [instance: 9e2043cc-ff4e-43e9-9867-920de4809cc4] Start destroying the instance on the hypervisor. {{(pid=75337) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 16:09:05 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:09:05 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:09:05 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:09:05 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:09:05 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:09:05 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:09:05 user nova-compute[75337]: DEBUG nova.network.neutron [req-8bc1c370-ca41-4a93-bd3e-e5a14c270c37 req-ed69a9c3-c8c0-4de4-b8ec-e21451cf512f service nova] [instance: 9e2043cc-ff4e-43e9-9867-920de4809cc4] Updated VIF entry in instance network info cache for port 36f87e2c-dbfb-484a-99b8-6a77e3bb986a. {{(pid=75337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 16:09:05 user nova-compute[75337]: DEBUG nova.network.neutron [req-8bc1c370-ca41-4a93-bd3e-e5a14c270c37 req-ed69a9c3-c8c0-4de4-b8ec-e21451cf512f service nova] [instance: 9e2043cc-ff4e-43e9-9867-920de4809cc4] Updating instance_info_cache with network_info: [{"id": "36f87e2c-dbfb-484a-99b8-6a77e3bb986a", "address": "fa:16:3e:a0:7d:db", "network": {"id": "df5f1c2e-c934-4237-aee6-f070a198c4ac", "bridge": "br-int", "label": "tempest-TestStampPattern-1883369969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37b65a37b3ac4a92af0279d7ef3b9637", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36f87e2c-db", "ovs_interfaceid": "36f87e2c-dbfb-484a-99b8-6a77e3bb986a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 16:09:05 user nova-compute[75337]: INFO nova.virt.libvirt.driver [-] [instance: 9e2043cc-ff4e-43e9-9867-920de4809cc4] Instance destroyed successfully.
Nov 06 16:09:05 user nova-compute[75337]: DEBUG nova.objects.instance [None req-d198019d-7c4b-41f1-949d-81c1108d5717 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Lazy-loading 'resources' on Instance uuid 9e2043cc-ff4e-43e9-9867-920de4809cc4 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 16:09:05 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-8bc1c370-ca41-4a93-bd3e-e5a14c270c37 req-ed69a9c3-c8c0-4de4-b8ec-e21451cf512f service nova] Releasing lock "refresh_cache-9e2043cc-ff4e-43e9-9867-920de4809cc4" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 16:09:05 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-d198019d-7c4b-41f1-949d-81c1108d5717 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T16:04:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1239054997',display_name='tempest-TestStampPattern-server-1239054997',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1239054997',id=43,image_ref='3deab4bc-5690-40b0-91cd-fced7f8b39bd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMMCtkcnnPytdqY3MPUgpmiSS7xeTmnpNw4yaIWZePSkgldKNk3oCL2U4/sFc1ScnWZoqLzBjkjfNxl1aD3owimjf0HTAAfgYQIOjLMlBJeg0uRD4v0ywlrz4Y1mxBwe3Q==',key_name='tempest-TestStampPattern-1350094120',keypairs=<?>,launch_index=0,launched_at=2023-11-06T16:05:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='37b65a37b3ac4a92af0279d7ef3b9637',ramdisk_id='',reservation_id='r-ips8c99q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='01b61f9a-2591-4714-b18e-54f674a441ab',image_min_disk='1',image_min_ram='0',image_owner_id='37b65a37b3ac4a92af0279d7ef3b9637',image_owner_project_name='tempest-TestStampPattern-2127170584',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-2127170584-project-member',image_user_id='b551ef2185264d24b3af5f38bd583701',owner_project_name='tempest-TestStampPattern-2127170584',owner_user_name='tempest-TestStampPattern-2127170584-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T16:05:06Z,user_data=None,user_id='b551ef2185264d24b3af5f38bd583701',uuid=9e2043cc-ff4e-43e9-9867-920de4809cc4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "36f87e2c-dbfb-484a-99b8-6a77e3bb986a", "address": "fa:16:3e:a0:7d:db", "network": {"id": "df5f1c2e-c934-4237-aee6-f070a198c4ac", "bridge": "br-int", "label": "tempest-TestStampPattern-1883369969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37b65a37b3ac4a92af0279d7ef3b9637", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36f87e2c-db", "ovs_interfaceid": "36f87e2c-dbfb-484a-99b8-6a77e3bb986a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 16:09:05 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-d198019d-7c4b-41f1-949d-81c1108d5717 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Converting VIF {"id": "36f87e2c-dbfb-484a-99b8-6a77e3bb986a", "address": "fa:16:3e:a0:7d:db", "network": {"id": "df5f1c2e-c934-4237-aee6-f070a198c4ac", "bridge": "br-int", "label": "tempest-TestStampPattern-1883369969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37b65a37b3ac4a92af0279d7ef3b9637", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36f87e2c-db", "ovs_interfaceid": "36f87e2c-dbfb-484a-99b8-6a77e3bb986a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 16:09:05 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-d198019d-7c4b-41f1-949d-81c1108d5717 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a0:7d:db,bridge_name='br-int',has_traffic_filtering=True,id=36f87e2c-dbfb-484a-99b8-6a77e3bb986a,network=Network(df5f1c2e-c934-4237-aee6-f070a198c4ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36f87e2c-db') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 16:09:05 user nova-compute[75337]: DEBUG os_vif [None req-d198019d-7c4b-41f1-949d-81c1108d5717 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a0:7d:db,bridge_name='br-int',has_traffic_filtering=True,id=36f87e2c-dbfb-484a-99b8-6a77e3bb986a,network=Network(df5f1c2e-c934-4237-aee6-f070a198c4ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36f87e2c-db') {{(pid=75337) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 16:09:05 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:09:05 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap36f87e2c-db, bridge=br-int, if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 16:09:05 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:09:05 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:09:05 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:09:05 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=09056f81-6aa3-4218-aa16-b4f1b3f139e6) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 16:09:05 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:09:05 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:09:05 user nova-compute[75337]: INFO os_vif [None req-d198019d-7c4b-41f1-949d-81c1108d5717 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a0:7d:db,bridge_name='br-int',has_traffic_filtering=True,id=36f87e2c-dbfb-484a-99b8-6a77e3bb986a,network=Network(df5f1c2e-c934-4237-aee6-f070a198c4ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36f87e2c-db')
Nov 06 16:09:05 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-d198019d-7c4b-41f1-949d-81c1108d5717 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] [instance: 9e2043cc-ff4e-43e9-9867-920de4809cc4] Deleting instance files /opt/stack/data/nova/instances/9e2043cc-ff4e-43e9-9867-920de4809cc4_del
Nov 06 16:09:05 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-d198019d-7c4b-41f1-949d-81c1108d5717 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] [instance: 9e2043cc-ff4e-43e9-9867-920de4809cc4] Deletion of /opt/stack/data/nova/instances/9e2043cc-ff4e-43e9-9867-920de4809cc4_del complete
Nov 06 16:09:06 user nova-compute[75337]: INFO nova.compute.manager [None req-d198019d-7c4b-41f1-949d-81c1108d5717 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] [instance: 9e2043cc-ff4e-43e9-9867-920de4809cc4] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 06 16:09:06 user nova-compute[75337]: DEBUG oslo.service.loopingcall [None req-d198019d-7c4b-41f1-949d-81c1108d5717 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75337) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 16:09:06 user nova-compute[75337]: DEBUG nova.compute.manager [-] [instance: 9e2043cc-ff4e-43e9-9867-920de4809cc4] Deallocating network for instance {{(pid=75337) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 16:09:06 user nova-compute[75337]: DEBUG nova.network.neutron [-] [instance: 9e2043cc-ff4e-43e9-9867-920de4809cc4] deallocate_for_instance() {{(pid=75337) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 16:09:06 user nova-compute[75337]: DEBUG nova.network.neutron [-] [instance: 9e2043cc-ff4e-43e9-9867-920de4809cc4] Updating instance_info_cache with network_info: [] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 16:09:06 user nova-compute[75337]: INFO nova.compute.manager [-] [instance: 9e2043cc-ff4e-43e9-9867-920de4809cc4] Took 0.65 seconds to deallocate network for instance.
Nov 06 16:09:06 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-d198019d-7c4b-41f1-949d-81c1108d5717 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:09:06 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-d198019d-7c4b-41f1-949d-81c1108d5717 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:09:06 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-d198019d-7c4b-41f1-949d-81c1108d5717 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 16:09:07 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-d198019d-7c4b-41f1-949d-81c1108d5717 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 16:09:07 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-d198019d-7c4b-41f1-949d-81c1108d5717 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.302s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:09:07 user nova-compute[75337]: INFO nova.scheduler.client.report [None req-d198019d-7c4b-41f1-949d-81c1108d5717 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Deleted allocations for instance 9e2043cc-ff4e-43e9-9867-920de4809cc4
Nov 06 16:09:07 user nova-compute[75337]: DEBUG nova.compute.manager [req-0b8761ca-1448-4a9b-adab-83c794b36a98 req-f2aa156a-e821-42e1-9352-e9050ee273c8 service nova] [instance: 9e2043cc-ff4e-43e9-9867-920de4809cc4] Received event network-vif-deleted-36f87e2c-dbfb-484a-99b8-6a77e3bb986a {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:09:07 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-d198019d-7c4b-41f1-949d-81c1108d5717 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Lock "9e2043cc-ff4e-43e9-9867-920de4809cc4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.048s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:09:09 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:09:10 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:09:13 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:09:14 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:09:15 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:09:16 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:09:16 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75337) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 16:09:17 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:09:19 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:09:19 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:09:20 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:09:21 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-31e267db-ca1a-40b5-9e63-0276b3f2c14e tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] [instance: f9c98d28-41f9-498f-8c1f-43517999775a] Calling os-brick to attach iSCSI Volume {{(pid=75337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 16:09:21 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-31e267db-ca1a-40b5-9e63-0276b3f2c14e tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2abc33d0c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e489f049-8b52-46e0-9fc4-a27475db3aea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lQXFwLNH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 16:09:21 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-31e267db-ca1a-40b5-9e63-0276b3f2c14e tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 16:09:21 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-31e267db-ca1a-40b5-9e63-0276b3f2c14e tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 16:09:21 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-31e267db-ca1a-40b5-9e63-0276b3f2c14e tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 16:09:21 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-31e267db-ca1a-40b5-9e63-0276b3f2c14e tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 16:09:21 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-31e267db-ca1a-40b5-9e63-0276b3f2c14e tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e489f049-8b52-46e0-9fc4-a27475db3aea" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 16:09:21 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-31e267db-ca1a-40b5-9e63-0276b3f2c14e tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e489f049-8b52-46e0-9fc4-a27475db3aea" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.018s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 16:09:21 user nova-compute[75337]: INFO os_brick.initiator.connectors.iscsi [None req-31e267db-ca1a-40b5-9e63-0276b3f2c14e tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 16:09:21 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e489f049-8b52-46e0-9fc4-a27475db3aea -p 172.16.0.220:3260 {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:09:21 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e8e0cc8-d8c5-4d96-a9d5-aa801b469edf tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] [instance: 88330c21-69e0-4d82-ac4d-b9e5e849f487] Calling os-brick to attach iSCSI Volume {{(pid=75337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 16:09:21 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e8e0cc8-d8c5-4d96-a9d5-aa801b469edf tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2abc33d0c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fd402fa7-6910-4e0a-8539-e467e32c337d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jzHhdsIv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 16:09:21 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-0e8e0cc8-d8c5-4d96-a9d5-aa801b469edf tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 16:09:21 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-0e8e0cc8-d8c5-4d96-a9d5-aa801b469edf tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 16:09:22 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e489f049-8b52-46e0-9fc4-a27475db3aea -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:09:22 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[098e6fa6-80d7-41f1-9c82-c0879c1244e7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:09:22 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-31e267db-ca1a-40b5-9e63-0276b3f2c14e tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 16:09:22 user nova-compute[75337]:  {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:09:22 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e489f049-8b52-46e0-9fc4-a27475db3aea -p 172.16.0.220:3260 --interface default --op new {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:09:22 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e489f049-8b52-46e0-9fc4-a27475db3aea -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:09:22 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[20cd9b06-6654-4081-8e74-c66aba81d80e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e489f049-8b52-46e0-9fc4-a27475db3aea] added\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:09:22 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-31e267db-ca1a-40b5-9e63-0276b3f2c14e tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e489f049-8b52-46e0-9fc4-a27475db3aea] added
Nov 06 16:09:22 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:09:22 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e489f049-8b52-46e0-9fc4-a27475db3aea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:09:22 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e489f049-8b52-46e0-9fc4-a27475db3aea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:09:22 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[57f9e687-8827-41bc-8aef-44ed840e8f00]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:09:22 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-31e267db-ca1a-40b5-9e63-0276b3f2c14e tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:09:22 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e489f049-8b52-46e0-9fc4-a27475db3aea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:09:22 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e489f049-8b52-46e0-9fc4-a27475db3aea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:09:22 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[13d9d80b-13f8-4264-bc8a-ef2393ec6b07]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:09:22 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-31e267db-ca1a-40b5-9e63-0276b3f2c14e tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:09:22 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e489f049-8b52-46e0-9fc4-a27475db3aea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lQXFwLNH {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:09:22 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e489f049-8b52-46e0-9fc4-a27475db3aea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lQXFwLNH" returned: 0 in 0.018s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:09:22 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[79a6cb66-7695-4666-8e34-d963ec832e14]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:09:22 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-31e267db-ca1a-40b5-9e63-0276b3f2c14e tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lQXFwLNH'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:09:22 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e489f049-8b52-46e0-9fc4-a27475db3aea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:09:22 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e489f049-8b52-46e0-9fc4-a27475db3aea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:09:22 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6de9ea9-6ce2-4c91-9745-52b4591f7c01]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:09:22 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-31e267db-ca1a-40b5-9e63-0276b3f2c14e tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:09:22 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:09:22 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:09:22 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[efdf979e-a885-4fb3-99d4-93415d87c7be]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b76252-f172-4a13-954b-87087c5eb447 (non-flash)\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:09:22 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-31e267db-ca1a-40b5-9e63-0276b3f2c14e tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139 (non-flash)
Nov 06 16:09:22 user nova-compute[75337]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b76252-f172-4a13-954b-87087c5eb447 (non-flash)
Nov 06 16:09:22 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 16:09:22 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-31e267db-ca1a-40b5-9e63-0276b3f2c14e tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139 (non-flash)
Nov 06 16:09:22 user nova-compute[75337]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b76252-f172-4a13-954b-87087c5eb447 (non-flash)
Nov 06 16:09:22 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 16:09:22 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e489f049-8b52-46e0-9fc4-a27475db3aea -p 172.16.0.220:3260 --login {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:09:22 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e489f049-8b52-46e0-9fc4-a27475db3aea -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:09:22 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fb34385-62be-49bd-b3f9-cc174af99940]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e489f049-8b52-46e0-9fc4-a27475db3aea, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e489f049-8b52-46e0-9fc4-a27475db3aea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:09:22 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-31e267db-ca1a-40b5-9e63-0276b3f2c14e tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e489f049-8b52-46e0-9fc4-a27475db3aea, portal: 172.16.0.220,3260]
Nov 06 16:09:22 user nova-compute[75337]: Login to [iface: default, target: iqn.2010-10.org.openstack:e489f049-8b52-46e0-9fc4-a27475db3aea, portal: 172.16.0.220,3260] successful.
Nov 06 16:09:22 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:09:22 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e489f049-8b52-46e0-9fc4-a27475db3aea -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:09:22 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e489f049-8b52-46e0-9fc4-a27475db3aea -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:09:22 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c1cd6c1-6f12-4b53-b8f6-2ba236dc4188]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:09:22 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-31e267db-ca1a-40b5-9e63-0276b3f2c14e tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:09:22 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:09:22 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:09:22 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[44247633-57fb-4746-b329-0b05ab9e12a3]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b76252-f172-4a13-954b-87087c5eb447 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e489f049-8b52-46e0-9fc4-a27475db3aea (non-flash)\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:09:22 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-31e267db-ca1a-40b5-9e63-0276b3f2c14e tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139 (non-flash)
Nov 06 16:09:22 user nova-compute[75337]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b76252-f172-4a13-954b-87087c5eb447 (non-flash)
Nov 06 16:09:22 user nova-compute[75337]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e489f049-8b52-46e0-9fc4-a27475db3aea (non-flash)
Nov 06 16:09:22 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 16:09:22 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-31e267db-ca1a-40b5-9e63-0276b3f2c14e tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139 (non-flash)
Nov 06 16:09:22 user nova-compute[75337]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b76252-f172-4a13-954b-87087c5eb447 (non-flash)
Nov 06 16:09:22 user nova-compute[75337]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e489f049-8b52-46e0-9fc4-a27475db3aea (non-flash)
Nov 06 16:09:22 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 16:09:22 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-31e267db-ca1a-40b5-9e63-0276b3f2c14e tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e489f049-8b52-46e0-9fc4-a27475db3aea" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.275s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 16:09:22 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-31e267db-ca1a-40b5-9e63-0276b3f2c14e tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Connected to 172.16.0.220:3260 {{(pid=75337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 16:09:22 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-31e267db-ca1a-40b5-9e63-0276b3f2c14e tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] HCTL ('33', '-', '-', 0) found on session 51 with lun 0 {{(pid=75337) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 16:09:22 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-31e267db-ca1a-40b5-9e63-0276b3f2c14e tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75337) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 16:09:22 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:09:22 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:09:22 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[0753f672-0f02-4d38-bdf0-e4315ad4c7ef]: (4, ('- - 0', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:09:22 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-31e267db-ca1a-40b5-9e63-0276b3f2c14e tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Searching for a device in session 51 and hctl ['33', '*', '*', 0] yield: None {{(pid=75337) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 16:09:22 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:09:23 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-31e267db-ca1a-40b5-9e63-0276b3f2c14e tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Searching for a device in session 51 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75337) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 16:09:23 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-31e267db-ca1a-40b5-9e63-0276b3f2c14e tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:e489f049-8b52-46e0-9fc4-a27475db3aea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lQXFwLNH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 16:09:23 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-31e267db-ca1a-40b5-9e63-0276b3f2c14e tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.324s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 16:09:23 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-31e267db-ca1a-40b5-9e63-0276b3f2c14e tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] <== connect_volume: return (1327ms) {'type': 'block', 'scsi_wwn': '26330613232306433', 'path': '/dev/sdb'} {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 16:09:23 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-31e267db-ca1a-40b5-9e63-0276b3f2c14e tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] [instance: f9c98d28-41f9-498f-8c1f-43517999775a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26330613232306433', 'path': '/dev/sdb'} {{(pid=75337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 16:09:23 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-0e8e0cc8-d8c5-4d96-a9d5-aa801b469edf tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.292s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 16:09:23 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-0e8e0cc8-d8c5-4d96-a9d5-aa801b469edf tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 16:09:23 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-0e8e0cc8-d8c5-4d96-a9d5-aa801b469edf tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fd402fa7-6910-4e0a-8539-e467e32c337d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 16:09:23 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-0e8e0cc8-d8c5-4d96-a9d5-aa801b469edf tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fd402fa7-6910-4e0a-8539-e467e32c337d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 16:09:23 user nova-compute[75337]: INFO os_brick.initiator.connectors.iscsi [None req-0e8e0cc8-d8c5-4d96-a9d5-aa801b469edf tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 16:09:23 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd402fa7-6910-4e0a-8539-e467e32c337d -p 172.16.0.220:3260 {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:09:23 user nova-compute[75337]: DEBUG nova.objects.instance [None req-31e267db-ca1a-40b5-9e63-0276b3f2c14e tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Lazy-loading 'flavor' on Instance uuid f9c98d28-41f9-498f-8c1f-43517999775a {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 16:09:23 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd402fa7-6910-4e0a-8539-e467e32c337d -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:09:23 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[85c9a3dd-f730-4893-9de3-c013a86034e4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:09:23 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e8e0cc8-d8c5-4d96-a9d5-aa801b469edf tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 16:09:23 user nova-compute[75337]:  {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:09:23 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd402fa7-6910-4e0a-8539-e467e32c337d -p 172.16.0.220:3260 --interface default --op new {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:09:23 user nova-compute[75337]: DEBUG nova.virt.libvirt.guest [None req-31e267db-ca1a-40b5-9e63-0276b3f2c14e tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] attach device xml: <disk type="block" device="disk">
Nov 06 16:09:23 user nova-compute[75337]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 16:09:23 user nova-compute[75337]:   <source dev="/dev/sdb"/>
Nov 06 16:09:23 user nova-compute[75337]:   <target dev="vdc" bus="virtio"/>
Nov 06 16:09:23 user nova-compute[75337]:   <serial>e489f049-8b52-46e0-9fc4-a27475db3aea</serial>
Nov 06 16:09:23 user nova-compute[75337]: </disk>
Nov 06 16:09:23 user nova-compute[75337]:  {{(pid=75337) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 06 16:09:23 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd402fa7-6910-4e0a-8539-e467e32c337d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:09:23 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[65f8e0d0-686e-4e11-900c-b928d80d31f9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fd402fa7-6910-4e0a-8539-e467e32c337d] added\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:09:23 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e8e0cc8-d8c5-4d96-a9d5-aa801b469edf tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fd402fa7-6910-4e0a-8539-e467e32c337d] added
Nov 06 16:09:23 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:09:23 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd402fa7-6910-4e0a-8539-e467e32c337d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:09:23 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd402fa7-6910-4e0a-8539-e467e32c337d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:09:23 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a748597-eb8b-460f-9bf7-2544695b5b53]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:09:23 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e8e0cc8-d8c5-4d96-a9d5-aa801b469edf tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:09:23 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd402fa7-6910-4e0a-8539-e467e32c337d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:09:23 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd402fa7-6910-4e0a-8539-e467e32c337d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:09:23 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae544817-3556-4be5-8391-18822d9924b2]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:09:23 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e8e0cc8-d8c5-4d96-a9d5-aa801b469edf tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:09:23 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd402fa7-6910-4e0a-8539-e467e32c337d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jzHhdsIv {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:09:23 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd402fa7-6910-4e0a-8539-e467e32c337d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jzHhdsIv" returned: 0 in 0.018s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:09:23 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a720df7-189b-479d-bb80-ad932469b4ce]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:09:23 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e8e0cc8-d8c5-4d96-a9d5-aa801b469edf tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jzHhdsIv'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:09:23 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd402fa7-6910-4e0a-8539-e467e32c337d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:09:23 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd402fa7-6910-4e0a-8539-e467e32c337d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:09:23 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9c8f945-1ac9-4e2b-9a2c-bd09e6ecd97b]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:09:23 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e8e0cc8-d8c5-4d96-a9d5-aa801b469edf tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:09:23 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:09:23 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:09:23 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[b871dbf7-5e22-43b4-a08b-86dc0b0c9020]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b76252-f172-4a13-954b-87087c5eb447 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e489f049-8b52-46e0-9fc4-a27475db3aea (non-flash)\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:09:23 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e8e0cc8-d8c5-4d96-a9d5-aa801b469edf tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139 (non-flash)
Nov 06 16:09:23 user nova-compute[75337]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b76252-f172-4a13-954b-87087c5eb447 (non-flash)
Nov 06 16:09:23 user nova-compute[75337]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e489f049-8b52-46e0-9fc4-a27475db3aea (non-flash)
Nov 06 16:09:23 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 16:09:23 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e8e0cc8-d8c5-4d96-a9d5-aa801b469edf tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139 (non-flash)
Nov 06 16:09:23 user nova-compute[75337]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b76252-f172-4a13-954b-87087c5eb447 (non-flash)
Nov 06 16:09:23 user nova-compute[75337]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e489f049-8b52-46e0-9fc4-a27475db3aea (non-flash)
Nov 06 16:09:23 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 16:09:23 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd402fa7-6910-4e0a-8539-e467e32c337d -p 172.16.0.220:3260 --login {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:09:23 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd402fa7-6910-4e0a-8539-e467e32c337d -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:09:23 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[41e219ea-c73e-437a-bf6b-645d0974c27e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fd402fa7-6910-4e0a-8539-e467e32c337d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fd402fa7-6910-4e0a-8539-e467e32c337d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:09:23 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e8e0cc8-d8c5-4d96-a9d5-aa801b469edf tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fd402fa7-6910-4e0a-8539-e467e32c337d, portal: 172.16.0.220,3260]
Nov 06 16:09:23 user nova-compute[75337]: Login to [iface: default, target: iqn.2010-10.org.openstack:fd402fa7-6910-4e0a-8539-e467e32c337d, portal: 172.16.0.220,3260] successful.
Nov 06 16:09:23 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:09:23 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd402fa7-6910-4e0a-8539-e467e32c337d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:09:23 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:09:23 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd402fa7-6910-4e0a-8539-e467e32c337d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:09:23 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[cba53328-8dab-42bb-9143-d5ed2a6fefbe]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:09:23 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e8e0cc8-d8c5-4d96-a9d5-aa801b469edf tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:09:23 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:09:23 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:09:23 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[77a9d88e-b00c-4af8-84aa-2a20e2b492db]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b76252-f172-4a13-954b-87087c5eb447 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e489f049-8b52-46e0-9fc4-a27475db3aea (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd402fa7-6910-4e0a-8539-e467e32c337d (non-flash)\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:09:23 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e8e0cc8-d8c5-4d96-a9d5-aa801b469edf tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139 (non-flash)
Nov 06 16:09:23 user nova-compute[75337]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b76252-f172-4a13-954b-87087c5eb447 (non-flash)
Nov 06 16:09:23 user nova-compute[75337]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e489f049-8b52-46e0-9fc4-a27475db3aea (non-flash)
Nov 06 16:09:23 user nova-compute[75337]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd402fa7-6910-4e0a-8539-e467e32c337d (non-flash)
Nov 06 16:09:23 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 16:09:23 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e8e0cc8-d8c5-4d96-a9d5-aa801b469edf tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139 (non-flash)
Nov 06 16:09:23 user nova-compute[75337]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b76252-f172-4a13-954b-87087c5eb447 (non-flash)
Nov 06 16:09:23 user nova-compute[75337]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e489f049-8b52-46e0-9fc4-a27475db3aea (non-flash)
Nov 06 16:09:23 user nova-compute[75337]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd402fa7-6910-4e0a-8539-e467e32c337d (non-flash)
Nov 06 16:09:23 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 16:09:23 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-0e8e0cc8-d8c5-4d96-a9d5-aa801b469edf tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fd402fa7-6910-4e0a-8539-e467e32c337d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.294s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 16:09:23 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e8e0cc8-d8c5-4d96-a9d5-aa801b469edf tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Connected to 172.16.0.220:3260 {{(pid=75337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 16:09:23 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-0e8e0cc8-d8c5-4d96-a9d5-aa801b469edf tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] HCTL ('36', '-', '-', 0) found on session 52 with lun 0 {{(pid=75337) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 16:09:23 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-0e8e0cc8-d8c5-4d96-a9d5-aa801b469edf tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75337) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 16:09:23 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:09:23 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.021s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:09:23 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[d34f21f4-d3d1-4959-a6f4-cbd54d099d07]: (4, ('- - 0', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:09:23 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-0e8e0cc8-d8c5-4d96-a9d5-aa801b469edf tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Searching for a device in session 52 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75337) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 16:09:23 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e8e0cc8-d8c5-4d96-a9d5-aa801b469edf tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:fd402fa7-6910-4e0a-8539-e467e32c337d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jzHhdsIv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 16:09:23 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-31e267db-ca1a-40b5-9e63-0276b3f2c14e tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] No BDM found with device name vda, not building metadata. {{(pid=75337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 16:09:23 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-31e267db-ca1a-40b5-9e63-0276b3f2c14e tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 16:09:23 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-31e267db-ca1a-40b5-9e63-0276b3f2c14e tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 16:09:23 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-31e267db-ca1a-40b5-9e63-0276b3f2c14e tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] No VIF found with MAC fa:16:3e:d6:6c:ea, not building metadata {{(pid=75337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 16:09:23 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-31e267db-ca1a-40b5-9e63-0276b3f2c14e tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Lock "f9c98d28-41f9-498f-8c1f-43517999775a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 61.301s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:09:24 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:09:24 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-0e8e0cc8-d8c5-4d96-a9d5-aa801b469edf tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.333s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 16:09:24 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e8e0cc8-d8c5-4d96-a9d5-aa801b469edf tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] <== connect_volume: return (2624ms) {'type': 'block', 'scsi_wwn': '23535633233666564', 'path': '/dev/sde'} {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 16:09:24 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e8e0cc8-d8c5-4d96-a9d5-aa801b469edf tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] [instance: 88330c21-69e0-4d82-ac4d-b9e5e849f487] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23535633233666564', 'path': '/dev/sde'} {{(pid=75337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 16:09:24 user nova-compute[75337]: DEBUG nova.objects.instance [None req-0e8e0cc8-d8c5-4d96-a9d5-aa801b469edf tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Lazy-loading 'flavor' on Instance uuid 88330c21-69e0-4d82-ac4d-b9e5e849f487 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 16:09:24 user nova-compute[75337]: DEBUG nova.virt.libvirt.guest [None req-0e8e0cc8-d8c5-4d96-a9d5-aa801b469edf tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] attach device xml: <disk type="block" device="disk">
Nov 06 16:09:24 user nova-compute[75337]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 16:09:24 user nova-compute[75337]:   <source dev="/dev/sde"/>
Nov 06 16:09:24 user nova-compute[75337]:   <target dev="vdb" bus="virtio"/>
Nov 06 16:09:24 user nova-compute[75337]:   <serial>fd402fa7-6910-4e0a-8539-e467e32c337d</serial>
Nov 06 16:09:24 user nova-compute[75337]: </disk>
Nov 06 16:09:24 user nova-compute[75337]:  {{(pid=75337) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 06 16:09:24 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:09:25 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-0e8e0cc8-d8c5-4d96-a9d5-aa801b469edf tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] No BDM found with device name vda, not building metadata. {{(pid=75337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 16:09:25 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-0e8e0cc8-d8c5-4d96-a9d5-aa801b469edf tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 16:09:25 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-0e8e0cc8-d8c5-4d96-a9d5-aa801b469edf tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] No VIF found with MAC fa:16:3e:d4:3f:d4, not building metadata {{(pid=75337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 16:09:25 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-98e16adf-d8d4-45f7-840f-950898dac16f tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Acquiring lock "f9c98d28-41f9-498f-8c1f-43517999775a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:09:25 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-98e16adf-d8d4-45f7-840f-950898dac16f tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Lock "f9c98d28-41f9-498f-8c1f-43517999775a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:09:25 user nova-compute[75337]: INFO nova.compute.manager [None req-98e16adf-d8d4-45f7-840f-950898dac16f tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] [instance: f9c98d28-41f9-498f-8c1f-43517999775a] Detaching volume 81b76252-f172-4a13-954b-87087c5eb447
Nov 06 16:09:25 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-0e8e0cc8-d8c5-4d96-a9d5-aa801b469edf tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Lock "88330c21-69e0-4d82-ac4d-b9e5e849f487" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 43.352s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:09:25 user nova-compute[75337]: INFO nova.virt.block_device [None req-98e16adf-d8d4-45f7-840f-950898dac16f tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] [instance: f9c98d28-41f9-498f-8c1f-43517999775a] Attempting to driver detach volume 81b76252-f172-4a13-954b-87087c5eb447 from mountpoint /dev/vdb
Nov 06 16:09:25 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-98e16adf-d8d4-45f7-840f-950898dac16f tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Attempting to detach device vdb from instance f9c98d28-41f9-498f-8c1f-43517999775a from the persistent domain config. {{(pid=75337) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 06 16:09:25 user nova-compute[75337]: DEBUG nova.virt.libvirt.guest [None req-98e16adf-d8d4-45f7-840f-950898dac16f tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 16:09:25 user nova-compute[75337]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 16:09:25 user nova-compute[75337]:   <source dev="/dev/sdd"/>
Nov 06 16:09:25 user nova-compute[75337]:   <target dev="vdb" bus="virtio"/>
Nov 06 16:09:25 user nova-compute[75337]:   <serial>81b76252-f172-4a13-954b-87087c5eb447</serial>
Nov 06 16:09:25 user nova-compute[75337]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 06 16:09:25 user nova-compute[75337]: </disk>
Nov 06 16:09:25 user nova-compute[75337]:  {{(pid=75337) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 16:09:25 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-98e16adf-d8d4-45f7-840f-950898dac16f tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Successfully detached device vdb from instance f9c98d28-41f9-498f-8c1f-43517999775a from the persistent domain config.
Nov 06 16:09:25 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-98e16adf-d8d4-45f7-840f-950898dac16f tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f9c98d28-41f9-498f-8c1f-43517999775a from the live domain config. {{(pid=75337) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 06 16:09:25 user nova-compute[75337]: DEBUG nova.virt.libvirt.guest [None req-98e16adf-d8d4-45f7-840f-950898dac16f tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 16:09:25 user nova-compute[75337]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 16:09:25 user nova-compute[75337]:   <source dev="/dev/sdd"/>
Nov 06 16:09:25 user nova-compute[75337]:   <target dev="vdb" bus="virtio"/>
Nov 06 16:09:25 user nova-compute[75337]:   <serial>81b76252-f172-4a13-954b-87087c5eb447</serial>
Nov 06 16:09:25 user nova-compute[75337]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 06 16:09:25 user nova-compute[75337]: </disk>
Nov 06 16:09:25 user nova-compute[75337]:  {{(pid=75337) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 16:09:25 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-94511e9a-9c44-4e1c-ac79-58ba0827413c tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Acquiring lock "15922f4f-f921-4245-8d3d-98ed47de946b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:09:25 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-94511e9a-9c44-4e1c-ac79-58ba0827413c tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Lock "15922f4f-f921-4245-8d3d-98ed47de946b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:09:25 user nova-compute[75337]: DEBUG nova.compute.manager [None req-94511e9a-9c44-4e1c-ac79-58ba0827413c tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] [instance: 15922f4f-f921-4245-8d3d-98ed47de946b] Starting instance... {{(pid=75337) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 16:09:25 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-98e16adf-d8d4-45f7-840f-950898dac16f tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f9c98d28-41f9-498f-8c1f-43517999775a {{(pid=75337) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 06 16:09:25 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-94511e9a-9c44-4e1c-ac79-58ba0827413c tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:09:25 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-94511e9a-9c44-4e1c-ac79-58ba0827413c tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:09:25 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-94511e9a-9c44-4e1c-ac79-58ba0827413c tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75337) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 16:09:25 user nova-compute[75337]: INFO nova.compute.claims [None req-94511e9a-9c44-4e1c-ac79-58ba0827413c tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] [instance: 15922f4f-f921-4245-8d3d-98ed47de946b] Claim successful on node user
Nov 06 16:09:25 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-94511e9a-9c44-4e1c-ac79-58ba0827413c tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Refreshing inventories for resource provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 06 16:09:25 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:09:25 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-94511e9a-9c44-4e1c-ac79-58ba0827413c tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Updating ProviderTree inventory for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 06 16:09:25 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-94511e9a-9c44-4e1c-ac79-58ba0827413c tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Updating inventory in ProviderTree for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 06 16:09:25 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-94511e9a-9c44-4e1c-ac79-58ba0827413c tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Refreshing aggregate associations for resource provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7, aggregates: None {{(pid=75337) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 06 16:09:26 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-94511e9a-9c44-4e1c-ac79-58ba0827413c tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Refreshing trait associations for resource provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7, traits: COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NODE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_IDE,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSSE3,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_USB {{(pid=75337) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 06 16:09:26 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-94511e9a-9c44-4e1c-ac79-58ba0827413c tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 16:09:26 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-94511e9a-9c44-4e1c-ac79-58ba0827413c tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 16:09:26 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-94511e9a-9c44-4e1c-ac79-58ba0827413c tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.494s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:09:26 user nova-compute[75337]: DEBUG nova.compute.manager [None req-94511e9a-9c44-4e1c-ac79-58ba0827413c tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] [instance: 15922f4f-f921-4245-8d3d-98ed47de946b] Start building networks asynchronously for instance. {{(pid=75337) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 16:09:26 user nova-compute[75337]: DEBUG nova.compute.manager [None req-94511e9a-9c44-4e1c-ac79-58ba0827413c tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] [instance: 15922f4f-f921-4245-8d3d-98ed47de946b] Allocating IP information in the background. {{(pid=75337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 16:09:26 user nova-compute[75337]: DEBUG nova.network.neutron [None req-94511e9a-9c44-4e1c-ac79-58ba0827413c tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] [instance: 15922f4f-f921-4245-8d3d-98ed47de946b] allocate_for_instance() {{(pid=75337) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 16:09:26 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-94511e9a-9c44-4e1c-ac79-58ba0827413c tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] [instance: 15922f4f-f921-4245-8d3d-98ed47de946b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 16:09:26 user nova-compute[75337]: DEBUG nova.compute.manager [None req-94511e9a-9c44-4e1c-ac79-58ba0827413c tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] [instance: 15922f4f-f921-4245-8d3d-98ed47de946b] Start building block device mappings for instance. {{(pid=75337) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 16:09:26 user nova-compute[75337]: INFO nova.virt.block_device [None req-94511e9a-9c44-4e1c-ac79-58ba0827413c tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] [instance: 15922f4f-f921-4245-8d3d-98ed47de946b] Booting with volume 06b3b613-3c1e-4420-a500-1ec3988c0940 at /dev/vda
Nov 06 16:09:26 user nova-compute[75337]: DEBUG nova.policy [None req-94511e9a-9c44-4e1c-ac79-58ba0827413c tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3204b8f95945489d8335cafa44ab2109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573524caeb6248339e924a5abb8e5964', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75337) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 16:09:26 user nova-compute[75337]: DEBUG os_brick.utils [None req-94511e9a-9c44-4e1c-ac79-58ba0827413c tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 16:09:26 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:09:26 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:09:26 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c01a877-15b9-4d92-8995-e8a9e7fd3a3e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4ff6411e45b8\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:09:26 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:09:26 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:09:26 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[361e72de-1037-4a6b-a966-e774a1a0e43e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:09:26 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:09:26 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:09:26 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c7d41a7-1d4d-42b5-8703-66538ee240d5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:09:26 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[b35a4e98-55b8-4045-8a90-087a71707cca]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:09:26 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-94511e9a-9c44-4e1c-ac79-58ba0827413c tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Running cmd (subprocess): nvme version {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:09:26 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-94511e9a-9c44-4e1c-ac79-58ba0827413c tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] 'nvme version' failed. Not Retrying. {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 16:09:26 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.nvmeof [None req-94511e9a-9c44-4e1c-ac79-58ba0827413c tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] nvme not present on system {{(pid=75337) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 16:09:26 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:09:26 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 16:09:26 user nova-compute[75337]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 16:09:26 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[75d58cda-7d56-41f4-9a16-2ce967a19749]: (4, '') {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:09:26 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.lightos [None req-94511e9a-9c44-4e1c-ac79-58ba0827413c tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75337) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 16:09:26 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.lightos [None req-94511e9a-9c44-4e1c-ac79-58ba0827413c tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 16:09:26 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.lightos [None req-94511e9a-9c44-4e1c-ac79-58ba0827413c tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] LIGHTOS: no hostnqn found. {{(pid=75337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 16:09:26 user nova-compute[75337]: DEBUG os_brick.utils [None req-94511e9a-9c44-4e1c-ac79-58ba0827413c tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4ff6411e45b8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 16:09:26 user nova-compute[75337]: DEBUG nova.virt.block_device [None req-94511e9a-9c44-4e1c-ac79-58ba0827413c tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] [instance: 15922f4f-f921-4245-8d3d-98ed47de946b] Updating existing volume attachment record: e012cfd7-ca96-49d6-87a4-7d71b2861c9f {{(pid=75337) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 16:09:27 user nova-compute[75337]: DEBUG nova.network.neutron [None req-94511e9a-9c44-4e1c-ac79-58ba0827413c tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] [instance: 15922f4f-f921-4245-8d3d-98ed47de946b] Successfully created port: 75853df2-1f1a-4a4f-be80-b29cd2452bd2 {{(pid=75337) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 16:09:28 user nova-compute[75337]: DEBUG nova.network.neutron [None req-94511e9a-9c44-4e1c-ac79-58ba0827413c tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] [instance: 15922f4f-f921-4245-8d3d-98ed47de946b] Successfully updated port: 75853df2-1f1a-4a4f-be80-b29cd2452bd2 {{(pid=75337) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 16:09:28 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-94511e9a-9c44-4e1c-ac79-58ba0827413c tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Acquiring lock "refresh_cache-15922f4f-f921-4245-8d3d-98ed47de946b" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 16:09:28 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-94511e9a-9c44-4e1c-ac79-58ba0827413c tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Acquired lock "refresh_cache-15922f4f-f921-4245-8d3d-98ed47de946b" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 16:09:28 user nova-compute[75337]: DEBUG nova.network.neutron [None req-94511e9a-9c44-4e1c-ac79-58ba0827413c tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] [instance: 15922f4f-f921-4245-8d3d-98ed47de946b] Building network info cache for instance {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 16:09:28 user nova-compute[75337]: DEBUG nova.compute.manager [req-942ab3c7-effc-49cf-8a85-9d3bbbef1100 req-c579ee35-8bb8-4521-acc9-4fa15077d743 service nova] [instance: 15922f4f-f921-4245-8d3d-98ed47de946b] Received event network-changed-75853df2-1f1a-4a4f-be80-b29cd2452bd2 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:09:28 user nova-compute[75337]: DEBUG nova.compute.manager [req-942ab3c7-effc-49cf-8a85-9d3bbbef1100 req-c579ee35-8bb8-4521-acc9-4fa15077d743 service nova] [instance: 15922f4f-f921-4245-8d3d-98ed47de946b] Refreshing instance network info cache due to event network-changed-75853df2-1f1a-4a4f-be80-b29cd2452bd2. {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 16:09:28 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-942ab3c7-effc-49cf-8a85-9d3bbbef1100 req-c579ee35-8bb8-4521-acc9-4fa15077d743 service nova] Acquiring lock "refresh_cache-15922f4f-f921-4245-8d3d-98ed47de946b" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 16:09:28 user nova-compute[75337]: DEBUG nova.network.neutron [None req-94511e9a-9c44-4e1c-ac79-58ba0827413c tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] [instance: 15922f4f-f921-4245-8d3d-98ed47de946b] Instance cache missing network info. {{(pid=75337) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 16:09:28 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-ebeeba1d-9a2c-42f7-818b-792580bb0268 tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Acquiring lock "d6eaef86-b841-4142-9549-31954fb34fa2" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:09:28 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-ebeeba1d-9a2c-42f7-818b-792580bb0268 tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Lock "d6eaef86-b841-4142-9549-31954fb34fa2" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:09:28 user nova-compute[75337]: DEBUG nova.compute.manager [None req-ebeeba1d-9a2c-42f7-818b-792580bb0268 tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: d6eaef86-b841-4142-9549-31954fb34fa2] Going to confirm migration 2 {{(pid=75337) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4774}}
Nov 06 16:09:28 user nova-compute[75337]: DEBUG nova.network.neutron [None req-94511e9a-9c44-4e1c-ac79-58ba0827413c tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] [instance: 15922f4f-f921-4245-8d3d-98ed47de946b] Updating instance_info_cache with network_info: [{"id": "75853df2-1f1a-4a4f-be80-b29cd2452bd2", "address": "fa:16:3e:f5:3f:f6", "network": {"id": "6b24c7e3-9e9c-4a84-8472-7629c0dc8029", "bridge": "br-int", "label": "tempest-TestShelveInstance-284079759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "573524caeb6248339e924a5abb8e5964", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75853df2-1f", "ovs_interfaceid": "75853df2-1f1a-4a4f-be80-b29cd2452bd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 16:09:28 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-94511e9a-9c44-4e1c-ac79-58ba0827413c tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Releasing lock "refresh_cache-15922f4f-f921-4245-8d3d-98ed47de946b" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 16:09:28 user nova-compute[75337]: DEBUG nova.compute.manager [None req-94511e9a-9c44-4e1c-ac79-58ba0827413c tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] [instance: 15922f4f-f921-4245-8d3d-98ed47de946b] Instance network_info: |[{"id": "75853df2-1f1a-4a4f-be80-b29cd2452bd2", "address": "fa:16:3e:f5:3f:f6", "network": {"id": "6b24c7e3-9e9c-4a84-8472-7629c0dc8029", "bridge": "br-int", "label": "tempest-TestShelveInstance-284079759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "573524caeb6248339e924a5abb8e5964", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75853df2-1f", "ovs_interfaceid": "75853df2-1f1a-4a4f-be80-b29cd2452bd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 16:09:28 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-942ab3c7-effc-49cf-8a85-9d3bbbef1100 req-c579ee35-8bb8-4521-acc9-4fa15077d743 service nova] Acquired lock "refresh_cache-15922f4f-f921-4245-8d3d-98ed47de946b" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 16:09:28 user nova-compute[75337]: DEBUG nova.network.neutron [req-942ab3c7-effc-49cf-8a85-9d3bbbef1100 req-c579ee35-8bb8-4521-acc9-4fa15077d743 service nova] [instance: 15922f4f-f921-4245-8d3d-98ed47de946b] Refreshing network info cache for port 75853df2-1f1a-4a4f-be80-b29cd2452bd2 {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 16:09:28 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-ebeeba1d-9a2c-42f7-818b-792580bb0268 tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Acquiring lock "refresh_cache-d6eaef86-b841-4142-9549-31954fb34fa2" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 16:09:28 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-ebeeba1d-9a2c-42f7-818b-792580bb0268 tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Acquired lock "refresh_cache-d6eaef86-b841-4142-9549-31954fb34fa2" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 16:09:28 user nova-compute[75337]: DEBUG nova.network.neutron [None req-ebeeba1d-9a2c-42f7-818b-792580bb0268 tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: d6eaef86-b841-4142-9549-31954fb34fa2] Building network info cache for instance {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 16:09:28 user nova-compute[75337]: DEBUG nova.objects.instance [None req-ebeeba1d-9a2c-42f7-818b-792580bb0268 tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Lazy-loading 'info_cache' on Instance uuid d6eaef86-b841-4142-9549-31954fb34fa2 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 16:09:28 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:09:28 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Starting heal instance info cache {{(pid=75337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 16:09:28 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "refresh_cache-f9c98d28-41f9-498f-8c1f-43517999775a" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 16:09:28 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquired lock "refresh_cache-f9c98d28-41f9-498f-8c1f-43517999775a" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 16:09:28 user nova-compute[75337]: DEBUG nova.network.neutron [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] [instance: f9c98d28-41f9-498f-8c1f-43517999775a] Forcefully refreshing network info cache for instance {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 16:09:28 user nova-compute[75337]: DEBUG nova.network.neutron [req-942ab3c7-effc-49cf-8a85-9d3bbbef1100 req-c579ee35-8bb8-4521-acc9-4fa15077d743 service nova] [instance: 15922f4f-f921-4245-8d3d-98ed47de946b] Updated VIF entry in instance network info cache for port 75853df2-1f1a-4a4f-be80-b29cd2452bd2. {{(pid=75337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 16:09:28 user nova-compute[75337]: DEBUG nova.network.neutron [req-942ab3c7-effc-49cf-8a85-9d3bbbef1100 req-c579ee35-8bb8-4521-acc9-4fa15077d743 service nova] [instance: 15922f4f-f921-4245-8d3d-98ed47de946b] Updating instance_info_cache with network_info: [{"id": "75853df2-1f1a-4a4f-be80-b29cd2452bd2", "address": "fa:16:3e:f5:3f:f6", "network": {"id": "6b24c7e3-9e9c-4a84-8472-7629c0dc8029", "bridge": "br-int", "label": "tempest-TestShelveInstance-284079759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "573524caeb6248339e924a5abb8e5964", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75853df2-1f", "ovs_interfaceid": "75853df2-1f1a-4a4f-be80-b29cd2452bd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 16:09:28 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-942ab3c7-effc-49cf-8a85-9d3bbbef1100 req-c579ee35-8bb8-4521-acc9-4fa15077d743 service nova] Releasing lock "refresh_cache-15922f4f-f921-4245-8d3d-98ed47de946b" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 16:09:29 user nova-compute[75337]: DEBUG nova.network.neutron [None req-ebeeba1d-9a2c-42f7-818b-792580bb0268 tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: d6eaef86-b841-4142-9549-31954fb34fa2] Updating instance_info_cache with network_info: [{"id": "99bb43c1-3b95-4be2-a534-845c37778773", "address": "fa:16:3e:98:6e:e3", "network": {"id": "7f234ecf-bfa6-4316-9dce-c15050ba7914", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1378707892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "243647103fd44f629e0f40be0b56407e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99bb43c1-3b", "ovs_interfaceid": "99bb43c1-3b95-4be2-a534-845c37778773", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 16:09:29 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-ebeeba1d-9a2c-42f7-818b-792580bb0268 tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Releasing lock "refresh_cache-d6eaef86-b841-4142-9549-31954fb34fa2" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 16:09:29 user nova-compute[75337]: DEBUG nova.objects.instance [None req-ebeeba1d-9a2c-42f7-818b-792580bb0268 tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Lazy-loading 'migration_context' on Instance uuid d6eaef86-b841-4142-9549-31954fb34fa2 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 16:09:29 user nova-compute[75337]: DEBUG nova.objects.base [None req-ebeeba1d-9a2c-42f7-818b-792580bb0268 tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Object Instance<d6eaef86-b841-4142-9549-31954fb34fa2> lazy-loaded attributes: info_cache,migration_context {{(pid=75337) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 16:09:29 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-ebeeba1d-9a2c-42f7-818b-792580bb0268 tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:09:29 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-ebeeba1d-9a2c-42f7-818b-792580bb0268 tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:09:29 user nova-compute[75337]: DEBUG nova.network.neutron [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] [instance: f9c98d28-41f9-498f-8c1f-43517999775a] Updating instance_info_cache with network_info: [{"id": "65003741-14af-48d8-9ca6-0e075aab5008", "address": "fa:16:3e:d6:6c:ea", "network": {"id": "8b217731-de9e-49bc-84bb-130fd42ede51", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-314618758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98fac9096a3b4f21ba805ba1437d9d38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65003741-14", "ovs_interfaceid": "65003741-14af-48d8-9ca6-0e075aab5008", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 16:09:29 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-ebeeba1d-9a2c-42f7-818b-792580bb0268 tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 16:09:29 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-ebeeba1d-9a2c-42f7-818b-792580bb0268 tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 16:09:29 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Releasing lock "refresh_cache-f9c98d28-41f9-498f-8c1f-43517999775a" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 16:09:29 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] [instance: f9c98d28-41f9-498f-8c1f-43517999775a] Updated the network info_cache for instance {{(pid=75337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 16:09:29 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-ebeeba1d-9a2c-42f7-818b-792580bb0268 tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.352s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:09:29 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager.update_available_resource {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:09:29 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:09:29 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:09:29 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:09:29 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Auditing locally available compute resources for user (node: user) {{(pid=75337) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 16:09:29 user nova-compute[75337]: INFO nova.scheduler.client.report [None req-ebeeba1d-9a2c-42f7-818b-792580bb0268 tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Deleted allocation for migration 9b362311-b7f0-4a00-b157-930adde8974f
Nov 06 16:09:29 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-ebeeba1d-9a2c-42f7-818b-792580bb0268 tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Lock "d6eaef86-b841-4142-9549-31954fb34fa2" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.570s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:09:29 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9c98d28-41f9-498f-8c1f-43517999775a/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:09:29 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:09:29 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9c98d28-41f9-498f-8c1f-43517999775a/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:09:29 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9c98d28-41f9-498f-8c1f-43517999775a/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:09:30 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9c98d28-41f9-498f-8c1f-43517999775a/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:09:30 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] skipping disk /dev/sdb (vdc) as it is a volume {{(pid=75337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 16:09:30 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04bedc8f-088d-41c4-8cbf-c68602e916c6/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:09:30 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04bedc8f-088d-41c4-8cbf-c68602e916c6/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:09:30 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04bedc8f-088d-41c4-8cbf-c68602e916c6/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:09:30 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04bedc8f-088d-41c4-8cbf-c68602e916c6/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:09:30 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01b61f9a-2591-4714-b18e-54f674a441ab/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:09:30 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01b61f9a-2591-4714-b18e-54f674a441ab/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:09:30 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01b61f9a-2591-4714-b18e-54f674a441ab/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:09:30 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01b61f9a-2591-4714-b18e-54f674a441ab/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:09:30 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:09:30 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 16:09:30 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6110b34a-6fd3-45fc-911d-4e5d3c7f2d78/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:09:31 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6110b34a-6fd3-45fc-911d-4e5d3c7f2d78/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:09:31 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6110b34a-6fd3-45fc-911d-4e5d3c7f2d78/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:09:31 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6110b34a-6fd3-45fc-911d-4e5d3c7f2d78/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:09:31 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88330c21-69e0-4d82-ac4d-b9e5e849f487/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:09:31 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88330c21-69e0-4d82-ac4d-b9e5e849f487/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:09:31 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88330c21-69e0-4d82-ac4d-b9e5e849f487/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:09:31 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88330c21-69e0-4d82-ac4d-b9e5e849f487/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:09:31 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 16:09:32 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 16:09:32 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 16:09:32 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Hypervisor/Node resource view: name=user free_ram=8079MB free_disk=24.856189727783203GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75337) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 16:09:32 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:09:32 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:09:32 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 6110b34a-6fd3-45fc-911d-4e5d3c7f2d78 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 16:09:32 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 01b61f9a-2591-4714-b18e-54f674a441ab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 16:09:32 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance f9c98d28-41f9-498f-8c1f-43517999775a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 16:09:32 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 88330c21-69e0-4d82-ac4d-b9e5e849f487 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 16:09:32 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance d6eaef86-b841-4142-9549-31954fb34fa2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 16:09:32 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 04bedc8f-088d-41c4-8cbf-c68602e916c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 16:09:32 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 15922f4f-f921-4245-8d3d-98ed47de946b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 16:09:32 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 16:09:32 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 16:09:32 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 16:09:32 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 16:09:32 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Compute_service record updated for user:user {{(pid=75337) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 16:09:32 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.383s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:09:34 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:09:35 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:09:35 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Cleaning up deleted instances {{(pid=75337) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 06 16:09:35 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] There are 0 instances to clean {{(pid=75337) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 06 16:09:35 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:09:37 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:09:37 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Cleaning up deleted instances with incomplete migration  {{(pid=75337) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 06 16:09:39 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-b07dd2c7-5a01-44a9-bf5d-7d16efa11ca0 tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] Acquiring lock "04bedc8f-088d-41c4-8cbf-c68602e916c6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:09:39 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-b07dd2c7-5a01-44a9-bf5d-7d16efa11ca0 tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] Lock "04bedc8f-088d-41c4-8cbf-c68602e916c6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:09:39 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-b07dd2c7-5a01-44a9-bf5d-7d16efa11ca0 tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] Acquiring lock "04bedc8f-088d-41c4-8cbf-c68602e916c6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:09:39 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-b07dd2c7-5a01-44a9-bf5d-7d16efa11ca0 tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] Lock "04bedc8f-088d-41c4-8cbf-c68602e916c6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:09:39 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-b07dd2c7-5a01-44a9-bf5d-7d16efa11ca0 tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] Lock "04bedc8f-088d-41c4-8cbf-c68602e916c6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:09:39 user nova-compute[75337]: INFO nova.compute.manager [None req-b07dd2c7-5a01-44a9-bf5d-7d16efa11ca0 tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] [instance: 04bedc8f-088d-41c4-8cbf-c68602e916c6] Terminating instance
Nov 06 16:09:39 user nova-compute[75337]: DEBUG nova.compute.manager [None req-b07dd2c7-5a01-44a9-bf5d-7d16efa11ca0 tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] [instance: 04bedc8f-088d-41c4-8cbf-c68602e916c6] Start destroying the instance on the hypervisor. {{(pid=75337) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 16:09:39 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:09:39 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:09:39 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:09:39 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:09:39 user nova-compute[75337]: DEBUG nova.compute.manager [req-0246a946-595e-4cdd-a909-755390cb843d req-b05936b6-151e-4225-a5dd-f95e8eb1e701 service nova] [instance: 04bedc8f-088d-41c4-8cbf-c68602e916c6] Received event network-vif-unplugged-ebfae3b1-c97c-400b-bcb8-74b0c998eae6 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:09:39 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-0246a946-595e-4cdd-a909-755390cb843d req-b05936b6-151e-4225-a5dd-f95e8eb1e701 service nova] Acquiring lock "04bedc8f-088d-41c4-8cbf-c68602e916c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:09:39 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-0246a946-595e-4cdd-a909-755390cb843d req-b05936b6-151e-4225-a5dd-f95e8eb1e701 service nova] Lock "04bedc8f-088d-41c4-8cbf-c68602e916c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:09:39 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-0246a946-595e-4cdd-a909-755390cb843d req-b05936b6-151e-4225-a5dd-f95e8eb1e701 service nova] Lock "04bedc8f-088d-41c4-8cbf-c68602e916c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:09:39 user nova-compute[75337]: DEBUG nova.compute.manager [req-0246a946-595e-4cdd-a909-755390cb843d req-b05936b6-151e-4225-a5dd-f95e8eb1e701 service nova] [instance: 04bedc8f-088d-41c4-8cbf-c68602e916c6] No waiting events found dispatching network-vif-unplugged-ebfae3b1-c97c-400b-bcb8-74b0c998eae6 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 16:09:39 user nova-compute[75337]: DEBUG nova.compute.manager [req-0246a946-595e-4cdd-a909-755390cb843d req-b05936b6-151e-4225-a5dd-f95e8eb1e701 service nova] [instance: 04bedc8f-088d-41c4-8cbf-c68602e916c6] Received event network-vif-unplugged-ebfae3b1-c97c-400b-bcb8-74b0c998eae6 for instance with task_state deleting. {{(pid=75337) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 16:09:39 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:09:40 user nova-compute[75337]: INFO nova.virt.libvirt.driver [-] [instance: 04bedc8f-088d-41c4-8cbf-c68602e916c6] Instance destroyed successfully.
Nov 06 16:09:40 user nova-compute[75337]: DEBUG nova.objects.instance [None req-b07dd2c7-5a01-44a9-bf5d-7d16efa11ca0 tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] Lazy-loading 'resources' on Instance uuid 04bedc8f-088d-41c4-8cbf-c68602e916c6 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 16:09:40 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-b07dd2c7-5a01-44a9-bf5d-7d16efa11ca0 tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T16:07:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-469045642',display_name='tempest-VolumesActionsTest-instance-469045642',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-469045642',id=46,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-06T16:07:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='888a739f27694bd5a56badca064a56b4',ramdisk_id='',reservation_id='r-wxzg1jio',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1546215062',owner_user_name='tempest-VolumesActionsTest-1546215062-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T16:07:56Z,user_data=None,user_id='4e0147898e9b4af9aaaa3379f431303e',uuid=04bedc8f-088d-41c4-8cbf-c68602e916c6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ebfae3b1-c97c-400b-bcb8-74b0c998eae6", "address": "fa:16:3e:4c:57:9e", "network": {"id": "6b7d7f72-e0a2-49a1-a1d8-927c62316dd2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-716305394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "888a739f27694bd5a56badca064a56b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebfae3b1-c9", "ovs_interfaceid": "ebfae3b1-c97c-400b-bcb8-74b0c998eae6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 16:09:40 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-b07dd2c7-5a01-44a9-bf5d-7d16efa11ca0 tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] Converting VIF {"id": "ebfae3b1-c97c-400b-bcb8-74b0c998eae6", "address": "fa:16:3e:4c:57:9e", "network": {"id": "6b7d7f72-e0a2-49a1-a1d8-927c62316dd2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-716305394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "888a739f27694bd5a56badca064a56b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebfae3b1-c9", "ovs_interfaceid": "ebfae3b1-c97c-400b-bcb8-74b0c998eae6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 16:09:40 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-b07dd2c7-5a01-44a9-bf5d-7d16efa11ca0 tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:57:9e,bridge_name='br-int',has_traffic_filtering=True,id=ebfae3b1-c97c-400b-bcb8-74b0c998eae6,network=Network(6b7d7f72-e0a2-49a1-a1d8-927c62316dd2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebfae3b1-c9') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 16:09:40 user nova-compute[75337]: DEBUG os_vif [None req-b07dd2c7-5a01-44a9-bf5d-7d16efa11ca0 tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:57:9e,bridge_name='br-int',has_traffic_filtering=True,id=ebfae3b1-c97c-400b-bcb8-74b0c998eae6,network=Network(6b7d7f72-e0a2-49a1-a1d8-927c62316dd2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebfae3b1-c9') {{(pid=75337) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 16:09:40 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:09:40 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapebfae3b1-c9, bridge=br-int, if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 16:09:40 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:09:40 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:09:40 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:09:40 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=676a047b-a0f9-4a22-8985-1e871bbd9086) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 16:09:40 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:09:40 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:09:40 user nova-compute[75337]: INFO os_vif [None req-b07dd2c7-5a01-44a9-bf5d-7d16efa11ca0 tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:57:9e,bridge_name='br-int',has_traffic_filtering=True,id=ebfae3b1-c97c-400b-bcb8-74b0c998eae6,network=Network(6b7d7f72-e0a2-49a1-a1d8-927c62316dd2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebfae3b1-c9')
Nov 06 16:09:40 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-b07dd2c7-5a01-44a9-bf5d-7d16efa11ca0 tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] [instance: 04bedc8f-088d-41c4-8cbf-c68602e916c6] Deleting instance files /opt/stack/data/nova/instances/04bedc8f-088d-41c4-8cbf-c68602e916c6_del
Nov 06 16:09:40 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-b07dd2c7-5a01-44a9-bf5d-7d16efa11ca0 tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] [instance: 04bedc8f-088d-41c4-8cbf-c68602e916c6] Deletion of /opt/stack/data/nova/instances/04bedc8f-088d-41c4-8cbf-c68602e916c6_del complete
Nov 06 16:09:40 user nova-compute[75337]: INFO nova.compute.manager [None req-b07dd2c7-5a01-44a9-bf5d-7d16efa11ca0 tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] [instance: 04bedc8f-088d-41c4-8cbf-c68602e916c6] Took 0.94 seconds to destroy the instance on the hypervisor.
Nov 06 16:09:40 user nova-compute[75337]: DEBUG oslo.service.loopingcall [None req-b07dd2c7-5a01-44a9-bf5d-7d16efa11ca0 tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75337) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 16:09:40 user nova-compute[75337]: DEBUG nova.compute.manager [-] [instance: 04bedc8f-088d-41c4-8cbf-c68602e916c6] Deallocating network for instance {{(pid=75337) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 16:09:40 user nova-compute[75337]: DEBUG nova.network.neutron [-] [instance: 04bedc8f-088d-41c4-8cbf-c68602e916c6] deallocate_for_instance() {{(pid=75337) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 16:09:40 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:09:40 user nova-compute[75337]: DEBUG nova.network.neutron [-] [instance: 04bedc8f-088d-41c4-8cbf-c68602e916c6] Updating instance_info_cache with network_info: [] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 16:09:40 user nova-compute[75337]: INFO nova.compute.manager [-] [instance: 04bedc8f-088d-41c4-8cbf-c68602e916c6] Took 0.54 seconds to deallocate network for instance.
Nov 06 16:09:40 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-b07dd2c7-5a01-44a9-bf5d-7d16efa11ca0 tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:09:40 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-b07dd2c7-5a01-44a9-bf5d-7d16efa11ca0 tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:09:40 user nova-compute[75337]: DEBUG nova.compute.manager [req-af26a66a-5db2-49e8-8f08-f0c93310e3da req-7e111848-6326-4114-9cbd-4a996970926a service nova] [instance: 04bedc8f-088d-41c4-8cbf-c68602e916c6] Received event network-vif-deleted-ebfae3b1-c97c-400b-bcb8-74b0c998eae6 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:09:41 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-b07dd2c7-5a01-44a9-bf5d-7d16efa11ca0 tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 16:09:41 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-b07dd2c7-5a01-44a9-bf5d-7d16efa11ca0 tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 16:09:41 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-b07dd2c7-5a01-44a9-bf5d-7d16efa11ca0 tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.267s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:09:41 user nova-compute[75337]: INFO nova.scheduler.client.report [None req-b07dd2c7-5a01-44a9-bf5d-7d16efa11ca0 tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] Deleted allocations for instance 04bedc8f-088d-41c4-8cbf-c68602e916c6
Nov 06 16:09:41 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-b07dd2c7-5a01-44a9-bf5d-7d16efa11ca0 tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] Lock "04bedc8f-088d-41c4-8cbf-c68602e916c6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.986s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:09:41 user nova-compute[75337]: DEBUG nova.compute.manager [req-d72b1f6c-5e69-43bb-8c17-b77d4d83f0b4 req-a3b037bc-3b59-40f5-96cd-26b8348edfc1 service nova] [instance: 04bedc8f-088d-41c4-8cbf-c68602e916c6] Received event network-vif-plugged-ebfae3b1-c97c-400b-bcb8-74b0c998eae6 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:09:41 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-d72b1f6c-5e69-43bb-8c17-b77d4d83f0b4 req-a3b037bc-3b59-40f5-96cd-26b8348edfc1 service nova] Acquiring lock "04bedc8f-088d-41c4-8cbf-c68602e916c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:09:41 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-d72b1f6c-5e69-43bb-8c17-b77d4d83f0b4 req-a3b037bc-3b59-40f5-96cd-26b8348edfc1 service nova] Lock "04bedc8f-088d-41c4-8cbf-c68602e916c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:09:41 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-d72b1f6c-5e69-43bb-8c17-b77d4d83f0b4 req-a3b037bc-3b59-40f5-96cd-26b8348edfc1 service nova] Lock "04bedc8f-088d-41c4-8cbf-c68602e916c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:09:41 user nova-compute[75337]: DEBUG nova.compute.manager [req-d72b1f6c-5e69-43bb-8c17-b77d4d83f0b4 req-a3b037bc-3b59-40f5-96cd-26b8348edfc1 service nova] [instance: 04bedc8f-088d-41c4-8cbf-c68602e916c6] No waiting events found dispatching network-vif-plugged-ebfae3b1-c97c-400b-bcb8-74b0c998eae6 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 16:09:41 user nova-compute[75337]: WARNING nova.compute.manager [req-d72b1f6c-5e69-43bb-8c17-b77d4d83f0b4 req-a3b037bc-3b59-40f5-96cd-26b8348edfc1 service nova] [instance: 04bedc8f-088d-41c4-8cbf-c68602e916c6] Received unexpected event network-vif-plugged-ebfae3b1-c97c-400b-bcb8-74b0c998eae6 for instance with vm_state deleted and task_state None.
Nov 06 16:09:44 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:09:45 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:09:45 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-98e16adf-d8d4-45f7-840f-950898dac16f tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f9c98d28-41f9-498f-8c1f-43517999775a is timed out.
Nov 06 16:09:45 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-98e16adf-d8d4-45f7-840f-950898dac16f tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Successfully detached device vdb from instance f9c98d28-41f9-498f-8c1f-43517999775a from the live domain config.
Nov 06 16:09:45 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-98e16adf-d8d4-45f7-840f-950898dac16f tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] [instance: f9c98d28-41f9-498f-8c1f-43517999775a] calling os-brick to detach iSCSI Volume {{(pid=75337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 16:09:45 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-98e16adf-d8d4-45f7-840f-950898dac16f tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2abc33d0c0>, {'target_iqn': 'iqn.2010-10.org.openstack:81b76252-f172-4a13-954b-87087c5eb447', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BFwmuETd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 16:09:45 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-98e16adf-d8d4-45f7-840f-950898dac16f tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 16:09:45 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-98e16adf-d8d4-45f7-840f-950898dac16f tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 16:09:45 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-98e16adf-d8d4-45f7-840f-950898dac16f tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 16:09:45 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:09:45 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:09:45 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4017a0b-e183-47eb-a796-1565fdfba3a3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:81b76252-f172-4a13-954b-87087c5eb447\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e489f049-8b52-46e0-9fc4-a27475db3aea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fd402fa7-6910-4e0a-8539-e467e32c337d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:09:45 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-98e16adf-d8d4-45f7-840f-950898dac16f tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 16:09:45 user nova-compute[75337]: No targets found.
Nov 06 16:09:45 user nova-compute[75337]: iSNS:
Nov 06 16:09:45 user nova-compute[75337]: No targets found.
Nov 06 16:09:45 user nova-compute[75337]: STATIC:
Nov 06 16:09:45 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:81b76252-f172-4a13-954b-87087c5eb447
Nov 06 16:09:45 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 16:09:45 user nova-compute[75337]:                 Iface Name: default
Nov 06 16:09:45 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:e489f049-8b52-46e0-9fc4-a27475db3aea
Nov 06 16:09:45 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 16:09:45 user nova-compute[75337]:                 Iface Name: default
Nov 06 16:09:45 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:fd402fa7-6910-4e0a-8539-e467e32c337d
Nov 06 16:09:45 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 16:09:45 user nova-compute[75337]:                 Iface Name: default
Nov 06 16:09:45 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139
Nov 06 16:09:45 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 16:09:45 user nova-compute[75337]:                 Iface Name: default
Nov 06 16:09:45 user nova-compute[75337]: FIRMWARE:
Nov 06 16:09:45 user nova-compute[75337]: No targets found.
Nov 06 16:09:45 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 16:09:45 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-98e16adf-d8d4-45f7-840f-950898dac16f tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 16:09:45 user nova-compute[75337]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 16:09:45 user nova-compute[75337]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75337) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 16:09:45 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-98e16adf-d8d4-45f7-840f-950898dac16f tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:81b76252-f172-4a13-954b-87087c5eb447', 0)] {{(pid=75337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 16:09:45 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:09:45 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:09:45 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dbad894-e10f-4aa3-b699-01cdf7d32aab]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:81b76252-f172-4a13-954b-87087c5eb447\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e489f049-8b52-46e0-9fc4-a27475db3aea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fd402fa7-6910-4e0a-8539-e467e32c337d\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:09:45 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:09:45 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:09:45 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[e40b20ed-1bd6-491d-bcc3-e20cd6aa815e]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b76252-f172-4a13-954b-87087c5eb447 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e489f049-8b52-46e0-9fc4-a27475db3aea (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd402fa7-6910-4e0a-8539-e467e32c337d (non-flash)\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:09:45 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-98e16adf-d8d4-45f7-840f-950898dac16f tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139 (non-flash)
Nov 06 16:09:45 user nova-compute[75337]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b76252-f172-4a13-954b-87087c5eb447 (non-flash)
Nov 06 16:09:45 user nova-compute[75337]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e489f049-8b52-46e0-9fc4-a27475db3aea (non-flash)
Nov 06 16:09:45 user nova-compute[75337]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd402fa7-6910-4e0a-8539-e467e32c337d (non-flash)
Nov 06 16:09:45 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 16:09:45 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-98e16adf-d8d4-45f7-840f-950898dac16f tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139 (non-flash)
Nov 06 16:09:45 user nova-compute[75337]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b76252-f172-4a13-954b-87087c5eb447 (non-flash)
Nov 06 16:09:45 user nova-compute[75337]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e489f049-8b52-46e0-9fc4-a27475db3aea (non-flash)
Nov 06 16:09:45 user nova-compute[75337]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd402fa7-6910-4e0a-8539-e467e32c337d (non-flash)
Nov 06 16:09:45 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 16:09:45 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-98e16adf-d8d4-45f7-840f-950898dac16f tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2a9c64d870>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:81b76252-f172-4a13-954b-87087c5eb447'): ({'sdd'}, set())}) {{(pid=75337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 16:09:45 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-98e16adf-d8d4-45f7-840f-950898dac16f tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Removing single pathed devices sdd {{(pid=75337) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 16:09:45 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:09:45 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:09:45 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d9caeb7-36c4-44bc-ab96-f7dd70334d69]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:09:45 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:09:45 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.024s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:09:45 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b449a4e-4c28-4b6c-b751-002b7977b3e4]: (4, ('ok\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:09:45 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-98e16adf-d8d4-45f7-840f-950898dac16f tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Flushing IO for device /dev/sdd {{(pid=75337) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 16:09:45 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:09:45 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:09:45 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[918ef091-436d-4d69-a70f-27a2c1f0cd9c]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:09:45 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-98e16adf-d8d4-45f7-840f-950898dac16f tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75337) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 16:09:45 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:09:45 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.041s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:09:45 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca930b54-f782-47ea-ab55-90929aa37ab5]: (4, ('1', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:09:45 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-98e16adf-d8d4-45f7-840f-950898dac16f tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 16:09:45 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-98e16adf-d8d4-45f7-840f-950898dac16f tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] SCSI volumes sdd have been removed. {{(pid=75337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 16:09:45 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-98e16adf-d8d4-45f7-840f-950898dac16f tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:81b76252-f172-4a13-954b-87087c5eb447')] {{(pid=75337) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 16:09:45 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81b76252-f172-4a13-954b-87087c5eb447 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:09:45 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81b76252-f172-4a13-954b-87087c5eb447 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:09:45 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[2de4ff31-beb7-4ec2-a6e0-f2829fa7d247]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:09:45 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-98e16adf-d8d4-45f7-840f-950898dac16f tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:09:45 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81b76252-f172-4a13-954b-87087c5eb447 -p 172.16.0.220:3260 --logout {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:09:46 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81b76252-f172-4a13-954b-87087c5eb447 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:09:46 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbfe0f20-60ae-4ca3-914b-a652995b9c0e]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:81b76252-f172-4a13-954b-87087c5eb447, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:81b76252-f172-4a13-954b-87087c5eb447, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:09:46 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-98e16adf-d8d4-45f7-840f-950898dac16f tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:81b76252-f172-4a13-954b-87087c5eb447, portal: 172.16.0.220,3260]
Nov 06 16:09:46 user nova-compute[75337]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:81b76252-f172-4a13-954b-87087c5eb447, portal: 172.16.0.220,3260] successful.
Nov 06 16:09:46 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:09:46 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81b76252-f172-4a13-954b-87087c5eb447 -p 172.16.0.220:3260 --op delete {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:09:46 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81b76252-f172-4a13-954b-87087c5eb447 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:09:46 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[4497ea60-e50f-4a1e-a741-ed113aea45e0]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:09:46 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-98e16adf-d8d4-45f7-840f-950898dac16f tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:09:46 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-98e16adf-d8d4-45f7-840f-950898dac16f tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.318s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 16:09:46 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-98e16adf-d8d4-45f7-840f-950898dac16f tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] <== disconnect_volume: return (319ms) None {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 16:09:46 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-98e16adf-d8d4-45f7-840f-950898dac16f tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] [instance: f9c98d28-41f9-498f-8c1f-43517999775a] Disconnected iSCSI Volume {{(pid=75337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 16:09:47 user nova-compute[75337]: DEBUG nova.objects.instance [None req-98e16adf-d8d4-45f7-840f-950898dac16f tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Lazy-loading 'flavor' on Instance uuid f9c98d28-41f9-498f-8c1f-43517999775a {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 16:09:47 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-98e16adf-d8d4-45f7-840f-950898dac16f tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Lock "f9c98d28-41f9-498f-8c1f-43517999775a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.027s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:09:48 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-25ed1b55-cd7a-4407-8382-b3112b0c935c tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Acquiring lock "f9c98d28-41f9-498f-8c1f-43517999775a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:09:48 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-25ed1b55-cd7a-4407-8382-b3112b0c935c tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Lock "f9c98d28-41f9-498f-8c1f-43517999775a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:09:48 user nova-compute[75337]: INFO nova.compute.manager [None req-25ed1b55-cd7a-4407-8382-b3112b0c935c tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] [instance: f9c98d28-41f9-498f-8c1f-43517999775a] Detaching volume e489f049-8b52-46e0-9fc4-a27475db3aea
Nov 06 16:09:48 user nova-compute[75337]: INFO nova.virt.block_device [None req-25ed1b55-cd7a-4407-8382-b3112b0c935c tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] [instance: f9c98d28-41f9-498f-8c1f-43517999775a] Attempting to driver detach volume e489f049-8b52-46e0-9fc4-a27475db3aea from mountpoint /dev/vdc
Nov 06 16:09:48 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-25ed1b55-cd7a-4407-8382-b3112b0c935c tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Attempting to detach device vdc from instance f9c98d28-41f9-498f-8c1f-43517999775a from the persistent domain config. {{(pid=75337) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 06 16:09:48 user nova-compute[75337]: DEBUG nova.virt.libvirt.guest [None req-25ed1b55-cd7a-4407-8382-b3112b0c935c tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 16:09:48 user nova-compute[75337]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 16:09:48 user nova-compute[75337]:   <source dev="/dev/sdb"/>
Nov 06 16:09:48 user nova-compute[75337]:   <target dev="vdc" bus="virtio"/>
Nov 06 16:09:48 user nova-compute[75337]:   <serial>e489f049-8b52-46e0-9fc4-a27475db3aea</serial>
Nov 06 16:09:48 user nova-compute[75337]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 06 16:09:48 user nova-compute[75337]: </disk>
Nov 06 16:09:48 user nova-compute[75337]:  {{(pid=75337) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 16:09:48 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-25ed1b55-cd7a-4407-8382-b3112b0c935c tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Successfully detached device vdc from instance f9c98d28-41f9-498f-8c1f-43517999775a from the persistent domain config.
Nov 06 16:09:48 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-25ed1b55-cd7a-4407-8382-b3112b0c935c tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance f9c98d28-41f9-498f-8c1f-43517999775a from the live domain config. {{(pid=75337) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 06 16:09:48 user nova-compute[75337]: DEBUG nova.virt.libvirt.guest [None req-25ed1b55-cd7a-4407-8382-b3112b0c935c tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 16:09:48 user nova-compute[75337]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 16:09:48 user nova-compute[75337]:   <source dev="/dev/sdb"/>
Nov 06 16:09:48 user nova-compute[75337]:   <target dev="vdc" bus="virtio"/>
Nov 06 16:09:48 user nova-compute[75337]:   <serial>e489f049-8b52-46e0-9fc4-a27475db3aea</serial>
Nov 06 16:09:48 user nova-compute[75337]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 06 16:09:48 user nova-compute[75337]: </disk>
Nov 06 16:09:48 user nova-compute[75337]:  {{(pid=75337) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 16:09:48 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-25ed1b55-cd7a-4407-8382-b3112b0c935c tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance f9c98d28-41f9-498f-8c1f-43517999775a {{(pid=75337) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 06 16:09:50 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:09:50 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:09:50 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75337) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 16:09:50 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 16:09:50 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 16:09:50 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:09:50 user nova-compute[75337]: DEBUG nova.compute.manager [None req-94511e9a-9c44-4e1c-ac79-58ba0827413c tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] [instance: 15922f4f-f921-4245-8d3d-98ed47de946b] Start spawning the instance on the hypervisor. {{(pid=75337) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 16:09:50 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-94511e9a-9c44-4e1c-ac79-58ba0827413c tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] [instance: 15922f4f-f921-4245-8d3d-98ed47de946b] Creating instance directory {{(pid=75337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 16:09:50 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-94511e9a-9c44-4e1c-ac79-58ba0827413c tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] [instance: 15922f4f-f921-4245-8d3d-98ed47de946b] Creating image(s)
Nov 06 16:09:50 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-94511e9a-9c44-4e1c-ac79-58ba0827413c tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] [instance: 15922f4f-f921-4245-8d3d-98ed47de946b] Did not create local disks {{(pid=75337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 06 16:09:50 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-94511e9a-9c44-4e1c-ac79-58ba0827413c tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] [instance: 15922f4f-f921-4245-8d3d-98ed47de946b] Ensure instance console log exists: /opt/stack/data/nova/instances/15922f4f-f921-4245-8d3d-98ed47de946b/console.log {{(pid=75337) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 16:09:50 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-94511e9a-9c44-4e1c-ac79-58ba0827413c tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:09:50 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-94511e9a-9c44-4e1c-ac79-58ba0827413c tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:09:50 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-94511e9a-9c44-4e1c-ac79-58ba0827413c tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:09:50 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-94511e9a-9c44-4e1c-ac79-58ba0827413c tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] [instance: 15922f4f-f921-4245-8d3d-98ed47de946b] Start _get_guest_xml network_info=[{"id": "75853df2-1f1a-4a4f-be80-b29cd2452bd2", "address": "fa:16:3e:f5:3f:f6", "network": {"id": "6b24c7e3-9e9c-4a84-8472-7629c0dc8029", "bridge": "br-int", "label": "tempest-TestShelveInstance-284079759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "573524caeb6248339e924a5abb8e5964", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75853df2-1f", "ovs_interfaceid": "75853df2-1f1a-4a4f-be80-b29cd2452bd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'attachment_id': 'e012cfd7-ca96-49d6-87a4-7d71b2861c9f', 'guest_format': None, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:06b3b613-3c1e-4420-a500-1ec3988c0940', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'niMJzqwT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '15922f4f-f921-4245-8d3d-98ed47de946b', 'attached_at': '', 'detached_at': '', 'volume_id': '06b3b613-3c1e-4420-a500-1ec3988c0940', 'serial': '06b3b613-3c1e-4420-a500-1ec3988c0940'}, 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=75337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 16:09:50 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-94511e9a-9c44-4e1c-ac79-58ba0827413c tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 16:09:50 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-94511e9a-9c44-4e1c-ac79-58ba0827413c tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 16:09:50 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-94511e9a-9c44-4e1c-ac79-58ba0827413c tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 16:09:50 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-94511e9a-9c44-4e1c-ac79-58ba0827413c tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] CPU controller missing on host. {{(pid=75337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 16:09:50 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-94511e9a-9c44-4e1c-ac79-58ba0827413c tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 16:09:50 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-94511e9a-9c44-4e1c-ac79-58ba0827413c tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] CPU controller found on host. {{(pid=75337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 16:09:50 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-94511e9a-9c44-4e1c-ac79-58ba0827413c tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75337) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 16:09:50 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-94511e9a-9c44-4e1c-ac79-58ba0827413c tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T15:34:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 16:09:50 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-94511e9a-9c44-4e1c-ac79-58ba0827413c tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Flavor limits 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 16:09:50 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-94511e9a-9c44-4e1c-ac79-58ba0827413c tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Image limits 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 16:09:50 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-94511e9a-9c44-4e1c-ac79-58ba0827413c tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Flavor pref 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 16:09:50 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-94511e9a-9c44-4e1c-ac79-58ba0827413c tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Image pref 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 16:09:50 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-94511e9a-9c44-4e1c-ac79-58ba0827413c tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 16:09:50 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-94511e9a-9c44-4e1c-ac79-58ba0827413c tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 16:09:50 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-94511e9a-9c44-4e1c-ac79-58ba0827413c tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 16:09:50 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-94511e9a-9c44-4e1c-ac79-58ba0827413c tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Got 1 possible topologies {{(pid=75337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 16:09:50 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-94511e9a-9c44-4e1c-ac79-58ba0827413c tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 16:09:50 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-94511e9a-9c44-4e1c-ac79-58ba0827413c tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 16:09:50 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-94511e9a-9c44-4e1c-ac79-58ba0827413c tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] [instance: 15922f4f-f921-4245-8d3d-98ed47de946b] Calling os-brick to attach iSCSI Volume {{(pid=75337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 16:09:50 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-94511e9a-9c44-4e1c-ac79-58ba0827413c tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2abc33d0c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:06b3b613-3c1e-4420-a500-1ec3988c0940', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'niMJzqwT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 16:09:50 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-94511e9a-9c44-4e1c-ac79-58ba0827413c tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 16:09:50 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-94511e9a-9c44-4e1c-ac79-58ba0827413c tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 16:09:50 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-94511e9a-9c44-4e1c-ac79-58ba0827413c tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 16:09:50 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-94511e9a-9c44-4e1c-ac79-58ba0827413c tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 16:09:50 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-94511e9a-9c44-4e1c-ac79-58ba0827413c tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:06b3b613-3c1e-4420-a500-1ec3988c0940" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 16:09:50 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-94511e9a-9c44-4e1c-ac79-58ba0827413c tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:06b3b613-3c1e-4420-a500-1ec3988c0940" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 16:09:50 user nova-compute[75337]: INFO os_brick.initiator.connectors.iscsi [None req-94511e9a-9c44-4e1c-ac79-58ba0827413c tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 16:09:50 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06b3b613-3c1e-4420-a500-1ec3988c0940 -p 172.16.0.220:3260 {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:09:50 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06b3b613-3c1e-4420-a500-1ec3988c0940 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:09:50 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[afdb4534-fd34-492f-8495-dbfb0974297c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:09:50 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-94511e9a-9c44-4e1c-ac79-58ba0827413c tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 16:09:50 user nova-compute[75337]:  {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:09:50 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06b3b613-3c1e-4420-a500-1ec3988c0940 -p 172.16.0.220:3260 --interface default --op new {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:09:50 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06b3b613-3c1e-4420-a500-1ec3988c0940 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:09:50 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc11610d-f2db-4da9-83c8-bd41ea788085]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:06b3b613-3c1e-4420-a500-1ec3988c0940] added\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:09:50 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-94511e9a-9c44-4e1c-ac79-58ba0827413c tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:06b3b613-3c1e-4420-a500-1ec3988c0940] added
Nov 06 16:09:50 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:09:50 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06b3b613-3c1e-4420-a500-1ec3988c0940 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:09:50 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06b3b613-3c1e-4420-a500-1ec3988c0940 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:09:50 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a23382d-ffae-4e03-a35e-75ff8ee22402]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:09:50 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-94511e9a-9c44-4e1c-ac79-58ba0827413c tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:09:50 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06b3b613-3c1e-4420-a500-1ec3988c0940 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:09:50 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06b3b613-3c1e-4420-a500-1ec3988c0940 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:09:50 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc1c929d-f584-435e-bb26-c5f54c85d4a9]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:09:50 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-94511e9a-9c44-4e1c-ac79-58ba0827413c tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:09:50 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06b3b613-3c1e-4420-a500-1ec3988c0940 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v niMJzqwT {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:09:50 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06b3b613-3c1e-4420-a500-1ec3988c0940 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v niMJzqwT" returned: 0 in 0.019s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:09:50 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[24fa02db-cdb6-4408-ba06-fb8e29702db0]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:09:50 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-94511e9a-9c44-4e1c-ac79-58ba0827413c tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'niMJzqwT'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:09:50 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06b3b613-3c1e-4420-a500-1ec3988c0940 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:09:50 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06b3b613-3c1e-4420-a500-1ec3988c0940 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:09:50 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[e05f0dfe-ae8a-4bf3-9113-4359438499a7]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:09:50 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-94511e9a-9c44-4e1c-ac79-58ba0827413c tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:09:50 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:09:50 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:09:50 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f301f26-059e-4757-867c-50a97837065c]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e489f049-8b52-46e0-9fc4-a27475db3aea (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd402fa7-6910-4e0a-8539-e467e32c337d (non-flash)\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:09:50 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-94511e9a-9c44-4e1c-ac79-58ba0827413c tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139 (non-flash)
Nov 06 16:09:50 user nova-compute[75337]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e489f049-8b52-46e0-9fc4-a27475db3aea (non-flash)
Nov 06 16:09:50 user nova-compute[75337]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd402fa7-6910-4e0a-8539-e467e32c337d (non-flash)
Nov 06 16:09:50 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 16:09:50 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-94511e9a-9c44-4e1c-ac79-58ba0827413c tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139 (non-flash)
Nov 06 16:09:50 user nova-compute[75337]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e489f049-8b52-46e0-9fc4-a27475db3aea (non-flash)
Nov 06 16:09:50 user nova-compute[75337]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd402fa7-6910-4e0a-8539-e467e32c337d (non-flash)
Nov 06 16:09:50 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 16:09:50 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06b3b613-3c1e-4420-a500-1ec3988c0940 -p 172.16.0.220:3260 --login {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:09:50 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06b3b613-3c1e-4420-a500-1ec3988c0940 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:09:50 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dec8c19-bb51-422a-b8b8-fccf313d5fe9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:06b3b613-3c1e-4420-a500-1ec3988c0940, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:06b3b613-3c1e-4420-a500-1ec3988c0940, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:09:50 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-94511e9a-9c44-4e1c-ac79-58ba0827413c tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:06b3b613-3c1e-4420-a500-1ec3988c0940, portal: 172.16.0.220,3260]
Nov 06 16:09:50 user nova-compute[75337]: Login to [iface: default, target: iqn.2010-10.org.openstack:06b3b613-3c1e-4420-a500-1ec3988c0940, portal: 172.16.0.220,3260] successful.
Nov 06 16:09:50 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:09:50 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06b3b613-3c1e-4420-a500-1ec3988c0940 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:09:50 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06b3b613-3c1e-4420-a500-1ec3988c0940 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:09:50 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[34c61439-8787-4224-9fe2-fff33a0e0862]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:09:50 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-94511e9a-9c44-4e1c-ac79-58ba0827413c tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:09:50 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:09:50 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:09:50 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[3892b3fc-70d1-47d8-ba9f-f6965e09d8f6]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e489f049-8b52-46e0-9fc4-a27475db3aea (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd402fa7-6910-4e0a-8539-e467e32c337d (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06b3b613-3c1e-4420-a500-1ec3988c0940 (non-flash)\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:09:50 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-94511e9a-9c44-4e1c-ac79-58ba0827413c tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139 (non-flash)
Nov 06 16:09:50 user nova-compute[75337]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e489f049-8b52-46e0-9fc4-a27475db3aea (non-flash)
Nov 06 16:09:50 user nova-compute[75337]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd402fa7-6910-4e0a-8539-e467e32c337d (non-flash)
Nov 06 16:09:50 user nova-compute[75337]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06b3b613-3c1e-4420-a500-1ec3988c0940 (non-flash)
Nov 06 16:09:50 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 16:09:50 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-94511e9a-9c44-4e1c-ac79-58ba0827413c tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139 (non-flash)
Nov 06 16:09:50 user nova-compute[75337]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e489f049-8b52-46e0-9fc4-a27475db3aea (non-flash)
Nov 06 16:09:50 user nova-compute[75337]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd402fa7-6910-4e0a-8539-e467e32c337d (non-flash)
Nov 06 16:09:50 user nova-compute[75337]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06b3b613-3c1e-4420-a500-1ec3988c0940 (non-flash)
Nov 06 16:09:50 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 16:09:50 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-94511e9a-9c44-4e1c-ac79-58ba0827413c tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:06b3b613-3c1e-4420-a500-1ec3988c0940" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.290s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 16:09:50 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-94511e9a-9c44-4e1c-ac79-58ba0827413c tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Connected to 172.16.0.220:3260 {{(pid=75337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 16:09:50 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-94511e9a-9c44-4e1c-ac79-58ba0827413c tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] HCTL ('35', '-', '-', 0) found on session 53 with lun 0 {{(pid=75337) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 16:09:50 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-94511e9a-9c44-4e1c-ac79-58ba0827413c tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75337) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 16:09:50 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:09:50 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:09:50 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c2082b4-1f8d-40ea-9d39-a4716d52e448]: (4, ('- - 0', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:09:50 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-94511e9a-9c44-4e1c-ac79-58ba0827413c tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Searching for a device in session 53 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75337) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 16:09:50 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-94511e9a-9c44-4e1c-ac79-58ba0827413c tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:06b3b613-3c1e-4420-a500-1ec3988c0940', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'niMJzqwT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 16:09:51 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-94511e9a-9c44-4e1c-ac79-58ba0827413c tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.329s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 16:09:51 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-94511e9a-9c44-4e1c-ac79-58ba0827413c tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] <== connect_volume: return (1330ms) {'type': 'block', 'scsi_wwn': '26339353537623732', 'path': '/dev/sdd'} {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 16:09:51 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-94511e9a-9c44-4e1c-ac79-58ba0827413c tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] [instance: 15922f4f-f921-4245-8d3d-98ed47de946b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26339353537623732', 'path': '/dev/sdd'} {{(pid=75337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 16:09:51 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-94511e9a-9c44-4e1c-ac79-58ba0827413c tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T16:09:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1606147193',display_name='tempest-TestShelveInstance-server-1606147193',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1606147193',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBET5bxZ8mLAaWl4HqozpzhdVRJ1LnlkTiYfny9D2S0JwqS5aepxP0yT+cU0Pc9wCAKkm2TfPGhm7ljhyuLG76JgiijG2E7WfgIyahxQ8ji6zb6gr2/OWhMqORY7NLSU2HQ==',key_name='tempest-TestShelveInstance-1222945182',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='573524caeb6248339e924a5abb8e5964',ramdisk_id='',reservation_id='r-totl4fkd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-652677760',owner_user_name='tempest-TestShelveInstance-652677760-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T16:09:26Z,user_data=None,user_id='3204b8f95945489d8335cafa44ab2109',uuid=15922f4f-f921-4245-8d3d-98ed47de946b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "75853df2-1f1a-4a4f-be80-b29cd2452bd2", "address": "fa:16:3e:f5:3f:f6", "network": {"id": "6b24c7e3-9e9c-4a84-8472-7629c0dc8029", "bridge": "br-int", "label": "tempest-TestShelveInstance-284079759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "573524caeb6248339e924a5abb8e5964", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75853df2-1f", "ovs_interfaceid": "75853df2-1f1a-4a4f-be80-b29cd2452bd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75337) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 16:09:51 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-94511e9a-9c44-4e1c-ac79-58ba0827413c tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Converting VIF {"id": "75853df2-1f1a-4a4f-be80-b29cd2452bd2", "address": "fa:16:3e:f5:3f:f6", "network": {"id": "6b24c7e3-9e9c-4a84-8472-7629c0dc8029", "bridge": "br-int", "label": "tempest-TestShelveInstance-284079759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "573524caeb6248339e924a5abb8e5964", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75853df2-1f", "ovs_interfaceid": "75853df2-1f1a-4a4f-be80-b29cd2452bd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 16:09:51 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-94511e9a-9c44-4e1c-ac79-58ba0827413c tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:3f:f6,bridge_name='br-int',has_traffic_filtering=True,id=75853df2-1f1a-4a4f-be80-b29cd2452bd2,network=Network(6b24c7e3-9e9c-4a84-8472-7629c0dc8029),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75853df2-1f') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 16:09:51 user nova-compute[75337]: DEBUG nova.objects.instance [None req-94511e9a-9c44-4e1c-ac79-58ba0827413c tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Lazy-loading 'pci_devices' on Instance uuid 15922f4f-f921-4245-8d3d-98ed47de946b {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 16:09:51 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-94511e9a-9c44-4e1c-ac79-58ba0827413c tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] [instance: 15922f4f-f921-4245-8d3d-98ed47de946b] End _get_guest_xml xml=<domain type="kvm">
Nov 06 16:09:51 user nova-compute[75337]:   <uuid>15922f4f-f921-4245-8d3d-98ed47de946b</uuid>
Nov 06 16:09:51 user nova-compute[75337]:   <name>instance-0000002f</name>
Nov 06 16:09:51 user nova-compute[75337]:   <memory>524288</memory>
Nov 06 16:09:51 user nova-compute[75337]:   <vcpu>1</vcpu>
Nov 06 16:09:51 user nova-compute[75337]:   <metadata>
Nov 06 16:09:51 user nova-compute[75337]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 16:09:51 user nova-compute[75337]:       <nova:package version="0.0.0"/>
Nov 06 16:09:51 user nova-compute[75337]:       <nova:name>tempest-TestShelveInstance-server-1606147193</nova:name>
Nov 06 16:09:51 user nova-compute[75337]:       <nova:creationTime>2023-11-06 16:09:50</nova:creationTime>
Nov 06 16:09:51 user nova-compute[75337]:       <nova:flavor name="m1.tiny">
Nov 06 16:09:51 user nova-compute[75337]:         <nova:memory>512</nova:memory>
Nov 06 16:09:51 user nova-compute[75337]:         <nova:disk>1</nova:disk>
Nov 06 16:09:51 user nova-compute[75337]:         <nova:swap>0</nova:swap>
Nov 06 16:09:51 user nova-compute[75337]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 16:09:51 user nova-compute[75337]:         <nova:vcpus>1</nova:vcpus>
Nov 06 16:09:51 user nova-compute[75337]:       </nova:flavor>
Nov 06 16:09:51 user nova-compute[75337]:       <nova:owner>
Nov 06 16:09:51 user nova-compute[75337]:         <nova:user uuid="3204b8f95945489d8335cafa44ab2109">tempest-TestShelveInstance-652677760-project-member</nova:user>
Nov 06 16:09:51 user nova-compute[75337]:         <nova:project uuid="573524caeb6248339e924a5abb8e5964">tempest-TestShelveInstance-652677760</nova:project>
Nov 06 16:09:51 user nova-compute[75337]:       </nova:owner>
Nov 06 16:09:51 user nova-compute[75337]:       <nova:ports>
Nov 06 16:09:51 user nova-compute[75337]:         <nova:port uuid="75853df2-1f1a-4a4f-be80-b29cd2452bd2">
Nov 06 16:09:51 user nova-compute[75337]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 06 16:09:51 user nova-compute[75337]:         </nova:port>
Nov 06 16:09:51 user nova-compute[75337]:       </nova:ports>
Nov 06 16:09:51 user nova-compute[75337]:     </nova:instance>
Nov 06 16:09:51 user nova-compute[75337]:   </metadata>
Nov 06 16:09:51 user nova-compute[75337]:   <sysinfo type="smbios">
Nov 06 16:09:51 user nova-compute[75337]:     <system>
Nov 06 16:09:51 user nova-compute[75337]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 16:09:51 user nova-compute[75337]:       <entry name="product">OpenStack Nova</entry>
Nov 06 16:09:51 user nova-compute[75337]:       <entry name="version">0.0.0</entry>
Nov 06 16:09:51 user nova-compute[75337]:       <entry name="serial">15922f4f-f921-4245-8d3d-98ed47de946b</entry>
Nov 06 16:09:51 user nova-compute[75337]:       <entry name="uuid">15922f4f-f921-4245-8d3d-98ed47de946b</entry>
Nov 06 16:09:51 user nova-compute[75337]:       <entry name="family">Virtual Machine</entry>
Nov 06 16:09:51 user nova-compute[75337]:     </system>
Nov 06 16:09:51 user nova-compute[75337]:   </sysinfo>
Nov 06 16:09:51 user nova-compute[75337]:   <os>
Nov 06 16:09:51 user nova-compute[75337]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 16:09:51 user nova-compute[75337]:     <boot dev="hd"/>
Nov 06 16:09:51 user nova-compute[75337]:     <smbios mode="sysinfo"/>
Nov 06 16:09:51 user nova-compute[75337]:   </os>
Nov 06 16:09:51 user nova-compute[75337]:   <features>
Nov 06 16:09:51 user nova-compute[75337]:     <acpi/>
Nov 06 16:09:51 user nova-compute[75337]:     <apic/>
Nov 06 16:09:51 user nova-compute[75337]:     <vmcoreinfo/>
Nov 06 16:09:51 user nova-compute[75337]:   </features>
Nov 06 16:09:51 user nova-compute[75337]:   <clock offset="utc">
Nov 06 16:09:51 user nova-compute[75337]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 16:09:51 user nova-compute[75337]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 16:09:51 user nova-compute[75337]:     <timer name="hpet" present="no"/>
Nov 06 16:09:51 user nova-compute[75337]:   </clock>
Nov 06 16:09:51 user nova-compute[75337]:   <cpu mode="custom" match="exact">
Nov 06 16:09:51 user nova-compute[75337]:     <model>Nehalem</model>
Nov 06 16:09:51 user nova-compute[75337]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 16:09:51 user nova-compute[75337]:   </cpu>
Nov 06 16:09:51 user nova-compute[75337]:   <devices>
Nov 06 16:09:51 user nova-compute[75337]:     <disk type="block" device="disk">
Nov 06 16:09:51 user nova-compute[75337]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 16:09:51 user nova-compute[75337]:       <source dev="/dev/sdd"/>
Nov 06 16:09:51 user nova-compute[75337]:       <target dev="vda" bus="virtio"/>
Nov 06 16:09:51 user nova-compute[75337]:       <serial>06b3b613-3c1e-4420-a500-1ec3988c0940</serial>
Nov 06 16:09:51 user nova-compute[75337]:     </disk>
Nov 06 16:09:51 user nova-compute[75337]:     <interface type="ethernet">
Nov 06 16:09:51 user nova-compute[75337]:       <mac address="fa:16:3e:f5:3f:f6"/>
Nov 06 16:09:51 user nova-compute[75337]:       <model type="virtio"/>
Nov 06 16:09:51 user nova-compute[75337]:       <mtu size="1442"/>
Nov 06 16:09:51 user nova-compute[75337]:       <target dev="tap75853df2-1f"/>
Nov 06 16:09:51 user nova-compute[75337]:     </interface>
Nov 06 16:09:51 user nova-compute[75337]:     <serial type="pty">
Nov 06 16:09:51 user nova-compute[75337]:       <log file="/opt/stack/data/nova/instances/15922f4f-f921-4245-8d3d-98ed47de946b/console.log" append="off"/>
Nov 06 16:09:51 user nova-compute[75337]:     </serial>
Nov 06 16:09:51 user nova-compute[75337]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 16:09:51 user nova-compute[75337]:     <video>
Nov 06 16:09:51 user nova-compute[75337]:       <model type="virtio"/>
Nov 06 16:09:51 user nova-compute[75337]:     </video>
Nov 06 16:09:51 user nova-compute[75337]:     <rng model="virtio">
Nov 06 16:09:51 user nova-compute[75337]:       <backend model="random">/dev/urandom</backend>
Nov 06 16:09:51 user nova-compute[75337]:     </rng>
Nov 06 16:09:51 user nova-compute[75337]:     <controller type="usb" index="0" model="none"/>
Nov 06 16:09:51 user nova-compute[75337]:     <memballoon model="virtio">
Nov 06 16:09:51 user nova-compute[75337]:       <stats period="10"/>
Nov 06 16:09:51 user nova-compute[75337]:     </memballoon>
Nov 06 16:09:51 user nova-compute[75337]:   </devices>
Nov 06 16:09:51 user nova-compute[75337]: </domain>
Nov 06 16:09:51 user nova-compute[75337]:  {{(pid=75337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 16:09:51 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-94511e9a-9c44-4e1c-ac79-58ba0827413c tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T16:09:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1606147193',display_name='tempest-TestShelveInstance-server-1606147193',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1606147193',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBET5bxZ8mLAaWl4HqozpzhdVRJ1LnlkTiYfny9D2S0JwqS5aepxP0yT+cU0Pc9wCAKkm2TfPGhm7ljhyuLG76JgiijG2E7WfgIyahxQ8ji6zb6gr2/OWhMqORY7NLSU2HQ==',key_name='tempest-TestShelveInstance-1222945182',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='573524caeb6248339e924a5abb8e5964',ramdisk_id='',reservation_id='r-totl4fkd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-652677760',owner_user_name='tempest-TestShelveInstance-652677760-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T16:09:26Z,user_data=None,user_id='3204b8f95945489d8335cafa44ab2109',uuid=15922f4f-f921-4245-8d3d-98ed47de946b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "75853df2-1f1a-4a4f-be80-b29cd2452bd2", "address": "fa:16:3e:f5:3f:f6", "network": {"id": "6b24c7e3-9e9c-4a84-8472-7629c0dc8029", "bridge": "br-int", "label": "tempest-TestShelveInstance-284079759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "573524caeb6248339e924a5abb8e5964", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75853df2-1f", "ovs_interfaceid": "75853df2-1f1a-4a4f-be80-b29cd2452bd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 16:09:51 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-94511e9a-9c44-4e1c-ac79-58ba0827413c tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Converting VIF {"id": "75853df2-1f1a-4a4f-be80-b29cd2452bd2", "address": "fa:16:3e:f5:3f:f6", "network": {"id": "6b24c7e3-9e9c-4a84-8472-7629c0dc8029", "bridge": "br-int", "label": "tempest-TestShelveInstance-284079759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "573524caeb6248339e924a5abb8e5964", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75853df2-1f", "ovs_interfaceid": "75853df2-1f1a-4a4f-be80-b29cd2452bd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 16:09:51 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-94511e9a-9c44-4e1c-ac79-58ba0827413c tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:3f:f6,bridge_name='br-int',has_traffic_filtering=True,id=75853df2-1f1a-4a4f-be80-b29cd2452bd2,network=Network(6b24c7e3-9e9c-4a84-8472-7629c0dc8029),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75853df2-1f') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 16:09:51 user nova-compute[75337]: DEBUG os_vif [None req-94511e9a-9c44-4e1c-ac79-58ba0827413c tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:3f:f6,bridge_name='br-int',has_traffic_filtering=True,id=75853df2-1f1a-4a4f-be80-b29cd2452bd2,network=Network(6b24c7e3-9e9c-4a84-8472-7629c0dc8029),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75853df2-1f') {{(pid=75337) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 16:09:51 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:09:51 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 16:09:51 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 16:09:51 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:09:51 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '38340026-a064-50e0-b5c5-09e2b91acbbb', '_type': 'linux-noop'}}, row=False) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 16:09:51 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:09:51 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:09:51 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap75853df2-1f, may_exist=True, interface_attrs={}) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 16:09:51 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap75853df2-1f, col_values=(('qos', UUID('cd4af50a-3998-4956-91a9-dbbfdbdaaf0b')),), if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 16:09:51 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap75853df2-1f, col_values=(('external_ids', {'iface-id': '75853df2-1f1a-4a4f-be80-b29cd2452bd2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f5:3f:f6', 'vm-uuid': '15922f4f-f921-4245-8d3d-98ed47de946b'}),), if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 16:09:51 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:09:51 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:09:51 user nova-compute[75337]: INFO os_vif [None req-94511e9a-9c44-4e1c-ac79-58ba0827413c tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:3f:f6,bridge_name='br-int',has_traffic_filtering=True,id=75853df2-1f1a-4a4f-be80-b29cd2452bd2,network=Network(6b24c7e3-9e9c-4a84-8472-7629c0dc8029),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75853df2-1f')
Nov 06 16:09:51 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-94511e9a-9c44-4e1c-ac79-58ba0827413c tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] No BDM found with device name vda, not building metadata. {{(pid=75337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 16:09:51 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-94511e9a-9c44-4e1c-ac79-58ba0827413c tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] No VIF found with MAC fa:16:3e:f5:3f:f6, not building metadata {{(pid=75337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 16:09:53 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:09:53 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:09:53 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:09:53 user nova-compute[75337]: DEBUG nova.compute.manager [req-f51abbe8-849a-4c36-9d33-61bf41231343 req-9d88d6dc-d5bb-4a87-9ee3-e9ac64973e0c service nova] [instance: 15922f4f-f921-4245-8d3d-98ed47de946b] Received event network-vif-plugged-75853df2-1f1a-4a4f-be80-b29cd2452bd2 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:09:53 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-f51abbe8-849a-4c36-9d33-61bf41231343 req-9d88d6dc-d5bb-4a87-9ee3-e9ac64973e0c service nova] Acquiring lock "15922f4f-f921-4245-8d3d-98ed47de946b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:09:53 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-f51abbe8-849a-4c36-9d33-61bf41231343 req-9d88d6dc-d5bb-4a87-9ee3-e9ac64973e0c service nova] Lock "15922f4f-f921-4245-8d3d-98ed47de946b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:09:53 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-f51abbe8-849a-4c36-9d33-61bf41231343 req-9d88d6dc-d5bb-4a87-9ee3-e9ac64973e0c service nova] Lock "15922f4f-f921-4245-8d3d-98ed47de946b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:09:53 user nova-compute[75337]: DEBUG nova.compute.manager [req-f51abbe8-849a-4c36-9d33-61bf41231343 req-9d88d6dc-d5bb-4a87-9ee3-e9ac64973e0c service nova] [instance: 15922f4f-f921-4245-8d3d-98ed47de946b] No waiting events found dispatching network-vif-plugged-75853df2-1f1a-4a4f-be80-b29cd2452bd2 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 16:09:53 user nova-compute[75337]: WARNING nova.compute.manager [req-f51abbe8-849a-4c36-9d33-61bf41231343 req-9d88d6dc-d5bb-4a87-9ee3-e9ac64973e0c service nova] [instance: 15922f4f-f921-4245-8d3d-98ed47de946b] Received unexpected event network-vif-plugged-75853df2-1f1a-4a4f-be80-b29cd2452bd2 for instance with vm_state building and task_state spawning.
Nov 06 16:09:53 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:09:53 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:09:53 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:09:53 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:09:54 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:09:55 user nova-compute[75337]: DEBUG nova.compute.manager [None req-94511e9a-9c44-4e1c-ac79-58ba0827413c tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] [instance: 15922f4f-f921-4245-8d3d-98ed47de946b] Instance event wait completed in 0 seconds for  {{(pid=75337) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 16:09:55 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-94511e9a-9c44-4e1c-ac79-58ba0827413c tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] [instance: 15922f4f-f921-4245-8d3d-98ed47de946b] Guest created on hypervisor {{(pid=75337) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 16:09:55 user nova-compute[75337]: INFO nova.virt.libvirt.driver [-] [instance: 15922f4f-f921-4245-8d3d-98ed47de946b] Instance spawned successfully.
Nov 06 16:09:55 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-94511e9a-9c44-4e1c-ac79-58ba0827413c tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] [instance: 15922f4f-f921-4245-8d3d-98ed47de946b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 16:09:55 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-94511e9a-9c44-4e1c-ac79-58ba0827413c tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] [instance: 15922f4f-f921-4245-8d3d-98ed47de946b] Found default for hw_cdrom_bus of ide {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 16:09:55 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-94511e9a-9c44-4e1c-ac79-58ba0827413c tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] [instance: 15922f4f-f921-4245-8d3d-98ed47de946b] Found default for hw_disk_bus of virtio {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 16:09:55 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-94511e9a-9c44-4e1c-ac79-58ba0827413c tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] [instance: 15922f4f-f921-4245-8d3d-98ed47de946b] Found default for hw_input_bus of None {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 16:09:55 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-94511e9a-9c44-4e1c-ac79-58ba0827413c tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] [instance: 15922f4f-f921-4245-8d3d-98ed47de946b] Found default for hw_pointer_model of None {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 16:09:55 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-94511e9a-9c44-4e1c-ac79-58ba0827413c tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] [instance: 15922f4f-f921-4245-8d3d-98ed47de946b] Found default for hw_video_model of virtio {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 16:09:55 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-94511e9a-9c44-4e1c-ac79-58ba0827413c tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] [instance: 15922f4f-f921-4245-8d3d-98ed47de946b] Found default for hw_vif_model of virtio {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 16:09:55 user nova-compute[75337]: DEBUG nova.compute.manager [req-3671b3a3-3e7b-41e3-8908-0337ae06e406 req-683a348e-b19e-4482-be7b-e3d8057264cb service nova] [instance: 15922f4f-f921-4245-8d3d-98ed47de946b] Received event network-vif-plugged-75853df2-1f1a-4a4f-be80-b29cd2452bd2 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:09:55 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-3671b3a3-3e7b-41e3-8908-0337ae06e406 req-683a348e-b19e-4482-be7b-e3d8057264cb service nova] Acquiring lock "15922f4f-f921-4245-8d3d-98ed47de946b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:09:55 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-3671b3a3-3e7b-41e3-8908-0337ae06e406 req-683a348e-b19e-4482-be7b-e3d8057264cb service nova] Lock "15922f4f-f921-4245-8d3d-98ed47de946b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:09:55 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-3671b3a3-3e7b-41e3-8908-0337ae06e406 req-683a348e-b19e-4482-be7b-e3d8057264cb service nova] Lock "15922f4f-f921-4245-8d3d-98ed47de946b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:09:55 user nova-compute[75337]: DEBUG nova.compute.manager [req-3671b3a3-3e7b-41e3-8908-0337ae06e406 req-683a348e-b19e-4482-be7b-e3d8057264cb service nova] [instance: 15922f4f-f921-4245-8d3d-98ed47de946b] No waiting events found dispatching network-vif-plugged-75853df2-1f1a-4a4f-be80-b29cd2452bd2 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 16:09:55 user nova-compute[75337]: WARNING nova.compute.manager [req-3671b3a3-3e7b-41e3-8908-0337ae06e406 req-683a348e-b19e-4482-be7b-e3d8057264cb service nova] [instance: 15922f4f-f921-4245-8d3d-98ed47de946b] Received unexpected event network-vif-plugged-75853df2-1f1a-4a4f-be80-b29cd2452bd2 for instance with vm_state building and task_state spawning.
Nov 06 16:09:55 user nova-compute[75337]: INFO nova.compute.manager [None req-94511e9a-9c44-4e1c-ac79-58ba0827413c tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] [instance: 15922f4f-f921-4245-8d3d-98ed47de946b] Took 5.14 seconds to spawn the instance on the hypervisor.
Nov 06 16:09:55 user nova-compute[75337]: DEBUG nova.compute.manager [None req-94511e9a-9c44-4e1c-ac79-58ba0827413c tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] [instance: 15922f4f-f921-4245-8d3d-98ed47de946b] Checking state {{(pid=75337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 16:09:55 user nova-compute[75337]: INFO nova.compute.manager [None req-94511e9a-9c44-4e1c-ac79-58ba0827413c tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] [instance: 15922f4f-f921-4245-8d3d-98ed47de946b] Took 29.85 seconds to build instance.
Nov 06 16:09:55 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-94511e9a-9c44-4e1c-ac79-58ba0827413c tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Lock "15922f4f-f921-4245-8d3d-98ed47de946b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 29.954s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:09:55 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:09:56 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:09:59 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:10:01 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:10:04 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-178d570d-a701-4eb3-b6c9-9ad734dd3847 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Acquiring lock "88330c21-69e0-4d82-ac4d-b9e5e849f487" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:10:04 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-178d570d-a701-4eb3-b6c9-9ad734dd3847 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Lock "88330c21-69e0-4d82-ac4d-b9e5e849f487" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:10:04 user nova-compute[75337]: INFO nova.compute.manager [None req-178d570d-a701-4eb3-b6c9-9ad734dd3847 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] [instance: 88330c21-69e0-4d82-ac4d-b9e5e849f487] Detaching volume fd402fa7-6910-4e0a-8539-e467e32c337d
Nov 06 16:10:04 user nova-compute[75337]: INFO nova.virt.block_device [None req-178d570d-a701-4eb3-b6c9-9ad734dd3847 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] [instance: 88330c21-69e0-4d82-ac4d-b9e5e849f487] Attempting to driver detach volume fd402fa7-6910-4e0a-8539-e467e32c337d from mountpoint /dev/vdb
Nov 06 16:10:04 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-178d570d-a701-4eb3-b6c9-9ad734dd3847 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Attempting to detach device vdb from instance 88330c21-69e0-4d82-ac4d-b9e5e849f487 from the persistent domain config. {{(pid=75337) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 06 16:10:04 user nova-compute[75337]: DEBUG nova.virt.libvirt.guest [None req-178d570d-a701-4eb3-b6c9-9ad734dd3847 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 16:10:04 user nova-compute[75337]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 16:10:04 user nova-compute[75337]:   <source dev="/dev/sde"/>
Nov 06 16:10:04 user nova-compute[75337]:   <target dev="vdb" bus="virtio"/>
Nov 06 16:10:04 user nova-compute[75337]:   <serial>fd402fa7-6910-4e0a-8539-e467e32c337d</serial>
Nov 06 16:10:04 user nova-compute[75337]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 06 16:10:04 user nova-compute[75337]: </disk>
Nov 06 16:10:04 user nova-compute[75337]:  {{(pid=75337) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 16:10:04 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-178d570d-a701-4eb3-b6c9-9ad734dd3847 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Successfully detached device vdb from instance 88330c21-69e0-4d82-ac4d-b9e5e849f487 from the persistent domain config.
Nov 06 16:10:04 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-178d570d-a701-4eb3-b6c9-9ad734dd3847 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 88330c21-69e0-4d82-ac4d-b9e5e849f487 from the live domain config. {{(pid=75337) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 06 16:10:04 user nova-compute[75337]: DEBUG nova.virt.libvirt.guest [None req-178d570d-a701-4eb3-b6c9-9ad734dd3847 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 16:10:04 user nova-compute[75337]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 16:10:04 user nova-compute[75337]:   <source dev="/dev/sde"/>
Nov 06 16:10:04 user nova-compute[75337]:   <target dev="vdb" bus="virtio"/>
Nov 06 16:10:04 user nova-compute[75337]:   <serial>fd402fa7-6910-4e0a-8539-e467e32c337d</serial>
Nov 06 16:10:04 user nova-compute[75337]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 06 16:10:04 user nova-compute[75337]: </disk>
Nov 06 16:10:04 user nova-compute[75337]:  {{(pid=75337) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 16:10:04 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-178d570d-a701-4eb3-b6c9-9ad734dd3847 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 88330c21-69e0-4d82-ac4d-b9e5e849f487 {{(pid=75337) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 06 16:10:06 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:10:06 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:10:06 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75337) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 16:10:06 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 16:10:06 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 16:10:06 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:10:08 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-25ed1b55-cd7a-4407-8382-b3112b0c935c tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance f9c98d28-41f9-498f-8c1f-43517999775a is timed out.
Nov 06 16:10:08 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-25ed1b55-cd7a-4407-8382-b3112b0c935c tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Successfully detached device vdc from instance f9c98d28-41f9-498f-8c1f-43517999775a from the live domain config.
Nov 06 16:10:08 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-25ed1b55-cd7a-4407-8382-b3112b0c935c tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] [instance: f9c98d28-41f9-498f-8c1f-43517999775a] calling os-brick to detach iSCSI Volume {{(pid=75337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 16:10:08 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-25ed1b55-cd7a-4407-8382-b3112b0c935c tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2abc33d0c0>, {'target_iqn': 'iqn.2010-10.org.openstack:e489f049-8b52-46e0-9fc4-a27475db3aea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lQXFwLNH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 16:10:08 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-25ed1b55-cd7a-4407-8382-b3112b0c935c tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 16:10:08 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-25ed1b55-cd7a-4407-8382-b3112b0c935c tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 16:10:08 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-25ed1b55-cd7a-4407-8382-b3112b0c935c tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 16:10:08 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:10:08 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:10:08 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6acf6a3-2ba3-4871-84af-59705070669a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:06b3b613-3c1e-4420-a500-1ec3988c0940\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e489f049-8b52-46e0-9fc4-a27475db3aea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fd402fa7-6910-4e0a-8539-e467e32c337d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:10:08 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-25ed1b55-cd7a-4407-8382-b3112b0c935c tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 16:10:08 user nova-compute[75337]: No targets found.
Nov 06 16:10:08 user nova-compute[75337]: iSNS:
Nov 06 16:10:08 user nova-compute[75337]: No targets found.
Nov 06 16:10:08 user nova-compute[75337]: STATIC:
Nov 06 16:10:08 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:06b3b613-3c1e-4420-a500-1ec3988c0940
Nov 06 16:10:08 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 16:10:08 user nova-compute[75337]:                 Iface Name: default
Nov 06 16:10:08 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:e489f049-8b52-46e0-9fc4-a27475db3aea
Nov 06 16:10:08 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 16:10:08 user nova-compute[75337]:                 Iface Name: default
Nov 06 16:10:08 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:fd402fa7-6910-4e0a-8539-e467e32c337d
Nov 06 16:10:08 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 16:10:08 user nova-compute[75337]:                 Iface Name: default
Nov 06 16:10:08 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139
Nov 06 16:10:08 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 16:10:08 user nova-compute[75337]:                 Iface Name: default
Nov 06 16:10:08 user nova-compute[75337]: FIRMWARE:
Nov 06 16:10:08 user nova-compute[75337]: No targets found.
Nov 06 16:10:08 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 16:10:08 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-25ed1b55-cd7a-4407-8382-b3112b0c935c tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 16:10:08 user nova-compute[75337]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 16:10:08 user nova-compute[75337]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75337) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 16:10:08 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-25ed1b55-cd7a-4407-8382-b3112b0c935c tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e489f049-8b52-46e0-9fc4-a27475db3aea', 0)] {{(pid=75337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 16:10:08 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:10:08 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:10:08 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b986109-422b-4aa2-9ffb-23601bebaeff]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:06b3b613-3c1e-4420-a500-1ec3988c0940\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e489f049-8b52-46e0-9fc4-a27475db3aea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fd402fa7-6910-4e0a-8539-e467e32c337d\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:10:08 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:10:08 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:10:08 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c9ea124-a7f8-4e9b-aea5-26beaf59693a]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e489f049-8b52-46e0-9fc4-a27475db3aea (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd402fa7-6910-4e0a-8539-e467e32c337d (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06b3b613-3c1e-4420-a500-1ec3988c0940 (non-flash)\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:10:08 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-25ed1b55-cd7a-4407-8382-b3112b0c935c tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139 (non-flash)
Nov 06 16:10:08 user nova-compute[75337]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e489f049-8b52-46e0-9fc4-a27475db3aea (non-flash)
Nov 06 16:10:08 user nova-compute[75337]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd402fa7-6910-4e0a-8539-e467e32c337d (non-flash)
Nov 06 16:10:08 user nova-compute[75337]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06b3b613-3c1e-4420-a500-1ec3988c0940 (non-flash)
Nov 06 16:10:08 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 16:10:08 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-25ed1b55-cd7a-4407-8382-b3112b0c935c tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139 (non-flash)
Nov 06 16:10:08 user nova-compute[75337]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e489f049-8b52-46e0-9fc4-a27475db3aea (non-flash)
Nov 06 16:10:08 user nova-compute[75337]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd402fa7-6910-4e0a-8539-e467e32c337d (non-flash)
Nov 06 16:10:08 user nova-compute[75337]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06b3b613-3c1e-4420-a500-1ec3988c0940 (non-flash)
Nov 06 16:10:08 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 16:10:08 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-25ed1b55-cd7a-4407-8382-b3112b0c935c tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2a9c25f1c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e489f049-8b52-46e0-9fc4-a27475db3aea'): ({'sdb'}, set())}) {{(pid=75337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 16:10:08 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-25ed1b55-cd7a-4407-8382-b3112b0c935c tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Removing single pathed devices sdb {{(pid=75337) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 16:10:08 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:10:08 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:10:08 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[331b3d7d-fd69-437a-a027-ff83898d59a3]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:10:08 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:10:08 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.026s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:10:08 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b45ac8e-591e-4c33-95c6-93f3ed6df8b6]: (4, ('ok\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:10:08 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-25ed1b55-cd7a-4407-8382-b3112b0c935c tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Flushing IO for device /dev/sdb {{(pid=75337) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 16:10:08 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:10:08 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:10:08 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[664739ff-3d0d-47b0-bc59-811300b27b43]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:10:08 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-25ed1b55-cd7a-4407-8382-b3112b0c935c tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75337) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 16:10:08 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:10:09 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:10:09 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[03c55049-c65c-414a-9102-19f1f1252af4]: (4, ('1', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:10:09 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-25ed1b55-cd7a-4407-8382-b3112b0c935c tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 16:10:09 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-25ed1b55-cd7a-4407-8382-b3112b0c935c tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] SCSI volumes sdb have been removed. {{(pid=75337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 16:10:09 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-25ed1b55-cd7a-4407-8382-b3112b0c935c tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e489f049-8b52-46e0-9fc4-a27475db3aea')] {{(pid=75337) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 16:10:09 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e489f049-8b52-46e0-9fc4-a27475db3aea -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:10:09 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e489f049-8b52-46e0-9fc4-a27475db3aea -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.039s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:10:09 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ea69073-f9b9-4d84-914a-101100fb8849]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:10:09 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-25ed1b55-cd7a-4407-8382-b3112b0c935c tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:10:09 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e489f049-8b52-46e0-9fc4-a27475db3aea -p 172.16.0.220:3260 --logout {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:10:09 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e489f049-8b52-46e0-9fc4-a27475db3aea -p 172.16.0.220:3260 --logout" returned: 0 in 0.128s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:10:09 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[575c4000-a72b-41b1-a6e7-60c9f8bcf2f5]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:e489f049-8b52-46e0-9fc4-a27475db3aea, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:e489f049-8b52-46e0-9fc4-a27475db3aea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:10:09 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-25ed1b55-cd7a-4407-8382-b3112b0c935c tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:e489f049-8b52-46e0-9fc4-a27475db3aea, portal: 172.16.0.220,3260]
Nov 06 16:10:09 user nova-compute[75337]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:e489f049-8b52-46e0-9fc4-a27475db3aea, portal: 172.16.0.220,3260] successful.
Nov 06 16:10:09 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:10:09 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e489f049-8b52-46e0-9fc4-a27475db3aea -p 172.16.0.220:3260 --op delete {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:10:09 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e489f049-8b52-46e0-9fc4-a27475db3aea -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:10:09 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[72a49d8d-8327-4267-861e-b9aad672f7ba]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:10:09 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-25ed1b55-cd7a-4407-8382-b3112b0c935c tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:10:09 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-25ed1b55-cd7a-4407-8382-b3112b0c935c tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.429s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 16:10:09 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-25ed1b55-cd7a-4407-8382-b3112b0c935c tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] <== disconnect_volume: return (431ms) None {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 16:10:09 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-25ed1b55-cd7a-4407-8382-b3112b0c935c tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] [instance: f9c98d28-41f9-498f-8c1f-43517999775a] Disconnected iSCSI Volume {{(pid=75337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 16:10:11 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:10:13 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:10:14 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:10:16 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:10:17 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:10:18 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:10:18 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75337) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 16:10:18 user nova-compute[75337]: DEBUG nova.objects.instance [None req-25ed1b55-cd7a-4407-8382-b3112b0c935c tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Lazy-loading 'flavor' on Instance uuid f9c98d28-41f9-498f-8c1f-43517999775a {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 16:10:19 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-25ed1b55-cd7a-4407-8382-b3112b0c935c tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Lock "f9c98d28-41f9-498f-8c1f-43517999775a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 30.768s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:10:19 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:10:19 user nova-compute[75337]: DEBUG nova.compute.manager [req-d0375892-7243-40ee-ae2f-35490356f943 req-2518c7b2-1461-4029-b5ce-d548ed4397c3 service nova] [instance: 01b61f9a-2591-4714-b18e-54f674a441ab] Received event network-changed-b5784ac8-0dc1-41ef-bb91-1e6b7d8a61fe {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:10:19 user nova-compute[75337]: DEBUG nova.compute.manager [req-d0375892-7243-40ee-ae2f-35490356f943 req-2518c7b2-1461-4029-b5ce-d548ed4397c3 service nova] [instance: 01b61f9a-2591-4714-b18e-54f674a441ab] Refreshing instance network info cache due to event network-changed-b5784ac8-0dc1-41ef-bb91-1e6b7d8a61fe. {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 16:10:19 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-d0375892-7243-40ee-ae2f-35490356f943 req-2518c7b2-1461-4029-b5ce-d548ed4397c3 service nova] Acquiring lock "refresh_cache-01b61f9a-2591-4714-b18e-54f674a441ab" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 16:10:19 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-d0375892-7243-40ee-ae2f-35490356f943 req-2518c7b2-1461-4029-b5ce-d548ed4397c3 service nova] Acquired lock "refresh_cache-01b61f9a-2591-4714-b18e-54f674a441ab" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 16:10:19 user nova-compute[75337]: DEBUG nova.network.neutron [req-d0375892-7243-40ee-ae2f-35490356f943 req-2518c7b2-1461-4029-b5ce-d548ed4397c3 service nova] [instance: 01b61f9a-2591-4714-b18e-54f674a441ab] Refreshing network info cache for port b5784ac8-0dc1-41ef-bb91-1e6b7d8a61fe {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 16:10:19 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-2aaf588e-8f6a-4aa6-b99c-07a55c7fcbd5 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Acquiring lock "01b61f9a-2591-4714-b18e-54f674a441ab" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:10:19 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-2aaf588e-8f6a-4aa6-b99c-07a55c7fcbd5 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Lock "01b61f9a-2591-4714-b18e-54f674a441ab" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:10:19 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-2aaf588e-8f6a-4aa6-b99c-07a55c7fcbd5 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Acquiring lock "01b61f9a-2591-4714-b18e-54f674a441ab-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:10:19 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-2aaf588e-8f6a-4aa6-b99c-07a55c7fcbd5 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Lock "01b61f9a-2591-4714-b18e-54f674a441ab-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:10:19 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-2aaf588e-8f6a-4aa6-b99c-07a55c7fcbd5 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Lock "01b61f9a-2591-4714-b18e-54f674a441ab-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:10:19 user nova-compute[75337]: INFO nova.compute.manager [None req-2aaf588e-8f6a-4aa6-b99c-07a55c7fcbd5 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] [instance: 01b61f9a-2591-4714-b18e-54f674a441ab] Terminating instance
Nov 06 16:10:19 user nova-compute[75337]: DEBUG nova.compute.manager [None req-2aaf588e-8f6a-4aa6-b99c-07a55c7fcbd5 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] [instance: 01b61f9a-2591-4714-b18e-54f674a441ab] Start destroying the instance on the hypervisor. {{(pid=75337) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 16:10:19 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:10:19 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:10:19 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:10:19 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:10:19 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:10:20 user nova-compute[75337]: INFO nova.virt.libvirt.driver [-] [instance: 01b61f9a-2591-4714-b18e-54f674a441ab] Instance destroyed successfully.
Nov 06 16:10:20 user nova-compute[75337]: DEBUG nova.objects.instance [None req-2aaf588e-8f6a-4aa6-b99c-07a55c7fcbd5 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Lazy-loading 'resources' on Instance uuid 01b61f9a-2591-4714-b18e-54f674a441ab {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 16:10:20 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-2aaf588e-8f6a-4aa6-b99c-07a55c7fcbd5 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T16:01:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1483310334',display_name='tempest-TestStampPattern-server-1483310334',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1483310334',id=39,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMMCtkcnnPytdqY3MPUgpmiSS7xeTmnpNw4yaIWZePSkgldKNk3oCL2U4/sFc1ScnWZoqLzBjkjfNxl1aD3owimjf0HTAAfgYQIOjLMlBJeg0uRD4v0ywlrz4Y1mxBwe3Q==',key_name='tempest-TestStampPattern-1350094120',keypairs=<?>,launch_index=0,launched_at=2023-11-06T16:01:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='37b65a37b3ac4a92af0279d7ef3b9637',ramdisk_id='',reservation_id='r-e6e2zlk2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-2127170584',owner_user_name='tempest-TestStampPattern-2127170584-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T16:04:55Z,user_data=None,user_id='b551ef2185264d24b3af5f38bd583701',uuid=01b61f9a-2591-4714-b18e-54f674a441ab,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b5784ac8-0dc1-41ef-bb91-1e6b7d8a61fe", "address": "fa:16:3e:2c:49:a1", "network": {"id": "df5f1c2e-c934-4237-aee6-f070a198c4ac", "bridge": "br-int", "label": "tempest-TestStampPattern-1883369969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37b65a37b3ac4a92af0279d7ef3b9637", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5784ac8-0d", "ovs_interfaceid": "b5784ac8-0dc1-41ef-bb91-1e6b7d8a61fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 16:10:20 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-2aaf588e-8f6a-4aa6-b99c-07a55c7fcbd5 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Converting VIF {"id": "b5784ac8-0dc1-41ef-bb91-1e6b7d8a61fe", "address": "fa:16:3e:2c:49:a1", "network": {"id": "df5f1c2e-c934-4237-aee6-f070a198c4ac", "bridge": "br-int", "label": "tempest-TestStampPattern-1883369969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37b65a37b3ac4a92af0279d7ef3b9637", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5784ac8-0d", "ovs_interfaceid": "b5784ac8-0dc1-41ef-bb91-1e6b7d8a61fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 16:10:20 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-2aaf588e-8f6a-4aa6-b99c-07a55c7fcbd5 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2c:49:a1,bridge_name='br-int',has_traffic_filtering=True,id=b5784ac8-0dc1-41ef-bb91-1e6b7d8a61fe,network=Network(df5f1c2e-c934-4237-aee6-f070a198c4ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5784ac8-0d') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 16:10:20 user nova-compute[75337]: DEBUG os_vif [None req-2aaf588e-8f6a-4aa6-b99c-07a55c7fcbd5 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2c:49:a1,bridge_name='br-int',has_traffic_filtering=True,id=b5784ac8-0dc1-41ef-bb91-1e6b7d8a61fe,network=Network(df5f1c2e-c934-4237-aee6-f070a198c4ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5784ac8-0d') {{(pid=75337) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 16:10:20 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:10:20 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb5784ac8-0d, bridge=br-int, if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 16:10:20 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:10:20 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-d0b3ba18-5ad8-46e9-a922-e36edecd0bee tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Acquiring lock "f9c98d28-41f9-498f-8c1f-43517999775a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:10:20 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-d0b3ba18-5ad8-46e9-a922-e36edecd0bee tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Lock "f9c98d28-41f9-498f-8c1f-43517999775a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:10:20 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-d0b3ba18-5ad8-46e9-a922-e36edecd0bee tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Acquiring lock "f9c98d28-41f9-498f-8c1f-43517999775a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:10:20 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-d0b3ba18-5ad8-46e9-a922-e36edecd0bee tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Lock "f9c98d28-41f9-498f-8c1f-43517999775a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:10:20 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-d0b3ba18-5ad8-46e9-a922-e36edecd0bee tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Lock "f9c98d28-41f9-498f-8c1f-43517999775a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:10:20 user nova-compute[75337]: INFO nova.compute.manager [None req-d0b3ba18-5ad8-46e9-a922-e36edecd0bee tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] [instance: f9c98d28-41f9-498f-8c1f-43517999775a] Terminating instance
Nov 06 16:10:20 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:10:20 user nova-compute[75337]: DEBUG nova.compute.manager [None req-d0b3ba18-5ad8-46e9-a922-e36edecd0bee tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] [instance: f9c98d28-41f9-498f-8c1f-43517999775a] Start destroying the instance on the hypervisor. {{(pid=75337) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 16:10:20 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:10:20 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c91c0b79-003f-44d4-abcf-37ba3b0cec66) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 16:10:20 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:10:20 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:10:20 user nova-compute[75337]: INFO os_vif [None req-2aaf588e-8f6a-4aa6-b99c-07a55c7fcbd5 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2c:49:a1,bridge_name='br-int',has_traffic_filtering=True,id=b5784ac8-0dc1-41ef-bb91-1e6b7d8a61fe,network=Network(df5f1c2e-c934-4237-aee6-f070a198c4ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5784ac8-0d')
Nov 06 16:10:20 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-2aaf588e-8f6a-4aa6-b99c-07a55c7fcbd5 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] [instance: 01b61f9a-2591-4714-b18e-54f674a441ab] Deleting instance files /opt/stack/data/nova/instances/01b61f9a-2591-4714-b18e-54f674a441ab_del
Nov 06 16:10:20 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-2aaf588e-8f6a-4aa6-b99c-07a55c7fcbd5 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] [instance: 01b61f9a-2591-4714-b18e-54f674a441ab] Deletion of /opt/stack/data/nova/instances/01b61f9a-2591-4714-b18e-54f674a441ab_del complete
Nov 06 16:10:20 user nova-compute[75337]: DEBUG nova.network.neutron [req-d0375892-7243-40ee-ae2f-35490356f943 req-2518c7b2-1461-4029-b5ce-d548ed4397c3 service nova] [instance: 01b61f9a-2591-4714-b18e-54f674a441ab] Updated VIF entry in instance network info cache for port b5784ac8-0dc1-41ef-bb91-1e6b7d8a61fe. {{(pid=75337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 16:10:20 user nova-compute[75337]: DEBUG nova.network.neutron [req-d0375892-7243-40ee-ae2f-35490356f943 req-2518c7b2-1461-4029-b5ce-d548ed4397c3 service nova] [instance: 01b61f9a-2591-4714-b18e-54f674a441ab] Updating instance_info_cache with network_info: [{"id": "b5784ac8-0dc1-41ef-bb91-1e6b7d8a61fe", "address": "fa:16:3e:2c:49:a1", "network": {"id": "df5f1c2e-c934-4237-aee6-f070a198c4ac", "bridge": "br-int", "label": "tempest-TestStampPattern-1883369969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37b65a37b3ac4a92af0279d7ef3b9637", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5784ac8-0d", "ovs_interfaceid": "b5784ac8-0dc1-41ef-bb91-1e6b7d8a61fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 16:10:20 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-d0375892-7243-40ee-ae2f-35490356f943 req-2518c7b2-1461-4029-b5ce-d548ed4397c3 service nova] Releasing lock "refresh_cache-01b61f9a-2591-4714-b18e-54f674a441ab" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 16:10:20 user nova-compute[75337]: INFO nova.compute.manager [None req-2aaf588e-8f6a-4aa6-b99c-07a55c7fcbd5 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] [instance: 01b61f9a-2591-4714-b18e-54f674a441ab] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 06 16:10:20 user nova-compute[75337]: DEBUG oslo.service.loopingcall [None req-2aaf588e-8f6a-4aa6-b99c-07a55c7fcbd5 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75337) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 16:10:20 user nova-compute[75337]: DEBUG nova.compute.manager [-] [instance: 01b61f9a-2591-4714-b18e-54f674a441ab] Deallocating network for instance {{(pid=75337) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 16:10:20 user nova-compute[75337]: DEBUG nova.network.neutron [-] [instance: 01b61f9a-2591-4714-b18e-54f674a441ab] deallocate_for_instance() {{(pid=75337) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 16:10:20 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:10:20 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:10:20 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:10:20 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:10:20 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:10:20 user nova-compute[75337]: DEBUG nova.network.neutron [-] [instance: 01b61f9a-2591-4714-b18e-54f674a441ab] Updating instance_info_cache with network_info: [] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 16:10:20 user nova-compute[75337]: INFO nova.compute.manager [-] [instance: 01b61f9a-2591-4714-b18e-54f674a441ab] Took 0.51 seconds to deallocate network for instance.
Nov 06 16:10:20 user nova-compute[75337]: DEBUG nova.compute.manager [req-ab61a6e8-b3b1-462c-9595-77ef2596ee23 req-a4a19dde-0448-4cac-87c5-817c131a3a5b service nova] [instance: 01b61f9a-2591-4714-b18e-54f674a441ab] Received event network-vif-deleted-b5784ac8-0dc1-41ef-bb91-1e6b7d8a61fe {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:10:20 user nova-compute[75337]: DEBUG nova.compute.manager [req-6f25c276-1a46-4bb3-8f6f-2bce2f23008c req-ebdb8515-3d0b-47ba-865d-6a9a480765aa service nova] [instance: f9c98d28-41f9-498f-8c1f-43517999775a] Received event network-vif-unplugged-65003741-14af-48d8-9ca6-0e075aab5008 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:10:20 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-6f25c276-1a46-4bb3-8f6f-2bce2f23008c req-ebdb8515-3d0b-47ba-865d-6a9a480765aa service nova] Acquiring lock "f9c98d28-41f9-498f-8c1f-43517999775a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:10:20 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-6f25c276-1a46-4bb3-8f6f-2bce2f23008c req-ebdb8515-3d0b-47ba-865d-6a9a480765aa service nova] Lock "f9c98d28-41f9-498f-8c1f-43517999775a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:10:20 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-6f25c276-1a46-4bb3-8f6f-2bce2f23008c req-ebdb8515-3d0b-47ba-865d-6a9a480765aa service nova] Lock "f9c98d28-41f9-498f-8c1f-43517999775a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:10:20 user nova-compute[75337]: DEBUG nova.compute.manager [req-6f25c276-1a46-4bb3-8f6f-2bce2f23008c req-ebdb8515-3d0b-47ba-865d-6a9a480765aa service nova] [instance: f9c98d28-41f9-498f-8c1f-43517999775a] No waiting events found dispatching network-vif-unplugged-65003741-14af-48d8-9ca6-0e075aab5008 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 16:10:20 user nova-compute[75337]: DEBUG nova.compute.manager [req-6f25c276-1a46-4bb3-8f6f-2bce2f23008c req-ebdb8515-3d0b-47ba-865d-6a9a480765aa service nova] [instance: f9c98d28-41f9-498f-8c1f-43517999775a] Received event network-vif-unplugged-65003741-14af-48d8-9ca6-0e075aab5008 for instance with task_state deleting. {{(pid=75337) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 16:10:20 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-2aaf588e-8f6a-4aa6-b99c-07a55c7fcbd5 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:10:20 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-2aaf588e-8f6a-4aa6-b99c-07a55c7fcbd5 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:10:20 user nova-compute[75337]: INFO nova.virt.libvirt.driver [-] [instance: f9c98d28-41f9-498f-8c1f-43517999775a] Instance destroyed successfully.
Nov 06 16:10:20 user nova-compute[75337]: DEBUG nova.objects.instance [None req-d0b3ba18-5ad8-46e9-a922-e36edecd0bee tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Lazy-loading 'resources' on Instance uuid f9c98d28-41f9-498f-8c1f-43517999775a {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 16:10:21 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-d0b3ba18-5ad8-46e9-a922-e36edecd0bee tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T16:05:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-952331388',display_name='tempest-AttachVolumeTestJSON-server-952331388',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-952331388',id=44,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOwKk9UoWoYFREe74ue/NAz48AjEU4QGi+Ck6n56tqRpGczSYurRXfrnD2NeGuCcYFTR415eQw2oqSOfOBlcvid8kAIrK7gJY4ux7BfEgumK8nDPb8eiQLXHwNEW5VCa/A==',key_name='tempest-keypair-493283673',keypairs=<?>,launch_index=0,launched_at=2023-11-06T16:05:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='98fac9096a3b4f21ba805ba1437d9d38',ramdisk_id='',reservation_id='r-yb5ac200',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-636759182',owner_user_name='tempest-AttachVolumeTestJSON-636759182-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T16:05:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ef1008574bea4cfca8a20b2edcf0aacd',uuid=f9c98d28-41f9-498f-8c1f-43517999775a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "65003741-14af-48d8-9ca6-0e075aab5008", "address": "fa:16:3e:d6:6c:ea", "network": {"id": "8b217731-de9e-49bc-84bb-130fd42ede51", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-314618758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98fac9096a3b4f21ba805ba1437d9d38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65003741-14", "ovs_interfaceid": "65003741-14af-48d8-9ca6-0e075aab5008", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 16:10:21 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-d0b3ba18-5ad8-46e9-a922-e36edecd0bee tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Converting VIF {"id": "65003741-14af-48d8-9ca6-0e075aab5008", "address": "fa:16:3e:d6:6c:ea", "network": {"id": "8b217731-de9e-49bc-84bb-130fd42ede51", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-314618758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98fac9096a3b4f21ba805ba1437d9d38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65003741-14", "ovs_interfaceid": "65003741-14af-48d8-9ca6-0e075aab5008", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 16:10:21 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-d0b3ba18-5ad8-46e9-a922-e36edecd0bee tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d6:6c:ea,bridge_name='br-int',has_traffic_filtering=True,id=65003741-14af-48d8-9ca6-0e075aab5008,network=Network(8b217731-de9e-49bc-84bb-130fd42ede51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65003741-14') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 16:10:21 user nova-compute[75337]: DEBUG os_vif [None req-d0b3ba18-5ad8-46e9-a922-e36edecd0bee tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d6:6c:ea,bridge_name='br-int',has_traffic_filtering=True,id=65003741-14af-48d8-9ca6-0e075aab5008,network=Network(8b217731-de9e-49bc-84bb-130fd42ede51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65003741-14') {{(pid=75337) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 16:10:21 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:10:21 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap65003741-14, bridge=br-int, if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 16:10:21 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:10:21 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:10:21 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:10:21 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f119c606-6d49-49e9-99d2-89345a6b0e84) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 16:10:21 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:10:21 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:10:21 user nova-compute[75337]: INFO os_vif [None req-d0b3ba18-5ad8-46e9-a922-e36edecd0bee tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d6:6c:ea,bridge_name='br-int',has_traffic_filtering=True,id=65003741-14af-48d8-9ca6-0e075aab5008,network=Network(8b217731-de9e-49bc-84bb-130fd42ede51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65003741-14')
Nov 06 16:10:21 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-d0b3ba18-5ad8-46e9-a922-e36edecd0bee tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] [instance: f9c98d28-41f9-498f-8c1f-43517999775a] Deleting instance files /opt/stack/data/nova/instances/f9c98d28-41f9-498f-8c1f-43517999775a_del
Nov 06 16:10:21 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-d0b3ba18-5ad8-46e9-a922-e36edecd0bee tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] [instance: f9c98d28-41f9-498f-8c1f-43517999775a] Deletion of /opt/stack/data/nova/instances/f9c98d28-41f9-498f-8c1f-43517999775a_del complete
Nov 06 16:10:21 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-2aaf588e-8f6a-4aa6-b99c-07a55c7fcbd5 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 16:10:21 user nova-compute[75337]: INFO nova.compute.manager [None req-d0b3ba18-5ad8-46e9-a922-e36edecd0bee tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] [instance: f9c98d28-41f9-498f-8c1f-43517999775a] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 06 16:10:21 user nova-compute[75337]: DEBUG oslo.service.loopingcall [None req-d0b3ba18-5ad8-46e9-a922-e36edecd0bee tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75337) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 16:10:21 user nova-compute[75337]: DEBUG nova.compute.manager [-] [instance: f9c98d28-41f9-498f-8c1f-43517999775a] Deallocating network for instance {{(pid=75337) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 16:10:21 user nova-compute[75337]: DEBUG nova.network.neutron [-] [instance: f9c98d28-41f9-498f-8c1f-43517999775a] deallocate_for_instance() {{(pid=75337) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 16:10:21 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-2aaf588e-8f6a-4aa6-b99c-07a55c7fcbd5 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 16:10:21 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-2aaf588e-8f6a-4aa6-b99c-07a55c7fcbd5 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.245s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:10:21 user nova-compute[75337]: INFO nova.scheduler.client.report [None req-2aaf588e-8f6a-4aa6-b99c-07a55c7fcbd5 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Deleted allocations for instance 01b61f9a-2591-4714-b18e-54f674a441ab
Nov 06 16:10:21 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-2aaf588e-8f6a-4aa6-b99c-07a55c7fcbd5 tempest-TestStampPattern-2127170584 tempest-TestStampPattern-2127170584-project-member] Lock "01b61f9a-2591-4714-b18e-54f674a441ab" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.826s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:10:21 user nova-compute[75337]: DEBUG nova.compute.manager [req-f433b80a-d33b-4a39-a311-b7b871c9ce30 req-f84cb7f2-d967-466f-b59b-4e7123095f2e service nova] [instance: 01b61f9a-2591-4714-b18e-54f674a441ab] Received event network-vif-unplugged-b5784ac8-0dc1-41ef-bb91-1e6b7d8a61fe {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:10:21 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-f433b80a-d33b-4a39-a311-b7b871c9ce30 req-f84cb7f2-d967-466f-b59b-4e7123095f2e service nova] Acquiring lock "01b61f9a-2591-4714-b18e-54f674a441ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:10:21 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-f433b80a-d33b-4a39-a311-b7b871c9ce30 req-f84cb7f2-d967-466f-b59b-4e7123095f2e service nova] Lock "01b61f9a-2591-4714-b18e-54f674a441ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:10:21 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-f433b80a-d33b-4a39-a311-b7b871c9ce30 req-f84cb7f2-d967-466f-b59b-4e7123095f2e service nova] Lock "01b61f9a-2591-4714-b18e-54f674a441ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:10:21 user nova-compute[75337]: DEBUG nova.compute.manager [req-f433b80a-d33b-4a39-a311-b7b871c9ce30 req-f84cb7f2-d967-466f-b59b-4e7123095f2e service nova] [instance: 01b61f9a-2591-4714-b18e-54f674a441ab] No waiting events found dispatching network-vif-unplugged-b5784ac8-0dc1-41ef-bb91-1e6b7d8a61fe {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 16:10:21 user nova-compute[75337]: WARNING nova.compute.manager [req-f433b80a-d33b-4a39-a311-b7b871c9ce30 req-f84cb7f2-d967-466f-b59b-4e7123095f2e service nova] [instance: 01b61f9a-2591-4714-b18e-54f674a441ab] Received unexpected event network-vif-unplugged-b5784ac8-0dc1-41ef-bb91-1e6b7d8a61fe for instance with vm_state deleted and task_state None.
Nov 06 16:10:21 user nova-compute[75337]: DEBUG nova.compute.manager [req-f433b80a-d33b-4a39-a311-b7b871c9ce30 req-f84cb7f2-d967-466f-b59b-4e7123095f2e service nova] [instance: 01b61f9a-2591-4714-b18e-54f674a441ab] Received event network-vif-plugged-b5784ac8-0dc1-41ef-bb91-1e6b7d8a61fe {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:10:21 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-f433b80a-d33b-4a39-a311-b7b871c9ce30 req-f84cb7f2-d967-466f-b59b-4e7123095f2e service nova] Acquiring lock "01b61f9a-2591-4714-b18e-54f674a441ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:10:21 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-f433b80a-d33b-4a39-a311-b7b871c9ce30 req-f84cb7f2-d967-466f-b59b-4e7123095f2e service nova] Lock "01b61f9a-2591-4714-b18e-54f674a441ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:10:21 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-f433b80a-d33b-4a39-a311-b7b871c9ce30 req-f84cb7f2-d967-466f-b59b-4e7123095f2e service nova] Lock "01b61f9a-2591-4714-b18e-54f674a441ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:10:21 user nova-compute[75337]: DEBUG nova.compute.manager [req-f433b80a-d33b-4a39-a311-b7b871c9ce30 req-f84cb7f2-d967-466f-b59b-4e7123095f2e service nova] [instance: 01b61f9a-2591-4714-b18e-54f674a441ab] No waiting events found dispatching network-vif-plugged-b5784ac8-0dc1-41ef-bb91-1e6b7d8a61fe {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 16:10:21 user nova-compute[75337]: WARNING nova.compute.manager [req-f433b80a-d33b-4a39-a311-b7b871c9ce30 req-f84cb7f2-d967-466f-b59b-4e7123095f2e service nova] [instance: 01b61f9a-2591-4714-b18e-54f674a441ab] Received unexpected event network-vif-plugged-b5784ac8-0dc1-41ef-bb91-1e6b7d8a61fe for instance with vm_state deleted and task_state None.
Nov 06 16:10:21 user nova-compute[75337]: DEBUG nova.network.neutron [-] [instance: f9c98d28-41f9-498f-8c1f-43517999775a] Updating instance_info_cache with network_info: [] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 16:10:21 user nova-compute[75337]: INFO nova.compute.manager [-] [instance: f9c98d28-41f9-498f-8c1f-43517999775a] Took 0.78 seconds to deallocate network for instance.
Nov 06 16:10:21 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-d0b3ba18-5ad8-46e9-a922-e36edecd0bee tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:10:21 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-d0b3ba18-5ad8-46e9-a922-e36edecd0bee tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:10:22 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-d0b3ba18-5ad8-46e9-a922-e36edecd0bee tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 16:10:22 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-d0b3ba18-5ad8-46e9-a922-e36edecd0bee tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 16:10:22 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-d0b3ba18-5ad8-46e9-a922-e36edecd0bee tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.188s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:10:22 user nova-compute[75337]: INFO nova.scheduler.client.report [None req-d0b3ba18-5ad8-46e9-a922-e36edecd0bee tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Deleted allocations for instance f9c98d28-41f9-498f-8c1f-43517999775a
Nov 06 16:10:22 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-d0b3ba18-5ad8-46e9-a922-e36edecd0bee tempest-AttachVolumeTestJSON-636759182 tempest-AttachVolumeTestJSON-636759182-project-member] Lock "f9c98d28-41f9-498f-8c1f-43517999775a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:10:22 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:10:22 user nova-compute[75337]: DEBUG nova.compute.manager [req-c7a63698-d0db-4a57-9a2d-c468ca6c3524 req-0420a31e-0cec-4f95-aaf8-35d2506774b5 service nova] [instance: f9c98d28-41f9-498f-8c1f-43517999775a] Received event network-vif-deleted-65003741-14af-48d8-9ca6-0e075aab5008 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:10:22 user nova-compute[75337]: DEBUG nova.compute.manager [req-eaa43b5b-4380-4135-ad49-be08e9d38cf1 req-20596906-9329-4bd4-8b9c-e55368cff772 service nova] [instance: f9c98d28-41f9-498f-8c1f-43517999775a] Received event network-vif-plugged-65003741-14af-48d8-9ca6-0e075aab5008 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:10:22 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-eaa43b5b-4380-4135-ad49-be08e9d38cf1 req-20596906-9329-4bd4-8b9c-e55368cff772 service nova] Acquiring lock "f9c98d28-41f9-498f-8c1f-43517999775a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:10:22 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-eaa43b5b-4380-4135-ad49-be08e9d38cf1 req-20596906-9329-4bd4-8b9c-e55368cff772 service nova] Lock "f9c98d28-41f9-498f-8c1f-43517999775a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:10:22 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-eaa43b5b-4380-4135-ad49-be08e9d38cf1 req-20596906-9329-4bd4-8b9c-e55368cff772 service nova] Lock "f9c98d28-41f9-498f-8c1f-43517999775a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:10:22 user nova-compute[75337]: DEBUG nova.compute.manager [req-eaa43b5b-4380-4135-ad49-be08e9d38cf1 req-20596906-9329-4bd4-8b9c-e55368cff772 service nova] [instance: f9c98d28-41f9-498f-8c1f-43517999775a] No waiting events found dispatching network-vif-plugged-65003741-14af-48d8-9ca6-0e075aab5008 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 16:10:22 user nova-compute[75337]: WARNING nova.compute.manager [req-eaa43b5b-4380-4135-ad49-be08e9d38cf1 req-20596906-9329-4bd4-8b9c-e55368cff772 service nova] [instance: f9c98d28-41f9-498f-8c1f-43517999775a] Received unexpected event network-vif-plugged-65003741-14af-48d8-9ca6-0e075aab5008 for instance with vm_state deleted and task_state None.
Nov 06 16:10:23 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:10:24 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-178d570d-a701-4eb3-b6c9-9ad734dd3847 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 88330c21-69e0-4d82-ac4d-b9e5e849f487 is timed out.
Nov 06 16:10:24 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-178d570d-a701-4eb3-b6c9-9ad734dd3847 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Successfully detached device vdb from instance 88330c21-69e0-4d82-ac4d-b9e5e849f487 from the live domain config.
Nov 06 16:10:24 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-178d570d-a701-4eb3-b6c9-9ad734dd3847 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] [instance: 88330c21-69e0-4d82-ac4d-b9e5e849f487] calling os-brick to detach iSCSI Volume {{(pid=75337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 16:10:24 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-178d570d-a701-4eb3-b6c9-9ad734dd3847 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2abc33d0c0>, {'target_iqn': 'iqn.2010-10.org.openstack:fd402fa7-6910-4e0a-8539-e467e32c337d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jzHhdsIv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 16:10:24 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-178d570d-a701-4eb3-b6c9-9ad734dd3847 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 16:10:24 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-178d570d-a701-4eb3-b6c9-9ad734dd3847 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 16:10:24 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-178d570d-a701-4eb3-b6c9-9ad734dd3847 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 16:10:24 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:10:24 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:10:24 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[45389112-8161-4aa2-9a45-abc3a50fe7d6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:06b3b613-3c1e-4420-a500-1ec3988c0940\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fd402fa7-6910-4e0a-8539-e467e32c337d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:10:24 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-178d570d-a701-4eb3-b6c9-9ad734dd3847 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 16:10:24 user nova-compute[75337]: No targets found.
Nov 06 16:10:24 user nova-compute[75337]: iSNS:
Nov 06 16:10:24 user nova-compute[75337]: No targets found.
Nov 06 16:10:24 user nova-compute[75337]: STATIC:
Nov 06 16:10:24 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:06b3b613-3c1e-4420-a500-1ec3988c0940
Nov 06 16:10:24 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 16:10:24 user nova-compute[75337]:                 Iface Name: default
Nov 06 16:10:24 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:fd402fa7-6910-4e0a-8539-e467e32c337d
Nov 06 16:10:24 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 16:10:24 user nova-compute[75337]:                 Iface Name: default
Nov 06 16:10:24 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139
Nov 06 16:10:24 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 16:10:24 user nova-compute[75337]:                 Iface Name: default
Nov 06 16:10:24 user nova-compute[75337]: FIRMWARE:
Nov 06 16:10:24 user nova-compute[75337]: No targets found.
Nov 06 16:10:24 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 16:10:24 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-178d570d-a701-4eb3-b6c9-9ad734dd3847 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 16:10:24 user nova-compute[75337]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 16:10:24 user nova-compute[75337]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75337) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 16:10:24 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-178d570d-a701-4eb3-b6c9-9ad734dd3847 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fd402fa7-6910-4e0a-8539-e467e32c337d', 0)] {{(pid=75337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 16:10:24 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:10:24 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:10:24 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[6690cb20-1d8b-4fa1-8cb9-ae14a60128ab]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:06b3b613-3c1e-4420-a500-1ec3988c0940\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fd402fa7-6910-4e0a-8539-e467e32c337d\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:10:24 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:10:24 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:10:24 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[56822c60-93a4-4f98-9eb9-78e598db0a76]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd402fa7-6910-4e0a-8539-e467e32c337d (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06b3b613-3c1e-4420-a500-1ec3988c0940 (non-flash)\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:10:24 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-178d570d-a701-4eb3-b6c9-9ad734dd3847 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139 (non-flash)
Nov 06 16:10:24 user nova-compute[75337]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd402fa7-6910-4e0a-8539-e467e32c337d (non-flash)
Nov 06 16:10:24 user nova-compute[75337]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06b3b613-3c1e-4420-a500-1ec3988c0940 (non-flash)
Nov 06 16:10:24 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 16:10:24 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-178d570d-a701-4eb3-b6c9-9ad734dd3847 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139 (non-flash)
Nov 06 16:10:24 user nova-compute[75337]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd402fa7-6910-4e0a-8539-e467e32c337d (non-flash)
Nov 06 16:10:24 user nova-compute[75337]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06b3b613-3c1e-4420-a500-1ec3988c0940 (non-flash)
Nov 06 16:10:24 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 16:10:24 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-178d570d-a701-4eb3-b6c9-9ad734dd3847 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2ac499f490>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fd402fa7-6910-4e0a-8539-e467e32c337d'): ({'sde'}, set())}) {{(pid=75337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 16:10:24 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-178d570d-a701-4eb3-b6c9-9ad734dd3847 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Removing single pathed devices sde {{(pid=75337) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 16:10:24 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:10:24 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:10:24 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9c0ef2a-2b65-497b-a143-b5917c15bef3]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:10:24 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:10:24 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:10:25 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:10:25 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a973796-9401-4ed9-b63e-6459af2ceb4b]: (4, ('ok\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:10:25 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-178d570d-a701-4eb3-b6c9-9ad734dd3847 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Flushing IO for device /dev/sde {{(pid=75337) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 16:10:25 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:10:25 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:10:25 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[000f7dda-1e21-4fbb-baa0-73c68c5954a7]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:10:25 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-178d570d-a701-4eb3-b6c9-9ad734dd3847 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75337) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 16:10:25 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:10:25 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.037s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:10:25 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[56363411-da5d-4fec-a5a4-6a3b5f404ec5]: (4, ('1', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:10:25 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-178d570d-a701-4eb3-b6c9-9ad734dd3847 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 16:10:25 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-178d570d-a701-4eb3-b6c9-9ad734dd3847 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] SCSI volumes sde have been removed. {{(pid=75337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 16:10:25 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-178d570d-a701-4eb3-b6c9-9ad734dd3847 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fd402fa7-6910-4e0a-8539-e467e32c337d')] {{(pid=75337) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 16:10:25 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd402fa7-6910-4e0a-8539-e467e32c337d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:10:25 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd402fa7-6910-4e0a-8539-e467e32c337d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:10:25 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a1eca05-50f1-4035-8d14-b8340ca3ffc6]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:10:25 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-178d570d-a701-4eb3-b6c9-9ad734dd3847 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:10:25 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd402fa7-6910-4e0a-8539-e467e32c337d -p 172.16.0.220:3260 --logout {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:10:25 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd402fa7-6910-4e0a-8539-e467e32c337d -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:10:25 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[f03ff330-b3bb-4a26-8b50-a339d2c0d00d]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:fd402fa7-6910-4e0a-8539-e467e32c337d, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:fd402fa7-6910-4e0a-8539-e467e32c337d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:10:25 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-178d570d-a701-4eb3-b6c9-9ad734dd3847 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:fd402fa7-6910-4e0a-8539-e467e32c337d, portal: 172.16.0.220,3260]
Nov 06 16:10:25 user nova-compute[75337]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:fd402fa7-6910-4e0a-8539-e467e32c337d, portal: 172.16.0.220,3260] successful.
Nov 06 16:10:25 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:10:25 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd402fa7-6910-4e0a-8539-e467e32c337d -p 172.16.0.220:3260 --op delete {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:10:25 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd402fa7-6910-4e0a-8539-e467e32c337d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:10:25 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[9199ae2c-4a2a-4903-922f-1dbf51d1531d]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:10:25 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-178d570d-a701-4eb3-b6c9-9ad734dd3847 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:10:25 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-178d570d-a701-4eb3-b6c9-9ad734dd3847 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.296s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 16:10:25 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-178d570d-a701-4eb3-b6c9-9ad734dd3847 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] <== disconnect_volume: return (297ms) None {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 16:10:25 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-178d570d-a701-4eb3-b6c9-9ad734dd3847 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] [instance: 88330c21-69e0-4d82-ac4d-b9e5e849f487] Disconnected iSCSI Volume {{(pid=75337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 16:10:25 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:10:26 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:10:26 user nova-compute[75337]: DEBUG nova.objects.instance [None req-178d570d-a701-4eb3-b6c9-9ad734dd3847 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Lazy-loading 'flavor' on Instance uuid 88330c21-69e0-4d82-ac4d-b9e5e849f487 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 16:10:26 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-178d570d-a701-4eb3-b6c9-9ad734dd3847 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Lock "88330c21-69e0-4d82-ac4d-b9e5e849f487" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.778s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:10:29 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:10:29 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Starting heal instance info cache {{(pid=75337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 16:10:29 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Rebuilding the list of instances to heal {{(pid=75337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 06 16:10:29 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "refresh_cache-6110b34a-6fd3-45fc-911d-4e5d3c7f2d78" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 16:10:29 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquired lock "refresh_cache-6110b34a-6fd3-45fc-911d-4e5d3c7f2d78" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 16:10:29 user nova-compute[75337]: DEBUG nova.network.neutron [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] [instance: 6110b34a-6fd3-45fc-911d-4e5d3c7f2d78] Forcefully refreshing network info cache for instance {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 16:10:29 user nova-compute[75337]: DEBUG nova.objects.instance [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lazy-loading 'info_cache' on Instance uuid 6110b34a-6fd3-45fc-911d-4e5d3c7f2d78 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 16:10:30 user nova-compute[75337]: DEBUG nova.network.neutron [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] [instance: 6110b34a-6fd3-45fc-911d-4e5d3c7f2d78] Updating instance_info_cache with network_info: [{"id": "fa3c6657-452e-4a95-b9c8-c59002be4e31", "address": "fa:16:3e:18:69:52", "network": {"id": "7f234ecf-bfa6-4316-9dce-c15050ba7914", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1378707892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "243647103fd44f629e0f40be0b56407e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa3c6657-45", "ovs_interfaceid": "fa3c6657-452e-4a95-b9c8-c59002be4e31", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 16:10:30 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Releasing lock "refresh_cache-6110b34a-6fd3-45fc-911d-4e5d3c7f2d78" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 16:10:30 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] [instance: 6110b34a-6fd3-45fc-911d-4e5d3c7f2d78] Updated the network info_cache for instance {{(pid=75337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 16:10:30 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager.update_available_resource {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:10:30 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:10:30 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:10:30 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:10:30 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Auditing locally available compute resources for user (node: user) {{(pid=75337) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 16:10:30 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 16:10:30 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 16:10:30 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6110b34a-6fd3-45fc-911d-4e5d3c7f2d78/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:10:30 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6110b34a-6fd3-45fc-911d-4e5d3c7f2d78/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:10:30 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6110b34a-6fd3-45fc-911d-4e5d3c7f2d78/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:10:30 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6110b34a-6fd3-45fc-911d-4e5d3c7f2d78/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:10:30 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88330c21-69e0-4d82-ac4d-b9e5e849f487/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:10:30 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88330c21-69e0-4d82-ac4d-b9e5e849f487/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:10:30 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88330c21-69e0-4d82-ac4d-b9e5e849f487/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:10:30 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88330c21-69e0-4d82-ac4d-b9e5e849f487/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:10:30 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-ad1ca3b1-8c21-42d5-8130-dfa3d552a63a tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] Acquiring lock "3d8dc993-9fca-43b9-9058-801d7c497b1f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:10:31 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-ad1ca3b1-8c21-42d5-8130-dfa3d552a63a tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] Lock "3d8dc993-9fca-43b9-9058-801d7c497b1f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:10:31 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:10:31 user nova-compute[75337]: DEBUG nova.compute.manager [None req-ad1ca3b1-8c21-42d5-8130-dfa3d552a63a tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] [instance: 3d8dc993-9fca-43b9-9058-801d7c497b1f] Starting instance... {{(pid=75337) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 16:10:31 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 16:10:31 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 16:10:31 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Hypervisor/Node resource view: name=user free_ram=8278MB free_disk=25.034278869628906GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75337) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 16:10:31 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:10:31 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:10:31 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-ad1ca3b1-8c21-42d5-8130-dfa3d552a63a tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:10:31 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 6110b34a-6fd3-45fc-911d-4e5d3c7f2d78 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 16:10:31 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 88330c21-69e0-4d82-ac4d-b9e5e849f487 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 16:10:31 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance d6eaef86-b841-4142-9549-31954fb34fa2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 16:10:31 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 15922f4f-f921-4245-8d3d-98ed47de946b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 16:10:31 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 3d8dc993-9fca-43b9-9058-801d7c497b1f has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 06 16:10:31 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 16:10:31 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 16:10:31 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 16:10:31 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 16:10:31 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Compute_service record updated for user:user {{(pid=75337) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 16:10:31 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.325s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:10:31 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-ad1ca3b1-8c21-42d5-8130-dfa3d552a63a tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.249s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:10:31 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-ad1ca3b1-8c21-42d5-8130-dfa3d552a63a tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75337) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 16:10:31 user nova-compute[75337]: INFO nova.compute.claims [None req-ad1ca3b1-8c21-42d5-8130-dfa3d552a63a tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] [instance: 3d8dc993-9fca-43b9-9058-801d7c497b1f] Claim successful on node user
Nov 06 16:10:31 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-ad1ca3b1-8c21-42d5-8130-dfa3d552a63a tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 16:10:31 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-ad1ca3b1-8c21-42d5-8130-dfa3d552a63a tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 16:10:32 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-ad1ca3b1-8c21-42d5-8130-dfa3d552a63a tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.336s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:10:32 user nova-compute[75337]: DEBUG nova.compute.manager [None req-ad1ca3b1-8c21-42d5-8130-dfa3d552a63a tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] [instance: 3d8dc993-9fca-43b9-9058-801d7c497b1f] Start building networks asynchronously for instance. {{(pid=75337) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 16:10:32 user nova-compute[75337]: DEBUG nova.compute.manager [None req-ad1ca3b1-8c21-42d5-8130-dfa3d552a63a tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] [instance: 3d8dc993-9fca-43b9-9058-801d7c497b1f] Allocating IP information in the background. {{(pid=75337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 16:10:32 user nova-compute[75337]: DEBUG nova.network.neutron [None req-ad1ca3b1-8c21-42d5-8130-dfa3d552a63a tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] [instance: 3d8dc993-9fca-43b9-9058-801d7c497b1f] allocate_for_instance() {{(pid=75337) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 16:10:32 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-ad1ca3b1-8c21-42d5-8130-dfa3d552a63a tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] [instance: 3d8dc993-9fca-43b9-9058-801d7c497b1f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 16:10:32 user nova-compute[75337]: DEBUG nova.compute.manager [None req-ad1ca3b1-8c21-42d5-8130-dfa3d552a63a tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] [instance: 3d8dc993-9fca-43b9-9058-801d7c497b1f] Start building block device mappings for instance. {{(pid=75337) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 16:10:32 user nova-compute[75337]: DEBUG nova.policy [None req-ad1ca3b1-8c21-42d5-8130-dfa3d552a63a tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4e0147898e9b4af9aaaa3379f431303e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '888a739f27694bd5a56badca064a56b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75337) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 16:10:32 user nova-compute[75337]: DEBUG nova.compute.manager [None req-ad1ca3b1-8c21-42d5-8130-dfa3d552a63a tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] [instance: 3d8dc993-9fca-43b9-9058-801d7c497b1f] Start spawning the instance on the hypervisor. {{(pid=75337) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 16:10:32 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-ad1ca3b1-8c21-42d5-8130-dfa3d552a63a tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] [instance: 3d8dc993-9fca-43b9-9058-801d7c497b1f] Creating instance directory {{(pid=75337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 16:10:32 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-ad1ca3b1-8c21-42d5-8130-dfa3d552a63a tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] [instance: 3d8dc993-9fca-43b9-9058-801d7c497b1f] Creating image(s)
Nov 06 16:10:32 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-ad1ca3b1-8c21-42d5-8130-dfa3d552a63a tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] Acquiring lock "/opt/stack/data/nova/instances/3d8dc993-9fca-43b9-9058-801d7c497b1f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:10:32 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-ad1ca3b1-8c21-42d5-8130-dfa3d552a63a tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] Lock "/opt/stack/data/nova/instances/3d8dc993-9fca-43b9-9058-801d7c497b1f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:10:32 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-ad1ca3b1-8c21-42d5-8130-dfa3d552a63a tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] Lock "/opt/stack/data/nova/instances/3d8dc993-9fca-43b9-9058-801d7c497b1f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:10:32 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-ad1ca3b1-8c21-42d5-8130-dfa3d552a63a tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:10:32 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-ad1ca3b1-8c21-42d5-8130-dfa3d552a63a tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json" returned: 0 in 0.174s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:10:32 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-ad1ca3b1-8c21-42d5-8130-dfa3d552a63a tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] Acquiring lock "06ba3c914798499e686c5ac75886932347225275" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:10:32 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-ad1ca3b1-8c21-42d5-8130-dfa3d552a63a tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] Lock "06ba3c914798499e686c5ac75886932347225275" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:10:32 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-ad1ca3b1-8c21-42d5-8130-dfa3d552a63a tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:10:32 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-ad1ca3b1-8c21-42d5-8130-dfa3d552a63a tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json" returned: 0 in 0.173s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:10:32 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-ad1ca3b1-8c21-42d5-8130-dfa3d552a63a tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275,backing_fmt=raw /opt/stack/data/nova/instances/3d8dc993-9fca-43b9-9058-801d7c497b1f/disk 1073741824 {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:10:32 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-ad1ca3b1-8c21-42d5-8130-dfa3d552a63a tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275,backing_fmt=raw /opt/stack/data/nova/instances/3d8dc993-9fca-43b9-9058-801d7c497b1f/disk 1073741824" returned: 0 in 0.061s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:10:32 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-ad1ca3b1-8c21-42d5-8130-dfa3d552a63a tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] Lock "06ba3c914798499e686c5ac75886932347225275" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:10:32 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-ad1ca3b1-8c21-42d5-8130-dfa3d552a63a tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:10:32 user nova-compute[75337]: DEBUG nova.network.neutron [None req-ad1ca3b1-8c21-42d5-8130-dfa3d552a63a tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] [instance: 3d8dc993-9fca-43b9-9058-801d7c497b1f] Successfully created port: 6931c93f-1b41-44f7-9acd-4bc3b834080f {{(pid=75337) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 16:10:32 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:10:32 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-ad1ca3b1-8c21-42d5-8130-dfa3d552a63a tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json" returned: 0 in 0.187s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:10:32 user nova-compute[75337]: DEBUG nova.virt.disk.api [None req-ad1ca3b1-8c21-42d5-8130-dfa3d552a63a tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3d8dc993-9fca-43b9-9058-801d7c497b1f/disk. size=1073741824 {{(pid=75337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 16:10:32 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-ad1ca3b1-8c21-42d5-8130-dfa3d552a63a tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d8dc993-9fca-43b9-9058-801d7c497b1f/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:10:33 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-ad1ca3b1-8c21-42d5-8130-dfa3d552a63a tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d8dc993-9fca-43b9-9058-801d7c497b1f/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:10:33 user nova-compute[75337]: DEBUG nova.virt.disk.api [None req-ad1ca3b1-8c21-42d5-8130-dfa3d552a63a tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] Cannot resize image /opt/stack/data/nova/instances/3d8dc993-9fca-43b9-9058-801d7c497b1f/disk to a smaller size. {{(pid=75337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 06 16:10:33 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-ad1ca3b1-8c21-42d5-8130-dfa3d552a63a tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] [instance: 3d8dc993-9fca-43b9-9058-801d7c497b1f] Created local disks {{(pid=75337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 16:10:33 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-ad1ca3b1-8c21-42d5-8130-dfa3d552a63a tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] [instance: 3d8dc993-9fca-43b9-9058-801d7c497b1f] Ensure instance console log exists: /opt/stack/data/nova/instances/3d8dc993-9fca-43b9-9058-801d7c497b1f/console.log {{(pid=75337) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 16:10:33 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-ad1ca3b1-8c21-42d5-8130-dfa3d552a63a tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:10:33 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-ad1ca3b1-8c21-42d5-8130-dfa3d552a63a tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:10:33 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-ad1ca3b1-8c21-42d5-8130-dfa3d552a63a tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:10:33 user nova-compute[75337]: DEBUG nova.network.neutron [None req-ad1ca3b1-8c21-42d5-8130-dfa3d552a63a tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] [instance: 3d8dc993-9fca-43b9-9058-801d7c497b1f] Successfully updated port: 6931c93f-1b41-44f7-9acd-4bc3b834080f {{(pid=75337) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 16:10:33 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-ad1ca3b1-8c21-42d5-8130-dfa3d552a63a tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] Acquiring lock "refresh_cache-3d8dc993-9fca-43b9-9058-801d7c497b1f" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 16:10:33 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-ad1ca3b1-8c21-42d5-8130-dfa3d552a63a tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] Acquired lock "refresh_cache-3d8dc993-9fca-43b9-9058-801d7c497b1f" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 16:10:33 user nova-compute[75337]: DEBUG nova.network.neutron [None req-ad1ca3b1-8c21-42d5-8130-dfa3d552a63a tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] [instance: 3d8dc993-9fca-43b9-9058-801d7c497b1f] Building network info cache for instance {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 16:10:33 user nova-compute[75337]: DEBUG nova.compute.manager [req-8f38aa6e-f1e1-4533-b555-e0476793d324 req-ae978742-5b93-43ff-acd9-73ab79578220 service nova] [instance: 3d8dc993-9fca-43b9-9058-801d7c497b1f] Received event network-changed-6931c93f-1b41-44f7-9acd-4bc3b834080f {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:10:33 user nova-compute[75337]: DEBUG nova.compute.manager [req-8f38aa6e-f1e1-4533-b555-e0476793d324 req-ae978742-5b93-43ff-acd9-73ab79578220 service nova] [instance: 3d8dc993-9fca-43b9-9058-801d7c497b1f] Refreshing instance network info cache due to event network-changed-6931c93f-1b41-44f7-9acd-4bc3b834080f. {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 16:10:33 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-8f38aa6e-f1e1-4533-b555-e0476793d324 req-ae978742-5b93-43ff-acd9-73ab79578220 service nova] Acquiring lock "refresh_cache-3d8dc993-9fca-43b9-9058-801d7c497b1f" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 16:10:33 user nova-compute[75337]: DEBUG nova.network.neutron [None req-ad1ca3b1-8c21-42d5-8130-dfa3d552a63a tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] [instance: 3d8dc993-9fca-43b9-9058-801d7c497b1f] Instance cache missing network info. {{(pid=75337) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 16:10:33 user nova-compute[75337]: DEBUG nova.network.neutron [None req-ad1ca3b1-8c21-42d5-8130-dfa3d552a63a tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] [instance: 3d8dc993-9fca-43b9-9058-801d7c497b1f] Updating instance_info_cache with network_info: [{"id": "6931c93f-1b41-44f7-9acd-4bc3b834080f", "address": "fa:16:3e:c3:64:2a", "network": {"id": "6b7d7f72-e0a2-49a1-a1d8-927c62316dd2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-716305394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "888a739f27694bd5a56badca064a56b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6931c93f-1b", "ovs_interfaceid": "6931c93f-1b41-44f7-9acd-4bc3b834080f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 16:10:33 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-ad1ca3b1-8c21-42d5-8130-dfa3d552a63a tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] Releasing lock "refresh_cache-3d8dc993-9fca-43b9-9058-801d7c497b1f" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 16:10:33 user nova-compute[75337]: DEBUG nova.compute.manager [None req-ad1ca3b1-8c21-42d5-8130-dfa3d552a63a tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] [instance: 3d8dc993-9fca-43b9-9058-801d7c497b1f] Instance network_info: |[{"id": "6931c93f-1b41-44f7-9acd-4bc3b834080f", "address": "fa:16:3e:c3:64:2a", "network": {"id": "6b7d7f72-e0a2-49a1-a1d8-927c62316dd2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-716305394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "888a739f27694bd5a56badca064a56b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6931c93f-1b", "ovs_interfaceid": "6931c93f-1b41-44f7-9acd-4bc3b834080f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 16:10:33 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-8f38aa6e-f1e1-4533-b555-e0476793d324 req-ae978742-5b93-43ff-acd9-73ab79578220 service nova] Acquired lock "refresh_cache-3d8dc993-9fca-43b9-9058-801d7c497b1f" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 16:10:33 user nova-compute[75337]: DEBUG nova.network.neutron [req-8f38aa6e-f1e1-4533-b555-e0476793d324 req-ae978742-5b93-43ff-acd9-73ab79578220 service nova] [instance: 3d8dc993-9fca-43b9-9058-801d7c497b1f] Refreshing network info cache for port 6931c93f-1b41-44f7-9acd-4bc3b834080f {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 16:10:33 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-ad1ca3b1-8c21-42d5-8130-dfa3d552a63a tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] [instance: 3d8dc993-9fca-43b9-9058-801d7c497b1f] Start _get_guest_xml network_info=[{"id": "6931c93f-1b41-44f7-9acd-4bc3b834080f", "address": "fa:16:3e:c3:64:2a", "network": {"id": "6b7d7f72-e0a2-49a1-a1d8-927c62316dd2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-716305394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "888a739f27694bd5a56badca064a56b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6931c93f-1b", "ovs_interfaceid": "6931c93f-1b41-44f7-9acd-4bc3b834080f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T15:34:14Z,direct_url=<?>,disk_format='qcow2',id=16b903ae-a40f-41a7-985b-4804cce92c62,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6549a15819f1469bbd5eeae8190e3d44',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T15:34:15Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'guest_format': None, 'size': 0, 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '16b903ae-a40f-41a7-985b-4804cce92c62'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 16:10:33 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-ad1ca3b1-8c21-42d5-8130-dfa3d552a63a tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 16:10:33 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-ad1ca3b1-8c21-42d5-8130-dfa3d552a63a tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 16:10:33 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-ad1ca3b1-8c21-42d5-8130-dfa3d552a63a tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 16:10:33 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-ad1ca3b1-8c21-42d5-8130-dfa3d552a63a tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] CPU controller missing on host. {{(pid=75337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 16:10:33 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-ad1ca3b1-8c21-42d5-8130-dfa3d552a63a tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 16:10:33 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-ad1ca3b1-8c21-42d5-8130-dfa3d552a63a tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] CPU controller found on host. {{(pid=75337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 16:10:33 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-ad1ca3b1-8c21-42d5-8130-dfa3d552a63a tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75337) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 16:10:33 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-ad1ca3b1-8c21-42d5-8130-dfa3d552a63a tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T15:34:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T15:34:14Z,direct_url=<?>,disk_format='qcow2',id=16b903ae-a40f-41a7-985b-4804cce92c62,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6549a15819f1469bbd5eeae8190e3d44',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T15:34:15Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 16:10:33 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-ad1ca3b1-8c21-42d5-8130-dfa3d552a63a tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] Flavor limits 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 16:10:33 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-ad1ca3b1-8c21-42d5-8130-dfa3d552a63a tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] Image limits 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 16:10:33 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-ad1ca3b1-8c21-42d5-8130-dfa3d552a63a tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] Flavor pref 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 16:10:33 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-ad1ca3b1-8c21-42d5-8130-dfa3d552a63a tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] Image pref 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 16:10:33 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-ad1ca3b1-8c21-42d5-8130-dfa3d552a63a tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 16:10:33 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-ad1ca3b1-8c21-42d5-8130-dfa3d552a63a tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 16:10:33 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-ad1ca3b1-8c21-42d5-8130-dfa3d552a63a tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 16:10:33 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-ad1ca3b1-8c21-42d5-8130-dfa3d552a63a tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] Got 1 possible topologies {{(pid=75337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 16:10:33 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-ad1ca3b1-8c21-42d5-8130-dfa3d552a63a tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 16:10:33 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-ad1ca3b1-8c21-42d5-8130-dfa3d552a63a tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 16:10:33 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-ad1ca3b1-8c21-42d5-8130-dfa3d552a63a tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T16:10:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1583587787',display_name='tempest-VolumesActionsTest-instance-1583587787',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1583587787',id=48,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='888a739f27694bd5a56badca064a56b4',ramdisk_id='',reservation_id='r-lmncmkaj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1546215062',owner_user_name='tempest-VolumesActionsTest-1546215062-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T16:10:32Z,user_data=None,user_id='4e0147898e9b4af9aaaa3379f431303e',uuid=3d8dc993-9fca-43b9-9058-801d7c497b1f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6931c93f-1b41-44f7-9acd-4bc3b834080f", "address": "fa:16:3e:c3:64:2a", "network": {"id": "6b7d7f72-e0a2-49a1-a1d8-927c62316dd2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-716305394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "888a739f27694bd5a56badca064a56b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6931c93f-1b", "ovs_interfaceid": "6931c93f-1b41-44f7-9acd-4bc3b834080f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75337) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 16:10:33 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-ad1ca3b1-8c21-42d5-8130-dfa3d552a63a tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] Converting VIF {"id": "6931c93f-1b41-44f7-9acd-4bc3b834080f", "address": "fa:16:3e:c3:64:2a", "network": {"id": "6b7d7f72-e0a2-49a1-a1d8-927c62316dd2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-716305394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "888a739f27694bd5a56badca064a56b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6931c93f-1b", "ovs_interfaceid": "6931c93f-1b41-44f7-9acd-4bc3b834080f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 16:10:33 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-ad1ca3b1-8c21-42d5-8130-dfa3d552a63a tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:64:2a,bridge_name='br-int',has_traffic_filtering=True,id=6931c93f-1b41-44f7-9acd-4bc3b834080f,network=Network(6b7d7f72-e0a2-49a1-a1d8-927c62316dd2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6931c93f-1b') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 16:10:33 user nova-compute[75337]: DEBUG nova.objects.instance [None req-ad1ca3b1-8c21-42d5-8130-dfa3d552a63a tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] Lazy-loading 'pci_devices' on Instance uuid 3d8dc993-9fca-43b9-9058-801d7c497b1f {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 16:10:33 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-ad1ca3b1-8c21-42d5-8130-dfa3d552a63a tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] [instance: 3d8dc993-9fca-43b9-9058-801d7c497b1f] End _get_guest_xml xml=<domain type="kvm">
Nov 06 16:10:33 user nova-compute[75337]:   <uuid>3d8dc993-9fca-43b9-9058-801d7c497b1f</uuid>
Nov 06 16:10:33 user nova-compute[75337]:   <name>instance-00000030</name>
Nov 06 16:10:33 user nova-compute[75337]:   <memory>524288</memory>
Nov 06 16:10:33 user nova-compute[75337]:   <vcpu>1</vcpu>
Nov 06 16:10:33 user nova-compute[75337]:   <metadata>
Nov 06 16:10:33 user nova-compute[75337]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 16:10:33 user nova-compute[75337]:       <nova:package version="0.0.0"/>
Nov 06 16:10:33 user nova-compute[75337]:       <nova:name>tempest-VolumesActionsTest-instance-1583587787</nova:name>
Nov 06 16:10:33 user nova-compute[75337]:       <nova:creationTime>2023-11-06 16:10:33</nova:creationTime>
Nov 06 16:10:33 user nova-compute[75337]:       <nova:flavor name="m1.tiny">
Nov 06 16:10:33 user nova-compute[75337]:         <nova:memory>512</nova:memory>
Nov 06 16:10:33 user nova-compute[75337]:         <nova:disk>1</nova:disk>
Nov 06 16:10:33 user nova-compute[75337]:         <nova:swap>0</nova:swap>
Nov 06 16:10:33 user nova-compute[75337]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 16:10:33 user nova-compute[75337]:         <nova:vcpus>1</nova:vcpus>
Nov 06 16:10:33 user nova-compute[75337]:       </nova:flavor>
Nov 06 16:10:33 user nova-compute[75337]:       <nova:owner>
Nov 06 16:10:33 user nova-compute[75337]:         <nova:user uuid="4e0147898e9b4af9aaaa3379f431303e">tempest-VolumesActionsTest-1546215062-project-member</nova:user>
Nov 06 16:10:33 user nova-compute[75337]:         <nova:project uuid="888a739f27694bd5a56badca064a56b4">tempest-VolumesActionsTest-1546215062</nova:project>
Nov 06 16:10:33 user nova-compute[75337]:       </nova:owner>
Nov 06 16:10:33 user nova-compute[75337]:       <nova:root type="image" uuid="16b903ae-a40f-41a7-985b-4804cce92c62"/>
Nov 06 16:10:33 user nova-compute[75337]:       <nova:ports>
Nov 06 16:10:33 user nova-compute[75337]:         <nova:port uuid="6931c93f-1b41-44f7-9acd-4bc3b834080f">
Nov 06 16:10:33 user nova-compute[75337]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 06 16:10:33 user nova-compute[75337]:         </nova:port>
Nov 06 16:10:33 user nova-compute[75337]:       </nova:ports>
Nov 06 16:10:33 user nova-compute[75337]:     </nova:instance>
Nov 06 16:10:33 user nova-compute[75337]:   </metadata>
Nov 06 16:10:33 user nova-compute[75337]:   <sysinfo type="smbios">
Nov 06 16:10:33 user nova-compute[75337]:     <system>
Nov 06 16:10:33 user nova-compute[75337]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 16:10:33 user nova-compute[75337]:       <entry name="product">OpenStack Nova</entry>
Nov 06 16:10:33 user nova-compute[75337]:       <entry name="version">0.0.0</entry>
Nov 06 16:10:33 user nova-compute[75337]:       <entry name="serial">3d8dc993-9fca-43b9-9058-801d7c497b1f</entry>
Nov 06 16:10:33 user nova-compute[75337]:       <entry name="uuid">3d8dc993-9fca-43b9-9058-801d7c497b1f</entry>
Nov 06 16:10:33 user nova-compute[75337]:       <entry name="family">Virtual Machine</entry>
Nov 06 16:10:33 user nova-compute[75337]:     </system>
Nov 06 16:10:33 user nova-compute[75337]:   </sysinfo>
Nov 06 16:10:33 user nova-compute[75337]:   <os>
Nov 06 16:10:33 user nova-compute[75337]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 16:10:33 user nova-compute[75337]:     <boot dev="hd"/>
Nov 06 16:10:33 user nova-compute[75337]:     <smbios mode="sysinfo"/>
Nov 06 16:10:33 user nova-compute[75337]:   </os>
Nov 06 16:10:33 user nova-compute[75337]:   <features>
Nov 06 16:10:33 user nova-compute[75337]:     <acpi/>
Nov 06 16:10:33 user nova-compute[75337]:     <apic/>
Nov 06 16:10:33 user nova-compute[75337]:     <vmcoreinfo/>
Nov 06 16:10:33 user nova-compute[75337]:   </features>
Nov 06 16:10:33 user nova-compute[75337]:   <clock offset="utc">
Nov 06 16:10:33 user nova-compute[75337]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 16:10:33 user nova-compute[75337]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 16:10:33 user nova-compute[75337]:     <timer name="hpet" present="no"/>
Nov 06 16:10:33 user nova-compute[75337]:   </clock>
Nov 06 16:10:33 user nova-compute[75337]:   <cpu mode="custom" match="exact">
Nov 06 16:10:33 user nova-compute[75337]:     <model>Nehalem</model>
Nov 06 16:10:33 user nova-compute[75337]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 16:10:33 user nova-compute[75337]:   </cpu>
Nov 06 16:10:33 user nova-compute[75337]:   <devices>
Nov 06 16:10:33 user nova-compute[75337]:     <disk type="file" device="disk">
Nov 06 16:10:33 user nova-compute[75337]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 16:10:33 user nova-compute[75337]:       <source file="/opt/stack/data/nova/instances/3d8dc993-9fca-43b9-9058-801d7c497b1f/disk"/>
Nov 06 16:10:33 user nova-compute[75337]:       <target dev="vda" bus="virtio"/>
Nov 06 16:10:33 user nova-compute[75337]:     </disk>
Nov 06 16:10:33 user nova-compute[75337]:     <interface type="ethernet">
Nov 06 16:10:33 user nova-compute[75337]:       <mac address="fa:16:3e:c3:64:2a"/>
Nov 06 16:10:33 user nova-compute[75337]:       <model type="virtio"/>
Nov 06 16:10:33 user nova-compute[75337]:       <mtu size="1442"/>
Nov 06 16:10:33 user nova-compute[75337]:       <target dev="tap6931c93f-1b"/>
Nov 06 16:10:33 user nova-compute[75337]:     </interface>
Nov 06 16:10:33 user nova-compute[75337]:     <serial type="pty">
Nov 06 16:10:33 user nova-compute[75337]:       <log file="/opt/stack/data/nova/instances/3d8dc993-9fca-43b9-9058-801d7c497b1f/console.log" append="off"/>
Nov 06 16:10:33 user nova-compute[75337]:     </serial>
Nov 06 16:10:33 user nova-compute[75337]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 16:10:33 user nova-compute[75337]:     <video>
Nov 06 16:10:33 user nova-compute[75337]:       <model type="virtio"/>
Nov 06 16:10:33 user nova-compute[75337]:     </video>
Nov 06 16:10:33 user nova-compute[75337]:     <rng model="virtio">
Nov 06 16:10:33 user nova-compute[75337]:       <backend model="random">/dev/urandom</backend>
Nov 06 16:10:33 user nova-compute[75337]:     </rng>
Nov 06 16:10:33 user nova-compute[75337]:     <controller type="usb" index="0" model="none"/>
Nov 06 16:10:33 user nova-compute[75337]:     <memballoon model="virtio">
Nov 06 16:10:33 user nova-compute[75337]:       <stats period="10"/>
Nov 06 16:10:33 user nova-compute[75337]:     </memballoon>
Nov 06 16:10:33 user nova-compute[75337]:   </devices>
Nov 06 16:10:33 user nova-compute[75337]: </domain>
Nov 06 16:10:33 user nova-compute[75337]:  {{(pid=75337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 16:10:33 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-ad1ca3b1-8c21-42d5-8130-dfa3d552a63a tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T16:10:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1583587787',display_name='tempest-VolumesActionsTest-instance-1583587787',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1583587787',id=48,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='888a739f27694bd5a56badca064a56b4',ramdisk_id='',reservation_id='r-lmncmkaj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1546215062',owner_user_name='tempest-VolumesActionsTest-1546215062-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T16:10:32Z,user_data=None,user_id='4e0147898e9b4af9aaaa3379f431303e',uuid=3d8dc993-9fca-43b9-9058-801d7c497b1f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6931c93f-1b41-44f7-9acd-4bc3b834080f", "address": "fa:16:3e:c3:64:2a", "network": {"id": "6b7d7f72-e0a2-49a1-a1d8-927c62316dd2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-716305394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "888a739f27694bd5a56badca064a56b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6931c93f-1b", "ovs_interfaceid": "6931c93f-1b41-44f7-9acd-4bc3b834080f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 16:10:33 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-ad1ca3b1-8c21-42d5-8130-dfa3d552a63a tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] Converting VIF {"id": "6931c93f-1b41-44f7-9acd-4bc3b834080f", "address": "fa:16:3e:c3:64:2a", "network": {"id": "6b7d7f72-e0a2-49a1-a1d8-927c62316dd2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-716305394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "888a739f27694bd5a56badca064a56b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6931c93f-1b", "ovs_interfaceid": "6931c93f-1b41-44f7-9acd-4bc3b834080f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 16:10:33 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-ad1ca3b1-8c21-42d5-8130-dfa3d552a63a tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:64:2a,bridge_name='br-int',has_traffic_filtering=True,id=6931c93f-1b41-44f7-9acd-4bc3b834080f,network=Network(6b7d7f72-e0a2-49a1-a1d8-927c62316dd2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6931c93f-1b') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 16:10:33 user nova-compute[75337]: DEBUG os_vif [None req-ad1ca3b1-8c21-42d5-8130-dfa3d552a63a tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:64:2a,bridge_name='br-int',has_traffic_filtering=True,id=6931c93f-1b41-44f7-9acd-4bc3b834080f,network=Network(6b7d7f72-e0a2-49a1-a1d8-927c62316dd2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6931c93f-1b') {{(pid=75337) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 16:10:33 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:10:33 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 16:10:33 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 16:10:33 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:10:33 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'feb0de43-89a7-56d1-9597-cbfc8cc432a8', '_type': 'linux-noop'}}, row=False) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 16:10:33 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:10:33 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:10:33 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:10:33 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6931c93f-1b, may_exist=True, interface_attrs={}) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 16:10:33 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6931c93f-1b, col_values=(('qos', UUID('484a6cca-2ae7-4cd7-8313-397a8d2d60e3')),), if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 16:10:33 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6931c93f-1b, col_values=(('external_ids', {'iface-id': '6931c93f-1b41-44f7-9acd-4bc3b834080f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c3:64:2a', 'vm-uuid': '3d8dc993-9fca-43b9-9058-801d7c497b1f'}),), if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 16:10:33 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:10:33 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:10:33 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:10:33 user nova-compute[75337]: INFO os_vif [None req-ad1ca3b1-8c21-42d5-8130-dfa3d552a63a tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:64:2a,bridge_name='br-int',has_traffic_filtering=True,id=6931c93f-1b41-44f7-9acd-4bc3b834080f,network=Network(6b7d7f72-e0a2-49a1-a1d8-927c62316dd2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6931c93f-1b')
Nov 06 16:10:33 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-ad1ca3b1-8c21-42d5-8130-dfa3d552a63a tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] No BDM found with device name vda, not building metadata. {{(pid=75337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 16:10:33 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-ad1ca3b1-8c21-42d5-8130-dfa3d552a63a tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] No VIF found with MAC fa:16:3e:c3:64:2a, not building metadata {{(pid=75337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 16:10:34 user nova-compute[75337]: DEBUG nova.network.neutron [req-8f38aa6e-f1e1-4533-b555-e0476793d324 req-ae978742-5b93-43ff-acd9-73ab79578220 service nova] [instance: 3d8dc993-9fca-43b9-9058-801d7c497b1f] Updated VIF entry in instance network info cache for port 6931c93f-1b41-44f7-9acd-4bc3b834080f. {{(pid=75337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 16:10:34 user nova-compute[75337]: DEBUG nova.network.neutron [req-8f38aa6e-f1e1-4533-b555-e0476793d324 req-ae978742-5b93-43ff-acd9-73ab79578220 service nova] [instance: 3d8dc993-9fca-43b9-9058-801d7c497b1f] Updating instance_info_cache with network_info: [{"id": "6931c93f-1b41-44f7-9acd-4bc3b834080f", "address": "fa:16:3e:c3:64:2a", "network": {"id": "6b7d7f72-e0a2-49a1-a1d8-927c62316dd2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-716305394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "888a739f27694bd5a56badca064a56b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6931c93f-1b", "ovs_interfaceid": "6931c93f-1b41-44f7-9acd-4bc3b834080f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 16:10:34 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-8f38aa6e-f1e1-4533-b555-e0476793d324 req-ae978742-5b93-43ff-acd9-73ab79578220 service nova] Releasing lock "refresh_cache-3d8dc993-9fca-43b9-9058-801d7c497b1f" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 16:10:35 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:10:35 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:10:35 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:10:35 user nova-compute[75337]: DEBUG nova.compute.manager [req-d85d681a-af35-462f-806e-de9345436420 req-081b014f-fb2b-4f55-993e-43548c400875 service nova] [instance: 3d8dc993-9fca-43b9-9058-801d7c497b1f] Received event network-vif-plugged-6931c93f-1b41-44f7-9acd-4bc3b834080f {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:10:35 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-d85d681a-af35-462f-806e-de9345436420 req-081b014f-fb2b-4f55-993e-43548c400875 service nova] Acquiring lock "3d8dc993-9fca-43b9-9058-801d7c497b1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:10:35 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-d85d681a-af35-462f-806e-de9345436420 req-081b014f-fb2b-4f55-993e-43548c400875 service nova] Lock "3d8dc993-9fca-43b9-9058-801d7c497b1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:10:35 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-d85d681a-af35-462f-806e-de9345436420 req-081b014f-fb2b-4f55-993e-43548c400875 service nova] Lock "3d8dc993-9fca-43b9-9058-801d7c497b1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:10:35 user nova-compute[75337]: DEBUG nova.compute.manager [req-d85d681a-af35-462f-806e-de9345436420 req-081b014f-fb2b-4f55-993e-43548c400875 service nova] [instance: 3d8dc993-9fca-43b9-9058-801d7c497b1f] No waiting events found dispatching network-vif-plugged-6931c93f-1b41-44f7-9acd-4bc3b834080f {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 16:10:35 user nova-compute[75337]: WARNING nova.compute.manager [req-d85d681a-af35-462f-806e-de9345436420 req-081b014f-fb2b-4f55-993e-43548c400875 service nova] [instance: 3d8dc993-9fca-43b9-9058-801d7c497b1f] Received unexpected event network-vif-plugged-6931c93f-1b41-44f7-9acd-4bc3b834080f for instance with vm_state building and task_state spawning.
Nov 06 16:10:35 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:10:35 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:10:35 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:10:37 user nova-compute[75337]: DEBUG nova.compute.manager [None req-ad1ca3b1-8c21-42d5-8130-dfa3d552a63a tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] [instance: 3d8dc993-9fca-43b9-9058-801d7c497b1f] Instance event wait completed in 0 seconds for  {{(pid=75337) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 16:10:37 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-ad1ca3b1-8c21-42d5-8130-dfa3d552a63a tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] [instance: 3d8dc993-9fca-43b9-9058-801d7c497b1f] Guest created on hypervisor {{(pid=75337) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 16:10:37 user nova-compute[75337]: INFO nova.virt.libvirt.driver [-] [instance: 3d8dc993-9fca-43b9-9058-801d7c497b1f] Instance spawned successfully.
Nov 06 16:10:37 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-ad1ca3b1-8c21-42d5-8130-dfa3d552a63a tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] [instance: 3d8dc993-9fca-43b9-9058-801d7c497b1f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 16:10:37 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-ad1ca3b1-8c21-42d5-8130-dfa3d552a63a tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] [instance: 3d8dc993-9fca-43b9-9058-801d7c497b1f] Found default for hw_cdrom_bus of ide {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 16:10:37 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-ad1ca3b1-8c21-42d5-8130-dfa3d552a63a tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] [instance: 3d8dc993-9fca-43b9-9058-801d7c497b1f] Found default for hw_disk_bus of virtio {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 16:10:37 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-ad1ca3b1-8c21-42d5-8130-dfa3d552a63a tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] [instance: 3d8dc993-9fca-43b9-9058-801d7c497b1f] Found default for hw_input_bus of None {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 16:10:37 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-ad1ca3b1-8c21-42d5-8130-dfa3d552a63a tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] [instance: 3d8dc993-9fca-43b9-9058-801d7c497b1f] Found default for hw_pointer_model of None {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 16:10:37 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-ad1ca3b1-8c21-42d5-8130-dfa3d552a63a tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] [instance: 3d8dc993-9fca-43b9-9058-801d7c497b1f] Found default for hw_video_model of virtio {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 16:10:37 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-ad1ca3b1-8c21-42d5-8130-dfa3d552a63a tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] [instance: 3d8dc993-9fca-43b9-9058-801d7c497b1f] Found default for hw_vif_model of virtio {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 16:10:37 user nova-compute[75337]: INFO nova.compute.manager [None req-ad1ca3b1-8c21-42d5-8130-dfa3d552a63a tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] [instance: 3d8dc993-9fca-43b9-9058-801d7c497b1f] Took 5.04 seconds to spawn the instance on the hypervisor.
Nov 06 16:10:37 user nova-compute[75337]: DEBUG nova.compute.manager [None req-ad1ca3b1-8c21-42d5-8130-dfa3d552a63a tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] [instance: 3d8dc993-9fca-43b9-9058-801d7c497b1f] Checking state {{(pid=75337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 16:10:37 user nova-compute[75337]: INFO nova.compute.manager [None req-ad1ca3b1-8c21-42d5-8130-dfa3d552a63a tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] [instance: 3d8dc993-9fca-43b9-9058-801d7c497b1f] Took 5.94 seconds to build instance.
Nov 06 16:10:37 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-ad1ca3b1-8c21-42d5-8130-dfa3d552a63a tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] Lock "3d8dc993-9fca-43b9-9058-801d7c497b1f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.354s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:10:37 user nova-compute[75337]: DEBUG nova.compute.manager [req-72e671d8-1757-4bfa-9737-9cb0e7bc220e req-636b2836-d140-4468-b875-646c3ba3deb6 service nova] [instance: 3d8dc993-9fca-43b9-9058-801d7c497b1f] Received event network-vif-plugged-6931c93f-1b41-44f7-9acd-4bc3b834080f {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:10:37 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-72e671d8-1757-4bfa-9737-9cb0e7bc220e req-636b2836-d140-4468-b875-646c3ba3deb6 service nova] Acquiring lock "3d8dc993-9fca-43b9-9058-801d7c497b1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:10:37 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-72e671d8-1757-4bfa-9737-9cb0e7bc220e req-636b2836-d140-4468-b875-646c3ba3deb6 service nova] Lock "3d8dc993-9fca-43b9-9058-801d7c497b1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:10:37 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-72e671d8-1757-4bfa-9737-9cb0e7bc220e req-636b2836-d140-4468-b875-646c3ba3deb6 service nova] Lock "3d8dc993-9fca-43b9-9058-801d7c497b1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:10:37 user nova-compute[75337]: DEBUG nova.compute.manager [req-72e671d8-1757-4bfa-9737-9cb0e7bc220e req-636b2836-d140-4468-b875-646c3ba3deb6 service nova] [instance: 3d8dc993-9fca-43b9-9058-801d7c497b1f] No waiting events found dispatching network-vif-plugged-6931c93f-1b41-44f7-9acd-4bc3b834080f {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 16:10:37 user nova-compute[75337]: WARNING nova.compute.manager [req-72e671d8-1757-4bfa-9737-9cb0e7bc220e req-636b2836-d140-4468-b875-646c3ba3deb6 service nova] [instance: 3d8dc993-9fca-43b9-9058-801d7c497b1f] Received unexpected event network-vif-plugged-6931c93f-1b41-44f7-9acd-4bc3b834080f for instance with vm_state active and task_state None.
Nov 06 16:10:38 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:10:40 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:10:43 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:10:48 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:10:53 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:10:55 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:10:58 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:11:00 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:11:00 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-861fd6a4-14db-492f-b7d8-7aaa19c432d9 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Acquiring lock "88330c21-69e0-4d82-ac4d-b9e5e849f487" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:11:00 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-861fd6a4-14db-492f-b7d8-7aaa19c432d9 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Lock "88330c21-69e0-4d82-ac4d-b9e5e849f487" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:11:00 user nova-compute[75337]: DEBUG nova.objects.instance [None req-861fd6a4-14db-492f-b7d8-7aaa19c432d9 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Lazy-loading 'flavor' on Instance uuid 88330c21-69e0-4d82-ac4d-b9e5e849f487 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 16:11:00 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-861fd6a4-14db-492f-b7d8-7aaa19c432d9 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Lock "88330c21-69e0-4d82-ac4d-b9e5e849f487" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:11:00 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-861fd6a4-14db-492f-b7d8-7aaa19c432d9 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Acquiring lock "88330c21-69e0-4d82-ac4d-b9e5e849f487" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:11:00 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-861fd6a4-14db-492f-b7d8-7aaa19c432d9 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Lock "88330c21-69e0-4d82-ac4d-b9e5e849f487" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:11:00 user nova-compute[75337]: INFO nova.compute.manager [None req-861fd6a4-14db-492f-b7d8-7aaa19c432d9 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] [instance: 88330c21-69e0-4d82-ac4d-b9e5e849f487] Attaching volume f9ea6438-faab-4c60-b86e-3c3b575976ca to /dev/vdb
Nov 06 16:11:01 user nova-compute[75337]: DEBUG os_brick.utils [None req-861fd6a4-14db-492f-b7d8-7aaa19c432d9 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 16:11:01 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:11:01 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:11:01 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb8c6852-67ab-471a-b9e0-fb336af54168]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4ff6411e45b8\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:11:01 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:11:01 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:11:01 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7ef0de1-6876-4ba5-a86c-d9d4e7a31010]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:11:01 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:11:01 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:11:01 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cadf70b-f7f7-4494-bab6-433635fb078e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:11:01 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c7956b6-f494-4195-8531-d3081bb41af3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:11:01 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-861fd6a4-14db-492f-b7d8-7aaa19c432d9 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Running cmd (subprocess): nvme version {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:11:01 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-861fd6a4-14db-492f-b7d8-7aaa19c432d9 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] 'nvme version' failed. Not Retrying. {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 16:11:01 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.nvmeof [None req-861fd6a4-14db-492f-b7d8-7aaa19c432d9 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] nvme not present on system {{(pid=75337) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 16:11:01 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:11:01 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 16:11:01 user nova-compute[75337]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 16:11:01 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[aba72a2f-0e87-47cd-91d4-094c85bbdf41]: (4, '') {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:11:01 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.lightos [None req-861fd6a4-14db-492f-b7d8-7aaa19c432d9 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75337) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 16:11:01 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.lightos [None req-861fd6a4-14db-492f-b7d8-7aaa19c432d9 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 16:11:01 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.lightos [None req-861fd6a4-14db-492f-b7d8-7aaa19c432d9 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] LIGHTOS: no hostnqn found. {{(pid=75337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 16:11:01 user nova-compute[75337]: DEBUG os_brick.utils [None req-861fd6a4-14db-492f-b7d8-7aaa19c432d9 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4ff6411e45b8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 16:11:01 user nova-compute[75337]: DEBUG nova.virt.block_device [None req-861fd6a4-14db-492f-b7d8-7aaa19c432d9 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] [instance: 88330c21-69e0-4d82-ac4d-b9e5e849f487] Updating existing volume attachment record: 2c8bf411-13df-444e-9701-97444f17696e {{(pid=75337) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 16:11:03 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:11:05 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:11:08 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:11:10 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:11:11 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:11:13 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:11:13 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:11:17 user nova-compute[75337]: DEBUG nova.compute.manager [req-ad1d1a41-7206-404d-a86a-f6014dd4f816 req-73aa52ca-9f9b-44bf-a6bf-aaa2939d45a4 service nova] [instance: 15922f4f-f921-4245-8d3d-98ed47de946b] Received event network-changed-75853df2-1f1a-4a4f-be80-b29cd2452bd2 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:11:17 user nova-compute[75337]: DEBUG nova.compute.manager [req-ad1d1a41-7206-404d-a86a-f6014dd4f816 req-73aa52ca-9f9b-44bf-a6bf-aaa2939d45a4 service nova] [instance: 15922f4f-f921-4245-8d3d-98ed47de946b] Refreshing instance network info cache due to event network-changed-75853df2-1f1a-4a4f-be80-b29cd2452bd2. {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 16:11:17 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-ad1d1a41-7206-404d-a86a-f6014dd4f816 req-73aa52ca-9f9b-44bf-a6bf-aaa2939d45a4 service nova] Acquiring lock "refresh_cache-15922f4f-f921-4245-8d3d-98ed47de946b" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 16:11:17 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-ad1d1a41-7206-404d-a86a-f6014dd4f816 req-73aa52ca-9f9b-44bf-a6bf-aaa2939d45a4 service nova] Acquired lock "refresh_cache-15922f4f-f921-4245-8d3d-98ed47de946b" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 16:11:17 user nova-compute[75337]: DEBUG nova.network.neutron [req-ad1d1a41-7206-404d-a86a-f6014dd4f816 req-73aa52ca-9f9b-44bf-a6bf-aaa2939d45a4 service nova] [instance: 15922f4f-f921-4245-8d3d-98ed47de946b] Refreshing network info cache for port 75853df2-1f1a-4a4f-be80-b29cd2452bd2 {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 16:11:18 user nova-compute[75337]: DEBUG nova.network.neutron [req-ad1d1a41-7206-404d-a86a-f6014dd4f816 req-73aa52ca-9f9b-44bf-a6bf-aaa2939d45a4 service nova] [instance: 15922f4f-f921-4245-8d3d-98ed47de946b] Updated VIF entry in instance network info cache for port 75853df2-1f1a-4a4f-be80-b29cd2452bd2. {{(pid=75337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 16:11:18 user nova-compute[75337]: DEBUG nova.network.neutron [req-ad1d1a41-7206-404d-a86a-f6014dd4f816 req-73aa52ca-9f9b-44bf-a6bf-aaa2939d45a4 service nova] [instance: 15922f4f-f921-4245-8d3d-98ed47de946b] Updating instance_info_cache with network_info: [{"id": "75853df2-1f1a-4a4f-be80-b29cd2452bd2", "address": "fa:16:3e:f5:3f:f6", "network": {"id": "6b24c7e3-9e9c-4a84-8472-7629c0dc8029", "bridge": "br-int", "label": "tempest-TestShelveInstance-284079759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "573524caeb6248339e924a5abb8e5964", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75853df2-1f", "ovs_interfaceid": "75853df2-1f1a-4a4f-be80-b29cd2452bd2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 16:11:18 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-ad1d1a41-7206-404d-a86a-f6014dd4f816 req-73aa52ca-9f9b-44bf-a6bf-aaa2939d45a4 service nova] Releasing lock "refresh_cache-15922f4f-f921-4245-8d3d-98ed47de946b" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 16:11:18 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:11:18 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:11:18 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:11:18 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75337) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 16:11:18 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 16:11:18 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 16:11:18 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:11:19 user nova-compute[75337]: INFO nova.compute.manager [None req-c9a457ab-ef44-4c25-9e24-7b9cb90bca9b tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: d6eaef86-b841-4142-9549-31954fb34fa2] Get console output
Nov 06 16:11:19 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-8200dee8-3973-44b3-9af1-d831bcf3edde tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Acquiring lock "15922f4f-f921-4245-8d3d-98ed47de946b" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:11:19 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-8200dee8-3973-44b3-9af1-d831bcf3edde tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Lock "15922f4f-f921-4245-8d3d-98ed47de946b" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:11:19 user nova-compute[75337]: INFO nova.compute.manager [None req-8200dee8-3973-44b3-9af1-d831bcf3edde tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] [instance: 15922f4f-f921-4245-8d3d-98ed47de946b] Shelve offloading
Nov 06 16:11:19 user nova-compute[75337]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Nov 06 16:11:19 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:11:19 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:11:19 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:11:19 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75337) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 16:11:19 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:11:19 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:11:19 user nova-compute[75337]: DEBUG nova.compute.manager [req-87a8aedb-fcd8-4bb9-9499-3f381946d6da req-014a6e5d-66d8-4b14-8d05-5df877ef1a0e service nova] [instance: 15922f4f-f921-4245-8d3d-98ed47de946b] Received event network-vif-unplugged-75853df2-1f1a-4a4f-be80-b29cd2452bd2 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:11:19 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-87a8aedb-fcd8-4bb9-9499-3f381946d6da req-014a6e5d-66d8-4b14-8d05-5df877ef1a0e service nova] Acquiring lock "15922f4f-f921-4245-8d3d-98ed47de946b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:11:19 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-87a8aedb-fcd8-4bb9-9499-3f381946d6da req-014a6e5d-66d8-4b14-8d05-5df877ef1a0e service nova] Lock "15922f4f-f921-4245-8d3d-98ed47de946b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:11:19 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-87a8aedb-fcd8-4bb9-9499-3f381946d6da req-014a6e5d-66d8-4b14-8d05-5df877ef1a0e service nova] Lock "15922f4f-f921-4245-8d3d-98ed47de946b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:11:19 user nova-compute[75337]: DEBUG nova.compute.manager [req-87a8aedb-fcd8-4bb9-9499-3f381946d6da req-014a6e5d-66d8-4b14-8d05-5df877ef1a0e service nova] [instance: 15922f4f-f921-4245-8d3d-98ed47de946b] No waiting events found dispatching network-vif-unplugged-75853df2-1f1a-4a4f-be80-b29cd2452bd2 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 16:11:19 user nova-compute[75337]: WARNING nova.compute.manager [req-87a8aedb-fcd8-4bb9-9499-3f381946d6da req-014a6e5d-66d8-4b14-8d05-5df877ef1a0e service nova] [instance: 15922f4f-f921-4245-8d3d-98ed47de946b] Received unexpected event network-vif-unplugged-75853df2-1f1a-4a4f-be80-b29cd2452bd2 for instance with vm_state active and task_state shelving.
Nov 06 16:11:20 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:11:20 user nova-compute[75337]: INFO nova.virt.libvirt.driver [-] [instance: 15922f4f-f921-4245-8d3d-98ed47de946b] Instance destroyed successfully.
Nov 06 16:11:20 user nova-compute[75337]: DEBUG nova.compute.manager [None req-8200dee8-3973-44b3-9af1-d831bcf3edde tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] [instance: 15922f4f-f921-4245-8d3d-98ed47de946b] Checking state {{(pid=75337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 16:11:20 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-8200dee8-3973-44b3-9af1-d831bcf3edde tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Acquiring lock "refresh_cache-15922f4f-f921-4245-8d3d-98ed47de946b" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 16:11:20 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-8200dee8-3973-44b3-9af1-d831bcf3edde tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Acquired lock "refresh_cache-15922f4f-f921-4245-8d3d-98ed47de946b" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 16:11:20 user nova-compute[75337]: DEBUG nova.network.neutron [None req-8200dee8-3973-44b3-9af1-d831bcf3edde tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] [instance: 15922f4f-f921-4245-8d3d-98ed47de946b] Building network info cache for instance {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 16:11:20 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:11:20 user nova-compute[75337]: DEBUG nova.network.neutron [None req-8200dee8-3973-44b3-9af1-d831bcf3edde tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] [instance: 15922f4f-f921-4245-8d3d-98ed47de946b] Updating instance_info_cache with network_info: [{"id": "75853df2-1f1a-4a4f-be80-b29cd2452bd2", "address": "fa:16:3e:f5:3f:f6", "network": {"id": "6b24c7e3-9e9c-4a84-8472-7629c0dc8029", "bridge": "br-int", "label": "tempest-TestShelveInstance-284079759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "573524caeb6248339e924a5abb8e5964", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75853df2-1f", "ovs_interfaceid": "75853df2-1f1a-4a4f-be80-b29cd2452bd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 16:11:20 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-8200dee8-3973-44b3-9af1-d831bcf3edde tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Releasing lock "refresh_cache-15922f4f-f921-4245-8d3d-98ed47de946b" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 16:11:21 user nova-compute[75337]: INFO nova.virt.libvirt.driver [-] [instance: 15922f4f-f921-4245-8d3d-98ed47de946b] Instance destroyed successfully.
Nov 06 16:11:21 user nova-compute[75337]: DEBUG nova.objects.instance [None req-8200dee8-3973-44b3-9af1-d831bcf3edde tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Lazy-loading 'resources' on Instance uuid 15922f4f-f921-4245-8d3d-98ed47de946b {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 16:11:21 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-8200dee8-3973-44b3-9af1-d831bcf3edde tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T16:09:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1606147193',display_name='tempest-TestShelveInstance-server-1606147193',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1606147193',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBET5bxZ8mLAaWl4HqozpzhdVRJ1LnlkTiYfny9D2S0JwqS5aepxP0yT+cU0Pc9wCAKkm2TfPGhm7ljhyuLG76JgiijG2E7WfgIyahxQ8ji6zb6gr2/OWhMqORY7NLSU2HQ==',key_name='tempest-TestShelveInstance-1222945182',keypairs=<?>,launch_index=0,launched_at=2023-11-06T16:09:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='573524caeb6248339e924a5abb8e5964',ramdisk_id='',reservation_id='r-totl4fkd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-652677760',owner_user_name='tempest-TestShelveInstance-652677760-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T16:09:56Z,user_data=None,user_id='3204b8f95945489d8335cafa44ab2109',uuid=15922f4f-f921-4245-8d3d-98ed47de946b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "75853df2-1f1a-4a4f-be80-b29cd2452bd2", "address": "fa:16:3e:f5:3f:f6", "network": {"id": "6b24c7e3-9e9c-4a84-8472-7629c0dc8029", "bridge": "br-int", "label": "tempest-TestShelveInstance-284079759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "573524caeb6248339e924a5abb8e5964", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75853df2-1f", "ovs_interfaceid": "75853df2-1f1a-4a4f-be80-b29cd2452bd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 16:11:21 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-8200dee8-3973-44b3-9af1-d831bcf3edde tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Converting VIF {"id": "75853df2-1f1a-4a4f-be80-b29cd2452bd2", "address": "fa:16:3e:f5:3f:f6", "network": {"id": "6b24c7e3-9e9c-4a84-8472-7629c0dc8029", "bridge": "br-int", "label": "tempest-TestShelveInstance-284079759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "573524caeb6248339e924a5abb8e5964", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75853df2-1f", "ovs_interfaceid": "75853df2-1f1a-4a4f-be80-b29cd2452bd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 16:11:21 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-8200dee8-3973-44b3-9af1-d831bcf3edde tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:3f:f6,bridge_name='br-int',has_traffic_filtering=True,id=75853df2-1f1a-4a4f-be80-b29cd2452bd2,network=Network(6b24c7e3-9e9c-4a84-8472-7629c0dc8029),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75853df2-1f') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 16:11:21 user nova-compute[75337]: DEBUG os_vif [None req-8200dee8-3973-44b3-9af1-d831bcf3edde tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:3f:f6,bridge_name='br-int',has_traffic_filtering=True,id=75853df2-1f1a-4a4f-be80-b29cd2452bd2,network=Network(6b24c7e3-9e9c-4a84-8472-7629c0dc8029),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75853df2-1f') {{(pid=75337) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 16:11:21 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:11:21 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap75853df2-1f, bridge=br-int, if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 16:11:21 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:11:21 user nova-compute[75337]: DEBUG nova.compute.manager [req-1f6a8540-0471-4b6a-8c89-a743bd9d9249 req-173a49d2-2102-47f7-ba7c-035415df6fd7 service nova] [instance: 15922f4f-f921-4245-8d3d-98ed47de946b] Received event network-changed-75853df2-1f1a-4a4f-be80-b29cd2452bd2 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:11:21 user nova-compute[75337]: DEBUG nova.compute.manager [req-1f6a8540-0471-4b6a-8c89-a743bd9d9249 req-173a49d2-2102-47f7-ba7c-035415df6fd7 service nova] [instance: 15922f4f-f921-4245-8d3d-98ed47de946b] Refreshing instance network info cache due to event network-changed-75853df2-1f1a-4a4f-be80-b29cd2452bd2. {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 16:11:21 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-1f6a8540-0471-4b6a-8c89-a743bd9d9249 req-173a49d2-2102-47f7-ba7c-035415df6fd7 service nova] Acquiring lock "refresh_cache-15922f4f-f921-4245-8d3d-98ed47de946b" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 16:11:21 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-1f6a8540-0471-4b6a-8c89-a743bd9d9249 req-173a49d2-2102-47f7-ba7c-035415df6fd7 service nova] Acquired lock "refresh_cache-15922f4f-f921-4245-8d3d-98ed47de946b" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 16:11:21 user nova-compute[75337]: DEBUG nova.network.neutron [req-1f6a8540-0471-4b6a-8c89-a743bd9d9249 req-173a49d2-2102-47f7-ba7c-035415df6fd7 service nova] [instance: 15922f4f-f921-4245-8d3d-98ed47de946b] Refreshing network info cache for port 75853df2-1f1a-4a4f-be80-b29cd2452bd2 {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 16:11:21 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:11:21 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:11:21 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cd4af50a-3998-4956-91a9-dbbfdbdaaf0b) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 16:11:21 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:11:21 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:11:21 user nova-compute[75337]: INFO os_vif [None req-8200dee8-3973-44b3-9af1-d831bcf3edde tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:3f:f6,bridge_name='br-int',has_traffic_filtering=True,id=75853df2-1f1a-4a4f-be80-b29cd2452bd2,network=Network(6b24c7e3-9e9c-4a84-8472-7629c0dc8029),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75853df2-1f')
Nov 06 16:11:21 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8200dee8-3973-44b3-9af1-d831bcf3edde tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] [instance: 15922f4f-f921-4245-8d3d-98ed47de946b] calling os-brick to detach iSCSI Volume {{(pid=75337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 16:11:21 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-8200dee8-3973-44b3-9af1-d831bcf3edde tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2abc33d0c0>, {'target_iqn': 'iqn.2010-10.org.openstack:06b3b613-3c1e-4420-a500-1ec3988c0940', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'niMJzqwT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 16:11:21 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-8200dee8-3973-44b3-9af1-d831bcf3edde tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 16:11:21 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-8200dee8-3973-44b3-9af1-d831bcf3edde tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 16:11:21 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-8200dee8-3973-44b3-9af1-d831bcf3edde tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 16:11:21 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:11:21 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:11:21 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[07dc825c-411e-4fdf-90d1-b6093d0f44cd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:06b3b613-3c1e-4420-a500-1ec3988c0940\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:11:21 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-8200dee8-3973-44b3-9af1-d831bcf3edde tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 16:11:21 user nova-compute[75337]: No targets found.
Nov 06 16:11:21 user nova-compute[75337]: iSNS:
Nov 06 16:11:21 user nova-compute[75337]: No targets found.
Nov 06 16:11:21 user nova-compute[75337]: STATIC:
Nov 06 16:11:21 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:06b3b613-3c1e-4420-a500-1ec3988c0940
Nov 06 16:11:21 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 16:11:21 user nova-compute[75337]:                 Iface Name: default
Nov 06 16:11:21 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139
Nov 06 16:11:21 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 16:11:21 user nova-compute[75337]:                 Iface Name: default
Nov 06 16:11:21 user nova-compute[75337]: FIRMWARE:
Nov 06 16:11:21 user nova-compute[75337]: No targets found.
Nov 06 16:11:21 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 16:11:21 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-8200dee8-3973-44b3-9af1-d831bcf3edde tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 16:11:21 user nova-compute[75337]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 16:11:21 user nova-compute[75337]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75337) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 16:11:21 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-8200dee8-3973-44b3-9af1-d831bcf3edde tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:06b3b613-3c1e-4420-a500-1ec3988c0940', 0)] {{(pid=75337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 16:11:21 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:11:21 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:11:21 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[e96caf72-67c8-4f67-8670-522fbfb0535c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:06b3b613-3c1e-4420-a500-1ec3988c0940\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:11:21 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:11:21 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:11:21 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[49275f52-8d6d-4386-beb1-67768ca038aa]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06b3b613-3c1e-4420-a500-1ec3988c0940 (non-flash)\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:11:21 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-8200dee8-3973-44b3-9af1-d831bcf3edde tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139 (non-flash)
Nov 06 16:11:21 user nova-compute[75337]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06b3b613-3c1e-4420-a500-1ec3988c0940 (non-flash)
Nov 06 16:11:21 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 16:11:21 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-8200dee8-3973-44b3-9af1-d831bcf3edde tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139 (non-flash)
Nov 06 16:11:21 user nova-compute[75337]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06b3b613-3c1e-4420-a500-1ec3988c0940 (non-flash)
Nov 06 16:11:21 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 16:11:21 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-8200dee8-3973-44b3-9af1-d831bcf3edde tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2a9c25c940>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:06b3b613-3c1e-4420-a500-1ec3988c0940'): ({'sdd'}, set())}) {{(pid=75337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 16:11:21 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-8200dee8-3973-44b3-9af1-d831bcf3edde tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Removing single pathed devices sdd {{(pid=75337) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 16:11:21 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:11:21 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:11:21 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[166fb52b-bc25-4a63-a817-629fdd3d7bdc]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:11:21 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:11:21 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:11:21 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[1440f020-56e1-47a8-83dd-cb0e6c45b11b]: (4, ('ok\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:11:21 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-8200dee8-3973-44b3-9af1-d831bcf3edde tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Flushing IO for device /dev/sdd {{(pid=75337) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 16:11:21 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:11:21 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:11:21 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[b73cf544-70b4-442e-b973-0f0bb41e4064]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:11:21 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-8200dee8-3973-44b3-9af1-d831bcf3edde tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75337) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 16:11:21 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:11:21 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.054s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:11:21 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd616712-304a-45a4-a79b-0d1bc936b296]: (4, ('1', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:11:21 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-8200dee8-3973-44b3-9af1-d831bcf3edde tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 16:11:21 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-8200dee8-3973-44b3-9af1-d831bcf3edde tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] SCSI volumes sdd have been removed. {{(pid=75337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 16:11:21 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-8200dee8-3973-44b3-9af1-d831bcf3edde tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:06b3b613-3c1e-4420-a500-1ec3988c0940')] {{(pid=75337) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 16:11:21 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06b3b613-3c1e-4420-a500-1ec3988c0940 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:11:21 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06b3b613-3c1e-4420-a500-1ec3988c0940 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:11:21 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[04e0d4ca-fc37-46a3-8699-a344750475c4]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:11:21 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-8200dee8-3973-44b3-9af1-d831bcf3edde tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:11:21 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06b3b613-3c1e-4420-a500-1ec3988c0940 -p 172.16.0.220:3260 --logout {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:11:21 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06b3b613-3c1e-4420-a500-1ec3988c0940 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:11:21 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[349b837d-4c2b-48ae-b643-a80134316688]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:06b3b613-3c1e-4420-a500-1ec3988c0940, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:06b3b613-3c1e-4420-a500-1ec3988c0940, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:11:21 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-8200dee8-3973-44b3-9af1-d831bcf3edde tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:06b3b613-3c1e-4420-a500-1ec3988c0940, portal: 172.16.0.220,3260]
Nov 06 16:11:21 user nova-compute[75337]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:06b3b613-3c1e-4420-a500-1ec3988c0940, portal: 172.16.0.220,3260] successful.
Nov 06 16:11:21 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:11:21 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06b3b613-3c1e-4420-a500-1ec3988c0940 -p 172.16.0.220:3260 --op delete {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:11:21 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06b3b613-3c1e-4420-a500-1ec3988c0940 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:11:21 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[573a7488-ee31-465f-9a2c-12150251f87d]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:11:21 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-8200dee8-3973-44b3-9af1-d831bcf3edde tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:11:21 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-8200dee8-3973-44b3-9af1-d831bcf3edde tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.350s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 16:11:21 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-8200dee8-3973-44b3-9af1-d831bcf3edde tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] <== disconnect_volume: return (351ms) None {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 16:11:21 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8200dee8-3973-44b3-9af1-d831bcf3edde tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] [instance: 15922f4f-f921-4245-8d3d-98ed47de946b] Disconnected iSCSI Volume {{(pid=75337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 16:11:21 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-8200dee8-3973-44b3-9af1-d831bcf3edde tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] [instance: 15922f4f-f921-4245-8d3d-98ed47de946b] Deleting instance files /opt/stack/data/nova/instances/15922f4f-f921-4245-8d3d-98ed47de946b_del
Nov 06 16:11:21 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-8200dee8-3973-44b3-9af1-d831bcf3edde tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] [instance: 15922f4f-f921-4245-8d3d-98ed47de946b] Deletion of /opt/stack/data/nova/instances/15922f4f-f921-4245-8d3d-98ed47de946b_del complete
Nov 06 16:11:21 user nova-compute[75337]: DEBUG nova.compute.manager [req-c5946dc0-8d74-4a67-b535-0d991cb53033 req-5e6e1dcb-684d-4e1c-9b76-9a1cba912323 service nova] [instance: 15922f4f-f921-4245-8d3d-98ed47de946b] Received event network-vif-plugged-75853df2-1f1a-4a4f-be80-b29cd2452bd2 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:11:21 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-c5946dc0-8d74-4a67-b535-0d991cb53033 req-5e6e1dcb-684d-4e1c-9b76-9a1cba912323 service nova] Acquiring lock "15922f4f-f921-4245-8d3d-98ed47de946b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:11:21 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-c5946dc0-8d74-4a67-b535-0d991cb53033 req-5e6e1dcb-684d-4e1c-9b76-9a1cba912323 service nova] Lock "15922f4f-f921-4245-8d3d-98ed47de946b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:11:21 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-c5946dc0-8d74-4a67-b535-0d991cb53033 req-5e6e1dcb-684d-4e1c-9b76-9a1cba912323 service nova] Lock "15922f4f-f921-4245-8d3d-98ed47de946b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:11:21 user nova-compute[75337]: DEBUG nova.compute.manager [req-c5946dc0-8d74-4a67-b535-0d991cb53033 req-5e6e1dcb-684d-4e1c-9b76-9a1cba912323 service nova] [instance: 15922f4f-f921-4245-8d3d-98ed47de946b] No waiting events found dispatching network-vif-plugged-75853df2-1f1a-4a4f-be80-b29cd2452bd2 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 16:11:21 user nova-compute[75337]: WARNING nova.compute.manager [req-c5946dc0-8d74-4a67-b535-0d991cb53033 req-5e6e1dcb-684d-4e1c-9b76-9a1cba912323 service nova] [instance: 15922f4f-f921-4245-8d3d-98ed47de946b] Received unexpected event network-vif-plugged-75853df2-1f1a-4a4f-be80-b29cd2452bd2 for instance with vm_state active and task_state shelving.
Nov 06 16:11:21 user nova-compute[75337]: DEBUG nova.network.neutron [req-1f6a8540-0471-4b6a-8c89-a743bd9d9249 req-173a49d2-2102-47f7-ba7c-035415df6fd7 service nova] [instance: 15922f4f-f921-4245-8d3d-98ed47de946b] Updated VIF entry in instance network info cache for port 75853df2-1f1a-4a4f-be80-b29cd2452bd2. {{(pid=75337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 16:11:21 user nova-compute[75337]: DEBUG nova.network.neutron [req-1f6a8540-0471-4b6a-8c89-a743bd9d9249 req-173a49d2-2102-47f7-ba7c-035415df6fd7 service nova] [instance: 15922f4f-f921-4245-8d3d-98ed47de946b] Updating instance_info_cache with network_info: [{"id": "75853df2-1f1a-4a4f-be80-b29cd2452bd2", "address": "fa:16:3e:f5:3f:f6", "network": {"id": "6b24c7e3-9e9c-4a84-8472-7629c0dc8029", "bridge": null, "label": "tempest-TestShelveInstance-284079759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "573524caeb6248339e924a5abb8e5964", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap75853df2-1f", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 16:11:21 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-1f6a8540-0471-4b6a-8c89-a743bd9d9249 req-173a49d2-2102-47f7-ba7c-035415df6fd7 service nova] Releasing lock "refresh_cache-15922f4f-f921-4245-8d3d-98ed47de946b" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 16:11:22 user nova-compute[75337]: INFO nova.scheduler.client.report [None req-8200dee8-3973-44b3-9af1-d831bcf3edde tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Deleted allocations for instance 15922f4f-f921-4245-8d3d-98ed47de946b
Nov 06 16:11:22 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-8200dee8-3973-44b3-9af1-d831bcf3edde tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:11:22 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-8200dee8-3973-44b3-9af1-d831bcf3edde tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:11:22 user nova-compute[75337]: DEBUG nova.objects.instance [None req-8200dee8-3973-44b3-9af1-d831bcf3edde tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Lazy-loading 'numa_topology' on Instance uuid 15922f4f-f921-4245-8d3d-98ed47de946b {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 16:11:22 user nova-compute[75337]: DEBUG nova.objects.base [None req-8200dee8-3973-44b3-9af1-d831bcf3edde tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Object Instance<15922f4f-f921-4245-8d3d-98ed47de946b> lazy-loaded attributes: resources,numa_topology {{(pid=75337) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 16:11:23 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-8200dee8-3973-44b3-9af1-d831bcf3edde tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 16:11:23 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-8200dee8-3973-44b3-9af1-d831bcf3edde tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 16:11:23 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-8200dee8-3973-44b3-9af1-d831bcf3edde tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.210s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:11:23 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-8200dee8-3973-44b3-9af1-d831bcf3edde tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Lock "15922f4f-f921-4245-8d3d-98ed47de946b" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 3.755s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:11:23 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-861fd6a4-14db-492f-b7d8-7aaa19c432d9 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] [instance: 88330c21-69e0-4d82-ac4d-b9e5e849f487] Calling os-brick to attach iSCSI Volume {{(pid=75337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 16:11:23 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-861fd6a4-14db-492f-b7d8-7aaa19c432d9 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2abc33d0c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f9ea6438-faab-4c60-b86e-3c3b575976ca', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yIeKYsFT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 16:11:23 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-861fd6a4-14db-492f-b7d8-7aaa19c432d9 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 16:11:23 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-861fd6a4-14db-492f-b7d8-7aaa19c432d9 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 16:11:23 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-861fd6a4-14db-492f-b7d8-7aaa19c432d9 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 16:11:23 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-861fd6a4-14db-492f-b7d8-7aaa19c432d9 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 16:11:23 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-861fd6a4-14db-492f-b7d8-7aaa19c432d9 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f9ea6438-faab-4c60-b86e-3c3b575976ca" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 16:11:23 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-861fd6a4-14db-492f-b7d8-7aaa19c432d9 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f9ea6438-faab-4c60-b86e-3c3b575976ca" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.097s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 16:11:23 user nova-compute[75337]: INFO os_brick.initiator.connectors.iscsi [None req-861fd6a4-14db-492f-b7d8-7aaa19c432d9 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 16:11:23 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:11:23 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9ea6438-faab-4c60-b86e-3c3b575976ca -p 172.16.0.220:3260 {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:11:23 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9ea6438-faab-4c60-b86e-3c3b575976ca -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:11:23 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[898f58d5-62f0-4bfa-9a7e-0f867dd1fdf1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:11:23 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-861fd6a4-14db-492f-b7d8-7aaa19c432d9 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 16:11:23 user nova-compute[75337]:  {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:11:23 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9ea6438-faab-4c60-b86e-3c3b575976ca -p 172.16.0.220:3260 --interface default --op new {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:11:23 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9ea6438-faab-4c60-b86e-3c3b575976ca -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:11:23 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[edcd1337-e951-4476-bc63-c00dda6adcf3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f9ea6438-faab-4c60-b86e-3c3b575976ca] added\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:11:23 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-861fd6a4-14db-492f-b7d8-7aaa19c432d9 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f9ea6438-faab-4c60-b86e-3c3b575976ca] added
Nov 06 16:11:23 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:11:23 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9ea6438-faab-4c60-b86e-3c3b575976ca -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:11:23 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9ea6438-faab-4c60-b86e-3c3b575976ca -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:11:23 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[093c3a36-fa66-4344-a09b-cab9c05e29cf]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:11:23 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-861fd6a4-14db-492f-b7d8-7aaa19c432d9 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:11:23 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9ea6438-faab-4c60-b86e-3c3b575976ca -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:11:23 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9ea6438-faab-4c60-b86e-3c3b575976ca -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:11:23 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[b06e6f33-7b95-4d71-9506-82954300f766]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:11:23 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-861fd6a4-14db-492f-b7d8-7aaa19c432d9 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:11:23 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9ea6438-faab-4c60-b86e-3c3b575976ca -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yIeKYsFT {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:11:23 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9ea6438-faab-4c60-b86e-3c3b575976ca -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yIeKYsFT" returned: 0 in 0.019s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:11:23 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[6581d8cc-2644-4cf5-8bf6-ae7a9a03f184]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:11:23 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-861fd6a4-14db-492f-b7d8-7aaa19c432d9 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yIeKYsFT'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:11:23 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9ea6438-faab-4c60-b86e-3c3b575976ca -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:11:23 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9ea6438-faab-4c60-b86e-3c3b575976ca -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:11:23 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e056a97-fe62-4fb1-acd1-dc003f5d9812]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:11:23 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-861fd6a4-14db-492f-b7d8-7aaa19c432d9 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:11:23 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:11:23 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:11:23 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ac35a59-e9f1-41e5-996f-4d1a455fe62c]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139 (non-flash)\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:11:23 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-861fd6a4-14db-492f-b7d8-7aaa19c432d9 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139 (non-flash)
Nov 06 16:11:23 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 16:11:23 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-861fd6a4-14db-492f-b7d8-7aaa19c432d9 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139 (non-flash)
Nov 06 16:11:23 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 16:11:23 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9ea6438-faab-4c60-b86e-3c3b575976ca -p 172.16.0.220:3260 --login {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:11:23 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9ea6438-faab-4c60-b86e-3c3b575976ca -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:11:23 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[87d025ca-058d-449e-9c06-b232fb0f01b4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f9ea6438-faab-4c60-b86e-3c3b575976ca, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f9ea6438-faab-4c60-b86e-3c3b575976ca, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:11:23 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-861fd6a4-14db-492f-b7d8-7aaa19c432d9 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f9ea6438-faab-4c60-b86e-3c3b575976ca, portal: 172.16.0.220,3260]
Nov 06 16:11:23 user nova-compute[75337]: Login to [iface: default, target: iqn.2010-10.org.openstack:f9ea6438-faab-4c60-b86e-3c3b575976ca, portal: 172.16.0.220,3260] successful.
Nov 06 16:11:23 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:11:23 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9ea6438-faab-4c60-b86e-3c3b575976ca -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:11:23 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9ea6438-faab-4c60-b86e-3c3b575976ca -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:11:23 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ed53c18-db81-472b-ad86-5ee80d2bfd76]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:11:23 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-861fd6a4-14db-492f-b7d8-7aaa19c432d9 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:11:23 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:11:23 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:11:23 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[17ba9a0f-b3f2-4392-a6f4-1d3bc71e31cf]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9ea6438-faab-4c60-b86e-3c3b575976ca (non-flash)\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:11:23 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-861fd6a4-14db-492f-b7d8-7aaa19c432d9 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139 (non-flash)
Nov 06 16:11:23 user nova-compute[75337]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9ea6438-faab-4c60-b86e-3c3b575976ca (non-flash)
Nov 06 16:11:23 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 16:11:23 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-861fd6a4-14db-492f-b7d8-7aaa19c432d9 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139 (non-flash)
Nov 06 16:11:23 user nova-compute[75337]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9ea6438-faab-4c60-b86e-3c3b575976ca (non-flash)
Nov 06 16:11:23 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 16:11:23 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-861fd6a4-14db-492f-b7d8-7aaa19c432d9 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f9ea6438-faab-4c60-b86e-3c3b575976ca" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.291s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 16:11:23 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-861fd6a4-14db-492f-b7d8-7aaa19c432d9 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Connected to 172.16.0.220:3260 {{(pid=75337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 16:11:23 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-861fd6a4-14db-492f-b7d8-7aaa19c432d9 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] HCTL ('33', '-', '-', 0) found on session 54 with lun 0 {{(pid=75337) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 16:11:23 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-861fd6a4-14db-492f-b7d8-7aaa19c432d9 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75337) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 16:11:23 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:11:23 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:11:23 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7f78be6-e0b8-40b9-9e15-13022c5d61ec]: (4, ('- - 0', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:11:23 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-861fd6a4-14db-492f-b7d8-7aaa19c432d9 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Searching for a device in session 54 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75337) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 16:11:23 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-861fd6a4-14db-492f-b7d8-7aaa19c432d9 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:f9ea6438-faab-4c60-b86e-3c3b575976ca', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yIeKYsFT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 16:11:24 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:11:24 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-861fd6a4-14db-492f-b7d8-7aaa19c432d9 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.421s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 16:11:24 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-861fd6a4-14db-492f-b7d8-7aaa19c432d9 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] <== connect_volume: return (1422ms) {'type': 'block', 'scsi_wwn': '26433653435666261', 'path': '/dev/sdb'} {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 16:11:24 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-861fd6a4-14db-492f-b7d8-7aaa19c432d9 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] [instance: 88330c21-69e0-4d82-ac4d-b9e5e849f487] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26433653435666261', 'path': '/dev/sdb'} {{(pid=75337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 16:11:24 user nova-compute[75337]: DEBUG nova.objects.instance [None req-861fd6a4-14db-492f-b7d8-7aaa19c432d9 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Lazy-loading 'flavor' on Instance uuid 88330c21-69e0-4d82-ac4d-b9e5e849f487 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 16:11:24 user nova-compute[75337]: DEBUG nova.virt.libvirt.guest [None req-861fd6a4-14db-492f-b7d8-7aaa19c432d9 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] attach device xml: <disk type="block" device="disk">
Nov 06 16:11:24 user nova-compute[75337]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 16:11:24 user nova-compute[75337]:   <source dev="/dev/sdb"/>
Nov 06 16:11:24 user nova-compute[75337]:   <target dev="vdb" bus="virtio"/>
Nov 06 16:11:24 user nova-compute[75337]:   <serial>f9ea6438-faab-4c60-b86e-3c3b575976ca</serial>
Nov 06 16:11:24 user nova-compute[75337]: </disk>
Nov 06 16:11:24 user nova-compute[75337]:  {{(pid=75337) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 06 16:11:25 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:11:25 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:11:25 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-861fd6a4-14db-492f-b7d8-7aaa19c432d9 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] No BDM found with device name vda, not building metadata. {{(pid=75337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 16:11:25 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-861fd6a4-14db-492f-b7d8-7aaa19c432d9 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 16:11:25 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-861fd6a4-14db-492f-b7d8-7aaa19c432d9 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] No VIF found with MAC fa:16:3e:d4:3f:d4, not building metadata {{(pid=75337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 16:11:25 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-861fd6a4-14db-492f-b7d8-7aaa19c432d9 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Lock "88330c21-69e0-4d82-ac4d-b9e5e849f487" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 24.617s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:11:26 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:11:27 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:11:27 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:11:28 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-e56eb404-cb73-47ee-867f-ecaf6f23d4f6 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Acquiring lock "88330c21-69e0-4d82-ac4d-b9e5e849f487" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:11:28 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-e56eb404-cb73-47ee-867f-ecaf6f23d4f6 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Lock "88330c21-69e0-4d82-ac4d-b9e5e849f487" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:11:28 user nova-compute[75337]: INFO nova.compute.manager [None req-e56eb404-cb73-47ee-867f-ecaf6f23d4f6 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] [instance: 88330c21-69e0-4d82-ac4d-b9e5e849f487] Detaching volume f9ea6438-faab-4c60-b86e-3c3b575976ca
Nov 06 16:11:28 user nova-compute[75337]: INFO nova.virt.block_device [None req-e56eb404-cb73-47ee-867f-ecaf6f23d4f6 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] [instance: 88330c21-69e0-4d82-ac4d-b9e5e849f487] Attempting to driver detach volume f9ea6438-faab-4c60-b86e-3c3b575976ca from mountpoint /dev/vdb
Nov 06 16:11:28 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-e56eb404-cb73-47ee-867f-ecaf6f23d4f6 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Attempting to detach device vdb from instance 88330c21-69e0-4d82-ac4d-b9e5e849f487 from the persistent domain config. {{(pid=75337) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 06 16:11:28 user nova-compute[75337]: DEBUG nova.virt.libvirt.guest [None req-e56eb404-cb73-47ee-867f-ecaf6f23d4f6 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 16:11:28 user nova-compute[75337]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 16:11:28 user nova-compute[75337]:   <source dev="/dev/sdb"/>
Nov 06 16:11:28 user nova-compute[75337]:   <target dev="vdb" bus="virtio"/>
Nov 06 16:11:28 user nova-compute[75337]:   <serial>f9ea6438-faab-4c60-b86e-3c3b575976ca</serial>
Nov 06 16:11:28 user nova-compute[75337]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 06 16:11:28 user nova-compute[75337]: </disk>
Nov 06 16:11:28 user nova-compute[75337]:  {{(pid=75337) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 16:11:28 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-e56eb404-cb73-47ee-867f-ecaf6f23d4f6 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Successfully detached device vdb from instance 88330c21-69e0-4d82-ac4d-b9e5e849f487 from the persistent domain config.
Nov 06 16:11:28 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-e56eb404-cb73-47ee-867f-ecaf6f23d4f6 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 88330c21-69e0-4d82-ac4d-b9e5e849f487 from the live domain config. {{(pid=75337) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 06 16:11:28 user nova-compute[75337]: DEBUG nova.virt.libvirt.guest [None req-e56eb404-cb73-47ee-867f-ecaf6f23d4f6 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 16:11:28 user nova-compute[75337]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 16:11:28 user nova-compute[75337]:   <source dev="/dev/sdb"/>
Nov 06 16:11:28 user nova-compute[75337]:   <target dev="vdb" bus="virtio"/>
Nov 06 16:11:28 user nova-compute[75337]:   <serial>f9ea6438-faab-4c60-b86e-3c3b575976ca</serial>
Nov 06 16:11:28 user nova-compute[75337]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 06 16:11:28 user nova-compute[75337]: </disk>
Nov 06 16:11:28 user nova-compute[75337]:  {{(pid=75337) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 16:11:28 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-e56eb404-cb73-47ee-867f-ecaf6f23d4f6 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 88330c21-69e0-4d82-ac4d-b9e5e849f487 {{(pid=75337) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 06 16:11:30 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:11:30 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:11:30 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Starting heal instance info cache {{(pid=75337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 16:11:30 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "refresh_cache-d6eaef86-b841-4142-9549-31954fb34fa2" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 16:11:30 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquired lock "refresh_cache-d6eaef86-b841-4142-9549-31954fb34fa2" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 16:11:30 user nova-compute[75337]: DEBUG nova.network.neutron [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] [instance: d6eaef86-b841-4142-9549-31954fb34fa2] Forcefully refreshing network info cache for instance {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 16:11:31 user nova-compute[75337]: DEBUG nova.network.neutron [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] [instance: d6eaef86-b841-4142-9549-31954fb34fa2] Updating instance_info_cache with network_info: [{"id": "99bb43c1-3b95-4be2-a534-845c37778773", "address": "fa:16:3e:98:6e:e3", "network": {"id": "7f234ecf-bfa6-4316-9dce-c15050ba7914", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1378707892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "243647103fd44f629e0f40be0b56407e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99bb43c1-3b", "ovs_interfaceid": "99bb43c1-3b95-4be2-a534-845c37778773", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 16:11:31 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Releasing lock "refresh_cache-d6eaef86-b841-4142-9549-31954fb34fa2" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 16:11:31 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] [instance: d6eaef86-b841-4142-9549-31954fb34fa2] Updated the network info_cache for instance {{(pid=75337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 16:11:31 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager.update_available_resource {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:11:31 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:11:31 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:11:31 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:11:31 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Auditing locally available compute resources for user (node: user) {{(pid=75337) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 16:11:31 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d8dc993-9fca-43b9-9058-801d7c497b1f/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:11:31 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:11:31 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d8dc993-9fca-43b9-9058-801d7c497b1f/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:11:31 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d8dc993-9fca-43b9-9058-801d7c497b1f/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:11:31 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d8dc993-9fca-43b9-9058-801d7c497b1f/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:11:31 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 16:11:31 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6110b34a-6fd3-45fc-911d-4e5d3c7f2d78/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:11:31 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6110b34a-6fd3-45fc-911d-4e5d3c7f2d78/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:11:31 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6110b34a-6fd3-45fc-911d-4e5d3c7f2d78/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:11:31 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6110b34a-6fd3-45fc-911d-4e5d3c7f2d78/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:11:31 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88330c21-69e0-4d82-ac4d-b9e5e849f487/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:11:32 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88330c21-69e0-4d82-ac4d-b9e5e849f487/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:11:32 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88330c21-69e0-4d82-ac4d-b9e5e849f487/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:11:32 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88330c21-69e0-4d82-ac4d-b9e5e849f487/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:11:32 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 16:11:32 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 16:11:32 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Hypervisor/Node resource view: name=user free_ram=8412MB free_disk=25.002704620361328GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75337) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 16:11:32 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:11:32 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:11:32 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 6110b34a-6fd3-45fc-911d-4e5d3c7f2d78 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 16:11:32 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 88330c21-69e0-4d82-ac4d-b9e5e849f487 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 16:11:32 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance d6eaef86-b841-4142-9549-31954fb34fa2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 16:11:32 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 3d8dc993-9fca-43b9-9058-801d7c497b1f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 16:11:32 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 16:11:32 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 16:11:32 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 16:11:32 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 16:11:33 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Compute_service record updated for user:user {{(pid=75337) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 16:11:33 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.303s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:11:35 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:11:36 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:11:41 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:11:41 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:11:41 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75337) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 16:11:41 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 16:11:41 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 16:11:41 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:11:46 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:11:48 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:11:48 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-e56eb404-cb73-47ee-867f-ecaf6f23d4f6 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 88330c21-69e0-4d82-ac4d-b9e5e849f487 is timed out.
Nov 06 16:11:48 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-e56eb404-cb73-47ee-867f-ecaf6f23d4f6 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Successfully detached device vdb from instance 88330c21-69e0-4d82-ac4d-b9e5e849f487 from the live domain config.
Nov 06 16:11:48 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e56eb404-cb73-47ee-867f-ecaf6f23d4f6 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] [instance: 88330c21-69e0-4d82-ac4d-b9e5e849f487] calling os-brick to detach iSCSI Volume {{(pid=75337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 16:11:48 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e56eb404-cb73-47ee-867f-ecaf6f23d4f6 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2abc33d0c0>, {'target_iqn': 'iqn.2010-10.org.openstack:f9ea6438-faab-4c60-b86e-3c3b575976ca', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yIeKYsFT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 16:11:48 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-e56eb404-cb73-47ee-867f-ecaf6f23d4f6 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 16:11:48 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-e56eb404-cb73-47ee-867f-ecaf6f23d4f6 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 16:11:48 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-e56eb404-cb73-47ee-867f-ecaf6f23d4f6 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 16:11:48 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:11:48 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:11:48 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[57ddda39-4468-4d24-be42-a83badd3a9ef]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f9ea6438-faab-4c60-b86e-3c3b575976ca\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:11:48 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e56eb404-cb73-47ee-867f-ecaf6f23d4f6 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 16:11:48 user nova-compute[75337]: No targets found.
Nov 06 16:11:48 user nova-compute[75337]: iSNS:
Nov 06 16:11:48 user nova-compute[75337]: No targets found.
Nov 06 16:11:48 user nova-compute[75337]: STATIC:
Nov 06 16:11:48 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:f9ea6438-faab-4c60-b86e-3c3b575976ca
Nov 06 16:11:48 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 16:11:48 user nova-compute[75337]:                 Iface Name: default
Nov 06 16:11:48 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139
Nov 06 16:11:48 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 16:11:48 user nova-compute[75337]:                 Iface Name: default
Nov 06 16:11:48 user nova-compute[75337]: FIRMWARE:
Nov 06 16:11:48 user nova-compute[75337]: No targets found.
Nov 06 16:11:48 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 16:11:48 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e56eb404-cb73-47ee-867f-ecaf6f23d4f6 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 16:11:48 user nova-compute[75337]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 16:11:48 user nova-compute[75337]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75337) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 16:11:48 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e56eb404-cb73-47ee-867f-ecaf6f23d4f6 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f9ea6438-faab-4c60-b86e-3c3b575976ca', 0)] {{(pid=75337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 16:11:48 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:11:48 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:11:48 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3cef515-3236-4d73-a160-179b23aa79b0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f9ea6438-faab-4c60-b86e-3c3b575976ca\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:11:48 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:11:49 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:11:49 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a1463a5-15a1-4760-867a-d15324e24757]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9ea6438-faab-4c60-b86e-3c3b575976ca (non-flash)\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:11:49 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e56eb404-cb73-47ee-867f-ecaf6f23d4f6 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139 (non-flash)
Nov 06 16:11:49 user nova-compute[75337]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9ea6438-faab-4c60-b86e-3c3b575976ca (non-flash)
Nov 06 16:11:49 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 16:11:49 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e56eb404-cb73-47ee-867f-ecaf6f23d4f6 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139 (non-flash)
Nov 06 16:11:49 user nova-compute[75337]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9ea6438-faab-4c60-b86e-3c3b575976ca (non-flash)
Nov 06 16:11:49 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 16:11:49 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e56eb404-cb73-47ee-867f-ecaf6f23d4f6 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2abc55cee0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f9ea6438-faab-4c60-b86e-3c3b575976ca'): ({'sdb'}, set())}) {{(pid=75337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 16:11:49 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-e56eb404-cb73-47ee-867f-ecaf6f23d4f6 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Removing single pathed devices sdb {{(pid=75337) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 16:11:49 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:11:49 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:11:49 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[598099d9-d736-46c7-b580-08ab3696d931]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:11:49 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:11:49 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:11:49 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[466b0a0c-00e7-44c5-b19f-fcbb7cf1c477]: (4, ('ok\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:11:49 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-e56eb404-cb73-47ee-867f-ecaf6f23d4f6 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Flushing IO for device /dev/sdb {{(pid=75337) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 16:11:49 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:11:49 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:11:49 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e7c18e3-c5e7-4b33-b22e-a5543608b402]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:11:49 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-e56eb404-cb73-47ee-867f-ecaf6f23d4f6 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75337) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 16:11:49 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:11:49 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:11:49 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[2493b09c-16b0-4d28-a894-6f51133e0d7c]: (4, ('1', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:11:49 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-e56eb404-cb73-47ee-867f-ecaf6f23d4f6 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 16:11:49 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-e56eb404-cb73-47ee-867f-ecaf6f23d4f6 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] SCSI volumes sdb have been removed. {{(pid=75337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 16:11:49 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e56eb404-cb73-47ee-867f-ecaf6f23d4f6 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f9ea6438-faab-4c60-b86e-3c3b575976ca')] {{(pid=75337) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 16:11:49 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9ea6438-faab-4c60-b86e-3c3b575976ca -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:11:49 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9ea6438-faab-4c60-b86e-3c3b575976ca -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:11:49 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa475b1d-b4b0-4a42-b8de-d83ff1f54c5e]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:11:49 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e56eb404-cb73-47ee-867f-ecaf6f23d4f6 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:11:49 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9ea6438-faab-4c60-b86e-3c3b575976ca -p 172.16.0.220:3260 --logout {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:11:49 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9ea6438-faab-4c60-b86e-3c3b575976ca -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:11:49 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a72f73d-c921-4e2e-9ba4-b65e5b9b6842]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:f9ea6438-faab-4c60-b86e-3c3b575976ca, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:f9ea6438-faab-4c60-b86e-3c3b575976ca, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:11:49 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e56eb404-cb73-47ee-867f-ecaf6f23d4f6 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:f9ea6438-faab-4c60-b86e-3c3b575976ca, portal: 172.16.0.220,3260]
Nov 06 16:11:49 user nova-compute[75337]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:f9ea6438-faab-4c60-b86e-3c3b575976ca, portal: 172.16.0.220,3260] successful.
Nov 06 16:11:49 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:11:49 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9ea6438-faab-4c60-b86e-3c3b575976ca -p 172.16.0.220:3260 --op delete {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:11:49 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9ea6438-faab-4c60-b86e-3c3b575976ca -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:11:49 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[24d28448-1cb4-4279-a3cf-a0dde23589af]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:11:49 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e56eb404-cb73-47ee-867f-ecaf6f23d4f6 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:11:49 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-e56eb404-cb73-47ee-867f-ecaf6f23d4f6 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.309s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 16:11:49 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e56eb404-cb73-47ee-867f-ecaf6f23d4f6 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] <== disconnect_volume: return (311ms) None {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 16:11:49 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e56eb404-cb73-47ee-867f-ecaf6f23d4f6 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] [instance: 88330c21-69e0-4d82-ac4d-b9e5e849f487] Disconnected iSCSI Volume {{(pid=75337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 16:11:50 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:11:50 user nova-compute[75337]: DEBUG nova.objects.instance [None req-e56eb404-cb73-47ee-867f-ecaf6f23d4f6 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Lazy-loading 'flavor' on Instance uuid 88330c21-69e0-4d82-ac4d-b9e5e849f487 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 16:11:50 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-e56eb404-cb73-47ee-867f-ecaf6f23d4f6 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Lock "88330c21-69e0-4d82-ac4d-b9e5e849f487" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.164s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:11:51 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:11:56 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:12:01 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:12:01 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:12:01 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75337) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 16:12:01 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 16:12:01 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 16:12:01 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:12:06 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:12:11 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:12:11 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:12:11 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75337) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 16:12:11 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 16:12:11 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 16:12:11 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:12:16 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:12:17 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:12:18 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:12:20 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-27081c3f-2a6f-4181-8731-8578bb561ddd tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Acquiring lock "d6eaef86-b841-4142-9549-31954fb34fa2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:12:20 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-27081c3f-2a6f-4181-8731-8578bb561ddd tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Lock "d6eaef86-b841-4142-9549-31954fb34fa2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:12:20 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-27081c3f-2a6f-4181-8731-8578bb561ddd tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Acquiring lock "d6eaef86-b841-4142-9549-31954fb34fa2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:12:20 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-27081c3f-2a6f-4181-8731-8578bb561ddd tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Lock "d6eaef86-b841-4142-9549-31954fb34fa2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:12:20 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-27081c3f-2a6f-4181-8731-8578bb561ddd tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Lock "d6eaef86-b841-4142-9549-31954fb34fa2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:12:20 user nova-compute[75337]: INFO nova.compute.manager [None req-27081c3f-2a6f-4181-8731-8578bb561ddd tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: d6eaef86-b841-4142-9549-31954fb34fa2] Terminating instance
Nov 06 16:12:20 user nova-compute[75337]: DEBUG nova.compute.manager [None req-27081c3f-2a6f-4181-8731-8578bb561ddd tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: d6eaef86-b841-4142-9549-31954fb34fa2] Start destroying the instance on the hypervisor. {{(pid=75337) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 16:12:20 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:12:20 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:12:20 user nova-compute[75337]: DEBUG nova.compute.manager [req-f9d41f65-82f7-49fe-914f-5997b97ddcbd req-47fe4eea-2824-4b0f-bbcf-74a18179e332 service nova] [instance: d6eaef86-b841-4142-9549-31954fb34fa2] Received event network-vif-unplugged-99bb43c1-3b95-4be2-a534-845c37778773 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:12:20 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-f9d41f65-82f7-49fe-914f-5997b97ddcbd req-47fe4eea-2824-4b0f-bbcf-74a18179e332 service nova] Acquiring lock "d6eaef86-b841-4142-9549-31954fb34fa2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:12:20 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-f9d41f65-82f7-49fe-914f-5997b97ddcbd req-47fe4eea-2824-4b0f-bbcf-74a18179e332 service nova] Lock "d6eaef86-b841-4142-9549-31954fb34fa2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:12:20 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-f9d41f65-82f7-49fe-914f-5997b97ddcbd req-47fe4eea-2824-4b0f-bbcf-74a18179e332 service nova] Lock "d6eaef86-b841-4142-9549-31954fb34fa2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:12:20 user nova-compute[75337]: DEBUG nova.compute.manager [req-f9d41f65-82f7-49fe-914f-5997b97ddcbd req-47fe4eea-2824-4b0f-bbcf-74a18179e332 service nova] [instance: d6eaef86-b841-4142-9549-31954fb34fa2] No waiting events found dispatching network-vif-unplugged-99bb43c1-3b95-4be2-a534-845c37778773 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 16:12:20 user nova-compute[75337]: DEBUG nova.compute.manager [req-f9d41f65-82f7-49fe-914f-5997b97ddcbd req-47fe4eea-2824-4b0f-bbcf-74a18179e332 service nova] [instance: d6eaef86-b841-4142-9549-31954fb34fa2] Received event network-vif-unplugged-99bb43c1-3b95-4be2-a534-845c37778773 for instance with task_state deleting. {{(pid=75337) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 16:12:20 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:12:20 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:12:20 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:12:20 user nova-compute[75337]: INFO nova.virt.libvirt.driver [-] [instance: d6eaef86-b841-4142-9549-31954fb34fa2] Instance destroyed successfully.
Nov 06 16:12:20 user nova-compute[75337]: DEBUG nova.objects.instance [None req-27081c3f-2a6f-4181-8731-8578bb561ddd tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Lazy-loading 'resources' on Instance uuid d6eaef86-b841-4142-9549-31954fb34fa2 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 16:12:20 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-27081c3f-2a6f-4181-8731-8578bb561ddd tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T16:04:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-861327703',display_name='tempest-ServerActionsTestOtherA-server-861327703',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-861327703',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL4qUjCjjdVsflRB1h4DRug41qRThkRpbPytYUyz/XMQHNCLS4P/DapnKkRg0/Jn7/AhFFjdzCG9PxcwwVtb8q/utJpW4U9sbkxfbmmpOTPsJTE2NdIyui4Q27o5JkMUFA==',key_name='tempest-keypair-766127816',keypairs=<?>,launch_index=0,launched_at=2023-11-06T16:08:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='243647103fd44f629e0f40be0b56407e',ramdisk_id='',reservation_id='r-zax76e41',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-783619975',owner_user_name='tempest-ServerActionsTestOtherA-783619975-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T16:09:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2e47bf9ad49645deb2c1f834938fa39f',uuid=d6eaef86-b841-4142-9549-31954fb34fa2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "99bb43c1-3b95-4be2-a534-845c37778773", "address": "fa:16:3e:98:6e:e3", "network": {"id": "7f234ecf-bfa6-4316-9dce-c15050ba7914", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1378707892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "243647103fd44f629e0f40be0b56407e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99bb43c1-3b", "ovs_interfaceid": "99bb43c1-3b95-4be2-a534-845c37778773", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 16:12:20 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-27081c3f-2a6f-4181-8731-8578bb561ddd tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Converting VIF {"id": "99bb43c1-3b95-4be2-a534-845c37778773", "address": "fa:16:3e:98:6e:e3", "network": {"id": "7f234ecf-bfa6-4316-9dce-c15050ba7914", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1378707892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "243647103fd44f629e0f40be0b56407e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99bb43c1-3b", "ovs_interfaceid": "99bb43c1-3b95-4be2-a534-845c37778773", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 16:12:20 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-27081c3f-2a6f-4181-8731-8578bb561ddd tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:98:6e:e3,bridge_name='br-int',has_traffic_filtering=True,id=99bb43c1-3b95-4be2-a534-845c37778773,network=Network(7f234ecf-bfa6-4316-9dce-c15050ba7914),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99bb43c1-3b') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 16:12:20 user nova-compute[75337]: DEBUG os_vif [None req-27081c3f-2a6f-4181-8731-8578bb561ddd tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:98:6e:e3,bridge_name='br-int',has_traffic_filtering=True,id=99bb43c1-3b95-4be2-a534-845c37778773,network=Network(7f234ecf-bfa6-4316-9dce-c15050ba7914),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99bb43c1-3b') {{(pid=75337) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 16:12:20 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:12:20 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap99bb43c1-3b, bridge=br-int, if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 16:12:20 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:12:20 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:12:20 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:12:20 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a28d4fae-a488-491b-b617-7016c85ff67b) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 16:12:20 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:12:20 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:12:20 user nova-compute[75337]: INFO os_vif [None req-27081c3f-2a6f-4181-8731-8578bb561ddd tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:98:6e:e3,bridge_name='br-int',has_traffic_filtering=True,id=99bb43c1-3b95-4be2-a534-845c37778773,network=Network(7f234ecf-bfa6-4316-9dce-c15050ba7914),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99bb43c1-3b')
Nov 06 16:12:20 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27081c3f-2a6f-4181-8731-8578bb561ddd tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: d6eaef86-b841-4142-9549-31954fb34fa2] calling os-brick to detach iSCSI Volume {{(pid=75337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 16:12:20 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-27081c3f-2a6f-4181-8731-8578bb561ddd tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2abc33d0c0>, {'target_iqn': 'iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wZVTXPEQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 16:12:20 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-27081c3f-2a6f-4181-8731-8578bb561ddd tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 16:12:20 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-27081c3f-2a6f-4181-8731-8578bb561ddd tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 16:12:20 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-27081c3f-2a6f-4181-8731-8578bb561ddd tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 16:12:20 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:12:20 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:12:20 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba0f0e78-2f5d-46df-8c45-d7ba0209bd88]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:12:20 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-27081c3f-2a6f-4181-8731-8578bb561ddd tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 16:12:20 user nova-compute[75337]: No targets found.
Nov 06 16:12:20 user nova-compute[75337]: iSNS:
Nov 06 16:12:20 user nova-compute[75337]: No targets found.
Nov 06 16:12:20 user nova-compute[75337]: STATIC:
Nov 06 16:12:20 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139
Nov 06 16:12:20 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 16:12:20 user nova-compute[75337]:                 Iface Name: default
Nov 06 16:12:20 user nova-compute[75337]: FIRMWARE:
Nov 06 16:12:20 user nova-compute[75337]: No targets found.
Nov 06 16:12:20 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 16:12:20 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-27081c3f-2a6f-4181-8731-8578bb561ddd tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 16:12:20 user nova-compute[75337]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 16:12:20 user nova-compute[75337]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75337) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 16:12:20 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-27081c3f-2a6f-4181-8731-8578bb561ddd tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139', 0)] {{(pid=75337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 16:12:20 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:12:21 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:12:21 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e4fe042-7e86-4b84-a29f-9191e40692cb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:12:21 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:12:21 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:12:21 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[b44f9457-522e-402d-9767-dcb316d9a5ec]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139 (non-flash)\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:12:21 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-27081c3f-2a6f-4181-8731-8578bb561ddd tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139 (non-flash)
Nov 06 16:12:21 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 16:12:21 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-27081c3f-2a6f-4181-8731-8578bb561ddd tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139 (non-flash)
Nov 06 16:12:21 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 16:12:21 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-27081c3f-2a6f-4181-8731-8578bb561ddd tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2a9c25d870>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139'): ({'sdc'}, set())}) {{(pid=75337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 16:12:21 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-27081c3f-2a6f-4181-8731-8578bb561ddd tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Removing single pathed devices sdc {{(pid=75337) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 16:12:21 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:12:21 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:12:21 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebfd5314-6e7c-433c-af1c-8900aee91c4c]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:12:21 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:12:21 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:12:21 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eece210-3afa-41cc-8678-cfd479884525]: (4, ('ok\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:12:21 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-27081c3f-2a6f-4181-8731-8578bb561ddd tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Flushing IO for device /dev/sdc {{(pid=75337) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 16:12:21 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:12:21 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:12:21 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1d4c149-4015-4067-a4f5-8b19226291bb]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:12:21 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-27081c3f-2a6f-4181-8731-8578bb561ddd tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75337) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 16:12:21 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:12:21 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.053s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:12:21 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[e42c3227-fccc-4866-bbce-00324121d0b3]: (4, ('1', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:12:21 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-27081c3f-2a6f-4181-8731-8578bb561ddd tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 16:12:21 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-27081c3f-2a6f-4181-8731-8578bb561ddd tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] SCSI volumes sdc have been removed. {{(pid=75337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 16:12:21 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-27081c3f-2a6f-4181-8731-8578bb561ddd tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139')] {{(pid=75337) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 16:12:21 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:12:21 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:12:21 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[8407f145-47d4-420c-a9c4-d98e638fee34]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:12:21 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-27081c3f-2a6f-4181-8731-8578bb561ddd tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:12:21 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139 -p 172.16.0.220:3260 --logout {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:12:21 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:12:21 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbcf18b7-c1c3-4f8e-921b-8e7db04c68bb]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:12:21 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-27081c3f-2a6f-4181-8731-8578bb561ddd tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139, portal: 172.16.0.220,3260]
Nov 06 16:12:21 user nova-compute[75337]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139, portal: 172.16.0.220,3260] successful.
Nov 06 16:12:21 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:12:21 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139 -p 172.16.0.220:3260 --op delete {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:12:21 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58cdef33-eb5c-4ee9-a1b4-ee008e62a139 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:12:21 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a5e4d6a-1696-48c7-9e2b-19f8ca44860d]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:12:21 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-27081c3f-2a6f-4181-8731-8578bb561ddd tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:12:21 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-27081c3f-2a6f-4181-8731-8578bb561ddd tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 16:12:21 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-27081c3f-2a6f-4181-8731-8578bb561ddd tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] <== disconnect_volume: return (309ms) None {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 16:12:21 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27081c3f-2a6f-4181-8731-8578bb561ddd tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: d6eaef86-b841-4142-9549-31954fb34fa2] Disconnected iSCSI Volume {{(pid=75337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 16:12:21 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-27081c3f-2a6f-4181-8731-8578bb561ddd tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: d6eaef86-b841-4142-9549-31954fb34fa2] Deleting instance files /opt/stack/data/nova/instances/d6eaef86-b841-4142-9549-31954fb34fa2_del
Nov 06 16:12:21 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-27081c3f-2a6f-4181-8731-8578bb561ddd tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: d6eaef86-b841-4142-9549-31954fb34fa2] Deletion of /opt/stack/data/nova/instances/d6eaef86-b841-4142-9549-31954fb34fa2_del complete
Nov 06 16:12:21 user nova-compute[75337]: INFO nova.compute.manager [None req-27081c3f-2a6f-4181-8731-8578bb561ddd tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: d6eaef86-b841-4142-9549-31954fb34fa2] Took 1.18 seconds to destroy the instance on the hypervisor.
Nov 06 16:12:21 user nova-compute[75337]: DEBUG oslo.service.loopingcall [None req-27081c3f-2a6f-4181-8731-8578bb561ddd tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75337) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 16:12:21 user nova-compute[75337]: DEBUG nova.compute.manager [-] [instance: d6eaef86-b841-4142-9549-31954fb34fa2] Deallocating network for instance {{(pid=75337) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 16:12:21 user nova-compute[75337]: DEBUG nova.network.neutron [-] [instance: d6eaef86-b841-4142-9549-31954fb34fa2] deallocate_for_instance() {{(pid=75337) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 16:12:21 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:12:21 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:12:21 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75337) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 16:12:21 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-9de255e4-5ae9-4ca1-9b78-6349c3e92caa tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] Acquiring lock "3d8dc993-9fca-43b9-9058-801d7c497b1f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:12:21 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-9de255e4-5ae9-4ca1-9b78-6349c3e92caa tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] Lock "3d8dc993-9fca-43b9-9058-801d7c497b1f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:12:21 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-9de255e4-5ae9-4ca1-9b78-6349c3e92caa tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] Acquiring lock "3d8dc993-9fca-43b9-9058-801d7c497b1f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:12:21 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-9de255e4-5ae9-4ca1-9b78-6349c3e92caa tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] Lock "3d8dc993-9fca-43b9-9058-801d7c497b1f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:12:21 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-9de255e4-5ae9-4ca1-9b78-6349c3e92caa tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] Lock "3d8dc993-9fca-43b9-9058-801d7c497b1f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:12:21 user nova-compute[75337]: INFO nova.compute.manager [None req-9de255e4-5ae9-4ca1-9b78-6349c3e92caa tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] [instance: 3d8dc993-9fca-43b9-9058-801d7c497b1f] Terminating instance
Nov 06 16:12:21 user nova-compute[75337]: DEBUG nova.compute.manager [None req-9de255e4-5ae9-4ca1-9b78-6349c3e92caa tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] [instance: 3d8dc993-9fca-43b9-9058-801d7c497b1f] Start destroying the instance on the hypervisor. {{(pid=75337) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 16:12:21 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:12:22 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:12:22 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:12:22 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:12:22 user nova-compute[75337]: DEBUG nova.network.neutron [-] [instance: d6eaef86-b841-4142-9549-31954fb34fa2] Updating instance_info_cache with network_info: [] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 16:12:22 user nova-compute[75337]: INFO nova.compute.manager [-] [instance: d6eaef86-b841-4142-9549-31954fb34fa2] Took 0.92 seconds to deallocate network for instance.
Nov 06 16:12:22 user nova-compute[75337]: INFO nova.virt.libvirt.driver [-] [instance: 3d8dc993-9fca-43b9-9058-801d7c497b1f] Instance destroyed successfully.
Nov 06 16:12:22 user nova-compute[75337]: DEBUG nova.objects.instance [None req-9de255e4-5ae9-4ca1-9b78-6349c3e92caa tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] Lazy-loading 'resources' on Instance uuid 3d8dc993-9fca-43b9-9058-801d7c497b1f {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 16:12:22 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-9de255e4-5ae9-4ca1-9b78-6349c3e92caa tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T16:10:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1583587787',display_name='tempest-VolumesActionsTest-instance-1583587787',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1583587787',id=48,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-06T16:10:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='888a739f27694bd5a56badca064a56b4',ramdisk_id='',reservation_id='r-lmncmkaj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1546215062',owner_user_name='tempest-VolumesActionsTest-1546215062-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T16:10:37Z,user_data=None,user_id='4e0147898e9b4af9aaaa3379f431303e',uuid=3d8dc993-9fca-43b9-9058-801d7c497b1f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6931c93f-1b41-44f7-9acd-4bc3b834080f", "address": "fa:16:3e:c3:64:2a", "network": {"id": "6b7d7f72-e0a2-49a1-a1d8-927c62316dd2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-716305394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "888a739f27694bd5a56badca064a56b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6931c93f-1b", "ovs_interfaceid": "6931c93f-1b41-44f7-9acd-4bc3b834080f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 16:12:22 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-9de255e4-5ae9-4ca1-9b78-6349c3e92caa tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] Converting VIF {"id": "6931c93f-1b41-44f7-9acd-4bc3b834080f", "address": "fa:16:3e:c3:64:2a", "network": {"id": "6b7d7f72-e0a2-49a1-a1d8-927c62316dd2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-716305394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "888a739f27694bd5a56badca064a56b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6931c93f-1b", "ovs_interfaceid": "6931c93f-1b41-44f7-9acd-4bc3b834080f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 16:12:22 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-9de255e4-5ae9-4ca1-9b78-6349c3e92caa tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:64:2a,bridge_name='br-int',has_traffic_filtering=True,id=6931c93f-1b41-44f7-9acd-4bc3b834080f,network=Network(6b7d7f72-e0a2-49a1-a1d8-927c62316dd2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6931c93f-1b') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 16:12:22 user nova-compute[75337]: DEBUG os_vif [None req-9de255e4-5ae9-4ca1-9b78-6349c3e92caa tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:64:2a,bridge_name='br-int',has_traffic_filtering=True,id=6931c93f-1b41-44f7-9acd-4bc3b834080f,network=Network(6b7d7f72-e0a2-49a1-a1d8-927c62316dd2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6931c93f-1b') {{(pid=75337) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 16:12:22 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:12:22 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6931c93f-1b, bridge=br-int, if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 16:12:22 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:12:22 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:12:22 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:12:22 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=484a6cca-2ae7-4cd7-8313-397a8d2d60e3) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 16:12:22 user nova-compute[75337]: DEBUG nova.compute.manager [req-6aaeacd5-45cb-435b-97c9-6681ea278f93 req-3c4351d6-f3e9-466a-8996-60536cff683a service nova] [instance: d6eaef86-b841-4142-9549-31954fb34fa2] Received event network-vif-plugged-99bb43c1-3b95-4be2-a534-845c37778773 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:12:22 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-6aaeacd5-45cb-435b-97c9-6681ea278f93 req-3c4351d6-f3e9-466a-8996-60536cff683a service nova] Acquiring lock "d6eaef86-b841-4142-9549-31954fb34fa2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:12:22 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-6aaeacd5-45cb-435b-97c9-6681ea278f93 req-3c4351d6-f3e9-466a-8996-60536cff683a service nova] Lock "d6eaef86-b841-4142-9549-31954fb34fa2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:12:22 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-6aaeacd5-45cb-435b-97c9-6681ea278f93 req-3c4351d6-f3e9-466a-8996-60536cff683a service nova] Lock "d6eaef86-b841-4142-9549-31954fb34fa2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:12:22 user nova-compute[75337]: DEBUG nova.compute.manager [req-6aaeacd5-45cb-435b-97c9-6681ea278f93 req-3c4351d6-f3e9-466a-8996-60536cff683a service nova] [instance: d6eaef86-b841-4142-9549-31954fb34fa2] No waiting events found dispatching network-vif-plugged-99bb43c1-3b95-4be2-a534-845c37778773 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 16:12:22 user nova-compute[75337]: WARNING nova.compute.manager [req-6aaeacd5-45cb-435b-97c9-6681ea278f93 req-3c4351d6-f3e9-466a-8996-60536cff683a service nova] [instance: d6eaef86-b841-4142-9549-31954fb34fa2] Received unexpected event network-vif-plugged-99bb43c1-3b95-4be2-a534-845c37778773 for instance with vm_state active and task_state deleting.
Nov 06 16:12:22 user nova-compute[75337]: DEBUG nova.compute.manager [req-6aaeacd5-45cb-435b-97c9-6681ea278f93 req-3c4351d6-f3e9-466a-8996-60536cff683a service nova] [instance: d6eaef86-b841-4142-9549-31954fb34fa2] Received event network-vif-deleted-99bb43c1-3b95-4be2-a534-845c37778773 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:12:22 user nova-compute[75337]: DEBUG nova.compute.manager [req-6aaeacd5-45cb-435b-97c9-6681ea278f93 req-3c4351d6-f3e9-466a-8996-60536cff683a service nova] [instance: 3d8dc993-9fca-43b9-9058-801d7c497b1f] Received event network-vif-unplugged-6931c93f-1b41-44f7-9acd-4bc3b834080f {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:12:22 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-6aaeacd5-45cb-435b-97c9-6681ea278f93 req-3c4351d6-f3e9-466a-8996-60536cff683a service nova] Acquiring lock "3d8dc993-9fca-43b9-9058-801d7c497b1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:12:22 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-6aaeacd5-45cb-435b-97c9-6681ea278f93 req-3c4351d6-f3e9-466a-8996-60536cff683a service nova] Lock "3d8dc993-9fca-43b9-9058-801d7c497b1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:12:22 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-6aaeacd5-45cb-435b-97c9-6681ea278f93 req-3c4351d6-f3e9-466a-8996-60536cff683a service nova] Lock "3d8dc993-9fca-43b9-9058-801d7c497b1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:12:22 user nova-compute[75337]: DEBUG nova.compute.manager [req-6aaeacd5-45cb-435b-97c9-6681ea278f93 req-3c4351d6-f3e9-466a-8996-60536cff683a service nova] [instance: 3d8dc993-9fca-43b9-9058-801d7c497b1f] No waiting events found dispatching network-vif-unplugged-6931c93f-1b41-44f7-9acd-4bc3b834080f {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 16:12:22 user nova-compute[75337]: DEBUG nova.compute.manager [req-6aaeacd5-45cb-435b-97c9-6681ea278f93 req-3c4351d6-f3e9-466a-8996-60536cff683a service nova] [instance: 3d8dc993-9fca-43b9-9058-801d7c497b1f] Received event network-vif-unplugged-6931c93f-1b41-44f7-9acd-4bc3b834080f for instance with task_state deleting. {{(pid=75337) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 16:12:22 user nova-compute[75337]: DEBUG nova.compute.manager [req-6aaeacd5-45cb-435b-97c9-6681ea278f93 req-3c4351d6-f3e9-466a-8996-60536cff683a service nova] [instance: 3d8dc993-9fca-43b9-9058-801d7c497b1f] Received event network-vif-plugged-6931c93f-1b41-44f7-9acd-4bc3b834080f {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:12:22 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-6aaeacd5-45cb-435b-97c9-6681ea278f93 req-3c4351d6-f3e9-466a-8996-60536cff683a service nova] Acquiring lock "3d8dc993-9fca-43b9-9058-801d7c497b1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:12:22 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-6aaeacd5-45cb-435b-97c9-6681ea278f93 req-3c4351d6-f3e9-466a-8996-60536cff683a service nova] Lock "3d8dc993-9fca-43b9-9058-801d7c497b1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:12:22 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-6aaeacd5-45cb-435b-97c9-6681ea278f93 req-3c4351d6-f3e9-466a-8996-60536cff683a service nova] Lock "3d8dc993-9fca-43b9-9058-801d7c497b1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:12:22 user nova-compute[75337]: DEBUG nova.compute.manager [req-6aaeacd5-45cb-435b-97c9-6681ea278f93 req-3c4351d6-f3e9-466a-8996-60536cff683a service nova] [instance: 3d8dc993-9fca-43b9-9058-801d7c497b1f] No waiting events found dispatching network-vif-plugged-6931c93f-1b41-44f7-9acd-4bc3b834080f {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 16:12:22 user nova-compute[75337]: WARNING nova.compute.manager [req-6aaeacd5-45cb-435b-97c9-6681ea278f93 req-3c4351d6-f3e9-466a-8996-60536cff683a service nova] [instance: 3d8dc993-9fca-43b9-9058-801d7c497b1f] Received unexpected event network-vif-plugged-6931c93f-1b41-44f7-9acd-4bc3b834080f for instance with vm_state active and task_state deleting.
Nov 06 16:12:22 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:12:22 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:12:22 user nova-compute[75337]: INFO os_vif [None req-9de255e4-5ae9-4ca1-9b78-6349c3e92caa tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:64:2a,bridge_name='br-int',has_traffic_filtering=True,id=6931c93f-1b41-44f7-9acd-4bc3b834080f,network=Network(6b7d7f72-e0a2-49a1-a1d8-927c62316dd2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6931c93f-1b')
Nov 06 16:12:22 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-9de255e4-5ae9-4ca1-9b78-6349c3e92caa tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] [instance: 3d8dc993-9fca-43b9-9058-801d7c497b1f] Deleting instance files /opt/stack/data/nova/instances/3d8dc993-9fca-43b9-9058-801d7c497b1f_del
Nov 06 16:12:22 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-9de255e4-5ae9-4ca1-9b78-6349c3e92caa tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] [instance: 3d8dc993-9fca-43b9-9058-801d7c497b1f] Deletion of /opt/stack/data/nova/instances/3d8dc993-9fca-43b9-9058-801d7c497b1f_del complete
Nov 06 16:12:22 user nova-compute[75337]: INFO nova.compute.manager [None req-9de255e4-5ae9-4ca1-9b78-6349c3e92caa tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] [instance: 3d8dc993-9fca-43b9-9058-801d7c497b1f] Took 0.73 seconds to destroy the instance on the hypervisor.
Nov 06 16:12:22 user nova-compute[75337]: DEBUG oslo.service.loopingcall [None req-9de255e4-5ae9-4ca1-9b78-6349c3e92caa tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75337) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 16:12:22 user nova-compute[75337]: DEBUG nova.compute.manager [-] [instance: 3d8dc993-9fca-43b9-9058-801d7c497b1f] Deallocating network for instance {{(pid=75337) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 16:12:22 user nova-compute[75337]: DEBUG nova.network.neutron [-] [instance: 3d8dc993-9fca-43b9-9058-801d7c497b1f] deallocate_for_instance() {{(pid=75337) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 16:12:23 user nova-compute[75337]: DEBUG nova.network.neutron [-] [instance: 3d8dc993-9fca-43b9-9058-801d7c497b1f] Updating instance_info_cache with network_info: [] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 16:12:23 user nova-compute[75337]: INFO nova.compute.manager [-] [instance: 3d8dc993-9fca-43b9-9058-801d7c497b1f] Took 0.51 seconds to deallocate network for instance.
Nov 06 16:12:23 user nova-compute[75337]: INFO nova.compute.manager [None req-27081c3f-2a6f-4181-8731-8578bb561ddd tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: d6eaef86-b841-4142-9549-31954fb34fa2] Took 0.92 seconds to detach 1 volumes for instance.
Nov 06 16:12:23 user nova-compute[75337]: DEBUG nova.compute.manager [None req-27081c3f-2a6f-4181-8731-8578bb561ddd tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: d6eaef86-b841-4142-9549-31954fb34fa2] Deleting volume: 58cdef33-eb5c-4ee9-a1b4-ee008e62a139 {{(pid=75337) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 06 16:12:23 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-9de255e4-5ae9-4ca1-9b78-6349c3e92caa tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:12:23 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-9de255e4-5ae9-4ca1-9b78-6349c3e92caa tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:12:23 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-27081c3f-2a6f-4181-8731-8578bb561ddd tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:12:23 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-9de255e4-5ae9-4ca1-9b78-6349c3e92caa tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 16:12:23 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-9de255e4-5ae9-4ca1-9b78-6349c3e92caa tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 16:12:23 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-9de255e4-5ae9-4ca1-9b78-6349c3e92caa tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.190s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:12:23 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-27081c3f-2a6f-4181-8731-8578bb561ddd tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.096s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:12:23 user nova-compute[75337]: INFO nova.scheduler.client.report [None req-9de255e4-5ae9-4ca1-9b78-6349c3e92caa tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] Deleted allocations for instance 3d8dc993-9fca-43b9-9058-801d7c497b1f
Nov 06 16:12:23 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-27081c3f-2a6f-4181-8731-8578bb561ddd tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 16:12:23 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:12:23 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-9de255e4-5ae9-4ca1-9b78-6349c3e92caa tempest-VolumesActionsTest-1546215062 tempest-VolumesActionsTest-1546215062-project-member] Lock "3d8dc993-9fca-43b9-9058-801d7c497b1f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.648s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:12:23 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-27081c3f-2a6f-4181-8731-8578bb561ddd tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 16:12:23 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-27081c3f-2a6f-4181-8731-8578bb561ddd tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.186s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:12:23 user nova-compute[75337]: INFO nova.scheduler.client.report [None req-27081c3f-2a6f-4181-8731-8578bb561ddd tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Deleted allocations for instance d6eaef86-b841-4142-9549-31954fb34fa2
Nov 06 16:12:23 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-27081c3f-2a6f-4181-8731-8578bb561ddd tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Lock "d6eaef86-b841-4142-9549-31954fb34fa2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.564s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:12:24 user nova-compute[75337]: DEBUG nova.compute.manager [req-798a719f-86bb-41c8-9e7b-84ad28a6df66 req-2e1e1d5e-c34e-4217-95e9-9c122c76457e service nova] [instance: 3d8dc993-9fca-43b9-9058-801d7c497b1f] Received event network-vif-deleted-6931c93f-1b41-44f7-9acd-4bc3b834080f {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:12:24 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-8e225941-653a-4bed-8c87-5149f1435dd0 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Acquiring lock "88330c21-69e0-4d82-ac4d-b9e5e849f487" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:12:24 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-8e225941-653a-4bed-8c87-5149f1435dd0 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Lock "88330c21-69e0-4d82-ac4d-b9e5e849f487" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:12:24 user nova-compute[75337]: DEBUG nova.objects.instance [None req-8e225941-653a-4bed-8c87-5149f1435dd0 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Lazy-loading 'flavor' on Instance uuid 88330c21-69e0-4d82-ac4d-b9e5e849f487 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 16:12:24 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-8e225941-653a-4bed-8c87-5149f1435dd0 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Lock "88330c21-69e0-4d82-ac4d-b9e5e849f487" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:12:24 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-8e225941-653a-4bed-8c87-5149f1435dd0 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Acquiring lock "88330c21-69e0-4d82-ac4d-b9e5e849f487" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:12:24 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-8e225941-653a-4bed-8c87-5149f1435dd0 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Lock "88330c21-69e0-4d82-ac4d-b9e5e849f487" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:12:24 user nova-compute[75337]: INFO nova.compute.manager [None req-8e225941-653a-4bed-8c87-5149f1435dd0 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] [instance: 88330c21-69e0-4d82-ac4d-b9e5e849f487] Attaching volume 04077f0a-c1e0-4221-8c86-707aabe64820 to /dev/vdb
Nov 06 16:12:24 user nova-compute[75337]: DEBUG os_brick.utils [None req-8e225941-653a-4bed-8c87-5149f1435dd0 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 16:12:24 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:12:24 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:12:24 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea8261c2-70ba-4a78-a30a-f5f0e6e21510]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4ff6411e45b8\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:12:24 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:12:24 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:12:24 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1a5c82a-164e-4b46-b447-ce30349aff02]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:12:24 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:12:24 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:12:24 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f8d61cd-d5fe-45fe-a4df-aed0e360aecd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:12:24 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[01aa8a14-556f-4d3d-8d94-aaef26ece8ec]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:12:24 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-8e225941-653a-4bed-8c87-5149f1435dd0 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Running cmd (subprocess): nvme version {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:12:24 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-8e225941-653a-4bed-8c87-5149f1435dd0 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] 'nvme version' failed. Not Retrying. {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 16:12:24 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8e225941-653a-4bed-8c87-5149f1435dd0 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] nvme not present on system {{(pid=75337) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 16:12:24 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:12:24 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 16:12:24 user nova-compute[75337]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 16:12:24 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceb325ea-b943-485e-b61b-8b972a39a6bb]: (4, '') {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:12:24 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.lightos [None req-8e225941-653a-4bed-8c87-5149f1435dd0 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75337) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 16:12:24 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.lightos [None req-8e225941-653a-4bed-8c87-5149f1435dd0 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 16:12:24 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.lightos [None req-8e225941-653a-4bed-8c87-5149f1435dd0 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] LIGHTOS: no hostnqn found. {{(pid=75337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 16:12:24 user nova-compute[75337]: DEBUG os_brick.utils [None req-8e225941-653a-4bed-8c87-5149f1435dd0 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4ff6411e45b8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 16:12:24 user nova-compute[75337]: DEBUG nova.virt.block_device [None req-8e225941-653a-4bed-8c87-5149f1435dd0 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] [instance: 88330c21-69e0-4d82-ac4d-b9e5e849f487] Updating existing volume attachment record: 92f6dc6c-dcf7-4a1e-abec-69fc738fbee0 {{(pid=75337) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 16:12:25 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:12:25 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:12:27 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:12:27 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:12:30 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:12:30 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:12:30 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Starting heal instance info cache {{(pid=75337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 16:12:30 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "refresh_cache-88330c21-69e0-4d82-ac4d-b9e5e849f487" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 16:12:30 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquired lock "refresh_cache-88330c21-69e0-4d82-ac4d-b9e5e849f487" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 16:12:30 user nova-compute[75337]: DEBUG nova.network.neutron [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] [instance: 88330c21-69e0-4d82-ac4d-b9e5e849f487] Forcefully refreshing network info cache for instance {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 16:12:31 user nova-compute[75337]: DEBUG nova.network.neutron [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] [instance: 88330c21-69e0-4d82-ac4d-b9e5e849f487] Updating instance_info_cache with network_info: [{"id": "4ae4cf27-266c-40f8-a268-1d03f150f318", "address": "fa:16:3e:d4:3f:d4", "network": {"id": "40ec2d9f-fe05-45bb-8321-e065c7c5cab0", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-863555405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b8417f9bf0f4ccbbcb9823c8825a3d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ae4cf27-26", "ovs_interfaceid": "4ae4cf27-266c-40f8-a268-1d03f150f318", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 16:12:31 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Releasing lock "refresh_cache-88330c21-69e0-4d82-ac4d-b9e5e849f487" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 16:12:31 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] [instance: 88330c21-69e0-4d82-ac4d-b9e5e849f487] Updated the network info_cache for instance {{(pid=75337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 16:12:32 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:12:32 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager.update_available_resource {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:12:32 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:12:32 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:12:32 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:12:32 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Auditing locally available compute resources for user (node: user) {{(pid=75337) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 16:12:32 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88330c21-69e0-4d82-ac4d-b9e5e849f487/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:12:32 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88330c21-69e0-4d82-ac4d-b9e5e849f487/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:12:32 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88330c21-69e0-4d82-ac4d-b9e5e849f487/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:12:33 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88330c21-69e0-4d82-ac4d-b9e5e849f487/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:12:33 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6110b34a-6fd3-45fc-911d-4e5d3c7f2d78/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:12:33 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6110b34a-6fd3-45fc-911d-4e5d3c7f2d78/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:12:33 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6110b34a-6fd3-45fc-911d-4e5d3c7f2d78/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:12:33 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6110b34a-6fd3-45fc-911d-4e5d3c7f2d78/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:12:33 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 16:12:33 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 16:12:33 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Hypervisor/Node resource view: name=user free_ram=8653MB free_disk=25.020381927490234GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75337) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 16:12:33 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:12:33 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:12:33 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 6110b34a-6fd3-45fc-911d-4e5d3c7f2d78 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 16:12:33 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 88330c21-69e0-4d82-ac4d-b9e5e849f487 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 16:12:33 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 16:12:33 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 16:12:34 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 16:12:34 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 16:12:34 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Compute_service record updated for user:user {{(pid=75337) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 16:12:34 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.219s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:12:35 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:12:37 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:12:42 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:12:46 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e225941-653a-4bed-8c87-5149f1435dd0 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] [instance: 88330c21-69e0-4d82-ac4d-b9e5e849f487] Calling os-brick to attach iSCSI Volume {{(pid=75337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 16:12:46 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e225941-653a-4bed-8c87-5149f1435dd0 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2abc33d0c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:04077f0a-c1e0-4221-8c86-707aabe64820', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YreGBSZk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 16:12:46 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-8e225941-653a-4bed-8c87-5149f1435dd0 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 16:12:46 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-8e225941-653a-4bed-8c87-5149f1435dd0 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 16:12:46 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-8e225941-653a-4bed-8c87-5149f1435dd0 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 16:12:46 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-8e225941-653a-4bed-8c87-5149f1435dd0 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 16:12:46 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-8e225941-653a-4bed-8c87-5149f1435dd0 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:04077f0a-c1e0-4221-8c86-707aabe64820" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 16:12:46 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-8e225941-653a-4bed-8c87-5149f1435dd0 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:04077f0a-c1e0-4221-8c86-707aabe64820" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 16:12:46 user nova-compute[75337]: INFO os_brick.initiator.connectors.iscsi [None req-8e225941-653a-4bed-8c87-5149f1435dd0 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 16:12:46 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04077f0a-c1e0-4221-8c86-707aabe64820 -p 172.16.0.220:3260 {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:12:46 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04077f0a-c1e0-4221-8c86-707aabe64820 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:12:46 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[c470b10a-d11f-4ec7-adb6-c4cbb500f6c7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:12:46 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e225941-653a-4bed-8c87-5149f1435dd0 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 16:12:46 user nova-compute[75337]:  {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:12:46 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04077f0a-c1e0-4221-8c86-707aabe64820 -p 172.16.0.220:3260 --interface default --op new {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:12:46 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04077f0a-c1e0-4221-8c86-707aabe64820 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:12:46 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d7444ad-f612-4c1b-b4c0-47747f84462a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:04077f0a-c1e0-4221-8c86-707aabe64820] added\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:12:46 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e225941-653a-4bed-8c87-5149f1435dd0 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:04077f0a-c1e0-4221-8c86-707aabe64820] added
Nov 06 16:12:46 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:12:46 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04077f0a-c1e0-4221-8c86-707aabe64820 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:12:46 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04077f0a-c1e0-4221-8c86-707aabe64820 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:12:46 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cb46bba-afc7-4430-b63a-b8631e9bc329]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:12:46 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e225941-653a-4bed-8c87-5149f1435dd0 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:12:46 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04077f0a-c1e0-4221-8c86-707aabe64820 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:12:46 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04077f0a-c1e0-4221-8c86-707aabe64820 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:12:46 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[448fecec-d3cc-4275-9d5b-851a4b74a902]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:12:46 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e225941-653a-4bed-8c87-5149f1435dd0 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:12:46 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04077f0a-c1e0-4221-8c86-707aabe64820 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YreGBSZk {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:12:46 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04077f0a-c1e0-4221-8c86-707aabe64820 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YreGBSZk" returned: 0 in 0.017s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:12:46 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dd84e7a-7be9-49ad-b9ed-8ef675b1a5d0]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:12:46 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e225941-653a-4bed-8c87-5149f1435dd0 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YreGBSZk'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:12:46 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04077f0a-c1e0-4221-8c86-707aabe64820 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:12:46 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04077f0a-c1e0-4221-8c86-707aabe64820 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:12:46 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b1614ae-26a1-4273-bb88-796343b456b1]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:12:46 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e225941-653a-4bed-8c87-5149f1435dd0 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:12:46 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:12:46 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:12:46 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c17f256-d33e-4a54-a4f0-36aee1cfee87]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:12:46 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e225941-653a-4bed-8c87-5149f1435dd0 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 06 16:12:46 user nova-compute[75337]:  {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 16:12:46 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e225941-653a-4bed-8c87-5149f1435dd0 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 06 16:12:46 user nova-compute[75337]:  {{(pid=75337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 16:12:46 user nova-compute[75337]: WARNING os_brick.initiator.connectors.iscsi [None req-8e225941-653a-4bed-8c87-5149f1435dd0 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 06 16:12:46 user nova-compute[75337]: 
Nov 06 16:12:46 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04077f0a-c1e0-4221-8c86-707aabe64820 -p 172.16.0.220:3260 --login {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:12:46 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04077f0a-c1e0-4221-8c86-707aabe64820 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:12:46 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6a307e5-0ca3-4e8f-9473-0a19ae61afe4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:04077f0a-c1e0-4221-8c86-707aabe64820, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:04077f0a-c1e0-4221-8c86-707aabe64820, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:12:46 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e225941-653a-4bed-8c87-5149f1435dd0 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:04077f0a-c1e0-4221-8c86-707aabe64820, portal: 172.16.0.220,3260]
Nov 06 16:12:46 user nova-compute[75337]: Login to [iface: default, target: iqn.2010-10.org.openstack:04077f0a-c1e0-4221-8c86-707aabe64820, portal: 172.16.0.220,3260] successful.
Nov 06 16:12:46 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:12:46 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04077f0a-c1e0-4221-8c86-707aabe64820 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:12:46 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04077f0a-c1e0-4221-8c86-707aabe64820 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:12:46 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[a98d4174-0514-49cc-bd96-9611cbbc91c6]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:12:46 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e225941-653a-4bed-8c87-5149f1435dd0 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:12:46 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:12:46 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:12:46 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae171078-84db-4aec-bd01-b6379827138a]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04077f0a-c1e0-4221-8c86-707aabe64820 (non-flash)\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:12:46 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e225941-653a-4bed-8c87-5149f1435dd0 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04077f0a-c1e0-4221-8c86-707aabe64820 (non-flash)
Nov 06 16:12:46 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 16:12:46 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e225941-653a-4bed-8c87-5149f1435dd0 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04077f0a-c1e0-4221-8c86-707aabe64820 (non-flash)
Nov 06 16:12:46 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 16:12:46 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-8e225941-653a-4bed-8c87-5149f1435dd0 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:04077f0a-c1e0-4221-8c86-707aabe64820" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.256s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 16:12:46 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e225941-653a-4bed-8c87-5149f1435dd0 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Connected to 172.16.0.220:3260 {{(pid=75337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 16:12:46 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-8e225941-653a-4bed-8c87-5149f1435dd0 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] HCTL ('33', '-', '-', 0) found on session 55 with lun 0 {{(pid=75337) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 16:12:46 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-8e225941-653a-4bed-8c87-5149f1435dd0 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75337) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 16:12:46 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:12:46 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:12:46 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e91f612-84be-401e-b94e-dc791de69ee8]: (4, ('- - 0', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:12:46 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-8e225941-653a-4bed-8c87-5149f1435dd0 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Searching for a device in session 55 and hctl ['33', '*', '*', 0] yield: None {{(pid=75337) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 16:12:47 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:12:47 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-8e225941-653a-4bed-8c87-5149f1435dd0 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Searching for a device in session 55 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75337) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 16:12:47 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e225941-653a-4bed-8c87-5149f1435dd0 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:04077f0a-c1e0-4221-8c86-707aabe64820', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YreGBSZk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 16:12:47 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-8e225941-653a-4bed-8c87-5149f1435dd0 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.288s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 16:12:47 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e225941-653a-4bed-8c87-5149f1435dd0 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] <== connect_volume: return (1290ms) {'type': 'block', 'scsi_wwn': '23431633337333866', 'path': '/dev/sdb'} {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 16:12:47 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e225941-653a-4bed-8c87-5149f1435dd0 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] [instance: 88330c21-69e0-4d82-ac4d-b9e5e849f487] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23431633337333866', 'path': '/dev/sdb'} {{(pid=75337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 16:12:47 user nova-compute[75337]: DEBUG nova.objects.instance [None req-8e225941-653a-4bed-8c87-5149f1435dd0 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Lazy-loading 'flavor' on Instance uuid 88330c21-69e0-4d82-ac4d-b9e5e849f487 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 16:12:47 user nova-compute[75337]: DEBUG nova.virt.libvirt.guest [None req-8e225941-653a-4bed-8c87-5149f1435dd0 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] attach device xml: <disk type="block" device="disk">
Nov 06 16:12:47 user nova-compute[75337]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 16:12:47 user nova-compute[75337]:   <source dev="/dev/sdb"/>
Nov 06 16:12:47 user nova-compute[75337]:   <target dev="vdb" bus="virtio"/>
Nov 06 16:12:47 user nova-compute[75337]:   <serial>04077f0a-c1e0-4221-8c86-707aabe64820</serial>
Nov 06 16:12:47 user nova-compute[75337]: </disk>
Nov 06 16:12:47 user nova-compute[75337]:  {{(pid=75337) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 06 16:12:48 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-8e225941-653a-4bed-8c87-5149f1435dd0 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] No BDM found with device name vda, not building metadata. {{(pid=75337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 16:12:48 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-8e225941-653a-4bed-8c87-5149f1435dd0 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 16:12:48 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-8e225941-653a-4bed-8c87-5149f1435dd0 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] No VIF found with MAC fa:16:3e:d4:3f:d4, not building metadata {{(pid=75337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 16:12:48 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-8e225941-653a-4bed-8c87-5149f1435dd0 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Lock "88330c21-69e0-4d82-ac4d-b9e5e849f487" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 23.490s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:12:50 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:12:50 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-b408690b-3fa3-41ec-9e99-e5666f5332bf tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Acquiring lock "88330c21-69e0-4d82-ac4d-b9e5e849f487" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:12:50 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-b408690b-3fa3-41ec-9e99-e5666f5332bf tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Lock "88330c21-69e0-4d82-ac4d-b9e5e849f487" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:12:50 user nova-compute[75337]: INFO nova.compute.manager [None req-b408690b-3fa3-41ec-9e99-e5666f5332bf tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] [instance: 88330c21-69e0-4d82-ac4d-b9e5e849f487] Detaching volume 04077f0a-c1e0-4221-8c86-707aabe64820
Nov 06 16:12:50 user nova-compute[75337]: INFO nova.virt.block_device [None req-b408690b-3fa3-41ec-9e99-e5666f5332bf tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] [instance: 88330c21-69e0-4d82-ac4d-b9e5e849f487] Attempting to driver detach volume 04077f0a-c1e0-4221-8c86-707aabe64820 from mountpoint /dev/vdb
Nov 06 16:12:50 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-b408690b-3fa3-41ec-9e99-e5666f5332bf tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Attempting to detach device vdb from instance 88330c21-69e0-4d82-ac4d-b9e5e849f487 from the persistent domain config. {{(pid=75337) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 06 16:12:50 user nova-compute[75337]: DEBUG nova.virt.libvirt.guest [None req-b408690b-3fa3-41ec-9e99-e5666f5332bf tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 16:12:50 user nova-compute[75337]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 16:12:50 user nova-compute[75337]:   <source dev="/dev/sdb"/>
Nov 06 16:12:50 user nova-compute[75337]:   <target dev="vdb" bus="virtio"/>
Nov 06 16:12:50 user nova-compute[75337]:   <serial>04077f0a-c1e0-4221-8c86-707aabe64820</serial>
Nov 06 16:12:50 user nova-compute[75337]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 06 16:12:50 user nova-compute[75337]: </disk>
Nov 06 16:12:50 user nova-compute[75337]:  {{(pid=75337) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 16:12:50 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-b408690b-3fa3-41ec-9e99-e5666f5332bf tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Successfully detached device vdb from instance 88330c21-69e0-4d82-ac4d-b9e5e849f487 from the persistent domain config.
Nov 06 16:12:50 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-b408690b-3fa3-41ec-9e99-e5666f5332bf tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 88330c21-69e0-4d82-ac4d-b9e5e849f487 from the live domain config. {{(pid=75337) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 06 16:12:50 user nova-compute[75337]: DEBUG nova.virt.libvirt.guest [None req-b408690b-3fa3-41ec-9e99-e5666f5332bf tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 16:12:50 user nova-compute[75337]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 16:12:50 user nova-compute[75337]:   <source dev="/dev/sdb"/>
Nov 06 16:12:50 user nova-compute[75337]:   <target dev="vdb" bus="virtio"/>
Nov 06 16:12:50 user nova-compute[75337]:   <serial>04077f0a-c1e0-4221-8c86-707aabe64820</serial>
Nov 06 16:12:50 user nova-compute[75337]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 06 16:12:50 user nova-compute[75337]: </disk>
Nov 06 16:12:50 user nova-compute[75337]:  {{(pid=75337) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 16:12:50 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-b408690b-3fa3-41ec-9e99-e5666f5332bf tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 88330c21-69e0-4d82-ac4d-b9e5e849f487 {{(pid=75337) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 06 16:12:52 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:12:55 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:12:57 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:13:02 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:13:07 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:13:10 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-b408690b-3fa3-41ec-9e99-e5666f5332bf tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 88330c21-69e0-4d82-ac4d-b9e5e849f487 is timed out.
Nov 06 16:13:10 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-b408690b-3fa3-41ec-9e99-e5666f5332bf tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Successfully detached device vdb from instance 88330c21-69e0-4d82-ac4d-b9e5e849f487 from the live domain config.
Nov 06 16:13:10 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b408690b-3fa3-41ec-9e99-e5666f5332bf tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] [instance: 88330c21-69e0-4d82-ac4d-b9e5e849f487] calling os-brick to detach iSCSI Volume {{(pid=75337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 16:13:10 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b408690b-3fa3-41ec-9e99-e5666f5332bf tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2abc33d0c0>, {'target_iqn': 'iqn.2010-10.org.openstack:04077f0a-c1e0-4221-8c86-707aabe64820', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YreGBSZk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 16:13:10 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-b408690b-3fa3-41ec-9e99-e5666f5332bf tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 16:13:10 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-b408690b-3fa3-41ec-9e99-e5666f5332bf tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 16:13:10 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-b408690b-3fa3-41ec-9e99-e5666f5332bf tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 16:13:10 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:13:10 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:13:10 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[705b4712-1fe2-4363-9023-efcc2f513420]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:04077f0a-c1e0-4221-8c86-707aabe64820\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:13:10 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b408690b-3fa3-41ec-9e99-e5666f5332bf tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 16:13:10 user nova-compute[75337]: No targets found.
Nov 06 16:13:10 user nova-compute[75337]: iSNS:
Nov 06 16:13:10 user nova-compute[75337]: No targets found.
Nov 06 16:13:10 user nova-compute[75337]: STATIC:
Nov 06 16:13:10 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:04077f0a-c1e0-4221-8c86-707aabe64820
Nov 06 16:13:10 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 16:13:10 user nova-compute[75337]:                 Iface Name: default
Nov 06 16:13:10 user nova-compute[75337]: FIRMWARE:
Nov 06 16:13:10 user nova-compute[75337]: No targets found.
Nov 06 16:13:10 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 16:13:10 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b408690b-3fa3-41ec-9e99-e5666f5332bf tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 16:13:10 user nova-compute[75337]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 16:13:10 user nova-compute[75337]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75337) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 16:13:10 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b408690b-3fa3-41ec-9e99-e5666f5332bf tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:04077f0a-c1e0-4221-8c86-707aabe64820', 0)] {{(pid=75337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 16:13:10 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:13:10 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:13:10 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[51bb4f19-e7c2-451d-bc90-9261adbc9edc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04077f0a-c1e0-4221-8c86-707aabe64820\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:13:10 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:13:10 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:13:10 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2a8a4f9-38b4-4945-93e8-44799eedc01b]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04077f0a-c1e0-4221-8c86-707aabe64820 (non-flash)\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:13:10 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b408690b-3fa3-41ec-9e99-e5666f5332bf tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04077f0a-c1e0-4221-8c86-707aabe64820 (non-flash)
Nov 06 16:13:10 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 16:13:10 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b408690b-3fa3-41ec-9e99-e5666f5332bf tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04077f0a-c1e0-4221-8c86-707aabe64820 (non-flash)
Nov 06 16:13:10 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 16:13:10 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b408690b-3fa3-41ec-9e99-e5666f5332bf tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2a9c3cba30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:04077f0a-c1e0-4221-8c86-707aabe64820'): ({'sdb'}, set())}) {{(pid=75337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 16:13:10 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-b408690b-3fa3-41ec-9e99-e5666f5332bf tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Removing single pathed devices sdb {{(pid=75337) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 16:13:10 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:13:10 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:13:10 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[be2eba35-e141-4db1-91f6-cfb66df40f73]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:13:10 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:13:10 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.025s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:13:10 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c9c132f-fb48-419a-a9a2-0c3831874d93]: (4, ('ok\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:13:10 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-b408690b-3fa3-41ec-9e99-e5666f5332bf tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Flushing IO for device /dev/sdb {{(pid=75337) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 16:13:10 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:13:11 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:13:11 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[85685742-5972-4fd0-a44b-fcbaff19a567]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:13:11 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-b408690b-3fa3-41ec-9e99-e5666f5332bf tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75337) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 16:13:11 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:13:11 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.056s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:13:11 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b0118e7-658d-4b85-98ac-f6929484c0a0]: (4, ('1', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:13:11 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-b408690b-3fa3-41ec-9e99-e5666f5332bf tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 16:13:11 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-b408690b-3fa3-41ec-9e99-e5666f5332bf tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] SCSI volumes sdb have been removed. {{(pid=75337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 16:13:11 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b408690b-3fa3-41ec-9e99-e5666f5332bf tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:04077f0a-c1e0-4221-8c86-707aabe64820')] {{(pid=75337) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 16:13:11 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04077f0a-c1e0-4221-8c86-707aabe64820 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:13:11 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04077f0a-c1e0-4221-8c86-707aabe64820 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:13:11 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e923747-0c88-4885-afd4-223538ed0589]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:13:11 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b408690b-3fa3-41ec-9e99-e5666f5332bf tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:13:11 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04077f0a-c1e0-4221-8c86-707aabe64820 -p 172.16.0.220:3260 --logout {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:13:11 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04077f0a-c1e0-4221-8c86-707aabe64820 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:13:11 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b4be1e0-5128-4d3f-979b-5bb6a49df769]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:04077f0a-c1e0-4221-8c86-707aabe64820, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:04077f0a-c1e0-4221-8c86-707aabe64820, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:13:11 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b408690b-3fa3-41ec-9e99-e5666f5332bf tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:04077f0a-c1e0-4221-8c86-707aabe64820, portal: 172.16.0.220,3260]
Nov 06 16:13:11 user nova-compute[75337]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:04077f0a-c1e0-4221-8c86-707aabe64820, portal: 172.16.0.220,3260] successful.
Nov 06 16:13:11 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:13:11 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04077f0a-c1e0-4221-8c86-707aabe64820 -p 172.16.0.220:3260 --op delete {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:13:11 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04077f0a-c1e0-4221-8c86-707aabe64820 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:13:11 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[08394956-4554-494e-a4b9-e22d68e9b218]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:13:11 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b408690b-3fa3-41ec-9e99-e5666f5332bf tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:13:11 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-b408690b-3fa3-41ec-9e99-e5666f5332bf tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.327s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 16:13:11 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b408690b-3fa3-41ec-9e99-e5666f5332bf tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] <== disconnect_volume: return (328ms) None {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 16:13:11 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b408690b-3fa3-41ec-9e99-e5666f5332bf tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] [instance: 88330c21-69e0-4d82-ac4d-b9e5e849f487] Disconnected iSCSI Volume {{(pid=75337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 16:13:11 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-b7a44922-d229-485e-85f1-1b80e31ba555 tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Acquiring lock "15922f4f-f921-4245-8d3d-98ed47de946b" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:13:11 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-b7a44922-d229-485e-85f1-1b80e31ba555 tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Lock "15922f4f-f921-4245-8d3d-98ed47de946b" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:13:11 user nova-compute[75337]: INFO nova.compute.manager [None req-b7a44922-d229-485e-85f1-1b80e31ba555 tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] [instance: 15922f4f-f921-4245-8d3d-98ed47de946b] Unshelving
Nov 06 16:13:11 user nova-compute[75337]: INFO nova.virt.block_device [None req-b7a44922-d229-485e-85f1-1b80e31ba555 tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] [instance: 15922f4f-f921-4245-8d3d-98ed47de946b] Booting with volume 06b3b613-3c1e-4420-a500-1ec3988c0940 at /dev/vda
Nov 06 16:13:11 user nova-compute[75337]: DEBUG os_brick.utils [None req-b7a44922-d229-485e-85f1-1b80e31ba555 tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 16:13:11 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:13:11 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:13:11 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[a196508e-4605-4fd9-8872-8d43f8df49dd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4ff6411e45b8\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:13:11 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:13:11 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:13:11 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[876bf78d-cbb3-4a43-9b56-443e4b51ea51]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:13:11 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:13:11 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:13:11 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[7395a179-fa24-47ea-a97c-563cd5ec5232]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:13:11 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[73332c83-a9e1-41d0-b17d-f937ae8a621f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:13:11 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-b7a44922-d229-485e-85f1-1b80e31ba555 tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Running cmd (subprocess): nvme version {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:13:11 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-b7a44922-d229-485e-85f1-1b80e31ba555 tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] 'nvme version' failed. Not Retrying. {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 16:13:11 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b7a44922-d229-485e-85f1-1b80e31ba555 tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] nvme not present on system {{(pid=75337) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 16:13:11 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:13:11 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 16:13:11 user nova-compute[75337]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 16:13:11 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c2d49ef-c229-4251-924a-c1b415dcc01f]: (4, '') {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:13:11 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.lightos [None req-b7a44922-d229-485e-85f1-1b80e31ba555 tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75337) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 16:13:11 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.lightos [None req-b7a44922-d229-485e-85f1-1b80e31ba555 tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 16:13:11 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.lightos [None req-b7a44922-d229-485e-85f1-1b80e31ba555 tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] LIGHTOS: no hostnqn found. {{(pid=75337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 16:13:11 user nova-compute[75337]: DEBUG os_brick.utils [None req-b7a44922-d229-485e-85f1-1b80e31ba555 tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4ff6411e45b8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 16:13:11 user nova-compute[75337]: DEBUG nova.virt.block_device [None req-b7a44922-d229-485e-85f1-1b80e31ba555 tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] [instance: 15922f4f-f921-4245-8d3d-98ed47de946b] Updating existing volume attachment record: 45757d3e-6a99-420e-8a8f-eb72f6ae128a {{(pid=75337) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 16:13:12 user nova-compute[75337]: DEBUG nova.objects.instance [None req-b408690b-3fa3-41ec-9e99-e5666f5332bf tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Lazy-loading 'flavor' on Instance uuid 88330c21-69e0-4d82-ac4d-b9e5e849f487 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 16:13:12 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-b408690b-3fa3-41ec-9e99-e5666f5332bf tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Lock "88330c21-69e0-4d82-ac4d-b9e5e849f487" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.866s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:13:12 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:13:17 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:13:17 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:13:20 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:13:21 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:13:21 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75337) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 16:13:22 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-e3f061ee-eae0-4749-9c69-f8c6c363d60f tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Acquiring lock "6110b34a-6fd3-45fc-911d-4e5d3c7f2d78" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:13:22 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-e3f061ee-eae0-4749-9c69-f8c6c363d60f tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Lock "6110b34a-6fd3-45fc-911d-4e5d3c7f2d78" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:13:22 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-e3f061ee-eae0-4749-9c69-f8c6c363d60f tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Acquiring lock "6110b34a-6fd3-45fc-911d-4e5d3c7f2d78-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:13:22 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-e3f061ee-eae0-4749-9c69-f8c6c363d60f tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Lock "6110b34a-6fd3-45fc-911d-4e5d3c7f2d78-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:13:22 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-e3f061ee-eae0-4749-9c69-f8c6c363d60f tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Lock "6110b34a-6fd3-45fc-911d-4e5d3c7f2d78-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:13:22 user nova-compute[75337]: INFO nova.compute.manager [None req-e3f061ee-eae0-4749-9c69-f8c6c363d60f tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: 6110b34a-6fd3-45fc-911d-4e5d3c7f2d78] Terminating instance
Nov 06 16:13:22 user nova-compute[75337]: DEBUG nova.compute.manager [None req-e3f061ee-eae0-4749-9c69-f8c6c363d60f tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: 6110b34a-6fd3-45fc-911d-4e5d3c7f2d78] Start destroying the instance on the hypervisor. {{(pid=75337) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 16:13:22 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:13:22 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:13:22 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:13:22 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:13:22 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:13:22 user nova-compute[75337]: DEBUG nova.compute.manager [req-51caca73-e30a-4e75-be03-25ddd8d70b6f req-1965ab95-65b0-4535-acf5-4ce7f5c44b36 service nova] [instance: 6110b34a-6fd3-45fc-911d-4e5d3c7f2d78] Received event network-vif-unplugged-fa3c6657-452e-4a95-b9c8-c59002be4e31 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:13:22 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-51caca73-e30a-4e75-be03-25ddd8d70b6f req-1965ab95-65b0-4535-acf5-4ce7f5c44b36 service nova] Acquiring lock "6110b34a-6fd3-45fc-911d-4e5d3c7f2d78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:13:22 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-51caca73-e30a-4e75-be03-25ddd8d70b6f req-1965ab95-65b0-4535-acf5-4ce7f5c44b36 service nova] Lock "6110b34a-6fd3-45fc-911d-4e5d3c7f2d78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:13:22 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-51caca73-e30a-4e75-be03-25ddd8d70b6f req-1965ab95-65b0-4535-acf5-4ce7f5c44b36 service nova] Lock "6110b34a-6fd3-45fc-911d-4e5d3c7f2d78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:13:22 user nova-compute[75337]: DEBUG nova.compute.manager [req-51caca73-e30a-4e75-be03-25ddd8d70b6f req-1965ab95-65b0-4535-acf5-4ce7f5c44b36 service nova] [instance: 6110b34a-6fd3-45fc-911d-4e5d3c7f2d78] No waiting events found dispatching network-vif-unplugged-fa3c6657-452e-4a95-b9c8-c59002be4e31 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 16:13:22 user nova-compute[75337]: DEBUG nova.compute.manager [req-51caca73-e30a-4e75-be03-25ddd8d70b6f req-1965ab95-65b0-4535-acf5-4ce7f5c44b36 service nova] [instance: 6110b34a-6fd3-45fc-911d-4e5d3c7f2d78] Received event network-vif-unplugged-fa3c6657-452e-4a95-b9c8-c59002be4e31 for instance with task_state deleting. {{(pid=75337) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 16:13:22 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:13:22 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:13:23 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:13:23 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:13:23 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:13:23 user nova-compute[75337]: INFO nova.virt.libvirt.driver [-] [instance: 6110b34a-6fd3-45fc-911d-4e5d3c7f2d78] Instance destroyed successfully.
Nov 06 16:13:23 user nova-compute[75337]: DEBUG nova.objects.instance [None req-e3f061ee-eae0-4749-9c69-f8c6c363d60f tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Lazy-loading 'resources' on Instance uuid 6110b34a-6fd3-45fc-911d-4e5d3c7f2d78 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 16:13:23 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:13:23 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-e3f061ee-eae0-4749-9c69-f8c6c363d60f tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T15:52:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-578840654',display_name='tempest-ServerActionsTestOtherA-server-578840654',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-578840654',id=28,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL4qUjCjjdVsflRB1h4DRug41qRThkRpbPytYUyz/XMQHNCLS4P/DapnKkRg0/Jn7/AhFFjdzCG9PxcwwVtb8q/utJpW4U9sbkxfbmmpOTPsJTE2NdIyui4Q27o5JkMUFA==',key_name='tempest-keypair-766127816',keypairs=<?>,launch_index=0,launched_at=2023-11-06T15:52:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='243647103fd44f629e0f40be0b56407e',ramdisk_id='',reservation_id='r-ctbkz4ay',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-783619975',owner_user_name='tempest-ServerActionsTestOtherA-783619975-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T15:52:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2e47bf9ad49645deb2c1f834938fa39f',uuid=6110b34a-6fd3-45fc-911d-4e5d3c7f2d78,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fa3c6657-452e-4a95-b9c8-c59002be4e31", "address": "fa:16:3e:18:69:52", "network": {"id": "7f234ecf-bfa6-4316-9dce-c15050ba7914", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1378707892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "243647103fd44f629e0f40be0b56407e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa3c6657-45", "ovs_interfaceid": "fa3c6657-452e-4a95-b9c8-c59002be4e31", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 16:13:23 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-e3f061ee-eae0-4749-9c69-f8c6c363d60f tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Converting VIF {"id": "fa3c6657-452e-4a95-b9c8-c59002be4e31", "address": "fa:16:3e:18:69:52", "network": {"id": "7f234ecf-bfa6-4316-9dce-c15050ba7914", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1378707892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "243647103fd44f629e0f40be0b56407e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa3c6657-45", "ovs_interfaceid": "fa3c6657-452e-4a95-b9c8-c59002be4e31", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 16:13:23 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-e3f061ee-eae0-4749-9c69-f8c6c363d60f tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:18:69:52,bridge_name='br-int',has_traffic_filtering=True,id=fa3c6657-452e-4a95-b9c8-c59002be4e31,network=Network(7f234ecf-bfa6-4316-9dce-c15050ba7914),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa3c6657-45') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 16:13:23 user nova-compute[75337]: DEBUG os_vif [None req-e3f061ee-eae0-4749-9c69-f8c6c363d60f tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:18:69:52,bridge_name='br-int',has_traffic_filtering=True,id=fa3c6657-452e-4a95-b9c8-c59002be4e31,network=Network(7f234ecf-bfa6-4316-9dce-c15050ba7914),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa3c6657-45') {{(pid=75337) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 16:13:23 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:13:23 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfa3c6657-45, bridge=br-int, if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 16:13:23 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:13:23 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:13:23 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:13:23 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=dcc630a3-0330-4781-a630-5e9781f87a8c) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 16:13:23 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:13:23 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:13:23 user nova-compute[75337]: INFO os_vif [None req-e3f061ee-eae0-4749-9c69-f8c6c363d60f tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:18:69:52,bridge_name='br-int',has_traffic_filtering=True,id=fa3c6657-452e-4a95-b9c8-c59002be4e31,network=Network(7f234ecf-bfa6-4316-9dce-c15050ba7914),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa3c6657-45')
Nov 06 16:13:23 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-e3f061ee-eae0-4749-9c69-f8c6c363d60f tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: 6110b34a-6fd3-45fc-911d-4e5d3c7f2d78] Deleting instance files /opt/stack/data/nova/instances/6110b34a-6fd3-45fc-911d-4e5d3c7f2d78_del
Nov 06 16:13:23 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-e3f061ee-eae0-4749-9c69-f8c6c363d60f tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: 6110b34a-6fd3-45fc-911d-4e5d3c7f2d78] Deletion of /opt/stack/data/nova/instances/6110b34a-6fd3-45fc-911d-4e5d3c7f2d78_del complete
Nov 06 16:13:23 user nova-compute[75337]: INFO nova.compute.manager [None req-e3f061ee-eae0-4749-9c69-f8c6c363d60f tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] [instance: 6110b34a-6fd3-45fc-911d-4e5d3c7f2d78] Took 0.67 seconds to destroy the instance on the hypervisor.
Nov 06 16:13:23 user nova-compute[75337]: DEBUG oslo.service.loopingcall [None req-e3f061ee-eae0-4749-9c69-f8c6c363d60f tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75337) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 16:13:23 user nova-compute[75337]: DEBUG nova.compute.manager [-] [instance: 6110b34a-6fd3-45fc-911d-4e5d3c7f2d78] Deallocating network for instance {{(pid=75337) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 16:13:23 user nova-compute[75337]: DEBUG nova.network.neutron [-] [instance: 6110b34a-6fd3-45fc-911d-4e5d3c7f2d78] deallocate_for_instance() {{(pid=75337) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 16:13:23 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:13:23 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:13:23 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:13:23 user nova-compute[75337]: DEBUG nova.network.neutron [-] [instance: 6110b34a-6fd3-45fc-911d-4e5d3c7f2d78] Updating instance_info_cache with network_info: [] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 16:13:23 user nova-compute[75337]: INFO nova.compute.manager [-] [instance: 6110b34a-6fd3-45fc-911d-4e5d3c7f2d78] Took 0.55 seconds to deallocate network for instance.
Nov 06 16:13:23 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:13:23 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:13:23 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-e3f061ee-eae0-4749-9c69-f8c6c363d60f tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:13:23 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-e3f061ee-eae0-4749-9c69-f8c6c363d60f tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:13:23 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-e3f061ee-eae0-4749-9c69-f8c6c363d60f tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 16:13:23 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-e3f061ee-eae0-4749-9c69-f8c6c363d60f tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 16:13:23 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-e3f061ee-eae0-4749-9c69-f8c6c363d60f tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.180s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:13:24 user nova-compute[75337]: INFO nova.scheduler.client.report [None req-e3f061ee-eae0-4749-9c69-f8c6c363d60f tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Deleted allocations for instance 6110b34a-6fd3-45fc-911d-4e5d3c7f2d78
Nov 06 16:13:24 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-e3f061ee-eae0-4749-9c69-f8c6c363d60f tempest-ServerActionsTestOtherA-783619975 tempest-ServerActionsTestOtherA-783619975-project-member] Lock "6110b34a-6fd3-45fc-911d-4e5d3c7f2d78" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.602s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:13:24 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:13:24 user nova-compute[75337]: DEBUG nova.compute.manager [req-f73296da-fddb-4f5a-a6b8-e796a4f34bfe req-7ccaf03a-1a53-4493-8ed9-f6bce1f7ba6c service nova] [instance: 6110b34a-6fd3-45fc-911d-4e5d3c7f2d78] Received event network-vif-plugged-fa3c6657-452e-4a95-b9c8-c59002be4e31 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:13:24 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-f73296da-fddb-4f5a-a6b8-e796a4f34bfe req-7ccaf03a-1a53-4493-8ed9-f6bce1f7ba6c service nova] Acquiring lock "6110b34a-6fd3-45fc-911d-4e5d3c7f2d78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:13:24 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-f73296da-fddb-4f5a-a6b8-e796a4f34bfe req-7ccaf03a-1a53-4493-8ed9-f6bce1f7ba6c service nova] Lock "6110b34a-6fd3-45fc-911d-4e5d3c7f2d78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:13:24 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-f73296da-fddb-4f5a-a6b8-e796a4f34bfe req-7ccaf03a-1a53-4493-8ed9-f6bce1f7ba6c service nova] Lock "6110b34a-6fd3-45fc-911d-4e5d3c7f2d78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:13:24 user nova-compute[75337]: DEBUG nova.compute.manager [req-f73296da-fddb-4f5a-a6b8-e796a4f34bfe req-7ccaf03a-1a53-4493-8ed9-f6bce1f7ba6c service nova] [instance: 6110b34a-6fd3-45fc-911d-4e5d3c7f2d78] No waiting events found dispatching network-vif-plugged-fa3c6657-452e-4a95-b9c8-c59002be4e31 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 16:13:24 user nova-compute[75337]: WARNING nova.compute.manager [req-f73296da-fddb-4f5a-a6b8-e796a4f34bfe req-7ccaf03a-1a53-4493-8ed9-f6bce1f7ba6c service nova] [instance: 6110b34a-6fd3-45fc-911d-4e5d3c7f2d78] Received unexpected event network-vif-plugged-fa3c6657-452e-4a95-b9c8-c59002be4e31 for instance with vm_state deleted and task_state None.
Nov 06 16:13:24 user nova-compute[75337]: DEBUG nova.compute.manager [req-f73296da-fddb-4f5a-a6b8-e796a4f34bfe req-7ccaf03a-1a53-4493-8ed9-f6bce1f7ba6c service nova] [instance: 6110b34a-6fd3-45fc-911d-4e5d3c7f2d78] Received event network-vif-deleted-fa3c6657-452e-4a95-b9c8-c59002be4e31 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:13:27 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:13:28 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:13:28 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:13:32 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:13:32 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Starting heal instance info cache {{(pid=75337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 16:13:32 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] [instance: 15922f4f-f921-4245-8d3d-98ed47de946b] Skipping network cache update for instance because it has been migrated to another host. {{(pid=75337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9966}}
Nov 06 16:13:32 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Didn't find any instances for network info cache update. {{(pid=75337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 06 16:13:33 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:13:34 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager.update_available_resource {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:13:34 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:13:34 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:13:34 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:13:34 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Auditing locally available compute resources for user (node: user) {{(pid=75337) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 16:13:34 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88330c21-69e0-4d82-ac4d-b9e5e849f487/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:13:34 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88330c21-69e0-4d82-ac4d-b9e5e849f487/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:13:34 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88330c21-69e0-4d82-ac4d-b9e5e849f487/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:13:35 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88330c21-69e0-4d82-ac4d-b9e5e849f487/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:13:35 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 16:13:35 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 16:13:35 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Hypervisor/Node resource view: name=user free_ram=8715MB free_disk=25.045608520507812GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75337) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 16:13:35 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:13:35 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:13:35 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 88330c21-69e0-4d82-ac4d-b9e5e849f487 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 16:13:35 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 15922f4f-f921-4245-8d3d-98ed47de946b has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 06 16:13:35 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 16:13:35 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 16:13:35 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 16:13:35 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 16:13:35 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Compute_service record updated for user:user {{(pid=75337) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 16:13:35 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.369s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:13:38 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:13:43 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:13:45 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:13:45 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:13:45 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:13:45 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:13:45 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:13:45 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:13:45 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:13:45 user nova-compute[75337]: DEBUG nova.virt.libvirt.imagecache [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Verify base images {{(pid=75337) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Nov 06 16:13:45 user nova-compute[75337]: DEBUG nova.virt.libvirt.imagecache [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Image id 16b903ae-a40f-41a7-985b-4804cce92c62 yields fingerprint 06ba3c914798499e686c5ac75886932347225275 {{(pid=75337) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 06 16:13:45 user nova-compute[75337]: INFO nova.virt.libvirt.imagecache [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] image 16b903ae-a40f-41a7-985b-4804cce92c62 at (/opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275): checking
Nov 06 16:13:45 user nova-compute[75337]: DEBUG nova.virt.libvirt.imagecache [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] image 16b903ae-a40f-41a7-985b-4804cce92c62 at (/opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275): image is in use {{(pid=75337) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Nov 06 16:13:45 user nova-compute[75337]: DEBUG nova.virt.libvirt.imagecache [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=75337) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 06 16:13:45 user nova-compute[75337]: DEBUG nova.virt.libvirt.imagecache [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] 88330c21-69e0-4d82-ac4d-b9e5e849f487 is a valid instance name {{(pid=75337) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 06 16:13:45 user nova-compute[75337]: DEBUG nova.virt.libvirt.imagecache [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] 88330c21-69e0-4d82-ac4d-b9e5e849f487 has a disk file {{(pid=75337) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 06 16:13:45 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88330c21-69e0-4d82-ac4d-b9e5e849f487/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:13:45 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88330c21-69e0-4d82-ac4d-b9e5e849f487/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:13:45 user nova-compute[75337]: DEBUG nova.virt.libvirt.imagecache [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 88330c21-69e0-4d82-ac4d-b9e5e849f487 is backed by 06ba3c914798499e686c5ac75886932347225275 {{(pid=75337) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 06 16:13:45 user nova-compute[75337]: WARNING nova.virt.libvirt.imagecache [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Unknown base file: /opt/stack/data/nova/instances/_base/6445952603fe665f75c52025b807ae6a15716542
Nov 06 16:13:45 user nova-compute[75337]: WARNING nova.virt.libvirt.imagecache [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Unknown base file: /opt/stack/data/nova/instances/_base/c7338109fcb7f9221b864c97256563d718cc56c1
Nov 06 16:13:45 user nova-compute[75337]: WARNING nova.virt.libvirt.imagecache [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Unknown base file: /opt/stack/data/nova/instances/_base/380623bf17d3cffe94ad1c10fb9e5fd681de8626
Nov 06 16:13:45 user nova-compute[75337]: WARNING nova.virt.libvirt.imagecache [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Unknown base file: /opt/stack/data/nova/instances/_base/de3199ff811058900b61738c0e14021565ee14a4
Nov 06 16:13:45 user nova-compute[75337]: WARNING nova.virt.libvirt.imagecache [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Unknown base file: /opt/stack/data/nova/instances/_base/640cdf25fe58c72118b9874ee05aa950de4ad567
Nov 06 16:13:45 user nova-compute[75337]: WARNING nova.virt.libvirt.imagecache [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Unknown base file: /opt/stack/data/nova/instances/_base/886e49c215980bb477bbfd15105c79194e5c3c8a
Nov 06 16:13:45 user nova-compute[75337]: WARNING nova.virt.libvirt.imagecache [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Unknown base file: /opt/stack/data/nova/instances/_base/4dae0f202bb0e6089d0cc3207935c36081a98611
Nov 06 16:13:45 user nova-compute[75337]: WARNING nova.virt.libvirt.imagecache [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Unknown base file: /opt/stack/data/nova/instances/_base/f52330de9506d9910cc3b4a9f6bd1a285101ae16
Nov 06 16:13:45 user nova-compute[75337]: INFO nova.virt.libvirt.imagecache [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Active base files: /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275
Nov 06 16:13:45 user nova-compute[75337]: INFO nova.virt.libvirt.imagecache [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Removable base files: /opt/stack/data/nova/instances/_base/6445952603fe665f75c52025b807ae6a15716542 /opt/stack/data/nova/instances/_base/c7338109fcb7f9221b864c97256563d718cc56c1 /opt/stack/data/nova/instances/_base/380623bf17d3cffe94ad1c10fb9e5fd681de8626 /opt/stack/data/nova/instances/_base/de3199ff811058900b61738c0e14021565ee14a4 /opt/stack/data/nova/instances/_base/640cdf25fe58c72118b9874ee05aa950de4ad567 /opt/stack/data/nova/instances/_base/886e49c215980bb477bbfd15105c79194e5c3c8a /opt/stack/data/nova/instances/_base/4dae0f202bb0e6089d0cc3207935c36081a98611 /opt/stack/data/nova/instances/_base/f52330de9506d9910cc3b4a9f6bd1a285101ae16
Nov 06 16:13:45 user nova-compute[75337]: INFO nova.virt.libvirt.imagecache [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/6445952603fe665f75c52025b807ae6a15716542
Nov 06 16:13:45 user nova-compute[75337]: INFO nova.virt.libvirt.imagecache [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/c7338109fcb7f9221b864c97256563d718cc56c1
Nov 06 16:13:45 user nova-compute[75337]: INFO nova.virt.libvirt.imagecache [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/380623bf17d3cffe94ad1c10fb9e5fd681de8626
Nov 06 16:13:45 user nova-compute[75337]: INFO nova.virt.libvirt.imagecache [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/de3199ff811058900b61738c0e14021565ee14a4
Nov 06 16:13:45 user nova-compute[75337]: INFO nova.virt.libvirt.imagecache [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/640cdf25fe58c72118b9874ee05aa950de4ad567
Nov 06 16:13:45 user nova-compute[75337]: INFO nova.virt.libvirt.imagecache [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/886e49c215980bb477bbfd15105c79194e5c3c8a
Nov 06 16:13:45 user nova-compute[75337]: INFO nova.virt.libvirt.imagecache [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/4dae0f202bb0e6089d0cc3207935c36081a98611
Nov 06 16:13:45 user nova-compute[75337]: INFO nova.virt.libvirt.imagecache [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/f52330de9506d9910cc3b4a9f6bd1a285101ae16
Nov 06 16:13:45 user nova-compute[75337]: DEBUG nova.virt.libvirt.imagecache [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Verification complete {{(pid=75337) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Nov 06 16:13:45 user nova-compute[75337]: DEBUG nova.virt.libvirt.imagecache [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Verify swap images {{(pid=75337) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Nov 06 16:13:45 user nova-compute[75337]: DEBUG nova.virt.libvirt.imagecache [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Verify ephemeral images {{(pid=75337) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Nov 06 16:13:47 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-b640fe9a-7b20-415e-aaa5-08a7c75007c9 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Acquiring lock "88330c21-69e0-4d82-ac4d-b9e5e849f487" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:13:47 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-b640fe9a-7b20-415e-aaa5-08a7c75007c9 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Lock "88330c21-69e0-4d82-ac4d-b9e5e849f487" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:13:47 user nova-compute[75337]: DEBUG nova.objects.instance [None req-b640fe9a-7b20-415e-aaa5-08a7c75007c9 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Lazy-loading 'flavor' on Instance uuid 88330c21-69e0-4d82-ac4d-b9e5e849f487 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 16:13:47 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-b640fe9a-7b20-415e-aaa5-08a7c75007c9 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Lock "88330c21-69e0-4d82-ac4d-b9e5e849f487" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.073s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:13:47 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-b640fe9a-7b20-415e-aaa5-08a7c75007c9 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Acquiring lock "88330c21-69e0-4d82-ac4d-b9e5e849f487" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:13:47 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-b640fe9a-7b20-415e-aaa5-08a7c75007c9 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Lock "88330c21-69e0-4d82-ac4d-b9e5e849f487" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:13:47 user nova-compute[75337]: INFO nova.compute.manager [None req-b640fe9a-7b20-415e-aaa5-08a7c75007c9 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] [instance: 88330c21-69e0-4d82-ac4d-b9e5e849f487] Attaching volume 831ff3d4-9d1e-465b-a878-2688b7c38078 to /dev/vdb
Nov 06 16:13:47 user nova-compute[75337]: DEBUG os_brick.utils [None req-b640fe9a-7b20-415e-aaa5-08a7c75007c9 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 16:13:47 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:13:47 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:13:47 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1f55193-3040-4e60-b9ad-07237fbd3a26]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4ff6411e45b8\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:13:47 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:13:47 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:13:47 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1954793-79c9-47e4-b2d5-70ff147852e3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:13:47 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:13:47 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:13:47 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[f95ffb85-c2e3-41c3-9ee9-62bb5f240271]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:13:47 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[1310e574-a8a7-47d5-a856-6c47c55fc43f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:13:47 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-b640fe9a-7b20-415e-aaa5-08a7c75007c9 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Running cmd (subprocess): nvme version {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:13:47 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-b640fe9a-7b20-415e-aaa5-08a7c75007c9 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] 'nvme version' failed. Not Retrying. {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 16:13:47 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b640fe9a-7b20-415e-aaa5-08a7c75007c9 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] nvme not present on system {{(pid=75337) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 16:13:47 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:13:47 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 16:13:47 user nova-compute[75337]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 16:13:47 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b4ca9e5-cf20-4eda-b916-2381c62ce85d]: (4, '') {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:13:47 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.lightos [None req-b640fe9a-7b20-415e-aaa5-08a7c75007c9 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75337) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 16:13:47 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.lightos [None req-b640fe9a-7b20-415e-aaa5-08a7c75007c9 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 16:13:47 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.lightos [None req-b640fe9a-7b20-415e-aaa5-08a7c75007c9 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] LIGHTOS: no hostnqn found. {{(pid=75337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 16:13:47 user nova-compute[75337]: DEBUG os_brick.utils [None req-b640fe9a-7b20-415e-aaa5-08a7c75007c9 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4ff6411e45b8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 16:13:47 user nova-compute[75337]: DEBUG nova.virt.block_device [None req-b640fe9a-7b20-415e-aaa5-08a7c75007c9 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] [instance: 88330c21-69e0-4d82-ac4d-b9e5e849f487] Updating existing volume attachment record: 4127b0ec-e4bd-498e-a32b-59b0fa65d6b1 {{(pid=75337) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 16:13:48 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:13:48 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-b7a44922-d229-485e-85f1-1b80e31ba555 tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:13:48 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-b7a44922-d229-485e-85f1-1b80e31ba555 tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:13:48 user nova-compute[75337]: DEBUG nova.objects.instance [None req-b7a44922-d229-485e-85f1-1b80e31ba555 tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Lazy-loading 'pci_requests' on Instance uuid 15922f4f-f921-4245-8d3d-98ed47de946b {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 16:13:48 user nova-compute[75337]: DEBUG nova.objects.instance [None req-b7a44922-d229-485e-85f1-1b80e31ba555 tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Lazy-loading 'numa_topology' on Instance uuid 15922f4f-f921-4245-8d3d-98ed47de946b {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 16:13:48 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-b7a44922-d229-485e-85f1-1b80e31ba555 tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75337) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 16:13:48 user nova-compute[75337]: INFO nova.compute.claims [None req-b7a44922-d229-485e-85f1-1b80e31ba555 tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] [instance: 15922f4f-f921-4245-8d3d-98ed47de946b] Claim successful on node user
Nov 06 16:13:48 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-b7a44922-d229-485e-85f1-1b80e31ba555 tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 16:13:48 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-b7a44922-d229-485e-85f1-1b80e31ba555 tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 16:13:48 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-b7a44922-d229-485e-85f1-1b80e31ba555 tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.342s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:13:48 user nova-compute[75337]: INFO nova.network.neutron [None req-b7a44922-d229-485e-85f1-1b80e31ba555 tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] [instance: 15922f4f-f921-4245-8d3d-98ed47de946b] Updating port 75853df2-1f1a-4a4f-be80-b29cd2452bd2 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 06 16:13:49 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-b7a44922-d229-485e-85f1-1b80e31ba555 tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Acquiring lock "refresh_cache-15922f4f-f921-4245-8d3d-98ed47de946b" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 16:13:49 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-b7a44922-d229-485e-85f1-1b80e31ba555 tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Acquired lock "refresh_cache-15922f4f-f921-4245-8d3d-98ed47de946b" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 16:13:49 user nova-compute[75337]: DEBUG nova.network.neutron [None req-b7a44922-d229-485e-85f1-1b80e31ba555 tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] [instance: 15922f4f-f921-4245-8d3d-98ed47de946b] Building network info cache for instance {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 16:13:50 user nova-compute[75337]: DEBUG nova.compute.manager [req-863a307e-c5a2-44eb-888b-0975235d750d req-44ef4a0f-ed57-4fb9-bd2b-4542d7138712 service nova] [instance: 15922f4f-f921-4245-8d3d-98ed47de946b] Received event network-changed-75853df2-1f1a-4a4f-be80-b29cd2452bd2 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:13:50 user nova-compute[75337]: DEBUG nova.compute.manager [req-863a307e-c5a2-44eb-888b-0975235d750d req-44ef4a0f-ed57-4fb9-bd2b-4542d7138712 service nova] [instance: 15922f4f-f921-4245-8d3d-98ed47de946b] Refreshing instance network info cache due to event network-changed-75853df2-1f1a-4a4f-be80-b29cd2452bd2. {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 16:13:50 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-863a307e-c5a2-44eb-888b-0975235d750d req-44ef4a0f-ed57-4fb9-bd2b-4542d7138712 service nova] Acquiring lock "refresh_cache-15922f4f-f921-4245-8d3d-98ed47de946b" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 16:13:50 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:13:50 user nova-compute[75337]: DEBUG nova.network.neutron [None req-b7a44922-d229-485e-85f1-1b80e31ba555 tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] [instance: 15922f4f-f921-4245-8d3d-98ed47de946b] Updating instance_info_cache with network_info: [{"id": "75853df2-1f1a-4a4f-be80-b29cd2452bd2", "address": "fa:16:3e:f5:3f:f6", "network": {"id": "6b24c7e3-9e9c-4a84-8472-7629c0dc8029", "bridge": "br-int", "label": "tempest-TestShelveInstance-284079759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "573524caeb6248339e924a5abb8e5964", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75853df2-1f", "ovs_interfaceid": "75853df2-1f1a-4a4f-be80-b29cd2452bd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 16:13:50 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-b7a44922-d229-485e-85f1-1b80e31ba555 tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Releasing lock "refresh_cache-15922f4f-f921-4245-8d3d-98ed47de946b" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 16:13:50 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-b7a44922-d229-485e-85f1-1b80e31ba555 tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] [instance: 15922f4f-f921-4245-8d3d-98ed47de946b] Creating instance directory {{(pid=75337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 16:13:50 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-b7a44922-d229-485e-85f1-1b80e31ba555 tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] [instance: 15922f4f-f921-4245-8d3d-98ed47de946b] Creating image(s)
Nov 06 16:13:50 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-b7a44922-d229-485e-85f1-1b80e31ba555 tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] [instance: 15922f4f-f921-4245-8d3d-98ed47de946b] Did not create local disks {{(pid=75337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 06 16:13:50 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-b7a44922-d229-485e-85f1-1b80e31ba555 tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] [instance: 15922f4f-f921-4245-8d3d-98ed47de946b] Ensure instance console log exists: /opt/stack/data/nova/instances/15922f4f-f921-4245-8d3d-98ed47de946b/console.log {{(pid=75337) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 16:13:50 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-b7a44922-d229-485e-85f1-1b80e31ba555 tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:13:50 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-b7a44922-d229-485e-85f1-1b80e31ba555 tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:13:50 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-b7a44922-d229-485e-85f1-1b80e31ba555 tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:13:50 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-b7a44922-d229-485e-85f1-1b80e31ba555 tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] [instance: 15922f4f-f921-4245-8d3d-98ed47de946b] Start _get_guest_xml network_info=[{"id": "75853df2-1f1a-4a4f-be80-b29cd2452bd2", "address": "fa:16:3e:f5:3f:f6", "network": {"id": "6b24c7e3-9e9c-4a84-8472-7629c0dc8029", "bridge": "br-int", "label": "tempest-TestShelveInstance-284079759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "573524caeb6248339e924a5abb8e5964", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75853df2-1f", "ovs_interfaceid": "75853df2-1f1a-4a4f-be80-b29cd2452bd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'attachment_id': '45757d3e-6a99-420e-8a8f-eb72f6ae128a', 'guest_format': None, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:06b3b613-3c1e-4420-a500-1ec3988c0940', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'niMJzqwT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '15922f4f-f921-4245-8d3d-98ed47de946b', 'attached_at': '', 'detached_at': '', 'volume_id': '06b3b613-3c1e-4420-a500-1ec3988c0940', 'serial': '06b3b613-3c1e-4420-a500-1ec3988c0940'}, 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=75337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 16:13:50 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-863a307e-c5a2-44eb-888b-0975235d750d req-44ef4a0f-ed57-4fb9-bd2b-4542d7138712 service nova] Acquired lock "refresh_cache-15922f4f-f921-4245-8d3d-98ed47de946b" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 16:13:50 user nova-compute[75337]: DEBUG nova.network.neutron [req-863a307e-c5a2-44eb-888b-0975235d750d req-44ef4a0f-ed57-4fb9-bd2b-4542d7138712 service nova] [instance: 15922f4f-f921-4245-8d3d-98ed47de946b] Refreshing network info cache for port 75853df2-1f1a-4a4f-be80-b29cd2452bd2 {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 16:13:50 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-b7a44922-d229-485e-85f1-1b80e31ba555 tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 16:13:50 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-b7a44922-d229-485e-85f1-1b80e31ba555 tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 16:13:50 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-b7a44922-d229-485e-85f1-1b80e31ba555 tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 16:13:50 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-b7a44922-d229-485e-85f1-1b80e31ba555 tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] CPU controller missing on host. {{(pid=75337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 16:13:50 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-b7a44922-d229-485e-85f1-1b80e31ba555 tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 16:13:50 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-b7a44922-d229-485e-85f1-1b80e31ba555 tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] CPU controller found on host. {{(pid=75337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 16:13:50 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-b7a44922-d229-485e-85f1-1b80e31ba555 tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75337) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 16:13:50 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-b7a44922-d229-485e-85f1-1b80e31ba555 tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T15:34:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 16:13:50 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-b7a44922-d229-485e-85f1-1b80e31ba555 tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Flavor limits 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 16:13:50 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-b7a44922-d229-485e-85f1-1b80e31ba555 tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Image limits 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 16:13:50 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-b7a44922-d229-485e-85f1-1b80e31ba555 tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Flavor pref 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 16:13:50 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-b7a44922-d229-485e-85f1-1b80e31ba555 tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Image pref 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 16:13:50 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-b7a44922-d229-485e-85f1-1b80e31ba555 tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 16:13:50 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-b7a44922-d229-485e-85f1-1b80e31ba555 tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 16:13:50 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-b7a44922-d229-485e-85f1-1b80e31ba555 tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 16:13:50 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-b7a44922-d229-485e-85f1-1b80e31ba555 tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Got 1 possible topologies {{(pid=75337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 16:13:50 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-b7a44922-d229-485e-85f1-1b80e31ba555 tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 16:13:50 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-b7a44922-d229-485e-85f1-1b80e31ba555 tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 16:13:50 user nova-compute[75337]: DEBUG nova.objects.instance [None req-b7a44922-d229-485e-85f1-1b80e31ba555 tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Lazy-loading 'vcpu_model' on Instance uuid 15922f4f-f921-4245-8d3d-98ed47de946b {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 16:13:50 user nova-compute[75337]: DEBUG nova.objects.base [None req-b7a44922-d229-485e-85f1-1b80e31ba555 tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Object Instance<15922f4f-f921-4245-8d3d-98ed47de946b> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=75337) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 16:13:50 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b7a44922-d229-485e-85f1-1b80e31ba555 tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] [instance: 15922f4f-f921-4245-8d3d-98ed47de946b] Calling os-brick to attach iSCSI Volume {{(pid=75337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 16:13:50 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7a44922-d229-485e-85f1-1b80e31ba555 tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2abc33d0c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:06b3b613-3c1e-4420-a500-1ec3988c0940', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'niMJzqwT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 16:13:50 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-b7a44922-d229-485e-85f1-1b80e31ba555 tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 16:13:50 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-b7a44922-d229-485e-85f1-1b80e31ba555 tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 16:13:50 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-b7a44922-d229-485e-85f1-1b80e31ba555 tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 16:13:50 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-b7a44922-d229-485e-85f1-1b80e31ba555 tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 16:13:50 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-b7a44922-d229-485e-85f1-1b80e31ba555 tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:06b3b613-3c1e-4420-a500-1ec3988c0940" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 16:13:50 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-b7a44922-d229-485e-85f1-1b80e31ba555 tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:06b3b613-3c1e-4420-a500-1ec3988c0940" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 16:13:50 user nova-compute[75337]: INFO os_brick.initiator.connectors.iscsi [None req-b7a44922-d229-485e-85f1-1b80e31ba555 tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 16:13:50 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06b3b613-3c1e-4420-a500-1ec3988c0940 -p 172.16.0.220:3260 {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:13:50 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06b3b613-3c1e-4420-a500-1ec3988c0940 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:13:50 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3626111-d077-48c5-af3c-f797ec5ede4c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:13:50 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7a44922-d229-485e-85f1-1b80e31ba555 tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 16:13:50 user nova-compute[75337]:  {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:13:50 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06b3b613-3c1e-4420-a500-1ec3988c0940 -p 172.16.0.220:3260 --interface default --op new {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:13:50 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06b3b613-3c1e-4420-a500-1ec3988c0940 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:13:50 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[02cb8734-85aa-40c9-b5be-8103221e27c1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:06b3b613-3c1e-4420-a500-1ec3988c0940] added\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:13:50 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7a44922-d229-485e-85f1-1b80e31ba555 tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:06b3b613-3c1e-4420-a500-1ec3988c0940] added
Nov 06 16:13:50 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:13:50 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06b3b613-3c1e-4420-a500-1ec3988c0940 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:13:50 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06b3b613-3c1e-4420-a500-1ec3988c0940 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.033s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:13:50 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[c34a93eb-0f10-4ded-9d29-ab97f08b2936]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:13:50 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7a44922-d229-485e-85f1-1b80e31ba555 tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:13:50 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06b3b613-3c1e-4420-a500-1ec3988c0940 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:13:50 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06b3b613-3c1e-4420-a500-1ec3988c0940 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.033s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:13:50 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[61641822-99c2-4e28-8740-d5d5796293c0]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:13:50 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7a44922-d229-485e-85f1-1b80e31ba555 tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:13:50 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06b3b613-3c1e-4420-a500-1ec3988c0940 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v niMJzqwT {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:13:50 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06b3b613-3c1e-4420-a500-1ec3988c0940 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v niMJzqwT" returned: 0 in 0.022s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:13:50 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5a01678-065a-4be8-8868-d9081b172199]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:13:50 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7a44922-d229-485e-85f1-1b80e31ba555 tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'niMJzqwT'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:13:50 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06b3b613-3c1e-4420-a500-1ec3988c0940 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:13:50 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06b3b613-3c1e-4420-a500-1ec3988c0940 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.034s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:13:50 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[403366e0-ecbb-4378-ab1d-54554f90ef6b]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:13:50 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7a44922-d229-485e-85f1-1b80e31ba555 tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:13:50 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:13:50 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:13:50 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[86713200-160f-4968-a5bd-24e51e47a88a]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1447057-1ed4-481c-96ce-dae096d6669a (non-flash)\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:13:50 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7a44922-d229-485e-85f1-1b80e31ba555 tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1447057-1ed4-481c-96ce-dae096d6669a (non-flash)
Nov 06 16:13:50 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 16:13:50 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7a44922-d229-485e-85f1-1b80e31ba555 tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1447057-1ed4-481c-96ce-dae096d6669a (non-flash)
Nov 06 16:13:50 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 16:13:50 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06b3b613-3c1e-4420-a500-1ec3988c0940 -p 172.16.0.220:3260 --login {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:13:50 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06b3b613-3c1e-4420-a500-1ec3988c0940 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:13:50 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[278576e9-a46f-49b4-946c-c0c8be032a55]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:06b3b613-3c1e-4420-a500-1ec3988c0940, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:06b3b613-3c1e-4420-a500-1ec3988c0940, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:13:50 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7a44922-d229-485e-85f1-1b80e31ba555 tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:06b3b613-3c1e-4420-a500-1ec3988c0940, portal: 172.16.0.220,3260]
Nov 06 16:13:50 user nova-compute[75337]: Login to [iface: default, target: iqn.2010-10.org.openstack:06b3b613-3c1e-4420-a500-1ec3988c0940, portal: 172.16.0.220,3260] successful.
Nov 06 16:13:50 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:13:50 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06b3b613-3c1e-4420-a500-1ec3988c0940 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:13:50 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06b3b613-3c1e-4420-a500-1ec3988c0940 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:13:50 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[cadba948-370f-45de-a495-f95b5164d574]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:13:50 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7a44922-d229-485e-85f1-1b80e31ba555 tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:13:50 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:13:50 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:13:50 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[88373d52-05ff-49bc-a18b-9c853bde95ee]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1447057-1ed4-481c-96ce-dae096d6669a (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06b3b613-3c1e-4420-a500-1ec3988c0940 (non-flash)\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:13:50 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7a44922-d229-485e-85f1-1b80e31ba555 tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1447057-1ed4-481c-96ce-dae096d6669a (non-flash)
Nov 06 16:13:50 user nova-compute[75337]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06b3b613-3c1e-4420-a500-1ec3988c0940 (non-flash)
Nov 06 16:13:50 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 16:13:50 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7a44922-d229-485e-85f1-1b80e31ba555 tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1447057-1ed4-481c-96ce-dae096d6669a (non-flash)
Nov 06 16:13:50 user nova-compute[75337]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06b3b613-3c1e-4420-a500-1ec3988c0940 (non-flash)
Nov 06 16:13:50 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 16:13:50 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-b7a44922-d229-485e-85f1-1b80e31ba555 tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:06b3b613-3c1e-4420-a500-1ec3988c0940" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.356s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 16:13:50 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7a44922-d229-485e-85f1-1b80e31ba555 tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Connected to 172.16.0.220:3260 {{(pid=75337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 16:13:50 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-b7a44922-d229-485e-85f1-1b80e31ba555 tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] HCTL ('34', '-', '-', 0) found on session 57 with lun 0 {{(pid=75337) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 16:13:50 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-b7a44922-d229-485e-85f1-1b80e31ba555 tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75337) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 16:13:51 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:13:51 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:13:51 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[214380fd-c570-4e05-adee-957a23e91f09]: (4, ('- - 0', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:13:51 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-b7a44922-d229-485e-85f1-1b80e31ba555 tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Searching for a device in session 57 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75337) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 16:13:51 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7a44922-d229-485e-85f1-1b80e31ba555 tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:06b3b613-3c1e-4420-a500-1ec3988c0940', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'niMJzqwT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 16:13:51 user nova-compute[75337]: DEBUG nova.network.neutron [req-863a307e-c5a2-44eb-888b-0975235d750d req-44ef4a0f-ed57-4fb9-bd2b-4542d7138712 service nova] [instance: 15922f4f-f921-4245-8d3d-98ed47de946b] Updated VIF entry in instance network info cache for port 75853df2-1f1a-4a4f-be80-b29cd2452bd2. {{(pid=75337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 16:13:51 user nova-compute[75337]: DEBUG nova.network.neutron [req-863a307e-c5a2-44eb-888b-0975235d750d req-44ef4a0f-ed57-4fb9-bd2b-4542d7138712 service nova] [instance: 15922f4f-f921-4245-8d3d-98ed47de946b] Updating instance_info_cache with network_info: [{"id": "75853df2-1f1a-4a4f-be80-b29cd2452bd2", "address": "fa:16:3e:f5:3f:f6", "network": {"id": "6b24c7e3-9e9c-4a84-8472-7629c0dc8029", "bridge": "br-int", "label": "tempest-TestShelveInstance-284079759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "573524caeb6248339e924a5abb8e5964", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75853df2-1f", "ovs_interfaceid": "75853df2-1f1a-4a4f-be80-b29cd2452bd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 16:13:51 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-863a307e-c5a2-44eb-888b-0975235d750d req-44ef4a0f-ed57-4fb9-bd2b-4542d7138712 service nova] Releasing lock "refresh_cache-15922f4f-f921-4245-8d3d-98ed47de946b" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 16:13:52 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-b7a44922-d229-485e-85f1-1b80e31ba555 tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.391s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 16:13:52 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7a44922-d229-485e-85f1-1b80e31ba555 tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] <== connect_volume: return (1393ms) {'type': 'block', 'scsi_wwn': '26339353537623732', 'path': '/dev/sdc'} {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 16:13:52 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b7a44922-d229-485e-85f1-1b80e31ba555 tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] [instance: 15922f4f-f921-4245-8d3d-98ed47de946b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26339353537623732', 'path': '/dev/sdc'} {{(pid=75337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 16:13:52 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-b7a44922-d229-485e-85f1-1b80e31ba555 tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-06T16:09:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1606147193',display_name='tempest-TestShelveInstance-server-1606147193',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1606147193',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1222945182',keypairs=<?>,launch_index=0,launched_at=2023-11-06T16:09:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='573524caeb6248339e924a5abb8e5964',ramdisk_id='',reservation_id='r-totl4fkd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-652677760',owner_user_name='tempest-TestShelveInstance-652677760-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T16:13:11Z,user_data=None,user_id='3204b8f95945489d8335cafa44ab2109',uuid=15922f4f-f921-4245-8d3d-98ed47de946b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "75853df2-1f1a-4a4f-be80-b29cd2452bd2", "address": "fa:16:3e:f5:3f:f6", "network": {"id": "6b24c7e3-9e9c-4a84-8472-7629c0dc8029", "bridge": "br-int", "label": "tempest-TestShelveInstance-284079759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "573524caeb6248339e924a5abb8e5964", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75853df2-1f", "ovs_interfaceid": "75853df2-1f1a-4a4f-be80-b29cd2452bd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75337) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 16:13:52 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-b7a44922-d229-485e-85f1-1b80e31ba555 tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Converting VIF {"id": "75853df2-1f1a-4a4f-be80-b29cd2452bd2", "address": "fa:16:3e:f5:3f:f6", "network": {"id": "6b24c7e3-9e9c-4a84-8472-7629c0dc8029", "bridge": "br-int", "label": "tempest-TestShelveInstance-284079759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "573524caeb6248339e924a5abb8e5964", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75853df2-1f", "ovs_interfaceid": "75853df2-1f1a-4a4f-be80-b29cd2452bd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 16:13:52 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-b7a44922-d229-485e-85f1-1b80e31ba555 tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:3f:f6,bridge_name='br-int',has_traffic_filtering=True,id=75853df2-1f1a-4a4f-be80-b29cd2452bd2,network=Network(6b24c7e3-9e9c-4a84-8472-7629c0dc8029),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75853df2-1f') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 16:13:52 user nova-compute[75337]: DEBUG nova.objects.instance [None req-b7a44922-d229-485e-85f1-1b80e31ba555 tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Lazy-loading 'pci_devices' on Instance uuid 15922f4f-f921-4245-8d3d-98ed47de946b {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 16:13:52 user nova-compute[75337]: DEBUG nova.objects.base [None req-b7a44922-d229-485e-85f1-1b80e31ba555 tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Object Instance<15922f4f-f921-4245-8d3d-98ed47de946b> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=75337) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 16:13:52 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-b7a44922-d229-485e-85f1-1b80e31ba555 tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] [instance: 15922f4f-f921-4245-8d3d-98ed47de946b] End _get_guest_xml xml=<domain type="kvm">
Nov 06 16:13:52 user nova-compute[75337]:   <uuid>15922f4f-f921-4245-8d3d-98ed47de946b</uuid>
Nov 06 16:13:52 user nova-compute[75337]:   <name>instance-0000002f</name>
Nov 06 16:13:52 user nova-compute[75337]:   <memory>524288</memory>
Nov 06 16:13:52 user nova-compute[75337]:   <vcpu>1</vcpu>
Nov 06 16:13:52 user nova-compute[75337]:   <metadata>
Nov 06 16:13:52 user nova-compute[75337]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 16:13:52 user nova-compute[75337]:       <nova:package version="0.0.0"/>
Nov 06 16:13:52 user nova-compute[75337]:       <nova:name>tempest-TestShelveInstance-server-1606147193</nova:name>
Nov 06 16:13:52 user nova-compute[75337]:       <nova:creationTime>2023-11-06 16:13:50</nova:creationTime>
Nov 06 16:13:52 user nova-compute[75337]:       <nova:flavor name="m1.tiny">
Nov 06 16:13:52 user nova-compute[75337]:         <nova:memory>512</nova:memory>
Nov 06 16:13:52 user nova-compute[75337]:         <nova:disk>1</nova:disk>
Nov 06 16:13:52 user nova-compute[75337]:         <nova:swap>0</nova:swap>
Nov 06 16:13:52 user nova-compute[75337]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 16:13:52 user nova-compute[75337]:         <nova:vcpus>1</nova:vcpus>
Nov 06 16:13:52 user nova-compute[75337]:       </nova:flavor>
Nov 06 16:13:52 user nova-compute[75337]:       <nova:owner>
Nov 06 16:13:52 user nova-compute[75337]:         <nova:user uuid="3204b8f95945489d8335cafa44ab2109">tempest-TestShelveInstance-652677760-project-member</nova:user>
Nov 06 16:13:52 user nova-compute[75337]:         <nova:project uuid="573524caeb6248339e924a5abb8e5964">tempest-TestShelveInstance-652677760</nova:project>
Nov 06 16:13:52 user nova-compute[75337]:       </nova:owner>
Nov 06 16:13:52 user nova-compute[75337]:       <nova:ports>
Nov 06 16:13:52 user nova-compute[75337]:         <nova:port uuid="75853df2-1f1a-4a4f-be80-b29cd2452bd2">
Nov 06 16:13:52 user nova-compute[75337]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 06 16:13:52 user nova-compute[75337]:         </nova:port>
Nov 06 16:13:52 user nova-compute[75337]:       </nova:ports>
Nov 06 16:13:52 user nova-compute[75337]:     </nova:instance>
Nov 06 16:13:52 user nova-compute[75337]:   </metadata>
Nov 06 16:13:52 user nova-compute[75337]:   <sysinfo type="smbios">
Nov 06 16:13:52 user nova-compute[75337]:     <system>
Nov 06 16:13:52 user nova-compute[75337]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 16:13:52 user nova-compute[75337]:       <entry name="product">OpenStack Nova</entry>
Nov 06 16:13:52 user nova-compute[75337]:       <entry name="version">0.0.0</entry>
Nov 06 16:13:52 user nova-compute[75337]:       <entry name="serial">15922f4f-f921-4245-8d3d-98ed47de946b</entry>
Nov 06 16:13:52 user nova-compute[75337]:       <entry name="uuid">15922f4f-f921-4245-8d3d-98ed47de946b</entry>
Nov 06 16:13:52 user nova-compute[75337]:       <entry name="family">Virtual Machine</entry>
Nov 06 16:13:52 user nova-compute[75337]:     </system>
Nov 06 16:13:52 user nova-compute[75337]:   </sysinfo>
Nov 06 16:13:52 user nova-compute[75337]:   <os>
Nov 06 16:13:52 user nova-compute[75337]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 16:13:52 user nova-compute[75337]:     <boot dev="hd"/>
Nov 06 16:13:52 user nova-compute[75337]:     <smbios mode="sysinfo"/>
Nov 06 16:13:52 user nova-compute[75337]:   </os>
Nov 06 16:13:52 user nova-compute[75337]:   <features>
Nov 06 16:13:52 user nova-compute[75337]:     <acpi/>
Nov 06 16:13:52 user nova-compute[75337]:     <apic/>
Nov 06 16:13:52 user nova-compute[75337]:     <vmcoreinfo/>
Nov 06 16:13:52 user nova-compute[75337]:   </features>
Nov 06 16:13:52 user nova-compute[75337]:   <clock offset="utc">
Nov 06 16:13:52 user nova-compute[75337]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 16:13:52 user nova-compute[75337]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 16:13:52 user nova-compute[75337]:     <timer name="hpet" present="no"/>
Nov 06 16:13:52 user nova-compute[75337]:   </clock>
Nov 06 16:13:52 user nova-compute[75337]:   <cpu mode="custom" match="exact">
Nov 06 16:13:52 user nova-compute[75337]:     <model>Nehalem</model>
Nov 06 16:13:52 user nova-compute[75337]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 16:13:52 user nova-compute[75337]:   </cpu>
Nov 06 16:13:52 user nova-compute[75337]:   <devices>
Nov 06 16:13:52 user nova-compute[75337]:     <disk type="block" device="disk">
Nov 06 16:13:52 user nova-compute[75337]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 16:13:52 user nova-compute[75337]:       <source dev="/dev/sdc"/>
Nov 06 16:13:52 user nova-compute[75337]:       <target dev="vda" bus="virtio"/>
Nov 06 16:13:52 user nova-compute[75337]:       <serial>06b3b613-3c1e-4420-a500-1ec3988c0940</serial>
Nov 06 16:13:52 user nova-compute[75337]:     </disk>
Nov 06 16:13:52 user nova-compute[75337]:     <interface type="ethernet">
Nov 06 16:13:52 user nova-compute[75337]:       <mac address="fa:16:3e:f5:3f:f6"/>
Nov 06 16:13:52 user nova-compute[75337]:       <model type="virtio"/>
Nov 06 16:13:52 user nova-compute[75337]:       <mtu size="1442"/>
Nov 06 16:13:52 user nova-compute[75337]:       <target dev="tap75853df2-1f"/>
Nov 06 16:13:52 user nova-compute[75337]:     </interface>
Nov 06 16:13:52 user nova-compute[75337]:     <serial type="pty">
Nov 06 16:13:52 user nova-compute[75337]:       <log file="/opt/stack/data/nova/instances/15922f4f-f921-4245-8d3d-98ed47de946b/console.log" append="off"/>
Nov 06 16:13:52 user nova-compute[75337]:     </serial>
Nov 06 16:13:52 user nova-compute[75337]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 16:13:52 user nova-compute[75337]:     <video>
Nov 06 16:13:52 user nova-compute[75337]:       <model type="virtio"/>
Nov 06 16:13:52 user nova-compute[75337]:     </video>
Nov 06 16:13:52 user nova-compute[75337]:     <rng model="virtio">
Nov 06 16:13:52 user nova-compute[75337]:       <backend model="random">/dev/urandom</backend>
Nov 06 16:13:52 user nova-compute[75337]:     </rng>
Nov 06 16:13:52 user nova-compute[75337]:     <controller type="usb" index="0" model="none"/>
Nov 06 16:13:52 user nova-compute[75337]:     <memballoon model="virtio">
Nov 06 16:13:52 user nova-compute[75337]:       <stats period="10"/>
Nov 06 16:13:52 user nova-compute[75337]:     </memballoon>
Nov 06 16:13:52 user nova-compute[75337]:   </devices>
Nov 06 16:13:52 user nova-compute[75337]: </domain>
Nov 06 16:13:52 user nova-compute[75337]:  {{(pid=75337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 16:13:52 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-b7a44922-d229-485e-85f1-1b80e31ba555 tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-06T16:09:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1606147193',display_name='tempest-TestShelveInstance-server-1606147193',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1606147193',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1222945182',keypairs=<?>,launch_index=0,launched_at=2023-11-06T16:09:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='573524caeb6248339e924a5abb8e5964',ramdisk_id='',reservation_id='r-totl4fkd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-652677760',owner_user_name='tempest-TestShelveInstance-652677760-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T16:13:11Z,user_data=None,user_id='3204b8f95945489d8335cafa44ab2109',uuid=15922f4f-f921-4245-8d3d-98ed47de946b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "75853df2-1f1a-4a4f-be80-b29cd2452bd2", "address": "fa:16:3e:f5:3f:f6", "network": {"id": "6b24c7e3-9e9c-4a84-8472-7629c0dc8029", "bridge": "br-int", "label": "tempest-TestShelveInstance-284079759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "573524caeb6248339e924a5abb8e5964", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75853df2-1f", "ovs_interfaceid": "75853df2-1f1a-4a4f-be80-b29cd2452bd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 16:13:52 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-b7a44922-d229-485e-85f1-1b80e31ba555 tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Converting VIF {"id": "75853df2-1f1a-4a4f-be80-b29cd2452bd2", "address": "fa:16:3e:f5:3f:f6", "network": {"id": "6b24c7e3-9e9c-4a84-8472-7629c0dc8029", "bridge": "br-int", "label": "tempest-TestShelveInstance-284079759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "573524caeb6248339e924a5abb8e5964", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75853df2-1f", "ovs_interfaceid": "75853df2-1f1a-4a4f-be80-b29cd2452bd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 16:13:52 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-b7a44922-d229-485e-85f1-1b80e31ba555 tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:3f:f6,bridge_name='br-int',has_traffic_filtering=True,id=75853df2-1f1a-4a4f-be80-b29cd2452bd2,network=Network(6b24c7e3-9e9c-4a84-8472-7629c0dc8029),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75853df2-1f') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 16:13:52 user nova-compute[75337]: DEBUG os_vif [None req-b7a44922-d229-485e-85f1-1b80e31ba555 tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:3f:f6,bridge_name='br-int',has_traffic_filtering=True,id=75853df2-1f1a-4a4f-be80-b29cd2452bd2,network=Network(6b24c7e3-9e9c-4a84-8472-7629c0dc8029),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75853df2-1f') {{(pid=75337) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 16:13:52 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:13:52 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 16:13:52 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 16:13:52 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:13:52 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '38340026-a064-50e0-b5c5-09e2b91acbbb', '_type': 'linux-noop'}}, row=False) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 16:13:52 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:13:52 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:13:52 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:13:52 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap75853df2-1f, may_exist=True, interface_attrs={}) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 16:13:52 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap75853df2-1f, col_values=(('qos', UUID('b4c4e463-4ba3-4f4e-b86f-72318f0e7232')),), if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 16:13:52 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap75853df2-1f, col_values=(('external_ids', {'iface-id': '75853df2-1f1a-4a4f-be80-b29cd2452bd2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f5:3f:f6', 'vm-uuid': '15922f4f-f921-4245-8d3d-98ed47de946b'}),), if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 16:13:52 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:13:52 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:13:52 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:13:52 user nova-compute[75337]: INFO os_vif [None req-b7a44922-d229-485e-85f1-1b80e31ba555 tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:3f:f6,bridge_name='br-int',has_traffic_filtering=True,id=75853df2-1f1a-4a4f-be80-b29cd2452bd2,network=Network(6b24c7e3-9e9c-4a84-8472-7629c0dc8029),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75853df2-1f')
Nov 06 16:13:52 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-b7a44922-d229-485e-85f1-1b80e31ba555 tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] No BDM found with device name vda, not building metadata. {{(pid=75337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 16:13:52 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-b7a44922-d229-485e-85f1-1b80e31ba555 tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] No VIF found with MAC fa:16:3e:f5:3f:f6, not building metadata {{(pid=75337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 16:13:53 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:13:53 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:13:53 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:13:53 user nova-compute[75337]: DEBUG nova.compute.manager [req-8ff9efc4-f79a-49f4-8bd0-661c0a9bf639 req-55bc8eda-e3e3-43c8-bcd1-25f181143c8f service nova] [instance: 15922f4f-f921-4245-8d3d-98ed47de946b] Received event network-vif-plugged-75853df2-1f1a-4a4f-be80-b29cd2452bd2 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:13:53 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-8ff9efc4-f79a-49f4-8bd0-661c0a9bf639 req-55bc8eda-e3e3-43c8-bcd1-25f181143c8f service nova] Acquiring lock "15922f4f-f921-4245-8d3d-98ed47de946b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:13:53 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-8ff9efc4-f79a-49f4-8bd0-661c0a9bf639 req-55bc8eda-e3e3-43c8-bcd1-25f181143c8f service nova] Lock "15922f4f-f921-4245-8d3d-98ed47de946b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:13:53 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-8ff9efc4-f79a-49f4-8bd0-661c0a9bf639 req-55bc8eda-e3e3-43c8-bcd1-25f181143c8f service nova] Lock "15922f4f-f921-4245-8d3d-98ed47de946b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:13:53 user nova-compute[75337]: DEBUG nova.compute.manager [req-8ff9efc4-f79a-49f4-8bd0-661c0a9bf639 req-55bc8eda-e3e3-43c8-bcd1-25f181143c8f service nova] [instance: 15922f4f-f921-4245-8d3d-98ed47de946b] No waiting events found dispatching network-vif-plugged-75853df2-1f1a-4a4f-be80-b29cd2452bd2 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 16:13:53 user nova-compute[75337]: WARNING nova.compute.manager [req-8ff9efc4-f79a-49f4-8bd0-661c0a9bf639 req-55bc8eda-e3e3-43c8-bcd1-25f181143c8f service nova] [instance: 15922f4f-f921-4245-8d3d-98ed47de946b] Received unexpected event network-vif-plugged-75853df2-1f1a-4a4f-be80-b29cd2452bd2 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 06 16:13:54 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:13:54 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:13:54 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:13:54 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:13:55 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:13:55 user nova-compute[75337]: DEBUG nova.compute.manager [req-650b3434-d948-4b29-8c1d-001af732cdd6 req-d3d098c3-19a2-4f86-944c-7462f270a194 service nova] [instance: 15922f4f-f921-4245-8d3d-98ed47de946b] Received event network-vif-plugged-75853df2-1f1a-4a4f-be80-b29cd2452bd2 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:13:55 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-650b3434-d948-4b29-8c1d-001af732cdd6 req-d3d098c3-19a2-4f86-944c-7462f270a194 service nova] Acquiring lock "15922f4f-f921-4245-8d3d-98ed47de946b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:13:55 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-650b3434-d948-4b29-8c1d-001af732cdd6 req-d3d098c3-19a2-4f86-944c-7462f270a194 service nova] Lock "15922f4f-f921-4245-8d3d-98ed47de946b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:13:55 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-650b3434-d948-4b29-8c1d-001af732cdd6 req-d3d098c3-19a2-4f86-944c-7462f270a194 service nova] Lock "15922f4f-f921-4245-8d3d-98ed47de946b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:13:55 user nova-compute[75337]: DEBUG nova.compute.manager [req-650b3434-d948-4b29-8c1d-001af732cdd6 req-d3d098c3-19a2-4f86-944c-7462f270a194 service nova] [instance: 15922f4f-f921-4245-8d3d-98ed47de946b] No waiting events found dispatching network-vif-plugged-75853df2-1f1a-4a4f-be80-b29cd2452bd2 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 16:13:55 user nova-compute[75337]: WARNING nova.compute.manager [req-650b3434-d948-4b29-8c1d-001af732cdd6 req-d3d098c3-19a2-4f86-944c-7462f270a194 service nova] [instance: 15922f4f-f921-4245-8d3d-98ed47de946b] Received unexpected event network-vif-plugged-75853df2-1f1a-4a4f-be80-b29cd2452bd2 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 06 16:13:55 user nova-compute[75337]: DEBUG nova.compute.manager [None req-b7a44922-d229-485e-85f1-1b80e31ba555 tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] [instance: 15922f4f-f921-4245-8d3d-98ed47de946b] Instance event wait completed in 0 seconds for  {{(pid=75337) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 16:13:55 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-b7a44922-d229-485e-85f1-1b80e31ba555 tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] [instance: 15922f4f-f921-4245-8d3d-98ed47de946b] Guest created on hypervisor {{(pid=75337) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 16:13:55 user nova-compute[75337]: INFO nova.virt.libvirt.driver [-] [instance: 15922f4f-f921-4245-8d3d-98ed47de946b] Instance spawned successfully.
Nov 06 16:13:55 user nova-compute[75337]: DEBUG nova.compute.manager [None req-b7a44922-d229-485e-85f1-1b80e31ba555 tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] [instance: 15922f4f-f921-4245-8d3d-98ed47de946b] Checking state {{(pid=75337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 16:13:55 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-b7a44922-d229-485e-85f1-1b80e31ba555 tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Lock "15922f4f-f921-4245-8d3d-98ed47de946b" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 44.575s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:13:57 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:14:00 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:14:02 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:14:07 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:14:10 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:14:10 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:14:10 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b640fe9a-7b20-415e-aaa5-08a7c75007c9 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] [instance: 88330c21-69e0-4d82-ac4d-b9e5e849f487] Calling os-brick to attach iSCSI Volume {{(pid=75337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 16:14:10 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b640fe9a-7b20-415e-aaa5-08a7c75007c9 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2abc33d0c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:831ff3d4-9d1e-465b-a878-2688b7c38078', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bOeXiMDV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 16:14:10 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-b640fe9a-7b20-415e-aaa5-08a7c75007c9 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 16:14:10 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-b640fe9a-7b20-415e-aaa5-08a7c75007c9 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 16:14:10 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-b640fe9a-7b20-415e-aaa5-08a7c75007c9 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 16:14:10 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-b640fe9a-7b20-415e-aaa5-08a7c75007c9 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 16:14:10 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-b640fe9a-7b20-415e-aaa5-08a7c75007c9 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:831ff3d4-9d1e-465b-a878-2688b7c38078" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 16:14:10 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-b640fe9a-7b20-415e-aaa5-08a7c75007c9 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:831ff3d4-9d1e-465b-a878-2688b7c38078" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 16:14:10 user nova-compute[75337]: INFO os_brick.initiator.connectors.iscsi [None req-b640fe9a-7b20-415e-aaa5-08a7c75007c9 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 16:14:10 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:831ff3d4-9d1e-465b-a878-2688b7c38078 -p 172.16.0.220:3260 {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:14:11 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:831ff3d4-9d1e-465b-a878-2688b7c38078 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:14:11 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6ef8428-01c1-4062-a181-094317b1a511]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:14:11 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b640fe9a-7b20-415e-aaa5-08a7c75007c9 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 16:14:11 user nova-compute[75337]:  {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:14:11 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:831ff3d4-9d1e-465b-a878-2688b7c38078 -p 172.16.0.220:3260 --interface default --op new {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:14:11 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:831ff3d4-9d1e-465b-a878-2688b7c38078 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:14:11 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e3abe7c-0422-4df2-8c31-6ac438c99027]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:831ff3d4-9d1e-465b-a878-2688b7c38078] added\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:14:11 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b640fe9a-7b20-415e-aaa5-08a7c75007c9 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:831ff3d4-9d1e-465b-a878-2688b7c38078] added
Nov 06 16:14:11 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:14:11 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:831ff3d4-9d1e-465b-a878-2688b7c38078 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:14:11 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:831ff3d4-9d1e-465b-a878-2688b7c38078 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:14:11 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1088429-cb3e-4fc7-90cf-5db183415d09]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:14:11 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b640fe9a-7b20-415e-aaa5-08a7c75007c9 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:14:11 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:831ff3d4-9d1e-465b-a878-2688b7c38078 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:14:11 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:831ff3d4-9d1e-465b-a878-2688b7c38078 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:14:11 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cfccefe-bceb-4ddd-825a-d7dc00811197]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:14:11 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b640fe9a-7b20-415e-aaa5-08a7c75007c9 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:14:11 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:831ff3d4-9d1e-465b-a878-2688b7c38078 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bOeXiMDV {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:14:11 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:831ff3d4-9d1e-465b-a878-2688b7c38078 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bOeXiMDV" returned: 0 in 0.020s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:14:11 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bc7b77c-fcf5-4ede-8ed8-b663a57cb53c]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:14:11 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b640fe9a-7b20-415e-aaa5-08a7c75007c9 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bOeXiMDV'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:14:11 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:831ff3d4-9d1e-465b-a878-2688b7c38078 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:14:11 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:831ff3d4-9d1e-465b-a878-2688b7c38078 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:14:11 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e5cfff3-e909-4cd2-b2c2-ba19d62b1810]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:14:11 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b640fe9a-7b20-415e-aaa5-08a7c75007c9 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:14:11 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:14:11 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:14:11 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[66aa5943-aa63-4a5b-80aa-c28617b9ca99]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06b3b613-3c1e-4420-a500-1ec3988c0940 (non-flash)\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:14:11 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b640fe9a-7b20-415e-aaa5-08a7c75007c9 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06b3b613-3c1e-4420-a500-1ec3988c0940 (non-flash)
Nov 06 16:14:11 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 16:14:11 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b640fe9a-7b20-415e-aaa5-08a7c75007c9 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06b3b613-3c1e-4420-a500-1ec3988c0940 (non-flash)
Nov 06 16:14:11 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 16:14:11 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:831ff3d4-9d1e-465b-a878-2688b7c38078 -p 172.16.0.220:3260 --login {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:14:11 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:831ff3d4-9d1e-465b-a878-2688b7c38078 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:14:11 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[da86383c-ed75-486d-a8a4-ef604bceb3a9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:831ff3d4-9d1e-465b-a878-2688b7c38078, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:831ff3d4-9d1e-465b-a878-2688b7c38078, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:14:11 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b640fe9a-7b20-415e-aaa5-08a7c75007c9 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:831ff3d4-9d1e-465b-a878-2688b7c38078, portal: 172.16.0.220,3260]
Nov 06 16:14:11 user nova-compute[75337]: Login to [iface: default, target: iqn.2010-10.org.openstack:831ff3d4-9d1e-465b-a878-2688b7c38078, portal: 172.16.0.220,3260] successful.
Nov 06 16:14:11 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:14:11 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:831ff3d4-9d1e-465b-a878-2688b7c38078 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:14:11 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:831ff3d4-9d1e-465b-a878-2688b7c38078 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:14:11 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[a39a86cf-593b-4349-b930-9739055178c1]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:14:11 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b640fe9a-7b20-415e-aaa5-08a7c75007c9 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:14:11 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:14:11 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:14:11 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[075bf00b-d846-4f7f-97f3-94027e690b12]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06b3b613-3c1e-4420-a500-1ec3988c0940 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:831ff3d4-9d1e-465b-a878-2688b7c38078 (non-flash)\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:14:11 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b640fe9a-7b20-415e-aaa5-08a7c75007c9 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06b3b613-3c1e-4420-a500-1ec3988c0940 (non-flash)
Nov 06 16:14:11 user nova-compute[75337]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:831ff3d4-9d1e-465b-a878-2688b7c38078 (non-flash)
Nov 06 16:14:11 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 16:14:11 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b640fe9a-7b20-415e-aaa5-08a7c75007c9 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06b3b613-3c1e-4420-a500-1ec3988c0940 (non-flash)
Nov 06 16:14:11 user nova-compute[75337]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:831ff3d4-9d1e-465b-a878-2688b7c38078 (non-flash)
Nov 06 16:14:11 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 16:14:11 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-b640fe9a-7b20-415e-aaa5-08a7c75007c9 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:831ff3d4-9d1e-465b-a878-2688b7c38078" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.268s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 16:14:11 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b640fe9a-7b20-415e-aaa5-08a7c75007c9 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Connected to 172.16.0.220:3260 {{(pid=75337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 16:14:11 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-b640fe9a-7b20-415e-aaa5-08a7c75007c9 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] HCTL ('33', '-', '-', 0) found on session 58 with lun 0 {{(pid=75337) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 16:14:11 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-b640fe9a-7b20-415e-aaa5-08a7c75007c9 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75337) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 16:14:11 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:14:11 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:14:11 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[92e9697d-c82d-4d09-9a71-317fe1831447]: (4, ('- - 0', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:14:11 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-b640fe9a-7b20-415e-aaa5-08a7c75007c9 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: None {{(pid=75337) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 16:14:12 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:14:12 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-b640fe9a-7b20-415e-aaa5-08a7c75007c9 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75337) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 16:14:12 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b640fe9a-7b20-415e-aaa5-08a7c75007c9 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:831ff3d4-9d1e-465b-a878-2688b7c38078', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bOeXiMDV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 16:14:12 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-b640fe9a-7b20-415e-aaa5-08a7c75007c9 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.298s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 16:14:12 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b640fe9a-7b20-415e-aaa5-08a7c75007c9 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] <== connect_volume: return (1299ms) {'type': 'block', 'scsi_wwn': '26466393533373066', 'path': '/dev/sdb'} {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 16:14:12 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b640fe9a-7b20-415e-aaa5-08a7c75007c9 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] [instance: 88330c21-69e0-4d82-ac4d-b9e5e849f487] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26466393533373066', 'path': '/dev/sdb'} {{(pid=75337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 16:14:12 user nova-compute[75337]: DEBUG nova.objects.instance [None req-b640fe9a-7b20-415e-aaa5-08a7c75007c9 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Lazy-loading 'flavor' on Instance uuid 88330c21-69e0-4d82-ac4d-b9e5e849f487 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 16:14:12 user nova-compute[75337]: DEBUG nova.virt.libvirt.guest [None req-b640fe9a-7b20-415e-aaa5-08a7c75007c9 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] attach device xml: <disk type="block" device="disk">
Nov 06 16:14:12 user nova-compute[75337]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 16:14:12 user nova-compute[75337]:   <source dev="/dev/sdb"/>
Nov 06 16:14:12 user nova-compute[75337]:   <target dev="vdb" bus="virtio"/>
Nov 06 16:14:12 user nova-compute[75337]:   <serial>831ff3d4-9d1e-465b-a878-2688b7c38078</serial>
Nov 06 16:14:12 user nova-compute[75337]: </disk>
Nov 06 16:14:12 user nova-compute[75337]:  {{(pid=75337) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 06 16:14:12 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-b640fe9a-7b20-415e-aaa5-08a7c75007c9 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] No BDM found with device name vda, not building metadata. {{(pid=75337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 16:14:12 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-b640fe9a-7b20-415e-aaa5-08a7c75007c9 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 16:14:12 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-b640fe9a-7b20-415e-aaa5-08a7c75007c9 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] No VIF found with MAC fa:16:3e:d4:3f:d4, not building metadata {{(pid=75337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 16:14:12 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-b640fe9a-7b20-415e-aaa5-08a7c75007c9 tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Lock "88330c21-69e0-4d82-ac4d-b9e5e849f487" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 25.571s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:14:14 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-5f224796-5239-44ac-84a2-887b2679bc8b tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Acquiring lock "88330c21-69e0-4d82-ac4d-b9e5e849f487" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:14:14 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-5f224796-5239-44ac-84a2-887b2679bc8b tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Lock "88330c21-69e0-4d82-ac4d-b9e5e849f487" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:14:14 user nova-compute[75337]: INFO nova.compute.manager [None req-5f224796-5239-44ac-84a2-887b2679bc8b tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] [instance: 88330c21-69e0-4d82-ac4d-b9e5e849f487] Detaching volume 831ff3d4-9d1e-465b-a878-2688b7c38078
Nov 06 16:14:14 user nova-compute[75337]: INFO nova.virt.block_device [None req-5f224796-5239-44ac-84a2-887b2679bc8b tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] [instance: 88330c21-69e0-4d82-ac4d-b9e5e849f487] Attempting to driver detach volume 831ff3d4-9d1e-465b-a878-2688b7c38078 from mountpoint /dev/vdb
Nov 06 16:14:14 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-5f224796-5239-44ac-84a2-887b2679bc8b tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Attempting to detach device vdb from instance 88330c21-69e0-4d82-ac4d-b9e5e849f487 from the persistent domain config. {{(pid=75337) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 06 16:14:14 user nova-compute[75337]: DEBUG nova.virt.libvirt.guest [None req-5f224796-5239-44ac-84a2-887b2679bc8b tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 16:14:14 user nova-compute[75337]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 16:14:14 user nova-compute[75337]:   <source dev="/dev/sdb"/>
Nov 06 16:14:14 user nova-compute[75337]:   <target dev="vdb" bus="virtio"/>
Nov 06 16:14:14 user nova-compute[75337]:   <serial>831ff3d4-9d1e-465b-a878-2688b7c38078</serial>
Nov 06 16:14:14 user nova-compute[75337]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 06 16:14:14 user nova-compute[75337]: </disk>
Nov 06 16:14:14 user nova-compute[75337]:  {{(pid=75337) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 16:14:14 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-5f224796-5239-44ac-84a2-887b2679bc8b tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Successfully detached device vdb from instance 88330c21-69e0-4d82-ac4d-b9e5e849f487 from the persistent domain config.
Nov 06 16:14:14 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-5f224796-5239-44ac-84a2-887b2679bc8b tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 88330c21-69e0-4d82-ac4d-b9e5e849f487 from the live domain config. {{(pid=75337) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 06 16:14:14 user nova-compute[75337]: DEBUG nova.virt.libvirt.guest [None req-5f224796-5239-44ac-84a2-887b2679bc8b tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 16:14:14 user nova-compute[75337]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 16:14:14 user nova-compute[75337]:   <source dev="/dev/sdb"/>
Nov 06 16:14:14 user nova-compute[75337]:   <target dev="vdb" bus="virtio"/>
Nov 06 16:14:14 user nova-compute[75337]:   <serial>831ff3d4-9d1e-465b-a878-2688b7c38078</serial>
Nov 06 16:14:14 user nova-compute[75337]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 06 16:14:14 user nova-compute[75337]: </disk>
Nov 06 16:14:14 user nova-compute[75337]:  {{(pid=75337) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 16:14:15 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:14:15 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-5f224796-5239-44ac-84a2-887b2679bc8b tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 88330c21-69e0-4d82-ac4d-b9e5e849f487 {{(pid=75337) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 06 16:14:16 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:14:17 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:14:17 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:14:20 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:14:20 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:14:21 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:14:21 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75337) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 16:14:21 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:14:22 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:14:23 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:14:23 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:14:25 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-1f926754-be0a-4241-83f5-76d3afbf72a5 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Acquiring lock "525c87e5-14c3-40fd-8976-8df151ed07fa" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:14:25 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-1f926754-be0a-4241-83f5-76d3afbf72a5 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Lock "525c87e5-14c3-40fd-8976-8df151ed07fa" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:14:25 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:14:25 user nova-compute[75337]: DEBUG nova.compute.manager [None req-1f926754-be0a-4241-83f5-76d3afbf72a5 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] [instance: 525c87e5-14c3-40fd-8976-8df151ed07fa] Starting instance... {{(pid=75337) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 16:14:25 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-1f926754-be0a-4241-83f5-76d3afbf72a5 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:14:25 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-1f926754-be0a-4241-83f5-76d3afbf72a5 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:14:25 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-1f926754-be0a-4241-83f5-76d3afbf72a5 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75337) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 16:14:25 user nova-compute[75337]: INFO nova.compute.claims [None req-1f926754-be0a-4241-83f5-76d3afbf72a5 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] [instance: 525c87e5-14c3-40fd-8976-8df151ed07fa] Claim successful on node user
Nov 06 16:14:25 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-1f926754-be0a-4241-83f5-76d3afbf72a5 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 16:14:25 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-1f926754-be0a-4241-83f5-76d3afbf72a5 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 16:14:25 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-1f926754-be0a-4241-83f5-76d3afbf72a5 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.247s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:14:25 user nova-compute[75337]: DEBUG nova.compute.manager [None req-1f926754-be0a-4241-83f5-76d3afbf72a5 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] [instance: 525c87e5-14c3-40fd-8976-8df151ed07fa] Start building networks asynchronously for instance. {{(pid=75337) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 16:14:25 user nova-compute[75337]: DEBUG nova.compute.manager [None req-1f926754-be0a-4241-83f5-76d3afbf72a5 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] [instance: 525c87e5-14c3-40fd-8976-8df151ed07fa] Allocating IP information in the background. {{(pid=75337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 16:14:25 user nova-compute[75337]: DEBUG nova.network.neutron [None req-1f926754-be0a-4241-83f5-76d3afbf72a5 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] [instance: 525c87e5-14c3-40fd-8976-8df151ed07fa] allocate_for_instance() {{(pid=75337) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 16:14:25 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-1f926754-be0a-4241-83f5-76d3afbf72a5 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] [instance: 525c87e5-14c3-40fd-8976-8df151ed07fa] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 16:14:25 user nova-compute[75337]: DEBUG nova.compute.manager [None req-1f926754-be0a-4241-83f5-76d3afbf72a5 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] [instance: 525c87e5-14c3-40fd-8976-8df151ed07fa] Start building block device mappings for instance. {{(pid=75337) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 16:14:25 user nova-compute[75337]: DEBUG nova.policy [None req-1f926754-be0a-4241-83f5-76d3afbf72a5 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '22979798bd154fd3af622e408520e95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f71610b3d00f412ea4aeba8068d032fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75337) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 16:14:25 user nova-compute[75337]: DEBUG nova.compute.manager [None req-1f926754-be0a-4241-83f5-76d3afbf72a5 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] [instance: 525c87e5-14c3-40fd-8976-8df151ed07fa] Start spawning the instance on the hypervisor. {{(pid=75337) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 16:14:25 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-1f926754-be0a-4241-83f5-76d3afbf72a5 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] [instance: 525c87e5-14c3-40fd-8976-8df151ed07fa] Creating instance directory {{(pid=75337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 16:14:25 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-1f926754-be0a-4241-83f5-76d3afbf72a5 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] [instance: 525c87e5-14c3-40fd-8976-8df151ed07fa] Creating image(s)
Nov 06 16:14:25 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-1f926754-be0a-4241-83f5-76d3afbf72a5 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Acquiring lock "/opt/stack/data/nova/instances/525c87e5-14c3-40fd-8976-8df151ed07fa/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:14:25 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-1f926754-be0a-4241-83f5-76d3afbf72a5 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Lock "/opt/stack/data/nova/instances/525c87e5-14c3-40fd-8976-8df151ed07fa/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:14:25 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-1f926754-be0a-4241-83f5-76d3afbf72a5 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Lock "/opt/stack/data/nova/instances/525c87e5-14c3-40fd-8976-8df151ed07fa/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:14:25 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-1f926754-be0a-4241-83f5-76d3afbf72a5 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:14:25 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-9fd0f904-99f7-437c-8c8a-1e194c93d7da tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Acquiring lock "de77f786-1ecf-4eac-ae4a-c4f6b1d47339" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:14:25 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-9fd0f904-99f7-437c-8c8a-1e194c93d7da tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Lock "de77f786-1ecf-4eac-ae4a-c4f6b1d47339" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:14:25 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-1f926754-be0a-4241-83f5-76d3afbf72a5 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json" returned: 0 in 0.187s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:14:25 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-1f926754-be0a-4241-83f5-76d3afbf72a5 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Acquiring lock "06ba3c914798499e686c5ac75886932347225275" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:14:25 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-1f926754-be0a-4241-83f5-76d3afbf72a5 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Lock "06ba3c914798499e686c5ac75886932347225275" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:14:25 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-1f926754-be0a-4241-83f5-76d3afbf72a5 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:14:25 user nova-compute[75337]: DEBUG nova.compute.manager [None req-9fd0f904-99f7-437c-8c8a-1e194c93d7da tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] [instance: de77f786-1ecf-4eac-ae4a-c4f6b1d47339] Starting instance... {{(pid=75337) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 16:14:26 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-9fd0f904-99f7-437c-8c8a-1e194c93d7da tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:14:26 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-9fd0f904-99f7-437c-8c8a-1e194c93d7da tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:14:26 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-9fd0f904-99f7-437c-8c8a-1e194c93d7da tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75337) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 16:14:26 user nova-compute[75337]: INFO nova.compute.claims [None req-9fd0f904-99f7-437c-8c8a-1e194c93d7da tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] [instance: de77f786-1ecf-4eac-ae4a-c4f6b1d47339] Claim successful on node user
Nov 06 16:14:26 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-1f926754-be0a-4241-83f5-76d3afbf72a5 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json" returned: 0 in 0.196s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:14:26 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-1f926754-be0a-4241-83f5-76d3afbf72a5 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275,backing_fmt=raw /opt/stack/data/nova/instances/525c87e5-14c3-40fd-8976-8df151ed07fa/disk 1073741824 {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:14:26 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:14:26 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-1f926754-be0a-4241-83f5-76d3afbf72a5 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275,backing_fmt=raw /opt/stack/data/nova/instances/525c87e5-14c3-40fd-8976-8df151ed07fa/disk 1073741824" returned: 0 in 0.063s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:14:26 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-1f926754-be0a-4241-83f5-76d3afbf72a5 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Lock "06ba3c914798499e686c5ac75886932347225275" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.263s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:14:26 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-1f926754-be0a-4241-83f5-76d3afbf72a5 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:14:26 user nova-compute[75337]: DEBUG nova.network.neutron [None req-1f926754-be0a-4241-83f5-76d3afbf72a5 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] [instance: 525c87e5-14c3-40fd-8976-8df151ed07fa] Successfully created port: 1dfbe337-9efa-4a6a-9801-e9264673d095 {{(pid=75337) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 16:14:26 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-1f926754-be0a-4241-83f5-76d3afbf72a5 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json" returned: 0 in 0.174s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:14:26 user nova-compute[75337]: DEBUG nova.virt.disk.api [None req-1f926754-be0a-4241-83f5-76d3afbf72a5 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Checking if we can resize image /opt/stack/data/nova/instances/525c87e5-14c3-40fd-8976-8df151ed07fa/disk. size=1073741824 {{(pid=75337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 16:14:26 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-1f926754-be0a-4241-83f5-76d3afbf72a5 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525c87e5-14c3-40fd-8976-8df151ed07fa/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:14:26 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-9fd0f904-99f7-437c-8c8a-1e194c93d7da tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Refreshing inventories for resource provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 06 16:14:26 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-9fd0f904-99f7-437c-8c8a-1e194c93d7da tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Updating ProviderTree inventory for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 06 16:14:26 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-9fd0f904-99f7-437c-8c8a-1e194c93d7da tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Updating inventory in ProviderTree for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 06 16:14:26 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-9fd0f904-99f7-437c-8c8a-1e194c93d7da tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Refreshing aggregate associations for resource provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7, aggregates: None {{(pid=75337) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 06 16:14:26 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-9fd0f904-99f7-437c-8c8a-1e194c93d7da tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Refreshing trait associations for resource provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7, traits: COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NODE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_IDE,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSSE3,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_USB {{(pid=75337) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 06 16:14:26 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-1f926754-be0a-4241-83f5-76d3afbf72a5 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525c87e5-14c3-40fd-8976-8df151ed07fa/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:14:26 user nova-compute[75337]: DEBUG nova.virt.disk.api [None req-1f926754-be0a-4241-83f5-76d3afbf72a5 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Cannot resize image /opt/stack/data/nova/instances/525c87e5-14c3-40fd-8976-8df151ed07fa/disk to a smaller size. {{(pid=75337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 06 16:14:26 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-1f926754-be0a-4241-83f5-76d3afbf72a5 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] [instance: 525c87e5-14c3-40fd-8976-8df151ed07fa] Created local disks {{(pid=75337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 16:14:26 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-1f926754-be0a-4241-83f5-76d3afbf72a5 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] [instance: 525c87e5-14c3-40fd-8976-8df151ed07fa] Ensure instance console log exists: /opt/stack/data/nova/instances/525c87e5-14c3-40fd-8976-8df151ed07fa/console.log {{(pid=75337) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 16:14:26 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-1f926754-be0a-4241-83f5-76d3afbf72a5 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:14:26 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-1f926754-be0a-4241-83f5-76d3afbf72a5 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:14:26 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-1f926754-be0a-4241-83f5-76d3afbf72a5 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:14:26 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:14:26 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-9fd0f904-99f7-437c-8c8a-1e194c93d7da tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 16:14:26 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-9fd0f904-99f7-437c-8c8a-1e194c93d7da tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 16:14:26 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-9fd0f904-99f7-437c-8c8a-1e194c93d7da tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.719s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:14:26 user nova-compute[75337]: DEBUG nova.compute.manager [None req-9fd0f904-99f7-437c-8c8a-1e194c93d7da tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] [instance: de77f786-1ecf-4eac-ae4a-c4f6b1d47339] Start building networks asynchronously for instance. {{(pid=75337) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 16:14:26 user nova-compute[75337]: DEBUG nova.compute.manager [None req-9fd0f904-99f7-437c-8c8a-1e194c93d7da tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] [instance: de77f786-1ecf-4eac-ae4a-c4f6b1d47339] Allocating IP information in the background. {{(pid=75337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 16:14:26 user nova-compute[75337]: DEBUG nova.network.neutron [None req-9fd0f904-99f7-437c-8c8a-1e194c93d7da tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] [instance: de77f786-1ecf-4eac-ae4a-c4f6b1d47339] allocate_for_instance() {{(pid=75337) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 16:14:26 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-9fd0f904-99f7-437c-8c8a-1e194c93d7da tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] [instance: de77f786-1ecf-4eac-ae4a-c4f6b1d47339] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 16:14:26 user nova-compute[75337]: DEBUG nova.compute.manager [None req-9fd0f904-99f7-437c-8c8a-1e194c93d7da tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] [instance: de77f786-1ecf-4eac-ae4a-c4f6b1d47339] Start building block device mappings for instance. {{(pid=75337) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 16:14:26 user nova-compute[75337]: DEBUG nova.policy [None req-9fd0f904-99f7-437c-8c8a-1e194c93d7da tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '22979798bd154fd3af622e408520e95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f71610b3d00f412ea4aeba8068d032fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75337) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 16:14:27 user nova-compute[75337]: DEBUG nova.compute.manager [None req-9fd0f904-99f7-437c-8c8a-1e194c93d7da tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] [instance: de77f786-1ecf-4eac-ae4a-c4f6b1d47339] Start spawning the instance on the hypervisor. {{(pid=75337) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 16:14:27 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-9fd0f904-99f7-437c-8c8a-1e194c93d7da tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] [instance: de77f786-1ecf-4eac-ae4a-c4f6b1d47339] Creating instance directory {{(pid=75337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 16:14:27 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-9fd0f904-99f7-437c-8c8a-1e194c93d7da tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] [instance: de77f786-1ecf-4eac-ae4a-c4f6b1d47339] Creating image(s)
Nov 06 16:14:27 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-9fd0f904-99f7-437c-8c8a-1e194c93d7da tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Acquiring lock "/opt/stack/data/nova/instances/de77f786-1ecf-4eac-ae4a-c4f6b1d47339/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:14:27 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-9fd0f904-99f7-437c-8c8a-1e194c93d7da tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Lock "/opt/stack/data/nova/instances/de77f786-1ecf-4eac-ae4a-c4f6b1d47339/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:14:27 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-9fd0f904-99f7-437c-8c8a-1e194c93d7da tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Lock "/opt/stack/data/nova/instances/de77f786-1ecf-4eac-ae4a-c4f6b1d47339/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:14:27 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-9fd0f904-99f7-437c-8c8a-1e194c93d7da tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:14:27 user nova-compute[75337]: DEBUG nova.network.neutron [None req-1f926754-be0a-4241-83f5-76d3afbf72a5 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] [instance: 525c87e5-14c3-40fd-8976-8df151ed07fa] Successfully updated port: 1dfbe337-9efa-4a6a-9801-e9264673d095 {{(pid=75337) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 16:14:27 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-1f926754-be0a-4241-83f5-76d3afbf72a5 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Acquiring lock "refresh_cache-525c87e5-14c3-40fd-8976-8df151ed07fa" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 16:14:27 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-1f926754-be0a-4241-83f5-76d3afbf72a5 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Acquired lock "refresh_cache-525c87e5-14c3-40fd-8976-8df151ed07fa" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 16:14:27 user nova-compute[75337]: DEBUG nova.network.neutron [None req-1f926754-be0a-4241-83f5-76d3afbf72a5 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] [instance: 525c87e5-14c3-40fd-8976-8df151ed07fa] Building network info cache for instance {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 16:14:27 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:14:27 user nova-compute[75337]: DEBUG nova.compute.manager [req-59a774ed-44be-457f-8c5b-4f5a4189dce3 req-3998f260-04f1-4762-aabe-29e41497c368 service nova] [instance: 525c87e5-14c3-40fd-8976-8df151ed07fa] Received event network-changed-1dfbe337-9efa-4a6a-9801-e9264673d095 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:14:27 user nova-compute[75337]: DEBUG nova.compute.manager [req-59a774ed-44be-457f-8c5b-4f5a4189dce3 req-3998f260-04f1-4762-aabe-29e41497c368 service nova] [instance: 525c87e5-14c3-40fd-8976-8df151ed07fa] Refreshing instance network info cache due to event network-changed-1dfbe337-9efa-4a6a-9801-e9264673d095. {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 16:14:27 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-59a774ed-44be-457f-8c5b-4f5a4189dce3 req-3998f260-04f1-4762-aabe-29e41497c368 service nova] Acquiring lock "refresh_cache-525c87e5-14c3-40fd-8976-8df151ed07fa" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 16:14:27 user nova-compute[75337]: DEBUG nova.network.neutron [None req-1f926754-be0a-4241-83f5-76d3afbf72a5 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] [instance: 525c87e5-14c3-40fd-8976-8df151ed07fa] Instance cache missing network info. {{(pid=75337) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 16:14:27 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-9fd0f904-99f7-437c-8c8a-1e194c93d7da tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json" returned: 0 in 0.226s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:14:27 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-9fd0f904-99f7-437c-8c8a-1e194c93d7da tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Acquiring lock "06ba3c914798499e686c5ac75886932347225275" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:14:27 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-9fd0f904-99f7-437c-8c8a-1e194c93d7da tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Lock "06ba3c914798499e686c5ac75886932347225275" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:14:27 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-9fd0f904-99f7-437c-8c8a-1e194c93d7da tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:14:27 user nova-compute[75337]: DEBUG nova.network.neutron [None req-9fd0f904-99f7-437c-8c8a-1e194c93d7da tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] [instance: de77f786-1ecf-4eac-ae4a-c4f6b1d47339] Successfully created port: 8f33a5c0-50e1-4bac-a686-733daf33a307 {{(pid=75337) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 16:14:27 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-9fd0f904-99f7-437c-8c8a-1e194c93d7da tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json" returned: 0 in 0.200s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:14:27 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-9fd0f904-99f7-437c-8c8a-1e194c93d7da tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275,backing_fmt=raw /opt/stack/data/nova/instances/de77f786-1ecf-4eac-ae4a-c4f6b1d47339/disk 1073741824 {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:14:27 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-9fd0f904-99f7-437c-8c8a-1e194c93d7da tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275,backing_fmt=raw /opt/stack/data/nova/instances/de77f786-1ecf-4eac-ae4a-c4f6b1d47339/disk 1073741824" returned: 0 in 0.049s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:14:27 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-9fd0f904-99f7-437c-8c8a-1e194c93d7da tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Lock "06ba3c914798499e686c5ac75886932347225275" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:14:27 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-9fd0f904-99f7-437c-8c8a-1e194c93d7da tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:14:27 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:14:27 user nova-compute[75337]: DEBUG nova.network.neutron [None req-1f926754-be0a-4241-83f5-76d3afbf72a5 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] [instance: 525c87e5-14c3-40fd-8976-8df151ed07fa] Updating instance_info_cache with network_info: [{"id": "1dfbe337-9efa-4a6a-9801-e9264673d095", "address": "fa:16:3e:fd:18:f1", "network": {"id": "0da0e0bd-b07e-4ae1-8625-a979ed32bd07", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-528047864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f71610b3d00f412ea4aeba8068d032fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dfbe337-9e", "ovs_interfaceid": "1dfbe337-9efa-4a6a-9801-e9264673d095", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 16:14:27 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-1f926754-be0a-4241-83f5-76d3afbf72a5 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Releasing lock "refresh_cache-525c87e5-14c3-40fd-8976-8df151ed07fa" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 16:14:27 user nova-compute[75337]: DEBUG nova.compute.manager [None req-1f926754-be0a-4241-83f5-76d3afbf72a5 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] [instance: 525c87e5-14c3-40fd-8976-8df151ed07fa] Instance network_info: |[{"id": "1dfbe337-9efa-4a6a-9801-e9264673d095", "address": "fa:16:3e:fd:18:f1", "network": {"id": "0da0e0bd-b07e-4ae1-8625-a979ed32bd07", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-528047864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f71610b3d00f412ea4aeba8068d032fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dfbe337-9e", "ovs_interfaceid": "1dfbe337-9efa-4a6a-9801-e9264673d095", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 16:14:27 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-59a774ed-44be-457f-8c5b-4f5a4189dce3 req-3998f260-04f1-4762-aabe-29e41497c368 service nova] Acquired lock "refresh_cache-525c87e5-14c3-40fd-8976-8df151ed07fa" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 16:14:27 user nova-compute[75337]: DEBUG nova.network.neutron [req-59a774ed-44be-457f-8c5b-4f5a4189dce3 req-3998f260-04f1-4762-aabe-29e41497c368 service nova] [instance: 525c87e5-14c3-40fd-8976-8df151ed07fa] Refreshing network info cache for port 1dfbe337-9efa-4a6a-9801-e9264673d095 {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 16:14:27 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-1f926754-be0a-4241-83f5-76d3afbf72a5 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] [instance: 525c87e5-14c3-40fd-8976-8df151ed07fa] Start _get_guest_xml network_info=[{"id": "1dfbe337-9efa-4a6a-9801-e9264673d095", "address": "fa:16:3e:fd:18:f1", "network": {"id": "0da0e0bd-b07e-4ae1-8625-a979ed32bd07", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-528047864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f71610b3d00f412ea4aeba8068d032fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dfbe337-9e", "ovs_interfaceid": "1dfbe337-9efa-4a6a-9801-e9264673d095", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T15:34:14Z,direct_url=<?>,disk_format='qcow2',id=16b903ae-a40f-41a7-985b-4804cce92c62,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6549a15819f1469bbd5eeae8190e3d44',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T15:34:15Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'guest_format': None, 'size': 0, 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '16b903ae-a40f-41a7-985b-4804cce92c62'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 16:14:27 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-1f926754-be0a-4241-83f5-76d3afbf72a5 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 16:14:27 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-1f926754-be0a-4241-83f5-76d3afbf72a5 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 16:14:27 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-1f926754-be0a-4241-83f5-76d3afbf72a5 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 16:14:27 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-1f926754-be0a-4241-83f5-76d3afbf72a5 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] CPU controller missing on host. {{(pid=75337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 16:14:27 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-1f926754-be0a-4241-83f5-76d3afbf72a5 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 16:14:27 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-1f926754-be0a-4241-83f5-76d3afbf72a5 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] CPU controller found on host. {{(pid=75337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 16:14:27 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-1f926754-be0a-4241-83f5-76d3afbf72a5 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75337) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 16:14:27 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-1f926754-be0a-4241-83f5-76d3afbf72a5 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T15:34:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T15:34:14Z,direct_url=<?>,disk_format='qcow2',id=16b903ae-a40f-41a7-985b-4804cce92c62,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6549a15819f1469bbd5eeae8190e3d44',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T15:34:15Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 16:14:27 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-1f926754-be0a-4241-83f5-76d3afbf72a5 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Flavor limits 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 16:14:27 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-1f926754-be0a-4241-83f5-76d3afbf72a5 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Image limits 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 16:14:27 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-1f926754-be0a-4241-83f5-76d3afbf72a5 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Flavor pref 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 16:14:27 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-1f926754-be0a-4241-83f5-76d3afbf72a5 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Image pref 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 16:14:27 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-1f926754-be0a-4241-83f5-76d3afbf72a5 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 16:14:27 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-1f926754-be0a-4241-83f5-76d3afbf72a5 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 16:14:27 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-1f926754-be0a-4241-83f5-76d3afbf72a5 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 16:14:27 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-1f926754-be0a-4241-83f5-76d3afbf72a5 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Got 1 possible topologies {{(pid=75337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 16:14:27 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-1f926754-be0a-4241-83f5-76d3afbf72a5 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 16:14:27 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-1f926754-be0a-4241-83f5-76d3afbf72a5 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 16:14:27 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-1f926754-be0a-4241-83f5-76d3afbf72a5 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T16:14:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1386418707',display_name='tempest-ServerRescueNegativeTestJSON-server-1386418707',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1386418707',id=49,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f71610b3d00f412ea4aeba8068d032fc',ramdisk_id='',reservation_id='r-kcpcz2gd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1763914139',owner_user_name='tempest-ServerRescueNegativeTestJSON-1763914139-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T16:14:26Z,user_data=None,user_id='22979798bd154fd3af622e408520e95c',uuid=525c87e5-14c3-40fd-8976-8df151ed07fa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1dfbe337-9efa-4a6a-9801-e9264673d095", "address": "fa:16:3e:fd:18:f1", "network": {"id": "0da0e0bd-b07e-4ae1-8625-a979ed32bd07", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-528047864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f71610b3d00f412ea4aeba8068d032fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dfbe337-9e", "ovs_interfaceid": "1dfbe337-9efa-4a6a-9801-e9264673d095", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75337) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 16:14:27 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-1f926754-be0a-4241-83f5-76d3afbf72a5 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Converting VIF {"id": "1dfbe337-9efa-4a6a-9801-e9264673d095", "address": "fa:16:3e:fd:18:f1", "network": {"id": "0da0e0bd-b07e-4ae1-8625-a979ed32bd07", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-528047864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f71610b3d00f412ea4aeba8068d032fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dfbe337-9e", "ovs_interfaceid": "1dfbe337-9efa-4a6a-9801-e9264673d095", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 16:14:27 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-1f926754-be0a-4241-83f5-76d3afbf72a5 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:18:f1,bridge_name='br-int',has_traffic_filtering=True,id=1dfbe337-9efa-4a6a-9801-e9264673d095,network=Network(0da0e0bd-b07e-4ae1-8625-a979ed32bd07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1dfbe337-9e') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 16:14:27 user nova-compute[75337]: DEBUG nova.objects.instance [None req-1f926754-be0a-4241-83f5-76d3afbf72a5 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Lazy-loading 'pci_devices' on Instance uuid 525c87e5-14c3-40fd-8976-8df151ed07fa {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 16:14:27 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-9fd0f904-99f7-437c-8c8a-1e194c93d7da tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json" returned: 0 in 0.211s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:14:27 user nova-compute[75337]: DEBUG nova.virt.disk.api [None req-9fd0f904-99f7-437c-8c8a-1e194c93d7da tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Checking if we can resize image /opt/stack/data/nova/instances/de77f786-1ecf-4eac-ae4a-c4f6b1d47339/disk. size=1073741824 {{(pid=75337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 16:14:27 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-9fd0f904-99f7-437c-8c8a-1e194c93d7da tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de77f786-1ecf-4eac-ae4a-c4f6b1d47339/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:14:27 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-1f926754-be0a-4241-83f5-76d3afbf72a5 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] [instance: 525c87e5-14c3-40fd-8976-8df151ed07fa] End _get_guest_xml xml=<domain type="kvm">
Nov 06 16:14:27 user nova-compute[75337]:   <uuid>525c87e5-14c3-40fd-8976-8df151ed07fa</uuid>
Nov 06 16:14:27 user nova-compute[75337]:   <name>instance-00000031</name>
Nov 06 16:14:27 user nova-compute[75337]:   <memory>524288</memory>
Nov 06 16:14:27 user nova-compute[75337]:   <vcpu>1</vcpu>
Nov 06 16:14:27 user nova-compute[75337]:   <metadata>
Nov 06 16:14:27 user nova-compute[75337]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 16:14:27 user nova-compute[75337]:       <nova:package version="0.0.0"/>
Nov 06 16:14:27 user nova-compute[75337]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1386418707</nova:name>
Nov 06 16:14:27 user nova-compute[75337]:       <nova:creationTime>2023-11-06 16:14:27</nova:creationTime>
Nov 06 16:14:27 user nova-compute[75337]:       <nova:flavor name="m1.tiny">
Nov 06 16:14:27 user nova-compute[75337]:         <nova:memory>512</nova:memory>
Nov 06 16:14:27 user nova-compute[75337]:         <nova:disk>1</nova:disk>
Nov 06 16:14:27 user nova-compute[75337]:         <nova:swap>0</nova:swap>
Nov 06 16:14:27 user nova-compute[75337]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 16:14:27 user nova-compute[75337]:         <nova:vcpus>1</nova:vcpus>
Nov 06 16:14:27 user nova-compute[75337]:       </nova:flavor>
Nov 06 16:14:27 user nova-compute[75337]:       <nova:owner>
Nov 06 16:14:27 user nova-compute[75337]:         <nova:user uuid="22979798bd154fd3af622e408520e95c">tempest-ServerRescueNegativeTestJSON-1763914139-project-member</nova:user>
Nov 06 16:14:27 user nova-compute[75337]:         <nova:project uuid="f71610b3d00f412ea4aeba8068d032fc">tempest-ServerRescueNegativeTestJSON-1763914139</nova:project>
Nov 06 16:14:27 user nova-compute[75337]:       </nova:owner>
Nov 06 16:14:27 user nova-compute[75337]:       <nova:root type="image" uuid="16b903ae-a40f-41a7-985b-4804cce92c62"/>
Nov 06 16:14:27 user nova-compute[75337]:       <nova:ports>
Nov 06 16:14:27 user nova-compute[75337]:         <nova:port uuid="1dfbe337-9efa-4a6a-9801-e9264673d095">
Nov 06 16:14:27 user nova-compute[75337]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 06 16:14:27 user nova-compute[75337]:         </nova:port>
Nov 06 16:14:27 user nova-compute[75337]:       </nova:ports>
Nov 06 16:14:27 user nova-compute[75337]:     </nova:instance>
Nov 06 16:14:27 user nova-compute[75337]:   </metadata>
Nov 06 16:14:27 user nova-compute[75337]:   <sysinfo type="smbios">
Nov 06 16:14:27 user nova-compute[75337]:     <system>
Nov 06 16:14:27 user nova-compute[75337]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 16:14:27 user nova-compute[75337]:       <entry name="product">OpenStack Nova</entry>
Nov 06 16:14:27 user nova-compute[75337]:       <entry name="version">0.0.0</entry>
Nov 06 16:14:27 user nova-compute[75337]:       <entry name="serial">525c87e5-14c3-40fd-8976-8df151ed07fa</entry>
Nov 06 16:14:27 user nova-compute[75337]:       <entry name="uuid">525c87e5-14c3-40fd-8976-8df151ed07fa</entry>
Nov 06 16:14:27 user nova-compute[75337]:       <entry name="family">Virtual Machine</entry>
Nov 06 16:14:27 user nova-compute[75337]:     </system>
Nov 06 16:14:27 user nova-compute[75337]:   </sysinfo>
Nov 06 16:14:27 user nova-compute[75337]:   <os>
Nov 06 16:14:27 user nova-compute[75337]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 16:14:27 user nova-compute[75337]:     <boot dev="hd"/>
Nov 06 16:14:27 user nova-compute[75337]:     <smbios mode="sysinfo"/>
Nov 06 16:14:27 user nova-compute[75337]:   </os>
Nov 06 16:14:27 user nova-compute[75337]:   <features>
Nov 06 16:14:27 user nova-compute[75337]:     <acpi/>
Nov 06 16:14:27 user nova-compute[75337]:     <apic/>
Nov 06 16:14:27 user nova-compute[75337]:     <vmcoreinfo/>
Nov 06 16:14:27 user nova-compute[75337]:   </features>
Nov 06 16:14:27 user nova-compute[75337]:   <clock offset="utc">
Nov 06 16:14:27 user nova-compute[75337]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 16:14:27 user nova-compute[75337]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 16:14:27 user nova-compute[75337]:     <timer name="hpet" present="no"/>
Nov 06 16:14:27 user nova-compute[75337]:   </clock>
Nov 06 16:14:27 user nova-compute[75337]:   <cpu mode="custom" match="exact">
Nov 06 16:14:27 user nova-compute[75337]:     <model>Nehalem</model>
Nov 06 16:14:27 user nova-compute[75337]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 16:14:27 user nova-compute[75337]:   </cpu>
Nov 06 16:14:27 user nova-compute[75337]:   <devices>
Nov 06 16:14:27 user nova-compute[75337]:     <disk type="file" device="disk">
Nov 06 16:14:27 user nova-compute[75337]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 16:14:27 user nova-compute[75337]:       <source file="/opt/stack/data/nova/instances/525c87e5-14c3-40fd-8976-8df151ed07fa/disk"/>
Nov 06 16:14:27 user nova-compute[75337]:       <target dev="vda" bus="virtio"/>
Nov 06 16:14:27 user nova-compute[75337]:     </disk>
Nov 06 16:14:27 user nova-compute[75337]:     <interface type="ethernet">
Nov 06 16:14:27 user nova-compute[75337]:       <mac address="fa:16:3e:fd:18:f1"/>
Nov 06 16:14:27 user nova-compute[75337]:       <model type="virtio"/>
Nov 06 16:14:27 user nova-compute[75337]:       <mtu size="1442"/>
Nov 06 16:14:27 user nova-compute[75337]:       <target dev="tap1dfbe337-9e"/>
Nov 06 16:14:27 user nova-compute[75337]:     </interface>
Nov 06 16:14:27 user nova-compute[75337]:     <serial type="pty">
Nov 06 16:14:27 user nova-compute[75337]:       <log file="/opt/stack/data/nova/instances/525c87e5-14c3-40fd-8976-8df151ed07fa/console.log" append="off"/>
Nov 06 16:14:27 user nova-compute[75337]:     </serial>
Nov 06 16:14:27 user nova-compute[75337]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 16:14:27 user nova-compute[75337]:     <video>
Nov 06 16:14:27 user nova-compute[75337]:       <model type="virtio"/>
Nov 06 16:14:27 user nova-compute[75337]:     </video>
Nov 06 16:14:27 user nova-compute[75337]:     <rng model="virtio">
Nov 06 16:14:27 user nova-compute[75337]:       <backend model="random">/dev/urandom</backend>
Nov 06 16:14:27 user nova-compute[75337]:     </rng>
Nov 06 16:14:27 user nova-compute[75337]:     <controller type="usb" index="0" model="none"/>
Nov 06 16:14:27 user nova-compute[75337]:     <memballoon model="virtio">
Nov 06 16:14:27 user nova-compute[75337]:       <stats period="10"/>
Nov 06 16:14:27 user nova-compute[75337]:     </memballoon>
Nov 06 16:14:27 user nova-compute[75337]:   </devices>
Nov 06 16:14:27 user nova-compute[75337]: </domain>
Nov 06 16:14:27 user nova-compute[75337]:  {{(pid=75337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 16:14:27 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-1f926754-be0a-4241-83f5-76d3afbf72a5 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T16:14:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1386418707',display_name='tempest-ServerRescueNegativeTestJSON-server-1386418707',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1386418707',id=49,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f71610b3d00f412ea4aeba8068d032fc',ramdisk_id='',reservation_id='r-kcpcz2gd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1763914139',owner_user_name='tempest-ServerRescueNegativeTestJSON-1763914139-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T16:14:26Z,user_data=None,user_id='22979798bd154fd3af622e408520e95c',uuid=525c87e5-14c3-40fd-8976-8df151ed07fa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1dfbe337-9efa-4a6a-9801-e9264673d095", "address": "fa:16:3e:fd:18:f1", "network": {"id": "0da0e0bd-b07e-4ae1-8625-a979ed32bd07", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-528047864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f71610b3d00f412ea4aeba8068d032fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dfbe337-9e", "ovs_interfaceid": "1dfbe337-9efa-4a6a-9801-e9264673d095", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 16:14:27 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-1f926754-be0a-4241-83f5-76d3afbf72a5 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Converting VIF {"id": "1dfbe337-9efa-4a6a-9801-e9264673d095", "address": "fa:16:3e:fd:18:f1", "network": {"id": "0da0e0bd-b07e-4ae1-8625-a979ed32bd07", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-528047864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f71610b3d00f412ea4aeba8068d032fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dfbe337-9e", "ovs_interfaceid": "1dfbe337-9efa-4a6a-9801-e9264673d095", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 16:14:27 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-1f926754-be0a-4241-83f5-76d3afbf72a5 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:18:f1,bridge_name='br-int',has_traffic_filtering=True,id=1dfbe337-9efa-4a6a-9801-e9264673d095,network=Network(0da0e0bd-b07e-4ae1-8625-a979ed32bd07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1dfbe337-9e') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 16:14:27 user nova-compute[75337]: DEBUG os_vif [None req-1f926754-be0a-4241-83f5-76d3afbf72a5 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:18:f1,bridge_name='br-int',has_traffic_filtering=True,id=1dfbe337-9efa-4a6a-9801-e9264673d095,network=Network(0da0e0bd-b07e-4ae1-8625-a979ed32bd07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1dfbe337-9e') {{(pid=75337) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 16:14:27 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:14:27 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 16:14:27 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 16:14:27 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:14:27 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '078ea53b-4d2e-5362-9a12-eed4347a8422', '_type': 'linux-noop'}}, row=False) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 16:14:27 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:14:27 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:14:27 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:14:27 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1dfbe337-9e, may_exist=True, interface_attrs={}) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 16:14:27 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1dfbe337-9e, col_values=(('qos', UUID('4cf55868-31a7-4c71-9605-148169ba73eb')),), if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 16:14:27 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1dfbe337-9e, col_values=(('external_ids', {'iface-id': '1dfbe337-9efa-4a6a-9801-e9264673d095', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fd:18:f1', 'vm-uuid': '525c87e5-14c3-40fd-8976-8df151ed07fa'}),), if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 16:14:27 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:14:27 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:14:27 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:14:27 user nova-compute[75337]: INFO os_vif [None req-1f926754-be0a-4241-83f5-76d3afbf72a5 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:18:f1,bridge_name='br-int',has_traffic_filtering=True,id=1dfbe337-9efa-4a6a-9801-e9264673d095,network=Network(0da0e0bd-b07e-4ae1-8625-a979ed32bd07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1dfbe337-9e')
Nov 06 16:14:27 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-1f926754-be0a-4241-83f5-76d3afbf72a5 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] No BDM found with device name vda, not building metadata. {{(pid=75337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 16:14:27 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-1f926754-be0a-4241-83f5-76d3afbf72a5 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] No VIF found with MAC fa:16:3e:fd:18:f1, not building metadata {{(pid=75337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 16:14:27 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-9fd0f904-99f7-437c-8c8a-1e194c93d7da tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de77f786-1ecf-4eac-ae4a-c4f6b1d47339/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:14:27 user nova-compute[75337]: DEBUG nova.virt.disk.api [None req-9fd0f904-99f7-437c-8c8a-1e194c93d7da tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Cannot resize image /opt/stack/data/nova/instances/de77f786-1ecf-4eac-ae4a-c4f6b1d47339/disk to a smaller size. {{(pid=75337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 06 16:14:27 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-9fd0f904-99f7-437c-8c8a-1e194c93d7da tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] [instance: de77f786-1ecf-4eac-ae4a-c4f6b1d47339] Created local disks {{(pid=75337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 16:14:27 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-9fd0f904-99f7-437c-8c8a-1e194c93d7da tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] [instance: de77f786-1ecf-4eac-ae4a-c4f6b1d47339] Ensure instance console log exists: /opt/stack/data/nova/instances/de77f786-1ecf-4eac-ae4a-c4f6b1d47339/console.log {{(pid=75337) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 16:14:27 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-9fd0f904-99f7-437c-8c8a-1e194c93d7da tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:14:27 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-9fd0f904-99f7-437c-8c8a-1e194c93d7da tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:14:27 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-9fd0f904-99f7-437c-8c8a-1e194c93d7da tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:14:28 user nova-compute[75337]: DEBUG nova.network.neutron [req-59a774ed-44be-457f-8c5b-4f5a4189dce3 req-3998f260-04f1-4762-aabe-29e41497c368 service nova] [instance: 525c87e5-14c3-40fd-8976-8df151ed07fa] Updated VIF entry in instance network info cache for port 1dfbe337-9efa-4a6a-9801-e9264673d095. {{(pid=75337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 16:14:28 user nova-compute[75337]: DEBUG nova.network.neutron [req-59a774ed-44be-457f-8c5b-4f5a4189dce3 req-3998f260-04f1-4762-aabe-29e41497c368 service nova] [instance: 525c87e5-14c3-40fd-8976-8df151ed07fa] Updating instance_info_cache with network_info: [{"id": "1dfbe337-9efa-4a6a-9801-e9264673d095", "address": "fa:16:3e:fd:18:f1", "network": {"id": "0da0e0bd-b07e-4ae1-8625-a979ed32bd07", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-528047864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f71610b3d00f412ea4aeba8068d032fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dfbe337-9e", "ovs_interfaceid": "1dfbe337-9efa-4a6a-9801-e9264673d095", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 16:14:28 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-59a774ed-44be-457f-8c5b-4f5a4189dce3 req-3998f260-04f1-4762-aabe-29e41497c368 service nova] Releasing lock "refresh_cache-525c87e5-14c3-40fd-8976-8df151ed07fa" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 16:14:28 user nova-compute[75337]: DEBUG nova.network.neutron [None req-9fd0f904-99f7-437c-8c8a-1e194c93d7da tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] [instance: de77f786-1ecf-4eac-ae4a-c4f6b1d47339] Successfully updated port: 8f33a5c0-50e1-4bac-a686-733daf33a307 {{(pid=75337) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 16:14:28 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-9fd0f904-99f7-437c-8c8a-1e194c93d7da tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Acquiring lock "refresh_cache-de77f786-1ecf-4eac-ae4a-c4f6b1d47339" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 16:14:28 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-9fd0f904-99f7-437c-8c8a-1e194c93d7da tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Acquired lock "refresh_cache-de77f786-1ecf-4eac-ae4a-c4f6b1d47339" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 16:14:28 user nova-compute[75337]: DEBUG nova.network.neutron [None req-9fd0f904-99f7-437c-8c8a-1e194c93d7da tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] [instance: de77f786-1ecf-4eac-ae4a-c4f6b1d47339] Building network info cache for instance {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 16:14:28 user nova-compute[75337]: DEBUG nova.compute.manager [req-4fb16512-b741-4a84-acf0-f4f694a06307 req-79c1f3f7-3729-4bda-a281-4aa636d034de service nova] [instance: de77f786-1ecf-4eac-ae4a-c4f6b1d47339] Received event network-changed-8f33a5c0-50e1-4bac-a686-733daf33a307 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:14:28 user nova-compute[75337]: DEBUG nova.compute.manager [req-4fb16512-b741-4a84-acf0-f4f694a06307 req-79c1f3f7-3729-4bda-a281-4aa636d034de service nova] [instance: de77f786-1ecf-4eac-ae4a-c4f6b1d47339] Refreshing instance network info cache due to event network-changed-8f33a5c0-50e1-4bac-a686-733daf33a307. {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 16:14:28 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-4fb16512-b741-4a84-acf0-f4f694a06307 req-79c1f3f7-3729-4bda-a281-4aa636d034de service nova] Acquiring lock "refresh_cache-de77f786-1ecf-4eac-ae4a-c4f6b1d47339" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 16:14:28 user nova-compute[75337]: DEBUG nova.network.neutron [None req-9fd0f904-99f7-437c-8c8a-1e194c93d7da tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] [instance: de77f786-1ecf-4eac-ae4a-c4f6b1d47339] Instance cache missing network info. {{(pid=75337) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 16:14:28 user nova-compute[75337]: DEBUG nova.network.neutron [None req-9fd0f904-99f7-437c-8c8a-1e194c93d7da tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] [instance: de77f786-1ecf-4eac-ae4a-c4f6b1d47339] Updating instance_info_cache with network_info: [{"id": "8f33a5c0-50e1-4bac-a686-733daf33a307", "address": "fa:16:3e:4b:fc:cf", "network": {"id": "0da0e0bd-b07e-4ae1-8625-a979ed32bd07", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-528047864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f71610b3d00f412ea4aeba8068d032fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f33a5c0-50", "ovs_interfaceid": "8f33a5c0-50e1-4bac-a686-733daf33a307", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 16:14:28 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-9fd0f904-99f7-437c-8c8a-1e194c93d7da tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Releasing lock "refresh_cache-de77f786-1ecf-4eac-ae4a-c4f6b1d47339" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 16:14:28 user nova-compute[75337]: DEBUG nova.compute.manager [None req-9fd0f904-99f7-437c-8c8a-1e194c93d7da tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] [instance: de77f786-1ecf-4eac-ae4a-c4f6b1d47339] Instance network_info: |[{"id": "8f33a5c0-50e1-4bac-a686-733daf33a307", "address": "fa:16:3e:4b:fc:cf", "network": {"id": "0da0e0bd-b07e-4ae1-8625-a979ed32bd07", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-528047864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f71610b3d00f412ea4aeba8068d032fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f33a5c0-50", "ovs_interfaceid": "8f33a5c0-50e1-4bac-a686-733daf33a307", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 16:14:28 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-4fb16512-b741-4a84-acf0-f4f694a06307 req-79c1f3f7-3729-4bda-a281-4aa636d034de service nova] Acquired lock "refresh_cache-de77f786-1ecf-4eac-ae4a-c4f6b1d47339" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 16:14:28 user nova-compute[75337]: DEBUG nova.network.neutron [req-4fb16512-b741-4a84-acf0-f4f694a06307 req-79c1f3f7-3729-4bda-a281-4aa636d034de service nova] [instance: de77f786-1ecf-4eac-ae4a-c4f6b1d47339] Refreshing network info cache for port 8f33a5c0-50e1-4bac-a686-733daf33a307 {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 16:14:28 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-9fd0f904-99f7-437c-8c8a-1e194c93d7da tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] [instance: de77f786-1ecf-4eac-ae4a-c4f6b1d47339] Start _get_guest_xml network_info=[{"id": "8f33a5c0-50e1-4bac-a686-733daf33a307", "address": "fa:16:3e:4b:fc:cf", "network": {"id": "0da0e0bd-b07e-4ae1-8625-a979ed32bd07", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-528047864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f71610b3d00f412ea4aeba8068d032fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f33a5c0-50", "ovs_interfaceid": "8f33a5c0-50e1-4bac-a686-733daf33a307", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T15:34:14Z,direct_url=<?>,disk_format='qcow2',id=16b903ae-a40f-41a7-985b-4804cce92c62,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6549a15819f1469bbd5eeae8190e3d44',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T15:34:15Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'guest_format': None, 'size': 0, 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '16b903ae-a40f-41a7-985b-4804cce92c62'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 16:14:28 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-9fd0f904-99f7-437c-8c8a-1e194c93d7da tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 16:14:28 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-9fd0f904-99f7-437c-8c8a-1e194c93d7da tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 16:14:28 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-9fd0f904-99f7-437c-8c8a-1e194c93d7da tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 16:14:28 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-9fd0f904-99f7-437c-8c8a-1e194c93d7da tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] CPU controller missing on host. {{(pid=75337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 16:14:28 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-9fd0f904-99f7-437c-8c8a-1e194c93d7da tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 16:14:28 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-9fd0f904-99f7-437c-8c8a-1e194c93d7da tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] CPU controller found on host. {{(pid=75337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 16:14:28 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-9fd0f904-99f7-437c-8c8a-1e194c93d7da tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75337) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 16:14:28 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-9fd0f904-99f7-437c-8c8a-1e194c93d7da tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T15:34:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T15:34:14Z,direct_url=<?>,disk_format='qcow2',id=16b903ae-a40f-41a7-985b-4804cce92c62,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6549a15819f1469bbd5eeae8190e3d44',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T15:34:15Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 16:14:28 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-9fd0f904-99f7-437c-8c8a-1e194c93d7da tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Flavor limits 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 16:14:28 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-9fd0f904-99f7-437c-8c8a-1e194c93d7da tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Image limits 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 16:14:28 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-9fd0f904-99f7-437c-8c8a-1e194c93d7da tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Flavor pref 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 16:14:28 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-9fd0f904-99f7-437c-8c8a-1e194c93d7da tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Image pref 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 16:14:28 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-9fd0f904-99f7-437c-8c8a-1e194c93d7da tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 16:14:28 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-9fd0f904-99f7-437c-8c8a-1e194c93d7da tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 16:14:28 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-9fd0f904-99f7-437c-8c8a-1e194c93d7da tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 16:14:28 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-9fd0f904-99f7-437c-8c8a-1e194c93d7da tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Got 1 possible topologies {{(pid=75337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 16:14:28 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-9fd0f904-99f7-437c-8c8a-1e194c93d7da tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 16:14:28 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-9fd0f904-99f7-437c-8c8a-1e194c93d7da tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 16:14:28 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-9fd0f904-99f7-437c-8c8a-1e194c93d7da tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T16:14:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1866514788',display_name='tempest-ServerRescueNegativeTestJSON-server-1866514788',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1866514788',id=50,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f71610b3d00f412ea4aeba8068d032fc',ramdisk_id='',reservation_id='r-b48pf70m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1763914139',owner_user_name='tempest-ServerRescueNegativeTestJSON-1763914139-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T16:14:27Z,user_data=None,user_id='22979798bd154fd3af622e408520e95c',uuid=de77f786-1ecf-4eac-ae4a-c4f6b1d47339,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8f33a5c0-50e1-4bac-a686-733daf33a307", "address": "fa:16:3e:4b:fc:cf", "network": {"id": "0da0e0bd-b07e-4ae1-8625-a979ed32bd07", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-528047864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f71610b3d00f412ea4aeba8068d032fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f33a5c0-50", "ovs_interfaceid": "8f33a5c0-50e1-4bac-a686-733daf33a307", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75337) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 16:14:28 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-9fd0f904-99f7-437c-8c8a-1e194c93d7da tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Converting VIF {"id": "8f33a5c0-50e1-4bac-a686-733daf33a307", "address": "fa:16:3e:4b:fc:cf", "network": {"id": "0da0e0bd-b07e-4ae1-8625-a979ed32bd07", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-528047864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f71610b3d00f412ea4aeba8068d032fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f33a5c0-50", "ovs_interfaceid": "8f33a5c0-50e1-4bac-a686-733daf33a307", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 16:14:28 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-9fd0f904-99f7-437c-8c8a-1e194c93d7da tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:fc:cf,bridge_name='br-int',has_traffic_filtering=True,id=8f33a5c0-50e1-4bac-a686-733daf33a307,network=Network(0da0e0bd-b07e-4ae1-8625-a979ed32bd07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f33a5c0-50') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 16:14:28 user nova-compute[75337]: DEBUG nova.objects.instance [None req-9fd0f904-99f7-437c-8c8a-1e194c93d7da tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Lazy-loading 'pci_devices' on Instance uuid de77f786-1ecf-4eac-ae4a-c4f6b1d47339 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 16:14:28 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-9fd0f904-99f7-437c-8c8a-1e194c93d7da tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] [instance: de77f786-1ecf-4eac-ae4a-c4f6b1d47339] End _get_guest_xml xml=<domain type="kvm">
Nov 06 16:14:28 user nova-compute[75337]:   <uuid>de77f786-1ecf-4eac-ae4a-c4f6b1d47339</uuid>
Nov 06 16:14:28 user nova-compute[75337]:   <name>instance-00000032</name>
Nov 06 16:14:28 user nova-compute[75337]:   <memory>524288</memory>
Nov 06 16:14:28 user nova-compute[75337]:   <vcpu>1</vcpu>
Nov 06 16:14:28 user nova-compute[75337]:   <metadata>
Nov 06 16:14:28 user nova-compute[75337]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 16:14:28 user nova-compute[75337]:       <nova:package version="0.0.0"/>
Nov 06 16:14:28 user nova-compute[75337]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1866514788</nova:name>
Nov 06 16:14:28 user nova-compute[75337]:       <nova:creationTime>2023-11-06 16:14:28</nova:creationTime>
Nov 06 16:14:28 user nova-compute[75337]:       <nova:flavor name="m1.tiny">
Nov 06 16:14:28 user nova-compute[75337]:         <nova:memory>512</nova:memory>
Nov 06 16:14:28 user nova-compute[75337]:         <nova:disk>1</nova:disk>
Nov 06 16:14:28 user nova-compute[75337]:         <nova:swap>0</nova:swap>
Nov 06 16:14:28 user nova-compute[75337]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 16:14:28 user nova-compute[75337]:         <nova:vcpus>1</nova:vcpus>
Nov 06 16:14:28 user nova-compute[75337]:       </nova:flavor>
Nov 06 16:14:28 user nova-compute[75337]:       <nova:owner>
Nov 06 16:14:28 user nova-compute[75337]:         <nova:user uuid="22979798bd154fd3af622e408520e95c">tempest-ServerRescueNegativeTestJSON-1763914139-project-member</nova:user>
Nov 06 16:14:28 user nova-compute[75337]:         <nova:project uuid="f71610b3d00f412ea4aeba8068d032fc">tempest-ServerRescueNegativeTestJSON-1763914139</nova:project>
Nov 06 16:14:28 user nova-compute[75337]:       </nova:owner>
Nov 06 16:14:28 user nova-compute[75337]:       <nova:root type="image" uuid="16b903ae-a40f-41a7-985b-4804cce92c62"/>
Nov 06 16:14:28 user nova-compute[75337]:       <nova:ports>
Nov 06 16:14:28 user nova-compute[75337]:         <nova:port uuid="8f33a5c0-50e1-4bac-a686-733daf33a307">
Nov 06 16:14:28 user nova-compute[75337]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 06 16:14:28 user nova-compute[75337]:         </nova:port>
Nov 06 16:14:28 user nova-compute[75337]:       </nova:ports>
Nov 06 16:14:28 user nova-compute[75337]:     </nova:instance>
Nov 06 16:14:28 user nova-compute[75337]:   </metadata>
Nov 06 16:14:28 user nova-compute[75337]:   <sysinfo type="smbios">
Nov 06 16:14:28 user nova-compute[75337]:     <system>
Nov 06 16:14:28 user nova-compute[75337]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 16:14:28 user nova-compute[75337]:       <entry name="product">OpenStack Nova</entry>
Nov 06 16:14:28 user nova-compute[75337]:       <entry name="version">0.0.0</entry>
Nov 06 16:14:28 user nova-compute[75337]:       <entry name="serial">de77f786-1ecf-4eac-ae4a-c4f6b1d47339</entry>
Nov 06 16:14:28 user nova-compute[75337]:       <entry name="uuid">de77f786-1ecf-4eac-ae4a-c4f6b1d47339</entry>
Nov 06 16:14:28 user nova-compute[75337]:       <entry name="family">Virtual Machine</entry>
Nov 06 16:14:28 user nova-compute[75337]:     </system>
Nov 06 16:14:28 user nova-compute[75337]:   </sysinfo>
Nov 06 16:14:28 user nova-compute[75337]:   <os>
Nov 06 16:14:28 user nova-compute[75337]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 16:14:28 user nova-compute[75337]:     <boot dev="hd"/>
Nov 06 16:14:28 user nova-compute[75337]:     <smbios mode="sysinfo"/>
Nov 06 16:14:28 user nova-compute[75337]:   </os>
Nov 06 16:14:28 user nova-compute[75337]:   <features>
Nov 06 16:14:28 user nova-compute[75337]:     <acpi/>
Nov 06 16:14:28 user nova-compute[75337]:     <apic/>
Nov 06 16:14:28 user nova-compute[75337]:     <vmcoreinfo/>
Nov 06 16:14:28 user nova-compute[75337]:   </features>
Nov 06 16:14:28 user nova-compute[75337]:   <clock offset="utc">
Nov 06 16:14:28 user nova-compute[75337]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 16:14:28 user nova-compute[75337]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 16:14:28 user nova-compute[75337]:     <timer name="hpet" present="no"/>
Nov 06 16:14:28 user nova-compute[75337]:   </clock>
Nov 06 16:14:28 user nova-compute[75337]:   <cpu mode="custom" match="exact">
Nov 06 16:14:28 user nova-compute[75337]:     <model>Nehalem</model>
Nov 06 16:14:28 user nova-compute[75337]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 16:14:28 user nova-compute[75337]:   </cpu>
Nov 06 16:14:28 user nova-compute[75337]:   <devices>
Nov 06 16:14:28 user nova-compute[75337]:     <disk type="file" device="disk">
Nov 06 16:14:28 user nova-compute[75337]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 16:14:28 user nova-compute[75337]:       <source file="/opt/stack/data/nova/instances/de77f786-1ecf-4eac-ae4a-c4f6b1d47339/disk"/>
Nov 06 16:14:28 user nova-compute[75337]:       <target dev="vda" bus="virtio"/>
Nov 06 16:14:28 user nova-compute[75337]:     </disk>
Nov 06 16:14:28 user nova-compute[75337]:     <interface type="ethernet">
Nov 06 16:14:28 user nova-compute[75337]:       <mac address="fa:16:3e:4b:fc:cf"/>
Nov 06 16:14:28 user nova-compute[75337]:       <model type="virtio"/>
Nov 06 16:14:28 user nova-compute[75337]:       <mtu size="1442"/>
Nov 06 16:14:28 user nova-compute[75337]:       <target dev="tap8f33a5c0-50"/>
Nov 06 16:14:28 user nova-compute[75337]:     </interface>
Nov 06 16:14:28 user nova-compute[75337]:     <serial type="pty">
Nov 06 16:14:28 user nova-compute[75337]:       <log file="/opt/stack/data/nova/instances/de77f786-1ecf-4eac-ae4a-c4f6b1d47339/console.log" append="off"/>
Nov 06 16:14:28 user nova-compute[75337]:     </serial>
Nov 06 16:14:28 user nova-compute[75337]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 16:14:28 user nova-compute[75337]:     <video>
Nov 06 16:14:28 user nova-compute[75337]:       <model type="virtio"/>
Nov 06 16:14:28 user nova-compute[75337]:     </video>
Nov 06 16:14:28 user nova-compute[75337]:     <rng model="virtio">
Nov 06 16:14:28 user nova-compute[75337]:       <backend model="random">/dev/urandom</backend>
Nov 06 16:14:28 user nova-compute[75337]:     </rng>
Nov 06 16:14:28 user nova-compute[75337]:     <controller type="usb" index="0" model="none"/>
Nov 06 16:14:28 user nova-compute[75337]:     <memballoon model="virtio">
Nov 06 16:14:28 user nova-compute[75337]:       <stats period="10"/>
Nov 06 16:14:28 user nova-compute[75337]:     </memballoon>
Nov 06 16:14:28 user nova-compute[75337]:   </devices>
Nov 06 16:14:28 user nova-compute[75337]: </domain>
Nov 06 16:14:28 user nova-compute[75337]:  {{(pid=75337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 16:14:28 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-9fd0f904-99f7-437c-8c8a-1e194c93d7da tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T16:14:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1866514788',display_name='tempest-ServerRescueNegativeTestJSON-server-1866514788',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1866514788',id=50,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f71610b3d00f412ea4aeba8068d032fc',ramdisk_id='',reservation_id='r-b48pf70m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1763914139',owner_user_name='tempest-ServerRescueNegativeTestJSON-1763914139-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T16:14:27Z,user_data=None,user_id='22979798bd154fd3af622e408520e95c',uuid=de77f786-1ecf-4eac-ae4a-c4f6b1d47339,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8f33a5c0-50e1-4bac-a686-733daf33a307", "address": "fa:16:3e:4b:fc:cf", "network": {"id": "0da0e0bd-b07e-4ae1-8625-a979ed32bd07", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-528047864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f71610b3d00f412ea4aeba8068d032fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f33a5c0-50", "ovs_interfaceid": "8f33a5c0-50e1-4bac-a686-733daf33a307", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 16:14:28 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-9fd0f904-99f7-437c-8c8a-1e194c93d7da tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Converting VIF {"id": "8f33a5c0-50e1-4bac-a686-733daf33a307", "address": "fa:16:3e:4b:fc:cf", "network": {"id": "0da0e0bd-b07e-4ae1-8625-a979ed32bd07", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-528047864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f71610b3d00f412ea4aeba8068d032fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f33a5c0-50", "ovs_interfaceid": "8f33a5c0-50e1-4bac-a686-733daf33a307", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 16:14:28 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-9fd0f904-99f7-437c-8c8a-1e194c93d7da tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:fc:cf,bridge_name='br-int',has_traffic_filtering=True,id=8f33a5c0-50e1-4bac-a686-733daf33a307,network=Network(0da0e0bd-b07e-4ae1-8625-a979ed32bd07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f33a5c0-50') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 16:14:28 user nova-compute[75337]: DEBUG os_vif [None req-9fd0f904-99f7-437c-8c8a-1e194c93d7da tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:fc:cf,bridge_name='br-int',has_traffic_filtering=True,id=8f33a5c0-50e1-4bac-a686-733daf33a307,network=Network(0da0e0bd-b07e-4ae1-8625-a979ed32bd07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f33a5c0-50') {{(pid=75337) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 16:14:28 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:14:28 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 16:14:28 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 16:14:28 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:14:28 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd76993c8-2c37-5668-8910-61200ebea473', '_type': 'linux-noop'}}, row=False) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 16:14:28 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:14:28 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:14:28 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:14:28 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:14:28 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8f33a5c0-50, may_exist=True, interface_attrs={}) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 16:14:28 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8f33a5c0-50, col_values=(('qos', UUID('61ed3663-738b-4c71-9858-2c1979a30f7b')),), if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 16:14:28 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8f33a5c0-50, col_values=(('external_ids', {'iface-id': '8f33a5c0-50e1-4bac-a686-733daf33a307', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4b:fc:cf', 'vm-uuid': 'de77f786-1ecf-4eac-ae4a-c4f6b1d47339'}),), if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 16:14:28 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:14:28 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:14:28 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:14:28 user nova-compute[75337]: INFO os_vif [None req-9fd0f904-99f7-437c-8c8a-1e194c93d7da tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:fc:cf,bridge_name='br-int',has_traffic_filtering=True,id=8f33a5c0-50e1-4bac-a686-733daf33a307,network=Network(0da0e0bd-b07e-4ae1-8625-a979ed32bd07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f33a5c0-50')
Nov 06 16:14:28 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-9fd0f904-99f7-437c-8c8a-1e194c93d7da tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] No BDM found with device name vda, not building metadata. {{(pid=75337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 16:14:28 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-9fd0f904-99f7-437c-8c8a-1e194c93d7da tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] No VIF found with MAC fa:16:3e:4b:fc:cf, not building metadata {{(pid=75337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 16:14:28 user nova-compute[75337]: DEBUG nova.network.neutron [req-4fb16512-b741-4a84-acf0-f4f694a06307 req-79c1f3f7-3729-4bda-a281-4aa636d034de service nova] [instance: de77f786-1ecf-4eac-ae4a-c4f6b1d47339] Updated VIF entry in instance network info cache for port 8f33a5c0-50e1-4bac-a686-733daf33a307. {{(pid=75337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 16:14:28 user nova-compute[75337]: DEBUG nova.network.neutron [req-4fb16512-b741-4a84-acf0-f4f694a06307 req-79c1f3f7-3729-4bda-a281-4aa636d034de service nova] [instance: de77f786-1ecf-4eac-ae4a-c4f6b1d47339] Updating instance_info_cache with network_info: [{"id": "8f33a5c0-50e1-4bac-a686-733daf33a307", "address": "fa:16:3e:4b:fc:cf", "network": {"id": "0da0e0bd-b07e-4ae1-8625-a979ed32bd07", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-528047864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f71610b3d00f412ea4aeba8068d032fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f33a5c0-50", "ovs_interfaceid": "8f33a5c0-50e1-4bac-a686-733daf33a307", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 16:14:28 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-4fb16512-b741-4a84-acf0-f4f694a06307 req-79c1f3f7-3729-4bda-a281-4aa636d034de service nova] Releasing lock "refresh_cache-de77f786-1ecf-4eac-ae4a-c4f6b1d47339" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 16:14:29 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:14:29 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:14:29 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:14:29 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:14:29 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:14:29 user nova-compute[75337]: DEBUG nova.compute.manager [req-62ece2ae-0abd-4c0d-890f-c79d7b6ea372 req-84a865ae-4694-46b7-916b-ac2803b96bc1 service nova] [instance: 525c87e5-14c3-40fd-8976-8df151ed07fa] Received event network-vif-plugged-1dfbe337-9efa-4a6a-9801-e9264673d095 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:14:29 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-62ece2ae-0abd-4c0d-890f-c79d7b6ea372 req-84a865ae-4694-46b7-916b-ac2803b96bc1 service nova] Acquiring lock "525c87e5-14c3-40fd-8976-8df151ed07fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:14:29 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-62ece2ae-0abd-4c0d-890f-c79d7b6ea372 req-84a865ae-4694-46b7-916b-ac2803b96bc1 service nova] Lock "525c87e5-14c3-40fd-8976-8df151ed07fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:14:29 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-62ece2ae-0abd-4c0d-890f-c79d7b6ea372 req-84a865ae-4694-46b7-916b-ac2803b96bc1 service nova] Lock "525c87e5-14c3-40fd-8976-8df151ed07fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:14:29 user nova-compute[75337]: DEBUG nova.compute.manager [req-62ece2ae-0abd-4c0d-890f-c79d7b6ea372 req-84a865ae-4694-46b7-916b-ac2803b96bc1 service nova] [instance: 525c87e5-14c3-40fd-8976-8df151ed07fa] No waiting events found dispatching network-vif-plugged-1dfbe337-9efa-4a6a-9801-e9264673d095 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 16:14:29 user nova-compute[75337]: WARNING nova.compute.manager [req-62ece2ae-0abd-4c0d-890f-c79d7b6ea372 req-84a865ae-4694-46b7-916b-ac2803b96bc1 service nova] [instance: 525c87e5-14c3-40fd-8976-8df151ed07fa] Received unexpected event network-vif-plugged-1dfbe337-9efa-4a6a-9801-e9264673d095 for instance with vm_state building and task_state spawning.
Nov 06 16:14:30 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:14:30 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:14:30 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:14:30 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:14:30 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:14:30 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:14:30 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:14:30 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:14:30 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:14:31 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:14:31 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:14:31 user nova-compute[75337]: DEBUG nova.compute.manager [req-26337b83-069b-463a-b6e0-77d0e78f93ff req-3b3742e1-32ee-4b16-bc6c-100f39e34a1c service nova] [instance: 525c87e5-14c3-40fd-8976-8df151ed07fa] Received event network-vif-plugged-1dfbe337-9efa-4a6a-9801-e9264673d095 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:14:31 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-26337b83-069b-463a-b6e0-77d0e78f93ff req-3b3742e1-32ee-4b16-bc6c-100f39e34a1c service nova] Acquiring lock "525c87e5-14c3-40fd-8976-8df151ed07fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:14:31 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-26337b83-069b-463a-b6e0-77d0e78f93ff req-3b3742e1-32ee-4b16-bc6c-100f39e34a1c service nova] Lock "525c87e5-14c3-40fd-8976-8df151ed07fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:14:31 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-26337b83-069b-463a-b6e0-77d0e78f93ff req-3b3742e1-32ee-4b16-bc6c-100f39e34a1c service nova] Lock "525c87e5-14c3-40fd-8976-8df151ed07fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:14:31 user nova-compute[75337]: DEBUG nova.compute.manager [req-26337b83-069b-463a-b6e0-77d0e78f93ff req-3b3742e1-32ee-4b16-bc6c-100f39e34a1c service nova] [instance: 525c87e5-14c3-40fd-8976-8df151ed07fa] No waiting events found dispatching network-vif-plugged-1dfbe337-9efa-4a6a-9801-e9264673d095 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 16:14:31 user nova-compute[75337]: WARNING nova.compute.manager [req-26337b83-069b-463a-b6e0-77d0e78f93ff req-3b3742e1-32ee-4b16-bc6c-100f39e34a1c service nova] [instance: 525c87e5-14c3-40fd-8976-8df151ed07fa] Received unexpected event network-vif-plugged-1dfbe337-9efa-4a6a-9801-e9264673d095 for instance with vm_state building and task_state spawning.
Nov 06 16:14:31 user nova-compute[75337]: DEBUG nova.compute.manager [req-26337b83-069b-463a-b6e0-77d0e78f93ff req-3b3742e1-32ee-4b16-bc6c-100f39e34a1c service nova] [instance: de77f786-1ecf-4eac-ae4a-c4f6b1d47339] Received event network-vif-plugged-8f33a5c0-50e1-4bac-a686-733daf33a307 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:14:31 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-26337b83-069b-463a-b6e0-77d0e78f93ff req-3b3742e1-32ee-4b16-bc6c-100f39e34a1c service nova] Acquiring lock "de77f786-1ecf-4eac-ae4a-c4f6b1d47339-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:14:31 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-26337b83-069b-463a-b6e0-77d0e78f93ff req-3b3742e1-32ee-4b16-bc6c-100f39e34a1c service nova] Lock "de77f786-1ecf-4eac-ae4a-c4f6b1d47339-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:14:31 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-26337b83-069b-463a-b6e0-77d0e78f93ff req-3b3742e1-32ee-4b16-bc6c-100f39e34a1c service nova] Lock "de77f786-1ecf-4eac-ae4a-c4f6b1d47339-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:14:31 user nova-compute[75337]: DEBUG nova.compute.manager [req-26337b83-069b-463a-b6e0-77d0e78f93ff req-3b3742e1-32ee-4b16-bc6c-100f39e34a1c service nova] [instance: de77f786-1ecf-4eac-ae4a-c4f6b1d47339] No waiting events found dispatching network-vif-plugged-8f33a5c0-50e1-4bac-a686-733daf33a307 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 16:14:31 user nova-compute[75337]: WARNING nova.compute.manager [req-26337b83-069b-463a-b6e0-77d0e78f93ff req-3b3742e1-32ee-4b16-bc6c-100f39e34a1c service nova] [instance: de77f786-1ecf-4eac-ae4a-c4f6b1d47339] Received unexpected event network-vif-plugged-8f33a5c0-50e1-4bac-a686-733daf33a307 for instance with vm_state building and task_state spawning.
Nov 06 16:14:31 user nova-compute[75337]: DEBUG nova.compute.manager [req-26337b83-069b-463a-b6e0-77d0e78f93ff req-3b3742e1-32ee-4b16-bc6c-100f39e34a1c service nova] [instance: de77f786-1ecf-4eac-ae4a-c4f6b1d47339] Received event network-vif-plugged-8f33a5c0-50e1-4bac-a686-733daf33a307 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:14:31 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-26337b83-069b-463a-b6e0-77d0e78f93ff req-3b3742e1-32ee-4b16-bc6c-100f39e34a1c service nova] Acquiring lock "de77f786-1ecf-4eac-ae4a-c4f6b1d47339-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:14:31 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-26337b83-069b-463a-b6e0-77d0e78f93ff req-3b3742e1-32ee-4b16-bc6c-100f39e34a1c service nova] Lock "de77f786-1ecf-4eac-ae4a-c4f6b1d47339-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:14:31 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-26337b83-069b-463a-b6e0-77d0e78f93ff req-3b3742e1-32ee-4b16-bc6c-100f39e34a1c service nova] Lock "de77f786-1ecf-4eac-ae4a-c4f6b1d47339-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:14:31 user nova-compute[75337]: DEBUG nova.compute.manager [req-26337b83-069b-463a-b6e0-77d0e78f93ff req-3b3742e1-32ee-4b16-bc6c-100f39e34a1c service nova] [instance: de77f786-1ecf-4eac-ae4a-c4f6b1d47339] No waiting events found dispatching network-vif-plugged-8f33a5c0-50e1-4bac-a686-733daf33a307 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 16:14:31 user nova-compute[75337]: WARNING nova.compute.manager [req-26337b83-069b-463a-b6e0-77d0e78f93ff req-3b3742e1-32ee-4b16-bc6c-100f39e34a1c service nova] [instance: de77f786-1ecf-4eac-ae4a-c4f6b1d47339] Received unexpected event network-vif-plugged-8f33a5c0-50e1-4bac-a686-733daf33a307 for instance with vm_state building and task_state spawning.
Nov 06 16:14:32 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:14:32 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Starting heal instance info cache {{(pid=75337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 16:14:32 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Rebuilding the list of instances to heal {{(pid=75337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 06 16:14:32 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] [instance: 525c87e5-14c3-40fd-8976-8df151ed07fa] Skipping network cache update for instance because it is Building. {{(pid=75337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 06 16:14:32 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] [instance: de77f786-1ecf-4eac-ae4a-c4f6b1d47339] Skipping network cache update for instance because it is Building. {{(pid=75337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 06 16:14:32 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "refresh_cache-88330c21-69e0-4d82-ac4d-b9e5e849f487" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 16:14:32 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquired lock "refresh_cache-88330c21-69e0-4d82-ac4d-b9e5e849f487" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 16:14:32 user nova-compute[75337]: DEBUG nova.network.neutron [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] [instance: 88330c21-69e0-4d82-ac4d-b9e5e849f487] Forcefully refreshing network info cache for instance {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 16:14:32 user nova-compute[75337]: DEBUG nova.objects.instance [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lazy-loading 'info_cache' on Instance uuid 88330c21-69e0-4d82-ac4d-b9e5e849f487 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 16:14:32 user nova-compute[75337]: DEBUG nova.compute.manager [None req-1f926754-be0a-4241-83f5-76d3afbf72a5 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] [instance: 525c87e5-14c3-40fd-8976-8df151ed07fa] Instance event wait completed in 0 seconds for  {{(pid=75337) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 16:14:32 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-1f926754-be0a-4241-83f5-76d3afbf72a5 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] [instance: 525c87e5-14c3-40fd-8976-8df151ed07fa] Guest created on hypervisor {{(pid=75337) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 16:14:32 user nova-compute[75337]: INFO nova.virt.libvirt.driver [-] [instance: 525c87e5-14c3-40fd-8976-8df151ed07fa] Instance spawned successfully.
Nov 06 16:14:32 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-1f926754-be0a-4241-83f5-76d3afbf72a5 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] [instance: 525c87e5-14c3-40fd-8976-8df151ed07fa] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 16:14:32 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-1f926754-be0a-4241-83f5-76d3afbf72a5 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] [instance: 525c87e5-14c3-40fd-8976-8df151ed07fa] Found default for hw_cdrom_bus of ide {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 16:14:32 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-1f926754-be0a-4241-83f5-76d3afbf72a5 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] [instance: 525c87e5-14c3-40fd-8976-8df151ed07fa] Found default for hw_disk_bus of virtio {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 16:14:32 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-1f926754-be0a-4241-83f5-76d3afbf72a5 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] [instance: 525c87e5-14c3-40fd-8976-8df151ed07fa] Found default for hw_input_bus of None {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 16:14:32 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-1f926754-be0a-4241-83f5-76d3afbf72a5 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] [instance: 525c87e5-14c3-40fd-8976-8df151ed07fa] Found default for hw_pointer_model of None {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 16:14:32 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-1f926754-be0a-4241-83f5-76d3afbf72a5 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] [instance: 525c87e5-14c3-40fd-8976-8df151ed07fa] Found default for hw_video_model of virtio {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 16:14:32 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-1f926754-be0a-4241-83f5-76d3afbf72a5 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] [instance: 525c87e5-14c3-40fd-8976-8df151ed07fa] Found default for hw_vif_model of virtio {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 16:14:32 user nova-compute[75337]: DEBUG nova.compute.manager [None req-9fd0f904-99f7-437c-8c8a-1e194c93d7da tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] [instance: de77f786-1ecf-4eac-ae4a-c4f6b1d47339] Instance event wait completed in 0 seconds for  {{(pid=75337) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 16:14:32 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-9fd0f904-99f7-437c-8c8a-1e194c93d7da tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] [instance: de77f786-1ecf-4eac-ae4a-c4f6b1d47339] Guest created on hypervisor {{(pid=75337) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 16:14:32 user nova-compute[75337]: INFO nova.virt.libvirt.driver [-] [instance: de77f786-1ecf-4eac-ae4a-c4f6b1d47339] Instance spawned successfully.
Nov 06 16:14:32 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-9fd0f904-99f7-437c-8c8a-1e194c93d7da tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] [instance: de77f786-1ecf-4eac-ae4a-c4f6b1d47339] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 16:14:32 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-9fd0f904-99f7-437c-8c8a-1e194c93d7da tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] [instance: de77f786-1ecf-4eac-ae4a-c4f6b1d47339] Found default for hw_cdrom_bus of ide {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 16:14:32 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-9fd0f904-99f7-437c-8c8a-1e194c93d7da tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] [instance: de77f786-1ecf-4eac-ae4a-c4f6b1d47339] Found default for hw_disk_bus of virtio {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 16:14:32 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-9fd0f904-99f7-437c-8c8a-1e194c93d7da tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] [instance: de77f786-1ecf-4eac-ae4a-c4f6b1d47339] Found default for hw_input_bus of None {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 16:14:32 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-9fd0f904-99f7-437c-8c8a-1e194c93d7da tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] [instance: de77f786-1ecf-4eac-ae4a-c4f6b1d47339] Found default for hw_pointer_model of None {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 16:14:32 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-9fd0f904-99f7-437c-8c8a-1e194c93d7da tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] [instance: de77f786-1ecf-4eac-ae4a-c4f6b1d47339] Found default for hw_video_model of virtio {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 16:14:32 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-9fd0f904-99f7-437c-8c8a-1e194c93d7da tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] [instance: de77f786-1ecf-4eac-ae4a-c4f6b1d47339] Found default for hw_vif_model of virtio {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 16:14:33 user nova-compute[75337]: INFO nova.compute.manager [None req-1f926754-be0a-4241-83f5-76d3afbf72a5 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] [instance: 525c87e5-14c3-40fd-8976-8df151ed07fa] Took 7.32 seconds to spawn the instance on the hypervisor.
Nov 06 16:14:33 user nova-compute[75337]: DEBUG nova.compute.manager [None req-1f926754-be0a-4241-83f5-76d3afbf72a5 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] [instance: 525c87e5-14c3-40fd-8976-8df151ed07fa] Checking state {{(pid=75337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 16:14:33 user nova-compute[75337]: INFO nova.compute.manager [None req-9fd0f904-99f7-437c-8c8a-1e194c93d7da tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] [instance: de77f786-1ecf-4eac-ae4a-c4f6b1d47339] Took 6.04 seconds to spawn the instance on the hypervisor.
Nov 06 16:14:33 user nova-compute[75337]: DEBUG nova.compute.manager [None req-9fd0f904-99f7-437c-8c8a-1e194c93d7da tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] [instance: de77f786-1ecf-4eac-ae4a-c4f6b1d47339] Checking state {{(pid=75337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 16:14:33 user nova-compute[75337]: INFO nova.compute.manager [None req-1f926754-be0a-4241-83f5-76d3afbf72a5 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] [instance: 525c87e5-14c3-40fd-8976-8df151ed07fa] Took 7.93 seconds to build instance.
Nov 06 16:14:33 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-1f926754-be0a-4241-83f5-76d3afbf72a5 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Lock "525c87e5-14c3-40fd-8976-8df151ed07fa" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.034s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:14:33 user nova-compute[75337]: INFO nova.compute.manager [None req-9fd0f904-99f7-437c-8c8a-1e194c93d7da tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] [instance: de77f786-1ecf-4eac-ae4a-c4f6b1d47339] Took 7.17 seconds to build instance.
Nov 06 16:14:33 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-9fd0f904-99f7-437c-8c8a-1e194c93d7da tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Lock "de77f786-1ecf-4eac-ae4a-c4f6b1d47339" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.308s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:14:33 user nova-compute[75337]: DEBUG nova.network.neutron [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] [instance: 88330c21-69e0-4d82-ac4d-b9e5e849f487] Updating instance_info_cache with network_info: [{"id": "4ae4cf27-266c-40f8-a268-1d03f150f318", "address": "fa:16:3e:d4:3f:d4", "network": {"id": "40ec2d9f-fe05-45bb-8321-e065c7c5cab0", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-863555405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b8417f9bf0f4ccbbcb9823c8825a3d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ae4cf27-26", "ovs_interfaceid": "4ae4cf27-266c-40f8-a268-1d03f150f318", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 16:14:33 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Releasing lock "refresh_cache-88330c21-69e0-4d82-ac4d-b9e5e849f487" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 16:14:33 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] [instance: 88330c21-69e0-4d82-ac4d-b9e5e849f487] Updated the network info_cache for instance {{(pid=75337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 16:14:33 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:14:35 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:14:35 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:14:35 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-5f224796-5239-44ac-84a2-887b2679bc8b tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 88330c21-69e0-4d82-ac4d-b9e5e849f487 is timed out.
Nov 06 16:14:35 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-5f224796-5239-44ac-84a2-887b2679bc8b tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Successfully detached device vdb from instance 88330c21-69e0-4d82-ac4d-b9e5e849f487 from the live domain config.
Nov 06 16:14:35 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5f224796-5239-44ac-84a2-887b2679bc8b tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] [instance: 88330c21-69e0-4d82-ac4d-b9e5e849f487] calling os-brick to detach iSCSI Volume {{(pid=75337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 16:14:35 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f224796-5239-44ac-84a2-887b2679bc8b tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2abc33d0c0>, {'target_iqn': 'iqn.2010-10.org.openstack:831ff3d4-9d1e-465b-a878-2688b7c38078', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bOeXiMDV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 16:14:35 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-5f224796-5239-44ac-84a2-887b2679bc8b tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 16:14:35 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-5f224796-5239-44ac-84a2-887b2679bc8b tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 16:14:35 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-5f224796-5239-44ac-84a2-887b2679bc8b tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 16:14:35 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:14:35 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:14:35 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0b7647f-1672-43ba-b98b-1d005b241998]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:06b3b613-3c1e-4420-a500-1ec3988c0940\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:831ff3d4-9d1e-465b-a878-2688b7c38078\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:14:35 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f224796-5239-44ac-84a2-887b2679bc8b tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 16:14:35 user nova-compute[75337]: No targets found.
Nov 06 16:14:35 user nova-compute[75337]: iSNS:
Nov 06 16:14:35 user nova-compute[75337]: No targets found.
Nov 06 16:14:35 user nova-compute[75337]: STATIC:
Nov 06 16:14:35 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:06b3b613-3c1e-4420-a500-1ec3988c0940
Nov 06 16:14:35 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 16:14:35 user nova-compute[75337]:                 Iface Name: default
Nov 06 16:14:35 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:831ff3d4-9d1e-465b-a878-2688b7c38078
Nov 06 16:14:35 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 16:14:35 user nova-compute[75337]:                 Iface Name: default
Nov 06 16:14:35 user nova-compute[75337]: FIRMWARE:
Nov 06 16:14:35 user nova-compute[75337]: No targets found.
Nov 06 16:14:35 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 16:14:35 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f224796-5239-44ac-84a2-887b2679bc8b tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 16:14:35 user nova-compute[75337]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 16:14:35 user nova-compute[75337]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75337) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 16:14:35 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f224796-5239-44ac-84a2-887b2679bc8b tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:831ff3d4-9d1e-465b-a878-2688b7c38078', 0)] {{(pid=75337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 16:14:35 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:14:35 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:14:35 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[21ad36dc-54b0-4d47-94fb-9565a5673250]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:06b3b613-3c1e-4420-a500-1ec3988c0940\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:831ff3d4-9d1e-465b-a878-2688b7c38078\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:14:35 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:14:35 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:14:35 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b813ed5-8354-4116-994b-5ea63d2cbd0b]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06b3b613-3c1e-4420-a500-1ec3988c0940 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:831ff3d4-9d1e-465b-a878-2688b7c38078 (non-flash)\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:14:35 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f224796-5239-44ac-84a2-887b2679bc8b tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06b3b613-3c1e-4420-a500-1ec3988c0940 (non-flash)
Nov 06 16:14:35 user nova-compute[75337]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:831ff3d4-9d1e-465b-a878-2688b7c38078 (non-flash)
Nov 06 16:14:35 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 16:14:35 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f224796-5239-44ac-84a2-887b2679bc8b tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06b3b613-3c1e-4420-a500-1ec3988c0940 (non-flash)
Nov 06 16:14:35 user nova-compute[75337]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:831ff3d4-9d1e-465b-a878-2688b7c38078 (non-flash)
Nov 06 16:14:35 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 16:14:35 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f224796-5239-44ac-84a2-887b2679bc8b tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2a9c42a950>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:831ff3d4-9d1e-465b-a878-2688b7c38078'): ({'sdb'}, set())}) {{(pid=75337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 16:14:35 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-5f224796-5239-44ac-84a2-887b2679bc8b tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Removing single pathed devices sdb {{(pid=75337) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 16:14:35 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:14:35 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:14:35 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[55d63a17-5abf-49e2-b10a-cb378d715ebb]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:14:35 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:14:35 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:14:35 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[2791eeb8-5f86-496d-bb04-5965a773bdbf]: (4, ('ok\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:14:35 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-5f224796-5239-44ac-84a2-887b2679bc8b tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Flushing IO for device /dev/sdb {{(pid=75337) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 16:14:35 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:14:35 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:14:35 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[9269fcc3-5859-4eab-8818-00a19f8d76cb]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:14:35 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-5f224796-5239-44ac-84a2-887b2679bc8b tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75337) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 16:14:35 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:14:35 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:14:35 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a85b380-d754-4205-9d3d-093b29f973ca]: (4, ('1', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:14:35 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-5f224796-5239-44ac-84a2-887b2679bc8b tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 16:14:35 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-5f224796-5239-44ac-84a2-887b2679bc8b tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] SCSI volumes sdb have been removed. {{(pid=75337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 16:14:35 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f224796-5239-44ac-84a2-887b2679bc8b tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:831ff3d4-9d1e-465b-a878-2688b7c38078')] {{(pid=75337) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 16:14:35 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:831ff3d4-9d1e-465b-a878-2688b7c38078 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:14:35 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:831ff3d4-9d1e-465b-a878-2688b7c38078 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:14:35 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[b89a9f51-6409-4b0d-be40-9d6821f53990]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:14:35 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f224796-5239-44ac-84a2-887b2679bc8b tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:14:35 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:831ff3d4-9d1e-465b-a878-2688b7c38078 -p 172.16.0.220:3260 --logout {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:14:35 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:831ff3d4-9d1e-465b-a878-2688b7c38078 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:14:35 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9847dbc-fe42-47f6-af51-060588618718]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:831ff3d4-9d1e-465b-a878-2688b7c38078, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:831ff3d4-9d1e-465b-a878-2688b7c38078, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:14:35 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f224796-5239-44ac-84a2-887b2679bc8b tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:831ff3d4-9d1e-465b-a878-2688b7c38078, portal: 172.16.0.220,3260]
Nov 06 16:14:35 user nova-compute[75337]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:831ff3d4-9d1e-465b-a878-2688b7c38078, portal: 172.16.0.220,3260] successful.
Nov 06 16:14:35 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:14:35 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:831ff3d4-9d1e-465b-a878-2688b7c38078 -p 172.16.0.220:3260 --op delete {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:14:35 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:831ff3d4-9d1e-465b-a878-2688b7c38078 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:14:35 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4c41a62-6053-46ea-8888-e52579dd2a8c]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:14:35 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f224796-5239-44ac-84a2-887b2679bc8b tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:14:35 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-5f224796-5239-44ac-84a2-887b2679bc8b tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.333s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 16:14:35 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f224796-5239-44ac-84a2-887b2679bc8b tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] <== disconnect_volume: return (335ms) None {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 16:14:35 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5f224796-5239-44ac-84a2-887b2679bc8b tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] [instance: 88330c21-69e0-4d82-ac4d-b9e5e849f487] Disconnected iSCSI Volume {{(pid=75337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 16:14:36 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager.update_available_resource {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:14:36 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:14:36 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:14:36 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:14:36 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Auditing locally available compute resources for user (node: user) {{(pid=75337) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 16:14:36 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88330c21-69e0-4d82-ac4d-b9e5e849f487/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:14:36 user nova-compute[75337]: DEBUG nova.objects.instance [None req-5f224796-5239-44ac-84a2-887b2679bc8b tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Lazy-loading 'flavor' on Instance uuid 88330c21-69e0-4d82-ac4d-b9e5e849f487 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 16:14:36 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-5f224796-5239-44ac-84a2-887b2679bc8b tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Lock "88330c21-69e0-4d82-ac4d-b9e5e849f487" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.933s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:14:36 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88330c21-69e0-4d82-ac4d-b9e5e849f487/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:14:36 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88330c21-69e0-4d82-ac4d-b9e5e849f487/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:14:37 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88330c21-69e0-4d82-ac4d-b9e5e849f487/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:14:37 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 16:14:37 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525c87e5-14c3-40fd-8976-8df151ed07fa/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:14:37 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525c87e5-14c3-40fd-8976-8df151ed07fa/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:14:37 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525c87e5-14c3-40fd-8976-8df151ed07fa/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:14:37 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525c87e5-14c3-40fd-8976-8df151ed07fa/disk --force-share --output=json" returned: 0 in 0.269s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:14:37 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de77f786-1ecf-4eac-ae4a-c4f6b1d47339/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:14:37 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de77f786-1ecf-4eac-ae4a-c4f6b1d47339/disk --force-share --output=json" returned: 0 in 0.270s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:14:37 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de77f786-1ecf-4eac-ae4a-c4f6b1d47339/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:14:38 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de77f786-1ecf-4eac-ae4a-c4f6b1d47339/disk --force-share --output=json" returned: 0 in 0.264s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:14:38 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 16:14:38 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 16:14:38 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Hypervisor/Node resource view: name=user free_ram=8576MB free_disk=25.031272888183594GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75337) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 16:14:38 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:14:38 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:14:38 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:14:38 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 88330c21-69e0-4d82-ac4d-b9e5e849f487 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 16:14:38 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 15922f4f-f921-4245-8d3d-98ed47de946b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 16:14:38 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 525c87e5-14c3-40fd-8976-8df151ed07fa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 16:14:38 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance de77f786-1ecf-4eac-ae4a-c4f6b1d47339 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 16:14:38 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 16:14:38 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 16:14:38 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 16:14:38 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 16:14:38 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Compute_service record updated for user:user {{(pid=75337) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 16:14:38 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.281s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:14:40 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:14:41 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:14:41 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Cleaning up deleted instances with incomplete migration  {{(pid=75337) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 06 16:14:43 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:14:45 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:14:45 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Cleaning up deleted instances {{(pid=75337) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 06 16:14:45 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] There are 0 instances to clean {{(pid=75337) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 06 16:14:48 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:14:48 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:14:48 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75337) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 16:14:48 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 16:14:48 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 16:14:48 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:14:50 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:14:53 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:14:55 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:14:55 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:14:58 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:15:00 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:15:01 user nova-compute[75337]: DEBUG nova.compute.manager [req-d3fefd37-f91c-432a-a740-ca149c283af3 req-2fa204e8-9867-4a55-92a1-7991d6267d64 service nova] [instance: 15922f4f-f921-4245-8d3d-98ed47de946b] Received event network-changed-75853df2-1f1a-4a4f-be80-b29cd2452bd2 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:15:01 user nova-compute[75337]: DEBUG nova.compute.manager [req-d3fefd37-f91c-432a-a740-ca149c283af3 req-2fa204e8-9867-4a55-92a1-7991d6267d64 service nova] [instance: 15922f4f-f921-4245-8d3d-98ed47de946b] Refreshing instance network info cache due to event network-changed-75853df2-1f1a-4a4f-be80-b29cd2452bd2. {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 16:15:01 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-d3fefd37-f91c-432a-a740-ca149c283af3 req-2fa204e8-9867-4a55-92a1-7991d6267d64 service nova] Acquiring lock "refresh_cache-15922f4f-f921-4245-8d3d-98ed47de946b" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 16:15:01 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-d3fefd37-f91c-432a-a740-ca149c283af3 req-2fa204e8-9867-4a55-92a1-7991d6267d64 service nova] Acquired lock "refresh_cache-15922f4f-f921-4245-8d3d-98ed47de946b" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 16:15:01 user nova-compute[75337]: DEBUG nova.network.neutron [req-d3fefd37-f91c-432a-a740-ca149c283af3 req-2fa204e8-9867-4a55-92a1-7991d6267d64 service nova] [instance: 15922f4f-f921-4245-8d3d-98ed47de946b] Refreshing network info cache for port 75853df2-1f1a-4a4f-be80-b29cd2452bd2 {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 16:15:02 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-3011a6a4-44c8-43ac-b653-24a29f3dbb9f tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Acquiring lock "15922f4f-f921-4245-8d3d-98ed47de946b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:15:02 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-3011a6a4-44c8-43ac-b653-24a29f3dbb9f tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Lock "15922f4f-f921-4245-8d3d-98ed47de946b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:15:02 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-3011a6a4-44c8-43ac-b653-24a29f3dbb9f tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Acquiring lock "15922f4f-f921-4245-8d3d-98ed47de946b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:15:02 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-3011a6a4-44c8-43ac-b653-24a29f3dbb9f tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Lock "15922f4f-f921-4245-8d3d-98ed47de946b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:15:02 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-3011a6a4-44c8-43ac-b653-24a29f3dbb9f tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Lock "15922f4f-f921-4245-8d3d-98ed47de946b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:15:02 user nova-compute[75337]: INFO nova.compute.manager [None req-3011a6a4-44c8-43ac-b653-24a29f3dbb9f tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] [instance: 15922f4f-f921-4245-8d3d-98ed47de946b] Terminating instance
Nov 06 16:15:02 user nova-compute[75337]: DEBUG nova.compute.manager [None req-3011a6a4-44c8-43ac-b653-24a29f3dbb9f tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] [instance: 15922f4f-f921-4245-8d3d-98ed47de946b] Start destroying the instance on the hypervisor. {{(pid=75337) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 16:15:02 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:15:02 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:15:02 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:15:02 user nova-compute[75337]: DEBUG nova.compute.manager [req-f0f27f8d-ae6c-4682-9cae-6a11c3d50f6d req-03d74dbf-84d4-4bd8-919f-b08dd86e862d service nova] [instance: 15922f4f-f921-4245-8d3d-98ed47de946b] Received event network-vif-unplugged-75853df2-1f1a-4a4f-be80-b29cd2452bd2 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:15:02 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-f0f27f8d-ae6c-4682-9cae-6a11c3d50f6d req-03d74dbf-84d4-4bd8-919f-b08dd86e862d service nova] Acquiring lock "15922f4f-f921-4245-8d3d-98ed47de946b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:15:02 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-f0f27f8d-ae6c-4682-9cae-6a11c3d50f6d req-03d74dbf-84d4-4bd8-919f-b08dd86e862d service nova] Lock "15922f4f-f921-4245-8d3d-98ed47de946b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:15:02 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-f0f27f8d-ae6c-4682-9cae-6a11c3d50f6d req-03d74dbf-84d4-4bd8-919f-b08dd86e862d service nova] Lock "15922f4f-f921-4245-8d3d-98ed47de946b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:15:02 user nova-compute[75337]: DEBUG nova.compute.manager [req-f0f27f8d-ae6c-4682-9cae-6a11c3d50f6d req-03d74dbf-84d4-4bd8-919f-b08dd86e862d service nova] [instance: 15922f4f-f921-4245-8d3d-98ed47de946b] No waiting events found dispatching network-vif-unplugged-75853df2-1f1a-4a4f-be80-b29cd2452bd2 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 16:15:02 user nova-compute[75337]: DEBUG nova.compute.manager [req-f0f27f8d-ae6c-4682-9cae-6a11c3d50f6d req-03d74dbf-84d4-4bd8-919f-b08dd86e862d service nova] [instance: 15922f4f-f921-4245-8d3d-98ed47de946b] Received event network-vif-unplugged-75853df2-1f1a-4a4f-be80-b29cd2452bd2 for instance with task_state deleting. {{(pid=75337) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 16:15:02 user nova-compute[75337]: DEBUG nova.network.neutron [req-d3fefd37-f91c-432a-a740-ca149c283af3 req-2fa204e8-9867-4a55-92a1-7991d6267d64 service nova] [instance: 15922f4f-f921-4245-8d3d-98ed47de946b] Updated VIF entry in instance network info cache for port 75853df2-1f1a-4a4f-be80-b29cd2452bd2. {{(pid=75337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 16:15:02 user nova-compute[75337]: DEBUG nova.network.neutron [req-d3fefd37-f91c-432a-a740-ca149c283af3 req-2fa204e8-9867-4a55-92a1-7991d6267d64 service nova] [instance: 15922f4f-f921-4245-8d3d-98ed47de946b] Updating instance_info_cache with network_info: [{"id": "75853df2-1f1a-4a4f-be80-b29cd2452bd2", "address": "fa:16:3e:f5:3f:f6", "network": {"id": "6b24c7e3-9e9c-4a84-8472-7629c0dc8029", "bridge": "br-int", "label": "tempest-TestShelveInstance-284079759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "573524caeb6248339e924a5abb8e5964", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75853df2-1f", "ovs_interfaceid": "75853df2-1f1a-4a4f-be80-b29cd2452bd2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 16:15:02 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-d3fefd37-f91c-432a-a740-ca149c283af3 req-2fa204e8-9867-4a55-92a1-7991d6267d64 service nova] Releasing lock "refresh_cache-15922f4f-f921-4245-8d3d-98ed47de946b" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 16:15:02 user nova-compute[75337]: INFO nova.virt.libvirt.driver [-] [instance: 15922f4f-f921-4245-8d3d-98ed47de946b] Instance destroyed successfully.
Nov 06 16:15:02 user nova-compute[75337]: DEBUG nova.objects.instance [None req-3011a6a4-44c8-43ac-b653-24a29f3dbb9f tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Lazy-loading 'resources' on Instance uuid 15922f4f-f921-4245-8d3d-98ed47de946b {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 16:15:02 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-3011a6a4-44c8-43ac-b653-24a29f3dbb9f tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-06T16:09:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1606147193',display_name='tempest-TestShelveInstance-server-1606147193',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1606147193',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBET5bxZ8mLAaWl4HqozpzhdVRJ1LnlkTiYfny9D2S0JwqS5aepxP0yT+cU0Pc9wCAKkm2TfPGhm7ljhyuLG76JgiijG2E7WfgIyahxQ8ji6zb6gr2/OWhMqORY7NLSU2HQ==',key_name='tempest-TestShelveInstance-1222945182',keypairs=<?>,launch_index=0,launched_at=2023-11-06T16:13:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='573524caeb6248339e924a5abb8e5964',ramdisk_id='',reservation_id='r-totl4fkd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-652677760',owner_user_name='tempest-TestShelveInstance-652677760-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T16:13:56Z,user_data=None,user_id='3204b8f95945489d8335cafa44ab2109',uuid=15922f4f-f921-4245-8d3d-98ed47de946b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "75853df2-1f1a-4a4f-be80-b29cd2452bd2", "address": "fa:16:3e:f5:3f:f6", "network": {"id": "6b24c7e3-9e9c-4a84-8472-7629c0dc8029", "bridge": "br-int", "label": "tempest-TestShelveInstance-284079759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "573524caeb6248339e924a5abb8e5964", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75853df2-1f", "ovs_interfaceid": "75853df2-1f1a-4a4f-be80-b29cd2452bd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 16:15:02 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-3011a6a4-44c8-43ac-b653-24a29f3dbb9f tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Converting VIF {"id": "75853df2-1f1a-4a4f-be80-b29cd2452bd2", "address": "fa:16:3e:f5:3f:f6", "network": {"id": "6b24c7e3-9e9c-4a84-8472-7629c0dc8029", "bridge": "br-int", "label": "tempest-TestShelveInstance-284079759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "573524caeb6248339e924a5abb8e5964", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75853df2-1f", "ovs_interfaceid": "75853df2-1f1a-4a4f-be80-b29cd2452bd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 16:15:02 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-3011a6a4-44c8-43ac-b653-24a29f3dbb9f tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:3f:f6,bridge_name='br-int',has_traffic_filtering=True,id=75853df2-1f1a-4a4f-be80-b29cd2452bd2,network=Network(6b24c7e3-9e9c-4a84-8472-7629c0dc8029),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75853df2-1f') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 16:15:02 user nova-compute[75337]: DEBUG os_vif [None req-3011a6a4-44c8-43ac-b653-24a29f3dbb9f tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:3f:f6,bridge_name='br-int',has_traffic_filtering=True,id=75853df2-1f1a-4a4f-be80-b29cd2452bd2,network=Network(6b24c7e3-9e9c-4a84-8472-7629c0dc8029),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75853df2-1f') {{(pid=75337) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 16:15:02 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:15:02 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap75853df2-1f, bridge=br-int, if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 16:15:02 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:15:02 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:15:02 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:15:02 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b4c4e463-4ba3-4f4e-b86f-72318f0e7232) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 16:15:02 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:15:02 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:15:02 user nova-compute[75337]: INFO os_vif [None req-3011a6a4-44c8-43ac-b653-24a29f3dbb9f tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:3f:f6,bridge_name='br-int',has_traffic_filtering=True,id=75853df2-1f1a-4a4f-be80-b29cd2452bd2,network=Network(6b24c7e3-9e9c-4a84-8472-7629c0dc8029),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75853df2-1f')
Nov 06 16:15:02 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3011a6a4-44c8-43ac-b653-24a29f3dbb9f tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] [instance: 15922f4f-f921-4245-8d3d-98ed47de946b] calling os-brick to detach iSCSI Volume {{(pid=75337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 16:15:02 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-3011a6a4-44c8-43ac-b653-24a29f3dbb9f tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2abc33d0c0>, {'target_iqn': 'iqn.2010-10.org.openstack:06b3b613-3c1e-4420-a500-1ec3988c0940', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'niMJzqwT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 16:15:02 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-3011a6a4-44c8-43ac-b653-24a29f3dbb9f tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 16:15:02 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-3011a6a4-44c8-43ac-b653-24a29f3dbb9f tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 16:15:02 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-3011a6a4-44c8-43ac-b653-24a29f3dbb9f tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 16:15:02 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:15:02 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:15:02 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[32b2e1bc-661f-4e9a-b943-166abb06e477]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:06b3b613-3c1e-4420-a500-1ec3988c0940\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:15:02 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-3011a6a4-44c8-43ac-b653-24a29f3dbb9f tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 16:15:02 user nova-compute[75337]: No targets found.
Nov 06 16:15:02 user nova-compute[75337]: iSNS:
Nov 06 16:15:02 user nova-compute[75337]: No targets found.
Nov 06 16:15:02 user nova-compute[75337]: STATIC:
Nov 06 16:15:02 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:06b3b613-3c1e-4420-a500-1ec3988c0940
Nov 06 16:15:02 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 16:15:02 user nova-compute[75337]:                 Iface Name: default
Nov 06 16:15:02 user nova-compute[75337]: FIRMWARE:
Nov 06 16:15:02 user nova-compute[75337]: No targets found.
Nov 06 16:15:02 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 16:15:02 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-3011a6a4-44c8-43ac-b653-24a29f3dbb9f tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 16:15:02 user nova-compute[75337]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 16:15:02 user nova-compute[75337]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75337) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 16:15:02 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-3011a6a4-44c8-43ac-b653-24a29f3dbb9f tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:06b3b613-3c1e-4420-a500-1ec3988c0940', 0)] {{(pid=75337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 16:15:02 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:15:02 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:15:02 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[6049cbda-da86-478b-8faf-5ee0902c08d6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:06b3b613-3c1e-4420-a500-1ec3988c0940\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:15:02 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:15:02 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:15:02 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ab0aa79-bc06-4647-8c98-2b537b51e84d]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06b3b613-3c1e-4420-a500-1ec3988c0940 (non-flash)\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:15:02 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-3011a6a4-44c8-43ac-b653-24a29f3dbb9f tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06b3b613-3c1e-4420-a500-1ec3988c0940 (non-flash)
Nov 06 16:15:02 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 16:15:02 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-3011a6a4-44c8-43ac-b653-24a29f3dbb9f tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06b3b613-3c1e-4420-a500-1ec3988c0940 (non-flash)
Nov 06 16:15:02 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 16:15:02 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-3011a6a4-44c8-43ac-b653-24a29f3dbb9f tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2ace535ea0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:06b3b613-3c1e-4420-a500-1ec3988c0940'): ({'sdc'}, set())}) {{(pid=75337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 16:15:02 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-3011a6a4-44c8-43ac-b653-24a29f3dbb9f tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Removing single pathed devices sdc {{(pid=75337) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 16:15:02 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:15:02 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:15:02 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[e499cd9c-546c-41ed-bc6c-c03be9724bb5]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:15:02 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:15:02 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:15:02 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bf4b586-35a0-4427-bf60-5a594dcec62c]: (4, ('ok\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:15:02 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-3011a6a4-44c8-43ac-b653-24a29f3dbb9f tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Flushing IO for device /dev/sdc {{(pid=75337) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 16:15:02 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:15:02 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:15:02 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5c8b571-7728-4663-a27c-7fb33a5cf0de]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:15:02 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-3011a6a4-44c8-43ac-b653-24a29f3dbb9f tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75337) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 16:15:02 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:15:03 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:15:03 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[e82b642c-a140-4b7b-a61f-49392432f5b2]: (4, ('1', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:15:03 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-3011a6a4-44c8-43ac-b653-24a29f3dbb9f tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 16:15:03 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-3011a6a4-44c8-43ac-b653-24a29f3dbb9f tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] SCSI volumes sdc have been removed. {{(pid=75337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 16:15:03 user nova-compute[75337]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26339353537623732', '/dev/disk/by-id/scsi-1SCST_BIO105196f2-c9557b72aa308db6', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_105196f2') {{(pid=86696) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 06 16:15:03 user nova-compute[75337]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-26339353537623732
Nov 06 16:15:03 user nova-compute[75337]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIO105196f2-c9557b72aa308db6
Nov 06 16:15:03 user nova-compute[75337]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_105196f2
Nov 06 16:15:03 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9ef2983-9b82-422f-a06b-e47a593e7cb9]: (4, None) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:15:03 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-3011a6a4-44c8-43ac-b653-24a29f3dbb9f tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:06b3b613-3c1e-4420-a500-1ec3988c0940')] {{(pid=75337) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 16:15:03 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06b3b613-3c1e-4420-a500-1ec3988c0940 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:15:03 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06b3b613-3c1e-4420-a500-1ec3988c0940 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:15:03 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[0990f27f-7c32-4235-83d0-ce0400a1df28]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:15:03 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-3011a6a4-44c8-43ac-b653-24a29f3dbb9f tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:15:03 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06b3b613-3c1e-4420-a500-1ec3988c0940 -p 172.16.0.220:3260 --logout {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:15:03 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06b3b613-3c1e-4420-a500-1ec3988c0940 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:15:03 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[61486dce-948d-4f26-a69e-c90161740076]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:06b3b613-3c1e-4420-a500-1ec3988c0940, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:06b3b613-3c1e-4420-a500-1ec3988c0940, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:15:03 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-3011a6a4-44c8-43ac-b653-24a29f3dbb9f tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:06b3b613-3c1e-4420-a500-1ec3988c0940, portal: 172.16.0.220,3260]
Nov 06 16:15:03 user nova-compute[75337]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:06b3b613-3c1e-4420-a500-1ec3988c0940, portal: 172.16.0.220,3260] successful.
Nov 06 16:15:03 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:15:03 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06b3b613-3c1e-4420-a500-1ec3988c0940 -p 172.16.0.220:3260 --op delete {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:15:03 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06b3b613-3c1e-4420-a500-1ec3988c0940 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:15:03 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[6af7a4cc-723b-43d8-bac9-6f9dce48ff9a]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:15:03 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-3011a6a4-44c8-43ac-b653-24a29f3dbb9f tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:15:03 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-3011a6a4-44c8-43ac-b653-24a29f3dbb9f tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 16:15:03 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-3011a6a4-44c8-43ac-b653-24a29f3dbb9f tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] <== disconnect_volume: return (303ms) None {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 16:15:03 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3011a6a4-44c8-43ac-b653-24a29f3dbb9f tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] [instance: 15922f4f-f921-4245-8d3d-98ed47de946b] Disconnected iSCSI Volume {{(pid=75337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 16:15:03 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-3011a6a4-44c8-43ac-b653-24a29f3dbb9f tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] [instance: 15922f4f-f921-4245-8d3d-98ed47de946b] Deleting instance files /opt/stack/data/nova/instances/15922f4f-f921-4245-8d3d-98ed47de946b_del
Nov 06 16:15:03 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-3011a6a4-44c8-43ac-b653-24a29f3dbb9f tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] [instance: 15922f4f-f921-4245-8d3d-98ed47de946b] Deletion of /opt/stack/data/nova/instances/15922f4f-f921-4245-8d3d-98ed47de946b_del complete
Nov 06 16:15:03 user nova-compute[75337]: INFO nova.compute.manager [None req-3011a6a4-44c8-43ac-b653-24a29f3dbb9f tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] [instance: 15922f4f-f921-4245-8d3d-98ed47de946b] Took 1.15 seconds to destroy the instance on the hypervisor.
Nov 06 16:15:03 user nova-compute[75337]: DEBUG oslo.service.loopingcall [None req-3011a6a4-44c8-43ac-b653-24a29f3dbb9f tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75337) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 16:15:03 user nova-compute[75337]: DEBUG nova.compute.manager [-] [instance: 15922f4f-f921-4245-8d3d-98ed47de946b] Deallocating network for instance {{(pid=75337) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 16:15:03 user nova-compute[75337]: DEBUG nova.network.neutron [-] [instance: 15922f4f-f921-4245-8d3d-98ed47de946b] deallocate_for_instance() {{(pid=75337) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 16:15:03 user nova-compute[75337]: DEBUG nova.network.neutron [-] [instance: 15922f4f-f921-4245-8d3d-98ed47de946b] Updating instance_info_cache with network_info: [] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 16:15:03 user nova-compute[75337]: INFO nova.compute.manager [-] [instance: 15922f4f-f921-4245-8d3d-98ed47de946b] Took 0.55 seconds to deallocate network for instance.
Nov 06 16:15:04 user nova-compute[75337]: DEBUG nova.compute.manager [req-042f7525-dbbe-4fb1-b2e8-5f708054e504 req-b217d6b2-f6b2-4705-8aeb-953389743944 service nova] [instance: 15922f4f-f921-4245-8d3d-98ed47de946b] Received event network-vif-plugged-75853df2-1f1a-4a4f-be80-b29cd2452bd2 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:15:04 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-042f7525-dbbe-4fb1-b2e8-5f708054e504 req-b217d6b2-f6b2-4705-8aeb-953389743944 service nova] Acquiring lock "15922f4f-f921-4245-8d3d-98ed47de946b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:15:04 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-042f7525-dbbe-4fb1-b2e8-5f708054e504 req-b217d6b2-f6b2-4705-8aeb-953389743944 service nova] Lock "15922f4f-f921-4245-8d3d-98ed47de946b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:15:04 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-042f7525-dbbe-4fb1-b2e8-5f708054e504 req-b217d6b2-f6b2-4705-8aeb-953389743944 service nova] Lock "15922f4f-f921-4245-8d3d-98ed47de946b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:15:04 user nova-compute[75337]: DEBUG nova.compute.manager [req-042f7525-dbbe-4fb1-b2e8-5f708054e504 req-b217d6b2-f6b2-4705-8aeb-953389743944 service nova] [instance: 15922f4f-f921-4245-8d3d-98ed47de946b] No waiting events found dispatching network-vif-plugged-75853df2-1f1a-4a4f-be80-b29cd2452bd2 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 16:15:04 user nova-compute[75337]: WARNING nova.compute.manager [req-042f7525-dbbe-4fb1-b2e8-5f708054e504 req-b217d6b2-f6b2-4705-8aeb-953389743944 service nova] [instance: 15922f4f-f921-4245-8d3d-98ed47de946b] Received unexpected event network-vif-plugged-75853df2-1f1a-4a4f-be80-b29cd2452bd2 for instance with vm_state active and task_state deleting.
Nov 06 16:15:04 user nova-compute[75337]: DEBUG nova.compute.manager [req-042f7525-dbbe-4fb1-b2e8-5f708054e504 req-b217d6b2-f6b2-4705-8aeb-953389743944 service nova] [instance: 15922f4f-f921-4245-8d3d-98ed47de946b] Received event network-vif-deleted-75853df2-1f1a-4a4f-be80-b29cd2452bd2 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:15:04 user nova-compute[75337]: INFO nova.compute.manager [None req-3011a6a4-44c8-43ac-b653-24a29f3dbb9f tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] [instance: 15922f4f-f921-4245-8d3d-98ed47de946b] Took 1.03 seconds to detach 1 volumes for instance.
Nov 06 16:15:04 user nova-compute[75337]: DEBUG nova.compute.manager [None req-3011a6a4-44c8-43ac-b653-24a29f3dbb9f tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] [instance: 15922f4f-f921-4245-8d3d-98ed47de946b] Deleting volume: 06b3b613-3c1e-4420-a500-1ec3988c0940 {{(pid=75337) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 06 16:15:04 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-3011a6a4-44c8-43ac-b653-24a29f3dbb9f tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:15:04 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-3011a6a4-44c8-43ac-b653-24a29f3dbb9f tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:15:05 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-3011a6a4-44c8-43ac-b653-24a29f3dbb9f tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 16:15:05 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-3011a6a4-44c8-43ac-b653-24a29f3dbb9f tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 16:15:05 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-3011a6a4-44c8-43ac-b653-24a29f3dbb9f tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.187s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:15:05 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:15:05 user nova-compute[75337]: INFO nova.scheduler.client.report [None req-3011a6a4-44c8-43ac-b653-24a29f3dbb9f tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Deleted allocations for instance 15922f4f-f921-4245-8d3d-98ed47de946b
Nov 06 16:15:05 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-3011a6a4-44c8-43ac-b653-24a29f3dbb9f tempest-TestShelveInstance-652677760 tempest-TestShelveInstance-652677760-project-member] Lock "15922f4f-f921-4245-8d3d-98ed47de946b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.168s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:15:07 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:15:12 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:15:17 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:15:18 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:15:20 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:15:21 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:15:21 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75337) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 16:15:22 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:15:22 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:15:22 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75337) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 16:15:22 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 16:15:22 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 16:15:22 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:15:25 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:15:27 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:15:27 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:15:29 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:15:29 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:15:32 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:15:32 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:15:32 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75337) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 16:15:32 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 16:15:32 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 16:15:32 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:15:33 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._sync_power_states {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:15:33 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Triggering sync for uuid 88330c21-69e0-4d82-ac4d-b9e5e849f487 {{(pid=75337) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 06 16:15:33 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Triggering sync for uuid 525c87e5-14c3-40fd-8976-8df151ed07fa {{(pid=75337) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 06 16:15:33 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Triggering sync for uuid de77f786-1ecf-4eac-ae4a-c4f6b1d47339 {{(pid=75337) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 06 16:15:33 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "88330c21-69e0-4d82-ac4d-b9e5e849f487" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:15:33 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "88330c21-69e0-4d82-ac4d-b9e5e849f487" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:15:33 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "525c87e5-14c3-40fd-8976-8df151ed07fa" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:15:33 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "525c87e5-14c3-40fd-8976-8df151ed07fa" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:15:33 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "de77f786-1ecf-4eac-ae4a-c4f6b1d47339" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:15:33 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "de77f786-1ecf-4eac-ae4a-c4f6b1d47339" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:15:34 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "88330c21-69e0-4d82-ac4d-b9e5e849f487" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.026s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:15:34 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "525c87e5-14c3-40fd-8976-8df151ed07fa" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.028s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:15:34 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "de77f786-1ecf-4eac-ae4a-c4f6b1d47339" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.041s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:15:34 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:15:34 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Starting heal instance info cache {{(pid=75337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 16:15:34 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Didn't find any instances for network info cache update. {{(pid=75337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 06 16:15:37 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:15:38 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager.update_available_resource {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:15:38 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:15:38 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:15:38 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:15:38 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Auditing locally available compute resources for user (node: user) {{(pid=75337) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 16:15:38 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88330c21-69e0-4d82-ac4d-b9e5e849f487/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:15:38 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88330c21-69e0-4d82-ac4d-b9e5e849f487/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:15:38 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88330c21-69e0-4d82-ac4d-b9e5e849f487/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:15:39 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88330c21-69e0-4d82-ac4d-b9e5e849f487/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:15:39 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525c87e5-14c3-40fd-8976-8df151ed07fa/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:15:39 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525c87e5-14c3-40fd-8976-8df151ed07fa/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:15:39 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525c87e5-14c3-40fd-8976-8df151ed07fa/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:15:39 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525c87e5-14c3-40fd-8976-8df151ed07fa/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:15:39 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de77f786-1ecf-4eac-ae4a-c4f6b1d47339/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:15:39 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de77f786-1ecf-4eac-ae4a-c4f6b1d47339/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:15:39 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de77f786-1ecf-4eac-ae4a-c4f6b1d47339/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:15:39 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de77f786-1ecf-4eac-ae4a-c4f6b1d47339/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:15:40 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 16:15:40 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 16:15:40 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Hypervisor/Node resource view: name=user free_ram=8567MB free_disk=24.973834991455078GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75337) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 16:15:40 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:15:40 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:15:40 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 88330c21-69e0-4d82-ac4d-b9e5e849f487 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 16:15:40 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 525c87e5-14c3-40fd-8976-8df151ed07fa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 16:15:40 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance de77f786-1ecf-4eac-ae4a-c4f6b1d47339 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 16:15:40 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 16:15:40 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 16:15:40 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 16:15:40 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 16:15:40 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Compute_service record updated for user:user {{(pid=75337) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 16:15:40 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.305s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:15:42 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:15:47 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:15:47 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:15:47 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75337) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 16:15:47 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 16:15:47 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 16:15:47 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:15:52 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:15:52 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:15:52 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75337) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 16:15:52 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 16:15:52 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 16:15:52 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:15:54 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:15:55 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:15:57 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:15:58 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:16:02 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:16:07 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:16:12 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:16:16 user nova-compute[75337]: INFO nova.compute.manager [None req-3ad4739d-39d5-4730-a6ce-dff77f3e155a tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] [instance: de77f786-1ecf-4eac-ae4a-c4f6b1d47339] Rescuing
Nov 06 16:16:16 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-3ad4739d-39d5-4730-a6ce-dff77f3e155a tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Acquiring lock "refresh_cache-de77f786-1ecf-4eac-ae4a-c4f6b1d47339" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 16:16:16 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-3ad4739d-39d5-4730-a6ce-dff77f3e155a tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Acquired lock "refresh_cache-de77f786-1ecf-4eac-ae4a-c4f6b1d47339" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 16:16:16 user nova-compute[75337]: DEBUG nova.network.neutron [None req-3ad4739d-39d5-4730-a6ce-dff77f3e155a tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] [instance: de77f786-1ecf-4eac-ae4a-c4f6b1d47339] Building network info cache for instance {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 16:16:16 user nova-compute[75337]: DEBUG nova.network.neutron [None req-3ad4739d-39d5-4730-a6ce-dff77f3e155a tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] [instance: de77f786-1ecf-4eac-ae4a-c4f6b1d47339] Updating instance_info_cache with network_info: [{"id": "8f33a5c0-50e1-4bac-a686-733daf33a307", "address": "fa:16:3e:4b:fc:cf", "network": {"id": "0da0e0bd-b07e-4ae1-8625-a979ed32bd07", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-528047864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f71610b3d00f412ea4aeba8068d032fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f33a5c0-50", "ovs_interfaceid": "8f33a5c0-50e1-4bac-a686-733daf33a307", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 16:16:16 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-3ad4739d-39d5-4730-a6ce-dff77f3e155a tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Releasing lock "refresh_cache-de77f786-1ecf-4eac-ae4a-c4f6b1d47339" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 16:16:16 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:16:16 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:16:17 user nova-compute[75337]: DEBUG nova.compute.manager [req-9e6e9897-029f-4dc2-9bbc-c9d88b17089f req-0dd66b4a-b7d0-4294-b474-4b30d19225a5 service nova] [instance: de77f786-1ecf-4eac-ae4a-c4f6b1d47339] Received event network-vif-unplugged-8f33a5c0-50e1-4bac-a686-733daf33a307 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:16:17 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-9e6e9897-029f-4dc2-9bbc-c9d88b17089f req-0dd66b4a-b7d0-4294-b474-4b30d19225a5 service nova] Acquiring lock "de77f786-1ecf-4eac-ae4a-c4f6b1d47339-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:16:17 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-9e6e9897-029f-4dc2-9bbc-c9d88b17089f req-0dd66b4a-b7d0-4294-b474-4b30d19225a5 service nova] Lock "de77f786-1ecf-4eac-ae4a-c4f6b1d47339-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:16:17 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-9e6e9897-029f-4dc2-9bbc-c9d88b17089f req-0dd66b4a-b7d0-4294-b474-4b30d19225a5 service nova] Lock "de77f786-1ecf-4eac-ae4a-c4f6b1d47339-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:16:17 user nova-compute[75337]: DEBUG nova.compute.manager [req-9e6e9897-029f-4dc2-9bbc-c9d88b17089f req-0dd66b4a-b7d0-4294-b474-4b30d19225a5 service nova] [instance: de77f786-1ecf-4eac-ae4a-c4f6b1d47339] No waiting events found dispatching network-vif-unplugged-8f33a5c0-50e1-4bac-a686-733daf33a307 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 16:16:17 user nova-compute[75337]: WARNING nova.compute.manager [req-9e6e9897-029f-4dc2-9bbc-c9d88b17089f req-0dd66b4a-b7d0-4294-b474-4b30d19225a5 service nova] [instance: de77f786-1ecf-4eac-ae4a-c4f6b1d47339] Received unexpected event network-vif-unplugged-8f33a5c0-50e1-4bac-a686-733daf33a307 for instance with vm_state active and task_state rescuing.
Nov 06 16:16:17 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:16:17 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:16:17 user nova-compute[75337]: INFO nova.virt.libvirt.driver [-] [instance: de77f786-1ecf-4eac-ae4a-c4f6b1d47339] Instance destroyed successfully.
Nov 06 16:16:17 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-3ad4739d-39d5-4730-a6ce-dff77f3e155a tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] [instance: de77f786-1ecf-4eac-ae4a-c4f6b1d47339] Attempting rescue
Nov 06 16:16:17 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-3ad4739d-39d5-4730-a6ce-dff77f3e155a tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75337) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 06 16:16:17 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-3ad4739d-39d5-4730-a6ce-dff77f3e155a tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] [instance: de77f786-1ecf-4eac-ae4a-c4f6b1d47339] Instance directory exists: not creating {{(pid=75337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 06 16:16:17 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-3ad4739d-39d5-4730-a6ce-dff77f3e155a tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] [instance: de77f786-1ecf-4eac-ae4a-c4f6b1d47339] Creating image(s)
Nov 06 16:16:17 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-3ad4739d-39d5-4730-a6ce-dff77f3e155a tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Acquiring lock "/opt/stack/data/nova/instances/de77f786-1ecf-4eac-ae4a-c4f6b1d47339/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:16:17 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-3ad4739d-39d5-4730-a6ce-dff77f3e155a tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Lock "/opt/stack/data/nova/instances/de77f786-1ecf-4eac-ae4a-c4f6b1d47339/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:16:17 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-3ad4739d-39d5-4730-a6ce-dff77f3e155a tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Lock "/opt/stack/data/nova/instances/de77f786-1ecf-4eac-ae4a-c4f6b1d47339/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:16:17 user nova-compute[75337]: DEBUG nova.objects.instance [None req-3ad4739d-39d5-4730-a6ce-dff77f3e155a tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Lazy-loading 'trusted_certs' on Instance uuid de77f786-1ecf-4eac-ae4a-c4f6b1d47339 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 16:16:17 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-3ad4739d-39d5-4730-a6ce-dff77f3e155a tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Acquiring lock "06ba3c914798499e686c5ac75886932347225275" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:16:17 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-3ad4739d-39d5-4730-a6ce-dff77f3e155a tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Lock "06ba3c914798499e686c5ac75886932347225275" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:16:17 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-3ad4739d-39d5-4730-a6ce-dff77f3e155a tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:16:17 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-3ad4739d-39d5-4730-a6ce-dff77f3e155a tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json" returned: 0 in 0.171s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:16:17 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-3ad4739d-39d5-4730-a6ce-dff77f3e155a tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275,backing_fmt=raw /opt/stack/data/nova/instances/de77f786-1ecf-4eac-ae4a-c4f6b1d47339/disk.rescue {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:16:17 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-3ad4739d-39d5-4730-a6ce-dff77f3e155a tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275,backing_fmt=raw /opt/stack/data/nova/instances/de77f786-1ecf-4eac-ae4a-c4f6b1d47339/disk.rescue" returned: 0 in 0.047s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:16:17 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-3ad4739d-39d5-4730-a6ce-dff77f3e155a tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Lock "06ba3c914798499e686c5ac75886932347225275" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.225s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:16:17 user nova-compute[75337]: DEBUG nova.objects.instance [None req-3ad4739d-39d5-4730-a6ce-dff77f3e155a tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Lazy-loading 'migration_context' on Instance uuid de77f786-1ecf-4eac-ae4a-c4f6b1d47339 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 16:16:17 user nova-compute[75337]: DEBUG nova.objects.base [None req-3ad4739d-39d5-4730-a6ce-dff77f3e155a tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Object Instance<de77f786-1ecf-4eac-ae4a-c4f6b1d47339> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75337) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 16:16:17 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-3ad4739d-39d5-4730-a6ce-dff77f3e155a tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] [instance: de77f786-1ecf-4eac-ae4a-c4f6b1d47339] Created local disks {{(pid=75337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 16:16:17 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-3ad4739d-39d5-4730-a6ce-dff77f3e155a tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] [instance: de77f786-1ecf-4eac-ae4a-c4f6b1d47339] Start _get_guest_xml network_info=[{"id": "8f33a5c0-50e1-4bac-a686-733daf33a307", "address": "fa:16:3e:4b:fc:cf", "network": {"id": "0da0e0bd-b07e-4ae1-8625-a979ed32bd07", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-528047864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-528047864-network", "vif_mac": "fa:16:3e:4b:fc:cf"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f71610b3d00f412ea4aeba8068d032fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f33a5c0-50", "ovs_interfaceid": "8f33a5c0-50e1-4bac-a686-733daf33a307", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T15:34:14Z,direct_url=<?>,disk_format='qcow2',id=16b903ae-a40f-41a7-985b-4804cce92c62,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6549a15819f1469bbd5eeae8190e3d44',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T15:34:15Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '16b903ae-a40f-41a7-985b-4804cce92c62', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 16:16:17 user nova-compute[75337]: DEBUG nova.objects.instance [None req-3ad4739d-39d5-4730-a6ce-dff77f3e155a tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Lazy-loading 'resources' on Instance uuid de77f786-1ecf-4eac-ae4a-c4f6b1d47339 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 16:16:17 user nova-compute[75337]: DEBUG nova.objects.base [None req-3ad4739d-39d5-4730-a6ce-dff77f3e155a tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Object Instance<de77f786-1ecf-4eac-ae4a-c4f6b1d47339> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75337) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 16:16:17 user nova-compute[75337]: DEBUG nova.objects.instance [None req-3ad4739d-39d5-4730-a6ce-dff77f3e155a tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Lazy-loading 'numa_topology' on Instance uuid de77f786-1ecf-4eac-ae4a-c4f6b1d47339 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 16:16:17 user nova-compute[75337]: DEBUG nova.objects.base [None req-3ad4739d-39d5-4730-a6ce-dff77f3e155a tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Object Instance<de77f786-1ecf-4eac-ae4a-c4f6b1d47339> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75337) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 16:16:17 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-3ad4739d-39d5-4730-a6ce-dff77f3e155a tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 16:16:17 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-3ad4739d-39d5-4730-a6ce-dff77f3e155a tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 16:16:17 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-3ad4739d-39d5-4730-a6ce-dff77f3e155a tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 16:16:17 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-3ad4739d-39d5-4730-a6ce-dff77f3e155a tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] CPU controller missing on host. {{(pid=75337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 16:16:17 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-3ad4739d-39d5-4730-a6ce-dff77f3e155a tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 16:16:17 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-3ad4739d-39d5-4730-a6ce-dff77f3e155a tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] CPU controller found on host. {{(pid=75337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 16:16:17 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-3ad4739d-39d5-4730-a6ce-dff77f3e155a tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75337) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 16:16:17 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-3ad4739d-39d5-4730-a6ce-dff77f3e155a tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T15:34:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T15:34:14Z,direct_url=<?>,disk_format='qcow2',id=16b903ae-a40f-41a7-985b-4804cce92c62,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6549a15819f1469bbd5eeae8190e3d44',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T15:34:15Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 16:16:17 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-3ad4739d-39d5-4730-a6ce-dff77f3e155a tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Flavor limits 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 16:16:17 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-3ad4739d-39d5-4730-a6ce-dff77f3e155a tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Image limits 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 16:16:17 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-3ad4739d-39d5-4730-a6ce-dff77f3e155a tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Flavor pref 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 16:16:17 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-3ad4739d-39d5-4730-a6ce-dff77f3e155a tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Image pref 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 16:16:17 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-3ad4739d-39d5-4730-a6ce-dff77f3e155a tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 16:16:17 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-3ad4739d-39d5-4730-a6ce-dff77f3e155a tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 16:16:17 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-3ad4739d-39d5-4730-a6ce-dff77f3e155a tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 16:16:17 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-3ad4739d-39d5-4730-a6ce-dff77f3e155a tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Got 1 possible topologies {{(pid=75337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 16:16:17 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-3ad4739d-39d5-4730-a6ce-dff77f3e155a tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 16:16:17 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-3ad4739d-39d5-4730-a6ce-dff77f3e155a tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 16:16:17 user nova-compute[75337]: DEBUG nova.objects.instance [None req-3ad4739d-39d5-4730-a6ce-dff77f3e155a tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Lazy-loading 'vcpu_model' on Instance uuid de77f786-1ecf-4eac-ae4a-c4f6b1d47339 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 16:16:17 user nova-compute[75337]: DEBUG nova.objects.base [None req-3ad4739d-39d5-4730-a6ce-dff77f3e155a tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Object Instance<de77f786-1ecf-4eac-ae4a-c4f6b1d47339> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75337) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 16:16:17 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-3ad4739d-39d5-4730-a6ce-dff77f3e155a tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T16:14:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1866514788',display_name='tempest-ServerRescueNegativeTestJSON-server-1866514788',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1866514788',id=50,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-06T16:14:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f71610b3d00f412ea4aeba8068d032fc',ramdisk_id='',reservation_id='r-b48pf70m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1763914139',owner_user_name='tempest-ServerRescueNegativeTestJSON-1763914139-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T16:14:33Z,user_data=None,user_id='22979798bd154fd3af622e408520e95c',uuid=de77f786-1ecf-4eac-ae4a-c4f6b1d47339,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8f33a5c0-50e1-4bac-a686-733daf33a307", "address": "fa:16:3e:4b:fc:cf", "network": {"id": "0da0e0bd-b07e-4ae1-8625-a979ed32bd07", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-528047864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-528047864-network", "vif_mac": "fa:16:3e:4b:fc:cf"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f71610b3d00f412ea4aeba8068d032fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f33a5c0-50", "ovs_interfaceid": "8f33a5c0-50e1-4bac-a686-733daf33a307", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75337) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 16:16:17 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-3ad4739d-39d5-4730-a6ce-dff77f3e155a tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Converting VIF {"id": "8f33a5c0-50e1-4bac-a686-733daf33a307", "address": "fa:16:3e:4b:fc:cf", "network": {"id": "0da0e0bd-b07e-4ae1-8625-a979ed32bd07", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-528047864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-528047864-network", "vif_mac": "fa:16:3e:4b:fc:cf"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f71610b3d00f412ea4aeba8068d032fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f33a5c0-50", "ovs_interfaceid": "8f33a5c0-50e1-4bac-a686-733daf33a307", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 16:16:17 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-3ad4739d-39d5-4730-a6ce-dff77f3e155a tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4b:fc:cf,bridge_name='br-int',has_traffic_filtering=True,id=8f33a5c0-50e1-4bac-a686-733daf33a307,network=Network(0da0e0bd-b07e-4ae1-8625-a979ed32bd07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f33a5c0-50') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 16:16:17 user nova-compute[75337]: DEBUG nova.objects.instance [None req-3ad4739d-39d5-4730-a6ce-dff77f3e155a tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Lazy-loading 'pci_devices' on Instance uuid de77f786-1ecf-4eac-ae4a-c4f6b1d47339 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 16:16:17 user nova-compute[75337]: DEBUG nova.objects.base [None req-3ad4739d-39d5-4730-a6ce-dff77f3e155a tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Object Instance<de77f786-1ecf-4eac-ae4a-c4f6b1d47339> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75337) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 16:16:17 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-3ad4739d-39d5-4730-a6ce-dff77f3e155a tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] [instance: de77f786-1ecf-4eac-ae4a-c4f6b1d47339] End _get_guest_xml xml=<domain type="kvm">
Nov 06 16:16:17 user nova-compute[75337]:   <uuid>de77f786-1ecf-4eac-ae4a-c4f6b1d47339</uuid>
Nov 06 16:16:17 user nova-compute[75337]:   <name>instance-00000032</name>
Nov 06 16:16:17 user nova-compute[75337]:   <memory>524288</memory>
Nov 06 16:16:17 user nova-compute[75337]:   <vcpu>1</vcpu>
Nov 06 16:16:17 user nova-compute[75337]:   <metadata>
Nov 06 16:16:17 user nova-compute[75337]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 16:16:17 user nova-compute[75337]:       <nova:package version="0.0.0"/>
Nov 06 16:16:17 user nova-compute[75337]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1866514788</nova:name>
Nov 06 16:16:17 user nova-compute[75337]:       <nova:creationTime>2023-11-06 16:16:17</nova:creationTime>
Nov 06 16:16:17 user nova-compute[75337]:       <nova:flavor name="m1.tiny">
Nov 06 16:16:17 user nova-compute[75337]:         <nova:memory>512</nova:memory>
Nov 06 16:16:17 user nova-compute[75337]:         <nova:disk>1</nova:disk>
Nov 06 16:16:17 user nova-compute[75337]:         <nova:swap>0</nova:swap>
Nov 06 16:16:17 user nova-compute[75337]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 16:16:17 user nova-compute[75337]:         <nova:vcpus>1</nova:vcpus>
Nov 06 16:16:17 user nova-compute[75337]:       </nova:flavor>
Nov 06 16:16:17 user nova-compute[75337]:       <nova:owner>
Nov 06 16:16:17 user nova-compute[75337]:         <nova:user uuid="22979798bd154fd3af622e408520e95c">tempest-ServerRescueNegativeTestJSON-1763914139-project-member</nova:user>
Nov 06 16:16:17 user nova-compute[75337]:         <nova:project uuid="f71610b3d00f412ea4aeba8068d032fc">tempest-ServerRescueNegativeTestJSON-1763914139</nova:project>
Nov 06 16:16:17 user nova-compute[75337]:       </nova:owner>
Nov 06 16:16:17 user nova-compute[75337]:       <nova:root type="image" uuid="16b903ae-a40f-41a7-985b-4804cce92c62"/>
Nov 06 16:16:17 user nova-compute[75337]:       <nova:ports>
Nov 06 16:16:17 user nova-compute[75337]:         <nova:port uuid="8f33a5c0-50e1-4bac-a686-733daf33a307">
Nov 06 16:16:17 user nova-compute[75337]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 06 16:16:17 user nova-compute[75337]:         </nova:port>
Nov 06 16:16:17 user nova-compute[75337]:       </nova:ports>
Nov 06 16:16:17 user nova-compute[75337]:     </nova:instance>
Nov 06 16:16:17 user nova-compute[75337]:   </metadata>
Nov 06 16:16:17 user nova-compute[75337]:   <sysinfo type="smbios">
Nov 06 16:16:17 user nova-compute[75337]:     <system>
Nov 06 16:16:17 user nova-compute[75337]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 16:16:17 user nova-compute[75337]:       <entry name="product">OpenStack Nova</entry>
Nov 06 16:16:17 user nova-compute[75337]:       <entry name="version">0.0.0</entry>
Nov 06 16:16:17 user nova-compute[75337]:       <entry name="serial">de77f786-1ecf-4eac-ae4a-c4f6b1d47339</entry>
Nov 06 16:16:17 user nova-compute[75337]:       <entry name="uuid">de77f786-1ecf-4eac-ae4a-c4f6b1d47339</entry>
Nov 06 16:16:17 user nova-compute[75337]:       <entry name="family">Virtual Machine</entry>
Nov 06 16:16:17 user nova-compute[75337]:     </system>
Nov 06 16:16:17 user nova-compute[75337]:   </sysinfo>
Nov 06 16:16:17 user nova-compute[75337]:   <os>
Nov 06 16:16:17 user nova-compute[75337]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 16:16:17 user nova-compute[75337]:     <smbios mode="sysinfo"/>
Nov 06 16:16:17 user nova-compute[75337]:   </os>
Nov 06 16:16:17 user nova-compute[75337]:   <features>
Nov 06 16:16:17 user nova-compute[75337]:     <acpi/>
Nov 06 16:16:17 user nova-compute[75337]:     <apic/>
Nov 06 16:16:17 user nova-compute[75337]:     <vmcoreinfo/>
Nov 06 16:16:17 user nova-compute[75337]:   </features>
Nov 06 16:16:17 user nova-compute[75337]:   <clock offset="utc">
Nov 06 16:16:17 user nova-compute[75337]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 16:16:17 user nova-compute[75337]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 16:16:17 user nova-compute[75337]:     <timer name="hpet" present="no"/>
Nov 06 16:16:17 user nova-compute[75337]:   </clock>
Nov 06 16:16:17 user nova-compute[75337]:   <cpu mode="custom" match="exact">
Nov 06 16:16:17 user nova-compute[75337]:     <model>Nehalem</model>
Nov 06 16:16:17 user nova-compute[75337]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 16:16:17 user nova-compute[75337]:   </cpu>
Nov 06 16:16:17 user nova-compute[75337]:   <devices>
Nov 06 16:16:17 user nova-compute[75337]:     <disk type="file" device="disk">
Nov 06 16:16:17 user nova-compute[75337]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 16:16:17 user nova-compute[75337]:       <source file="/opt/stack/data/nova/instances/de77f786-1ecf-4eac-ae4a-c4f6b1d47339/disk.rescue"/>
Nov 06 16:16:17 user nova-compute[75337]:       <target dev="vda" bus="virtio"/>
Nov 06 16:16:17 user nova-compute[75337]:     </disk>
Nov 06 16:16:17 user nova-compute[75337]:     <disk type="file" device="disk">
Nov 06 16:16:17 user nova-compute[75337]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 16:16:17 user nova-compute[75337]:       <source file="/opt/stack/data/nova/instances/de77f786-1ecf-4eac-ae4a-c4f6b1d47339/disk"/>
Nov 06 16:16:17 user nova-compute[75337]:       <target dev="vdb" bus="virtio"/>
Nov 06 16:16:17 user nova-compute[75337]:     </disk>
Nov 06 16:16:17 user nova-compute[75337]:     <interface type="ethernet">
Nov 06 16:16:17 user nova-compute[75337]:       <mac address="fa:16:3e:4b:fc:cf"/>
Nov 06 16:16:17 user nova-compute[75337]:       <model type="virtio"/>
Nov 06 16:16:17 user nova-compute[75337]:       <mtu size="1442"/>
Nov 06 16:16:17 user nova-compute[75337]:       <target dev="tap8f33a5c0-50"/>
Nov 06 16:16:17 user nova-compute[75337]:     </interface>
Nov 06 16:16:17 user nova-compute[75337]:     <serial type="pty">
Nov 06 16:16:17 user nova-compute[75337]:       <log file="/opt/stack/data/nova/instances/de77f786-1ecf-4eac-ae4a-c4f6b1d47339/console.log" append="off"/>
Nov 06 16:16:17 user nova-compute[75337]:     </serial>
Nov 06 16:16:17 user nova-compute[75337]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 16:16:17 user nova-compute[75337]:     <video>
Nov 06 16:16:17 user nova-compute[75337]:       <model type="virtio"/>
Nov 06 16:16:17 user nova-compute[75337]:     </video>
Nov 06 16:16:17 user nova-compute[75337]:     <rng model="virtio">
Nov 06 16:16:17 user nova-compute[75337]:       <backend model="random">/dev/urandom</backend>
Nov 06 16:16:17 user nova-compute[75337]:     </rng>
Nov 06 16:16:17 user nova-compute[75337]:     <controller type="usb" index="0" model="none"/>
Nov 06 16:16:17 user nova-compute[75337]:     <memballoon model="virtio">
Nov 06 16:16:17 user nova-compute[75337]:       <stats period="10"/>
Nov 06 16:16:17 user nova-compute[75337]:     </memballoon>
Nov 06 16:16:17 user nova-compute[75337]:   </devices>
Nov 06 16:16:17 user nova-compute[75337]: </domain>
Nov 06 16:16:17 user nova-compute[75337]:  {{(pid=75337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 16:16:17 user nova-compute[75337]: INFO nova.virt.libvirt.driver [-] [instance: de77f786-1ecf-4eac-ae4a-c4f6b1d47339] Instance destroyed successfully.
Nov 06 16:16:17 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-3ad4739d-39d5-4730-a6ce-dff77f3e155a tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] No BDM found with device name vda, not building metadata. {{(pid=75337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 16:16:17 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-3ad4739d-39d5-4730-a6ce-dff77f3e155a tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 16:16:17 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-3ad4739d-39d5-4730-a6ce-dff77f3e155a tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] No VIF found with MAC fa:16:3e:4b:fc:cf, not building metadata {{(pid=75337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 16:16:17 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:16:19 user nova-compute[75337]: DEBUG nova.compute.manager [req-474aeffa-b45d-4a1c-8c50-21f43162cf7c req-b7acff7d-942f-4f08-b5e2-525e57f5a93e service nova] [instance: de77f786-1ecf-4eac-ae4a-c4f6b1d47339] Received event network-vif-plugged-8f33a5c0-50e1-4bac-a686-733daf33a307 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:16:19 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-474aeffa-b45d-4a1c-8c50-21f43162cf7c req-b7acff7d-942f-4f08-b5e2-525e57f5a93e service nova] Acquiring lock "de77f786-1ecf-4eac-ae4a-c4f6b1d47339-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:16:19 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-474aeffa-b45d-4a1c-8c50-21f43162cf7c req-b7acff7d-942f-4f08-b5e2-525e57f5a93e service nova] Lock "de77f786-1ecf-4eac-ae4a-c4f6b1d47339-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:16:19 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-474aeffa-b45d-4a1c-8c50-21f43162cf7c req-b7acff7d-942f-4f08-b5e2-525e57f5a93e service nova] Lock "de77f786-1ecf-4eac-ae4a-c4f6b1d47339-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:16:19 user nova-compute[75337]: DEBUG nova.compute.manager [req-474aeffa-b45d-4a1c-8c50-21f43162cf7c req-b7acff7d-942f-4f08-b5e2-525e57f5a93e service nova] [instance: de77f786-1ecf-4eac-ae4a-c4f6b1d47339] No waiting events found dispatching network-vif-plugged-8f33a5c0-50e1-4bac-a686-733daf33a307 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 16:16:19 user nova-compute[75337]: WARNING nova.compute.manager [req-474aeffa-b45d-4a1c-8c50-21f43162cf7c req-b7acff7d-942f-4f08-b5e2-525e57f5a93e service nova] [instance: de77f786-1ecf-4eac-ae4a-c4f6b1d47339] Received unexpected event network-vif-plugged-8f33a5c0-50e1-4bac-a686-733daf33a307 for instance with vm_state active and task_state rescuing.
Nov 06 16:16:19 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:16:19 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:16:19 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:16:19 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:16:19 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:16:20 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:16:20 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:16:20 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:16:21 user nova-compute[75337]: DEBUG nova.compute.manager [req-8f0cc9d6-bfef-4a53-b07a-bbb503cc9aa0 req-be345812-4aa3-4bcf-8af7-40447729ac27 service nova] [instance: de77f786-1ecf-4eac-ae4a-c4f6b1d47339] Received event network-vif-plugged-8f33a5c0-50e1-4bac-a686-733daf33a307 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:16:21 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-8f0cc9d6-bfef-4a53-b07a-bbb503cc9aa0 req-be345812-4aa3-4bcf-8af7-40447729ac27 service nova] Acquiring lock "de77f786-1ecf-4eac-ae4a-c4f6b1d47339-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:16:21 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-8f0cc9d6-bfef-4a53-b07a-bbb503cc9aa0 req-be345812-4aa3-4bcf-8af7-40447729ac27 service nova] Lock "de77f786-1ecf-4eac-ae4a-c4f6b1d47339-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:16:21 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-8f0cc9d6-bfef-4a53-b07a-bbb503cc9aa0 req-be345812-4aa3-4bcf-8af7-40447729ac27 service nova] Lock "de77f786-1ecf-4eac-ae4a-c4f6b1d47339-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:16:21 user nova-compute[75337]: DEBUG nova.compute.manager [req-8f0cc9d6-bfef-4a53-b07a-bbb503cc9aa0 req-be345812-4aa3-4bcf-8af7-40447729ac27 service nova] [instance: de77f786-1ecf-4eac-ae4a-c4f6b1d47339] No waiting events found dispatching network-vif-plugged-8f33a5c0-50e1-4bac-a686-733daf33a307 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 16:16:21 user nova-compute[75337]: WARNING nova.compute.manager [req-8f0cc9d6-bfef-4a53-b07a-bbb503cc9aa0 req-be345812-4aa3-4bcf-8af7-40447729ac27 service nova] [instance: de77f786-1ecf-4eac-ae4a-c4f6b1d47339] Received unexpected event network-vif-plugged-8f33a5c0-50e1-4bac-a686-733daf33a307 for instance with vm_state active and task_state rescuing.
Nov 06 16:16:21 user nova-compute[75337]: DEBUG nova.compute.manager [req-8f0cc9d6-bfef-4a53-b07a-bbb503cc9aa0 req-be345812-4aa3-4bcf-8af7-40447729ac27 service nova] [instance: de77f786-1ecf-4eac-ae4a-c4f6b1d47339] Received event network-vif-plugged-8f33a5c0-50e1-4bac-a686-733daf33a307 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:16:21 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-8f0cc9d6-bfef-4a53-b07a-bbb503cc9aa0 req-be345812-4aa3-4bcf-8af7-40447729ac27 service nova] Acquiring lock "de77f786-1ecf-4eac-ae4a-c4f6b1d47339-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:16:21 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-8f0cc9d6-bfef-4a53-b07a-bbb503cc9aa0 req-be345812-4aa3-4bcf-8af7-40447729ac27 service nova] Lock "de77f786-1ecf-4eac-ae4a-c4f6b1d47339-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:16:21 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-8f0cc9d6-bfef-4a53-b07a-bbb503cc9aa0 req-be345812-4aa3-4bcf-8af7-40447729ac27 service nova] Lock "de77f786-1ecf-4eac-ae4a-c4f6b1d47339-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:16:21 user nova-compute[75337]: DEBUG nova.compute.manager [req-8f0cc9d6-bfef-4a53-b07a-bbb503cc9aa0 req-be345812-4aa3-4bcf-8af7-40447729ac27 service nova] [instance: de77f786-1ecf-4eac-ae4a-c4f6b1d47339] No waiting events found dispatching network-vif-plugged-8f33a5c0-50e1-4bac-a686-733daf33a307 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 16:16:21 user nova-compute[75337]: WARNING nova.compute.manager [req-8f0cc9d6-bfef-4a53-b07a-bbb503cc9aa0 req-be345812-4aa3-4bcf-8af7-40447729ac27 service nova] [instance: de77f786-1ecf-4eac-ae4a-c4f6b1d47339] Received unexpected event network-vif-plugged-8f33a5c0-50e1-4bac-a686-733daf33a307 for instance with vm_state active and task_state rescuing.
Nov 06 16:16:21 user nova-compute[75337]: DEBUG nova.compute.manager [None req-3ad4739d-39d5-4730-a6ce-dff77f3e155a tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] [instance: de77f786-1ecf-4eac-ae4a-c4f6b1d47339] Checking state {{(pid=75337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 16:16:22 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-9c448716-e454-4b98-9867-91a662bdac0e tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Acquiring lock "88330c21-69e0-4d82-ac4d-b9e5e849f487" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:16:22 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-9c448716-e454-4b98-9867-91a662bdac0e tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Lock "88330c21-69e0-4d82-ac4d-b9e5e849f487" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:16:22 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-9c448716-e454-4b98-9867-91a662bdac0e tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Acquiring lock "88330c21-69e0-4d82-ac4d-b9e5e849f487-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:16:22 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-9c448716-e454-4b98-9867-91a662bdac0e tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Lock "88330c21-69e0-4d82-ac4d-b9e5e849f487-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:16:22 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-9c448716-e454-4b98-9867-91a662bdac0e tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Lock "88330c21-69e0-4d82-ac4d-b9e5e849f487-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:16:22 user nova-compute[75337]: INFO nova.compute.manager [None req-9c448716-e454-4b98-9867-91a662bdac0e tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] [instance: 88330c21-69e0-4d82-ac4d-b9e5e849f487] Terminating instance
Nov 06 16:16:22 user nova-compute[75337]: DEBUG nova.compute.manager [None req-9c448716-e454-4b98-9867-91a662bdac0e tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] [instance: 88330c21-69e0-4d82-ac4d-b9e5e849f487] Start destroying the instance on the hypervisor. {{(pid=75337) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 16:16:22 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:16:22 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:16:22 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:16:22 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:16:23 user nova-compute[75337]: DEBUG nova.compute.manager [req-61b89029-78f3-4bd7-8844-947366754411 req-01373538-0e2f-41df-9c0e-75b32dafe3e6 service nova] [instance: 88330c21-69e0-4d82-ac4d-b9e5e849f487] Received event network-vif-unplugged-4ae4cf27-266c-40f8-a268-1d03f150f318 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:16:23 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-61b89029-78f3-4bd7-8844-947366754411 req-01373538-0e2f-41df-9c0e-75b32dafe3e6 service nova] Acquiring lock "88330c21-69e0-4d82-ac4d-b9e5e849f487-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:16:23 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-61b89029-78f3-4bd7-8844-947366754411 req-01373538-0e2f-41df-9c0e-75b32dafe3e6 service nova] Lock "88330c21-69e0-4d82-ac4d-b9e5e849f487-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:16:23 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-61b89029-78f3-4bd7-8844-947366754411 req-01373538-0e2f-41df-9c0e-75b32dafe3e6 service nova] Lock "88330c21-69e0-4d82-ac4d-b9e5e849f487-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:16:23 user nova-compute[75337]: DEBUG nova.compute.manager [req-61b89029-78f3-4bd7-8844-947366754411 req-01373538-0e2f-41df-9c0e-75b32dafe3e6 service nova] [instance: 88330c21-69e0-4d82-ac4d-b9e5e849f487] No waiting events found dispatching network-vif-unplugged-4ae4cf27-266c-40f8-a268-1d03f150f318 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 16:16:23 user nova-compute[75337]: DEBUG nova.compute.manager [req-61b89029-78f3-4bd7-8844-947366754411 req-01373538-0e2f-41df-9c0e-75b32dafe3e6 service nova] [instance: 88330c21-69e0-4d82-ac4d-b9e5e849f487] Received event network-vif-unplugged-4ae4cf27-266c-40f8-a268-1d03f150f318 for instance with task_state deleting. {{(pid=75337) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 16:16:23 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:16:23 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:16:23 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:16:23 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:16:23 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:16:23 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75337) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 16:16:23 user nova-compute[75337]: INFO nova.virt.libvirt.driver [-] [instance: 88330c21-69e0-4d82-ac4d-b9e5e849f487] Instance destroyed successfully.
Nov 06 16:16:23 user nova-compute[75337]: DEBUG nova.objects.instance [None req-9c448716-e454-4b98-9867-91a662bdac0e tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Lazy-loading 'resources' on Instance uuid 88330c21-69e0-4d82-ac4d-b9e5e849f487 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 16:16:23 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-9c448716-e454-4b98-9867-91a662bdac0e tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T16:06:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-307149588',display_name='tempest-SnapshotDataIntegrityTests-server-307149588',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-307149588',id=45,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH1LqK7urhxtmlD+dHJNix1u7YK0/vHOvLaVUP45fm3AZUTXI1SutvrmQqyqFK5QAihENEb2S35GcZM+k1Cd4KwmJwEqlw80fwBG6OZQDBSXRlQArqDcbk/695qlrAk5Uw==',key_name='tempest-keypair-1834344123',keypairs=<?>,launch_index=0,launched_at=2023-11-06T16:06:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5b8417f9bf0f4ccbbcb9823c8825a3d1',ramdisk_id='',reservation_id='r-8mvz0su0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-175285321',owner_user_name='tempest-SnapshotDataIntegrityTests-175285321-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T16:06:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1f529c0585334b539f0235a5464b4567',uuid=88330c21-69e0-4d82-ac4d-b9e5e849f487,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4ae4cf27-266c-40f8-a268-1d03f150f318", "address": "fa:16:3e:d4:3f:d4", "network": {"id": "40ec2d9f-fe05-45bb-8321-e065c7c5cab0", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-863555405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b8417f9bf0f4ccbbcb9823c8825a3d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ae4cf27-26", "ovs_interfaceid": "4ae4cf27-266c-40f8-a268-1d03f150f318", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 16:16:23 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-9c448716-e454-4b98-9867-91a662bdac0e tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Converting VIF {"id": "4ae4cf27-266c-40f8-a268-1d03f150f318", "address": "fa:16:3e:d4:3f:d4", "network": {"id": "40ec2d9f-fe05-45bb-8321-e065c7c5cab0", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-863555405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b8417f9bf0f4ccbbcb9823c8825a3d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ae4cf27-26", "ovs_interfaceid": "4ae4cf27-266c-40f8-a268-1d03f150f318", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 16:16:23 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-9c448716-e454-4b98-9867-91a662bdac0e tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d4:3f:d4,bridge_name='br-int',has_traffic_filtering=True,id=4ae4cf27-266c-40f8-a268-1d03f150f318,network=Network(40ec2d9f-fe05-45bb-8321-e065c7c5cab0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ae4cf27-26') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 16:16:23 user nova-compute[75337]: DEBUG os_vif [None req-9c448716-e454-4b98-9867-91a662bdac0e tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d4:3f:d4,bridge_name='br-int',has_traffic_filtering=True,id=4ae4cf27-266c-40f8-a268-1d03f150f318,network=Network(40ec2d9f-fe05-45bb-8321-e065c7c5cab0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ae4cf27-26') {{(pid=75337) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 16:16:23 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:16:23 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4ae4cf27-26, bridge=br-int, if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 16:16:23 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:16:23 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:16:23 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:16:23 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9c3a3712-7d20-4961-8386-8db7b3f7b98b) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 16:16:23 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:16:23 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:16:23 user nova-compute[75337]: INFO os_vif [None req-9c448716-e454-4b98-9867-91a662bdac0e tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d4:3f:d4,bridge_name='br-int',has_traffic_filtering=True,id=4ae4cf27-266c-40f8-a268-1d03f150f318,network=Network(40ec2d9f-fe05-45bb-8321-e065c7c5cab0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ae4cf27-26')
Nov 06 16:16:23 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-9c448716-e454-4b98-9867-91a662bdac0e tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] [instance: 88330c21-69e0-4d82-ac4d-b9e5e849f487] Deleting instance files /opt/stack/data/nova/instances/88330c21-69e0-4d82-ac4d-b9e5e849f487_del
Nov 06 16:16:23 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-9c448716-e454-4b98-9867-91a662bdac0e tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] [instance: 88330c21-69e0-4d82-ac4d-b9e5e849f487] Deletion of /opt/stack/data/nova/instances/88330c21-69e0-4d82-ac4d-b9e5e849f487_del complete
Nov 06 16:16:23 user nova-compute[75337]: INFO nova.compute.manager [None req-9c448716-e454-4b98-9867-91a662bdac0e tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] [instance: 88330c21-69e0-4d82-ac4d-b9e5e849f487] Took 0.93 seconds to destroy the instance on the hypervisor.
Nov 06 16:16:23 user nova-compute[75337]: DEBUG oslo.service.loopingcall [None req-9c448716-e454-4b98-9867-91a662bdac0e tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75337) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 16:16:23 user nova-compute[75337]: DEBUG nova.compute.manager [-] [instance: 88330c21-69e0-4d82-ac4d-b9e5e849f487] Deallocating network for instance {{(pid=75337) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 16:16:23 user nova-compute[75337]: DEBUG nova.network.neutron [-] [instance: 88330c21-69e0-4d82-ac4d-b9e5e849f487] deallocate_for_instance() {{(pid=75337) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 16:16:24 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:16:24 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:16:24 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:16:24 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:16:24 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:16:24 user nova-compute[75337]: DEBUG nova.network.neutron [-] [instance: 88330c21-69e0-4d82-ac4d-b9e5e849f487] Updating instance_info_cache with network_info: [] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 16:16:24 user nova-compute[75337]: INFO nova.compute.manager [-] [instance: 88330c21-69e0-4d82-ac4d-b9e5e849f487] Took 1.04 seconds to deallocate network for instance.
Nov 06 16:16:24 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-9c448716-e454-4b98-9867-91a662bdac0e tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:16:24 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-9c448716-e454-4b98-9867-91a662bdac0e tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:16:24 user nova-compute[75337]: DEBUG nova.compute.manager [req-7f23bacf-6347-40ef-bf4b-855567fa0643 req-2945107b-72d7-4aed-bd55-e85f07327606 service nova] [instance: 88330c21-69e0-4d82-ac4d-b9e5e849f487] Received event network-vif-deleted-4ae4cf27-266c-40f8-a268-1d03f150f318 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:16:24 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-9c448716-e454-4b98-9867-91a662bdac0e tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 16:16:24 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-9c448716-e454-4b98-9867-91a662bdac0e tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 16:16:24 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-9c448716-e454-4b98-9867-91a662bdac0e tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.181s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:16:25 user nova-compute[75337]: INFO nova.scheduler.client.report [None req-9c448716-e454-4b98-9867-91a662bdac0e tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Deleted allocations for instance 88330c21-69e0-4d82-ac4d-b9e5e849f487
Nov 06 16:16:25 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-9c448716-e454-4b98-9867-91a662bdac0e tempest-SnapshotDataIntegrityTests-175285321 tempest-SnapshotDataIntegrityTests-175285321-project-member] Lock "88330c21-69e0-4d82-ac4d-b9e5e849f487" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.354s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:16:25 user nova-compute[75337]: DEBUG nova.compute.manager [req-a1507371-f9f4-455d-9ebd-3d8c28350976 req-7704e13e-3d65-407e-8841-f860d765c8f1 service nova] [instance: 88330c21-69e0-4d82-ac4d-b9e5e849f487] Received event network-vif-plugged-4ae4cf27-266c-40f8-a268-1d03f150f318 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:16:25 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-a1507371-f9f4-455d-9ebd-3d8c28350976 req-7704e13e-3d65-407e-8841-f860d765c8f1 service nova] Acquiring lock "88330c21-69e0-4d82-ac4d-b9e5e849f487-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:16:25 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-a1507371-f9f4-455d-9ebd-3d8c28350976 req-7704e13e-3d65-407e-8841-f860d765c8f1 service nova] Lock "88330c21-69e0-4d82-ac4d-b9e5e849f487-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:16:25 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-a1507371-f9f4-455d-9ebd-3d8c28350976 req-7704e13e-3d65-407e-8841-f860d765c8f1 service nova] Lock "88330c21-69e0-4d82-ac4d-b9e5e849f487-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:16:25 user nova-compute[75337]: DEBUG nova.compute.manager [req-a1507371-f9f4-455d-9ebd-3d8c28350976 req-7704e13e-3d65-407e-8841-f860d765c8f1 service nova] [instance: 88330c21-69e0-4d82-ac4d-b9e5e849f487] No waiting events found dispatching network-vif-plugged-4ae4cf27-266c-40f8-a268-1d03f150f318 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 16:16:25 user nova-compute[75337]: WARNING nova.compute.manager [req-a1507371-f9f4-455d-9ebd-3d8c28350976 req-7704e13e-3d65-407e-8841-f860d765c8f1 service nova] [instance: 88330c21-69e0-4d82-ac4d-b9e5e849f487] Received unexpected event network-vif-plugged-4ae4cf27-266c-40f8-a268-1d03f150f318 for instance with vm_state deleted and task_state None.
Nov 06 16:16:25 user nova-compute[75337]: DEBUG nova.compute.manager [req-a1507371-f9f4-455d-9ebd-3d8c28350976 req-7704e13e-3d65-407e-8841-f860d765c8f1 service nova] [instance: 88330c21-69e0-4d82-ac4d-b9e5e849f487] Received event network-vif-plugged-4ae4cf27-266c-40f8-a268-1d03f150f318 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:16:25 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-a1507371-f9f4-455d-9ebd-3d8c28350976 req-7704e13e-3d65-407e-8841-f860d765c8f1 service nova] Acquiring lock "88330c21-69e0-4d82-ac4d-b9e5e849f487-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:16:25 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-a1507371-f9f4-455d-9ebd-3d8c28350976 req-7704e13e-3d65-407e-8841-f860d765c8f1 service nova] Lock "88330c21-69e0-4d82-ac4d-b9e5e849f487-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:16:25 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-a1507371-f9f4-455d-9ebd-3d8c28350976 req-7704e13e-3d65-407e-8841-f860d765c8f1 service nova] Lock "88330c21-69e0-4d82-ac4d-b9e5e849f487-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:16:25 user nova-compute[75337]: DEBUG nova.compute.manager [req-a1507371-f9f4-455d-9ebd-3d8c28350976 req-7704e13e-3d65-407e-8841-f860d765c8f1 service nova] [instance: 88330c21-69e0-4d82-ac4d-b9e5e849f487] No waiting events found dispatching network-vif-plugged-4ae4cf27-266c-40f8-a268-1d03f150f318 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 16:16:25 user nova-compute[75337]: WARNING nova.compute.manager [req-a1507371-f9f4-455d-9ebd-3d8c28350976 req-7704e13e-3d65-407e-8841-f860d765c8f1 service nova] [instance: 88330c21-69e0-4d82-ac4d-b9e5e849f487] Received unexpected event network-vif-plugged-4ae4cf27-266c-40f8-a268-1d03f150f318 for instance with vm_state deleted and task_state None.
Nov 06 16:16:25 user nova-compute[75337]: DEBUG nova.compute.manager [req-a1507371-f9f4-455d-9ebd-3d8c28350976 req-7704e13e-3d65-407e-8841-f860d765c8f1 service nova] [instance: 88330c21-69e0-4d82-ac4d-b9e5e849f487] Received event network-vif-plugged-4ae4cf27-266c-40f8-a268-1d03f150f318 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:16:25 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-a1507371-f9f4-455d-9ebd-3d8c28350976 req-7704e13e-3d65-407e-8841-f860d765c8f1 service nova] Acquiring lock "88330c21-69e0-4d82-ac4d-b9e5e849f487-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:16:25 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-a1507371-f9f4-455d-9ebd-3d8c28350976 req-7704e13e-3d65-407e-8841-f860d765c8f1 service nova] Lock "88330c21-69e0-4d82-ac4d-b9e5e849f487-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:16:25 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-a1507371-f9f4-455d-9ebd-3d8c28350976 req-7704e13e-3d65-407e-8841-f860d765c8f1 service nova] Lock "88330c21-69e0-4d82-ac4d-b9e5e849f487-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:16:25 user nova-compute[75337]: DEBUG nova.compute.manager [req-a1507371-f9f4-455d-9ebd-3d8c28350976 req-7704e13e-3d65-407e-8841-f860d765c8f1 service nova] [instance: 88330c21-69e0-4d82-ac4d-b9e5e849f487] No waiting events found dispatching network-vif-plugged-4ae4cf27-266c-40f8-a268-1d03f150f318 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 16:16:25 user nova-compute[75337]: WARNING nova.compute.manager [req-a1507371-f9f4-455d-9ebd-3d8c28350976 req-7704e13e-3d65-407e-8841-f860d765c8f1 service nova] [instance: 88330c21-69e0-4d82-ac4d-b9e5e849f487] Received unexpected event network-vif-plugged-4ae4cf27-266c-40f8-a268-1d03f150f318 for instance with vm_state deleted and task_state None.
Nov 06 16:16:25 user nova-compute[75337]: DEBUG nova.compute.manager [req-a1507371-f9f4-455d-9ebd-3d8c28350976 req-7704e13e-3d65-407e-8841-f860d765c8f1 service nova] [instance: 88330c21-69e0-4d82-ac4d-b9e5e849f487] Received event network-vif-unplugged-4ae4cf27-266c-40f8-a268-1d03f150f318 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:16:25 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-a1507371-f9f4-455d-9ebd-3d8c28350976 req-7704e13e-3d65-407e-8841-f860d765c8f1 service nova] Acquiring lock "88330c21-69e0-4d82-ac4d-b9e5e849f487-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:16:25 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-a1507371-f9f4-455d-9ebd-3d8c28350976 req-7704e13e-3d65-407e-8841-f860d765c8f1 service nova] Lock "88330c21-69e0-4d82-ac4d-b9e5e849f487-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:16:25 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-a1507371-f9f4-455d-9ebd-3d8c28350976 req-7704e13e-3d65-407e-8841-f860d765c8f1 service nova] Lock "88330c21-69e0-4d82-ac4d-b9e5e849f487-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:16:25 user nova-compute[75337]: DEBUG nova.compute.manager [req-a1507371-f9f4-455d-9ebd-3d8c28350976 req-7704e13e-3d65-407e-8841-f860d765c8f1 service nova] [instance: 88330c21-69e0-4d82-ac4d-b9e5e849f487] No waiting events found dispatching network-vif-unplugged-4ae4cf27-266c-40f8-a268-1d03f150f318 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 16:16:25 user nova-compute[75337]: WARNING nova.compute.manager [req-a1507371-f9f4-455d-9ebd-3d8c28350976 req-7704e13e-3d65-407e-8841-f860d765c8f1 service nova] [instance: 88330c21-69e0-4d82-ac4d-b9e5e849f487] Received unexpected event network-vif-unplugged-4ae4cf27-266c-40f8-a268-1d03f150f318 for instance with vm_state deleted and task_state None.
Nov 06 16:16:25 user nova-compute[75337]: DEBUG nova.compute.manager [req-a1507371-f9f4-455d-9ebd-3d8c28350976 req-7704e13e-3d65-407e-8841-f860d765c8f1 service nova] [instance: 88330c21-69e0-4d82-ac4d-b9e5e849f487] Received event network-vif-plugged-4ae4cf27-266c-40f8-a268-1d03f150f318 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:16:25 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-a1507371-f9f4-455d-9ebd-3d8c28350976 req-7704e13e-3d65-407e-8841-f860d765c8f1 service nova] Acquiring lock "88330c21-69e0-4d82-ac4d-b9e5e849f487-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:16:25 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-a1507371-f9f4-455d-9ebd-3d8c28350976 req-7704e13e-3d65-407e-8841-f860d765c8f1 service nova] Lock "88330c21-69e0-4d82-ac4d-b9e5e849f487-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:16:25 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-a1507371-f9f4-455d-9ebd-3d8c28350976 req-7704e13e-3d65-407e-8841-f860d765c8f1 service nova] Lock "88330c21-69e0-4d82-ac4d-b9e5e849f487-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:16:25 user nova-compute[75337]: DEBUG nova.compute.manager [req-a1507371-f9f4-455d-9ebd-3d8c28350976 req-7704e13e-3d65-407e-8841-f860d765c8f1 service nova] [instance: 88330c21-69e0-4d82-ac4d-b9e5e849f487] No waiting events found dispatching network-vif-plugged-4ae4cf27-266c-40f8-a268-1d03f150f318 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 16:16:25 user nova-compute[75337]: WARNING nova.compute.manager [req-a1507371-f9f4-455d-9ebd-3d8c28350976 req-7704e13e-3d65-407e-8841-f860d765c8f1 service nova] [instance: 88330c21-69e0-4d82-ac4d-b9e5e849f487] Received unexpected event network-vif-plugged-4ae4cf27-266c-40f8-a268-1d03f150f318 for instance with vm_state deleted and task_state None.
Nov 06 16:16:26 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:16:27 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:16:28 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:16:29 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:16:29 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:16:33 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:16:34 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:16:34 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Starting heal instance info cache {{(pid=75337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 16:16:34 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Rebuilding the list of instances to heal {{(pid=75337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 06 16:16:34 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "refresh_cache-525c87e5-14c3-40fd-8976-8df151ed07fa" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 16:16:34 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquired lock "refresh_cache-525c87e5-14c3-40fd-8976-8df151ed07fa" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 16:16:34 user nova-compute[75337]: DEBUG nova.network.neutron [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] [instance: 525c87e5-14c3-40fd-8976-8df151ed07fa] Forcefully refreshing network info cache for instance {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 16:16:34 user nova-compute[75337]: DEBUG nova.objects.instance [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lazy-loading 'info_cache' on Instance uuid 525c87e5-14c3-40fd-8976-8df151ed07fa {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 16:16:35 user nova-compute[75337]: DEBUG nova.network.neutron [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] [instance: 525c87e5-14c3-40fd-8976-8df151ed07fa] Updating instance_info_cache with network_info: [{"id": "1dfbe337-9efa-4a6a-9801-e9264673d095", "address": "fa:16:3e:fd:18:f1", "network": {"id": "0da0e0bd-b07e-4ae1-8625-a979ed32bd07", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-528047864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f71610b3d00f412ea4aeba8068d032fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dfbe337-9e", "ovs_interfaceid": "1dfbe337-9efa-4a6a-9801-e9264673d095", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 16:16:35 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Releasing lock "refresh_cache-525c87e5-14c3-40fd-8976-8df151ed07fa" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 16:16:35 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] [instance: 525c87e5-14c3-40fd-8976-8df151ed07fa] Updated the network info_cache for instance {{(pid=75337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 16:16:35 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:16:36 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:16:38 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:16:39 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager.update_available_resource {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:16:39 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:16:39 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:16:39 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:16:39 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Auditing locally available compute resources for user (node: user) {{(pid=75337) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 16:16:39 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525c87e5-14c3-40fd-8976-8df151ed07fa/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:16:39 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525c87e5-14c3-40fd-8976-8df151ed07fa/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:16:39 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525c87e5-14c3-40fd-8976-8df151ed07fa/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:16:40 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525c87e5-14c3-40fd-8976-8df151ed07fa/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:16:40 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de77f786-1ecf-4eac-ae4a-c4f6b1d47339/disk.rescue --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:16:40 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:16:40 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de77f786-1ecf-4eac-ae4a-c4f6b1d47339/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:16:40 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de77f786-1ecf-4eac-ae4a-c4f6b1d47339/disk.rescue --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:16:40 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de77f786-1ecf-4eac-ae4a-c4f6b1d47339/disk.rescue --force-share --output=json" returned: 0 in 0.169s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:16:40 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de77f786-1ecf-4eac-ae4a-c4f6b1d47339/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:16:40 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de77f786-1ecf-4eac-ae4a-c4f6b1d47339/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:16:40 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de77f786-1ecf-4eac-ae4a-c4f6b1d47339/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:16:40 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de77f786-1ecf-4eac-ae4a-c4f6b1d47339/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:16:41 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 16:16:41 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 16:16:41 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Hypervisor/Node resource view: name=user free_ram=8757MB free_disk=24.999309539794922GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75337) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 16:16:41 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:16:41 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:16:41 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 525c87e5-14c3-40fd-8976-8df151ed07fa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 16:16:41 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance de77f786-1ecf-4eac-ae4a-c4f6b1d47339 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 16:16:41 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 16:16:41 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 16:16:41 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 16:16:41 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 16:16:41 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Compute_service record updated for user:user {{(pid=75337) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 16:16:41 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.215s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:16:43 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:16:45 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:16:48 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:16:50 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:16:53 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:16:55 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:16:58 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:17:03 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:17:03 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:17:03 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75337) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 16:17:03 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 16:17:03 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 16:17:03 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:17:08 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:17:13 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:17:14 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:17:17 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:17:18 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:17:19 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:17:21 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:17:21 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:17:23 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:17:23 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75337) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 16:17:23 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:17:27 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:17:28 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:17:28 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:17:28 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:17:28 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75337) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 16:17:28 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 16:17:28 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 16:17:28 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:17:30 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:17:31 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:17:33 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:17:36 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:17:36 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Starting heal instance info cache {{(pid=75337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 16:17:36 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "refresh_cache-de77f786-1ecf-4eac-ae4a-c4f6b1d47339" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 16:17:36 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquired lock "refresh_cache-de77f786-1ecf-4eac-ae4a-c4f6b1d47339" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 16:17:36 user nova-compute[75337]: DEBUG nova.network.neutron [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] [instance: de77f786-1ecf-4eac-ae4a-c4f6b1d47339] Forcefully refreshing network info cache for instance {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 16:17:36 user nova-compute[75337]: DEBUG nova.network.neutron [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] [instance: de77f786-1ecf-4eac-ae4a-c4f6b1d47339] Updating instance_info_cache with network_info: [{"id": "8f33a5c0-50e1-4bac-a686-733daf33a307", "address": "fa:16:3e:4b:fc:cf", "network": {"id": "0da0e0bd-b07e-4ae1-8625-a979ed32bd07", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-528047864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f71610b3d00f412ea4aeba8068d032fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f33a5c0-50", "ovs_interfaceid": "8f33a5c0-50e1-4bac-a686-733daf33a307", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 16:17:37 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Releasing lock "refresh_cache-de77f786-1ecf-4eac-ae4a-c4f6b1d47339" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 16:17:37 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] [instance: de77f786-1ecf-4eac-ae4a-c4f6b1d47339] Updated the network info_cache for instance {{(pid=75337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 16:17:38 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:17:38 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:17:38 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75337) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 16:17:38 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 16:17:38 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 16:17:38 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:17:41 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager.update_available_resource {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:17:41 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:17:41 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:17:41 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:17:41 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Auditing locally available compute resources for user (node: user) {{(pid=75337) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 16:17:41 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525c87e5-14c3-40fd-8976-8df151ed07fa/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:17:41 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525c87e5-14c3-40fd-8976-8df151ed07fa/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:17:41 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525c87e5-14c3-40fd-8976-8df151ed07fa/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:17:42 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525c87e5-14c3-40fd-8976-8df151ed07fa/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:17:42 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de77f786-1ecf-4eac-ae4a-c4f6b1d47339/disk.rescue --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:17:42 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de77f786-1ecf-4eac-ae4a-c4f6b1d47339/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:17:42 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de77f786-1ecf-4eac-ae4a-c4f6b1d47339/disk.rescue --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:17:42 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de77f786-1ecf-4eac-ae4a-c4f6b1d47339/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:17:42 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de77f786-1ecf-4eac-ae4a-c4f6b1d47339/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:17:42 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de77f786-1ecf-4eac-ae4a-c4f6b1d47339/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:17:42 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de77f786-1ecf-4eac-ae4a-c4f6b1d47339/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:17:42 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de77f786-1ecf-4eac-ae4a-c4f6b1d47339/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:17:43 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 16:17:43 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 16:17:43 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Hypervisor/Node resource view: name=user free_ram=8879MB free_disk=24.989700317382812GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75337) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 16:17:43 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:17:43 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:17:43 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 525c87e5-14c3-40fd-8976-8df151ed07fa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 16:17:43 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance de77f786-1ecf-4eac-ae4a-c4f6b1d47339 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 16:17:43 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 16:17:43 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 16:17:43 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 16:17:43 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 16:17:43 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Compute_service record updated for user:user {{(pid=75337) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 16:17:43 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.177s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:17:43 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:17:48 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:17:53 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:17:58 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:18:03 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:18:08 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:18:08 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:18:08 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75337) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 16:18:08 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 16:18:08 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 16:18:08 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:18:13 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:18:18 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:18:18 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:18:18 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75337) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 16:18:18 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 16:18:18 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 16:18:18 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:18:21 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:18:22 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:18:23 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:18:24 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:18:24 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75337) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 16:18:28 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:18:29 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:18:30 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:18:32 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:18:32 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:18:33 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:18:36 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:18:38 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:18:38 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Starting heal instance info cache {{(pid=75337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 16:18:38 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Rebuilding the list of instances to heal {{(pid=75337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 06 16:18:38 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:18:38 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "refresh_cache-525c87e5-14c3-40fd-8976-8df151ed07fa" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 16:18:38 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquired lock "refresh_cache-525c87e5-14c3-40fd-8976-8df151ed07fa" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 16:18:38 user nova-compute[75337]: DEBUG nova.network.neutron [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] [instance: 525c87e5-14c3-40fd-8976-8df151ed07fa] Forcefully refreshing network info cache for instance {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 16:18:38 user nova-compute[75337]: DEBUG nova.objects.instance [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lazy-loading 'info_cache' on Instance uuid 525c87e5-14c3-40fd-8976-8df151ed07fa {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 16:18:39 user nova-compute[75337]: DEBUG nova.network.neutron [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] [instance: 525c87e5-14c3-40fd-8976-8df151ed07fa] Updating instance_info_cache with network_info: [{"id": "1dfbe337-9efa-4a6a-9801-e9264673d095", "address": "fa:16:3e:fd:18:f1", "network": {"id": "0da0e0bd-b07e-4ae1-8625-a979ed32bd07", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-528047864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f71610b3d00f412ea4aeba8068d032fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dfbe337-9e", "ovs_interfaceid": "1dfbe337-9efa-4a6a-9801-e9264673d095", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 16:18:39 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Releasing lock "refresh_cache-525c87e5-14c3-40fd-8976-8df151ed07fa" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 16:18:39 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] [instance: 525c87e5-14c3-40fd-8976-8df151ed07fa] Updated the network info_cache for instance {{(pid=75337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 16:18:42 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager.update_available_resource {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:18:42 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:18:42 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:18:42 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:18:42 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Auditing locally available compute resources for user (node: user) {{(pid=75337) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 16:18:42 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525c87e5-14c3-40fd-8976-8df151ed07fa/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:18:42 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525c87e5-14c3-40fd-8976-8df151ed07fa/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:18:42 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525c87e5-14c3-40fd-8976-8df151ed07fa/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:18:43 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525c87e5-14c3-40fd-8976-8df151ed07fa/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:18:43 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de77f786-1ecf-4eac-ae4a-c4f6b1d47339/disk.rescue --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:18:43 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de77f786-1ecf-4eac-ae4a-c4f6b1d47339/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:18:43 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de77f786-1ecf-4eac-ae4a-c4f6b1d47339/disk.rescue --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:18:43 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de77f786-1ecf-4eac-ae4a-c4f6b1d47339/disk.rescue --force-share --output=json" returned: 0 in 0.166s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:18:43 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de77f786-1ecf-4eac-ae4a-c4f6b1d47339/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:18:43 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de77f786-1ecf-4eac-ae4a-c4f6b1d47339/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:18:43 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de77f786-1ecf-4eac-ae4a-c4f6b1d47339/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:18:43 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:18:43 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de77f786-1ecf-4eac-ae4a-c4f6b1d47339/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:18:44 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 16:18:44 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 16:18:44 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Hypervisor/Node resource view: name=user free_ram=8900MB free_disk=24.9891357421875GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75337) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 16:18:44 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:18:44 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:18:44 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 525c87e5-14c3-40fd-8976-8df151ed07fa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 16:18:44 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance de77f786-1ecf-4eac-ae4a-c4f6b1d47339 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 16:18:44 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 16:18:44 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 16:18:44 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 16:18:44 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 16:18:44 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Compute_service record updated for user:user {{(pid=75337) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 16:18:44 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.231s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:18:48 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:18:53 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:18:58 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:19:03 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:19:08 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:19:12 user nova-compute[75337]: INFO nova.compute.manager [None req-cf6854d6-176c-4488-9d92-056f4ab2cf40 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] [instance: 525c87e5-14c3-40fd-8976-8df151ed07fa] Rescuing
Nov 06 16:19:12 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-cf6854d6-176c-4488-9d92-056f4ab2cf40 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Acquiring lock "refresh_cache-525c87e5-14c3-40fd-8976-8df151ed07fa" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 16:19:12 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-cf6854d6-176c-4488-9d92-056f4ab2cf40 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Acquired lock "refresh_cache-525c87e5-14c3-40fd-8976-8df151ed07fa" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 16:19:12 user nova-compute[75337]: DEBUG nova.network.neutron [None req-cf6854d6-176c-4488-9d92-056f4ab2cf40 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] [instance: 525c87e5-14c3-40fd-8976-8df151ed07fa] Building network info cache for instance {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 16:19:13 user nova-compute[75337]: DEBUG nova.network.neutron [None req-cf6854d6-176c-4488-9d92-056f4ab2cf40 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] [instance: 525c87e5-14c3-40fd-8976-8df151ed07fa] Updating instance_info_cache with network_info: [{"id": "1dfbe337-9efa-4a6a-9801-e9264673d095", "address": "fa:16:3e:fd:18:f1", "network": {"id": "0da0e0bd-b07e-4ae1-8625-a979ed32bd07", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-528047864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f71610b3d00f412ea4aeba8068d032fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dfbe337-9e", "ovs_interfaceid": "1dfbe337-9efa-4a6a-9801-e9264673d095", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 16:19:13 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-cf6854d6-176c-4488-9d92-056f4ab2cf40 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Releasing lock "refresh_cache-525c87e5-14c3-40fd-8976-8df151ed07fa" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 16:19:13 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:19:13 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:19:13 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:19:13 user nova-compute[75337]: DEBUG nova.compute.manager [req-28153a6e-bbac-44d3-b994-1847d8c49b65 req-fa279649-ae0f-4df3-9d0c-ed4ee60c73b9 service nova] [instance: 525c87e5-14c3-40fd-8976-8df151ed07fa] Received event network-vif-unplugged-1dfbe337-9efa-4a6a-9801-e9264673d095 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:19:13 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-28153a6e-bbac-44d3-b994-1847d8c49b65 req-fa279649-ae0f-4df3-9d0c-ed4ee60c73b9 service nova] Acquiring lock "525c87e5-14c3-40fd-8976-8df151ed07fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:19:13 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-28153a6e-bbac-44d3-b994-1847d8c49b65 req-fa279649-ae0f-4df3-9d0c-ed4ee60c73b9 service nova] Lock "525c87e5-14c3-40fd-8976-8df151ed07fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:19:13 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-28153a6e-bbac-44d3-b994-1847d8c49b65 req-fa279649-ae0f-4df3-9d0c-ed4ee60c73b9 service nova] Lock "525c87e5-14c3-40fd-8976-8df151ed07fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:19:13 user nova-compute[75337]: DEBUG nova.compute.manager [req-28153a6e-bbac-44d3-b994-1847d8c49b65 req-fa279649-ae0f-4df3-9d0c-ed4ee60c73b9 service nova] [instance: 525c87e5-14c3-40fd-8976-8df151ed07fa] No waiting events found dispatching network-vif-unplugged-1dfbe337-9efa-4a6a-9801-e9264673d095 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 16:19:13 user nova-compute[75337]: WARNING nova.compute.manager [req-28153a6e-bbac-44d3-b994-1847d8c49b65 req-fa279649-ae0f-4df3-9d0c-ed4ee60c73b9 service nova] [instance: 525c87e5-14c3-40fd-8976-8df151ed07fa] Received unexpected event network-vif-unplugged-1dfbe337-9efa-4a6a-9801-e9264673d095 for instance with vm_state active and task_state rescuing.
Nov 06 16:19:13 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:19:13 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:19:13 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:19:13 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:19:13 user nova-compute[75337]: INFO nova.virt.libvirt.driver [-] [instance: 525c87e5-14c3-40fd-8976-8df151ed07fa] Instance destroyed successfully.
Nov 06 16:19:13 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-cf6854d6-176c-4488-9d92-056f4ab2cf40 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] [instance: 525c87e5-14c3-40fd-8976-8df151ed07fa] Attempting rescue
Nov 06 16:19:13 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-cf6854d6-176c-4488-9d92-056f4ab2cf40 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75337) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 06 16:19:13 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-cf6854d6-176c-4488-9d92-056f4ab2cf40 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] [instance: 525c87e5-14c3-40fd-8976-8df151ed07fa] Instance directory exists: not creating {{(pid=75337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 06 16:19:13 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-cf6854d6-176c-4488-9d92-056f4ab2cf40 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] [instance: 525c87e5-14c3-40fd-8976-8df151ed07fa] Creating image(s)
Nov 06 16:19:13 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-cf6854d6-176c-4488-9d92-056f4ab2cf40 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Acquiring lock "/opt/stack/data/nova/instances/525c87e5-14c3-40fd-8976-8df151ed07fa/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:19:13 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-cf6854d6-176c-4488-9d92-056f4ab2cf40 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Lock "/opt/stack/data/nova/instances/525c87e5-14c3-40fd-8976-8df151ed07fa/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:19:13 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-cf6854d6-176c-4488-9d92-056f4ab2cf40 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Lock "/opt/stack/data/nova/instances/525c87e5-14c3-40fd-8976-8df151ed07fa/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:19:13 user nova-compute[75337]: DEBUG nova.objects.instance [None req-cf6854d6-176c-4488-9d92-056f4ab2cf40 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Lazy-loading 'trusted_certs' on Instance uuid 525c87e5-14c3-40fd-8976-8df151ed07fa {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 16:19:13 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-cf6854d6-176c-4488-9d92-056f4ab2cf40 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Acquiring lock "06ba3c914798499e686c5ac75886932347225275" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:19:13 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-cf6854d6-176c-4488-9d92-056f4ab2cf40 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Lock "06ba3c914798499e686c5ac75886932347225275" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:19:13 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-cf6854d6-176c-4488-9d92-056f4ab2cf40 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:19:14 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-cf6854d6-176c-4488-9d92-056f4ab2cf40 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json" returned: 0 in 0.168s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:19:14 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-cf6854d6-176c-4488-9d92-056f4ab2cf40 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275,backing_fmt=raw /opt/stack/data/nova/instances/525c87e5-14c3-40fd-8976-8df151ed07fa/disk.rescue {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:19:14 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-cf6854d6-176c-4488-9d92-056f4ab2cf40 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275,backing_fmt=raw /opt/stack/data/nova/instances/525c87e5-14c3-40fd-8976-8df151ed07fa/disk.rescue" returned: 0 in 0.049s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:19:14 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-cf6854d6-176c-4488-9d92-056f4ab2cf40 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Lock "06ba3c914798499e686c5ac75886932347225275" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.228s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:19:14 user nova-compute[75337]: DEBUG nova.objects.instance [None req-cf6854d6-176c-4488-9d92-056f4ab2cf40 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Lazy-loading 'migration_context' on Instance uuid 525c87e5-14c3-40fd-8976-8df151ed07fa {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 16:19:14 user nova-compute[75337]: DEBUG nova.objects.base [None req-cf6854d6-176c-4488-9d92-056f4ab2cf40 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Object Instance<525c87e5-14c3-40fd-8976-8df151ed07fa> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75337) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 16:19:14 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-cf6854d6-176c-4488-9d92-056f4ab2cf40 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] [instance: 525c87e5-14c3-40fd-8976-8df151ed07fa] Created local disks {{(pid=75337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 16:19:14 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-cf6854d6-176c-4488-9d92-056f4ab2cf40 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] [instance: 525c87e5-14c3-40fd-8976-8df151ed07fa] Start _get_guest_xml network_info=[{"id": "1dfbe337-9efa-4a6a-9801-e9264673d095", "address": "fa:16:3e:fd:18:f1", "network": {"id": "0da0e0bd-b07e-4ae1-8625-a979ed32bd07", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-528047864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-528047864-network", "vif_mac": "fa:16:3e:fd:18:f1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f71610b3d00f412ea4aeba8068d032fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dfbe337-9e", "ovs_interfaceid": "1dfbe337-9efa-4a6a-9801-e9264673d095", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T15:34:14Z,direct_url=<?>,disk_format='qcow2',id=16b903ae-a40f-41a7-985b-4804cce92c62,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6549a15819f1469bbd5eeae8190e3d44',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T15:34:15Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '16b903ae-a40f-41a7-985b-4804cce92c62', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 16:19:14 user nova-compute[75337]: DEBUG nova.objects.instance [None req-cf6854d6-176c-4488-9d92-056f4ab2cf40 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Lazy-loading 'resources' on Instance uuid 525c87e5-14c3-40fd-8976-8df151ed07fa {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 16:19:14 user nova-compute[75337]: DEBUG nova.objects.base [None req-cf6854d6-176c-4488-9d92-056f4ab2cf40 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Object Instance<525c87e5-14c3-40fd-8976-8df151ed07fa> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75337) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 16:19:14 user nova-compute[75337]: DEBUG nova.objects.instance [None req-cf6854d6-176c-4488-9d92-056f4ab2cf40 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Lazy-loading 'numa_topology' on Instance uuid 525c87e5-14c3-40fd-8976-8df151ed07fa {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 16:19:14 user nova-compute[75337]: DEBUG nova.objects.base [None req-cf6854d6-176c-4488-9d92-056f4ab2cf40 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Object Instance<525c87e5-14c3-40fd-8976-8df151ed07fa> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75337) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 16:19:14 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-cf6854d6-176c-4488-9d92-056f4ab2cf40 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 16:19:14 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-cf6854d6-176c-4488-9d92-056f4ab2cf40 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 16:19:14 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-cf6854d6-176c-4488-9d92-056f4ab2cf40 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 16:19:14 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-cf6854d6-176c-4488-9d92-056f4ab2cf40 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] CPU controller missing on host. {{(pid=75337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 16:19:14 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-cf6854d6-176c-4488-9d92-056f4ab2cf40 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 16:19:14 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-cf6854d6-176c-4488-9d92-056f4ab2cf40 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] CPU controller found on host. {{(pid=75337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 16:19:14 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-cf6854d6-176c-4488-9d92-056f4ab2cf40 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75337) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 16:19:14 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-cf6854d6-176c-4488-9d92-056f4ab2cf40 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T15:34:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T15:34:14Z,direct_url=<?>,disk_format='qcow2',id=16b903ae-a40f-41a7-985b-4804cce92c62,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6549a15819f1469bbd5eeae8190e3d44',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T15:34:15Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 16:19:14 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-cf6854d6-176c-4488-9d92-056f4ab2cf40 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Flavor limits 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 16:19:14 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-cf6854d6-176c-4488-9d92-056f4ab2cf40 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Image limits 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 16:19:14 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-cf6854d6-176c-4488-9d92-056f4ab2cf40 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Flavor pref 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 16:19:14 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-cf6854d6-176c-4488-9d92-056f4ab2cf40 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Image pref 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 16:19:14 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-cf6854d6-176c-4488-9d92-056f4ab2cf40 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 16:19:14 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-cf6854d6-176c-4488-9d92-056f4ab2cf40 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 16:19:14 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-cf6854d6-176c-4488-9d92-056f4ab2cf40 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 16:19:14 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-cf6854d6-176c-4488-9d92-056f4ab2cf40 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Got 1 possible topologies {{(pid=75337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 16:19:14 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-cf6854d6-176c-4488-9d92-056f4ab2cf40 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 16:19:14 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-cf6854d6-176c-4488-9d92-056f4ab2cf40 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 16:19:14 user nova-compute[75337]: DEBUG nova.objects.instance [None req-cf6854d6-176c-4488-9d92-056f4ab2cf40 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Lazy-loading 'vcpu_model' on Instance uuid 525c87e5-14c3-40fd-8976-8df151ed07fa {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 16:19:14 user nova-compute[75337]: DEBUG nova.objects.base [None req-cf6854d6-176c-4488-9d92-056f4ab2cf40 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Object Instance<525c87e5-14c3-40fd-8976-8df151ed07fa> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75337) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 16:19:14 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-cf6854d6-176c-4488-9d92-056f4ab2cf40 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T16:14:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1386418707',display_name='tempest-ServerRescueNegativeTestJSON-server-1386418707',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1386418707',id=49,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-06T16:14:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f71610b3d00f412ea4aeba8068d032fc',ramdisk_id='',reservation_id='r-kcpcz2gd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1763914139',owner_user_name='tempest-ServerRescueNegativeTestJSON-1763914139-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T16:14:33Z,user_data=None,user_id='22979798bd154fd3af622e408520e95c',uuid=525c87e5-14c3-40fd-8976-8df151ed07fa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1dfbe337-9efa-4a6a-9801-e9264673d095", "address": "fa:16:3e:fd:18:f1", "network": {"id": "0da0e0bd-b07e-4ae1-8625-a979ed32bd07", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-528047864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-528047864-network", "vif_mac": "fa:16:3e:fd:18:f1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f71610b3d00f412ea4aeba8068d032fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dfbe337-9e", "ovs_interfaceid": "1dfbe337-9efa-4a6a-9801-e9264673d095", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75337) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 16:19:14 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-cf6854d6-176c-4488-9d92-056f4ab2cf40 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Converting VIF {"id": "1dfbe337-9efa-4a6a-9801-e9264673d095", "address": "fa:16:3e:fd:18:f1", "network": {"id": "0da0e0bd-b07e-4ae1-8625-a979ed32bd07", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-528047864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-528047864-network", "vif_mac": "fa:16:3e:fd:18:f1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f71610b3d00f412ea4aeba8068d032fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dfbe337-9e", "ovs_interfaceid": "1dfbe337-9efa-4a6a-9801-e9264673d095", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 16:19:14 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-cf6854d6-176c-4488-9d92-056f4ab2cf40 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fd:18:f1,bridge_name='br-int',has_traffic_filtering=True,id=1dfbe337-9efa-4a6a-9801-e9264673d095,network=Network(0da0e0bd-b07e-4ae1-8625-a979ed32bd07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1dfbe337-9e') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 16:19:14 user nova-compute[75337]: DEBUG nova.objects.instance [None req-cf6854d6-176c-4488-9d92-056f4ab2cf40 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Lazy-loading 'pci_devices' on Instance uuid 525c87e5-14c3-40fd-8976-8df151ed07fa {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 16:19:14 user nova-compute[75337]: DEBUG nova.objects.base [None req-cf6854d6-176c-4488-9d92-056f4ab2cf40 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Object Instance<525c87e5-14c3-40fd-8976-8df151ed07fa> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75337) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 16:19:14 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-cf6854d6-176c-4488-9d92-056f4ab2cf40 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] [instance: 525c87e5-14c3-40fd-8976-8df151ed07fa] End _get_guest_xml xml=<domain type="kvm">
Nov 06 16:19:14 user nova-compute[75337]:   <uuid>525c87e5-14c3-40fd-8976-8df151ed07fa</uuid>
Nov 06 16:19:14 user nova-compute[75337]:   <name>instance-00000031</name>
Nov 06 16:19:14 user nova-compute[75337]:   <memory>524288</memory>
Nov 06 16:19:14 user nova-compute[75337]:   <vcpu>1</vcpu>
Nov 06 16:19:14 user nova-compute[75337]:   <metadata>
Nov 06 16:19:14 user nova-compute[75337]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 16:19:14 user nova-compute[75337]:       <nova:package version="0.0.0"/>
Nov 06 16:19:14 user nova-compute[75337]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1386418707</nova:name>
Nov 06 16:19:14 user nova-compute[75337]:       <nova:creationTime>2023-11-06 16:19:14</nova:creationTime>
Nov 06 16:19:14 user nova-compute[75337]:       <nova:flavor name="m1.tiny">
Nov 06 16:19:14 user nova-compute[75337]:         <nova:memory>512</nova:memory>
Nov 06 16:19:14 user nova-compute[75337]:         <nova:disk>1</nova:disk>
Nov 06 16:19:14 user nova-compute[75337]:         <nova:swap>0</nova:swap>
Nov 06 16:19:14 user nova-compute[75337]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 16:19:14 user nova-compute[75337]:         <nova:vcpus>1</nova:vcpus>
Nov 06 16:19:14 user nova-compute[75337]:       </nova:flavor>
Nov 06 16:19:14 user nova-compute[75337]:       <nova:owner>
Nov 06 16:19:14 user nova-compute[75337]:         <nova:user uuid="22979798bd154fd3af622e408520e95c">tempest-ServerRescueNegativeTestJSON-1763914139-project-member</nova:user>
Nov 06 16:19:14 user nova-compute[75337]:         <nova:project uuid="f71610b3d00f412ea4aeba8068d032fc">tempest-ServerRescueNegativeTestJSON-1763914139</nova:project>
Nov 06 16:19:14 user nova-compute[75337]:       </nova:owner>
Nov 06 16:19:14 user nova-compute[75337]:       <nova:root type="image" uuid="16b903ae-a40f-41a7-985b-4804cce92c62"/>
Nov 06 16:19:14 user nova-compute[75337]:       <nova:ports>
Nov 06 16:19:14 user nova-compute[75337]:         <nova:port uuid="1dfbe337-9efa-4a6a-9801-e9264673d095">
Nov 06 16:19:14 user nova-compute[75337]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 06 16:19:14 user nova-compute[75337]:         </nova:port>
Nov 06 16:19:14 user nova-compute[75337]:       </nova:ports>
Nov 06 16:19:14 user nova-compute[75337]:     </nova:instance>
Nov 06 16:19:14 user nova-compute[75337]:   </metadata>
Nov 06 16:19:14 user nova-compute[75337]:   <sysinfo type="smbios">
Nov 06 16:19:14 user nova-compute[75337]:     <system>
Nov 06 16:19:14 user nova-compute[75337]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 16:19:14 user nova-compute[75337]:       <entry name="product">OpenStack Nova</entry>
Nov 06 16:19:14 user nova-compute[75337]:       <entry name="version">0.0.0</entry>
Nov 06 16:19:14 user nova-compute[75337]:       <entry name="serial">525c87e5-14c3-40fd-8976-8df151ed07fa</entry>
Nov 06 16:19:14 user nova-compute[75337]:       <entry name="uuid">525c87e5-14c3-40fd-8976-8df151ed07fa</entry>
Nov 06 16:19:14 user nova-compute[75337]:       <entry name="family">Virtual Machine</entry>
Nov 06 16:19:14 user nova-compute[75337]:     </system>
Nov 06 16:19:14 user nova-compute[75337]:   </sysinfo>
Nov 06 16:19:14 user nova-compute[75337]:   <os>
Nov 06 16:19:14 user nova-compute[75337]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 16:19:14 user nova-compute[75337]:     <smbios mode="sysinfo"/>
Nov 06 16:19:14 user nova-compute[75337]:   </os>
Nov 06 16:19:14 user nova-compute[75337]:   <features>
Nov 06 16:19:14 user nova-compute[75337]:     <acpi/>
Nov 06 16:19:14 user nova-compute[75337]:     <apic/>
Nov 06 16:19:14 user nova-compute[75337]:     <vmcoreinfo/>
Nov 06 16:19:14 user nova-compute[75337]:   </features>
Nov 06 16:19:14 user nova-compute[75337]:   <clock offset="utc">
Nov 06 16:19:14 user nova-compute[75337]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 16:19:14 user nova-compute[75337]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 16:19:14 user nova-compute[75337]:     <timer name="hpet" present="no"/>
Nov 06 16:19:14 user nova-compute[75337]:   </clock>
Nov 06 16:19:14 user nova-compute[75337]:   <cpu mode="custom" match="exact">
Nov 06 16:19:14 user nova-compute[75337]:     <model>Nehalem</model>
Nov 06 16:19:14 user nova-compute[75337]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 16:19:14 user nova-compute[75337]:   </cpu>
Nov 06 16:19:14 user nova-compute[75337]:   <devices>
Nov 06 16:19:14 user nova-compute[75337]:     <disk type="file" device="disk">
Nov 06 16:19:14 user nova-compute[75337]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 16:19:14 user nova-compute[75337]:       <source file="/opt/stack/data/nova/instances/525c87e5-14c3-40fd-8976-8df151ed07fa/disk.rescue"/>
Nov 06 16:19:14 user nova-compute[75337]:       <target dev="vda" bus="virtio"/>
Nov 06 16:19:14 user nova-compute[75337]:     </disk>
Nov 06 16:19:14 user nova-compute[75337]:     <disk type="file" device="disk">
Nov 06 16:19:14 user nova-compute[75337]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 16:19:14 user nova-compute[75337]:       <source file="/opt/stack/data/nova/instances/525c87e5-14c3-40fd-8976-8df151ed07fa/disk"/>
Nov 06 16:19:14 user nova-compute[75337]:       <target dev="vdb" bus="virtio"/>
Nov 06 16:19:14 user nova-compute[75337]:     </disk>
Nov 06 16:19:14 user nova-compute[75337]:     <interface type="ethernet">
Nov 06 16:19:14 user nova-compute[75337]:       <mac address="fa:16:3e:fd:18:f1"/>
Nov 06 16:19:14 user nova-compute[75337]:       <model type="virtio"/>
Nov 06 16:19:14 user nova-compute[75337]:       <mtu size="1442"/>
Nov 06 16:19:14 user nova-compute[75337]:       <target dev="tap1dfbe337-9e"/>
Nov 06 16:19:14 user nova-compute[75337]:     </interface>
Nov 06 16:19:14 user nova-compute[75337]:     <serial type="pty">
Nov 06 16:19:14 user nova-compute[75337]:       <log file="/opt/stack/data/nova/instances/525c87e5-14c3-40fd-8976-8df151ed07fa/console.log" append="off"/>
Nov 06 16:19:14 user nova-compute[75337]:     </serial>
Nov 06 16:19:14 user nova-compute[75337]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 16:19:14 user nova-compute[75337]:     <video>
Nov 06 16:19:14 user nova-compute[75337]:       <model type="virtio"/>
Nov 06 16:19:14 user nova-compute[75337]:     </video>
Nov 06 16:19:14 user nova-compute[75337]:     <rng model="virtio">
Nov 06 16:19:14 user nova-compute[75337]:       <backend model="random">/dev/urandom</backend>
Nov 06 16:19:14 user nova-compute[75337]:     </rng>
Nov 06 16:19:14 user nova-compute[75337]:     <controller type="usb" index="0" model="none"/>
Nov 06 16:19:14 user nova-compute[75337]:     <memballoon model="virtio">
Nov 06 16:19:14 user nova-compute[75337]:       <stats period="10"/>
Nov 06 16:19:14 user nova-compute[75337]:     </memballoon>
Nov 06 16:19:14 user nova-compute[75337]:   </devices>
Nov 06 16:19:14 user nova-compute[75337]: </domain>
Nov 06 16:19:14 user nova-compute[75337]:  {{(pid=75337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 16:19:14 user nova-compute[75337]: INFO nova.virt.libvirt.driver [-] [instance: 525c87e5-14c3-40fd-8976-8df151ed07fa] Instance destroyed successfully.
Nov 06 16:19:14 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-cf6854d6-176c-4488-9d92-056f4ab2cf40 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] No BDM found with device name vda, not building metadata. {{(pid=75337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 16:19:14 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-cf6854d6-176c-4488-9d92-056f4ab2cf40 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 16:19:14 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-cf6854d6-176c-4488-9d92-056f4ab2cf40 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] No VIF found with MAC fa:16:3e:fd:18:f1, not building metadata {{(pid=75337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 16:19:15 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:19:15 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:19:15 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:19:15 user nova-compute[75337]: DEBUG nova.compute.manager [req-3fe85bfe-7f52-42d7-9d09-d49a1586e382 req-8f5df446-593a-4f94-b993-66207c510c7b service nova] [instance: 525c87e5-14c3-40fd-8976-8df151ed07fa] Received event network-vif-plugged-1dfbe337-9efa-4a6a-9801-e9264673d095 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:19:15 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-3fe85bfe-7f52-42d7-9d09-d49a1586e382 req-8f5df446-593a-4f94-b993-66207c510c7b service nova] Acquiring lock "525c87e5-14c3-40fd-8976-8df151ed07fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:19:15 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-3fe85bfe-7f52-42d7-9d09-d49a1586e382 req-8f5df446-593a-4f94-b993-66207c510c7b service nova] Lock "525c87e5-14c3-40fd-8976-8df151ed07fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:19:15 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-3fe85bfe-7f52-42d7-9d09-d49a1586e382 req-8f5df446-593a-4f94-b993-66207c510c7b service nova] Lock "525c87e5-14c3-40fd-8976-8df151ed07fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:19:15 user nova-compute[75337]: DEBUG nova.compute.manager [req-3fe85bfe-7f52-42d7-9d09-d49a1586e382 req-8f5df446-593a-4f94-b993-66207c510c7b service nova] [instance: 525c87e5-14c3-40fd-8976-8df151ed07fa] No waiting events found dispatching network-vif-plugged-1dfbe337-9efa-4a6a-9801-e9264673d095 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 16:19:15 user nova-compute[75337]: WARNING nova.compute.manager [req-3fe85bfe-7f52-42d7-9d09-d49a1586e382 req-8f5df446-593a-4f94-b993-66207c510c7b service nova] [instance: 525c87e5-14c3-40fd-8976-8df151ed07fa] Received unexpected event network-vif-plugged-1dfbe337-9efa-4a6a-9801-e9264673d095 for instance with vm_state active and task_state rescuing.
Nov 06 16:19:15 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:19:15 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:19:17 user nova-compute[75337]: DEBUG nova.compute.manager [None req-cf6854d6-176c-4488-9d92-056f4ab2cf40 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] [instance: 525c87e5-14c3-40fd-8976-8df151ed07fa] Checking state {{(pid=75337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 16:19:17 user nova-compute[75337]: DEBUG nova.compute.manager [req-edc70c87-91c0-42df-88a1-75b06b73a5dc req-5b77b6ba-a15c-4457-9f8d-3628dfee1f83 service nova] [instance: 525c87e5-14c3-40fd-8976-8df151ed07fa] Received event network-vif-plugged-1dfbe337-9efa-4a6a-9801-e9264673d095 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:19:17 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-edc70c87-91c0-42df-88a1-75b06b73a5dc req-5b77b6ba-a15c-4457-9f8d-3628dfee1f83 service nova] Acquiring lock "525c87e5-14c3-40fd-8976-8df151ed07fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:19:17 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-edc70c87-91c0-42df-88a1-75b06b73a5dc req-5b77b6ba-a15c-4457-9f8d-3628dfee1f83 service nova] Lock "525c87e5-14c3-40fd-8976-8df151ed07fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:19:17 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-edc70c87-91c0-42df-88a1-75b06b73a5dc req-5b77b6ba-a15c-4457-9f8d-3628dfee1f83 service nova] Lock "525c87e5-14c3-40fd-8976-8df151ed07fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:19:17 user nova-compute[75337]: DEBUG nova.compute.manager [req-edc70c87-91c0-42df-88a1-75b06b73a5dc req-5b77b6ba-a15c-4457-9f8d-3628dfee1f83 service nova] [instance: 525c87e5-14c3-40fd-8976-8df151ed07fa] No waiting events found dispatching network-vif-plugged-1dfbe337-9efa-4a6a-9801-e9264673d095 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 16:19:17 user nova-compute[75337]: WARNING nova.compute.manager [req-edc70c87-91c0-42df-88a1-75b06b73a5dc req-5b77b6ba-a15c-4457-9f8d-3628dfee1f83 service nova] [instance: 525c87e5-14c3-40fd-8976-8df151ed07fa] Received unexpected event network-vif-plugged-1dfbe337-9efa-4a6a-9801-e9264673d095 for instance with vm_state active and task_state rescuing.
Nov 06 16:19:17 user nova-compute[75337]: DEBUG nova.compute.manager [req-edc70c87-91c0-42df-88a1-75b06b73a5dc req-5b77b6ba-a15c-4457-9f8d-3628dfee1f83 service nova] [instance: 525c87e5-14c3-40fd-8976-8df151ed07fa] Received event network-vif-plugged-1dfbe337-9efa-4a6a-9801-e9264673d095 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:19:17 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-edc70c87-91c0-42df-88a1-75b06b73a5dc req-5b77b6ba-a15c-4457-9f8d-3628dfee1f83 service nova] Acquiring lock "525c87e5-14c3-40fd-8976-8df151ed07fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:19:17 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-edc70c87-91c0-42df-88a1-75b06b73a5dc req-5b77b6ba-a15c-4457-9f8d-3628dfee1f83 service nova] Lock "525c87e5-14c3-40fd-8976-8df151ed07fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:19:17 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-edc70c87-91c0-42df-88a1-75b06b73a5dc req-5b77b6ba-a15c-4457-9f8d-3628dfee1f83 service nova] Lock "525c87e5-14c3-40fd-8976-8df151ed07fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:19:17 user nova-compute[75337]: DEBUG nova.compute.manager [req-edc70c87-91c0-42df-88a1-75b06b73a5dc req-5b77b6ba-a15c-4457-9f8d-3628dfee1f83 service nova] [instance: 525c87e5-14c3-40fd-8976-8df151ed07fa] No waiting events found dispatching network-vif-plugged-1dfbe337-9efa-4a6a-9801-e9264673d095 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 16:19:17 user nova-compute[75337]: WARNING nova.compute.manager [req-edc70c87-91c0-42df-88a1-75b06b73a5dc req-5b77b6ba-a15c-4457-9f8d-3628dfee1f83 service nova] [instance: 525c87e5-14c3-40fd-8976-8df151ed07fa] Received unexpected event network-vif-plugged-1dfbe337-9efa-4a6a-9801-e9264673d095 for instance with vm_state active and task_state rescuing.
Nov 06 16:19:18 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:19:20 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:19:22 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:19:23 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:19:24 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:19:26 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:19:26 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75337) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 16:19:28 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:19:31 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:19:31 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:19:32 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:19:33 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:19:34 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:19:35 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:19:38 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:19:40 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:19:40 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:19:40 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Starting heal instance info cache {{(pid=75337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 16:19:40 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "refresh_cache-de77f786-1ecf-4eac-ae4a-c4f6b1d47339" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 16:19:40 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquired lock "refresh_cache-de77f786-1ecf-4eac-ae4a-c4f6b1d47339" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 16:19:40 user nova-compute[75337]: DEBUG nova.network.neutron [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] [instance: de77f786-1ecf-4eac-ae4a-c4f6b1d47339] Forcefully refreshing network info cache for instance {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 16:19:41 user nova-compute[75337]: DEBUG nova.network.neutron [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] [instance: de77f786-1ecf-4eac-ae4a-c4f6b1d47339] Updating instance_info_cache with network_info: [{"id": "8f33a5c0-50e1-4bac-a686-733daf33a307", "address": "fa:16:3e:4b:fc:cf", "network": {"id": "0da0e0bd-b07e-4ae1-8625-a979ed32bd07", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-528047864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f71610b3d00f412ea4aeba8068d032fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f33a5c0-50", "ovs_interfaceid": "8f33a5c0-50e1-4bac-a686-733daf33a307", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 16:19:41 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Releasing lock "refresh_cache-de77f786-1ecf-4eac-ae4a-c4f6b1d47339" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 16:19:41 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] [instance: de77f786-1ecf-4eac-ae4a-c4f6b1d47339] Updated the network info_cache for instance {{(pid=75337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 16:19:42 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:19:42 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Cleaning up deleted instances with incomplete migration  {{(pid=75337) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 06 16:19:43 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager.update_available_resource {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:19:43 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:19:43 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:19:43 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:19:43 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Auditing locally available compute resources for user (node: user) {{(pid=75337) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 16:19:43 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525c87e5-14c3-40fd-8976-8df151ed07fa/disk.rescue --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:19:43 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:19:43 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525c87e5-14c3-40fd-8976-8df151ed07fa/disk.rescue --force-share --output=json" returned: 0 in 0.202s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:19:43 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525c87e5-14c3-40fd-8976-8df151ed07fa/disk.rescue --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:19:44 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525c87e5-14c3-40fd-8976-8df151ed07fa/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:19:44 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525c87e5-14c3-40fd-8976-8df151ed07fa/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:19:44 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525c87e5-14c3-40fd-8976-8df151ed07fa/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:19:44 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525c87e5-14c3-40fd-8976-8df151ed07fa/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:19:44 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525c87e5-14c3-40fd-8976-8df151ed07fa/disk --force-share --output=json" returned: 0 in 0.270s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:19:44 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de77f786-1ecf-4eac-ae4a-c4f6b1d47339/disk.rescue --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:19:44 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de77f786-1ecf-4eac-ae4a-c4f6b1d47339/disk.rescue --force-share --output=json" returned: 0 in 0.215s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:19:44 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de77f786-1ecf-4eac-ae4a-c4f6b1d47339/disk.rescue --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:19:45 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de77f786-1ecf-4eac-ae4a-c4f6b1d47339/disk.rescue --force-share --output=json" returned: 0 in 0.273s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:19:45 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de77f786-1ecf-4eac-ae4a-c4f6b1d47339/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:19:45 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:19:45 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de77f786-1ecf-4eac-ae4a-c4f6b1d47339/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:19:45 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de77f786-1ecf-4eac-ae4a-c4f6b1d47339/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:19:45 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de77f786-1ecf-4eac-ae4a-c4f6b1d47339/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:19:45 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 16:19:45 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 16:19:45 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Hypervisor/Node resource view: name=user free_ram=8839MB free_disk=24.987468719482422GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75337) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 16:19:45 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:19:45 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:19:46 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 525c87e5-14c3-40fd-8976-8df151ed07fa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 16:19:46 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance de77f786-1ecf-4eac-ae4a-c4f6b1d47339 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 16:19:46 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 16:19:46 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 16:19:46 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Refreshing inventories for resource provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 06 16:19:46 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Updating ProviderTree inventory for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 06 16:19:46 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Updating inventory in ProviderTree for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 06 16:19:46 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Refreshing aggregate associations for resource provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7, aggregates: None {{(pid=75337) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 06 16:19:46 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Refreshing trait associations for resource provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7, traits: COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NODE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_IDE,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSSE3,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_USB {{(pid=75337) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 06 16:19:46 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 16:19:46 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 16:19:46 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Compute_service record updated for user:user {{(pid=75337) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 16:19:46 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.524s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:19:48 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:19:49 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:19:49 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Cleaning up deleted instances {{(pid=75337) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 06 16:19:49 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] There are 0 instances to clean {{(pid=75337) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 06 16:19:50 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:19:53 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:19:58 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:20:03 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:20:04 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:20:08 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:20:13 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:20:18 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:20:21 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:20:23 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:20:26 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:20:28 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:20:28 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75337) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 16:20:28 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:20:32 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:20:32 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:20:32 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:20:33 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:20:35 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:20:38 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:20:41 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:20:41 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:20:41 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Starting heal instance info cache {{(pid=75337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 16:20:41 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Rebuilding the list of instances to heal {{(pid=75337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 06 16:20:41 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "refresh_cache-525c87e5-14c3-40fd-8976-8df151ed07fa" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 16:20:41 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquired lock "refresh_cache-525c87e5-14c3-40fd-8976-8df151ed07fa" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 16:20:41 user nova-compute[75337]: DEBUG nova.network.neutron [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] [instance: 525c87e5-14c3-40fd-8976-8df151ed07fa] Forcefully refreshing network info cache for instance {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 16:20:41 user nova-compute[75337]: DEBUG nova.objects.instance [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lazy-loading 'info_cache' on Instance uuid 525c87e5-14c3-40fd-8976-8df151ed07fa {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 16:20:42 user nova-compute[75337]: DEBUG nova.network.neutron [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] [instance: 525c87e5-14c3-40fd-8976-8df151ed07fa] Updating instance_info_cache with network_info: [{"id": "1dfbe337-9efa-4a6a-9801-e9264673d095", "address": "fa:16:3e:fd:18:f1", "network": {"id": "0da0e0bd-b07e-4ae1-8625-a979ed32bd07", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-528047864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f71610b3d00f412ea4aeba8068d032fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dfbe337-9e", "ovs_interfaceid": "1dfbe337-9efa-4a6a-9801-e9264673d095", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 16:20:42 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Releasing lock "refresh_cache-525c87e5-14c3-40fd-8976-8df151ed07fa" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 16:20:42 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] [instance: 525c87e5-14c3-40fd-8976-8df151ed07fa] Updated the network info_cache for instance {{(pid=75337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 16:20:43 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:20:44 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager.update_available_resource {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:20:44 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:20:44 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:20:44 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:20:44 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Auditing locally available compute resources for user (node: user) {{(pid=75337) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 16:20:44 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525c87e5-14c3-40fd-8976-8df151ed07fa/disk.rescue --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:20:44 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525c87e5-14c3-40fd-8976-8df151ed07fa/disk.rescue --force-share --output=json" returned: 0 in 0.207s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:20:44 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525c87e5-14c3-40fd-8976-8df151ed07fa/disk.rescue --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:20:45 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525c87e5-14c3-40fd-8976-8df151ed07fa/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:20:45 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525c87e5-14c3-40fd-8976-8df151ed07fa/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:20:45 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525c87e5-14c3-40fd-8976-8df151ed07fa/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:20:45 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525c87e5-14c3-40fd-8976-8df151ed07fa/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:20:45 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525c87e5-14c3-40fd-8976-8df151ed07fa/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:20:45 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de77f786-1ecf-4eac-ae4a-c4f6b1d47339/disk.rescue --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:20:45 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de77f786-1ecf-4eac-ae4a-c4f6b1d47339/disk.rescue --force-share --output=json" returned: 0 in 0.199s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:20:45 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de77f786-1ecf-4eac-ae4a-c4f6b1d47339/disk.rescue --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:20:45 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de77f786-1ecf-4eac-ae4a-c4f6b1d47339/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:20:45 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de77f786-1ecf-4eac-ae4a-c4f6b1d47339/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:20:46 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de77f786-1ecf-4eac-ae4a-c4f6b1d47339/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:20:46 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de77f786-1ecf-4eac-ae4a-c4f6b1d47339/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:20:46 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de77f786-1ecf-4eac-ae4a-c4f6b1d47339/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:20:46 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 16:20:46 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 16:20:46 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Hypervisor/Node resource view: name=user free_ram=8888MB free_disk=24.98682403564453GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75337) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 16:20:46 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:20:46 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:20:46 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 525c87e5-14c3-40fd-8976-8df151ed07fa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 16:20:46 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance de77f786-1ecf-4eac-ae4a-c4f6b1d47339 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 16:20:46 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 16:20:46 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 16:20:46 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 16:20:46 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 16:20:46 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Compute_service record updated for user:user {{(pid=75337) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 16:20:46 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.210s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:20:48 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:20:53 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:20:58 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:21:03 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:21:03 user nova-compute[75337]: INFO nova.compute.manager [None req-47b53546-9bf2-4ebf-be94-db5e94a8815b tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] [instance: 525c87e5-14c3-40fd-8976-8df151ed07fa] Unrescuing
Nov 06 16:21:03 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-47b53546-9bf2-4ebf-be94-db5e94a8815b tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Acquiring lock "refresh_cache-525c87e5-14c3-40fd-8976-8df151ed07fa" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 16:21:03 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-47b53546-9bf2-4ebf-be94-db5e94a8815b tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Acquired lock "refresh_cache-525c87e5-14c3-40fd-8976-8df151ed07fa" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 16:21:03 user nova-compute[75337]: DEBUG nova.network.neutron [None req-47b53546-9bf2-4ebf-be94-db5e94a8815b tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] [instance: 525c87e5-14c3-40fd-8976-8df151ed07fa] Building network info cache for instance {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 16:21:04 user nova-compute[75337]: DEBUG nova.network.neutron [None req-47b53546-9bf2-4ebf-be94-db5e94a8815b tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] [instance: 525c87e5-14c3-40fd-8976-8df151ed07fa] Updating instance_info_cache with network_info: [{"id": "1dfbe337-9efa-4a6a-9801-e9264673d095", "address": "fa:16:3e:fd:18:f1", "network": {"id": "0da0e0bd-b07e-4ae1-8625-a979ed32bd07", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-528047864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f71610b3d00f412ea4aeba8068d032fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dfbe337-9e", "ovs_interfaceid": "1dfbe337-9efa-4a6a-9801-e9264673d095", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 16:21:04 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-47b53546-9bf2-4ebf-be94-db5e94a8815b tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Releasing lock "refresh_cache-525c87e5-14c3-40fd-8976-8df151ed07fa" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 16:21:04 user nova-compute[75337]: DEBUG nova.objects.instance [None req-47b53546-9bf2-4ebf-be94-db5e94a8815b tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Lazy-loading 'flavor' on Instance uuid 525c87e5-14c3-40fd-8976-8df151ed07fa {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 16:21:04 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:21:04 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:21:04 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:21:04 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:21:04 user nova-compute[75337]: DEBUG nova.compute.manager [req-7fb73520-5756-4b74-8724-f90a2b10909e req-a9827c16-fa57-44e4-b6c0-d99edf200449 service nova] [instance: 525c87e5-14c3-40fd-8976-8df151ed07fa] Received event network-vif-unplugged-1dfbe337-9efa-4a6a-9801-e9264673d095 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:21:04 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-7fb73520-5756-4b74-8724-f90a2b10909e req-a9827c16-fa57-44e4-b6c0-d99edf200449 service nova] Acquiring lock "525c87e5-14c3-40fd-8976-8df151ed07fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:21:04 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-7fb73520-5756-4b74-8724-f90a2b10909e req-a9827c16-fa57-44e4-b6c0-d99edf200449 service nova] Lock "525c87e5-14c3-40fd-8976-8df151ed07fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:21:04 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-7fb73520-5756-4b74-8724-f90a2b10909e req-a9827c16-fa57-44e4-b6c0-d99edf200449 service nova] Lock "525c87e5-14c3-40fd-8976-8df151ed07fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:21:04 user nova-compute[75337]: DEBUG nova.compute.manager [req-7fb73520-5756-4b74-8724-f90a2b10909e req-a9827c16-fa57-44e4-b6c0-d99edf200449 service nova] [instance: 525c87e5-14c3-40fd-8976-8df151ed07fa] No waiting events found dispatching network-vif-unplugged-1dfbe337-9efa-4a6a-9801-e9264673d095 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 16:21:04 user nova-compute[75337]: WARNING nova.compute.manager [req-7fb73520-5756-4b74-8724-f90a2b10909e req-a9827c16-fa57-44e4-b6c0-d99edf200449 service nova] [instance: 525c87e5-14c3-40fd-8976-8df151ed07fa] Received unexpected event network-vif-unplugged-1dfbe337-9efa-4a6a-9801-e9264673d095 for instance with vm_state rescued and task_state unrescuing.
Nov 06 16:21:04 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:21:05 user nova-compute[75337]: INFO nova.virt.libvirt.driver [-] [instance: 525c87e5-14c3-40fd-8976-8df151ed07fa] Instance destroyed successfully.
Nov 06 16:21:06 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:21:06 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:21:06 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:21:06 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:21:06 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:21:06 user nova-compute[75337]: DEBUG nova.compute.manager [req-350e9277-32e1-4626-85d7-e19429f07650 req-f54c687d-fb95-4218-b28c-84728638047a service nova] [instance: 525c87e5-14c3-40fd-8976-8df151ed07fa] Received event network-vif-plugged-1dfbe337-9efa-4a6a-9801-e9264673d095 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:21:06 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-350e9277-32e1-4626-85d7-e19429f07650 req-f54c687d-fb95-4218-b28c-84728638047a service nova] Acquiring lock "525c87e5-14c3-40fd-8976-8df151ed07fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:21:06 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-350e9277-32e1-4626-85d7-e19429f07650 req-f54c687d-fb95-4218-b28c-84728638047a service nova] Lock "525c87e5-14c3-40fd-8976-8df151ed07fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:21:06 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-350e9277-32e1-4626-85d7-e19429f07650 req-f54c687d-fb95-4218-b28c-84728638047a service nova] Lock "525c87e5-14c3-40fd-8976-8df151ed07fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:21:06 user nova-compute[75337]: DEBUG nova.compute.manager [req-350e9277-32e1-4626-85d7-e19429f07650 req-f54c687d-fb95-4218-b28c-84728638047a service nova] [instance: 525c87e5-14c3-40fd-8976-8df151ed07fa] No waiting events found dispatching network-vif-plugged-1dfbe337-9efa-4a6a-9801-e9264673d095 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 16:21:06 user nova-compute[75337]: WARNING nova.compute.manager [req-350e9277-32e1-4626-85d7-e19429f07650 req-f54c687d-fb95-4218-b28c-84728638047a service nova] [instance: 525c87e5-14c3-40fd-8976-8df151ed07fa] Received unexpected event network-vif-plugged-1dfbe337-9efa-4a6a-9801-e9264673d095 for instance with vm_state rescued and task_state unrescuing.
Nov 06 16:21:08 user nova-compute[75337]: DEBUG nova.compute.manager [None req-47b53546-9bf2-4ebf-be94-db5e94a8815b tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] [instance: 525c87e5-14c3-40fd-8976-8df151ed07fa] Checking state {{(pid=75337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 16:21:08 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:21:09 user nova-compute[75337]: DEBUG nova.compute.manager [req-37b57e05-0205-413e-843e-bcd4458d976a req-27409e56-f179-41bf-a18f-8e6227e23f54 service nova] [instance: 525c87e5-14c3-40fd-8976-8df151ed07fa] Received event network-vif-plugged-1dfbe337-9efa-4a6a-9801-e9264673d095 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:21:09 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-37b57e05-0205-413e-843e-bcd4458d976a req-27409e56-f179-41bf-a18f-8e6227e23f54 service nova] Acquiring lock "525c87e5-14c3-40fd-8976-8df151ed07fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:21:09 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-37b57e05-0205-413e-843e-bcd4458d976a req-27409e56-f179-41bf-a18f-8e6227e23f54 service nova] Lock "525c87e5-14c3-40fd-8976-8df151ed07fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:21:09 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-37b57e05-0205-413e-843e-bcd4458d976a req-27409e56-f179-41bf-a18f-8e6227e23f54 service nova] Lock "525c87e5-14c3-40fd-8976-8df151ed07fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:21:09 user nova-compute[75337]: DEBUG nova.compute.manager [req-37b57e05-0205-413e-843e-bcd4458d976a req-27409e56-f179-41bf-a18f-8e6227e23f54 service nova] [instance: 525c87e5-14c3-40fd-8976-8df151ed07fa] No waiting events found dispatching network-vif-plugged-1dfbe337-9efa-4a6a-9801-e9264673d095 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 16:21:09 user nova-compute[75337]: WARNING nova.compute.manager [req-37b57e05-0205-413e-843e-bcd4458d976a req-27409e56-f179-41bf-a18f-8e6227e23f54 service nova] [instance: 525c87e5-14c3-40fd-8976-8df151ed07fa] Received unexpected event network-vif-plugged-1dfbe337-9efa-4a6a-9801-e9264673d095 for instance with vm_state active and task_state None.
Nov 06 16:21:09 user nova-compute[75337]: DEBUG nova.compute.manager [req-37b57e05-0205-413e-843e-bcd4458d976a req-27409e56-f179-41bf-a18f-8e6227e23f54 service nova] [instance: 525c87e5-14c3-40fd-8976-8df151ed07fa] Received event network-vif-plugged-1dfbe337-9efa-4a6a-9801-e9264673d095 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:21:09 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-37b57e05-0205-413e-843e-bcd4458d976a req-27409e56-f179-41bf-a18f-8e6227e23f54 service nova] Acquiring lock "525c87e5-14c3-40fd-8976-8df151ed07fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:21:09 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-37b57e05-0205-413e-843e-bcd4458d976a req-27409e56-f179-41bf-a18f-8e6227e23f54 service nova] Lock "525c87e5-14c3-40fd-8976-8df151ed07fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:21:09 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-37b57e05-0205-413e-843e-bcd4458d976a req-27409e56-f179-41bf-a18f-8e6227e23f54 service nova] Lock "525c87e5-14c3-40fd-8976-8df151ed07fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:21:09 user nova-compute[75337]: DEBUG nova.compute.manager [req-37b57e05-0205-413e-843e-bcd4458d976a req-27409e56-f179-41bf-a18f-8e6227e23f54 service nova] [instance: 525c87e5-14c3-40fd-8976-8df151ed07fa] No waiting events found dispatching network-vif-plugged-1dfbe337-9efa-4a6a-9801-e9264673d095 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 16:21:09 user nova-compute[75337]: WARNING nova.compute.manager [req-37b57e05-0205-413e-843e-bcd4458d976a req-27409e56-f179-41bf-a18f-8e6227e23f54 service nova] [instance: 525c87e5-14c3-40fd-8976-8df151ed07fa] Received unexpected event network-vif-plugged-1dfbe337-9efa-4a6a-9801-e9264673d095 for instance with vm_state active and task_state None.
Nov 06 16:21:10 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:21:13 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:21:18 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:21:23 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:21:24 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:21:25 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:21:27 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:21:28 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:21:28 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75337) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 16:21:28 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:21:30 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:21:32 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:21:33 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:21:33 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:21:34 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:21:35 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:21:35 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:21:38 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:21:40 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:21:42 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:21:42 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Starting heal instance info cache {{(pid=75337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 16:21:42 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "refresh_cache-de77f786-1ecf-4eac-ae4a-c4f6b1d47339" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 16:21:42 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquired lock "refresh_cache-de77f786-1ecf-4eac-ae4a-c4f6b1d47339" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 16:21:42 user nova-compute[75337]: DEBUG nova.network.neutron [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] [instance: de77f786-1ecf-4eac-ae4a-c4f6b1d47339] Forcefully refreshing network info cache for instance {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 16:21:43 user nova-compute[75337]: DEBUG nova.network.neutron [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] [instance: de77f786-1ecf-4eac-ae4a-c4f6b1d47339] Updating instance_info_cache with network_info: [{"id": "8f33a5c0-50e1-4bac-a686-733daf33a307", "address": "fa:16:3e:4b:fc:cf", "network": {"id": "0da0e0bd-b07e-4ae1-8625-a979ed32bd07", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-528047864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f71610b3d00f412ea4aeba8068d032fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f33a5c0-50", "ovs_interfaceid": "8f33a5c0-50e1-4bac-a686-733daf33a307", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 16:21:43 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Releasing lock "refresh_cache-de77f786-1ecf-4eac-ae4a-c4f6b1d47339" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 16:21:43 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] [instance: de77f786-1ecf-4eac-ae4a-c4f6b1d47339] Updated the network info_cache for instance {{(pid=75337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 16:21:43 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:21:46 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager.update_available_resource {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:21:46 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:21:46 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:21:46 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:21:46 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Auditing locally available compute resources for user (node: user) {{(pid=75337) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 16:21:46 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525c87e5-14c3-40fd-8976-8df151ed07fa/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:21:46 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525c87e5-14c3-40fd-8976-8df151ed07fa/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:21:46 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525c87e5-14c3-40fd-8976-8df151ed07fa/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:21:47 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525c87e5-14c3-40fd-8976-8df151ed07fa/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:21:47 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de77f786-1ecf-4eac-ae4a-c4f6b1d47339/disk.rescue --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:21:47 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de77f786-1ecf-4eac-ae4a-c4f6b1d47339/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:21:47 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de77f786-1ecf-4eac-ae4a-c4f6b1d47339/disk.rescue --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:21:47 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de77f786-1ecf-4eac-ae4a-c4f6b1d47339/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:21:47 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de77f786-1ecf-4eac-ae4a-c4f6b1d47339/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:21:47 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de77f786-1ecf-4eac-ae4a-c4f6b1d47339/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:21:47 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de77f786-1ecf-4eac-ae4a-c4f6b1d47339/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:21:47 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de77f786-1ecf-4eac-ae4a-c4f6b1d47339/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:21:48 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 16:21:48 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 16:21:48 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Hypervisor/Node resource view: name=user free_ram=8862MB free_disk=24.985706329345703GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75337) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 16:21:48 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:21:48 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:21:48 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 525c87e5-14c3-40fd-8976-8df151ed07fa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 16:21:48 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance de77f786-1ecf-4eac-ae4a-c4f6b1d47339 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 16:21:48 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 16:21:48 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 16:21:48 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 16:21:48 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 16:21:48 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Compute_service record updated for user:user {{(pid=75337) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 16:21:48 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.250s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:21:48 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:21:53 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:21:58 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:22:03 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:22:08 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:22:13 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:22:18 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:22:23 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:22:24 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:22:28 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:22:28 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:22:28 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:22:28 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75337) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 16:22:28 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 16:22:28 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 16:22:28 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:22:30 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:22:30 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75337) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 16:22:32 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:22:33 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:22:35 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:22:35 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:22:37 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:22:38 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:22:43 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:22:43 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Starting heal instance info cache {{(pid=75337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 16:22:43 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Rebuilding the list of instances to heal {{(pid=75337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 06 16:22:43 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "refresh_cache-525c87e5-14c3-40fd-8976-8df151ed07fa" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 16:22:43 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquired lock "refresh_cache-525c87e5-14c3-40fd-8976-8df151ed07fa" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 16:22:43 user nova-compute[75337]: DEBUG nova.network.neutron [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] [instance: 525c87e5-14c3-40fd-8976-8df151ed07fa] Forcefully refreshing network info cache for instance {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 16:22:43 user nova-compute[75337]: DEBUG nova.objects.instance [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lazy-loading 'info_cache' on Instance uuid 525c87e5-14c3-40fd-8976-8df151ed07fa {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 16:22:43 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:22:44 user nova-compute[75337]: DEBUG nova.network.neutron [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] [instance: 525c87e5-14c3-40fd-8976-8df151ed07fa] Updating instance_info_cache with network_info: [{"id": "1dfbe337-9efa-4a6a-9801-e9264673d095", "address": "fa:16:3e:fd:18:f1", "network": {"id": "0da0e0bd-b07e-4ae1-8625-a979ed32bd07", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-528047864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f71610b3d00f412ea4aeba8068d032fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dfbe337-9e", "ovs_interfaceid": "1dfbe337-9efa-4a6a-9801-e9264673d095", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 16:22:44 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Releasing lock "refresh_cache-525c87e5-14c3-40fd-8976-8df151ed07fa" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 16:22:44 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] [instance: 525c87e5-14c3-40fd-8976-8df151ed07fa] Updated the network info_cache for instance {{(pid=75337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 16:22:47 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:22:47 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager.update_available_resource {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:22:47 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:22:47 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:22:47 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:22:47 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Auditing locally available compute resources for user (node: user) {{(pid=75337) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 16:22:47 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525c87e5-14c3-40fd-8976-8df151ed07fa/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:22:47 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525c87e5-14c3-40fd-8976-8df151ed07fa/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:22:47 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525c87e5-14c3-40fd-8976-8df151ed07fa/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:22:48 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525c87e5-14c3-40fd-8976-8df151ed07fa/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:22:48 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de77f786-1ecf-4eac-ae4a-c4f6b1d47339/disk.rescue --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:22:48 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de77f786-1ecf-4eac-ae4a-c4f6b1d47339/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:22:48 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de77f786-1ecf-4eac-ae4a-c4f6b1d47339/disk.rescue --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:22:48 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de77f786-1ecf-4eac-ae4a-c4f6b1d47339/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:22:48 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de77f786-1ecf-4eac-ae4a-c4f6b1d47339/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:22:48 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de77f786-1ecf-4eac-ae4a-c4f6b1d47339/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:22:48 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de77f786-1ecf-4eac-ae4a-c4f6b1d47339/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:22:48 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de77f786-1ecf-4eac-ae4a-c4f6b1d47339/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:22:49 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:22:49 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 16:22:49 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 16:22:49 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Hypervisor/Node resource view: name=user free_ram=8904MB free_disk=24.985149383544922GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75337) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 16:22:49 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:22:49 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:22:49 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 525c87e5-14c3-40fd-8976-8df151ed07fa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 16:22:49 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance de77f786-1ecf-4eac-ae4a-c4f6b1d47339 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 16:22:49 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 16:22:49 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 16:22:49 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 16:22:49 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 16:22:49 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Compute_service record updated for user:user {{(pid=75337) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 16:22:49 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.199s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:22:54 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:22:59 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:23:00 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:23:02 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-56fcdf48-0a83-4ec9-b194-7e1b52c3fb4c tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Acquiring lock "7fc86edc-e217-4c70-88f8-02f4618d7ae0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:23:02 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-56fcdf48-0a83-4ec9-b194-7e1b52c3fb4c tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Lock "7fc86edc-e217-4c70-88f8-02f4618d7ae0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:23:02 user nova-compute[75337]: DEBUG nova.compute.manager [None req-56fcdf48-0a83-4ec9-b194-7e1b52c3fb4c tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] [instance: 7fc86edc-e217-4c70-88f8-02f4618d7ae0] Starting instance... {{(pid=75337) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 16:23:02 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-56fcdf48-0a83-4ec9-b194-7e1b52c3fb4c tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:23:02 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-56fcdf48-0a83-4ec9-b194-7e1b52c3fb4c tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:23:02 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-56fcdf48-0a83-4ec9-b194-7e1b52c3fb4c tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75337) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 16:23:02 user nova-compute[75337]: INFO nova.compute.claims [None req-56fcdf48-0a83-4ec9-b194-7e1b52c3fb4c tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] [instance: 7fc86edc-e217-4c70-88f8-02f4618d7ae0] Claim successful on node user
Nov 06 16:23:03 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-56fcdf48-0a83-4ec9-b194-7e1b52c3fb4c tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 16:23:03 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-56fcdf48-0a83-4ec9-b194-7e1b52c3fb4c tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 16:23:03 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-56fcdf48-0a83-4ec9-b194-7e1b52c3fb4c tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.217s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:23:03 user nova-compute[75337]: DEBUG nova.compute.manager [None req-56fcdf48-0a83-4ec9-b194-7e1b52c3fb4c tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] [instance: 7fc86edc-e217-4c70-88f8-02f4618d7ae0] Start building networks asynchronously for instance. {{(pid=75337) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 16:23:03 user nova-compute[75337]: DEBUG nova.compute.manager [None req-56fcdf48-0a83-4ec9-b194-7e1b52c3fb4c tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] [instance: 7fc86edc-e217-4c70-88f8-02f4618d7ae0] Allocating IP information in the background. {{(pid=75337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 16:23:03 user nova-compute[75337]: DEBUG nova.network.neutron [None req-56fcdf48-0a83-4ec9-b194-7e1b52c3fb4c tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] [instance: 7fc86edc-e217-4c70-88f8-02f4618d7ae0] allocate_for_instance() {{(pid=75337) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 16:23:03 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-56fcdf48-0a83-4ec9-b194-7e1b52c3fb4c tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] [instance: 7fc86edc-e217-4c70-88f8-02f4618d7ae0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 16:23:03 user nova-compute[75337]: DEBUG nova.compute.manager [None req-56fcdf48-0a83-4ec9-b194-7e1b52c3fb4c tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] [instance: 7fc86edc-e217-4c70-88f8-02f4618d7ae0] Start building block device mappings for instance. {{(pid=75337) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 16:23:03 user nova-compute[75337]: DEBUG nova.policy [None req-56fcdf48-0a83-4ec9-b194-7e1b52c3fb4c tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '22979798bd154fd3af622e408520e95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f71610b3d00f412ea4aeba8068d032fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75337) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 16:23:03 user nova-compute[75337]: DEBUG nova.compute.manager [None req-56fcdf48-0a83-4ec9-b194-7e1b52c3fb4c tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] [instance: 7fc86edc-e217-4c70-88f8-02f4618d7ae0] Start spawning the instance on the hypervisor. {{(pid=75337) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 16:23:03 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-56fcdf48-0a83-4ec9-b194-7e1b52c3fb4c tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] [instance: 7fc86edc-e217-4c70-88f8-02f4618d7ae0] Creating instance directory {{(pid=75337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 16:23:03 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-56fcdf48-0a83-4ec9-b194-7e1b52c3fb4c tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] [instance: 7fc86edc-e217-4c70-88f8-02f4618d7ae0] Creating image(s)
Nov 06 16:23:03 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-56fcdf48-0a83-4ec9-b194-7e1b52c3fb4c tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Acquiring lock "/opt/stack/data/nova/instances/7fc86edc-e217-4c70-88f8-02f4618d7ae0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:23:03 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-56fcdf48-0a83-4ec9-b194-7e1b52c3fb4c tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Lock "/opt/stack/data/nova/instances/7fc86edc-e217-4c70-88f8-02f4618d7ae0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:23:03 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-56fcdf48-0a83-4ec9-b194-7e1b52c3fb4c tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Lock "/opt/stack/data/nova/instances/7fc86edc-e217-4c70-88f8-02f4618d7ae0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:23:03 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-56fcdf48-0a83-4ec9-b194-7e1b52c3fb4c tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:23:03 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-56fcdf48-0a83-4ec9-b194-7e1b52c3fb4c tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json" returned: 0 in 0.185s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:23:03 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-56fcdf48-0a83-4ec9-b194-7e1b52c3fb4c tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Acquiring lock "06ba3c914798499e686c5ac75886932347225275" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:23:03 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-56fcdf48-0a83-4ec9-b194-7e1b52c3fb4c tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Lock "06ba3c914798499e686c5ac75886932347225275" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:23:03 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-56fcdf48-0a83-4ec9-b194-7e1b52c3fb4c tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:23:03 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-56fcdf48-0a83-4ec9-b194-7e1b52c3fb4c tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json" returned: 0 in 0.176s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:23:03 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-56fcdf48-0a83-4ec9-b194-7e1b52c3fb4c tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275,backing_fmt=raw /opt/stack/data/nova/instances/7fc86edc-e217-4c70-88f8-02f4618d7ae0/disk 1073741824 {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:23:03 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-56fcdf48-0a83-4ec9-b194-7e1b52c3fb4c tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275,backing_fmt=raw /opt/stack/data/nova/instances/7fc86edc-e217-4c70-88f8-02f4618d7ae0/disk 1073741824" returned: 0 in 0.051s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:23:03 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-56fcdf48-0a83-4ec9-b194-7e1b52c3fb4c tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Lock "06ba3c914798499e686c5ac75886932347225275" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:23:03 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-56fcdf48-0a83-4ec9-b194-7e1b52c3fb4c tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:23:03 user nova-compute[75337]: DEBUG nova.network.neutron [None req-56fcdf48-0a83-4ec9-b194-7e1b52c3fb4c tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] [instance: 7fc86edc-e217-4c70-88f8-02f4618d7ae0] Successfully created port: f9a9cc4f-9e35-485e-988b-2fcfbd4ad748 {{(pid=75337) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 16:23:03 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-56fcdf48-0a83-4ec9-b194-7e1b52c3fb4c tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json" returned: 0 in 0.180s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:23:03 user nova-compute[75337]: DEBUG nova.virt.disk.api [None req-56fcdf48-0a83-4ec9-b194-7e1b52c3fb4c tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7fc86edc-e217-4c70-88f8-02f4618d7ae0/disk. size=1073741824 {{(pid=75337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 16:23:03 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-56fcdf48-0a83-4ec9-b194-7e1b52c3fb4c tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fc86edc-e217-4c70-88f8-02f4618d7ae0/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:23:04 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:23:04 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-56fcdf48-0a83-4ec9-b194-7e1b52c3fb4c tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fc86edc-e217-4c70-88f8-02f4618d7ae0/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:23:04 user nova-compute[75337]: DEBUG nova.virt.disk.api [None req-56fcdf48-0a83-4ec9-b194-7e1b52c3fb4c tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Cannot resize image /opt/stack/data/nova/instances/7fc86edc-e217-4c70-88f8-02f4618d7ae0/disk to a smaller size. {{(pid=75337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 06 16:23:04 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-56fcdf48-0a83-4ec9-b194-7e1b52c3fb4c tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] [instance: 7fc86edc-e217-4c70-88f8-02f4618d7ae0] Created local disks {{(pid=75337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 16:23:04 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-56fcdf48-0a83-4ec9-b194-7e1b52c3fb4c tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] [instance: 7fc86edc-e217-4c70-88f8-02f4618d7ae0] Ensure instance console log exists: /opt/stack/data/nova/instances/7fc86edc-e217-4c70-88f8-02f4618d7ae0/console.log {{(pid=75337) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 16:23:04 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-56fcdf48-0a83-4ec9-b194-7e1b52c3fb4c tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:23:04 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-56fcdf48-0a83-4ec9-b194-7e1b52c3fb4c tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:23:04 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-56fcdf48-0a83-4ec9-b194-7e1b52c3fb4c tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:23:04 user nova-compute[75337]: DEBUG nova.network.neutron [None req-56fcdf48-0a83-4ec9-b194-7e1b52c3fb4c tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] [instance: 7fc86edc-e217-4c70-88f8-02f4618d7ae0] Successfully updated port: f9a9cc4f-9e35-485e-988b-2fcfbd4ad748 {{(pid=75337) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 16:23:04 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-56fcdf48-0a83-4ec9-b194-7e1b52c3fb4c tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Acquiring lock "refresh_cache-7fc86edc-e217-4c70-88f8-02f4618d7ae0" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 16:23:04 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-56fcdf48-0a83-4ec9-b194-7e1b52c3fb4c tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Acquired lock "refresh_cache-7fc86edc-e217-4c70-88f8-02f4618d7ae0" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 16:23:04 user nova-compute[75337]: DEBUG nova.network.neutron [None req-56fcdf48-0a83-4ec9-b194-7e1b52c3fb4c tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] [instance: 7fc86edc-e217-4c70-88f8-02f4618d7ae0] Building network info cache for instance {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 16:23:04 user nova-compute[75337]: DEBUG nova.network.neutron [None req-56fcdf48-0a83-4ec9-b194-7e1b52c3fb4c tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] [instance: 7fc86edc-e217-4c70-88f8-02f4618d7ae0] Instance cache missing network info. {{(pid=75337) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 16:23:04 user nova-compute[75337]: DEBUG nova.compute.manager [req-6ac88fe5-caa6-4b8e-8eb6-2a4143bbde3b req-7c20d24c-42f0-454d-a637-3665451ae0e6 service nova] [instance: 7fc86edc-e217-4c70-88f8-02f4618d7ae0] Received event network-changed-f9a9cc4f-9e35-485e-988b-2fcfbd4ad748 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:23:04 user nova-compute[75337]: DEBUG nova.compute.manager [req-6ac88fe5-caa6-4b8e-8eb6-2a4143bbde3b req-7c20d24c-42f0-454d-a637-3665451ae0e6 service nova] [instance: 7fc86edc-e217-4c70-88f8-02f4618d7ae0] Refreshing instance network info cache due to event network-changed-f9a9cc4f-9e35-485e-988b-2fcfbd4ad748. {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 16:23:04 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-6ac88fe5-caa6-4b8e-8eb6-2a4143bbde3b req-7c20d24c-42f0-454d-a637-3665451ae0e6 service nova] Acquiring lock "refresh_cache-7fc86edc-e217-4c70-88f8-02f4618d7ae0" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 16:23:05 user nova-compute[75337]: DEBUG nova.network.neutron [None req-56fcdf48-0a83-4ec9-b194-7e1b52c3fb4c tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] [instance: 7fc86edc-e217-4c70-88f8-02f4618d7ae0] Updating instance_info_cache with network_info: [{"id": "f9a9cc4f-9e35-485e-988b-2fcfbd4ad748", "address": "fa:16:3e:40:ad:75", "network": {"id": "0da0e0bd-b07e-4ae1-8625-a979ed32bd07", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-528047864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f71610b3d00f412ea4aeba8068d032fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9a9cc4f-9e", "ovs_interfaceid": "f9a9cc4f-9e35-485e-988b-2fcfbd4ad748", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 16:23:05 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-56fcdf48-0a83-4ec9-b194-7e1b52c3fb4c tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Releasing lock "refresh_cache-7fc86edc-e217-4c70-88f8-02f4618d7ae0" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 16:23:05 user nova-compute[75337]: DEBUG nova.compute.manager [None req-56fcdf48-0a83-4ec9-b194-7e1b52c3fb4c tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] [instance: 7fc86edc-e217-4c70-88f8-02f4618d7ae0] Instance network_info: |[{"id": "f9a9cc4f-9e35-485e-988b-2fcfbd4ad748", "address": "fa:16:3e:40:ad:75", "network": {"id": "0da0e0bd-b07e-4ae1-8625-a979ed32bd07", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-528047864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f71610b3d00f412ea4aeba8068d032fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9a9cc4f-9e", "ovs_interfaceid": "f9a9cc4f-9e35-485e-988b-2fcfbd4ad748", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 16:23:05 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-6ac88fe5-caa6-4b8e-8eb6-2a4143bbde3b req-7c20d24c-42f0-454d-a637-3665451ae0e6 service nova] Acquired lock "refresh_cache-7fc86edc-e217-4c70-88f8-02f4618d7ae0" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 16:23:05 user nova-compute[75337]: DEBUG nova.network.neutron [req-6ac88fe5-caa6-4b8e-8eb6-2a4143bbde3b req-7c20d24c-42f0-454d-a637-3665451ae0e6 service nova] [instance: 7fc86edc-e217-4c70-88f8-02f4618d7ae0] Refreshing network info cache for port f9a9cc4f-9e35-485e-988b-2fcfbd4ad748 {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 16:23:05 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-56fcdf48-0a83-4ec9-b194-7e1b52c3fb4c tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] [instance: 7fc86edc-e217-4c70-88f8-02f4618d7ae0] Start _get_guest_xml network_info=[{"id": "f9a9cc4f-9e35-485e-988b-2fcfbd4ad748", "address": "fa:16:3e:40:ad:75", "network": {"id": "0da0e0bd-b07e-4ae1-8625-a979ed32bd07", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-528047864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f71610b3d00f412ea4aeba8068d032fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9a9cc4f-9e", "ovs_interfaceid": "f9a9cc4f-9e35-485e-988b-2fcfbd4ad748", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T15:34:14Z,direct_url=<?>,disk_format='qcow2',id=16b903ae-a40f-41a7-985b-4804cce92c62,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6549a15819f1469bbd5eeae8190e3d44',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T15:34:15Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'guest_format': None, 'size': 0, 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '16b903ae-a40f-41a7-985b-4804cce92c62'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 16:23:05 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-56fcdf48-0a83-4ec9-b194-7e1b52c3fb4c tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 16:23:05 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-56fcdf48-0a83-4ec9-b194-7e1b52c3fb4c tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 16:23:05 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-56fcdf48-0a83-4ec9-b194-7e1b52c3fb4c tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 16:23:05 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-56fcdf48-0a83-4ec9-b194-7e1b52c3fb4c tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] CPU controller missing on host. {{(pid=75337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 16:23:05 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-56fcdf48-0a83-4ec9-b194-7e1b52c3fb4c tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 16:23:05 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-56fcdf48-0a83-4ec9-b194-7e1b52c3fb4c tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] CPU controller found on host. {{(pid=75337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 16:23:05 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-56fcdf48-0a83-4ec9-b194-7e1b52c3fb4c tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75337) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 16:23:05 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-56fcdf48-0a83-4ec9-b194-7e1b52c3fb4c tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T15:34:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T15:34:14Z,direct_url=<?>,disk_format='qcow2',id=16b903ae-a40f-41a7-985b-4804cce92c62,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6549a15819f1469bbd5eeae8190e3d44',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T15:34:15Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 16:23:05 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-56fcdf48-0a83-4ec9-b194-7e1b52c3fb4c tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Flavor limits 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 16:23:05 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-56fcdf48-0a83-4ec9-b194-7e1b52c3fb4c tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Image limits 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 16:23:05 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-56fcdf48-0a83-4ec9-b194-7e1b52c3fb4c tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Flavor pref 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 16:23:05 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-56fcdf48-0a83-4ec9-b194-7e1b52c3fb4c tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Image pref 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 16:23:05 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-56fcdf48-0a83-4ec9-b194-7e1b52c3fb4c tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 16:23:05 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-56fcdf48-0a83-4ec9-b194-7e1b52c3fb4c tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 16:23:05 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-56fcdf48-0a83-4ec9-b194-7e1b52c3fb4c tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 16:23:05 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-56fcdf48-0a83-4ec9-b194-7e1b52c3fb4c tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Got 1 possible topologies {{(pid=75337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 16:23:05 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-56fcdf48-0a83-4ec9-b194-7e1b52c3fb4c tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 16:23:05 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-56fcdf48-0a83-4ec9-b194-7e1b52c3fb4c tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 16:23:05 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-56fcdf48-0a83-4ec9-b194-7e1b52c3fb4c tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T16:23:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-567659544',display_name='tempest-ServerRescueNegativeTestJSON-server-567659544',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-567659544',id=51,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKCnwS9V2datn/d83z1Ldzc4r6vlQ1N+FoURVDDxeb+oh6NM9SfP5Ne+mUOvSzwFBDwZ2iQPrPcxMtYEj6Zhw1KRsLXtveytGBAgQSJy5Blq0NiUK/k8xSRWkrZB/atZ2Q==',key_name='tempest-keypair-630615777',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f71610b3d00f412ea4aeba8068d032fc',ramdisk_id='',reservation_id='r-vht4ttph',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1763914139',owner_user_name='tempest-ServerRescueNegativeTestJSON-1763914139-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T16:23:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='22979798bd154fd3af622e408520e95c',uuid=7fc86edc-e217-4c70-88f8-02f4618d7ae0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f9a9cc4f-9e35-485e-988b-2fcfbd4ad748", "address": "fa:16:3e:40:ad:75", "network": {"id": "0da0e0bd-b07e-4ae1-8625-a979ed32bd07", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-528047864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f71610b3d00f412ea4aeba8068d032fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9a9cc4f-9e", "ovs_interfaceid": "f9a9cc4f-9e35-485e-988b-2fcfbd4ad748", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75337) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 16:23:05 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-56fcdf48-0a83-4ec9-b194-7e1b52c3fb4c tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Converting VIF {"id": "f9a9cc4f-9e35-485e-988b-2fcfbd4ad748", "address": "fa:16:3e:40:ad:75", "network": {"id": "0da0e0bd-b07e-4ae1-8625-a979ed32bd07", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-528047864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f71610b3d00f412ea4aeba8068d032fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9a9cc4f-9e", "ovs_interfaceid": "f9a9cc4f-9e35-485e-988b-2fcfbd4ad748", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 16:23:05 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-56fcdf48-0a83-4ec9-b194-7e1b52c3fb4c tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:ad:75,bridge_name='br-int',has_traffic_filtering=True,id=f9a9cc4f-9e35-485e-988b-2fcfbd4ad748,network=Network(0da0e0bd-b07e-4ae1-8625-a979ed32bd07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9a9cc4f-9e') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 16:23:05 user nova-compute[75337]: DEBUG nova.objects.instance [None req-56fcdf48-0a83-4ec9-b194-7e1b52c3fb4c tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Lazy-loading 'pci_devices' on Instance uuid 7fc86edc-e217-4c70-88f8-02f4618d7ae0 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 16:23:05 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-56fcdf48-0a83-4ec9-b194-7e1b52c3fb4c tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] [instance: 7fc86edc-e217-4c70-88f8-02f4618d7ae0] End _get_guest_xml xml=<domain type="kvm">
Nov 06 16:23:05 user nova-compute[75337]:   <uuid>7fc86edc-e217-4c70-88f8-02f4618d7ae0</uuid>
Nov 06 16:23:05 user nova-compute[75337]:   <name>instance-00000033</name>
Nov 06 16:23:05 user nova-compute[75337]:   <memory>524288</memory>
Nov 06 16:23:05 user nova-compute[75337]:   <vcpu>1</vcpu>
Nov 06 16:23:05 user nova-compute[75337]:   <metadata>
Nov 06 16:23:05 user nova-compute[75337]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 16:23:05 user nova-compute[75337]:       <nova:package version="0.0.0"/>
Nov 06 16:23:05 user nova-compute[75337]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-567659544</nova:name>
Nov 06 16:23:05 user nova-compute[75337]:       <nova:creationTime>2023-11-06 16:23:05</nova:creationTime>
Nov 06 16:23:05 user nova-compute[75337]:       <nova:flavor name="m1.tiny">
Nov 06 16:23:05 user nova-compute[75337]:         <nova:memory>512</nova:memory>
Nov 06 16:23:05 user nova-compute[75337]:         <nova:disk>1</nova:disk>
Nov 06 16:23:05 user nova-compute[75337]:         <nova:swap>0</nova:swap>
Nov 06 16:23:05 user nova-compute[75337]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 16:23:05 user nova-compute[75337]:         <nova:vcpus>1</nova:vcpus>
Nov 06 16:23:05 user nova-compute[75337]:       </nova:flavor>
Nov 06 16:23:05 user nova-compute[75337]:       <nova:owner>
Nov 06 16:23:05 user nova-compute[75337]:         <nova:user uuid="22979798bd154fd3af622e408520e95c">tempest-ServerRescueNegativeTestJSON-1763914139-project-member</nova:user>
Nov 06 16:23:05 user nova-compute[75337]:         <nova:project uuid="f71610b3d00f412ea4aeba8068d032fc">tempest-ServerRescueNegativeTestJSON-1763914139</nova:project>
Nov 06 16:23:05 user nova-compute[75337]:       </nova:owner>
Nov 06 16:23:05 user nova-compute[75337]:       <nova:root type="image" uuid="16b903ae-a40f-41a7-985b-4804cce92c62"/>
Nov 06 16:23:05 user nova-compute[75337]:       <nova:ports>
Nov 06 16:23:05 user nova-compute[75337]:         <nova:port uuid="f9a9cc4f-9e35-485e-988b-2fcfbd4ad748">
Nov 06 16:23:05 user nova-compute[75337]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 06 16:23:05 user nova-compute[75337]:         </nova:port>
Nov 06 16:23:05 user nova-compute[75337]:       </nova:ports>
Nov 06 16:23:05 user nova-compute[75337]:     </nova:instance>
Nov 06 16:23:05 user nova-compute[75337]:   </metadata>
Nov 06 16:23:05 user nova-compute[75337]:   <sysinfo type="smbios">
Nov 06 16:23:05 user nova-compute[75337]:     <system>
Nov 06 16:23:05 user nova-compute[75337]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 16:23:05 user nova-compute[75337]:       <entry name="product">OpenStack Nova</entry>
Nov 06 16:23:05 user nova-compute[75337]:       <entry name="version">0.0.0</entry>
Nov 06 16:23:05 user nova-compute[75337]:       <entry name="serial">7fc86edc-e217-4c70-88f8-02f4618d7ae0</entry>
Nov 06 16:23:05 user nova-compute[75337]:       <entry name="uuid">7fc86edc-e217-4c70-88f8-02f4618d7ae0</entry>
Nov 06 16:23:05 user nova-compute[75337]:       <entry name="family">Virtual Machine</entry>
Nov 06 16:23:05 user nova-compute[75337]:     </system>
Nov 06 16:23:05 user nova-compute[75337]:   </sysinfo>
Nov 06 16:23:05 user nova-compute[75337]:   <os>
Nov 06 16:23:05 user nova-compute[75337]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 16:23:05 user nova-compute[75337]:     <boot dev="hd"/>
Nov 06 16:23:05 user nova-compute[75337]:     <smbios mode="sysinfo"/>
Nov 06 16:23:05 user nova-compute[75337]:   </os>
Nov 06 16:23:05 user nova-compute[75337]:   <features>
Nov 06 16:23:05 user nova-compute[75337]:     <acpi/>
Nov 06 16:23:05 user nova-compute[75337]:     <apic/>
Nov 06 16:23:05 user nova-compute[75337]:     <vmcoreinfo/>
Nov 06 16:23:05 user nova-compute[75337]:   </features>
Nov 06 16:23:05 user nova-compute[75337]:   <clock offset="utc">
Nov 06 16:23:05 user nova-compute[75337]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 16:23:05 user nova-compute[75337]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 16:23:05 user nova-compute[75337]:     <timer name="hpet" present="no"/>
Nov 06 16:23:05 user nova-compute[75337]:   </clock>
Nov 06 16:23:05 user nova-compute[75337]:   <cpu mode="custom" match="exact">
Nov 06 16:23:05 user nova-compute[75337]:     <model>Nehalem</model>
Nov 06 16:23:05 user nova-compute[75337]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 16:23:05 user nova-compute[75337]:   </cpu>
Nov 06 16:23:05 user nova-compute[75337]:   <devices>
Nov 06 16:23:05 user nova-compute[75337]:     <disk type="file" device="disk">
Nov 06 16:23:05 user nova-compute[75337]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 16:23:05 user nova-compute[75337]:       <source file="/opt/stack/data/nova/instances/7fc86edc-e217-4c70-88f8-02f4618d7ae0/disk"/>
Nov 06 16:23:05 user nova-compute[75337]:       <target dev="vda" bus="virtio"/>
Nov 06 16:23:05 user nova-compute[75337]:     </disk>
Nov 06 16:23:05 user nova-compute[75337]:     <interface type="ethernet">
Nov 06 16:23:05 user nova-compute[75337]:       <mac address="fa:16:3e:40:ad:75"/>
Nov 06 16:23:05 user nova-compute[75337]:       <model type="virtio"/>
Nov 06 16:23:05 user nova-compute[75337]:       <mtu size="1442"/>
Nov 06 16:23:05 user nova-compute[75337]:       <target dev="tapf9a9cc4f-9e"/>
Nov 06 16:23:05 user nova-compute[75337]:     </interface>
Nov 06 16:23:05 user nova-compute[75337]:     <serial type="pty">
Nov 06 16:23:05 user nova-compute[75337]:       <log file="/opt/stack/data/nova/instances/7fc86edc-e217-4c70-88f8-02f4618d7ae0/console.log" append="off"/>
Nov 06 16:23:05 user nova-compute[75337]:     </serial>
Nov 06 16:23:05 user nova-compute[75337]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 16:23:05 user nova-compute[75337]:     <video>
Nov 06 16:23:05 user nova-compute[75337]:       <model type="virtio"/>
Nov 06 16:23:05 user nova-compute[75337]:     </video>
Nov 06 16:23:05 user nova-compute[75337]:     <rng model="virtio">
Nov 06 16:23:05 user nova-compute[75337]:       <backend model="random">/dev/urandom</backend>
Nov 06 16:23:05 user nova-compute[75337]:     </rng>
Nov 06 16:23:05 user nova-compute[75337]:     <controller type="usb" index="0" model="none"/>
Nov 06 16:23:05 user nova-compute[75337]:     <memballoon model="virtio">
Nov 06 16:23:05 user nova-compute[75337]:       <stats period="10"/>
Nov 06 16:23:05 user nova-compute[75337]:     </memballoon>
Nov 06 16:23:05 user nova-compute[75337]:   </devices>
Nov 06 16:23:05 user nova-compute[75337]: </domain>
Nov 06 16:23:05 user nova-compute[75337]:  {{(pid=75337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 16:23:05 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-56fcdf48-0a83-4ec9-b194-7e1b52c3fb4c tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T16:23:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-567659544',display_name='tempest-ServerRescueNegativeTestJSON-server-567659544',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-567659544',id=51,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKCnwS9V2datn/d83z1Ldzc4r6vlQ1N+FoURVDDxeb+oh6NM9SfP5Ne+mUOvSzwFBDwZ2iQPrPcxMtYEj6Zhw1KRsLXtveytGBAgQSJy5Blq0NiUK/k8xSRWkrZB/atZ2Q==',key_name='tempest-keypair-630615777',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f71610b3d00f412ea4aeba8068d032fc',ramdisk_id='',reservation_id='r-vht4ttph',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1763914139',owner_user_name='tempest-ServerRescueNegativeTestJSON-1763914139-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T16:23:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='22979798bd154fd3af622e408520e95c',uuid=7fc86edc-e217-4c70-88f8-02f4618d7ae0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f9a9cc4f-9e35-485e-988b-2fcfbd4ad748", "address": "fa:16:3e:40:ad:75", "network": {"id": "0da0e0bd-b07e-4ae1-8625-a979ed32bd07", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-528047864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f71610b3d00f412ea4aeba8068d032fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9a9cc4f-9e", "ovs_interfaceid": "f9a9cc4f-9e35-485e-988b-2fcfbd4ad748", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 16:23:05 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-56fcdf48-0a83-4ec9-b194-7e1b52c3fb4c tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Converting VIF {"id": "f9a9cc4f-9e35-485e-988b-2fcfbd4ad748", "address": "fa:16:3e:40:ad:75", "network": {"id": "0da0e0bd-b07e-4ae1-8625-a979ed32bd07", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-528047864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f71610b3d00f412ea4aeba8068d032fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9a9cc4f-9e", "ovs_interfaceid": "f9a9cc4f-9e35-485e-988b-2fcfbd4ad748", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 16:23:05 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-56fcdf48-0a83-4ec9-b194-7e1b52c3fb4c tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:ad:75,bridge_name='br-int',has_traffic_filtering=True,id=f9a9cc4f-9e35-485e-988b-2fcfbd4ad748,network=Network(0da0e0bd-b07e-4ae1-8625-a979ed32bd07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9a9cc4f-9e') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 16:23:05 user nova-compute[75337]: DEBUG os_vif [None req-56fcdf48-0a83-4ec9-b194-7e1b52c3fb4c tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:ad:75,bridge_name='br-int',has_traffic_filtering=True,id=f9a9cc4f-9e35-485e-988b-2fcfbd4ad748,network=Network(0da0e0bd-b07e-4ae1-8625-a979ed32bd07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9a9cc4f-9e') {{(pid=75337) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 16:23:05 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:23:05 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 16:23:05 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 16:23:05 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:23:05 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '256de7fc-0d64-5953-99e6-e91cded513fb', '_type': 'linux-noop'}}, row=False) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 16:23:05 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:23:05 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:23:05 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:23:05 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf9a9cc4f-9e, may_exist=True, interface_attrs={}) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 16:23:05 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf9a9cc4f-9e, col_values=(('qos', UUID('80cdffe5-aca2-4889-a4e7-663da1f774b7')),), if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 16:23:05 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf9a9cc4f-9e, col_values=(('external_ids', {'iface-id': 'f9a9cc4f-9e35-485e-988b-2fcfbd4ad748', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:40:ad:75', 'vm-uuid': '7fc86edc-e217-4c70-88f8-02f4618d7ae0'}),), if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 16:23:05 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:23:05 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:23:05 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:23:05 user nova-compute[75337]: INFO os_vif [None req-56fcdf48-0a83-4ec9-b194-7e1b52c3fb4c tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:ad:75,bridge_name='br-int',has_traffic_filtering=True,id=f9a9cc4f-9e35-485e-988b-2fcfbd4ad748,network=Network(0da0e0bd-b07e-4ae1-8625-a979ed32bd07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9a9cc4f-9e')
Nov 06 16:23:05 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-56fcdf48-0a83-4ec9-b194-7e1b52c3fb4c tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] No BDM found with device name vda, not building metadata. {{(pid=75337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 16:23:05 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-56fcdf48-0a83-4ec9-b194-7e1b52c3fb4c tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] No VIF found with MAC fa:16:3e:40:ad:75, not building metadata {{(pid=75337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 16:23:05 user nova-compute[75337]: DEBUG nova.network.neutron [req-6ac88fe5-caa6-4b8e-8eb6-2a4143bbde3b req-7c20d24c-42f0-454d-a637-3665451ae0e6 service nova] [instance: 7fc86edc-e217-4c70-88f8-02f4618d7ae0] Updated VIF entry in instance network info cache for port f9a9cc4f-9e35-485e-988b-2fcfbd4ad748. {{(pid=75337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 16:23:05 user nova-compute[75337]: DEBUG nova.network.neutron [req-6ac88fe5-caa6-4b8e-8eb6-2a4143bbde3b req-7c20d24c-42f0-454d-a637-3665451ae0e6 service nova] [instance: 7fc86edc-e217-4c70-88f8-02f4618d7ae0] Updating instance_info_cache with network_info: [{"id": "f9a9cc4f-9e35-485e-988b-2fcfbd4ad748", "address": "fa:16:3e:40:ad:75", "network": {"id": "0da0e0bd-b07e-4ae1-8625-a979ed32bd07", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-528047864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f71610b3d00f412ea4aeba8068d032fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9a9cc4f-9e", "ovs_interfaceid": "f9a9cc4f-9e35-485e-988b-2fcfbd4ad748", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 16:23:05 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-6ac88fe5-caa6-4b8e-8eb6-2a4143bbde3b req-7c20d24c-42f0-454d-a637-3665451ae0e6 service nova] Releasing lock "refresh_cache-7fc86edc-e217-4c70-88f8-02f4618d7ae0" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 16:23:06 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:23:06 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:23:06 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:23:06 user nova-compute[75337]: DEBUG nova.compute.manager [req-e31fe2a4-565b-4c08-99f3-abe81d311237 req-f742e2c6-d0a9-4ddd-82d6-c2e01b680482 service nova] [instance: 7fc86edc-e217-4c70-88f8-02f4618d7ae0] Received event network-vif-plugged-f9a9cc4f-9e35-485e-988b-2fcfbd4ad748 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:23:06 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-e31fe2a4-565b-4c08-99f3-abe81d311237 req-f742e2c6-d0a9-4ddd-82d6-c2e01b680482 service nova] Acquiring lock "7fc86edc-e217-4c70-88f8-02f4618d7ae0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:23:06 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-e31fe2a4-565b-4c08-99f3-abe81d311237 req-f742e2c6-d0a9-4ddd-82d6-c2e01b680482 service nova] Lock "7fc86edc-e217-4c70-88f8-02f4618d7ae0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:23:06 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-e31fe2a4-565b-4c08-99f3-abe81d311237 req-f742e2c6-d0a9-4ddd-82d6-c2e01b680482 service nova] Lock "7fc86edc-e217-4c70-88f8-02f4618d7ae0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:23:06 user nova-compute[75337]: DEBUG nova.compute.manager [req-e31fe2a4-565b-4c08-99f3-abe81d311237 req-f742e2c6-d0a9-4ddd-82d6-c2e01b680482 service nova] [instance: 7fc86edc-e217-4c70-88f8-02f4618d7ae0] No waiting events found dispatching network-vif-plugged-f9a9cc4f-9e35-485e-988b-2fcfbd4ad748 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 16:23:06 user nova-compute[75337]: WARNING nova.compute.manager [req-e31fe2a4-565b-4c08-99f3-abe81d311237 req-f742e2c6-d0a9-4ddd-82d6-c2e01b680482 service nova] [instance: 7fc86edc-e217-4c70-88f8-02f4618d7ae0] Received unexpected event network-vif-plugged-f9a9cc4f-9e35-485e-988b-2fcfbd4ad748 for instance with vm_state building and task_state spawning.
Nov 06 16:23:06 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:23:06 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:23:08 user nova-compute[75337]: DEBUG nova.compute.manager [None req-56fcdf48-0a83-4ec9-b194-7e1b52c3fb4c tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] [instance: 7fc86edc-e217-4c70-88f8-02f4618d7ae0] Instance event wait completed in 0 seconds for  {{(pid=75337) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 16:23:08 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-56fcdf48-0a83-4ec9-b194-7e1b52c3fb4c tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] [instance: 7fc86edc-e217-4c70-88f8-02f4618d7ae0] Guest created on hypervisor {{(pid=75337) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 16:23:08 user nova-compute[75337]: INFO nova.virt.libvirt.driver [-] [instance: 7fc86edc-e217-4c70-88f8-02f4618d7ae0] Instance spawned successfully.
Nov 06 16:23:08 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-56fcdf48-0a83-4ec9-b194-7e1b52c3fb4c tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] [instance: 7fc86edc-e217-4c70-88f8-02f4618d7ae0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 16:23:08 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-56fcdf48-0a83-4ec9-b194-7e1b52c3fb4c tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] [instance: 7fc86edc-e217-4c70-88f8-02f4618d7ae0] Found default for hw_cdrom_bus of ide {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 16:23:08 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-56fcdf48-0a83-4ec9-b194-7e1b52c3fb4c tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] [instance: 7fc86edc-e217-4c70-88f8-02f4618d7ae0] Found default for hw_disk_bus of virtio {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 16:23:08 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-56fcdf48-0a83-4ec9-b194-7e1b52c3fb4c tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] [instance: 7fc86edc-e217-4c70-88f8-02f4618d7ae0] Found default for hw_input_bus of None {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 16:23:08 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-56fcdf48-0a83-4ec9-b194-7e1b52c3fb4c tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] [instance: 7fc86edc-e217-4c70-88f8-02f4618d7ae0] Found default for hw_pointer_model of None {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 16:23:08 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-56fcdf48-0a83-4ec9-b194-7e1b52c3fb4c tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] [instance: 7fc86edc-e217-4c70-88f8-02f4618d7ae0] Found default for hw_video_model of virtio {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 16:23:08 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-56fcdf48-0a83-4ec9-b194-7e1b52c3fb4c tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] [instance: 7fc86edc-e217-4c70-88f8-02f4618d7ae0] Found default for hw_vif_model of virtio {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 16:23:08 user nova-compute[75337]: INFO nova.compute.manager [None req-56fcdf48-0a83-4ec9-b194-7e1b52c3fb4c tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] [instance: 7fc86edc-e217-4c70-88f8-02f4618d7ae0] Took 5.29 seconds to spawn the instance on the hypervisor.
Nov 06 16:23:08 user nova-compute[75337]: DEBUG nova.compute.manager [None req-56fcdf48-0a83-4ec9-b194-7e1b52c3fb4c tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] [instance: 7fc86edc-e217-4c70-88f8-02f4618d7ae0] Checking state {{(pid=75337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 16:23:08 user nova-compute[75337]: DEBUG nova.compute.manager [req-2f38f498-0d94-43ac-96be-00cb30265a9a req-cb65de41-1bda-49ac-9842-30758704b77f service nova] [instance: 7fc86edc-e217-4c70-88f8-02f4618d7ae0] Received event network-vif-plugged-f9a9cc4f-9e35-485e-988b-2fcfbd4ad748 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:23:08 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-2f38f498-0d94-43ac-96be-00cb30265a9a req-cb65de41-1bda-49ac-9842-30758704b77f service nova] Acquiring lock "7fc86edc-e217-4c70-88f8-02f4618d7ae0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:23:08 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-2f38f498-0d94-43ac-96be-00cb30265a9a req-cb65de41-1bda-49ac-9842-30758704b77f service nova] Lock "7fc86edc-e217-4c70-88f8-02f4618d7ae0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:23:08 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-2f38f498-0d94-43ac-96be-00cb30265a9a req-cb65de41-1bda-49ac-9842-30758704b77f service nova] Lock "7fc86edc-e217-4c70-88f8-02f4618d7ae0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:23:08 user nova-compute[75337]: DEBUG nova.compute.manager [req-2f38f498-0d94-43ac-96be-00cb30265a9a req-cb65de41-1bda-49ac-9842-30758704b77f service nova] [instance: 7fc86edc-e217-4c70-88f8-02f4618d7ae0] No waiting events found dispatching network-vif-plugged-f9a9cc4f-9e35-485e-988b-2fcfbd4ad748 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 16:23:08 user nova-compute[75337]: WARNING nova.compute.manager [req-2f38f498-0d94-43ac-96be-00cb30265a9a req-cb65de41-1bda-49ac-9842-30758704b77f service nova] [instance: 7fc86edc-e217-4c70-88f8-02f4618d7ae0] Received unexpected event network-vif-plugged-f9a9cc4f-9e35-485e-988b-2fcfbd4ad748 for instance with vm_state active and task_state None.
Nov 06 16:23:08 user nova-compute[75337]: INFO nova.compute.manager [None req-56fcdf48-0a83-4ec9-b194-7e1b52c3fb4c tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] [instance: 7fc86edc-e217-4c70-88f8-02f4618d7ae0] Took 5.82 seconds to build instance.
Nov 06 16:23:08 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-56fcdf48-0a83-4ec9-b194-7e1b52c3fb4c tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Lock "7fc86edc-e217-4c70-88f8-02f4618d7ae0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.906s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:23:10 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:23:10 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:23:15 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:23:20 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:23:25 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:23:25 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:23:25 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:23:28 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:23:30 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:23:30 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:23:32 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:23:32 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75337) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 16:23:33 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:23:35 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:23:35 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:23:37 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:23:37 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:23:37 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:23:40 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:23:40 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:23:44 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:23:44 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Starting heal instance info cache {{(pid=75337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 16:23:44 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "refresh_cache-de77f786-1ecf-4eac-ae4a-c4f6b1d47339" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 16:23:44 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquired lock "refresh_cache-de77f786-1ecf-4eac-ae4a-c4f6b1d47339" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 16:23:44 user nova-compute[75337]: DEBUG nova.network.neutron [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] [instance: de77f786-1ecf-4eac-ae4a-c4f6b1d47339] Forcefully refreshing network info cache for instance {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 16:23:45 user nova-compute[75337]: DEBUG nova.network.neutron [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] [instance: de77f786-1ecf-4eac-ae4a-c4f6b1d47339] Updating instance_info_cache with network_info: [{"id": "8f33a5c0-50e1-4bac-a686-733daf33a307", "address": "fa:16:3e:4b:fc:cf", "network": {"id": "0da0e0bd-b07e-4ae1-8625-a979ed32bd07", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-528047864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f71610b3d00f412ea4aeba8068d032fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f33a5c0-50", "ovs_interfaceid": "8f33a5c0-50e1-4bac-a686-733daf33a307", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 16:23:45 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Releasing lock "refresh_cache-de77f786-1ecf-4eac-ae4a-c4f6b1d47339" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 16:23:45 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] [instance: de77f786-1ecf-4eac-ae4a-c4f6b1d47339] Updated the network info_cache for instance {{(pid=75337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 16:23:45 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:23:48 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager.update_available_resource {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:23:48 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:23:48 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:23:48 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:23:48 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Auditing locally available compute resources for user (node: user) {{(pid=75337) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 16:23:48 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fc86edc-e217-4c70-88f8-02f4618d7ae0/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:23:48 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fc86edc-e217-4c70-88f8-02f4618d7ae0/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:23:48 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fc86edc-e217-4c70-88f8-02f4618d7ae0/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:23:49 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fc86edc-e217-4c70-88f8-02f4618d7ae0/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:23:49 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525c87e5-14c3-40fd-8976-8df151ed07fa/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:23:49 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525c87e5-14c3-40fd-8976-8df151ed07fa/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:23:49 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525c87e5-14c3-40fd-8976-8df151ed07fa/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:23:49 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525c87e5-14c3-40fd-8976-8df151ed07fa/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:23:49 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de77f786-1ecf-4eac-ae4a-c4f6b1d47339/disk.rescue --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:23:49 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de77f786-1ecf-4eac-ae4a-c4f6b1d47339/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:23:49 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de77f786-1ecf-4eac-ae4a-c4f6b1d47339/disk.rescue --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:23:49 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de77f786-1ecf-4eac-ae4a-c4f6b1d47339/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:23:49 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de77f786-1ecf-4eac-ae4a-c4f6b1d47339/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:23:49 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de77f786-1ecf-4eac-ae4a-c4f6b1d47339/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:23:49 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de77f786-1ecf-4eac-ae4a-c4f6b1d47339/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:23:50 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de77f786-1ecf-4eac-ae4a-c4f6b1d47339/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:23:50 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:23:50 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 16:23:50 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 16:23:50 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Hypervisor/Node resource view: name=user free_ram=8760MB free_disk=24.955467224121094GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75337) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 16:23:50 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:23:50 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:23:50 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 525c87e5-14c3-40fd-8976-8df151ed07fa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 16:23:50 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance de77f786-1ecf-4eac-ae4a-c4f6b1d47339 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 16:23:50 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 7fc86edc-e217-4c70-88f8-02f4618d7ae0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 16:23:50 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 16:23:50 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 16:23:50 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 16:23:50 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 16:23:50 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Compute_service record updated for user:user {{(pid=75337) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 16:23:50 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.261s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:23:55 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:23:55 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:23:55 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75337) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 16:23:55 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 16:23:55 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 16:23:55 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:24:00 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:24:00 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:24:00 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75337) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 16:24:00 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 16:24:00 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 16:24:00 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:24:05 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:24:05 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:24:05 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75337) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 16:24:05 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 16:24:05 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 16:24:05 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:24:10 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4996-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:24:10 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:24:10 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75337) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 16:24:10 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 16:24:10 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 16:24:10 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:24:15 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:24:15 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:24:15 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75337) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 16:24:15 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 16:24:15 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 16:24:15 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:24:20 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:24:25 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:24:25 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:24:28 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:24:30 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:24:33 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:24:33 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75337) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 16:24:35 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:24:35 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:24:35 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:24:35 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75337) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 16:24:35 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 16:24:35 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 16:24:35 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:24:37 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:24:37 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:24:37 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:24:40 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:24:40 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:24:40 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75337) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 16:24:40 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 16:24:40 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 16:24:40 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:24:45 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:24:46 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:24:46 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Starting heal instance info cache {{(pid=75337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 16:24:46 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Rebuilding the list of instances to heal {{(pid=75337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 06 16:24:46 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "refresh_cache-525c87e5-14c3-40fd-8976-8df151ed07fa" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 16:24:46 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquired lock "refresh_cache-525c87e5-14c3-40fd-8976-8df151ed07fa" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 16:24:46 user nova-compute[75337]: DEBUG nova.network.neutron [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] [instance: 525c87e5-14c3-40fd-8976-8df151ed07fa] Forcefully refreshing network info cache for instance {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 16:24:46 user nova-compute[75337]: DEBUG nova.objects.instance [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lazy-loading 'info_cache' on Instance uuid 525c87e5-14c3-40fd-8976-8df151ed07fa {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 16:24:47 user nova-compute[75337]: DEBUG nova.network.neutron [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] [instance: 525c87e5-14c3-40fd-8976-8df151ed07fa] Updating instance_info_cache with network_info: [{"id": "1dfbe337-9efa-4a6a-9801-e9264673d095", "address": "fa:16:3e:fd:18:f1", "network": {"id": "0da0e0bd-b07e-4ae1-8625-a979ed32bd07", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-528047864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f71610b3d00f412ea4aeba8068d032fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dfbe337-9e", "ovs_interfaceid": "1dfbe337-9efa-4a6a-9801-e9264673d095", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 16:24:47 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Releasing lock "refresh_cache-525c87e5-14c3-40fd-8976-8df151ed07fa" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 16:24:47 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] [instance: 525c87e5-14c3-40fd-8976-8df151ed07fa] Updated the network info_cache for instance {{(pid=75337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 16:24:49 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager.update_available_resource {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:24:49 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:24:49 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:24:49 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:24:49 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Auditing locally available compute resources for user (node: user) {{(pid=75337) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 16:24:49 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fc86edc-e217-4c70-88f8-02f4618d7ae0/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:24:49 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fc86edc-e217-4c70-88f8-02f4618d7ae0/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:24:49 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fc86edc-e217-4c70-88f8-02f4618d7ae0/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:24:50 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fc86edc-e217-4c70-88f8-02f4618d7ae0/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:24:50 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525c87e5-14c3-40fd-8976-8df151ed07fa/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:24:50 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525c87e5-14c3-40fd-8976-8df151ed07fa/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:24:50 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525c87e5-14c3-40fd-8976-8df151ed07fa/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:24:50 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525c87e5-14c3-40fd-8976-8df151ed07fa/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:24:50 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de77f786-1ecf-4eac-ae4a-c4f6b1d47339/disk.rescue --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:24:50 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de77f786-1ecf-4eac-ae4a-c4f6b1d47339/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:24:50 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de77f786-1ecf-4eac-ae4a-c4f6b1d47339/disk.rescue --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:24:50 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:24:50 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de77f786-1ecf-4eac-ae4a-c4f6b1d47339/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:24:50 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de77f786-1ecf-4eac-ae4a-c4f6b1d47339/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:24:50 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de77f786-1ecf-4eac-ae4a-c4f6b1d47339/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:24:50 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de77f786-1ecf-4eac-ae4a-c4f6b1d47339/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:24:51 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de77f786-1ecf-4eac-ae4a-c4f6b1d47339/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:24:51 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 16:24:51 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 16:24:51 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Hypervisor/Node resource view: name=user free_ram=8796MB free_disk=24.954898834228516GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75337) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 16:24:51 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:24:51 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:24:51 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 525c87e5-14c3-40fd-8976-8df151ed07fa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 16:24:51 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance de77f786-1ecf-4eac-ae4a-c4f6b1d47339 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 16:24:51 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 7fc86edc-e217-4c70-88f8-02f4618d7ae0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 16:24:51 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 16:24:51 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 16:24:51 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Refreshing inventories for resource provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 06 16:24:51 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Updating ProviderTree inventory for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 06 16:24:51 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Updating inventory in ProviderTree for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 06 16:24:51 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Refreshing aggregate associations for resource provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7, aggregates: None {{(pid=75337) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 06 16:24:51 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Refreshing trait associations for resource provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7, traits: COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NODE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_IDE,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSSE3,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_USB {{(pid=75337) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 06 16:24:51 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 16:24:51 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 16:24:51 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Compute_service record updated for user:user {{(pid=75337) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 16:24:51 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.425s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:24:51 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:24:51 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Cleaning up deleted instances with incomplete migration  {{(pid=75337) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 06 16:24:52 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:24:54 user nova-compute[75337]: DEBUG nova.compute.manager [req-762b6018-d0e1-4925-af4a-effa3b922158 req-d05eb266-efd9-43ff-8446-6eb3811dd70a service nova] [instance: 7fc86edc-e217-4c70-88f8-02f4618d7ae0] Received event network-changed-f9a9cc4f-9e35-485e-988b-2fcfbd4ad748 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:24:54 user nova-compute[75337]: DEBUG nova.compute.manager [req-762b6018-d0e1-4925-af4a-effa3b922158 req-d05eb266-efd9-43ff-8446-6eb3811dd70a service nova] [instance: 7fc86edc-e217-4c70-88f8-02f4618d7ae0] Refreshing instance network info cache due to event network-changed-f9a9cc4f-9e35-485e-988b-2fcfbd4ad748. {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 16:24:54 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-762b6018-d0e1-4925-af4a-effa3b922158 req-d05eb266-efd9-43ff-8446-6eb3811dd70a service nova] Acquiring lock "refresh_cache-7fc86edc-e217-4c70-88f8-02f4618d7ae0" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 16:24:54 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-762b6018-d0e1-4925-af4a-effa3b922158 req-d05eb266-efd9-43ff-8446-6eb3811dd70a service nova] Acquired lock "refresh_cache-7fc86edc-e217-4c70-88f8-02f4618d7ae0" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 16:24:54 user nova-compute[75337]: DEBUG nova.network.neutron [req-762b6018-d0e1-4925-af4a-effa3b922158 req-d05eb266-efd9-43ff-8446-6eb3811dd70a service nova] [instance: 7fc86edc-e217-4c70-88f8-02f4618d7ae0] Refreshing network info cache for port f9a9cc4f-9e35-485e-988b-2fcfbd4ad748 {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 16:24:54 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-73cbd514-608c-496a-ad5c-daa537a95566 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Acquiring lock "7fc86edc-e217-4c70-88f8-02f4618d7ae0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:24:54 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-73cbd514-608c-496a-ad5c-daa537a95566 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Lock "7fc86edc-e217-4c70-88f8-02f4618d7ae0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:24:54 user nova-compute[75337]: DEBUG nova.objects.instance [None req-73cbd514-608c-496a-ad5c-daa537a95566 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Lazy-loading 'flavor' on Instance uuid 7fc86edc-e217-4c70-88f8-02f4618d7ae0 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 16:24:54 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-73cbd514-608c-496a-ad5c-daa537a95566 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Lock "7fc86edc-e217-4c70-88f8-02f4618d7ae0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:24:54 user nova-compute[75337]: DEBUG nova.network.neutron [req-762b6018-d0e1-4925-af4a-effa3b922158 req-d05eb266-efd9-43ff-8446-6eb3811dd70a service nova] [instance: 7fc86edc-e217-4c70-88f8-02f4618d7ae0] Updated VIF entry in instance network info cache for port f9a9cc4f-9e35-485e-988b-2fcfbd4ad748. {{(pid=75337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 16:24:54 user nova-compute[75337]: DEBUG nova.network.neutron [req-762b6018-d0e1-4925-af4a-effa3b922158 req-d05eb266-efd9-43ff-8446-6eb3811dd70a service nova] [instance: 7fc86edc-e217-4c70-88f8-02f4618d7ae0] Updating instance_info_cache with network_info: [{"id": "f9a9cc4f-9e35-485e-988b-2fcfbd4ad748", "address": "fa:16:3e:40:ad:75", "network": {"id": "0da0e0bd-b07e-4ae1-8625-a979ed32bd07", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-528047864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f71610b3d00f412ea4aeba8068d032fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9a9cc4f-9e", "ovs_interfaceid": "f9a9cc4f-9e35-485e-988b-2fcfbd4ad748", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 16:24:54 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-762b6018-d0e1-4925-af4a-effa3b922158 req-d05eb266-efd9-43ff-8446-6eb3811dd70a service nova] Releasing lock "refresh_cache-7fc86edc-e217-4c70-88f8-02f4618d7ae0" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 16:24:54 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-73cbd514-608c-496a-ad5c-daa537a95566 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Acquiring lock "7fc86edc-e217-4c70-88f8-02f4618d7ae0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:24:54 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-73cbd514-608c-496a-ad5c-daa537a95566 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Lock "7fc86edc-e217-4c70-88f8-02f4618d7ae0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:24:54 user nova-compute[75337]: INFO nova.compute.manager [None req-73cbd514-608c-496a-ad5c-daa537a95566 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] [instance: 7fc86edc-e217-4c70-88f8-02f4618d7ae0] Attaching volume 60b94dc8-dfa5-4b29-b453-9e5833d9c711 to /dev/vdb
Nov 06 16:24:54 user nova-compute[75337]: DEBUG os_brick.utils [None req-73cbd514-608c-496a-ad5c-daa537a95566 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 16:24:54 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:24:54 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:24:54 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a7912cb-63e6-480f-bc22-a898740dc1ae]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4ff6411e45b8\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:24:54 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:24:54 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:24:54 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b3c46cb-9a22-4c3d-9497-ed46413fdc92]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:24:54 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:24:54 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:24:54 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a31ed28-e06e-4a2d-bca9-9294f73a682c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:24:54 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[afe1affe-1426-4b56-acc7-b2ec14d73b48]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:24:54 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-73cbd514-608c-496a-ad5c-daa537a95566 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Running cmd (subprocess): nvme version {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:24:54 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-73cbd514-608c-496a-ad5c-daa537a95566 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] 'nvme version' failed. Not Retrying. {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 16:24:54 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.nvmeof [None req-73cbd514-608c-496a-ad5c-daa537a95566 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] nvme not present on system {{(pid=75337) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 16:24:54 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:24:54 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 16:24:54 user nova-compute[75337]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 16:24:54 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[319f0f37-32f3-4c96-bc0c-3a554a4fd160]: (4, '') {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:24:54 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.lightos [None req-73cbd514-608c-496a-ad5c-daa537a95566 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75337) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 16:24:54 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.lightos [None req-73cbd514-608c-496a-ad5c-daa537a95566 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 16:24:54 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.lightos [None req-73cbd514-608c-496a-ad5c-daa537a95566 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] LIGHTOS: no hostnqn found. {{(pid=75337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 16:24:54 user nova-compute[75337]: DEBUG os_brick.utils [None req-73cbd514-608c-496a-ad5c-daa537a95566 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4ff6411e45b8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 16:24:54 user nova-compute[75337]: DEBUG nova.virt.block_device [None req-73cbd514-608c-496a-ad5c-daa537a95566 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] [instance: 7fc86edc-e217-4c70-88f8-02f4618d7ae0] Updating existing volume attachment record: 3af2f421-65d1-46a3-a698-d3580d13a372 {{(pid=75337) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 16:24:55 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:24:55 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:24:56 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:24:56 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Cleaning up deleted instances {{(pid=75337) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 06 16:24:56 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] There are 0 instances to clean {{(pid=75337) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 06 16:25:00 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:25:00 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:25:05 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:25:05 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:25:08 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:25:10 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:25:10 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:25:15 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:25:15 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:25:15 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75337) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 16:25:15 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 16:25:15 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 16:25:15 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:25:20 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:25:24 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:25:25 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:25:25 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:25:25 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-73cbd514-608c-496a-ad5c-daa537a95566 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] [instance: 7fc86edc-e217-4c70-88f8-02f4618d7ae0] Calling os-brick to attach iSCSI Volume {{(pid=75337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 16:25:25 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-73cbd514-608c-496a-ad5c-daa537a95566 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2abc33d0c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:60b94dc8-dfa5-4b29-b453-9e5833d9c711', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xYOdLIwg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 16:25:25 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-73cbd514-608c-496a-ad5c-daa537a95566 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 16:25:25 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-73cbd514-608c-496a-ad5c-daa537a95566 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 16:25:25 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-73cbd514-608c-496a-ad5c-daa537a95566 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 16:25:25 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-73cbd514-608c-496a-ad5c-daa537a95566 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 16:25:25 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-73cbd514-608c-496a-ad5c-daa537a95566 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:60b94dc8-dfa5-4b29-b453-9e5833d9c711" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 16:25:25 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-73cbd514-608c-496a-ad5c-daa537a95566 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:60b94dc8-dfa5-4b29-b453-9e5833d9c711" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 16:25:25 user nova-compute[75337]: INFO os_brick.initiator.connectors.iscsi [None req-73cbd514-608c-496a-ad5c-daa537a95566 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 16:25:25 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60b94dc8-dfa5-4b29-b453-9e5833d9c711 -p 172.16.0.220:3260 {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:25:25 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60b94dc8-dfa5-4b29-b453-9e5833d9c711 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:25:25 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[de6cef92-1840-4669-8a5c-17f5f73c7c2e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:25:25 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-73cbd514-608c-496a-ad5c-daa537a95566 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 16:25:25 user nova-compute[75337]:  {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:25:25 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60b94dc8-dfa5-4b29-b453-9e5833d9c711 -p 172.16.0.220:3260 --interface default --op new {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:25:25 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60b94dc8-dfa5-4b29-b453-9e5833d9c711 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:25:25 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[40d6f64d-bab9-4036-84ae-5e1f67ad1f82]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:60b94dc8-dfa5-4b29-b453-9e5833d9c711] added\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:25:25 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-73cbd514-608c-496a-ad5c-daa537a95566 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:60b94dc8-dfa5-4b29-b453-9e5833d9c711] added
Nov 06 16:25:25 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:25:25 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60b94dc8-dfa5-4b29-b453-9e5833d9c711 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:25:25 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60b94dc8-dfa5-4b29-b453-9e5833d9c711 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:25:25 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[a795f49a-e96c-4a91-8a74-9b1c30d6a7a8]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:25:25 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-73cbd514-608c-496a-ad5c-daa537a95566 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:25:25 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60b94dc8-dfa5-4b29-b453-9e5833d9c711 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:25:25 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60b94dc8-dfa5-4b29-b453-9e5833d9c711 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:25:25 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[174e6926-a79e-4047-a27d-05bb65fa28e9]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:25:25 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-73cbd514-608c-496a-ad5c-daa537a95566 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:25:25 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60b94dc8-dfa5-4b29-b453-9e5833d9c711 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xYOdLIwg {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:25:25 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60b94dc8-dfa5-4b29-b453-9e5833d9c711 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xYOdLIwg" returned: 0 in 0.018s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:25:25 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c188078-d9d3-40b1-84cc-e00790132395]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:25:25 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-73cbd514-608c-496a-ad5c-daa537a95566 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xYOdLIwg'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:25:25 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60b94dc8-dfa5-4b29-b453-9e5833d9c711 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:25:25 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60b94dc8-dfa5-4b29-b453-9e5833d9c711 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:25:25 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[69eab856-7fcc-4247-830f-3179330daa94]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:25:25 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-73cbd514-608c-496a-ad5c-daa537a95566 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:25:25 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:25:25 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.020s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:25:25 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0cf6c81-b96c-4d8d-9414-9b68a1efc186]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:25:25 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-73cbd514-608c-496a-ad5c-daa537a95566 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 06 16:25:25 user nova-compute[75337]:  {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 16:25:25 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-73cbd514-608c-496a-ad5c-daa537a95566 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 06 16:25:25 user nova-compute[75337]:  {{(pid=75337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 16:25:25 user nova-compute[75337]: WARNING os_brick.initiator.connectors.iscsi [None req-73cbd514-608c-496a-ad5c-daa537a95566 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 06 16:25:25 user nova-compute[75337]: 
Nov 06 16:25:25 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60b94dc8-dfa5-4b29-b453-9e5833d9c711 -p 172.16.0.220:3260 --login {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:25:26 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60b94dc8-dfa5-4b29-b453-9e5833d9c711 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:25:26 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[90cfebb5-f04d-4fe4-b04d-5b3b8ab669e9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:60b94dc8-dfa5-4b29-b453-9e5833d9c711, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:60b94dc8-dfa5-4b29-b453-9e5833d9c711, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:25:26 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-73cbd514-608c-496a-ad5c-daa537a95566 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:60b94dc8-dfa5-4b29-b453-9e5833d9c711, portal: 172.16.0.220,3260]
Nov 06 16:25:26 user nova-compute[75337]: Login to [iface: default, target: iqn.2010-10.org.openstack:60b94dc8-dfa5-4b29-b453-9e5833d9c711, portal: 172.16.0.220,3260] successful.
Nov 06 16:25:26 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:25:26 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60b94dc8-dfa5-4b29-b453-9e5833d9c711 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:25:26 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60b94dc8-dfa5-4b29-b453-9e5833d9c711 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:25:26 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f4b21d1-cda2-4bce-a827-f7b3e09188ed]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:25:26 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-73cbd514-608c-496a-ad5c-daa537a95566 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:25:26 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:25:26 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:25:26 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[d637f92d-bb5e-40ab-ab81-a1d8f47212a0]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b94dc8-dfa5-4b29-b453-9e5833d9c711 (non-flash)\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:25:26 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-73cbd514-608c-496a-ad5c-daa537a95566 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b94dc8-dfa5-4b29-b453-9e5833d9c711 (non-flash)
Nov 06 16:25:26 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 16:25:26 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-73cbd514-608c-496a-ad5c-daa537a95566 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b94dc8-dfa5-4b29-b453-9e5833d9c711 (non-flash)
Nov 06 16:25:26 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 16:25:26 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-73cbd514-608c-496a-ad5c-daa537a95566 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:60b94dc8-dfa5-4b29-b453-9e5833d9c711" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.266s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 16:25:26 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-73cbd514-608c-496a-ad5c-daa537a95566 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Connected to 172.16.0.220:3260 {{(pid=75337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 16:25:26 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-73cbd514-608c-496a-ad5c-daa537a95566 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] HCTL ('33', '-', '-', 0) found on session 60 with lun 0 {{(pid=75337) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 16:25:26 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-73cbd514-608c-496a-ad5c-daa537a95566 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75337) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 16:25:26 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:25:26 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:25:26 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9abba77-9959-49d2-84fe-a6a0489924bf]: (4, ('- - 0', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:25:26 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-73cbd514-608c-496a-ad5c-daa537a95566 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Searching for a device in session 60 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75337) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 16:25:26 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-73cbd514-608c-496a-ad5c-daa537a95566 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:60b94dc8-dfa5-4b29-b453-9e5833d9c711', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xYOdLIwg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 16:25:27 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-73cbd514-608c-496a-ad5c-daa537a95566 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.294s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 16:25:27 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-73cbd514-608c-496a-ad5c-daa537a95566 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] <== connect_volume: return (1296ms) {'type': 'block', 'scsi_wwn': '26232323034333536', 'path': '/dev/sdb'} {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 16:25:27 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-73cbd514-608c-496a-ad5c-daa537a95566 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] [instance: 7fc86edc-e217-4c70-88f8-02f4618d7ae0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26232323034333536', 'path': '/dev/sdb'} {{(pid=75337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 16:25:27 user nova-compute[75337]: DEBUG nova.objects.instance [None req-73cbd514-608c-496a-ad5c-daa537a95566 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Lazy-loading 'flavor' on Instance uuid 7fc86edc-e217-4c70-88f8-02f4618d7ae0 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 16:25:27 user nova-compute[75337]: DEBUG nova.virt.libvirt.guest [None req-73cbd514-608c-496a-ad5c-daa537a95566 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] attach device xml: <disk type="block" device="disk">
Nov 06 16:25:27 user nova-compute[75337]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 16:25:27 user nova-compute[75337]:   <source dev="/dev/sdb"/>
Nov 06 16:25:27 user nova-compute[75337]:   <target dev="vdb" bus="virtio"/>
Nov 06 16:25:27 user nova-compute[75337]:   <serial>60b94dc8-dfa5-4b29-b453-9e5833d9c711</serial>
Nov 06 16:25:27 user nova-compute[75337]: </disk>
Nov 06 16:25:27 user nova-compute[75337]:  {{(pid=75337) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 06 16:25:27 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-73cbd514-608c-496a-ad5c-daa537a95566 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] No BDM found with device name vda, not building metadata. {{(pid=75337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 16:25:27 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-73cbd514-608c-496a-ad5c-daa537a95566 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 16:25:27 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-73cbd514-608c-496a-ad5c-daa537a95566 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] No VIF found with MAC fa:16:3e:40:ad:75, not building metadata {{(pid=75337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 16:25:27 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-73cbd514-608c-496a-ad5c-daa537a95566 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Lock "7fc86edc-e217-4c70-88f8-02f4618d7ae0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 32.954s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:25:28 user nova-compute[75337]: INFO nova.compute.manager [None req-f9ef10d8-e674-4796-b100-6ac63e1410a9 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] [instance: 7fc86edc-e217-4c70-88f8-02f4618d7ae0] Rescuing
Nov 06 16:25:28 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-f9ef10d8-e674-4796-b100-6ac63e1410a9 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Acquiring lock "refresh_cache-7fc86edc-e217-4c70-88f8-02f4618d7ae0" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 16:25:28 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-f9ef10d8-e674-4796-b100-6ac63e1410a9 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Acquired lock "refresh_cache-7fc86edc-e217-4c70-88f8-02f4618d7ae0" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 16:25:28 user nova-compute[75337]: DEBUG nova.network.neutron [None req-f9ef10d8-e674-4796-b100-6ac63e1410a9 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] [instance: 7fc86edc-e217-4c70-88f8-02f4618d7ae0] Building network info cache for instance {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 16:25:28 user nova-compute[75337]: DEBUG nova.network.neutron [None req-f9ef10d8-e674-4796-b100-6ac63e1410a9 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] [instance: 7fc86edc-e217-4c70-88f8-02f4618d7ae0] Updating instance_info_cache with network_info: [{"id": "f9a9cc4f-9e35-485e-988b-2fcfbd4ad748", "address": "fa:16:3e:40:ad:75", "network": {"id": "0da0e0bd-b07e-4ae1-8625-a979ed32bd07", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-528047864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f71610b3d00f412ea4aeba8068d032fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9a9cc4f-9e", "ovs_interfaceid": "f9a9cc4f-9e35-485e-988b-2fcfbd4ad748", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 16:25:28 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-f9ef10d8-e674-4796-b100-6ac63e1410a9 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Releasing lock "refresh_cache-7fc86edc-e217-4c70-88f8-02f4618d7ae0" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 16:25:28 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:25:28 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:25:28 user nova-compute[75337]: DEBUG nova.compute.manager [req-6f2b855f-963b-4528-a4af-001aa514d4d8 req-b300ee19-3bda-4339-b318-ca25bd742ab3 service nova] [instance: 7fc86edc-e217-4c70-88f8-02f4618d7ae0] Received event network-vif-unplugged-f9a9cc4f-9e35-485e-988b-2fcfbd4ad748 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:25:28 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-6f2b855f-963b-4528-a4af-001aa514d4d8 req-b300ee19-3bda-4339-b318-ca25bd742ab3 service nova] Acquiring lock "7fc86edc-e217-4c70-88f8-02f4618d7ae0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:25:28 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-6f2b855f-963b-4528-a4af-001aa514d4d8 req-b300ee19-3bda-4339-b318-ca25bd742ab3 service nova] Lock "7fc86edc-e217-4c70-88f8-02f4618d7ae0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:25:28 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-6f2b855f-963b-4528-a4af-001aa514d4d8 req-b300ee19-3bda-4339-b318-ca25bd742ab3 service nova] Lock "7fc86edc-e217-4c70-88f8-02f4618d7ae0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:25:28 user nova-compute[75337]: DEBUG nova.compute.manager [req-6f2b855f-963b-4528-a4af-001aa514d4d8 req-b300ee19-3bda-4339-b318-ca25bd742ab3 service nova] [instance: 7fc86edc-e217-4c70-88f8-02f4618d7ae0] No waiting events found dispatching network-vif-unplugged-f9a9cc4f-9e35-485e-988b-2fcfbd4ad748 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 16:25:28 user nova-compute[75337]: WARNING nova.compute.manager [req-6f2b855f-963b-4528-a4af-001aa514d4d8 req-b300ee19-3bda-4339-b318-ca25bd742ab3 service nova] [instance: 7fc86edc-e217-4c70-88f8-02f4618d7ae0] Received unexpected event network-vif-unplugged-f9a9cc4f-9e35-485e-988b-2fcfbd4ad748 for instance with vm_state active and task_state rescuing.
Nov 06 16:25:28 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:25:28 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:25:29 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:25:29 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:25:29 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:25:29 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:25:29 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:25:29 user nova-compute[75337]: INFO nova.virt.libvirt.driver [-] [instance: 7fc86edc-e217-4c70-88f8-02f4618d7ae0] Instance destroyed successfully.
Nov 06 16:25:29 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-f9ef10d8-e674-4796-b100-6ac63e1410a9 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] [instance: 7fc86edc-e217-4c70-88f8-02f4618d7ae0] Attempting rescue
Nov 06 16:25:29 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-f9ef10d8-e674-4796-b100-6ac63e1410a9 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75337) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 06 16:25:29 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-f9ef10d8-e674-4796-b100-6ac63e1410a9 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] [instance: 7fc86edc-e217-4c70-88f8-02f4618d7ae0] Instance directory exists: not creating {{(pid=75337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 06 16:25:29 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-f9ef10d8-e674-4796-b100-6ac63e1410a9 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] [instance: 7fc86edc-e217-4c70-88f8-02f4618d7ae0] Creating image(s)
Nov 06 16:25:29 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-f9ef10d8-e674-4796-b100-6ac63e1410a9 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Acquiring lock "/opt/stack/data/nova/instances/7fc86edc-e217-4c70-88f8-02f4618d7ae0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:25:29 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-f9ef10d8-e674-4796-b100-6ac63e1410a9 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Lock "/opt/stack/data/nova/instances/7fc86edc-e217-4c70-88f8-02f4618d7ae0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:25:29 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-f9ef10d8-e674-4796-b100-6ac63e1410a9 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Lock "/opt/stack/data/nova/instances/7fc86edc-e217-4c70-88f8-02f4618d7ae0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.011s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:25:29 user nova-compute[75337]: DEBUG nova.objects.instance [None req-f9ef10d8-e674-4796-b100-6ac63e1410a9 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Lazy-loading 'trusted_certs' on Instance uuid 7fc86edc-e217-4c70-88f8-02f4618d7ae0 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 16:25:29 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-f9ef10d8-e674-4796-b100-6ac63e1410a9 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Acquiring lock "06ba3c914798499e686c5ac75886932347225275" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:25:29 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-f9ef10d8-e674-4796-b100-6ac63e1410a9 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Lock "06ba3c914798499e686c5ac75886932347225275" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:25:29 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-f9ef10d8-e674-4796-b100-6ac63e1410a9 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:25:29 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:25:29 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:25:29 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-f9ef10d8-e674-4796-b100-6ac63e1410a9 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json" returned: 0 in 0.178s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:25:29 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-f9ef10d8-e674-4796-b100-6ac63e1410a9 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275,backing_fmt=raw /opt/stack/data/nova/instances/7fc86edc-e217-4c70-88f8-02f4618d7ae0/disk.rescue {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:25:29 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-f9ef10d8-e674-4796-b100-6ac63e1410a9 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275,backing_fmt=raw /opt/stack/data/nova/instances/7fc86edc-e217-4c70-88f8-02f4618d7ae0/disk.rescue" returned: 0 in 0.048s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:25:29 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-f9ef10d8-e674-4796-b100-6ac63e1410a9 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Lock "06ba3c914798499e686c5ac75886932347225275" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:25:29 user nova-compute[75337]: DEBUG nova.objects.instance [None req-f9ef10d8-e674-4796-b100-6ac63e1410a9 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Lazy-loading 'migration_context' on Instance uuid 7fc86edc-e217-4c70-88f8-02f4618d7ae0 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 16:25:29 user nova-compute[75337]: DEBUG nova.objects.base [None req-f9ef10d8-e674-4796-b100-6ac63e1410a9 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Object Instance<7fc86edc-e217-4c70-88f8-02f4618d7ae0> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75337) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 16:25:29 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-f9ef10d8-e674-4796-b100-6ac63e1410a9 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] [instance: 7fc86edc-e217-4c70-88f8-02f4618d7ae0] Created local disks {{(pid=75337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 16:25:29 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-f9ef10d8-e674-4796-b100-6ac63e1410a9 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] [instance: 7fc86edc-e217-4c70-88f8-02f4618d7ae0] Start _get_guest_xml network_info=[{"id": "f9a9cc4f-9e35-485e-988b-2fcfbd4ad748", "address": "fa:16:3e:40:ad:75", "network": {"id": "0da0e0bd-b07e-4ae1-8625-a979ed32bd07", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-528047864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-528047864-network", "vif_mac": "fa:16:3e:40:ad:75"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f71610b3d00f412ea4aeba8068d032fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9a9cc4f-9e", "ovs_interfaceid": "f9a9cc4f-9e35-485e-988b-2fcfbd4ad748", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T15:34:14Z,direct_url=<?>,disk_format='qcow2',id=16b903ae-a40f-41a7-985b-4804cce92c62,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6549a15819f1469bbd5eeae8190e3d44',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T15:34:15Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '16b903ae-a40f-41a7-985b-4804cce92c62', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 16:25:29 user nova-compute[75337]: DEBUG nova.objects.instance [None req-f9ef10d8-e674-4796-b100-6ac63e1410a9 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Lazy-loading 'resources' on Instance uuid 7fc86edc-e217-4c70-88f8-02f4618d7ae0 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 16:25:29 user nova-compute[75337]: DEBUG nova.objects.base [None req-f9ef10d8-e674-4796-b100-6ac63e1410a9 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Object Instance<7fc86edc-e217-4c70-88f8-02f4618d7ae0> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75337) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 16:25:29 user nova-compute[75337]: DEBUG nova.objects.instance [None req-f9ef10d8-e674-4796-b100-6ac63e1410a9 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Lazy-loading 'numa_topology' on Instance uuid 7fc86edc-e217-4c70-88f8-02f4618d7ae0 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 16:25:29 user nova-compute[75337]: DEBUG nova.objects.base [None req-f9ef10d8-e674-4796-b100-6ac63e1410a9 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Object Instance<7fc86edc-e217-4c70-88f8-02f4618d7ae0> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75337) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 16:25:29 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-f9ef10d8-e674-4796-b100-6ac63e1410a9 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 16:25:29 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-f9ef10d8-e674-4796-b100-6ac63e1410a9 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 16:25:29 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-f9ef10d8-e674-4796-b100-6ac63e1410a9 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 16:25:29 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-f9ef10d8-e674-4796-b100-6ac63e1410a9 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] CPU controller missing on host. {{(pid=75337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 16:25:29 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-f9ef10d8-e674-4796-b100-6ac63e1410a9 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 16:25:29 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-f9ef10d8-e674-4796-b100-6ac63e1410a9 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] CPU controller found on host. {{(pid=75337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 16:25:29 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-f9ef10d8-e674-4796-b100-6ac63e1410a9 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75337) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 16:25:29 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-f9ef10d8-e674-4796-b100-6ac63e1410a9 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T15:34:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T15:34:14Z,direct_url=<?>,disk_format='qcow2',id=16b903ae-a40f-41a7-985b-4804cce92c62,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6549a15819f1469bbd5eeae8190e3d44',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T15:34:15Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 16:25:29 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-f9ef10d8-e674-4796-b100-6ac63e1410a9 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Flavor limits 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 16:25:29 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-f9ef10d8-e674-4796-b100-6ac63e1410a9 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Image limits 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 16:25:29 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-f9ef10d8-e674-4796-b100-6ac63e1410a9 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Flavor pref 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 16:25:29 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-f9ef10d8-e674-4796-b100-6ac63e1410a9 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Image pref 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 16:25:29 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-f9ef10d8-e674-4796-b100-6ac63e1410a9 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 16:25:29 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-f9ef10d8-e674-4796-b100-6ac63e1410a9 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 16:25:29 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-f9ef10d8-e674-4796-b100-6ac63e1410a9 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 16:25:29 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-f9ef10d8-e674-4796-b100-6ac63e1410a9 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Got 1 possible topologies {{(pid=75337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 16:25:29 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-f9ef10d8-e674-4796-b100-6ac63e1410a9 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 16:25:29 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-f9ef10d8-e674-4796-b100-6ac63e1410a9 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 16:25:29 user nova-compute[75337]: DEBUG nova.objects.instance [None req-f9ef10d8-e674-4796-b100-6ac63e1410a9 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Lazy-loading 'vcpu_model' on Instance uuid 7fc86edc-e217-4c70-88f8-02f4618d7ae0 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 16:25:29 user nova-compute[75337]: DEBUG nova.objects.base [None req-f9ef10d8-e674-4796-b100-6ac63e1410a9 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Object Instance<7fc86edc-e217-4c70-88f8-02f4618d7ae0> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75337) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 16:25:29 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-f9ef10d8-e674-4796-b100-6ac63e1410a9 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T16:23:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-567659544',display_name='tempest-ServerRescueNegativeTestJSON-server-567659544',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-567659544',id=51,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKCnwS9V2datn/d83z1Ldzc4r6vlQ1N+FoURVDDxeb+oh6NM9SfP5Ne+mUOvSzwFBDwZ2iQPrPcxMtYEj6Zhw1KRsLXtveytGBAgQSJy5Blq0NiUK/k8xSRWkrZB/atZ2Q==',key_name='tempest-keypair-630615777',keypairs=<?>,launch_index=0,launched_at=2023-11-06T16:23:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f71610b3d00f412ea4aeba8068d032fc',ramdisk_id='',reservation_id='r-vht4ttph',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1763914139',owner_user_name='tempest-ServerRescueNegativeTestJSON-1763914139-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T16:23:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='22979798bd154fd3af622e408520e95c',uuid=7fc86edc-e217-4c70-88f8-02f4618d7ae0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f9a9cc4f-9e35-485e-988b-2fcfbd4ad748", "address": "fa:16:3e:40:ad:75", "network": {"id": "0da0e0bd-b07e-4ae1-8625-a979ed32bd07", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-528047864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-528047864-network", "vif_mac": "fa:16:3e:40:ad:75"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f71610b3d00f412ea4aeba8068d032fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9a9cc4f-9e", "ovs_interfaceid": "f9a9cc4f-9e35-485e-988b-2fcfbd4ad748", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75337) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 16:25:29 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-f9ef10d8-e674-4796-b100-6ac63e1410a9 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Converting VIF {"id": "f9a9cc4f-9e35-485e-988b-2fcfbd4ad748", "address": "fa:16:3e:40:ad:75", "network": {"id": "0da0e0bd-b07e-4ae1-8625-a979ed32bd07", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-528047864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-528047864-network", "vif_mac": "fa:16:3e:40:ad:75"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f71610b3d00f412ea4aeba8068d032fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9a9cc4f-9e", "ovs_interfaceid": "f9a9cc4f-9e35-485e-988b-2fcfbd4ad748", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 16:25:29 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-f9ef10d8-e674-4796-b100-6ac63e1410a9 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:40:ad:75,bridge_name='br-int',has_traffic_filtering=True,id=f9a9cc4f-9e35-485e-988b-2fcfbd4ad748,network=Network(0da0e0bd-b07e-4ae1-8625-a979ed32bd07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9a9cc4f-9e') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 16:25:29 user nova-compute[75337]: DEBUG nova.objects.instance [None req-f9ef10d8-e674-4796-b100-6ac63e1410a9 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Lazy-loading 'pci_devices' on Instance uuid 7fc86edc-e217-4c70-88f8-02f4618d7ae0 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 16:25:29 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:25:29 user nova-compute[75337]: DEBUG nova.objects.base [None req-f9ef10d8-e674-4796-b100-6ac63e1410a9 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Object Instance<7fc86edc-e217-4c70-88f8-02f4618d7ae0> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75337) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 16:25:29 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-f9ef10d8-e674-4796-b100-6ac63e1410a9 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] [instance: 7fc86edc-e217-4c70-88f8-02f4618d7ae0] End _get_guest_xml xml=<domain type="kvm">
Nov 06 16:25:29 user nova-compute[75337]:   <uuid>7fc86edc-e217-4c70-88f8-02f4618d7ae0</uuid>
Nov 06 16:25:29 user nova-compute[75337]:   <name>instance-00000033</name>
Nov 06 16:25:29 user nova-compute[75337]:   <memory>524288</memory>
Nov 06 16:25:29 user nova-compute[75337]:   <vcpu>1</vcpu>
Nov 06 16:25:29 user nova-compute[75337]:   <metadata>
Nov 06 16:25:29 user nova-compute[75337]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 16:25:29 user nova-compute[75337]:       <nova:package version="0.0.0"/>
Nov 06 16:25:29 user nova-compute[75337]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-567659544</nova:name>
Nov 06 16:25:29 user nova-compute[75337]:       <nova:creationTime>2023-11-06 16:25:29</nova:creationTime>
Nov 06 16:25:29 user nova-compute[75337]:       <nova:flavor name="m1.tiny">
Nov 06 16:25:29 user nova-compute[75337]:         <nova:memory>512</nova:memory>
Nov 06 16:25:29 user nova-compute[75337]:         <nova:disk>1</nova:disk>
Nov 06 16:25:29 user nova-compute[75337]:         <nova:swap>0</nova:swap>
Nov 06 16:25:29 user nova-compute[75337]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 16:25:29 user nova-compute[75337]:         <nova:vcpus>1</nova:vcpus>
Nov 06 16:25:29 user nova-compute[75337]:       </nova:flavor>
Nov 06 16:25:29 user nova-compute[75337]:       <nova:owner>
Nov 06 16:25:29 user nova-compute[75337]:         <nova:user uuid="22979798bd154fd3af622e408520e95c">tempest-ServerRescueNegativeTestJSON-1763914139-project-member</nova:user>
Nov 06 16:25:29 user nova-compute[75337]:         <nova:project uuid="f71610b3d00f412ea4aeba8068d032fc">tempest-ServerRescueNegativeTestJSON-1763914139</nova:project>
Nov 06 16:25:29 user nova-compute[75337]:       </nova:owner>
Nov 06 16:25:29 user nova-compute[75337]:       <nova:root type="image" uuid="16b903ae-a40f-41a7-985b-4804cce92c62"/>
Nov 06 16:25:29 user nova-compute[75337]:       <nova:ports>
Nov 06 16:25:29 user nova-compute[75337]:         <nova:port uuid="f9a9cc4f-9e35-485e-988b-2fcfbd4ad748">
Nov 06 16:25:29 user nova-compute[75337]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 06 16:25:29 user nova-compute[75337]:         </nova:port>
Nov 06 16:25:29 user nova-compute[75337]:       </nova:ports>
Nov 06 16:25:29 user nova-compute[75337]:     </nova:instance>
Nov 06 16:25:29 user nova-compute[75337]:   </metadata>
Nov 06 16:25:29 user nova-compute[75337]:   <sysinfo type="smbios">
Nov 06 16:25:29 user nova-compute[75337]:     <system>
Nov 06 16:25:29 user nova-compute[75337]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 16:25:29 user nova-compute[75337]:       <entry name="product">OpenStack Nova</entry>
Nov 06 16:25:29 user nova-compute[75337]:       <entry name="version">0.0.0</entry>
Nov 06 16:25:29 user nova-compute[75337]:       <entry name="serial">7fc86edc-e217-4c70-88f8-02f4618d7ae0</entry>
Nov 06 16:25:29 user nova-compute[75337]:       <entry name="uuid">7fc86edc-e217-4c70-88f8-02f4618d7ae0</entry>
Nov 06 16:25:29 user nova-compute[75337]:       <entry name="family">Virtual Machine</entry>
Nov 06 16:25:29 user nova-compute[75337]:     </system>
Nov 06 16:25:29 user nova-compute[75337]:   </sysinfo>
Nov 06 16:25:29 user nova-compute[75337]:   <os>
Nov 06 16:25:29 user nova-compute[75337]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 16:25:29 user nova-compute[75337]:     <smbios mode="sysinfo"/>
Nov 06 16:25:29 user nova-compute[75337]:   </os>
Nov 06 16:25:29 user nova-compute[75337]:   <features>
Nov 06 16:25:29 user nova-compute[75337]:     <acpi/>
Nov 06 16:25:29 user nova-compute[75337]:     <apic/>
Nov 06 16:25:29 user nova-compute[75337]:     <vmcoreinfo/>
Nov 06 16:25:29 user nova-compute[75337]:   </features>
Nov 06 16:25:29 user nova-compute[75337]:   <clock offset="utc">
Nov 06 16:25:29 user nova-compute[75337]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 16:25:29 user nova-compute[75337]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 16:25:29 user nova-compute[75337]:     <timer name="hpet" present="no"/>
Nov 06 16:25:29 user nova-compute[75337]:   </clock>
Nov 06 16:25:29 user nova-compute[75337]:   <cpu mode="custom" match="exact">
Nov 06 16:25:29 user nova-compute[75337]:     <model>Nehalem</model>
Nov 06 16:25:29 user nova-compute[75337]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 16:25:29 user nova-compute[75337]:   </cpu>
Nov 06 16:25:29 user nova-compute[75337]:   <devices>
Nov 06 16:25:29 user nova-compute[75337]:     <disk type="file" device="disk">
Nov 06 16:25:29 user nova-compute[75337]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 16:25:29 user nova-compute[75337]:       <source file="/opt/stack/data/nova/instances/7fc86edc-e217-4c70-88f8-02f4618d7ae0/disk.rescue"/>
Nov 06 16:25:29 user nova-compute[75337]:       <target dev="vda" bus="virtio"/>
Nov 06 16:25:29 user nova-compute[75337]:     </disk>
Nov 06 16:25:29 user nova-compute[75337]:     <disk type="file" device="disk">
Nov 06 16:25:29 user nova-compute[75337]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 16:25:29 user nova-compute[75337]:       <source file="/opt/stack/data/nova/instances/7fc86edc-e217-4c70-88f8-02f4618d7ae0/disk"/>
Nov 06 16:25:29 user nova-compute[75337]:       <target dev="vdb" bus="virtio"/>
Nov 06 16:25:29 user nova-compute[75337]:     </disk>
Nov 06 16:25:29 user nova-compute[75337]:     <interface type="ethernet">
Nov 06 16:25:29 user nova-compute[75337]:       <mac address="fa:16:3e:40:ad:75"/>
Nov 06 16:25:29 user nova-compute[75337]:       <model type="virtio"/>
Nov 06 16:25:29 user nova-compute[75337]:       <mtu size="1442"/>
Nov 06 16:25:29 user nova-compute[75337]:       <target dev="tapf9a9cc4f-9e"/>
Nov 06 16:25:29 user nova-compute[75337]:     </interface>
Nov 06 16:25:29 user nova-compute[75337]:     <serial type="pty">
Nov 06 16:25:29 user nova-compute[75337]:       <log file="/opt/stack/data/nova/instances/7fc86edc-e217-4c70-88f8-02f4618d7ae0/console.log" append="off"/>
Nov 06 16:25:29 user nova-compute[75337]:     </serial>
Nov 06 16:25:29 user nova-compute[75337]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 16:25:29 user nova-compute[75337]:     <video>
Nov 06 16:25:29 user nova-compute[75337]:       <model type="virtio"/>
Nov 06 16:25:29 user nova-compute[75337]:     </video>
Nov 06 16:25:29 user nova-compute[75337]:     <rng model="virtio">
Nov 06 16:25:29 user nova-compute[75337]:       <backend model="random">/dev/urandom</backend>
Nov 06 16:25:29 user nova-compute[75337]:     </rng>
Nov 06 16:25:29 user nova-compute[75337]:     <controller type="usb" index="0" model="none"/>
Nov 06 16:25:29 user nova-compute[75337]:     <memballoon model="virtio">
Nov 06 16:25:29 user nova-compute[75337]:       <stats period="10"/>
Nov 06 16:25:29 user nova-compute[75337]:     </memballoon>
Nov 06 16:25:29 user nova-compute[75337]:   </devices>
Nov 06 16:25:29 user nova-compute[75337]: </domain>
Nov 06 16:25:29 user nova-compute[75337]:  {{(pid=75337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 16:25:29 user nova-compute[75337]: INFO nova.virt.libvirt.driver [-] [instance: 7fc86edc-e217-4c70-88f8-02f4618d7ae0] Instance destroyed successfully.
Nov 06 16:25:29 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-f9ef10d8-e674-4796-b100-6ac63e1410a9 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] No BDM found with device name vda, not building metadata. {{(pid=75337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 16:25:29 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-f9ef10d8-e674-4796-b100-6ac63e1410a9 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 16:25:29 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-f9ef10d8-e674-4796-b100-6ac63e1410a9 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] No VIF found with MAC fa:16:3e:40:ad:75, not building metadata {{(pid=75337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 16:25:30 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:25:30 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:25:30 user nova-compute[75337]: DEBUG nova.compute.manager [req-6aed2619-2956-4c2c-9b2b-fc0db5ef8a68 req-2e7753f5-adbb-4d08-a8ee-07516742f07f service nova] [instance: 7fc86edc-e217-4c70-88f8-02f4618d7ae0] Received event network-vif-plugged-f9a9cc4f-9e35-485e-988b-2fcfbd4ad748 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:25:30 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-6aed2619-2956-4c2c-9b2b-fc0db5ef8a68 req-2e7753f5-adbb-4d08-a8ee-07516742f07f service nova] Acquiring lock "7fc86edc-e217-4c70-88f8-02f4618d7ae0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:25:30 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-6aed2619-2956-4c2c-9b2b-fc0db5ef8a68 req-2e7753f5-adbb-4d08-a8ee-07516742f07f service nova] Lock "7fc86edc-e217-4c70-88f8-02f4618d7ae0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:25:30 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-6aed2619-2956-4c2c-9b2b-fc0db5ef8a68 req-2e7753f5-adbb-4d08-a8ee-07516742f07f service nova] Lock "7fc86edc-e217-4c70-88f8-02f4618d7ae0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:25:30 user nova-compute[75337]: DEBUG nova.compute.manager [req-6aed2619-2956-4c2c-9b2b-fc0db5ef8a68 req-2e7753f5-adbb-4d08-a8ee-07516742f07f service nova] [instance: 7fc86edc-e217-4c70-88f8-02f4618d7ae0] No waiting events found dispatching network-vif-plugged-f9a9cc4f-9e35-485e-988b-2fcfbd4ad748 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 16:25:30 user nova-compute[75337]: WARNING nova.compute.manager [req-6aed2619-2956-4c2c-9b2b-fc0db5ef8a68 req-2e7753f5-adbb-4d08-a8ee-07516742f07f service nova] [instance: 7fc86edc-e217-4c70-88f8-02f4618d7ae0] Received unexpected event network-vif-plugged-f9a9cc4f-9e35-485e-988b-2fcfbd4ad748 for instance with vm_state active and task_state rescuing.
Nov 06 16:25:31 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:25:31 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:25:31 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:25:31 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:25:31 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:25:32 user nova-compute[75337]: DEBUG nova.compute.manager [req-e36cd8a9-8175-4dfa-bd41-bd278d76e52a req-0732fdd8-1ec7-41df-a13f-f13b290e6a2d service nova] [instance: 7fc86edc-e217-4c70-88f8-02f4618d7ae0] Received event network-vif-plugged-f9a9cc4f-9e35-485e-988b-2fcfbd4ad748 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:25:32 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-e36cd8a9-8175-4dfa-bd41-bd278d76e52a req-0732fdd8-1ec7-41df-a13f-f13b290e6a2d service nova] Acquiring lock "7fc86edc-e217-4c70-88f8-02f4618d7ae0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:25:32 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-e36cd8a9-8175-4dfa-bd41-bd278d76e52a req-0732fdd8-1ec7-41df-a13f-f13b290e6a2d service nova] Lock "7fc86edc-e217-4c70-88f8-02f4618d7ae0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:25:32 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-e36cd8a9-8175-4dfa-bd41-bd278d76e52a req-0732fdd8-1ec7-41df-a13f-f13b290e6a2d service nova] Lock "7fc86edc-e217-4c70-88f8-02f4618d7ae0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:25:32 user nova-compute[75337]: DEBUG nova.compute.manager [req-e36cd8a9-8175-4dfa-bd41-bd278d76e52a req-0732fdd8-1ec7-41df-a13f-f13b290e6a2d service nova] [instance: 7fc86edc-e217-4c70-88f8-02f4618d7ae0] No waiting events found dispatching network-vif-plugged-f9a9cc4f-9e35-485e-988b-2fcfbd4ad748 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 16:25:32 user nova-compute[75337]: WARNING nova.compute.manager [req-e36cd8a9-8175-4dfa-bd41-bd278d76e52a req-0732fdd8-1ec7-41df-a13f-f13b290e6a2d service nova] [instance: 7fc86edc-e217-4c70-88f8-02f4618d7ae0] Received unexpected event network-vif-plugged-f9a9cc4f-9e35-485e-988b-2fcfbd4ad748 for instance with vm_state active and task_state rescuing.
Nov 06 16:25:32 user nova-compute[75337]: DEBUG nova.compute.manager [req-e36cd8a9-8175-4dfa-bd41-bd278d76e52a req-0732fdd8-1ec7-41df-a13f-f13b290e6a2d service nova] [instance: 7fc86edc-e217-4c70-88f8-02f4618d7ae0] Received event network-vif-plugged-f9a9cc4f-9e35-485e-988b-2fcfbd4ad748 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:25:32 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-e36cd8a9-8175-4dfa-bd41-bd278d76e52a req-0732fdd8-1ec7-41df-a13f-f13b290e6a2d service nova] Acquiring lock "7fc86edc-e217-4c70-88f8-02f4618d7ae0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:25:32 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-e36cd8a9-8175-4dfa-bd41-bd278d76e52a req-0732fdd8-1ec7-41df-a13f-f13b290e6a2d service nova] Lock "7fc86edc-e217-4c70-88f8-02f4618d7ae0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:25:32 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-e36cd8a9-8175-4dfa-bd41-bd278d76e52a req-0732fdd8-1ec7-41df-a13f-f13b290e6a2d service nova] Lock "7fc86edc-e217-4c70-88f8-02f4618d7ae0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:25:32 user nova-compute[75337]: DEBUG nova.compute.manager [req-e36cd8a9-8175-4dfa-bd41-bd278d76e52a req-0732fdd8-1ec7-41df-a13f-f13b290e6a2d service nova] [instance: 7fc86edc-e217-4c70-88f8-02f4618d7ae0] No waiting events found dispatching network-vif-plugged-f9a9cc4f-9e35-485e-988b-2fcfbd4ad748 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 16:25:32 user nova-compute[75337]: WARNING nova.compute.manager [req-e36cd8a9-8175-4dfa-bd41-bd278d76e52a req-0732fdd8-1ec7-41df-a13f-f13b290e6a2d service nova] [instance: 7fc86edc-e217-4c70-88f8-02f4618d7ae0] Received unexpected event network-vif-plugged-f9a9cc4f-9e35-485e-988b-2fcfbd4ad748 for instance with vm_state active and task_state rescuing.
Nov 06 16:25:33 user nova-compute[75337]: DEBUG nova.compute.manager [None req-f9ef10d8-e674-4796-b100-6ac63e1410a9 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] [instance: 7fc86edc-e217-4c70-88f8-02f4618d7ae0] Checking state {{(pid=75337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 16:25:34 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:25:34 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75337) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 16:25:35 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:25:35 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:25:36 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:25:37 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:25:37 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:25:38 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:25:40 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:25:40 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:25:40 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75337) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 16:25:40 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 16:25:40 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 16:25:40 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:25:45 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:25:46 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:25:46 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Starting heal instance info cache {{(pid=75337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 16:25:46 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "refresh_cache-de77f786-1ecf-4eac-ae4a-c4f6b1d47339" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 16:25:46 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquired lock "refresh_cache-de77f786-1ecf-4eac-ae4a-c4f6b1d47339" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 16:25:46 user nova-compute[75337]: DEBUG nova.network.neutron [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] [instance: de77f786-1ecf-4eac-ae4a-c4f6b1d47339] Forcefully refreshing network info cache for instance {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 16:25:47 user nova-compute[75337]: DEBUG nova.network.neutron [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] [instance: de77f786-1ecf-4eac-ae4a-c4f6b1d47339] Updating instance_info_cache with network_info: [{"id": "8f33a5c0-50e1-4bac-a686-733daf33a307", "address": "fa:16:3e:4b:fc:cf", "network": {"id": "0da0e0bd-b07e-4ae1-8625-a979ed32bd07", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-528047864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f71610b3d00f412ea4aeba8068d032fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f33a5c0-50", "ovs_interfaceid": "8f33a5c0-50e1-4bac-a686-733daf33a307", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 16:25:47 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Releasing lock "refresh_cache-de77f786-1ecf-4eac-ae4a-c4f6b1d47339" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 16:25:47 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] [instance: de77f786-1ecf-4eac-ae4a-c4f6b1d47339] Updated the network info_cache for instance {{(pid=75337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 16:25:49 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager.update_available_resource {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:25:49 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:25:49 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:25:49 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:25:49 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Auditing locally available compute resources for user (node: user) {{(pid=75337) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 16:25:49 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fc86edc-e217-4c70-88f8-02f4618d7ae0/disk.rescue --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:25:49 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fc86edc-e217-4c70-88f8-02f4618d7ae0/disk.rescue --force-share --output=json" returned: 0 in 0.196s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:25:49 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fc86edc-e217-4c70-88f8-02f4618d7ae0/disk.rescue --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:25:50 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fc86edc-e217-4c70-88f8-02f4618d7ae0/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:25:50 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] skipping disk /opt/stack/data/nova/instances/7fc86edc-e217-4c70-88f8-02f4618d7ae0/disk (vdb) as it is a volume {{(pid=75337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 16:25:50 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525c87e5-14c3-40fd-8976-8df151ed07fa/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:25:50 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525c87e5-14c3-40fd-8976-8df151ed07fa/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:25:50 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525c87e5-14c3-40fd-8976-8df151ed07fa/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:25:50 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:25:50 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525c87e5-14c3-40fd-8976-8df151ed07fa/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:25:50 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de77f786-1ecf-4eac-ae4a-c4f6b1d47339/disk.rescue --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:25:50 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de77f786-1ecf-4eac-ae4a-c4f6b1d47339/disk.rescue --force-share --output=json" returned: 0 in 0.169s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:25:50 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de77f786-1ecf-4eac-ae4a-c4f6b1d47339/disk.rescue --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:25:50 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:25:50 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de77f786-1ecf-4eac-ae4a-c4f6b1d47339/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:25:50 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de77f786-1ecf-4eac-ae4a-c4f6b1d47339/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:25:50 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de77f786-1ecf-4eac-ae4a-c4f6b1d47339/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:25:50 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de77f786-1ecf-4eac-ae4a-c4f6b1d47339/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:25:51 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de77f786-1ecf-4eac-ae4a-c4f6b1d47339/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:25:51 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 16:25:51 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 16:25:51 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Hypervisor/Node resource view: name=user free_ram=8717MB free_disk=24.952960968017578GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75337) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 16:25:51 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:25:51 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:25:51 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 525c87e5-14c3-40fd-8976-8df151ed07fa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 16:25:51 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance de77f786-1ecf-4eac-ae4a-c4f6b1d47339 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 16:25:51 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 7fc86edc-e217-4c70-88f8-02f4618d7ae0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 16:25:51 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 16:25:51 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 16:25:51 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 16:25:51 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 16:25:51 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Compute_service record updated for user:user {{(pid=75337) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 16:25:51 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.254s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:25:55 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:25:55 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:26:00 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:26:00 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:26:01 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._sync_power_states {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:26:01 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Triggering sync for uuid 525c87e5-14c3-40fd-8976-8df151ed07fa {{(pid=75337) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 06 16:26:01 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Triggering sync for uuid de77f786-1ecf-4eac-ae4a-c4f6b1d47339 {{(pid=75337) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 06 16:26:01 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Triggering sync for uuid 7fc86edc-e217-4c70-88f8-02f4618d7ae0 {{(pid=75337) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 06 16:26:01 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "525c87e5-14c3-40fd-8976-8df151ed07fa" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:26:01 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "525c87e5-14c3-40fd-8976-8df151ed07fa" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:26:01 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "de77f786-1ecf-4eac-ae4a-c4f6b1d47339" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:26:01 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "de77f786-1ecf-4eac-ae4a-c4f6b1d47339" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:26:01 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "7fc86edc-e217-4c70-88f8-02f4618d7ae0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:26:01 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "7fc86edc-e217-4c70-88f8-02f4618d7ae0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:26:01 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "525c87e5-14c3-40fd-8976-8df151ed07fa" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.027s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:26:01 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "de77f786-1ecf-4eac-ae4a-c4f6b1d47339" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.027s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:26:01 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "7fc86edc-e217-4c70-88f8-02f4618d7ae0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.029s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:26:05 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:26:05 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:26:10 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:26:15 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:26:15 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:26:15 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75337) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 16:26:15 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 16:26:15 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 16:26:15 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:26:20 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:26:20 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:26:20 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75337) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 16:26:20 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 16:26:20 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 16:26:20 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:26:25 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:26:25 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:26:25 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75337) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 16:26:25 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 16:26:25 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 16:26:25 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:26:26 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:26:30 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:26:30 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:26:30 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75337) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 16:26:30 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 16:26:30 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 16:26:30 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:26:31 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:26:34 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:26:34 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75337) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 16:26:35 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:26:35 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:26:35 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75337) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 16:26:35 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 16:26:35 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 16:26:35 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:26:36 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:26:37 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:26:38 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:26:40 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:26:40 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:26:40 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:26:40 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75337) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 16:26:40 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 16:26:40 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 16:26:40 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:26:45 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:26:45 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:26:45 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75337) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 16:26:45 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 16:26:45 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 16:26:45 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:26:47 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:26:47 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Starting heal instance info cache {{(pid=75337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 16:26:47 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "refresh_cache-7fc86edc-e217-4c70-88f8-02f4618d7ae0" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 16:26:47 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquired lock "refresh_cache-7fc86edc-e217-4c70-88f8-02f4618d7ae0" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 16:26:47 user nova-compute[75337]: DEBUG nova.network.neutron [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] [instance: 7fc86edc-e217-4c70-88f8-02f4618d7ae0] Forcefully refreshing network info cache for instance {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 16:26:48 user nova-compute[75337]: DEBUG nova.network.neutron [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] [instance: 7fc86edc-e217-4c70-88f8-02f4618d7ae0] Updating instance_info_cache with network_info: [{"id": "f9a9cc4f-9e35-485e-988b-2fcfbd4ad748", "address": "fa:16:3e:40:ad:75", "network": {"id": "0da0e0bd-b07e-4ae1-8625-a979ed32bd07", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-528047864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f71610b3d00f412ea4aeba8068d032fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9a9cc4f-9e", "ovs_interfaceid": "f9a9cc4f-9e35-485e-988b-2fcfbd4ad748", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 16:26:48 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Releasing lock "refresh_cache-7fc86edc-e217-4c70-88f8-02f4618d7ae0" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 16:26:48 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] [instance: 7fc86edc-e217-4c70-88f8-02f4618d7ae0] Updated the network info_cache for instance {{(pid=75337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 16:26:50 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:26:50 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:26:50 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75337) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 16:26:50 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 16:26:50 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 16:26:50 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:26:51 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager.update_available_resource {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:26:51 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:26:51 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:26:51 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:26:51 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Auditing locally available compute resources for user (node: user) {{(pid=75337) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 16:26:51 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fc86edc-e217-4c70-88f8-02f4618d7ae0/disk.rescue --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:26:51 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fc86edc-e217-4c70-88f8-02f4618d7ae0/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:26:51 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fc86edc-e217-4c70-88f8-02f4618d7ae0/disk.rescue --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:26:52 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fc86edc-e217-4c70-88f8-02f4618d7ae0/disk.rescue --force-share --output=json" returned: 0 in 0.169s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:26:52 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] skipping disk /opt/stack/data/nova/instances/7fc86edc-e217-4c70-88f8-02f4618d7ae0/disk (vdb) as it is a volume {{(pid=75337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 16:26:52 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525c87e5-14c3-40fd-8976-8df151ed07fa/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:26:52 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525c87e5-14c3-40fd-8976-8df151ed07fa/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:26:52 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525c87e5-14c3-40fd-8976-8df151ed07fa/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:26:52 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525c87e5-14c3-40fd-8976-8df151ed07fa/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:26:52 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de77f786-1ecf-4eac-ae4a-c4f6b1d47339/disk.rescue --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:26:52 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de77f786-1ecf-4eac-ae4a-c4f6b1d47339/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:26:52 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de77f786-1ecf-4eac-ae4a-c4f6b1d47339/disk.rescue --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:26:52 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de77f786-1ecf-4eac-ae4a-c4f6b1d47339/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:26:52 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de77f786-1ecf-4eac-ae4a-c4f6b1d47339/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:26:52 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de77f786-1ecf-4eac-ae4a-c4f6b1d47339/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:26:52 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de77f786-1ecf-4eac-ae4a-c4f6b1d47339/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:26:53 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de77f786-1ecf-4eac-ae4a-c4f6b1d47339/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:26:53 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 16:26:53 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 16:26:53 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Hypervisor/Node resource view: name=user free_ram=8823MB free_disk=24.95220184326172GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75337) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 16:26:53 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:26:53 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:26:53 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 525c87e5-14c3-40fd-8976-8df151ed07fa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 16:26:53 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance de77f786-1ecf-4eac-ae4a-c4f6b1d47339 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 16:26:53 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 7fc86edc-e217-4c70-88f8-02f4618d7ae0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 16:26:53 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 16:26:53 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 16:26:53 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 16:26:53 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 16:26:53 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Compute_service record updated for user:user {{(pid=75337) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 16:26:53 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.228s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:26:54 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:26:55 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:27:00 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:27:00 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:27:00 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75337) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 16:27:00 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 16:27:00 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 16:27:00 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:27:05 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:27:05 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:27:05 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75337) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 16:27:05 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 16:27:05 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 16:27:05 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:27:10 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:27:15 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:27:15 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:27:15 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75337) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 16:27:15 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 16:27:15 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 16:27:15 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:27:18 user nova-compute[75337]: INFO nova.compute.manager [None req-3e502eb7-f962-4803-8bd1-a9489689382d tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] [instance: 7fc86edc-e217-4c70-88f8-02f4618d7ae0] Unrescuing
Nov 06 16:27:18 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-3e502eb7-f962-4803-8bd1-a9489689382d tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Acquiring lock "refresh_cache-7fc86edc-e217-4c70-88f8-02f4618d7ae0" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 16:27:18 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-3e502eb7-f962-4803-8bd1-a9489689382d tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Acquired lock "refresh_cache-7fc86edc-e217-4c70-88f8-02f4618d7ae0" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 16:27:18 user nova-compute[75337]: DEBUG nova.network.neutron [None req-3e502eb7-f962-4803-8bd1-a9489689382d tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] [instance: 7fc86edc-e217-4c70-88f8-02f4618d7ae0] Building network info cache for instance {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 16:27:19 user nova-compute[75337]: DEBUG nova.network.neutron [None req-3e502eb7-f962-4803-8bd1-a9489689382d tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] [instance: 7fc86edc-e217-4c70-88f8-02f4618d7ae0] Updating instance_info_cache with network_info: [{"id": "f9a9cc4f-9e35-485e-988b-2fcfbd4ad748", "address": "fa:16:3e:40:ad:75", "network": {"id": "0da0e0bd-b07e-4ae1-8625-a979ed32bd07", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-528047864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f71610b3d00f412ea4aeba8068d032fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9a9cc4f-9e", "ovs_interfaceid": "f9a9cc4f-9e35-485e-988b-2fcfbd4ad748", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 16:27:19 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-3e502eb7-f962-4803-8bd1-a9489689382d tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Releasing lock "refresh_cache-7fc86edc-e217-4c70-88f8-02f4618d7ae0" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 16:27:19 user nova-compute[75337]: DEBUG nova.objects.instance [None req-3e502eb7-f962-4803-8bd1-a9489689382d tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Lazy-loading 'flavor' on Instance uuid 7fc86edc-e217-4c70-88f8-02f4618d7ae0 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 16:27:19 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:27:19 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:27:19 user nova-compute[75337]: DEBUG nova.compute.manager [req-92164b58-27db-47ca-be09-1b6842f9748a req-94a0b50d-f63c-49d7-b2bc-ea305b692605 service nova] [instance: 7fc86edc-e217-4c70-88f8-02f4618d7ae0] Received event network-vif-unplugged-f9a9cc4f-9e35-485e-988b-2fcfbd4ad748 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:27:19 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-92164b58-27db-47ca-be09-1b6842f9748a req-94a0b50d-f63c-49d7-b2bc-ea305b692605 service nova] Acquiring lock "7fc86edc-e217-4c70-88f8-02f4618d7ae0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:27:19 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-92164b58-27db-47ca-be09-1b6842f9748a req-94a0b50d-f63c-49d7-b2bc-ea305b692605 service nova] Lock "7fc86edc-e217-4c70-88f8-02f4618d7ae0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:27:19 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-92164b58-27db-47ca-be09-1b6842f9748a req-94a0b50d-f63c-49d7-b2bc-ea305b692605 service nova] Lock "7fc86edc-e217-4c70-88f8-02f4618d7ae0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:27:19 user nova-compute[75337]: DEBUG nova.compute.manager [req-92164b58-27db-47ca-be09-1b6842f9748a req-94a0b50d-f63c-49d7-b2bc-ea305b692605 service nova] [instance: 7fc86edc-e217-4c70-88f8-02f4618d7ae0] No waiting events found dispatching network-vif-unplugged-f9a9cc4f-9e35-485e-988b-2fcfbd4ad748 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 16:27:19 user nova-compute[75337]: WARNING nova.compute.manager [req-92164b58-27db-47ca-be09-1b6842f9748a req-94a0b50d-f63c-49d7-b2bc-ea305b692605 service nova] [instance: 7fc86edc-e217-4c70-88f8-02f4618d7ae0] Received unexpected event network-vif-unplugged-f9a9cc4f-9e35-485e-988b-2fcfbd4ad748 for instance with vm_state rescued and task_state unrescuing.
Nov 06 16:27:19 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:27:19 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:27:19 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:27:19 user nova-compute[75337]: INFO nova.virt.libvirt.driver [-] [instance: 7fc86edc-e217-4c70-88f8-02f4618d7ae0] Instance destroyed successfully.
Nov 06 16:27:20 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:27:21 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:27:21 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:27:21 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:27:21 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:27:21 user nova-compute[75337]: DEBUG nova.compute.manager [req-3b7ad23c-ae98-4402-8cef-11c7858d2dff req-d4d40369-8edc-4ba2-aabd-9509478890e2 service nova] [instance: 7fc86edc-e217-4c70-88f8-02f4618d7ae0] Received event network-vif-plugged-f9a9cc4f-9e35-485e-988b-2fcfbd4ad748 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:27:21 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-3b7ad23c-ae98-4402-8cef-11c7858d2dff req-d4d40369-8edc-4ba2-aabd-9509478890e2 service nova] Acquiring lock "7fc86edc-e217-4c70-88f8-02f4618d7ae0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:27:21 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-3b7ad23c-ae98-4402-8cef-11c7858d2dff req-d4d40369-8edc-4ba2-aabd-9509478890e2 service nova] Lock "7fc86edc-e217-4c70-88f8-02f4618d7ae0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:27:21 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-3b7ad23c-ae98-4402-8cef-11c7858d2dff req-d4d40369-8edc-4ba2-aabd-9509478890e2 service nova] Lock "7fc86edc-e217-4c70-88f8-02f4618d7ae0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:27:21 user nova-compute[75337]: DEBUG nova.compute.manager [req-3b7ad23c-ae98-4402-8cef-11c7858d2dff req-d4d40369-8edc-4ba2-aabd-9509478890e2 service nova] [instance: 7fc86edc-e217-4c70-88f8-02f4618d7ae0] No waiting events found dispatching network-vif-plugged-f9a9cc4f-9e35-485e-988b-2fcfbd4ad748 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 16:27:21 user nova-compute[75337]: WARNING nova.compute.manager [req-3b7ad23c-ae98-4402-8cef-11c7858d2dff req-d4d40369-8edc-4ba2-aabd-9509478890e2 service nova] [instance: 7fc86edc-e217-4c70-88f8-02f4618d7ae0] Received unexpected event network-vif-plugged-f9a9cc4f-9e35-485e-988b-2fcfbd4ad748 for instance with vm_state rescued and task_state unrescuing.
Nov 06 16:27:21 user nova-compute[75337]: DEBUG nova.compute.manager [req-3b7ad23c-ae98-4402-8cef-11c7858d2dff req-d4d40369-8edc-4ba2-aabd-9509478890e2 service nova] [instance: 7fc86edc-e217-4c70-88f8-02f4618d7ae0] Received event network-vif-plugged-f9a9cc4f-9e35-485e-988b-2fcfbd4ad748 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:27:21 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-3b7ad23c-ae98-4402-8cef-11c7858d2dff req-d4d40369-8edc-4ba2-aabd-9509478890e2 service nova] Acquiring lock "7fc86edc-e217-4c70-88f8-02f4618d7ae0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:27:21 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-3b7ad23c-ae98-4402-8cef-11c7858d2dff req-d4d40369-8edc-4ba2-aabd-9509478890e2 service nova] Lock "7fc86edc-e217-4c70-88f8-02f4618d7ae0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:27:21 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-3b7ad23c-ae98-4402-8cef-11c7858d2dff req-d4d40369-8edc-4ba2-aabd-9509478890e2 service nova] Lock "7fc86edc-e217-4c70-88f8-02f4618d7ae0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:27:21 user nova-compute[75337]: DEBUG nova.compute.manager [req-3b7ad23c-ae98-4402-8cef-11c7858d2dff req-d4d40369-8edc-4ba2-aabd-9509478890e2 service nova] [instance: 7fc86edc-e217-4c70-88f8-02f4618d7ae0] No waiting events found dispatching network-vif-plugged-f9a9cc4f-9e35-485e-988b-2fcfbd4ad748 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 16:27:21 user nova-compute[75337]: WARNING nova.compute.manager [req-3b7ad23c-ae98-4402-8cef-11c7858d2dff req-d4d40369-8edc-4ba2-aabd-9509478890e2 service nova] [instance: 7fc86edc-e217-4c70-88f8-02f4618d7ae0] Received unexpected event network-vif-plugged-f9a9cc4f-9e35-485e-988b-2fcfbd4ad748 for instance with vm_state rescued and task_state unrescuing.
Nov 06 16:27:21 user nova-compute[75337]: DEBUG nova.compute.manager [req-3b7ad23c-ae98-4402-8cef-11c7858d2dff req-d4d40369-8edc-4ba2-aabd-9509478890e2 service nova] [instance: 7fc86edc-e217-4c70-88f8-02f4618d7ae0] Received event network-vif-plugged-f9a9cc4f-9e35-485e-988b-2fcfbd4ad748 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:27:21 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-3b7ad23c-ae98-4402-8cef-11c7858d2dff req-d4d40369-8edc-4ba2-aabd-9509478890e2 service nova] Acquiring lock "7fc86edc-e217-4c70-88f8-02f4618d7ae0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:27:21 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-3b7ad23c-ae98-4402-8cef-11c7858d2dff req-d4d40369-8edc-4ba2-aabd-9509478890e2 service nova] Lock "7fc86edc-e217-4c70-88f8-02f4618d7ae0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:27:21 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-3b7ad23c-ae98-4402-8cef-11c7858d2dff req-d4d40369-8edc-4ba2-aabd-9509478890e2 service nova] Lock "7fc86edc-e217-4c70-88f8-02f4618d7ae0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:27:21 user nova-compute[75337]: DEBUG nova.compute.manager [req-3b7ad23c-ae98-4402-8cef-11c7858d2dff req-d4d40369-8edc-4ba2-aabd-9509478890e2 service nova] [instance: 7fc86edc-e217-4c70-88f8-02f4618d7ae0] No waiting events found dispatching network-vif-plugged-f9a9cc4f-9e35-485e-988b-2fcfbd4ad748 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 16:27:21 user nova-compute[75337]: WARNING nova.compute.manager [req-3b7ad23c-ae98-4402-8cef-11c7858d2dff req-d4d40369-8edc-4ba2-aabd-9509478890e2 service nova] [instance: 7fc86edc-e217-4c70-88f8-02f4618d7ae0] Received unexpected event network-vif-plugged-f9a9cc4f-9e35-485e-988b-2fcfbd4ad748 for instance with vm_state rescued and task_state unrescuing.
Nov 06 16:27:23 user nova-compute[75337]: DEBUG nova.compute.manager [None req-3e502eb7-f962-4803-8bd1-a9489689382d tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] [instance: 7fc86edc-e217-4c70-88f8-02f4618d7ae0] Checking state {{(pid=75337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 16:27:25 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:27:25 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:27:27 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:27:30 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:27:30 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:27:30 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75337) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 16:27:30 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 16:27:30 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 16:27:30 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:27:33 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:27:35 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:27:36 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:27:36 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:27:36 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75337) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 16:27:39 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:27:39 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:27:40 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:27:40 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:27:41 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:27:45 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:27:45 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:27:48 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:27:48 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Starting heal instance info cache {{(pid=75337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 16:27:48 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Rebuilding the list of instances to heal {{(pid=75337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 06 16:27:48 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "refresh_cache-525c87e5-14c3-40fd-8976-8df151ed07fa" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 16:27:48 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquired lock "refresh_cache-525c87e5-14c3-40fd-8976-8df151ed07fa" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 16:27:48 user nova-compute[75337]: DEBUG nova.network.neutron [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] [instance: 525c87e5-14c3-40fd-8976-8df151ed07fa] Forcefully refreshing network info cache for instance {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 16:27:48 user nova-compute[75337]: DEBUG nova.objects.instance [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lazy-loading 'info_cache' on Instance uuid 525c87e5-14c3-40fd-8976-8df151ed07fa {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 16:27:49 user nova-compute[75337]: DEBUG nova.network.neutron [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] [instance: 525c87e5-14c3-40fd-8976-8df151ed07fa] Updating instance_info_cache with network_info: [{"id": "1dfbe337-9efa-4a6a-9801-e9264673d095", "address": "fa:16:3e:fd:18:f1", "network": {"id": "0da0e0bd-b07e-4ae1-8625-a979ed32bd07", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-528047864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f71610b3d00f412ea4aeba8068d032fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dfbe337-9e", "ovs_interfaceid": "1dfbe337-9efa-4a6a-9801-e9264673d095", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 16:27:49 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Releasing lock "refresh_cache-525c87e5-14c3-40fd-8976-8df151ed07fa" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 16:27:49 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] [instance: 525c87e5-14c3-40fd-8976-8df151ed07fa] Updated the network info_cache for instance {{(pid=75337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 16:27:50 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:27:50 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:27:53 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager.update_available_resource {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:27:53 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:27:53 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:27:53 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:27:53 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Auditing locally available compute resources for user (node: user) {{(pid=75337) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 16:27:53 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fc86edc-e217-4c70-88f8-02f4618d7ae0/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:27:53 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fc86edc-e217-4c70-88f8-02f4618d7ae0/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:27:53 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fc86edc-e217-4c70-88f8-02f4618d7ae0/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:27:54 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fc86edc-e217-4c70-88f8-02f4618d7ae0/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:27:54 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 16:27:54 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525c87e5-14c3-40fd-8976-8df151ed07fa/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:27:54 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525c87e5-14c3-40fd-8976-8df151ed07fa/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:27:54 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525c87e5-14c3-40fd-8976-8df151ed07fa/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:27:54 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525c87e5-14c3-40fd-8976-8df151ed07fa/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:27:54 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de77f786-1ecf-4eac-ae4a-c4f6b1d47339/disk.rescue --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:27:54 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de77f786-1ecf-4eac-ae4a-c4f6b1d47339/disk.rescue --force-share --output=json" returned: 0 in 0.169s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:27:54 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de77f786-1ecf-4eac-ae4a-c4f6b1d47339/disk.rescue --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:27:54 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de77f786-1ecf-4eac-ae4a-c4f6b1d47339/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:27:54 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de77f786-1ecf-4eac-ae4a-c4f6b1d47339/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:27:54 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de77f786-1ecf-4eac-ae4a-c4f6b1d47339/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:27:54 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de77f786-1ecf-4eac-ae4a-c4f6b1d47339/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:27:55 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de77f786-1ecf-4eac-ae4a-c4f6b1d47339/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:27:55 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:27:55 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 16:27:55 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 16:27:55 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Hypervisor/Node resource view: name=user free_ram=8753MB free_disk=24.950969696044922GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75337) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 16:27:55 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:27:55 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:27:55 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 525c87e5-14c3-40fd-8976-8df151ed07fa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 16:27:55 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance de77f786-1ecf-4eac-ae4a-c4f6b1d47339 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 16:27:55 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 7fc86edc-e217-4c70-88f8-02f4618d7ae0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 16:27:55 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 16:27:55 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 16:27:55 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 16:27:55 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 16:27:55 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Compute_service record updated for user:user {{(pid=75337) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 16:27:55 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.238s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:27:55 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:28:00 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:28:00 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:28:00 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75337) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 16:28:00 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 16:28:00 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 16:28:00 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:28:05 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:28:05 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:28:05 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75337) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 16:28:05 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 16:28:05 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 16:28:05 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:28:10 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:28:15 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:28:15 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:28:15 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75337) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 16:28:15 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 16:28:15 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 16:28:15 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:28:20 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:28:20 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:28:20 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75337) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 16:28:20 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 16:28:20 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 16:28:20 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:28:25 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:28:30 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:28:30 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:28:30 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75337) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 16:28:30 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 16:28:30 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 16:28:30 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:28:31 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:28:35 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:28:35 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:28:35 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:28:35 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75337) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 16:28:35 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 16:28:35 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 16:28:35 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:28:36 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:28:36 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75337) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 16:28:38 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:28:39 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:28:39 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:28:40 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:28:40 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:28:40 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75337) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 16:28:40 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 16:28:40 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 16:28:40 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:28:41 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:28:45 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:28:48 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:28:48 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Starting heal instance info cache {{(pid=75337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 16:28:48 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "refresh_cache-de77f786-1ecf-4eac-ae4a-c4f6b1d47339" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 16:28:48 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquired lock "refresh_cache-de77f786-1ecf-4eac-ae4a-c4f6b1d47339" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 16:28:48 user nova-compute[75337]: DEBUG nova.network.neutron [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] [instance: de77f786-1ecf-4eac-ae4a-c4f6b1d47339] Forcefully refreshing network info cache for instance {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 16:28:49 user nova-compute[75337]: DEBUG nova.network.neutron [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] [instance: de77f786-1ecf-4eac-ae4a-c4f6b1d47339] Updating instance_info_cache with network_info: [{"id": "8f33a5c0-50e1-4bac-a686-733daf33a307", "address": "fa:16:3e:4b:fc:cf", "network": {"id": "0da0e0bd-b07e-4ae1-8625-a979ed32bd07", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-528047864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f71610b3d00f412ea4aeba8068d032fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f33a5c0-50", "ovs_interfaceid": "8f33a5c0-50e1-4bac-a686-733daf33a307", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 16:28:49 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Releasing lock "refresh_cache-de77f786-1ecf-4eac-ae4a-c4f6b1d47339" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 16:28:49 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] [instance: de77f786-1ecf-4eac-ae4a-c4f6b1d47339] Updated the network info_cache for instance {{(pid=75337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 16:28:50 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:28:50 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:28:50 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75337) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 16:28:50 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 16:28:50 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 16:28:50 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:28:53 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:28:53 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager.update_available_resource {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:28:53 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:28:53 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:28:53 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:28:53 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Auditing locally available compute resources for user (node: user) {{(pid=75337) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 16:28:53 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fc86edc-e217-4c70-88f8-02f4618d7ae0/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:28:53 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fc86edc-e217-4c70-88f8-02f4618d7ae0/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:28:53 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fc86edc-e217-4c70-88f8-02f4618d7ae0/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:28:54 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fc86edc-e217-4c70-88f8-02f4618d7ae0/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:28:54 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 16:28:54 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525c87e5-14c3-40fd-8976-8df151ed07fa/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:28:54 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525c87e5-14c3-40fd-8976-8df151ed07fa/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:28:54 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525c87e5-14c3-40fd-8976-8df151ed07fa/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:28:54 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525c87e5-14c3-40fd-8976-8df151ed07fa/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:28:54 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de77f786-1ecf-4eac-ae4a-c4f6b1d47339/disk.rescue --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:28:54 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de77f786-1ecf-4eac-ae4a-c4f6b1d47339/disk.rescue --force-share --output=json" returned: 0 in 0.167s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:28:54 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de77f786-1ecf-4eac-ae4a-c4f6b1d47339/disk.rescue --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:28:54 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de77f786-1ecf-4eac-ae4a-c4f6b1d47339/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:28:54 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de77f786-1ecf-4eac-ae4a-c4f6b1d47339/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:28:54 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de77f786-1ecf-4eac-ae4a-c4f6b1d47339/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:28:54 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de77f786-1ecf-4eac-ae4a-c4f6b1d47339/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:28:55 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de77f786-1ecf-4eac-ae4a-c4f6b1d47339/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:28:55 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 16:28:55 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 16:28:55 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Hypervisor/Node resource view: name=user free_ram=8805MB free_disk=24.95041275024414GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75337) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 16:28:55 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:28:55 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:28:55 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 525c87e5-14c3-40fd-8976-8df151ed07fa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 16:28:55 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance de77f786-1ecf-4eac-ae4a-c4f6b1d47339 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 16:28:55 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 7fc86edc-e217-4c70-88f8-02f4618d7ae0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 16:28:55 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 16:28:55 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 16:28:55 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 16:28:55 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 16:28:55 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Compute_service record updated for user:user {{(pid=75337) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 16:28:55 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.224s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:28:55 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:29:00 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:29:05 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:29:10 user nova-compute[75337]: DEBUG nova.compute.manager [req-624e7282-e985-417a-89f0-d93fbe723724 req-708611e6-0727-4fb4-bfe6-673444be9a0a service nova] [instance: 7fc86edc-e217-4c70-88f8-02f4618d7ae0] Received event network-changed-f9a9cc4f-9e35-485e-988b-2fcfbd4ad748 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:29:10 user nova-compute[75337]: DEBUG nova.compute.manager [req-624e7282-e985-417a-89f0-d93fbe723724 req-708611e6-0727-4fb4-bfe6-673444be9a0a service nova] [instance: 7fc86edc-e217-4c70-88f8-02f4618d7ae0] Refreshing instance network info cache due to event network-changed-f9a9cc4f-9e35-485e-988b-2fcfbd4ad748. {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 16:29:10 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-624e7282-e985-417a-89f0-d93fbe723724 req-708611e6-0727-4fb4-bfe6-673444be9a0a service nova] Acquiring lock "refresh_cache-7fc86edc-e217-4c70-88f8-02f4618d7ae0" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 16:29:10 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-624e7282-e985-417a-89f0-d93fbe723724 req-708611e6-0727-4fb4-bfe6-673444be9a0a service nova] Acquired lock "refresh_cache-7fc86edc-e217-4c70-88f8-02f4618d7ae0" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 16:29:10 user nova-compute[75337]: DEBUG nova.network.neutron [req-624e7282-e985-417a-89f0-d93fbe723724 req-708611e6-0727-4fb4-bfe6-673444be9a0a service nova] [instance: 7fc86edc-e217-4c70-88f8-02f4618d7ae0] Refreshing network info cache for port f9a9cc4f-9e35-485e-988b-2fcfbd4ad748 {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 16:29:10 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:29:11 user nova-compute[75337]: DEBUG nova.network.neutron [req-624e7282-e985-417a-89f0-d93fbe723724 req-708611e6-0727-4fb4-bfe6-673444be9a0a service nova] [instance: 7fc86edc-e217-4c70-88f8-02f4618d7ae0] Updated VIF entry in instance network info cache for port f9a9cc4f-9e35-485e-988b-2fcfbd4ad748. {{(pid=75337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 16:29:11 user nova-compute[75337]: DEBUG nova.network.neutron [req-624e7282-e985-417a-89f0-d93fbe723724 req-708611e6-0727-4fb4-bfe6-673444be9a0a service nova] [instance: 7fc86edc-e217-4c70-88f8-02f4618d7ae0] Updating instance_info_cache with network_info: [{"id": "f9a9cc4f-9e35-485e-988b-2fcfbd4ad748", "address": "fa:16:3e:40:ad:75", "network": {"id": "0da0e0bd-b07e-4ae1-8625-a979ed32bd07", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-528047864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f71610b3d00f412ea4aeba8068d032fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9a9cc4f-9e", "ovs_interfaceid": "f9a9cc4f-9e35-485e-988b-2fcfbd4ad748", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 16:29:11 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-40e80148-a9fb-4583-bd01-8a40fa0e3f36 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Acquiring lock "7fc86edc-e217-4c70-88f8-02f4618d7ae0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:29:11 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-40e80148-a9fb-4583-bd01-8a40fa0e3f36 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Lock "7fc86edc-e217-4c70-88f8-02f4618d7ae0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:29:11 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-624e7282-e985-417a-89f0-d93fbe723724 req-708611e6-0727-4fb4-bfe6-673444be9a0a service nova] Releasing lock "refresh_cache-7fc86edc-e217-4c70-88f8-02f4618d7ae0" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 16:29:11 user nova-compute[75337]: INFO nova.compute.manager [None req-40e80148-a9fb-4583-bd01-8a40fa0e3f36 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] [instance: 7fc86edc-e217-4c70-88f8-02f4618d7ae0] Detaching volume 60b94dc8-dfa5-4b29-b453-9e5833d9c711
Nov 06 16:29:11 user nova-compute[75337]: INFO nova.virt.block_device [None req-40e80148-a9fb-4583-bd01-8a40fa0e3f36 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] [instance: 7fc86edc-e217-4c70-88f8-02f4618d7ae0] Attempting to driver detach volume 60b94dc8-dfa5-4b29-b453-9e5833d9c711 from mountpoint /dev/vdb
Nov 06 16:29:11 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-40e80148-a9fb-4583-bd01-8a40fa0e3f36 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Attempting to detach device vdb from instance 7fc86edc-e217-4c70-88f8-02f4618d7ae0 from the persistent domain config. {{(pid=75337) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 06 16:29:11 user nova-compute[75337]: DEBUG nova.virt.libvirt.guest [None req-40e80148-a9fb-4583-bd01-8a40fa0e3f36 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 16:29:11 user nova-compute[75337]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 16:29:11 user nova-compute[75337]:   <source dev="/dev/sdb"/>
Nov 06 16:29:11 user nova-compute[75337]:   <target dev="vdb" bus="virtio"/>
Nov 06 16:29:11 user nova-compute[75337]:   <serial>60b94dc8-dfa5-4b29-b453-9e5833d9c711</serial>
Nov 06 16:29:11 user nova-compute[75337]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 06 16:29:11 user nova-compute[75337]: </disk>
Nov 06 16:29:11 user nova-compute[75337]:  {{(pid=75337) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 16:29:11 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-40e80148-a9fb-4583-bd01-8a40fa0e3f36 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Successfully detached device vdb from instance 7fc86edc-e217-4c70-88f8-02f4618d7ae0 from the persistent domain config.
Nov 06 16:29:11 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-40e80148-a9fb-4583-bd01-8a40fa0e3f36 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7fc86edc-e217-4c70-88f8-02f4618d7ae0 from the live domain config. {{(pid=75337) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 06 16:29:11 user nova-compute[75337]: DEBUG nova.virt.libvirt.guest [None req-40e80148-a9fb-4583-bd01-8a40fa0e3f36 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 16:29:11 user nova-compute[75337]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 16:29:11 user nova-compute[75337]:   <source dev="/dev/sdb"/>
Nov 06 16:29:11 user nova-compute[75337]:   <target dev="vdb" bus="virtio"/>
Nov 06 16:29:11 user nova-compute[75337]:   <serial>60b94dc8-dfa5-4b29-b453-9e5833d9c711</serial>
Nov 06 16:29:11 user nova-compute[75337]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 06 16:29:11 user nova-compute[75337]: </disk>
Nov 06 16:29:11 user nova-compute[75337]:  {{(pid=75337) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 16:29:11 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-40e80148-a9fb-4583-bd01-8a40fa0e3f36 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7fc86edc-e217-4c70-88f8-02f4618d7ae0 {{(pid=75337) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 06 16:29:12 user nova-compute[75337]: DEBUG nova.compute.manager [req-69f1c3d8-a316-4123-9f7d-a14a4a56256f req-72988668-0904-46ad-b4a0-7f111642ece2 service nova] [instance: 7fc86edc-e217-4c70-88f8-02f4618d7ae0] Received event network-changed-f9a9cc4f-9e35-485e-988b-2fcfbd4ad748 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:29:12 user nova-compute[75337]: DEBUG nova.compute.manager [req-69f1c3d8-a316-4123-9f7d-a14a4a56256f req-72988668-0904-46ad-b4a0-7f111642ece2 service nova] [instance: 7fc86edc-e217-4c70-88f8-02f4618d7ae0] Refreshing instance network info cache due to event network-changed-f9a9cc4f-9e35-485e-988b-2fcfbd4ad748. {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 16:29:12 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-69f1c3d8-a316-4123-9f7d-a14a4a56256f req-72988668-0904-46ad-b4a0-7f111642ece2 service nova] Acquiring lock "refresh_cache-7fc86edc-e217-4c70-88f8-02f4618d7ae0" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 16:29:12 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-69f1c3d8-a316-4123-9f7d-a14a4a56256f req-72988668-0904-46ad-b4a0-7f111642ece2 service nova] Acquired lock "refresh_cache-7fc86edc-e217-4c70-88f8-02f4618d7ae0" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 16:29:12 user nova-compute[75337]: DEBUG nova.network.neutron [req-69f1c3d8-a316-4123-9f7d-a14a4a56256f req-72988668-0904-46ad-b4a0-7f111642ece2 service nova] [instance: 7fc86edc-e217-4c70-88f8-02f4618d7ae0] Refreshing network info cache for port f9a9cc4f-9e35-485e-988b-2fcfbd4ad748 {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 16:29:13 user nova-compute[75337]: DEBUG nova.network.neutron [req-69f1c3d8-a316-4123-9f7d-a14a4a56256f req-72988668-0904-46ad-b4a0-7f111642ece2 service nova] [instance: 7fc86edc-e217-4c70-88f8-02f4618d7ae0] Updated VIF entry in instance network info cache for port f9a9cc4f-9e35-485e-988b-2fcfbd4ad748. {{(pid=75337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 16:29:13 user nova-compute[75337]: DEBUG nova.network.neutron [req-69f1c3d8-a316-4123-9f7d-a14a4a56256f req-72988668-0904-46ad-b4a0-7f111642ece2 service nova] [instance: 7fc86edc-e217-4c70-88f8-02f4618d7ae0] Updating instance_info_cache with network_info: [{"id": "f9a9cc4f-9e35-485e-988b-2fcfbd4ad748", "address": "fa:16:3e:40:ad:75", "network": {"id": "0da0e0bd-b07e-4ae1-8625-a979ed32bd07", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-528047864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f71610b3d00f412ea4aeba8068d032fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9a9cc4f-9e", "ovs_interfaceid": "f9a9cc4f-9e35-485e-988b-2fcfbd4ad748", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 16:29:13 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-69f1c3d8-a316-4123-9f7d-a14a4a56256f req-72988668-0904-46ad-b4a0-7f111642ece2 service nova] Releasing lock "refresh_cache-7fc86edc-e217-4c70-88f8-02f4618d7ae0" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 16:29:15 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:29:15 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:29:20 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:29:25 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:29:25 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:29:25 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75337) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 16:29:25 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 16:29:25 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 16:29:25 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:29:30 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:29:30 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:29:30 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75337) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 16:29:30 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 16:29:30 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 16:29:30 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:29:31 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-40e80148-a9fb-4583-bd01-8a40fa0e3f36 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 7fc86edc-e217-4c70-88f8-02f4618d7ae0 is timed out.
Nov 06 16:29:31 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-40e80148-a9fb-4583-bd01-8a40fa0e3f36 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Successfully detached device vdb from instance 7fc86edc-e217-4c70-88f8-02f4618d7ae0 from the live domain config.
Nov 06 16:29:31 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40e80148-a9fb-4583-bd01-8a40fa0e3f36 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] [instance: 7fc86edc-e217-4c70-88f8-02f4618d7ae0] calling os-brick to detach iSCSI Volume {{(pid=75337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 16:29:31 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-40e80148-a9fb-4583-bd01-8a40fa0e3f36 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2abc33d0c0>, {'target_iqn': 'iqn.2010-10.org.openstack:60b94dc8-dfa5-4b29-b453-9e5833d9c711', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xYOdLIwg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 16:29:31 user nova-compute[75337]: WARNING os_brick.initiator.connectors.base [None req-40e80148-a9fb-4583-bd01-8a40fa0e3f36 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 16:29:31 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-40e80148-a9fb-4583-bd01-8a40fa0e3f36 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 16:29:31 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-40e80148-a9fb-4583-bd01-8a40fa0e3f36 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 16:29:31 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:29:31 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:29:31 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aac05e1-57ed-4133-abfb-65765572695c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:60b94dc8-dfa5-4b29-b453-9e5833d9c711\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:29:31 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-40e80148-a9fb-4583-bd01-8a40fa0e3f36 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 16:29:31 user nova-compute[75337]: No targets found.
Nov 06 16:29:31 user nova-compute[75337]: iSNS:
Nov 06 16:29:31 user nova-compute[75337]: No targets found.
Nov 06 16:29:31 user nova-compute[75337]: STATIC:
Nov 06 16:29:31 user nova-compute[75337]: Target: iqn.2010-10.org.openstack:60b94dc8-dfa5-4b29-b453-9e5833d9c711
Nov 06 16:29:31 user nova-compute[75337]:         Portal: 172.16.0.220:3260,-1
Nov 06 16:29:31 user nova-compute[75337]:                 Iface Name: default
Nov 06 16:29:31 user nova-compute[75337]: FIRMWARE:
Nov 06 16:29:31 user nova-compute[75337]: No targets found.
Nov 06 16:29:31 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 16:29:31 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-40e80148-a9fb-4583-bd01-8a40fa0e3f36 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 16:29:31 user nova-compute[75337]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 16:29:31 user nova-compute[75337]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75337) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 16:29:31 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-40e80148-a9fb-4583-bd01-8a40fa0e3f36 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:60b94dc8-dfa5-4b29-b453-9e5833d9c711', 0)] {{(pid=75337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 16:29:31 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:29:31 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:29:31 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[80c62706-e33d-4b45-b388-cfc5c4958f66]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:60b94dc8-dfa5-4b29-b453-9e5833d9c711\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:29:31 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:29:31 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:29:31 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bb79931-45a7-43a4-88f1-c5488890afe6]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b94dc8-dfa5-4b29-b453-9e5833d9c711 (non-flash)\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:29:31 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-40e80148-a9fb-4583-bd01-8a40fa0e3f36 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b94dc8-dfa5-4b29-b453-9e5833d9c711 (non-flash)
Nov 06 16:29:31 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 16:29:31 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-40e80148-a9fb-4583-bd01-8a40fa0e3f36 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b94dc8-dfa5-4b29-b453-9e5833d9c711 (non-flash)
Nov 06 16:29:31 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 16:29:31 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-40e80148-a9fb-4583-bd01-8a40fa0e3f36 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2a9c4488b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:60b94dc8-dfa5-4b29-b453-9e5833d9c711'): ({'sdb'}, set())}) {{(pid=75337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 16:29:31 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-40e80148-a9fb-4583-bd01-8a40fa0e3f36 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Removing single pathed devices sdb {{(pid=75337) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 16:29:31 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:29:31 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:29:31 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[41edf15c-8269-4ecb-9589-1cf5682ae49a]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:29:31 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:29:31 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:29:31 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[f355f868-6dff-4ba6-a703-2139194a3645]: (4, ('ok\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:29:31 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-40e80148-a9fb-4583-bd01-8a40fa0e3f36 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Flushing IO for device /dev/sdb {{(pid=75337) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 16:29:31 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:29:31 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:29:31 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f127451-dad0-45cc-9842-6cda6ece1ade]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:29:31 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-40e80148-a9fb-4583-bd01-8a40fa0e3f36 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75337) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 16:29:31 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:29:31 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:29:31 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d8b3206-00a7-42bf-92d0-1e2f834953ec]: (4, ('1', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:29:31 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-40e80148-a9fb-4583-bd01-8a40fa0e3f36 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 16:29:31 user nova-compute[75337]: DEBUG os_brick.initiator.linuxscsi [None req-40e80148-a9fb-4583-bd01-8a40fa0e3f36 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] SCSI volumes sdb have been removed. {{(pid=75337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 16:29:31 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-40e80148-a9fb-4583-bd01-8a40fa0e3f36 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:60b94dc8-dfa5-4b29-b453-9e5833d9c711')] {{(pid=75337) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 16:29:31 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60b94dc8-dfa5-4b29-b453-9e5833d9c711 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:29:31 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60b94dc8-dfa5-4b29-b453-9e5833d9c711 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:29:31 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ce43849-8552-4100-a1c0-a3c0e54abbaa]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:29:31 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-40e80148-a9fb-4583-bd01-8a40fa0e3f36 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:29:31 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60b94dc8-dfa5-4b29-b453-9e5833d9c711 -p 172.16.0.220:3260 --logout {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:29:31 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60b94dc8-dfa5-4b29-b453-9e5833d9c711 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:29:31 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae212650-78d5-4223-859a-12aa066aa8eb]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:60b94dc8-dfa5-4b29-b453-9e5833d9c711, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:60b94dc8-dfa5-4b29-b453-9e5833d9c711, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:29:31 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-40e80148-a9fb-4583-bd01-8a40fa0e3f36 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:60b94dc8-dfa5-4b29-b453-9e5833d9c711, portal: 172.16.0.220,3260]
Nov 06 16:29:31 user nova-compute[75337]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:60b94dc8-dfa5-4b29-b453-9e5833d9c711, portal: 172.16.0.220,3260] successful.
Nov 06 16:29:31 user nova-compute[75337]:  stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:29:31 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60b94dc8-dfa5-4b29-b453-9e5833d9c711 -p 172.16.0.220:3260 --op delete {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:29:31 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60b94dc8-dfa5-4b29-b453-9e5833d9c711 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:29:31 user nova-compute[75337]: DEBUG oslo.privsep.daemon [-] privsep: reply[29d54dec-3481-45af-8be8-3363065bba8e]: (4, ('', '')) {{(pid=86696) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 16:29:31 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-40e80148-a9fb-4583-bd01-8a40fa0e3f36 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 16:29:31 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.base [None req-40e80148-a9fb-4583-bd01-8a40fa0e3f36 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.292s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 16:29:31 user nova-compute[75337]: DEBUG os_brick.initiator.connectors.iscsi [None req-40e80148-a9fb-4583-bd01-8a40fa0e3f36 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] <== disconnect_volume: return (294ms) None {{(pid=75337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 16:29:31 user nova-compute[75337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40e80148-a9fb-4583-bd01-8a40fa0e3f36 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] [instance: 7fc86edc-e217-4c70-88f8-02f4618d7ae0] Disconnected iSCSI Volume {{(pid=75337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 16:29:32 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:29:32 user nova-compute[75337]: DEBUG nova.objects.instance [None req-40e80148-a9fb-4583-bd01-8a40fa0e3f36 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Lazy-loading 'flavor' on Instance uuid 7fc86edc-e217-4c70-88f8-02f4618d7ae0 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 16:29:32 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-40e80148-a9fb-4583-bd01-8a40fa0e3f36 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Lock "7fc86edc-e217-4c70-88f8-02f4618d7ae0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.761s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:29:35 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:29:35 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:29:35 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75337) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 16:29:35 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 16:29:35 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 16:29:35 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:29:36 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:29:36 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:29:36 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75337) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 16:29:39 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:29:39 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:29:40 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:29:40 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:29:43 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:29:45 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:29:49 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:29:49 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Starting heal instance info cache {{(pid=75337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 16:29:49 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "refresh_cache-7fc86edc-e217-4c70-88f8-02f4618d7ae0" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 16:29:49 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquired lock "refresh_cache-7fc86edc-e217-4c70-88f8-02f4618d7ae0" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 16:29:49 user nova-compute[75337]: DEBUG nova.network.neutron [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] [instance: 7fc86edc-e217-4c70-88f8-02f4618d7ae0] Forcefully refreshing network info cache for instance {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 16:29:50 user nova-compute[75337]: DEBUG nova.network.neutron [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] [instance: 7fc86edc-e217-4c70-88f8-02f4618d7ae0] Updating instance_info_cache with network_info: [{"id": "f9a9cc4f-9e35-485e-988b-2fcfbd4ad748", "address": "fa:16:3e:40:ad:75", "network": {"id": "0da0e0bd-b07e-4ae1-8625-a979ed32bd07", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-528047864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f71610b3d00f412ea4aeba8068d032fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9a9cc4f-9e", "ovs_interfaceid": "f9a9cc4f-9e35-485e-988b-2fcfbd4ad748", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 16:29:50 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Releasing lock "refresh_cache-7fc86edc-e217-4c70-88f8-02f4618d7ae0" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 16:29:50 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] [instance: 7fc86edc-e217-4c70-88f8-02f4618d7ae0] Updated the network info_cache for instance {{(pid=75337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 16:29:50 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:29:50 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:29:50 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75337) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 16:29:50 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 16:29:50 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 16:29:50 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:29:54 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager.update_available_resource {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:29:54 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:29:54 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:29:54 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:29:54 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Auditing locally available compute resources for user (node: user) {{(pid=75337) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 16:29:54 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fc86edc-e217-4c70-88f8-02f4618d7ae0/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:29:54 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fc86edc-e217-4c70-88f8-02f4618d7ae0/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:29:54 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fc86edc-e217-4c70-88f8-02f4618d7ae0/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:29:55 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fc86edc-e217-4c70-88f8-02f4618d7ae0/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:29:55 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525c87e5-14c3-40fd-8976-8df151ed07fa/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:29:55 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525c87e5-14c3-40fd-8976-8df151ed07fa/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:29:55 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525c87e5-14c3-40fd-8976-8df151ed07fa/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:29:55 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525c87e5-14c3-40fd-8976-8df151ed07fa/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:29:55 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de77f786-1ecf-4eac-ae4a-c4f6b1d47339/disk.rescue --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:29:55 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de77f786-1ecf-4eac-ae4a-c4f6b1d47339/disk.rescue --force-share --output=json" returned: 0 in 0.168s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:29:55 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de77f786-1ecf-4eac-ae4a-c4f6b1d47339/disk.rescue --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:29:55 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de77f786-1ecf-4eac-ae4a-c4f6b1d47339/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:29:55 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de77f786-1ecf-4eac-ae4a-c4f6b1d47339/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:29:55 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:29:55 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de77f786-1ecf-4eac-ae4a-c4f6b1d47339/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:29:55 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de77f786-1ecf-4eac-ae4a-c4f6b1d47339/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:29:56 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de77f786-1ecf-4eac-ae4a-c4f6b1d47339/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:29:56 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 16:29:56 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 16:29:56 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Hypervisor/Node resource view: name=user free_ram=8808MB free_disk=24.949668884277344GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75337) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 16:29:56 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:29:56 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:29:56 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 525c87e5-14c3-40fd-8976-8df151ed07fa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 16:29:56 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance de77f786-1ecf-4eac-ae4a-c4f6b1d47339 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 16:29:56 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 7fc86edc-e217-4c70-88f8-02f4618d7ae0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 16:29:56 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 16:29:56 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 16:29:56 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Refreshing inventories for resource provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 06 16:29:56 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Updating ProviderTree inventory for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 06 16:29:56 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Updating inventory in ProviderTree for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 06 16:29:56 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Refreshing aggregate associations for resource provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7, aggregates: None {{(pid=75337) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 06 16:29:56 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Refreshing trait associations for resource provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7, traits: COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NODE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_IDE,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSSE3,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_USB {{(pid=75337) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 06 16:29:56 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 16:29:56 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 16:29:56 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Compute_service record updated for user:user {{(pid=75337) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 16:29:56 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.524s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:30:00 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:30:00 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:30:00 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75337) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 16:30:00 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 16:30:00 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 16:30:00 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:30:01 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-0cfbf328-5284-4582-a681-e5afcf2fa9df tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Acquiring lock "7fc86edc-e217-4c70-88f8-02f4618d7ae0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:30:01 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-0cfbf328-5284-4582-a681-e5afcf2fa9df tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Lock "7fc86edc-e217-4c70-88f8-02f4618d7ae0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:30:01 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-0cfbf328-5284-4582-a681-e5afcf2fa9df tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Acquiring lock "7fc86edc-e217-4c70-88f8-02f4618d7ae0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:30:01 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-0cfbf328-5284-4582-a681-e5afcf2fa9df tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Lock "7fc86edc-e217-4c70-88f8-02f4618d7ae0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:30:01 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-0cfbf328-5284-4582-a681-e5afcf2fa9df tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Lock "7fc86edc-e217-4c70-88f8-02f4618d7ae0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:30:01 user nova-compute[75337]: INFO nova.compute.manager [None req-0cfbf328-5284-4582-a681-e5afcf2fa9df tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] [instance: 7fc86edc-e217-4c70-88f8-02f4618d7ae0] Terminating instance
Nov 06 16:30:01 user nova-compute[75337]: DEBUG nova.compute.manager [None req-0cfbf328-5284-4582-a681-e5afcf2fa9df tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] [instance: 7fc86edc-e217-4c70-88f8-02f4618d7ae0] Start destroying the instance on the hypervisor. {{(pid=75337) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 16:30:01 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:30:01 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:30:01 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:30:01 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:30:01 user nova-compute[75337]: DEBUG nova.compute.manager [req-9992e002-7a04-4a04-97c6-0184f7c144ff req-0c311989-a4b1-47cc-a018-85a6a5518d3c service nova] [instance: 7fc86edc-e217-4c70-88f8-02f4618d7ae0] Received event network-vif-unplugged-f9a9cc4f-9e35-485e-988b-2fcfbd4ad748 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:30:01 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-9992e002-7a04-4a04-97c6-0184f7c144ff req-0c311989-a4b1-47cc-a018-85a6a5518d3c service nova] Acquiring lock "7fc86edc-e217-4c70-88f8-02f4618d7ae0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:30:01 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-9992e002-7a04-4a04-97c6-0184f7c144ff req-0c311989-a4b1-47cc-a018-85a6a5518d3c service nova] Lock "7fc86edc-e217-4c70-88f8-02f4618d7ae0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:30:01 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-9992e002-7a04-4a04-97c6-0184f7c144ff req-0c311989-a4b1-47cc-a018-85a6a5518d3c service nova] Lock "7fc86edc-e217-4c70-88f8-02f4618d7ae0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:30:01 user nova-compute[75337]: DEBUG nova.compute.manager [req-9992e002-7a04-4a04-97c6-0184f7c144ff req-0c311989-a4b1-47cc-a018-85a6a5518d3c service nova] [instance: 7fc86edc-e217-4c70-88f8-02f4618d7ae0] No waiting events found dispatching network-vif-unplugged-f9a9cc4f-9e35-485e-988b-2fcfbd4ad748 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 16:30:01 user nova-compute[75337]: DEBUG nova.compute.manager [req-9992e002-7a04-4a04-97c6-0184f7c144ff req-0c311989-a4b1-47cc-a018-85a6a5518d3c service nova] [instance: 7fc86edc-e217-4c70-88f8-02f4618d7ae0] Received event network-vif-unplugged-f9a9cc4f-9e35-485e-988b-2fcfbd4ad748 for instance with task_state deleting. {{(pid=75337) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 16:30:02 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:30:02 user nova-compute[75337]: INFO nova.virt.libvirt.driver [-] [instance: 7fc86edc-e217-4c70-88f8-02f4618d7ae0] Instance destroyed successfully.
Nov 06 16:30:02 user nova-compute[75337]: DEBUG nova.objects.instance [None req-0cfbf328-5284-4582-a681-e5afcf2fa9df tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Lazy-loading 'resources' on Instance uuid 7fc86edc-e217-4c70-88f8-02f4618d7ae0 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 16:30:02 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-0cfbf328-5284-4582-a681-e5afcf2fa9df tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T16:23:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-567659544',display_name='tempest-ServerRescueNegativeTestJSON-server-567659544',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-567659544',id=51,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKCnwS9V2datn/d83z1Ldzc4r6vlQ1N+FoURVDDxeb+oh6NM9SfP5Ne+mUOvSzwFBDwZ2iQPrPcxMtYEj6Zhw1KRsLXtveytGBAgQSJy5Blq0NiUK/k8xSRWkrZB/atZ2Q==',key_name='tempest-keypair-630615777',keypairs=<?>,launch_index=0,launched_at=2023-11-06T16:25:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f71610b3d00f412ea4aeba8068d032fc',ramdisk_id='',reservation_id='r-vht4ttph',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1763914139',owner_user_name='tempest-ServerRescueNegativeTestJSON-1763914139-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T16:27:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='22979798bd154fd3af622e408520e95c',uuid=7fc86edc-e217-4c70-88f8-02f4618d7ae0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f9a9cc4f-9e35-485e-988b-2fcfbd4ad748", "address": "fa:16:3e:40:ad:75", "network": {"id": "0da0e0bd-b07e-4ae1-8625-a979ed32bd07", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-528047864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f71610b3d00f412ea4aeba8068d032fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9a9cc4f-9e", "ovs_interfaceid": "f9a9cc4f-9e35-485e-988b-2fcfbd4ad748", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 16:30:02 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-0cfbf328-5284-4582-a681-e5afcf2fa9df tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Converting VIF {"id": "f9a9cc4f-9e35-485e-988b-2fcfbd4ad748", "address": "fa:16:3e:40:ad:75", "network": {"id": "0da0e0bd-b07e-4ae1-8625-a979ed32bd07", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-528047864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f71610b3d00f412ea4aeba8068d032fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9a9cc4f-9e", "ovs_interfaceid": "f9a9cc4f-9e35-485e-988b-2fcfbd4ad748", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 16:30:02 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-0cfbf328-5284-4582-a681-e5afcf2fa9df tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:40:ad:75,bridge_name='br-int',has_traffic_filtering=True,id=f9a9cc4f-9e35-485e-988b-2fcfbd4ad748,network=Network(0da0e0bd-b07e-4ae1-8625-a979ed32bd07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9a9cc4f-9e') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 16:30:02 user nova-compute[75337]: DEBUG os_vif [None req-0cfbf328-5284-4582-a681-e5afcf2fa9df tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:40:ad:75,bridge_name='br-int',has_traffic_filtering=True,id=f9a9cc4f-9e35-485e-988b-2fcfbd4ad748,network=Network(0da0e0bd-b07e-4ae1-8625-a979ed32bd07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9a9cc4f-9e') {{(pid=75337) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 16:30:02 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:30:02 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf9a9cc4f-9e, bridge=br-int, if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 16:30:02 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:30:02 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:30:02 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=80cdffe5-aca2-4889-a4e7-663da1f774b7) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 16:30:02 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:30:02 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:30:02 user nova-compute[75337]: INFO os_vif [None req-0cfbf328-5284-4582-a681-e5afcf2fa9df tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:40:ad:75,bridge_name='br-int',has_traffic_filtering=True,id=f9a9cc4f-9e35-485e-988b-2fcfbd4ad748,network=Network(0da0e0bd-b07e-4ae1-8625-a979ed32bd07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9a9cc4f-9e')
Nov 06 16:30:02 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-0cfbf328-5284-4582-a681-e5afcf2fa9df tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] [instance: 7fc86edc-e217-4c70-88f8-02f4618d7ae0] Deleting instance files /opt/stack/data/nova/instances/7fc86edc-e217-4c70-88f8-02f4618d7ae0_del
Nov 06 16:30:02 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-0cfbf328-5284-4582-a681-e5afcf2fa9df tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] [instance: 7fc86edc-e217-4c70-88f8-02f4618d7ae0] Deletion of /opt/stack/data/nova/instances/7fc86edc-e217-4c70-88f8-02f4618d7ae0_del complete
Nov 06 16:30:02 user nova-compute[75337]: INFO nova.compute.manager [None req-0cfbf328-5284-4582-a681-e5afcf2fa9df tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] [instance: 7fc86edc-e217-4c70-88f8-02f4618d7ae0] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 06 16:30:02 user nova-compute[75337]: DEBUG oslo.service.loopingcall [None req-0cfbf328-5284-4582-a681-e5afcf2fa9df tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75337) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 16:30:02 user nova-compute[75337]: DEBUG nova.compute.manager [-] [instance: 7fc86edc-e217-4c70-88f8-02f4618d7ae0] Deallocating network for instance {{(pid=75337) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 16:30:02 user nova-compute[75337]: DEBUG nova.network.neutron [-] [instance: 7fc86edc-e217-4c70-88f8-02f4618d7ae0] deallocate_for_instance() {{(pid=75337) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 16:30:03 user nova-compute[75337]: DEBUG nova.network.neutron [-] [instance: 7fc86edc-e217-4c70-88f8-02f4618d7ae0] Updating instance_info_cache with network_info: [] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 16:30:03 user nova-compute[75337]: INFO nova.compute.manager [-] [instance: 7fc86edc-e217-4c70-88f8-02f4618d7ae0] Took 1.22 seconds to deallocate network for instance.
Nov 06 16:30:03 user nova-compute[75337]: DEBUG nova.compute.manager [req-b7537edc-69b9-4830-be88-cc664b0b8005 req-695facf3-75c6-4dfd-ad83-0092f3a4d81b service nova] [instance: 7fc86edc-e217-4c70-88f8-02f4618d7ae0] Received event network-vif-deleted-f9a9cc4f-9e35-485e-988b-2fcfbd4ad748 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:30:04 user nova-compute[75337]: DEBUG nova.compute.manager [req-76125252-589a-4485-84c8-70824362e6d3 req-e90f0806-c3d5-4701-8bbf-8a2a3aa7c683 service nova] [instance: 7fc86edc-e217-4c70-88f8-02f4618d7ae0] Received event network-vif-plugged-f9a9cc4f-9e35-485e-988b-2fcfbd4ad748 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:30:04 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-76125252-589a-4485-84c8-70824362e6d3 req-e90f0806-c3d5-4701-8bbf-8a2a3aa7c683 service nova] Acquiring lock "7fc86edc-e217-4c70-88f8-02f4618d7ae0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:30:04 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-76125252-589a-4485-84c8-70824362e6d3 req-e90f0806-c3d5-4701-8bbf-8a2a3aa7c683 service nova] Lock "7fc86edc-e217-4c70-88f8-02f4618d7ae0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:30:04 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-76125252-589a-4485-84c8-70824362e6d3 req-e90f0806-c3d5-4701-8bbf-8a2a3aa7c683 service nova] Lock "7fc86edc-e217-4c70-88f8-02f4618d7ae0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:30:04 user nova-compute[75337]: DEBUG nova.compute.manager [req-76125252-589a-4485-84c8-70824362e6d3 req-e90f0806-c3d5-4701-8bbf-8a2a3aa7c683 service nova] [instance: 7fc86edc-e217-4c70-88f8-02f4618d7ae0] No waiting events found dispatching network-vif-plugged-f9a9cc4f-9e35-485e-988b-2fcfbd4ad748 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 16:30:04 user nova-compute[75337]: WARNING nova.compute.manager [req-76125252-589a-4485-84c8-70824362e6d3 req-e90f0806-c3d5-4701-8bbf-8a2a3aa7c683 service nova] [instance: 7fc86edc-e217-4c70-88f8-02f4618d7ae0] Received unexpected event network-vif-plugged-f9a9cc4f-9e35-485e-988b-2fcfbd4ad748 for instance with vm_state active and task_state deleting.
Nov 06 16:30:04 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-0cfbf328-5284-4582-a681-e5afcf2fa9df tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:30:04 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-0cfbf328-5284-4582-a681-e5afcf2fa9df tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:30:04 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-0cfbf328-5284-4582-a681-e5afcf2fa9df tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 16:30:04 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-0cfbf328-5284-4582-a681-e5afcf2fa9df tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 16:30:04 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-0cfbf328-5284-4582-a681-e5afcf2fa9df tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.198s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:30:04 user nova-compute[75337]: INFO nova.scheduler.client.report [None req-0cfbf328-5284-4582-a681-e5afcf2fa9df tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Deleted allocations for instance 7fc86edc-e217-4c70-88f8-02f4618d7ae0
Nov 06 16:30:04 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-0cfbf328-5284-4582-a681-e5afcf2fa9df tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Lock "7fc86edc-e217-4c70-88f8-02f4618d7ae0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.819s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:30:04 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:30:04 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Cleaning up deleted instances with incomplete migration  {{(pid=75337) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 06 16:30:05 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:30:05 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Cleaning up deleted instances {{(pid=75337) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 06 16:30:05 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] There are 0 instances to clean {{(pid=75337) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 06 16:30:07 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:30:12 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:30:12 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:30:12 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75337) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 16:30:12 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 16:30:12 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 16:30:12 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:30:17 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:30:22 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:30:22 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:30:27 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:30:27 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:30:27 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75337) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 16:30:27 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 16:30:27 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 16:30:27 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:30:31 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:30:32 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:30:37 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:30:37 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:30:37 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75337) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 16:30:38 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:30:41 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:30:41 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:30:42 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:30:42 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:30:45 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:30:47 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:30:51 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:30:51 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Starting heal instance info cache {{(pid=75337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 16:30:51 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Rebuilding the list of instances to heal {{(pid=75337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 06 16:30:51 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "refresh_cache-525c87e5-14c3-40fd-8976-8df151ed07fa" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 16:30:51 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquired lock "refresh_cache-525c87e5-14c3-40fd-8976-8df151ed07fa" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 16:30:51 user nova-compute[75337]: DEBUG nova.network.neutron [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] [instance: 525c87e5-14c3-40fd-8976-8df151ed07fa] Forcefully refreshing network info cache for instance {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 16:30:51 user nova-compute[75337]: DEBUG nova.objects.instance [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lazy-loading 'info_cache' on Instance uuid 525c87e5-14c3-40fd-8976-8df151ed07fa {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 16:30:52 user nova-compute[75337]: DEBUG nova.network.neutron [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] [instance: 525c87e5-14c3-40fd-8976-8df151ed07fa] Updating instance_info_cache with network_info: [{"id": "1dfbe337-9efa-4a6a-9801-e9264673d095", "address": "fa:16:3e:fd:18:f1", "network": {"id": "0da0e0bd-b07e-4ae1-8625-a979ed32bd07", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-528047864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f71610b3d00f412ea4aeba8068d032fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dfbe337-9e", "ovs_interfaceid": "1dfbe337-9efa-4a6a-9801-e9264673d095", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 16:30:52 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Releasing lock "refresh_cache-525c87e5-14c3-40fd-8976-8df151ed07fa" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 16:30:52 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] [instance: 525c87e5-14c3-40fd-8976-8df151ed07fa] Updated the network info_cache for instance {{(pid=75337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 16:30:52 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:30:52 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:30:55 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:30:55 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager.update_available_resource {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:30:55 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:30:55 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:30:55 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:30:55 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Auditing locally available compute resources for user (node: user) {{(pid=75337) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 16:30:55 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525c87e5-14c3-40fd-8976-8df151ed07fa/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:30:55 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525c87e5-14c3-40fd-8976-8df151ed07fa/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:30:55 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525c87e5-14c3-40fd-8976-8df151ed07fa/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:30:56 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525c87e5-14c3-40fd-8976-8df151ed07fa/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:30:56 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de77f786-1ecf-4eac-ae4a-c4f6b1d47339/disk.rescue --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:30:56 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de77f786-1ecf-4eac-ae4a-c4f6b1d47339/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:30:56 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de77f786-1ecf-4eac-ae4a-c4f6b1d47339/disk.rescue --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:30:56 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de77f786-1ecf-4eac-ae4a-c4f6b1d47339/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:30:56 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de77f786-1ecf-4eac-ae4a-c4f6b1d47339/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:30:56 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de77f786-1ecf-4eac-ae4a-c4f6b1d47339/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:30:56 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de77f786-1ecf-4eac-ae4a-c4f6b1d47339/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:30:56 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de77f786-1ecf-4eac-ae4a-c4f6b1d47339/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:30:57 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 16:30:57 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 16:30:57 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Hypervisor/Node resource view: name=user free_ram=8894MB free_disk=24.97690200805664GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75337) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 16:30:57 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:30:57 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:30:57 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 525c87e5-14c3-40fd-8976-8df151ed07fa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 16:30:57 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance de77f786-1ecf-4eac-ae4a-c4f6b1d47339 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 16:30:57 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 16:30:57 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 16:30:57 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:30:57 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 16:30:57 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 16:30:57 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Compute_service record updated for user:user {{(pid=75337) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 16:30:57 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.267s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:31:02 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:31:07 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:31:12 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:31:14 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-d0064d09-4d98-438a-86c5-7589dba02416 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Acquiring lock "de77f786-1ecf-4eac-ae4a-c4f6b1d47339" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:31:14 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-d0064d09-4d98-438a-86c5-7589dba02416 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Lock "de77f786-1ecf-4eac-ae4a-c4f6b1d47339" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:31:14 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-d0064d09-4d98-438a-86c5-7589dba02416 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Acquiring lock "de77f786-1ecf-4eac-ae4a-c4f6b1d47339-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:31:14 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-d0064d09-4d98-438a-86c5-7589dba02416 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Lock "de77f786-1ecf-4eac-ae4a-c4f6b1d47339-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:31:14 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-d0064d09-4d98-438a-86c5-7589dba02416 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Lock "de77f786-1ecf-4eac-ae4a-c4f6b1d47339-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:31:14 user nova-compute[75337]: INFO nova.compute.manager [None req-d0064d09-4d98-438a-86c5-7589dba02416 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] [instance: de77f786-1ecf-4eac-ae4a-c4f6b1d47339] Terminating instance
Nov 06 16:31:14 user nova-compute[75337]: DEBUG nova.compute.manager [None req-d0064d09-4d98-438a-86c5-7589dba02416 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] [instance: de77f786-1ecf-4eac-ae4a-c4f6b1d47339] Start destroying the instance on the hypervisor. {{(pid=75337) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 16:31:14 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:31:14 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:31:14 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:31:14 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:31:14 user nova-compute[75337]: DEBUG nova.compute.manager [req-7a89793e-0070-4ffc-b7ed-8ac3177dd0e4 req-dfb7009f-3421-4619-9bc0-b13ca07e0483 service nova] [instance: de77f786-1ecf-4eac-ae4a-c4f6b1d47339] Received event network-vif-unplugged-8f33a5c0-50e1-4bac-a686-733daf33a307 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:31:14 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-7a89793e-0070-4ffc-b7ed-8ac3177dd0e4 req-dfb7009f-3421-4619-9bc0-b13ca07e0483 service nova] Acquiring lock "de77f786-1ecf-4eac-ae4a-c4f6b1d47339-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:31:14 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-7a89793e-0070-4ffc-b7ed-8ac3177dd0e4 req-dfb7009f-3421-4619-9bc0-b13ca07e0483 service nova] Lock "de77f786-1ecf-4eac-ae4a-c4f6b1d47339-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:31:14 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-7a89793e-0070-4ffc-b7ed-8ac3177dd0e4 req-dfb7009f-3421-4619-9bc0-b13ca07e0483 service nova] Lock "de77f786-1ecf-4eac-ae4a-c4f6b1d47339-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:31:14 user nova-compute[75337]: DEBUG nova.compute.manager [req-7a89793e-0070-4ffc-b7ed-8ac3177dd0e4 req-dfb7009f-3421-4619-9bc0-b13ca07e0483 service nova] [instance: de77f786-1ecf-4eac-ae4a-c4f6b1d47339] No waiting events found dispatching network-vif-unplugged-8f33a5c0-50e1-4bac-a686-733daf33a307 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 16:31:14 user nova-compute[75337]: DEBUG nova.compute.manager [req-7a89793e-0070-4ffc-b7ed-8ac3177dd0e4 req-dfb7009f-3421-4619-9bc0-b13ca07e0483 service nova] [instance: de77f786-1ecf-4eac-ae4a-c4f6b1d47339] Received event network-vif-unplugged-8f33a5c0-50e1-4bac-a686-733daf33a307 for instance with task_state deleting. {{(pid=75337) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 16:31:14 user nova-compute[75337]: INFO nova.virt.libvirt.driver [-] [instance: de77f786-1ecf-4eac-ae4a-c4f6b1d47339] Instance destroyed successfully.
Nov 06 16:31:14 user nova-compute[75337]: DEBUG nova.objects.instance [None req-d0064d09-4d98-438a-86c5-7589dba02416 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Lazy-loading 'resources' on Instance uuid de77f786-1ecf-4eac-ae4a-c4f6b1d47339 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 16:31:14 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-d0064d09-4d98-438a-86c5-7589dba02416 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T16:14:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1866514788',display_name='tempest-ServerRescueNegativeTestJSON-server-1866514788',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1866514788',id=50,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-06T16:16:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f71610b3d00f412ea4aeba8068d032fc',ramdisk_id='',reservation_id='r-b48pf70m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1763914139',owner_user_name='tempest-ServerRescueNegativeTestJSON-1763914139-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T16:16:21Z,user_data=None,user_id='22979798bd154fd3af622e408520e95c',uuid=de77f786-1ecf-4eac-ae4a-c4f6b1d47339,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "8f33a5c0-50e1-4bac-a686-733daf33a307", "address": "fa:16:3e:4b:fc:cf", "network": {"id": "0da0e0bd-b07e-4ae1-8625-a979ed32bd07", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-528047864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f71610b3d00f412ea4aeba8068d032fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f33a5c0-50", "ovs_interfaceid": "8f33a5c0-50e1-4bac-a686-733daf33a307", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 16:31:14 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-d0064d09-4d98-438a-86c5-7589dba02416 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Converting VIF {"id": "8f33a5c0-50e1-4bac-a686-733daf33a307", "address": "fa:16:3e:4b:fc:cf", "network": {"id": "0da0e0bd-b07e-4ae1-8625-a979ed32bd07", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-528047864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f71610b3d00f412ea4aeba8068d032fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f33a5c0-50", "ovs_interfaceid": "8f33a5c0-50e1-4bac-a686-733daf33a307", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 16:31:14 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-d0064d09-4d98-438a-86c5-7589dba02416 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4b:fc:cf,bridge_name='br-int',has_traffic_filtering=True,id=8f33a5c0-50e1-4bac-a686-733daf33a307,network=Network(0da0e0bd-b07e-4ae1-8625-a979ed32bd07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f33a5c0-50') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 16:31:14 user nova-compute[75337]: DEBUG os_vif [None req-d0064d09-4d98-438a-86c5-7589dba02416 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4b:fc:cf,bridge_name='br-int',has_traffic_filtering=True,id=8f33a5c0-50e1-4bac-a686-733daf33a307,network=Network(0da0e0bd-b07e-4ae1-8625-a979ed32bd07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f33a5c0-50') {{(pid=75337) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 16:31:14 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:31:14 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8f33a5c0-50, bridge=br-int, if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 16:31:14 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:31:14 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:31:14 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:31:14 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=61ed3663-738b-4c71-9858-2c1979a30f7b) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 16:31:14 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:31:14 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:31:14 user nova-compute[75337]: INFO os_vif [None req-d0064d09-4d98-438a-86c5-7589dba02416 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4b:fc:cf,bridge_name='br-int',has_traffic_filtering=True,id=8f33a5c0-50e1-4bac-a686-733daf33a307,network=Network(0da0e0bd-b07e-4ae1-8625-a979ed32bd07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f33a5c0-50')
Nov 06 16:31:14 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-d0064d09-4d98-438a-86c5-7589dba02416 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] [instance: de77f786-1ecf-4eac-ae4a-c4f6b1d47339] Deleting instance files /opt/stack/data/nova/instances/de77f786-1ecf-4eac-ae4a-c4f6b1d47339_del
Nov 06 16:31:14 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-d0064d09-4d98-438a-86c5-7589dba02416 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] [instance: de77f786-1ecf-4eac-ae4a-c4f6b1d47339] Deletion of /opt/stack/data/nova/instances/de77f786-1ecf-4eac-ae4a-c4f6b1d47339_del complete
Nov 06 16:31:15 user nova-compute[75337]: INFO nova.compute.manager [None req-d0064d09-4d98-438a-86c5-7589dba02416 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] [instance: de77f786-1ecf-4eac-ae4a-c4f6b1d47339] Took 0.66 seconds to destroy the instance on the hypervisor.
Nov 06 16:31:15 user nova-compute[75337]: DEBUG oslo.service.loopingcall [None req-d0064d09-4d98-438a-86c5-7589dba02416 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75337) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 16:31:15 user nova-compute[75337]: DEBUG nova.compute.manager [-] [instance: de77f786-1ecf-4eac-ae4a-c4f6b1d47339] Deallocating network for instance {{(pid=75337) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 16:31:15 user nova-compute[75337]: DEBUG nova.network.neutron [-] [instance: de77f786-1ecf-4eac-ae4a-c4f6b1d47339] deallocate_for_instance() {{(pid=75337) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 16:31:15 user nova-compute[75337]: DEBUG nova.network.neutron [-] [instance: de77f786-1ecf-4eac-ae4a-c4f6b1d47339] Updating instance_info_cache with network_info: [] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 16:31:15 user nova-compute[75337]: INFO nova.compute.manager [-] [instance: de77f786-1ecf-4eac-ae4a-c4f6b1d47339] Took 0.47 seconds to deallocate network for instance.
Nov 06 16:31:15 user nova-compute[75337]: DEBUG nova.compute.manager [req-bd21ec18-dfc9-4fae-9ad7-7d2d728dc6db req-d6b7d292-34c1-4d6f-a1e2-cf32fa0d08a7 service nova] [instance: de77f786-1ecf-4eac-ae4a-c4f6b1d47339] Received event network-vif-deleted-8f33a5c0-50e1-4bac-a686-733daf33a307 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:31:15 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-d0064d09-4d98-438a-86c5-7589dba02416 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:31:15 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-d0064d09-4d98-438a-86c5-7589dba02416 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:31:15 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-d0064d09-4d98-438a-86c5-7589dba02416 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 16:31:15 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-d0064d09-4d98-438a-86c5-7589dba02416 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 16:31:15 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-d0064d09-4d98-438a-86c5-7589dba02416 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.163s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:31:15 user nova-compute[75337]: INFO nova.scheduler.client.report [None req-d0064d09-4d98-438a-86c5-7589dba02416 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Deleted allocations for instance de77f786-1ecf-4eac-ae4a-c4f6b1d47339
Nov 06 16:31:15 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-d0064d09-4d98-438a-86c5-7589dba02416 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Lock "de77f786-1ecf-4eac-ae4a-c4f6b1d47339" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.502s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:31:16 user nova-compute[75337]: DEBUG nova.compute.manager [req-d8b42cdc-4402-4979-a26a-b145df08b745 req-403e68b5-73e2-4788-86ea-2e452ada579b service nova] [instance: de77f786-1ecf-4eac-ae4a-c4f6b1d47339] Received event network-vif-plugged-8f33a5c0-50e1-4bac-a686-733daf33a307 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:31:16 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-d8b42cdc-4402-4979-a26a-b145df08b745 req-403e68b5-73e2-4788-86ea-2e452ada579b service nova] Acquiring lock "de77f786-1ecf-4eac-ae4a-c4f6b1d47339-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:31:16 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-d8b42cdc-4402-4979-a26a-b145df08b745 req-403e68b5-73e2-4788-86ea-2e452ada579b service nova] Lock "de77f786-1ecf-4eac-ae4a-c4f6b1d47339-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:31:16 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-d8b42cdc-4402-4979-a26a-b145df08b745 req-403e68b5-73e2-4788-86ea-2e452ada579b service nova] Lock "de77f786-1ecf-4eac-ae4a-c4f6b1d47339-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:31:16 user nova-compute[75337]: DEBUG nova.compute.manager [req-d8b42cdc-4402-4979-a26a-b145df08b745 req-403e68b5-73e2-4788-86ea-2e452ada579b service nova] [instance: de77f786-1ecf-4eac-ae4a-c4f6b1d47339] No waiting events found dispatching network-vif-plugged-8f33a5c0-50e1-4bac-a686-733daf33a307 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 16:31:16 user nova-compute[75337]: WARNING nova.compute.manager [req-d8b42cdc-4402-4979-a26a-b145df08b745 req-403e68b5-73e2-4788-86ea-2e452ada579b service nova] [instance: de77f786-1ecf-4eac-ae4a-c4f6b1d47339] Received unexpected event network-vif-plugged-8f33a5c0-50e1-4bac-a686-733daf33a307 for instance with vm_state deleted and task_state None.
Nov 06 16:31:19 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:31:24 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:31:29 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:31:34 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:31:34 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:31:38 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:31:38 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:31:38 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75337) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 16:31:39 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:31:41 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:31:42 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:31:43 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:31:44 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:31:46 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:31:49 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:31:51 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:31:51 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Starting heal instance info cache {{(pid=75337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 16:31:51 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Didn't find any instances for network info cache update. {{(pid=75337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 06 16:31:54 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:31:57 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager.update_available_resource {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:31:57 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:31:57 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:31:57 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:31:57 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Auditing locally available compute resources for user (node: user) {{(pid=75337) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 16:31:57 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525c87e5-14c3-40fd-8976-8df151ed07fa/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:31:57 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525c87e5-14c3-40fd-8976-8df151ed07fa/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:31:57 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525c87e5-14c3-40fd-8976-8df151ed07fa/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:31:58 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525c87e5-14c3-40fd-8976-8df151ed07fa/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:31:58 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 16:31:58 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 16:31:58 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Hypervisor/Node resource view: name=user free_ram=8970MB free_disk=25.00432586669922GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75337) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 16:31:58 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:31:58 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:31:58 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 525c87e5-14c3-40fd-8976-8df151ed07fa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 16:31:58 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 16:31:58 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 16:31:58 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 16:31:58 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 16:31:58 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Compute_service record updated for user:user {{(pid=75337) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 16:31:58 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.379s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:31:59 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:32:04 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-8de37e6f-f3f7-4703-b5c1-28e208281ac0 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Acquiring lock "525c87e5-14c3-40fd-8976-8df151ed07fa" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:32:04 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-8de37e6f-f3f7-4703-b5c1-28e208281ac0 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Lock "525c87e5-14c3-40fd-8976-8df151ed07fa" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:32:04 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-8de37e6f-f3f7-4703-b5c1-28e208281ac0 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Acquiring lock "525c87e5-14c3-40fd-8976-8df151ed07fa-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:32:04 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-8de37e6f-f3f7-4703-b5c1-28e208281ac0 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Lock "525c87e5-14c3-40fd-8976-8df151ed07fa-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:32:04 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-8de37e6f-f3f7-4703-b5c1-28e208281ac0 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Lock "525c87e5-14c3-40fd-8976-8df151ed07fa-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:32:04 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:32:04 user nova-compute[75337]: INFO nova.compute.manager [None req-8de37e6f-f3f7-4703-b5c1-28e208281ac0 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] [instance: 525c87e5-14c3-40fd-8976-8df151ed07fa] Terminating instance
Nov 06 16:32:04 user nova-compute[75337]: DEBUG nova.compute.manager [None req-8de37e6f-f3f7-4703-b5c1-28e208281ac0 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] [instance: 525c87e5-14c3-40fd-8976-8df151ed07fa] Start destroying the instance on the hypervisor. {{(pid=75337) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 16:32:05 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:32:05 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:32:05 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:32:05 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:32:05 user nova-compute[75337]: DEBUG nova.compute.manager [req-e104b23a-f300-4a98-9dbf-8e14dc5afa6e req-aafe45e6-27b2-4310-a115-dbe42c929175 service nova] [instance: 525c87e5-14c3-40fd-8976-8df151ed07fa] Received event network-vif-unplugged-1dfbe337-9efa-4a6a-9801-e9264673d095 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:32:05 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-e104b23a-f300-4a98-9dbf-8e14dc5afa6e req-aafe45e6-27b2-4310-a115-dbe42c929175 service nova] Acquiring lock "525c87e5-14c3-40fd-8976-8df151ed07fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:32:05 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-e104b23a-f300-4a98-9dbf-8e14dc5afa6e req-aafe45e6-27b2-4310-a115-dbe42c929175 service nova] Lock "525c87e5-14c3-40fd-8976-8df151ed07fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:32:05 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-e104b23a-f300-4a98-9dbf-8e14dc5afa6e req-aafe45e6-27b2-4310-a115-dbe42c929175 service nova] Lock "525c87e5-14c3-40fd-8976-8df151ed07fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:32:05 user nova-compute[75337]: DEBUG nova.compute.manager [req-e104b23a-f300-4a98-9dbf-8e14dc5afa6e req-aafe45e6-27b2-4310-a115-dbe42c929175 service nova] [instance: 525c87e5-14c3-40fd-8976-8df151ed07fa] No waiting events found dispatching network-vif-unplugged-1dfbe337-9efa-4a6a-9801-e9264673d095 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 16:32:05 user nova-compute[75337]: DEBUG nova.compute.manager [req-e104b23a-f300-4a98-9dbf-8e14dc5afa6e req-aafe45e6-27b2-4310-a115-dbe42c929175 service nova] [instance: 525c87e5-14c3-40fd-8976-8df151ed07fa] Received event network-vif-unplugged-1dfbe337-9efa-4a6a-9801-e9264673d095 for instance with task_state deleting. {{(pid=75337) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 16:32:05 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:32:05 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:32:05 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:32:05 user nova-compute[75337]: INFO nova.virt.libvirt.driver [-] [instance: 525c87e5-14c3-40fd-8976-8df151ed07fa] Instance destroyed successfully.
Nov 06 16:32:05 user nova-compute[75337]: DEBUG nova.objects.instance [None req-8de37e6f-f3f7-4703-b5c1-28e208281ac0 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Lazy-loading 'resources' on Instance uuid 525c87e5-14c3-40fd-8976-8df151ed07fa {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 16:32:05 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-8de37e6f-f3f7-4703-b5c1-28e208281ac0 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T16:14:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1386418707',display_name='tempest-ServerRescueNegativeTestJSON-server-1386418707',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1386418707',id=49,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-06T16:19:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f71610b3d00f412ea4aeba8068d032fc',ramdisk_id='',reservation_id='r-kcpcz2gd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1763914139',owner_user_name='tempest-ServerRescueNegativeTestJSON-1763914139-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T16:21:09Z,user_data=None,user_id='22979798bd154fd3af622e408520e95c',uuid=525c87e5-14c3-40fd-8976-8df151ed07fa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1dfbe337-9efa-4a6a-9801-e9264673d095", "address": "fa:16:3e:fd:18:f1", "network": {"id": "0da0e0bd-b07e-4ae1-8625-a979ed32bd07", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-528047864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f71610b3d00f412ea4aeba8068d032fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dfbe337-9e", "ovs_interfaceid": "1dfbe337-9efa-4a6a-9801-e9264673d095", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 16:32:05 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-8de37e6f-f3f7-4703-b5c1-28e208281ac0 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Converting VIF {"id": "1dfbe337-9efa-4a6a-9801-e9264673d095", "address": "fa:16:3e:fd:18:f1", "network": {"id": "0da0e0bd-b07e-4ae1-8625-a979ed32bd07", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-528047864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f71610b3d00f412ea4aeba8068d032fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dfbe337-9e", "ovs_interfaceid": "1dfbe337-9efa-4a6a-9801-e9264673d095", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 16:32:05 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-8de37e6f-f3f7-4703-b5c1-28e208281ac0 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fd:18:f1,bridge_name='br-int',has_traffic_filtering=True,id=1dfbe337-9efa-4a6a-9801-e9264673d095,network=Network(0da0e0bd-b07e-4ae1-8625-a979ed32bd07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1dfbe337-9e') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 16:32:05 user nova-compute[75337]: DEBUG os_vif [None req-8de37e6f-f3f7-4703-b5c1-28e208281ac0 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fd:18:f1,bridge_name='br-int',has_traffic_filtering=True,id=1dfbe337-9efa-4a6a-9801-e9264673d095,network=Network(0da0e0bd-b07e-4ae1-8625-a979ed32bd07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1dfbe337-9e') {{(pid=75337) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 16:32:05 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:32:05 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1dfbe337-9e, bridge=br-int, if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 16:32:05 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:32:05 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:32:05 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:32:05 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4cf55868-31a7-4c71-9605-148169ba73eb) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 16:32:05 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:32:05 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:32:05 user nova-compute[75337]: INFO os_vif [None req-8de37e6f-f3f7-4703-b5c1-28e208281ac0 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fd:18:f1,bridge_name='br-int',has_traffic_filtering=True,id=1dfbe337-9efa-4a6a-9801-e9264673d095,network=Network(0da0e0bd-b07e-4ae1-8625-a979ed32bd07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1dfbe337-9e')
Nov 06 16:32:05 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-8de37e6f-f3f7-4703-b5c1-28e208281ac0 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] [instance: 525c87e5-14c3-40fd-8976-8df151ed07fa] Deleting instance files /opt/stack/data/nova/instances/525c87e5-14c3-40fd-8976-8df151ed07fa_del
Nov 06 16:32:05 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-8de37e6f-f3f7-4703-b5c1-28e208281ac0 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] [instance: 525c87e5-14c3-40fd-8976-8df151ed07fa] Deletion of /opt/stack/data/nova/instances/525c87e5-14c3-40fd-8976-8df151ed07fa_del complete
Nov 06 16:32:05 user nova-compute[75337]: INFO nova.compute.manager [None req-8de37e6f-f3f7-4703-b5c1-28e208281ac0 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] [instance: 525c87e5-14c3-40fd-8976-8df151ed07fa] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 06 16:32:05 user nova-compute[75337]: DEBUG oslo.service.loopingcall [None req-8de37e6f-f3f7-4703-b5c1-28e208281ac0 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75337) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 16:32:05 user nova-compute[75337]: DEBUG nova.compute.manager [-] [instance: 525c87e5-14c3-40fd-8976-8df151ed07fa] Deallocating network for instance {{(pid=75337) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 16:32:05 user nova-compute[75337]: DEBUG nova.network.neutron [-] [instance: 525c87e5-14c3-40fd-8976-8df151ed07fa] deallocate_for_instance() {{(pid=75337) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 16:32:06 user nova-compute[75337]: DEBUG nova.network.neutron [-] [instance: 525c87e5-14c3-40fd-8976-8df151ed07fa] Updating instance_info_cache with network_info: [] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 16:32:06 user nova-compute[75337]: INFO nova.compute.manager [-] [instance: 525c87e5-14c3-40fd-8976-8df151ed07fa] Took 0.46 seconds to deallocate network for instance.
Nov 06 16:32:06 user nova-compute[75337]: DEBUG nova.compute.manager [req-a797e9cc-88a7-40e1-a373-0c5e90a8e7e1 req-9c9b4572-69aa-495c-8b89-aeb0189385b7 service nova] [instance: 525c87e5-14c3-40fd-8976-8df151ed07fa] Received event network-vif-deleted-1dfbe337-9efa-4a6a-9801-e9264673d095 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:32:06 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-8de37e6f-f3f7-4703-b5c1-28e208281ac0 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:32:06 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-8de37e6f-f3f7-4703-b5c1-28e208281ac0 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:32:06 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-8de37e6f-f3f7-4703-b5c1-28e208281ac0 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 16:32:06 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-8de37e6f-f3f7-4703-b5c1-28e208281ac0 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 16:32:06 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-8de37e6f-f3f7-4703-b5c1-28e208281ac0 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.101s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:32:06 user nova-compute[75337]: INFO nova.scheduler.client.report [None req-8de37e6f-f3f7-4703-b5c1-28e208281ac0 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Deleted allocations for instance 525c87e5-14c3-40fd-8976-8df151ed07fa
Nov 06 16:32:06 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-8de37e6f-f3f7-4703-b5c1-28e208281ac0 tempest-ServerRescueNegativeTestJSON-1763914139 tempest-ServerRescueNegativeTestJSON-1763914139-project-member] Lock "525c87e5-14c3-40fd-8976-8df151ed07fa" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.592s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:32:07 user nova-compute[75337]: DEBUG nova.compute.manager [req-e26845a3-e401-4aa6-af17-53fffaf1f740 req-b2134784-33b1-4055-bf3e-bc36d4a363e9 service nova] [instance: 525c87e5-14c3-40fd-8976-8df151ed07fa] Received event network-vif-plugged-1dfbe337-9efa-4a6a-9801-e9264673d095 {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:32:07 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-e26845a3-e401-4aa6-af17-53fffaf1f740 req-b2134784-33b1-4055-bf3e-bc36d4a363e9 service nova] Acquiring lock "525c87e5-14c3-40fd-8976-8df151ed07fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:32:07 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-e26845a3-e401-4aa6-af17-53fffaf1f740 req-b2134784-33b1-4055-bf3e-bc36d4a363e9 service nova] Lock "525c87e5-14c3-40fd-8976-8df151ed07fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:32:07 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-e26845a3-e401-4aa6-af17-53fffaf1f740 req-b2134784-33b1-4055-bf3e-bc36d4a363e9 service nova] Lock "525c87e5-14c3-40fd-8976-8df151ed07fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:32:07 user nova-compute[75337]: DEBUG nova.compute.manager [req-e26845a3-e401-4aa6-af17-53fffaf1f740 req-b2134784-33b1-4055-bf3e-bc36d4a363e9 service nova] [instance: 525c87e5-14c3-40fd-8976-8df151ed07fa] No waiting events found dispatching network-vif-plugged-1dfbe337-9efa-4a6a-9801-e9264673d095 {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 16:32:07 user nova-compute[75337]: WARNING nova.compute.manager [req-e26845a3-e401-4aa6-af17-53fffaf1f740 req-b2134784-33b1-4055-bf3e-bc36d4a363e9 service nova] [instance: 525c87e5-14c3-40fd-8976-8df151ed07fa] Received unexpected event network-vif-plugged-1dfbe337-9efa-4a6a-9801-e9264673d095 for instance with vm_state deleted and task_state None.
Nov 06 16:32:10 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:32:15 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:32:20 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:32:20 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:32:20 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75337) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 16:32:20 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 16:32:20 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 16:32:20 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:32:25 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:32:30 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:32:30 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:32:30 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75337) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 16:32:30 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 16:32:30 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 16:32:30 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:32:34 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:32:35 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:32:38 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:32:38 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:32:38 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75337) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 16:32:40 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:32:43 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:32:43 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:32:45 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:32:45 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:32:45 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:32:45 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75337) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 16:32:45 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 16:32:45 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 16:32:45 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:32:46 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:32:50 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:32:51 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:32:51 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Starting heal instance info cache {{(pid=75337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 16:32:51 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Rebuilding the list of instances to heal {{(pid=75337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 06 16:32:51 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Didn't find any instances for network info cache update. {{(pid=75337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 06 16:32:55 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:32:55 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:32:55 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75337) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 16:32:55 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 16:32:55 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 16:32:55 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:32:56 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:32:57 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:32:57 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager.update_available_resource {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:32:57 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:32:57 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:32:57 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:32:57 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Auditing locally available compute resources for user (node: user) {{(pid=75337) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 16:32:57 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 16:32:57 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 16:32:57 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Hypervisor/Node resource view: name=user free_ram=9117MB free_disk=25.023967742919922GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75337) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 16:32:57 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:32:57 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:32:57 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:32:58 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 16:32:58 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 16:32:58 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 16:32:58 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 16:32:58 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Compute_service record updated for user:user {{(pid=75337) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 16:32:58 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.149s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:33:00 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:33:05 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:33:05 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:33:05 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75337) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 16:33:05 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 16:33:05 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 16:33:05 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:33:10 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:33:15 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:33:20 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:33:25 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:33:30 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:33:35 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:33:35 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:33:38 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:33:39 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:33:39 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75337) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 16:33:40 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:33:45 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:33:45 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:33:45 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_shelved_instances {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:33:45 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:33:45 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:33:45 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:33:45 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75337) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 16:33:45 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 16:33:45 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 16:33:45 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:33:48 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:33:50 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:33:52 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:33:53 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:33:53 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Starting heal instance info cache {{(pid=75337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 16:33:53 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Rebuilding the list of instances to heal {{(pid=75337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 06 16:33:53 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Didn't find any instances for network info cache update. {{(pid=75337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 06 16:33:55 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:33:57 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager.update_available_resource {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:33:57 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:33:57 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:33:57 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:33:57 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Auditing locally available compute resources for user (node: user) {{(pid=75337) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 16:33:57 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 16:33:57 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 16:33:57 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Hypervisor/Node resource view: name=user free_ram=9098MB free_disk=25.02212905883789GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75337) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 16:33:57 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:33:57 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:33:58 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 16:33:58 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 16:33:58 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 16:33:58 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 16:33:58 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Compute_service record updated for user:user {{(pid=75337) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 16:33:58 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.118s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:34:00 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:34:03 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:34:05 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:34:05 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:34:05 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:34:09 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:34:10 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:34:10 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:34:10 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:34:12 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-dcbbead5-6a42-4a1e-9857-6ee6f3fddffe tempest-VolumesActionsTest-1016914342 tempest-VolumesActionsTest-1016914342-project-member] Acquiring lock "66334b94-6886-4b63-b5ee-53f9dc0b4be5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:34:12 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-dcbbead5-6a42-4a1e-9857-6ee6f3fddffe tempest-VolumesActionsTest-1016914342 tempest-VolumesActionsTest-1016914342-project-member] Lock "66334b94-6886-4b63-b5ee-53f9dc0b4be5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:34:12 user nova-compute[75337]: DEBUG nova.compute.manager [None req-dcbbead5-6a42-4a1e-9857-6ee6f3fddffe tempest-VolumesActionsTest-1016914342 tempest-VolumesActionsTest-1016914342-project-member] [instance: 66334b94-6886-4b63-b5ee-53f9dc0b4be5] Starting instance... {{(pid=75337) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 16:34:12 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-dcbbead5-6a42-4a1e-9857-6ee6f3fddffe tempest-VolumesActionsTest-1016914342 tempest-VolumesActionsTest-1016914342-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:34:12 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-dcbbead5-6a42-4a1e-9857-6ee6f3fddffe tempest-VolumesActionsTest-1016914342 tempest-VolumesActionsTest-1016914342-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:34:12 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-dcbbead5-6a42-4a1e-9857-6ee6f3fddffe tempest-VolumesActionsTest-1016914342 tempest-VolumesActionsTest-1016914342-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75337) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 16:34:12 user nova-compute[75337]: INFO nova.compute.claims [None req-dcbbead5-6a42-4a1e-9857-6ee6f3fddffe tempest-VolumesActionsTest-1016914342 tempest-VolumesActionsTest-1016914342-project-member] [instance: 66334b94-6886-4b63-b5ee-53f9dc0b4be5] Claim successful on node user
Nov 06 16:34:12 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-dcbbead5-6a42-4a1e-9857-6ee6f3fddffe tempest-VolumesActionsTest-1016914342 tempest-VolumesActionsTest-1016914342-project-member] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 16:34:12 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-dcbbead5-6a42-4a1e-9857-6ee6f3fddffe tempest-VolumesActionsTest-1016914342 tempest-VolumesActionsTest-1016914342-project-member] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 16:34:12 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-dcbbead5-6a42-4a1e-9857-6ee6f3fddffe tempest-VolumesActionsTest-1016914342 tempest-VolumesActionsTest-1016914342-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.192s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:34:12 user nova-compute[75337]: DEBUG nova.compute.manager [None req-dcbbead5-6a42-4a1e-9857-6ee6f3fddffe tempest-VolumesActionsTest-1016914342 tempest-VolumesActionsTest-1016914342-project-member] [instance: 66334b94-6886-4b63-b5ee-53f9dc0b4be5] Start building networks asynchronously for instance. {{(pid=75337) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 16:34:12 user nova-compute[75337]: DEBUG nova.compute.manager [None req-dcbbead5-6a42-4a1e-9857-6ee6f3fddffe tempest-VolumesActionsTest-1016914342 tempest-VolumesActionsTest-1016914342-project-member] [instance: 66334b94-6886-4b63-b5ee-53f9dc0b4be5] Allocating IP information in the background. {{(pid=75337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 16:34:12 user nova-compute[75337]: DEBUG nova.network.neutron [None req-dcbbead5-6a42-4a1e-9857-6ee6f3fddffe tempest-VolumesActionsTest-1016914342 tempest-VolumesActionsTest-1016914342-project-member] [instance: 66334b94-6886-4b63-b5ee-53f9dc0b4be5] allocate_for_instance() {{(pid=75337) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 16:34:12 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-dcbbead5-6a42-4a1e-9857-6ee6f3fddffe tempest-VolumesActionsTest-1016914342 tempest-VolumesActionsTest-1016914342-project-member] [instance: 66334b94-6886-4b63-b5ee-53f9dc0b4be5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 16:34:12 user nova-compute[75337]: DEBUG nova.compute.manager [None req-dcbbead5-6a42-4a1e-9857-6ee6f3fddffe tempest-VolumesActionsTest-1016914342 tempest-VolumesActionsTest-1016914342-project-member] [instance: 66334b94-6886-4b63-b5ee-53f9dc0b4be5] Start building block device mappings for instance. {{(pid=75337) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 16:34:12 user nova-compute[75337]: DEBUG nova.policy [None req-dcbbead5-6a42-4a1e-9857-6ee6f3fddffe tempest-VolumesActionsTest-1016914342 tempest-VolumesActionsTest-1016914342-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f2f84bfd83db4cc3819c4299403b44fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4f7688d43824e26b29a15bd02d1588e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75337) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 16:34:12 user nova-compute[75337]: DEBUG nova.compute.manager [None req-dcbbead5-6a42-4a1e-9857-6ee6f3fddffe tempest-VolumesActionsTest-1016914342 tempest-VolumesActionsTest-1016914342-project-member] [instance: 66334b94-6886-4b63-b5ee-53f9dc0b4be5] Start spawning the instance on the hypervisor. {{(pid=75337) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 16:34:12 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-dcbbead5-6a42-4a1e-9857-6ee6f3fddffe tempest-VolumesActionsTest-1016914342 tempest-VolumesActionsTest-1016914342-project-member] [instance: 66334b94-6886-4b63-b5ee-53f9dc0b4be5] Creating instance directory {{(pid=75337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 16:34:12 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-dcbbead5-6a42-4a1e-9857-6ee6f3fddffe tempest-VolumesActionsTest-1016914342 tempest-VolumesActionsTest-1016914342-project-member] [instance: 66334b94-6886-4b63-b5ee-53f9dc0b4be5] Creating image(s)
Nov 06 16:34:12 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-dcbbead5-6a42-4a1e-9857-6ee6f3fddffe tempest-VolumesActionsTest-1016914342 tempest-VolumesActionsTest-1016914342-project-member] Acquiring lock "/opt/stack/data/nova/instances/66334b94-6886-4b63-b5ee-53f9dc0b4be5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:34:12 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-dcbbead5-6a42-4a1e-9857-6ee6f3fddffe tempest-VolumesActionsTest-1016914342 tempest-VolumesActionsTest-1016914342-project-member] Lock "/opt/stack/data/nova/instances/66334b94-6886-4b63-b5ee-53f9dc0b4be5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:34:12 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-dcbbead5-6a42-4a1e-9857-6ee6f3fddffe tempest-VolumesActionsTest-1016914342 tempest-VolumesActionsTest-1016914342-project-member] Lock "/opt/stack/data/nova/instances/66334b94-6886-4b63-b5ee-53f9dc0b4be5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:34:12 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-dcbbead5-6a42-4a1e-9857-6ee6f3fddffe tempest-VolumesActionsTest-1016914342 tempest-VolumesActionsTest-1016914342-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:34:13 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-dcbbead5-6a42-4a1e-9857-6ee6f3fddffe tempest-VolumesActionsTest-1016914342 tempest-VolumesActionsTest-1016914342-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json" returned: 0 in 0.174s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:34:13 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-dcbbead5-6a42-4a1e-9857-6ee6f3fddffe tempest-VolumesActionsTest-1016914342 tempest-VolumesActionsTest-1016914342-project-member] Acquiring lock "06ba3c914798499e686c5ac75886932347225275" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:34:13 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-dcbbead5-6a42-4a1e-9857-6ee6f3fddffe tempest-VolumesActionsTest-1016914342 tempest-VolumesActionsTest-1016914342-project-member] Lock "06ba3c914798499e686c5ac75886932347225275" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:34:13 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-dcbbead5-6a42-4a1e-9857-6ee6f3fddffe tempest-VolumesActionsTest-1016914342 tempest-VolumesActionsTest-1016914342-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:34:13 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-dcbbead5-6a42-4a1e-9857-6ee6f3fddffe tempest-VolumesActionsTest-1016914342 tempest-VolumesActionsTest-1016914342-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json" returned: 0 in 0.187s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:34:13 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-dcbbead5-6a42-4a1e-9857-6ee6f3fddffe tempest-VolumesActionsTest-1016914342 tempest-VolumesActionsTest-1016914342-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275,backing_fmt=raw /opt/stack/data/nova/instances/66334b94-6886-4b63-b5ee-53f9dc0b4be5/disk 1073741824 {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:34:13 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-dcbbead5-6a42-4a1e-9857-6ee6f3fddffe tempest-VolumesActionsTest-1016914342 tempest-VolumesActionsTest-1016914342-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275,backing_fmt=raw /opt/stack/data/nova/instances/66334b94-6886-4b63-b5ee-53f9dc0b4be5/disk 1073741824" returned: 0 in 0.057s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:34:13 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-dcbbead5-6a42-4a1e-9857-6ee6f3fddffe tempest-VolumesActionsTest-1016914342 tempest-VolumesActionsTest-1016914342-project-member] Lock "06ba3c914798499e686c5ac75886932347225275" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.251s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:34:13 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-dcbbead5-6a42-4a1e-9857-6ee6f3fddffe tempest-VolumesActionsTest-1016914342 tempest-VolumesActionsTest-1016914342-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:34:13 user nova-compute[75337]: DEBUG nova.network.neutron [None req-dcbbead5-6a42-4a1e-9857-6ee6f3fddffe tempest-VolumesActionsTest-1016914342 tempest-VolumesActionsTest-1016914342-project-member] [instance: 66334b94-6886-4b63-b5ee-53f9dc0b4be5] Successfully created port: 657d9efb-b845-4171-8b31-82f1fb046e6c {{(pid=75337) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 16:34:13 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-dcbbead5-6a42-4a1e-9857-6ee6f3fddffe tempest-VolumesActionsTest-1016914342 tempest-VolumesActionsTest-1016914342-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06ba3c914798499e686c5ac75886932347225275 --force-share --output=json" returned: 0 in 0.176s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:34:13 user nova-compute[75337]: DEBUG nova.virt.disk.api [None req-dcbbead5-6a42-4a1e-9857-6ee6f3fddffe tempest-VolumesActionsTest-1016914342 tempest-VolumesActionsTest-1016914342-project-member] Checking if we can resize image /opt/stack/data/nova/instances/66334b94-6886-4b63-b5ee-53f9dc0b4be5/disk. size=1073741824 {{(pid=75337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 16:34:13 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-dcbbead5-6a42-4a1e-9857-6ee6f3fddffe tempest-VolumesActionsTest-1016914342 tempest-VolumesActionsTest-1016914342-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66334b94-6886-4b63-b5ee-53f9dc0b4be5/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:34:13 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-dcbbead5-6a42-4a1e-9857-6ee6f3fddffe tempest-VolumesActionsTest-1016914342 tempest-VolumesActionsTest-1016914342-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66334b94-6886-4b63-b5ee-53f9dc0b4be5/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:34:13 user nova-compute[75337]: DEBUG nova.virt.disk.api [None req-dcbbead5-6a42-4a1e-9857-6ee6f3fddffe tempest-VolumesActionsTest-1016914342 tempest-VolumesActionsTest-1016914342-project-member] Cannot resize image /opt/stack/data/nova/instances/66334b94-6886-4b63-b5ee-53f9dc0b4be5/disk to a smaller size. {{(pid=75337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 06 16:34:13 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-dcbbead5-6a42-4a1e-9857-6ee6f3fddffe tempest-VolumesActionsTest-1016914342 tempest-VolumesActionsTest-1016914342-project-member] [instance: 66334b94-6886-4b63-b5ee-53f9dc0b4be5] Created local disks {{(pid=75337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 16:34:13 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-dcbbead5-6a42-4a1e-9857-6ee6f3fddffe tempest-VolumesActionsTest-1016914342 tempest-VolumesActionsTest-1016914342-project-member] [instance: 66334b94-6886-4b63-b5ee-53f9dc0b4be5] Ensure instance console log exists: /opt/stack/data/nova/instances/66334b94-6886-4b63-b5ee-53f9dc0b4be5/console.log {{(pid=75337) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 16:34:13 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-dcbbead5-6a42-4a1e-9857-6ee6f3fddffe tempest-VolumesActionsTest-1016914342 tempest-VolumesActionsTest-1016914342-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:34:13 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-dcbbead5-6a42-4a1e-9857-6ee6f3fddffe tempest-VolumesActionsTest-1016914342 tempest-VolumesActionsTest-1016914342-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:34:13 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-dcbbead5-6a42-4a1e-9857-6ee6f3fddffe tempest-VolumesActionsTest-1016914342 tempest-VolumesActionsTest-1016914342-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:34:13 user nova-compute[75337]: DEBUG nova.network.neutron [None req-dcbbead5-6a42-4a1e-9857-6ee6f3fddffe tempest-VolumesActionsTest-1016914342 tempest-VolumesActionsTest-1016914342-project-member] [instance: 66334b94-6886-4b63-b5ee-53f9dc0b4be5] Successfully updated port: 657d9efb-b845-4171-8b31-82f1fb046e6c {{(pid=75337) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 16:34:13 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-dcbbead5-6a42-4a1e-9857-6ee6f3fddffe tempest-VolumesActionsTest-1016914342 tempest-VolumesActionsTest-1016914342-project-member] Acquiring lock "refresh_cache-66334b94-6886-4b63-b5ee-53f9dc0b4be5" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 16:34:13 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-dcbbead5-6a42-4a1e-9857-6ee6f3fddffe tempest-VolumesActionsTest-1016914342 tempest-VolumesActionsTest-1016914342-project-member] Acquired lock "refresh_cache-66334b94-6886-4b63-b5ee-53f9dc0b4be5" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 16:34:13 user nova-compute[75337]: DEBUG nova.network.neutron [None req-dcbbead5-6a42-4a1e-9857-6ee6f3fddffe tempest-VolumesActionsTest-1016914342 tempest-VolumesActionsTest-1016914342-project-member] [instance: 66334b94-6886-4b63-b5ee-53f9dc0b4be5] Building network info cache for instance {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 16:34:13 user nova-compute[75337]: DEBUG nova.network.neutron [None req-dcbbead5-6a42-4a1e-9857-6ee6f3fddffe tempest-VolumesActionsTest-1016914342 tempest-VolumesActionsTest-1016914342-project-member] [instance: 66334b94-6886-4b63-b5ee-53f9dc0b4be5] Instance cache missing network info. {{(pid=75337) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 16:34:14 user nova-compute[75337]: DEBUG nova.compute.manager [req-7bcf05b6-782e-4f15-9698-634ac3987218 req-d5734f9f-e081-4864-b399-fd6c4fce08b0 service nova] [instance: 66334b94-6886-4b63-b5ee-53f9dc0b4be5] Received event network-changed-657d9efb-b845-4171-8b31-82f1fb046e6c {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:34:14 user nova-compute[75337]: DEBUG nova.compute.manager [req-7bcf05b6-782e-4f15-9698-634ac3987218 req-d5734f9f-e081-4864-b399-fd6c4fce08b0 service nova] [instance: 66334b94-6886-4b63-b5ee-53f9dc0b4be5] Refreshing instance network info cache due to event network-changed-657d9efb-b845-4171-8b31-82f1fb046e6c. {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 16:34:14 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-7bcf05b6-782e-4f15-9698-634ac3987218 req-d5734f9f-e081-4864-b399-fd6c4fce08b0 service nova] Acquiring lock "refresh_cache-66334b94-6886-4b63-b5ee-53f9dc0b4be5" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 16:34:14 user nova-compute[75337]: DEBUG nova.network.neutron [None req-dcbbead5-6a42-4a1e-9857-6ee6f3fddffe tempest-VolumesActionsTest-1016914342 tempest-VolumesActionsTest-1016914342-project-member] [instance: 66334b94-6886-4b63-b5ee-53f9dc0b4be5] Updating instance_info_cache with network_info: [{"id": "657d9efb-b845-4171-8b31-82f1fb046e6c", "address": "fa:16:3e:22:59:b5", "network": {"id": "7c1dd053-8eb8-41fa-ba08-44cb8cb140e8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1069692825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4f7688d43824e26b29a15bd02d1588e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap657d9efb-b8", "ovs_interfaceid": "657d9efb-b845-4171-8b31-82f1fb046e6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 16:34:14 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-dcbbead5-6a42-4a1e-9857-6ee6f3fddffe tempest-VolumesActionsTest-1016914342 tempest-VolumesActionsTest-1016914342-project-member] Releasing lock "refresh_cache-66334b94-6886-4b63-b5ee-53f9dc0b4be5" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 16:34:14 user nova-compute[75337]: DEBUG nova.compute.manager [None req-dcbbead5-6a42-4a1e-9857-6ee6f3fddffe tempest-VolumesActionsTest-1016914342 tempest-VolumesActionsTest-1016914342-project-member] [instance: 66334b94-6886-4b63-b5ee-53f9dc0b4be5] Instance network_info: |[{"id": "657d9efb-b845-4171-8b31-82f1fb046e6c", "address": "fa:16:3e:22:59:b5", "network": {"id": "7c1dd053-8eb8-41fa-ba08-44cb8cb140e8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1069692825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4f7688d43824e26b29a15bd02d1588e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap657d9efb-b8", "ovs_interfaceid": "657d9efb-b845-4171-8b31-82f1fb046e6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 16:34:14 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-7bcf05b6-782e-4f15-9698-634ac3987218 req-d5734f9f-e081-4864-b399-fd6c4fce08b0 service nova] Acquired lock "refresh_cache-66334b94-6886-4b63-b5ee-53f9dc0b4be5" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 16:34:14 user nova-compute[75337]: DEBUG nova.network.neutron [req-7bcf05b6-782e-4f15-9698-634ac3987218 req-d5734f9f-e081-4864-b399-fd6c4fce08b0 service nova] [instance: 66334b94-6886-4b63-b5ee-53f9dc0b4be5] Refreshing network info cache for port 657d9efb-b845-4171-8b31-82f1fb046e6c {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 16:34:14 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-dcbbead5-6a42-4a1e-9857-6ee6f3fddffe tempest-VolumesActionsTest-1016914342 tempest-VolumesActionsTest-1016914342-project-member] [instance: 66334b94-6886-4b63-b5ee-53f9dc0b4be5] Start _get_guest_xml network_info=[{"id": "657d9efb-b845-4171-8b31-82f1fb046e6c", "address": "fa:16:3e:22:59:b5", "network": {"id": "7c1dd053-8eb8-41fa-ba08-44cb8cb140e8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1069692825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4f7688d43824e26b29a15bd02d1588e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap657d9efb-b8", "ovs_interfaceid": "657d9efb-b845-4171-8b31-82f1fb046e6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T15:34:14Z,direct_url=<?>,disk_format='qcow2',id=16b903ae-a40f-41a7-985b-4804cce92c62,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6549a15819f1469bbd5eeae8190e3d44',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T15:34:15Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'guest_format': None, 'size': 0, 'device_type': 'disk', 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '16b903ae-a40f-41a7-985b-4804cce92c62'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 16:34:14 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-dcbbead5-6a42-4a1e-9857-6ee6f3fddffe tempest-VolumesActionsTest-1016914342 tempest-VolumesActionsTest-1016914342-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 16:34:14 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-dcbbead5-6a42-4a1e-9857-6ee6f3fddffe tempest-VolumesActionsTest-1016914342 tempest-VolumesActionsTest-1016914342-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 16:34:14 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-dcbbead5-6a42-4a1e-9857-6ee6f3fddffe tempest-VolumesActionsTest-1016914342 tempest-VolumesActionsTest-1016914342-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 16:34:14 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-dcbbead5-6a42-4a1e-9857-6ee6f3fddffe tempest-VolumesActionsTest-1016914342 tempest-VolumesActionsTest-1016914342-project-member] CPU controller missing on host. {{(pid=75337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 16:34:14 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-dcbbead5-6a42-4a1e-9857-6ee6f3fddffe tempest-VolumesActionsTest-1016914342 tempest-VolumesActionsTest-1016914342-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 16:34:14 user nova-compute[75337]: DEBUG nova.virt.libvirt.host [None req-dcbbead5-6a42-4a1e-9857-6ee6f3fddffe tempest-VolumesActionsTest-1016914342 tempest-VolumesActionsTest-1016914342-project-member] CPU controller found on host. {{(pid=75337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 16:34:14 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-dcbbead5-6a42-4a1e-9857-6ee6f3fddffe tempest-VolumesActionsTest-1016914342 tempest-VolumesActionsTest-1016914342-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75337) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 16:34:14 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-dcbbead5-6a42-4a1e-9857-6ee6f3fddffe tempest-VolumesActionsTest-1016914342 tempest-VolumesActionsTest-1016914342-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T15:34:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T15:34:14Z,direct_url=<?>,disk_format='qcow2',id=16b903ae-a40f-41a7-985b-4804cce92c62,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6549a15819f1469bbd5eeae8190e3d44',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T15:34:15Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 16:34:14 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-dcbbead5-6a42-4a1e-9857-6ee6f3fddffe tempest-VolumesActionsTest-1016914342 tempest-VolumesActionsTest-1016914342-project-member] Flavor limits 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 16:34:14 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-dcbbead5-6a42-4a1e-9857-6ee6f3fddffe tempest-VolumesActionsTest-1016914342 tempest-VolumesActionsTest-1016914342-project-member] Image limits 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 16:34:14 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-dcbbead5-6a42-4a1e-9857-6ee6f3fddffe tempest-VolumesActionsTest-1016914342 tempest-VolumesActionsTest-1016914342-project-member] Flavor pref 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 16:34:14 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-dcbbead5-6a42-4a1e-9857-6ee6f3fddffe tempest-VolumesActionsTest-1016914342 tempest-VolumesActionsTest-1016914342-project-member] Image pref 0:0:0 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 16:34:14 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-dcbbead5-6a42-4a1e-9857-6ee6f3fddffe tempest-VolumesActionsTest-1016914342 tempest-VolumesActionsTest-1016914342-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 16:34:14 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-dcbbead5-6a42-4a1e-9857-6ee6f3fddffe tempest-VolumesActionsTest-1016914342 tempest-VolumesActionsTest-1016914342-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 16:34:14 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-dcbbead5-6a42-4a1e-9857-6ee6f3fddffe tempest-VolumesActionsTest-1016914342 tempest-VolumesActionsTest-1016914342-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 16:34:14 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-dcbbead5-6a42-4a1e-9857-6ee6f3fddffe tempest-VolumesActionsTest-1016914342 tempest-VolumesActionsTest-1016914342-project-member] Got 1 possible topologies {{(pid=75337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 16:34:14 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-dcbbead5-6a42-4a1e-9857-6ee6f3fddffe tempest-VolumesActionsTest-1016914342 tempest-VolumesActionsTest-1016914342-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 16:34:14 user nova-compute[75337]: DEBUG nova.virt.hardware [None req-dcbbead5-6a42-4a1e-9857-6ee6f3fddffe tempest-VolumesActionsTest-1016914342 tempest-VolumesActionsTest-1016914342-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 16:34:14 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-dcbbead5-6a42-4a1e-9857-6ee6f3fddffe tempest-VolumesActionsTest-1016914342 tempest-VolumesActionsTest-1016914342-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T16:34:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-2053072028',display_name='tempest-VolumesActionsTest-instance-2053072028',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-2053072028',id=52,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e4f7688d43824e26b29a15bd02d1588e',ramdisk_id='',reservation_id='r-ky7625op',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1016914342',owner_user_name='tempest-VolumesActionsTest-1016914342-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T16:34:13Z,user_data=None,user_id='f2f84bfd83db4cc3819c4299403b44fa',uuid=66334b94-6886-4b63-b5ee-53f9dc0b4be5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "657d9efb-b845-4171-8b31-82f1fb046e6c", "address": "fa:16:3e:22:59:b5", "network": {"id": "7c1dd053-8eb8-41fa-ba08-44cb8cb140e8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1069692825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4f7688d43824e26b29a15bd02d1588e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap657d9efb-b8", "ovs_interfaceid": "657d9efb-b845-4171-8b31-82f1fb046e6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75337) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 16:34:14 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-dcbbead5-6a42-4a1e-9857-6ee6f3fddffe tempest-VolumesActionsTest-1016914342 tempest-VolumesActionsTest-1016914342-project-member] Converting VIF {"id": "657d9efb-b845-4171-8b31-82f1fb046e6c", "address": "fa:16:3e:22:59:b5", "network": {"id": "7c1dd053-8eb8-41fa-ba08-44cb8cb140e8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1069692825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4f7688d43824e26b29a15bd02d1588e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap657d9efb-b8", "ovs_interfaceid": "657d9efb-b845-4171-8b31-82f1fb046e6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 16:34:14 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-dcbbead5-6a42-4a1e-9857-6ee6f3fddffe tempest-VolumesActionsTest-1016914342 tempest-VolumesActionsTest-1016914342-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:59:b5,bridge_name='br-int',has_traffic_filtering=True,id=657d9efb-b845-4171-8b31-82f1fb046e6c,network=Network(7c1dd053-8eb8-41fa-ba08-44cb8cb140e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap657d9efb-b8') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 16:34:14 user nova-compute[75337]: DEBUG nova.objects.instance [None req-dcbbead5-6a42-4a1e-9857-6ee6f3fddffe tempest-VolumesActionsTest-1016914342 tempest-VolumesActionsTest-1016914342-project-member] Lazy-loading 'pci_devices' on Instance uuid 66334b94-6886-4b63-b5ee-53f9dc0b4be5 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 16:34:14 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-dcbbead5-6a42-4a1e-9857-6ee6f3fddffe tempest-VolumesActionsTest-1016914342 tempest-VolumesActionsTest-1016914342-project-member] [instance: 66334b94-6886-4b63-b5ee-53f9dc0b4be5] End _get_guest_xml xml=<domain type="kvm">
Nov 06 16:34:14 user nova-compute[75337]:   <uuid>66334b94-6886-4b63-b5ee-53f9dc0b4be5</uuid>
Nov 06 16:34:14 user nova-compute[75337]:   <name>instance-00000034</name>
Nov 06 16:34:14 user nova-compute[75337]:   <memory>524288</memory>
Nov 06 16:34:14 user nova-compute[75337]:   <vcpu>1</vcpu>
Nov 06 16:34:14 user nova-compute[75337]:   <metadata>
Nov 06 16:34:14 user nova-compute[75337]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 16:34:14 user nova-compute[75337]:       <nova:package version="0.0.0"/>
Nov 06 16:34:14 user nova-compute[75337]:       <nova:name>tempest-VolumesActionsTest-instance-2053072028</nova:name>
Nov 06 16:34:14 user nova-compute[75337]:       <nova:creationTime>2023-11-06 16:34:14</nova:creationTime>
Nov 06 16:34:14 user nova-compute[75337]:       <nova:flavor name="m1.tiny">
Nov 06 16:34:14 user nova-compute[75337]:         <nova:memory>512</nova:memory>
Nov 06 16:34:14 user nova-compute[75337]:         <nova:disk>1</nova:disk>
Nov 06 16:34:14 user nova-compute[75337]:         <nova:swap>0</nova:swap>
Nov 06 16:34:14 user nova-compute[75337]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 16:34:14 user nova-compute[75337]:         <nova:vcpus>1</nova:vcpus>
Nov 06 16:34:14 user nova-compute[75337]:       </nova:flavor>
Nov 06 16:34:14 user nova-compute[75337]:       <nova:owner>
Nov 06 16:34:14 user nova-compute[75337]:         <nova:user uuid="f2f84bfd83db4cc3819c4299403b44fa">tempest-VolumesActionsTest-1016914342-project-member</nova:user>
Nov 06 16:34:14 user nova-compute[75337]:         <nova:project uuid="e4f7688d43824e26b29a15bd02d1588e">tempest-VolumesActionsTest-1016914342</nova:project>
Nov 06 16:34:14 user nova-compute[75337]:       </nova:owner>
Nov 06 16:34:14 user nova-compute[75337]:       <nova:root type="image" uuid="16b903ae-a40f-41a7-985b-4804cce92c62"/>
Nov 06 16:34:14 user nova-compute[75337]:       <nova:ports>
Nov 06 16:34:14 user nova-compute[75337]:         <nova:port uuid="657d9efb-b845-4171-8b31-82f1fb046e6c">
Nov 06 16:34:14 user nova-compute[75337]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 06 16:34:14 user nova-compute[75337]:         </nova:port>
Nov 06 16:34:14 user nova-compute[75337]:       </nova:ports>
Nov 06 16:34:14 user nova-compute[75337]:     </nova:instance>
Nov 06 16:34:14 user nova-compute[75337]:   </metadata>
Nov 06 16:34:14 user nova-compute[75337]:   <sysinfo type="smbios">
Nov 06 16:34:14 user nova-compute[75337]:     <system>
Nov 06 16:34:14 user nova-compute[75337]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 16:34:14 user nova-compute[75337]:       <entry name="product">OpenStack Nova</entry>
Nov 06 16:34:14 user nova-compute[75337]:       <entry name="version">0.0.0</entry>
Nov 06 16:34:14 user nova-compute[75337]:       <entry name="serial">66334b94-6886-4b63-b5ee-53f9dc0b4be5</entry>
Nov 06 16:34:14 user nova-compute[75337]:       <entry name="uuid">66334b94-6886-4b63-b5ee-53f9dc0b4be5</entry>
Nov 06 16:34:14 user nova-compute[75337]:       <entry name="family">Virtual Machine</entry>
Nov 06 16:34:14 user nova-compute[75337]:     </system>
Nov 06 16:34:14 user nova-compute[75337]:   </sysinfo>
Nov 06 16:34:14 user nova-compute[75337]:   <os>
Nov 06 16:34:14 user nova-compute[75337]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 16:34:14 user nova-compute[75337]:     <boot dev="hd"/>
Nov 06 16:34:14 user nova-compute[75337]:     <smbios mode="sysinfo"/>
Nov 06 16:34:14 user nova-compute[75337]:   </os>
Nov 06 16:34:14 user nova-compute[75337]:   <features>
Nov 06 16:34:14 user nova-compute[75337]:     <acpi/>
Nov 06 16:34:14 user nova-compute[75337]:     <apic/>
Nov 06 16:34:14 user nova-compute[75337]:     <vmcoreinfo/>
Nov 06 16:34:14 user nova-compute[75337]:   </features>
Nov 06 16:34:14 user nova-compute[75337]:   <clock offset="utc">
Nov 06 16:34:14 user nova-compute[75337]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 16:34:14 user nova-compute[75337]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 16:34:14 user nova-compute[75337]:     <timer name="hpet" present="no"/>
Nov 06 16:34:14 user nova-compute[75337]:   </clock>
Nov 06 16:34:14 user nova-compute[75337]:   <cpu mode="custom" match="exact">
Nov 06 16:34:14 user nova-compute[75337]:     <model>Nehalem</model>
Nov 06 16:34:14 user nova-compute[75337]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 16:34:14 user nova-compute[75337]:   </cpu>
Nov 06 16:34:14 user nova-compute[75337]:   <devices>
Nov 06 16:34:14 user nova-compute[75337]:     <disk type="file" device="disk">
Nov 06 16:34:14 user nova-compute[75337]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 16:34:14 user nova-compute[75337]:       <source file="/opt/stack/data/nova/instances/66334b94-6886-4b63-b5ee-53f9dc0b4be5/disk"/>
Nov 06 16:34:14 user nova-compute[75337]:       <target dev="vda" bus="virtio"/>
Nov 06 16:34:14 user nova-compute[75337]:     </disk>
Nov 06 16:34:14 user nova-compute[75337]:     <interface type="ethernet">
Nov 06 16:34:14 user nova-compute[75337]:       <mac address="fa:16:3e:22:59:b5"/>
Nov 06 16:34:14 user nova-compute[75337]:       <model type="virtio"/>
Nov 06 16:34:14 user nova-compute[75337]:       <mtu size="1442"/>
Nov 06 16:34:14 user nova-compute[75337]:       <target dev="tap657d9efb-b8"/>
Nov 06 16:34:14 user nova-compute[75337]:     </interface>
Nov 06 16:34:14 user nova-compute[75337]:     <serial type="pty">
Nov 06 16:34:14 user nova-compute[75337]:       <log file="/opt/stack/data/nova/instances/66334b94-6886-4b63-b5ee-53f9dc0b4be5/console.log" append="off"/>
Nov 06 16:34:14 user nova-compute[75337]:     </serial>
Nov 06 16:34:14 user nova-compute[75337]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 16:34:14 user nova-compute[75337]:     <video>
Nov 06 16:34:14 user nova-compute[75337]:       <model type="virtio"/>
Nov 06 16:34:14 user nova-compute[75337]:     </video>
Nov 06 16:34:14 user nova-compute[75337]:     <rng model="virtio">
Nov 06 16:34:14 user nova-compute[75337]:       <backend model="random">/dev/urandom</backend>
Nov 06 16:34:14 user nova-compute[75337]:     </rng>
Nov 06 16:34:14 user nova-compute[75337]:     <controller type="usb" index="0" model="none"/>
Nov 06 16:34:14 user nova-compute[75337]:     <memballoon model="virtio">
Nov 06 16:34:14 user nova-compute[75337]:       <stats period="10"/>
Nov 06 16:34:14 user nova-compute[75337]:     </memballoon>
Nov 06 16:34:14 user nova-compute[75337]:   </devices>
Nov 06 16:34:14 user nova-compute[75337]: </domain>
Nov 06 16:34:14 user nova-compute[75337]:  {{(pid=75337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 16:34:14 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-dcbbead5-6a42-4a1e-9857-6ee6f3fddffe tempest-VolumesActionsTest-1016914342 tempest-VolumesActionsTest-1016914342-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T16:34:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-2053072028',display_name='tempest-VolumesActionsTest-instance-2053072028',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-2053072028',id=52,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e4f7688d43824e26b29a15bd02d1588e',ramdisk_id='',reservation_id='r-ky7625op',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1016914342',owner_user_name='tempest-VolumesActionsTest-1016914342-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T16:34:13Z,user_data=None,user_id='f2f84bfd83db4cc3819c4299403b44fa',uuid=66334b94-6886-4b63-b5ee-53f9dc0b4be5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "657d9efb-b845-4171-8b31-82f1fb046e6c", "address": "fa:16:3e:22:59:b5", "network": {"id": "7c1dd053-8eb8-41fa-ba08-44cb8cb140e8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1069692825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4f7688d43824e26b29a15bd02d1588e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap657d9efb-b8", "ovs_interfaceid": "657d9efb-b845-4171-8b31-82f1fb046e6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 16:34:14 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-dcbbead5-6a42-4a1e-9857-6ee6f3fddffe tempest-VolumesActionsTest-1016914342 tempest-VolumesActionsTest-1016914342-project-member] Converting VIF {"id": "657d9efb-b845-4171-8b31-82f1fb046e6c", "address": "fa:16:3e:22:59:b5", "network": {"id": "7c1dd053-8eb8-41fa-ba08-44cb8cb140e8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1069692825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4f7688d43824e26b29a15bd02d1588e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap657d9efb-b8", "ovs_interfaceid": "657d9efb-b845-4171-8b31-82f1fb046e6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 16:34:14 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-dcbbead5-6a42-4a1e-9857-6ee6f3fddffe tempest-VolumesActionsTest-1016914342 tempest-VolumesActionsTest-1016914342-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:59:b5,bridge_name='br-int',has_traffic_filtering=True,id=657d9efb-b845-4171-8b31-82f1fb046e6c,network=Network(7c1dd053-8eb8-41fa-ba08-44cb8cb140e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap657d9efb-b8') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 16:34:14 user nova-compute[75337]: DEBUG os_vif [None req-dcbbead5-6a42-4a1e-9857-6ee6f3fddffe tempest-VolumesActionsTest-1016914342 tempest-VolumesActionsTest-1016914342-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:59:b5,bridge_name='br-int',has_traffic_filtering=True,id=657d9efb-b845-4171-8b31-82f1fb046e6c,network=Network(7c1dd053-8eb8-41fa-ba08-44cb8cb140e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap657d9efb-b8') {{(pid=75337) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 16:34:14 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:34:14 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 16:34:14 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 16:34:14 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:34:14 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c6e1c831-99f7-5bfe-b4a5-2ec48d01f856', '_type': 'linux-noop'}}, row=False) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 16:34:14 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:34:14 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:34:14 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap657d9efb-b8, may_exist=True, interface_attrs={}) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 16:34:14 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap657d9efb-b8, col_values=(('qos', UUID('0fb56687-6edc-4bc3-b003-952257cd17ed')),), if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 16:34:14 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap657d9efb-b8, col_values=(('external_ids', {'iface-id': '657d9efb-b845-4171-8b31-82f1fb046e6c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:22:59:b5', 'vm-uuid': '66334b94-6886-4b63-b5ee-53f9dc0b4be5'}),), if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 16:34:14 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:34:14 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:34:14 user nova-compute[75337]: INFO os_vif [None req-dcbbead5-6a42-4a1e-9857-6ee6f3fddffe tempest-VolumesActionsTest-1016914342 tempest-VolumesActionsTest-1016914342-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:59:b5,bridge_name='br-int',has_traffic_filtering=True,id=657d9efb-b845-4171-8b31-82f1fb046e6c,network=Network(7c1dd053-8eb8-41fa-ba08-44cb8cb140e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap657d9efb-b8')
Nov 06 16:34:14 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-dcbbead5-6a42-4a1e-9857-6ee6f3fddffe tempest-VolumesActionsTest-1016914342 tempest-VolumesActionsTest-1016914342-project-member] No BDM found with device name vda, not building metadata. {{(pid=75337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 16:34:14 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-dcbbead5-6a42-4a1e-9857-6ee6f3fddffe tempest-VolumesActionsTest-1016914342 tempest-VolumesActionsTest-1016914342-project-member] No VIF found with MAC fa:16:3e:22:59:b5, not building metadata {{(pid=75337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 16:34:14 user nova-compute[75337]: DEBUG nova.network.neutron [req-7bcf05b6-782e-4f15-9698-634ac3987218 req-d5734f9f-e081-4864-b399-fd6c4fce08b0 service nova] [instance: 66334b94-6886-4b63-b5ee-53f9dc0b4be5] Updated VIF entry in instance network info cache for port 657d9efb-b845-4171-8b31-82f1fb046e6c. {{(pid=75337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 16:34:14 user nova-compute[75337]: DEBUG nova.network.neutron [req-7bcf05b6-782e-4f15-9698-634ac3987218 req-d5734f9f-e081-4864-b399-fd6c4fce08b0 service nova] [instance: 66334b94-6886-4b63-b5ee-53f9dc0b4be5] Updating instance_info_cache with network_info: [{"id": "657d9efb-b845-4171-8b31-82f1fb046e6c", "address": "fa:16:3e:22:59:b5", "network": {"id": "7c1dd053-8eb8-41fa-ba08-44cb8cb140e8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1069692825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4f7688d43824e26b29a15bd02d1588e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap657d9efb-b8", "ovs_interfaceid": "657d9efb-b845-4171-8b31-82f1fb046e6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 16:34:14 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-7bcf05b6-782e-4f15-9698-634ac3987218 req-d5734f9f-e081-4864-b399-fd6c4fce08b0 service nova] Releasing lock "refresh_cache-66334b94-6886-4b63-b5ee-53f9dc0b4be5" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 16:34:15 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:34:15 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:34:15 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:34:15 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:34:15 user nova-compute[75337]: DEBUG nova.compute.manager [req-6a7af419-944f-4968-9d35-d5efaae6701b req-91c56bad-c3e1-4f0e-8914-644fb9f3b033 service nova] [instance: 66334b94-6886-4b63-b5ee-53f9dc0b4be5] Received event network-vif-plugged-657d9efb-b845-4171-8b31-82f1fb046e6c {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:34:15 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-6a7af419-944f-4968-9d35-d5efaae6701b req-91c56bad-c3e1-4f0e-8914-644fb9f3b033 service nova] Acquiring lock "66334b94-6886-4b63-b5ee-53f9dc0b4be5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:34:15 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-6a7af419-944f-4968-9d35-d5efaae6701b req-91c56bad-c3e1-4f0e-8914-644fb9f3b033 service nova] Lock "66334b94-6886-4b63-b5ee-53f9dc0b4be5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:34:15 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-6a7af419-944f-4968-9d35-d5efaae6701b req-91c56bad-c3e1-4f0e-8914-644fb9f3b033 service nova] Lock "66334b94-6886-4b63-b5ee-53f9dc0b4be5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:34:15 user nova-compute[75337]: DEBUG nova.compute.manager [req-6a7af419-944f-4968-9d35-d5efaae6701b req-91c56bad-c3e1-4f0e-8914-644fb9f3b033 service nova] [instance: 66334b94-6886-4b63-b5ee-53f9dc0b4be5] No waiting events found dispatching network-vif-plugged-657d9efb-b845-4171-8b31-82f1fb046e6c {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 16:34:15 user nova-compute[75337]: WARNING nova.compute.manager [req-6a7af419-944f-4968-9d35-d5efaae6701b req-91c56bad-c3e1-4f0e-8914-644fb9f3b033 service nova] [instance: 66334b94-6886-4b63-b5ee-53f9dc0b4be5] Received unexpected event network-vif-plugged-657d9efb-b845-4171-8b31-82f1fb046e6c for instance with vm_state building and task_state spawning.
Nov 06 16:34:16 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:34:16 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:34:16 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:34:16 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:34:17 user nova-compute[75337]: DEBUG nova.compute.manager [None req-dcbbead5-6a42-4a1e-9857-6ee6f3fddffe tempest-VolumesActionsTest-1016914342 tempest-VolumesActionsTest-1016914342-project-member] [instance: 66334b94-6886-4b63-b5ee-53f9dc0b4be5] Instance event wait completed in 0 seconds for  {{(pid=75337) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 16:34:17 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-dcbbead5-6a42-4a1e-9857-6ee6f3fddffe tempest-VolumesActionsTest-1016914342 tempest-VolumesActionsTest-1016914342-project-member] [instance: 66334b94-6886-4b63-b5ee-53f9dc0b4be5] Guest created on hypervisor {{(pid=75337) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 16:34:17 user nova-compute[75337]: INFO nova.virt.libvirt.driver [-] [instance: 66334b94-6886-4b63-b5ee-53f9dc0b4be5] Instance spawned successfully.
Nov 06 16:34:17 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-dcbbead5-6a42-4a1e-9857-6ee6f3fddffe tempest-VolumesActionsTest-1016914342 tempest-VolumesActionsTest-1016914342-project-member] [instance: 66334b94-6886-4b63-b5ee-53f9dc0b4be5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 16:34:17 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-dcbbead5-6a42-4a1e-9857-6ee6f3fddffe tempest-VolumesActionsTest-1016914342 tempest-VolumesActionsTest-1016914342-project-member] [instance: 66334b94-6886-4b63-b5ee-53f9dc0b4be5] Found default for hw_cdrom_bus of ide {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 16:34:17 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-dcbbead5-6a42-4a1e-9857-6ee6f3fddffe tempest-VolumesActionsTest-1016914342 tempest-VolumesActionsTest-1016914342-project-member] [instance: 66334b94-6886-4b63-b5ee-53f9dc0b4be5] Found default for hw_disk_bus of virtio {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 16:34:17 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-dcbbead5-6a42-4a1e-9857-6ee6f3fddffe tempest-VolumesActionsTest-1016914342 tempest-VolumesActionsTest-1016914342-project-member] [instance: 66334b94-6886-4b63-b5ee-53f9dc0b4be5] Found default for hw_input_bus of None {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 16:34:17 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-dcbbead5-6a42-4a1e-9857-6ee6f3fddffe tempest-VolumesActionsTest-1016914342 tempest-VolumesActionsTest-1016914342-project-member] [instance: 66334b94-6886-4b63-b5ee-53f9dc0b4be5] Found default for hw_pointer_model of None {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 16:34:17 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-dcbbead5-6a42-4a1e-9857-6ee6f3fddffe tempest-VolumesActionsTest-1016914342 tempest-VolumesActionsTest-1016914342-project-member] [instance: 66334b94-6886-4b63-b5ee-53f9dc0b4be5] Found default for hw_video_model of virtio {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 16:34:17 user nova-compute[75337]: DEBUG nova.virt.libvirt.driver [None req-dcbbead5-6a42-4a1e-9857-6ee6f3fddffe tempest-VolumesActionsTest-1016914342 tempest-VolumesActionsTest-1016914342-project-member] [instance: 66334b94-6886-4b63-b5ee-53f9dc0b4be5] Found default for hw_vif_model of virtio {{(pid=75337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 16:34:17 user nova-compute[75337]: INFO nova.compute.manager [None req-dcbbead5-6a42-4a1e-9857-6ee6f3fddffe tempest-VolumesActionsTest-1016914342 tempest-VolumesActionsTest-1016914342-project-member] [instance: 66334b94-6886-4b63-b5ee-53f9dc0b4be5] Took 5.14 seconds to spawn the instance on the hypervisor.
Nov 06 16:34:17 user nova-compute[75337]: DEBUG nova.compute.manager [None req-dcbbead5-6a42-4a1e-9857-6ee6f3fddffe tempest-VolumesActionsTest-1016914342 tempest-VolumesActionsTest-1016914342-project-member] [instance: 66334b94-6886-4b63-b5ee-53f9dc0b4be5] Checking state {{(pid=75337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 16:34:18 user nova-compute[75337]: DEBUG nova.compute.manager [req-c63b8015-4031-4ba5-818b-5b5f897a3801 req-e11581b3-40cb-482e-a4c2-acc56932692e service nova] [instance: 66334b94-6886-4b63-b5ee-53f9dc0b4be5] Received event network-vif-plugged-657d9efb-b845-4171-8b31-82f1fb046e6c {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:34:18 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-c63b8015-4031-4ba5-818b-5b5f897a3801 req-e11581b3-40cb-482e-a4c2-acc56932692e service nova] Acquiring lock "66334b94-6886-4b63-b5ee-53f9dc0b4be5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:34:18 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-c63b8015-4031-4ba5-818b-5b5f897a3801 req-e11581b3-40cb-482e-a4c2-acc56932692e service nova] Lock "66334b94-6886-4b63-b5ee-53f9dc0b4be5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:34:18 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-c63b8015-4031-4ba5-818b-5b5f897a3801 req-e11581b3-40cb-482e-a4c2-acc56932692e service nova] Lock "66334b94-6886-4b63-b5ee-53f9dc0b4be5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:34:18 user nova-compute[75337]: DEBUG nova.compute.manager [req-c63b8015-4031-4ba5-818b-5b5f897a3801 req-e11581b3-40cb-482e-a4c2-acc56932692e service nova] [instance: 66334b94-6886-4b63-b5ee-53f9dc0b4be5] No waiting events found dispatching network-vif-plugged-657d9efb-b845-4171-8b31-82f1fb046e6c {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 16:34:18 user nova-compute[75337]: WARNING nova.compute.manager [req-c63b8015-4031-4ba5-818b-5b5f897a3801 req-e11581b3-40cb-482e-a4c2-acc56932692e service nova] [instance: 66334b94-6886-4b63-b5ee-53f9dc0b4be5] Received unexpected event network-vif-plugged-657d9efb-b845-4171-8b31-82f1fb046e6c for instance with vm_state building and task_state spawning.
Nov 06 16:34:18 user nova-compute[75337]: INFO nova.compute.manager [None req-dcbbead5-6a42-4a1e-9857-6ee6f3fddffe tempest-VolumesActionsTest-1016914342 tempest-VolumesActionsTest-1016914342-project-member] [instance: 66334b94-6886-4b63-b5ee-53f9dc0b4be5] Took 5.67 seconds to build instance.
Nov 06 16:34:18 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-dcbbead5-6a42-4a1e-9857-6ee6f3fddffe tempest-VolumesActionsTest-1016914342 tempest-VolumesActionsTest-1016914342-project-member] Lock "66334b94-6886-4b63-b5ee-53f9dc0b4be5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.760s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:34:19 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:34:20 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:34:24 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:34:25 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:34:29 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:34:34 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:34:35 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:34:35 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:34:38 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:34:39 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:34:39 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:34:39 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75337) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 16:34:40 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:34:44 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:34:45 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:34:45 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:34:45 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:34:46 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:34:48 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:34:49 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:34:50 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:34:53 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:34:53 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Starting heal instance info cache {{(pid=75337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 16:34:53 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Rebuilding the list of instances to heal {{(pid=75337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 06 16:34:53 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "refresh_cache-66334b94-6886-4b63-b5ee-53f9dc0b4be5" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 16:34:53 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquired lock "refresh_cache-66334b94-6886-4b63-b5ee-53f9dc0b4be5" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 16:34:53 user nova-compute[75337]: DEBUG nova.network.neutron [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] [instance: 66334b94-6886-4b63-b5ee-53f9dc0b4be5] Forcefully refreshing network info cache for instance {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 16:34:53 user nova-compute[75337]: DEBUG nova.objects.instance [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lazy-loading 'info_cache' on Instance uuid 66334b94-6886-4b63-b5ee-53f9dc0b4be5 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 16:34:54 user nova-compute[75337]: DEBUG nova.network.neutron [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] [instance: 66334b94-6886-4b63-b5ee-53f9dc0b4be5] Updating instance_info_cache with network_info: [{"id": "657d9efb-b845-4171-8b31-82f1fb046e6c", "address": "fa:16:3e:22:59:b5", "network": {"id": "7c1dd053-8eb8-41fa-ba08-44cb8cb140e8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1069692825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4f7688d43824e26b29a15bd02d1588e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap657d9efb-b8", "ovs_interfaceid": "657d9efb-b845-4171-8b31-82f1fb046e6c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 16:34:54 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Releasing lock "refresh_cache-66334b94-6886-4b63-b5ee-53f9dc0b4be5" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 16:34:54 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] [instance: 66334b94-6886-4b63-b5ee-53f9dc0b4be5] Updated the network info_cache for instance {{(pid=75337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 16:34:54 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:34:58 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager.update_available_resource {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:34:58 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:34:58 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:34:58 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:34:58 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Auditing locally available compute resources for user (node: user) {{(pid=75337) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 16:34:58 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66334b94-6886-4b63-b5ee-53f9dc0b4be5/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:34:58 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66334b94-6886-4b63-b5ee-53f9dc0b4be5/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:34:58 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66334b94-6886-4b63-b5ee-53f9dc0b4be5/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:34:59 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66334b94-6886-4b63-b5ee-53f9dc0b4be5/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:34:59 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 16:34:59 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 16:34:59 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Hypervisor/Node resource view: name=user free_ram=8924MB free_disk=24.991764068603516GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75337) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 16:34:59 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:34:59 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:34:59 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:34:59 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 66334b94-6886-4b63-b5ee-53f9dc0b4be5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 16:34:59 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 16:34:59 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 16:34:59 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Refreshing inventories for resource provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 06 16:34:59 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Updating ProviderTree inventory for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 06 16:34:59 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Updating inventory in ProviderTree for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 06 16:34:59 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Refreshing aggregate associations for resource provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7, aggregates: None {{(pid=75337) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 06 16:34:59 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Refreshing trait associations for resource provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7, traits: COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NODE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_IDE,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSSE3,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_USB {{(pid=75337) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 06 16:34:59 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 16:34:59 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 16:34:59 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Compute_service record updated for user:user {{(pid=75337) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 16:34:59 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.291s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:35:01 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:35:04 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:35:05 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:35:05 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Cleaning up deleted instances {{(pid=75337) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 06 16:35:05 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] There are 0 instances to clean {{(pid=75337) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 06 16:35:09 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:35:13 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:35:14 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:35:14 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:35:14 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Cleaning up deleted instances with incomplete migration  {{(pid=75337) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 06 16:35:19 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:35:24 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:35:28 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:35:29 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:35:29 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:35:29 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75337) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 16:35:29 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 16:35:29 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 16:35:29 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:35:34 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:35:35 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:35:39 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:35:39 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:35:39 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75337) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 16:35:40 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:35:44 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:35:46 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:35:46 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:35:48 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:35:49 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:35:50 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:35:54 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:35:54 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:35:54 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Starting heal instance info cache {{(pid=75337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 16:35:54 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Rebuilding the list of instances to heal {{(pid=75337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 06 16:35:54 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "refresh_cache-66334b94-6886-4b63-b5ee-53f9dc0b4be5" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 16:35:54 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquired lock "refresh_cache-66334b94-6886-4b63-b5ee-53f9dc0b4be5" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 16:35:54 user nova-compute[75337]: DEBUG nova.network.neutron [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] [instance: 66334b94-6886-4b63-b5ee-53f9dc0b4be5] Forcefully refreshing network info cache for instance {{(pid=75337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 16:35:54 user nova-compute[75337]: DEBUG nova.objects.instance [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lazy-loading 'info_cache' on Instance uuid 66334b94-6886-4b63-b5ee-53f9dc0b4be5 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 16:35:55 user nova-compute[75337]: DEBUG nova.network.neutron [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] [instance: 66334b94-6886-4b63-b5ee-53f9dc0b4be5] Updating instance_info_cache with network_info: [{"id": "657d9efb-b845-4171-8b31-82f1fb046e6c", "address": "fa:16:3e:22:59:b5", "network": {"id": "7c1dd053-8eb8-41fa-ba08-44cb8cb140e8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1069692825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4f7688d43824e26b29a15bd02d1588e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap657d9efb-b8", "ovs_interfaceid": "657d9efb-b845-4171-8b31-82f1fb046e6c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 16:35:55 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Releasing lock "refresh_cache-66334b94-6886-4b63-b5ee-53f9dc0b4be5" {{(pid=75337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 16:35:55 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] [instance: 66334b94-6886-4b63-b5ee-53f9dc0b4be5] Updated the network info_cache for instance {{(pid=75337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 16:35:58 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager.update_available_resource {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:35:58 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:35:58 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:35:58 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:35:58 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Auditing locally available compute resources for user (node: user) {{(pid=75337) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 16:35:58 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66334b94-6886-4b63-b5ee-53f9dc0b4be5/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:35:58 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66334b94-6886-4b63-b5ee-53f9dc0b4be5/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:35:58 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66334b94-6886-4b63-b5ee-53f9dc0b4be5/disk --force-share --output=json {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 16:35:59 user nova-compute[75337]: DEBUG oslo_concurrency.processutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66334b94-6886-4b63-b5ee-53f9dc0b4be5/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 16:35:59 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 16:35:59 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 16:35:59 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Hypervisor/Node resource view: name=user free_ram=8965MB free_disk=24.99114227294922GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75337) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 16:35:59 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:35:59 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:35:59 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:35:59 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Instance 66334b94-6886-4b63-b5ee-53f9dc0b4be5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 16:35:59 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 16:35:59 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 16:35:59 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 16:35:59 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 16:35:59 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Compute_service record updated for user:user {{(pid=75337) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 16:35:59 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.169s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:36:04 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:36:09 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:36:14 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:36:19 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:36:20 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-05045d24-6588-4cd1-892f-3c96779ee00e tempest-VolumesActionsTest-1016914342 tempest-VolumesActionsTest-1016914342-project-member] Acquiring lock "66334b94-6886-4b63-b5ee-53f9dc0b4be5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:36:20 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-05045d24-6588-4cd1-892f-3c96779ee00e tempest-VolumesActionsTest-1016914342 tempest-VolumesActionsTest-1016914342-project-member] Lock "66334b94-6886-4b63-b5ee-53f9dc0b4be5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:36:20 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-05045d24-6588-4cd1-892f-3c96779ee00e tempest-VolumesActionsTest-1016914342 tempest-VolumesActionsTest-1016914342-project-member] Acquiring lock "66334b94-6886-4b63-b5ee-53f9dc0b4be5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:36:20 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-05045d24-6588-4cd1-892f-3c96779ee00e tempest-VolumesActionsTest-1016914342 tempest-VolumesActionsTest-1016914342-project-member] Lock "66334b94-6886-4b63-b5ee-53f9dc0b4be5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:36:20 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-05045d24-6588-4cd1-892f-3c96779ee00e tempest-VolumesActionsTest-1016914342 tempest-VolumesActionsTest-1016914342-project-member] Lock "66334b94-6886-4b63-b5ee-53f9dc0b4be5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:36:20 user nova-compute[75337]: INFO nova.compute.manager [None req-05045d24-6588-4cd1-892f-3c96779ee00e tempest-VolumesActionsTest-1016914342 tempest-VolumesActionsTest-1016914342-project-member] [instance: 66334b94-6886-4b63-b5ee-53f9dc0b4be5] Terminating instance
Nov 06 16:36:20 user nova-compute[75337]: DEBUG nova.compute.manager [None req-05045d24-6588-4cd1-892f-3c96779ee00e tempest-VolumesActionsTest-1016914342 tempest-VolumesActionsTest-1016914342-project-member] [instance: 66334b94-6886-4b63-b5ee-53f9dc0b4be5] Start destroying the instance on the hypervisor. {{(pid=75337) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 16:36:20 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:36:20 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:36:20 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:36:20 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:36:20 user nova-compute[75337]: DEBUG nova.compute.manager [req-d9aa2720-3ce0-4c46-b257-ff2c81f0d042 req-9786b4bb-8a5a-4022-b438-16822a79db78 service nova] [instance: 66334b94-6886-4b63-b5ee-53f9dc0b4be5] Received event network-vif-unplugged-657d9efb-b845-4171-8b31-82f1fb046e6c {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:36:20 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-d9aa2720-3ce0-4c46-b257-ff2c81f0d042 req-9786b4bb-8a5a-4022-b438-16822a79db78 service nova] Acquiring lock "66334b94-6886-4b63-b5ee-53f9dc0b4be5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:36:20 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-d9aa2720-3ce0-4c46-b257-ff2c81f0d042 req-9786b4bb-8a5a-4022-b438-16822a79db78 service nova] Lock "66334b94-6886-4b63-b5ee-53f9dc0b4be5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:36:20 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-d9aa2720-3ce0-4c46-b257-ff2c81f0d042 req-9786b4bb-8a5a-4022-b438-16822a79db78 service nova] Lock "66334b94-6886-4b63-b5ee-53f9dc0b4be5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:36:20 user nova-compute[75337]: DEBUG nova.compute.manager [req-d9aa2720-3ce0-4c46-b257-ff2c81f0d042 req-9786b4bb-8a5a-4022-b438-16822a79db78 service nova] [instance: 66334b94-6886-4b63-b5ee-53f9dc0b4be5] No waiting events found dispatching network-vif-unplugged-657d9efb-b845-4171-8b31-82f1fb046e6c {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 16:36:20 user nova-compute[75337]: DEBUG nova.compute.manager [req-d9aa2720-3ce0-4c46-b257-ff2c81f0d042 req-9786b4bb-8a5a-4022-b438-16822a79db78 service nova] [instance: 66334b94-6886-4b63-b5ee-53f9dc0b4be5] Received event network-vif-unplugged-657d9efb-b845-4171-8b31-82f1fb046e6c for instance with task_state deleting. {{(pid=75337) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 16:36:20 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:36:20 user nova-compute[75337]: INFO nova.virt.libvirt.driver [-] [instance: 66334b94-6886-4b63-b5ee-53f9dc0b4be5] Instance destroyed successfully.
Nov 06 16:36:20 user nova-compute[75337]: DEBUG nova.objects.instance [None req-05045d24-6588-4cd1-892f-3c96779ee00e tempest-VolumesActionsTest-1016914342 tempest-VolumesActionsTest-1016914342-project-member] Lazy-loading 'resources' on Instance uuid 66334b94-6886-4b63-b5ee-53f9dc0b4be5 {{(pid=75337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 16:36:20 user nova-compute[75337]: DEBUG nova.virt.libvirt.vif [None req-05045d24-6588-4cd1-892f-3c96779ee00e tempest-VolumesActionsTest-1016914342 tempest-VolumesActionsTest-1016914342-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T16:34:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-2053072028',display_name='tempest-VolumesActionsTest-instance-2053072028',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-2053072028',id=52,image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-06T16:34:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e4f7688d43824e26b29a15bd02d1588e',ramdisk_id='',reservation_id='r-ky7625op',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='16b903ae-a40f-41a7-985b-4804cce92c62',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1016914342',owner_user_name='tempest-VolumesActionsTest-1016914342-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T16:34:18Z,user_data=None,user_id='f2f84bfd83db4cc3819c4299403b44fa',uuid=66334b94-6886-4b63-b5ee-53f9dc0b4be5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "657d9efb-b845-4171-8b31-82f1fb046e6c", "address": "fa:16:3e:22:59:b5", "network": {"id": "7c1dd053-8eb8-41fa-ba08-44cb8cb140e8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1069692825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4f7688d43824e26b29a15bd02d1588e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap657d9efb-b8", "ovs_interfaceid": "657d9efb-b845-4171-8b31-82f1fb046e6c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 16:36:20 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-05045d24-6588-4cd1-892f-3c96779ee00e tempest-VolumesActionsTest-1016914342 tempest-VolumesActionsTest-1016914342-project-member] Converting VIF {"id": "657d9efb-b845-4171-8b31-82f1fb046e6c", "address": "fa:16:3e:22:59:b5", "network": {"id": "7c1dd053-8eb8-41fa-ba08-44cb8cb140e8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1069692825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4f7688d43824e26b29a15bd02d1588e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap657d9efb-b8", "ovs_interfaceid": "657d9efb-b845-4171-8b31-82f1fb046e6c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 16:36:20 user nova-compute[75337]: DEBUG nova.network.os_vif_util [None req-05045d24-6588-4cd1-892f-3c96779ee00e tempest-VolumesActionsTest-1016914342 tempest-VolumesActionsTest-1016914342-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:22:59:b5,bridge_name='br-int',has_traffic_filtering=True,id=657d9efb-b845-4171-8b31-82f1fb046e6c,network=Network(7c1dd053-8eb8-41fa-ba08-44cb8cb140e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap657d9efb-b8') {{(pid=75337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 16:36:20 user nova-compute[75337]: DEBUG os_vif [None req-05045d24-6588-4cd1-892f-3c96779ee00e tempest-VolumesActionsTest-1016914342 tempest-VolumesActionsTest-1016914342-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:22:59:b5,bridge_name='br-int',has_traffic_filtering=True,id=657d9efb-b845-4171-8b31-82f1fb046e6c,network=Network(7c1dd053-8eb8-41fa-ba08-44cb8cb140e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap657d9efb-b8') {{(pid=75337) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 16:36:20 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:36:20 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap657d9efb-b8, bridge=br-int, if_exists=True) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 16:36:20 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:36:20 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:36:20 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:36:20 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0fb56687-6edc-4bc3-b003-952257cd17ed) {{(pid=75337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 16:36:20 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:36:20 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:36:20 user nova-compute[75337]: INFO os_vif [None req-05045d24-6588-4cd1-892f-3c96779ee00e tempest-VolumesActionsTest-1016914342 tempest-VolumesActionsTest-1016914342-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:22:59:b5,bridge_name='br-int',has_traffic_filtering=True,id=657d9efb-b845-4171-8b31-82f1fb046e6c,network=Network(7c1dd053-8eb8-41fa-ba08-44cb8cb140e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap657d9efb-b8')
Nov 06 16:36:20 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-05045d24-6588-4cd1-892f-3c96779ee00e tempest-VolumesActionsTest-1016914342 tempest-VolumesActionsTest-1016914342-project-member] [instance: 66334b94-6886-4b63-b5ee-53f9dc0b4be5] Deleting instance files /opt/stack/data/nova/instances/66334b94-6886-4b63-b5ee-53f9dc0b4be5_del
Nov 06 16:36:20 user nova-compute[75337]: INFO nova.virt.libvirt.driver [None req-05045d24-6588-4cd1-892f-3c96779ee00e tempest-VolumesActionsTest-1016914342 tempest-VolumesActionsTest-1016914342-project-member] [instance: 66334b94-6886-4b63-b5ee-53f9dc0b4be5] Deletion of /opt/stack/data/nova/instances/66334b94-6886-4b63-b5ee-53f9dc0b4be5_del complete
Nov 06 16:36:20 user nova-compute[75337]: INFO nova.compute.manager [None req-05045d24-6588-4cd1-892f-3c96779ee00e tempest-VolumesActionsTest-1016914342 tempest-VolumesActionsTest-1016914342-project-member] [instance: 66334b94-6886-4b63-b5ee-53f9dc0b4be5] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 06 16:36:20 user nova-compute[75337]: DEBUG oslo.service.loopingcall [None req-05045d24-6588-4cd1-892f-3c96779ee00e tempest-VolumesActionsTest-1016914342 tempest-VolumesActionsTest-1016914342-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75337) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 16:36:20 user nova-compute[75337]: DEBUG nova.compute.manager [-] [instance: 66334b94-6886-4b63-b5ee-53f9dc0b4be5] Deallocating network for instance {{(pid=75337) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 16:36:20 user nova-compute[75337]: DEBUG nova.network.neutron [-] [instance: 66334b94-6886-4b63-b5ee-53f9dc0b4be5] deallocate_for_instance() {{(pid=75337) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 16:36:21 user nova-compute[75337]: DEBUG nova.network.neutron [-] [instance: 66334b94-6886-4b63-b5ee-53f9dc0b4be5] Updating instance_info_cache with network_info: [] {{(pid=75337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 16:36:21 user nova-compute[75337]: INFO nova.compute.manager [-] [instance: 66334b94-6886-4b63-b5ee-53f9dc0b4be5] Took 0.44 seconds to deallocate network for instance.
Nov 06 16:36:21 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-05045d24-6588-4cd1-892f-3c96779ee00e tempest-VolumesActionsTest-1016914342 tempest-VolumesActionsTest-1016914342-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:36:21 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-05045d24-6588-4cd1-892f-3c96779ee00e tempest-VolumesActionsTest-1016914342 tempest-VolumesActionsTest-1016914342-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:36:21 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-05045d24-6588-4cd1-892f-3c96779ee00e tempest-VolumesActionsTest-1016914342 tempest-VolumesActionsTest-1016914342-project-member] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 16:36:21 user nova-compute[75337]: DEBUG nova.compute.manager [req-846e3ac3-2a1a-41b8-bce5-5e4ec7589f54 req-26ed0694-9b11-47a9-89cd-2fac9d97563b service nova] [instance: 66334b94-6886-4b63-b5ee-53f9dc0b4be5] Received event network-vif-deleted-657d9efb-b845-4171-8b31-82f1fb046e6c {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:36:21 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-05045d24-6588-4cd1-892f-3c96779ee00e tempest-VolumesActionsTest-1016914342 tempest-VolumesActionsTest-1016914342-project-member] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 16:36:21 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-05045d24-6588-4cd1-892f-3c96779ee00e tempest-VolumesActionsTest-1016914342 tempest-VolumesActionsTest-1016914342-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.114s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:36:21 user nova-compute[75337]: INFO nova.scheduler.client.report [None req-05045d24-6588-4cd1-892f-3c96779ee00e tempest-VolumesActionsTest-1016914342 tempest-VolumesActionsTest-1016914342-project-member] Deleted allocations for instance 66334b94-6886-4b63-b5ee-53f9dc0b4be5
Nov 06 16:36:21 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-05045d24-6588-4cd1-892f-3c96779ee00e tempest-VolumesActionsTest-1016914342 tempest-VolumesActionsTest-1016914342-project-member] Lock "66334b94-6886-4b63-b5ee-53f9dc0b4be5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.686s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:36:22 user nova-compute[75337]: DEBUG nova.compute.manager [req-debc4fb2-553e-4feb-b0a6-b03660f0fcb0 req-16afd762-16dd-4b04-b47f-1d4c83039a84 service nova] [instance: 66334b94-6886-4b63-b5ee-53f9dc0b4be5] Received event network-vif-plugged-657d9efb-b845-4171-8b31-82f1fb046e6c {{(pid=75337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 16:36:22 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-debc4fb2-553e-4feb-b0a6-b03660f0fcb0 req-16afd762-16dd-4b04-b47f-1d4c83039a84 service nova] Acquiring lock "66334b94-6886-4b63-b5ee-53f9dc0b4be5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:36:22 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-debc4fb2-553e-4feb-b0a6-b03660f0fcb0 req-16afd762-16dd-4b04-b47f-1d4c83039a84 service nova] Lock "66334b94-6886-4b63-b5ee-53f9dc0b4be5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:36:22 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [req-debc4fb2-553e-4feb-b0a6-b03660f0fcb0 req-16afd762-16dd-4b04-b47f-1d4c83039a84 service nova] Lock "66334b94-6886-4b63-b5ee-53f9dc0b4be5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:36:22 user nova-compute[75337]: DEBUG nova.compute.manager [req-debc4fb2-553e-4feb-b0a6-b03660f0fcb0 req-16afd762-16dd-4b04-b47f-1d4c83039a84 service nova] [instance: 66334b94-6886-4b63-b5ee-53f9dc0b4be5] No waiting events found dispatching network-vif-plugged-657d9efb-b845-4171-8b31-82f1fb046e6c {{(pid=75337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 16:36:22 user nova-compute[75337]: WARNING nova.compute.manager [req-debc4fb2-553e-4feb-b0a6-b03660f0fcb0 req-16afd762-16dd-4b04-b47f-1d4c83039a84 service nova] [instance: 66334b94-6886-4b63-b5ee-53f9dc0b4be5] Received unexpected event network-vif-plugged-657d9efb-b845-4171-8b31-82f1fb046e6c for instance with vm_state deleted and task_state None.
Nov 06 16:36:25 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:36:28 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._sync_power_states {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:36:30 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:36:35 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:36:37 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:36:40 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:36:40 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:36:40 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75337) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 16:36:40 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:36:40 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:36:40 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75337) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 16:36:40 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 16:36:40 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 16:36:40 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:36:45 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:36:46 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:36:48 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:36:49 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:36:50 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:36:52 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:36:55 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:36:55 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Starting heal instance info cache {{(pid=75337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 16:36:55 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Rebuilding the list of instances to heal {{(pid=75337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 06 16:36:55 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Didn't find any instances for network info cache update. {{(pid=75337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 06 16:36:55 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:36:58 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager.update_available_resource {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:36:58 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:36:58 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:36:58 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:36:58 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Auditing locally available compute resources for user (node: user) {{(pid=75337) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 16:36:58 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 16:36:58 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 16:36:58 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Hypervisor/Node resource view: name=user free_ram=9100MB free_disk=25.018131256103516GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75337) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 16:36:58 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:36:58 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:36:59 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 16:36:59 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 16:36:59 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 16:36:59 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 16:36:59 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Compute_service record updated for user:user {{(pid=75337) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 16:36:59 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.240s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:37:00 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:37:02 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:37:05 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:37:10 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:37:15 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:37:20 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:37:25 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:37:30 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:37:35 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:37:38 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:37:40 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:37:40 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:37:42 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:37:42 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75337) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 16:37:45 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:37:48 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:37:50 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:37:50 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:37:50 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:37:54 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:37:55 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:37:55 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:37:55 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75337) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 16:37:55 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 16:37:55 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 16:37:55 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:37:56 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:37:56 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Starting heal instance info cache {{(pid=75337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 16:37:56 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Rebuilding the list of instances to heal {{(pid=75337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 06 16:37:56 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Didn't find any instances for network info cache update. {{(pid=75337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 06 16:38:00 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager.update_available_resource {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:38:00 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:38:00 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:38:00 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:38:00 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Auditing locally available compute resources for user (node: user) {{(pid=75337) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 16:38:01 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:38:01 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 16:38:01 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 16:38:01 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Hypervisor/Node resource view: name=user free_ram=9098MB free_disk=25.01675796508789GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75337) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 16:38:01 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:38:01 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:38:01 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 16:38:01 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 16:38:01 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 16:38:01 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 16:38:01 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Compute_service record updated for user:user {{(pid=75337) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 16:38:01 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.126s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:38:06 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:38:06 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:38:06 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75337) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 16:38:06 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 16:38:06 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 16:38:06 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:38:11 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:38:16 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:38:16 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:38:16 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75337) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 16:38:16 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 16:38:16 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 16:38:16 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:38:21 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:38:26 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:38:31 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:38:34 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:38:36 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:38:36 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:38:39 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:38:40 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:38:41 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:38:41 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:38:42 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:38:42 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75337) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 16:38:46 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:38:46 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:38:46 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75337) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 16:38:46 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 16:38:46 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 16:38:46 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:38:50 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:38:50 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:38:51 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:38:51 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:38:55 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:38:56 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:38:58 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:38:58 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Starting heal instance info cache {{(pid=75337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 16:38:58 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Rebuilding the list of instances to heal {{(pid=75337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 06 16:38:58 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Didn't find any instances for network info cache update. {{(pid=75337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 06 16:39:01 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:39:01 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:39:01 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75337) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 16:39:01 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 16:39:01 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 16:39:01 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:39:01 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager.update_available_resource {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:39:01 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:39:01 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:39:01 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:39:01 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Auditing locally available compute resources for user (node: user) {{(pid=75337) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 16:39:01 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 16:39:01 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 16:39:01 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Hypervisor/Node resource view: name=user free_ram=9086MB free_disk=25.01517105102539GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75337) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 16:39:01 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:39:01 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:39:01 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 16:39:01 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 16:39:02 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 16:39:02 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 16:39:02 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Compute_service record updated for user:user {{(pid=75337) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 16:39:02 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.103s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:39:03 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:39:06 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:39:11 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:39:16 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:39:16 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:39:16 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75337) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 16:39:16 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 16:39:16 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 16:39:16 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:39:21 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:39:26 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:39:31 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:39:36 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:39:40 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:39:41 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:39:43 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:39:44 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:39:44 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75337) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 16:39:46 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:39:50 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:39:51 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:39:51 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:39:51 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75337) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 16:39:51 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 16:39:51 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 16:39:51 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:39:51 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:39:53 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:39:56 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:39:57 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:39:58 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:39:58 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Starting heal instance info cache {{(pid=75337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 16:39:58 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Rebuilding the list of instances to heal {{(pid=75337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 06 16:39:58 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Didn't find any instances for network info cache update. {{(pid=75337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 06 16:40:01 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:40:01 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager.update_available_resource {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:40:01 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:40:01 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:40:01 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:40:01 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Auditing locally available compute resources for user (node: user) {{(pid=75337) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 16:40:01 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 16:40:01 user nova-compute[75337]: WARNING nova.virt.libvirt.driver [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 16:40:01 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Hypervisor/Node resource view: name=user free_ram=9090MB free_disk=24.998489379882812GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75337) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 16:40:01 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 16:40:01 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 16:40:01 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 16:40:01 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 16:40:01 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Refreshing inventories for resource provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 06 16:40:02 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Updating ProviderTree inventory for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 06 16:40:02 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Updating inventory in ProviderTree for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 06 16:40:02 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Refreshing aggregate associations for resource provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7, aggregates: None {{(pid=75337) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 06 16:40:02 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Refreshing trait associations for resource provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7, traits: COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NODE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_IDE,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSSE3,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_USB {{(pid=75337) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 06 16:40:02 user nova-compute[75337]: DEBUG nova.compute.provider_tree [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Inventory has not changed in ProviderTree for provider: 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 {{(pid=75337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 16:40:02 user nova-compute[75337]: DEBUG nova.scheduler.client.report [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Inventory has not changed for provider 4d91090a-92e5-4a8b-957b-2c8ad80bd8f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 16:40:02 user nova-compute[75337]: DEBUG nova.compute.resource_tracker [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Compute_service record updated for user:user {{(pid=75337) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 16:40:02 user nova-compute[75337]: DEBUG oslo_concurrency.lockutils [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.223s {{(pid=75337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 16:40:03 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:40:06 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:40:08 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:40:08 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Cleaning up deleted instances {{(pid=75337) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 06 16:40:08 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] There are 0 instances to clean {{(pid=75337) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 06 16:40:11 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:40:16 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:40:21 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:40:23 user nova-compute[75337]: DEBUG oslo_service.periodic_task [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 16:40:23 user nova-compute[75337]: DEBUG nova.compute.manager [None req-97d5fa8d-bca4-42b7-804f-5ce92321025f None None] Cleaning up deleted instances with incomplete migration  {{(pid=75337) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 06 16:40:26 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 16:40:26 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 16:40:26 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75337) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 16:40:26 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 16:40:26 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 16:40:26 user nova-compute[75337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}